2024-09-06T14:27:36.183 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-06T14:27:36.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-06T14:27:36.306 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365 branch: wip-athakkar-testing-2024-09-04-1837 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: adking@redhat.com first_in_suite: false job_id: '7892365' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-athakkar-testing-2024-09-04-1837 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-04-1837 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 owner: scheduled_adking@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9103 sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 sleep_before_teardown: 0 subset: 1/20 suite: orch:cephadm suite_branch: wip-athakkar-testing-2024-09-04-1837 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIEeozXj893uJKrnNPx3uvI5GMyyrB5nNP6YMPKC8jkHWbASjSuOgbii7HAPJjivsyXKNPKhku1p4MwlNG7jDqU= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfUudTkwuuUWGwHZ6segZF1TvrquYP2OwVG6vd2Y3qKV8QY21EPAOgcQ4PsanzE8MKWQYvTWcGozpMglU3iECU= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-06_13:43:09 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: adking verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-06T14:27:36.306 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa; will attempt to use it 2024-09-06T14:27:36.307 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks 2024-09-06T14:27:36.307 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-06T14:27:36.309 INFO:teuthology.task.internal:Checking packages... 2024-09-06T14:27:36.332 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73' 2024-09-06T14:27:36.332 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:27:36.332 INFO:teuthology.packaging:ref: None 2024-09-06T14:27:36.332 INFO:teuthology.packaging:tag: None 2024-09-06T14:27:36.332 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-04-1837 2024-09-06T14:27:36.332 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:27:36.332 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-athakkar-testing-2024-09-04-1837 2024-09-06T14:27:36.483 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4704.g8b38c33c 2024-09-06T14:27:36.484 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-06T14:27:36.492 INFO:teuthology.task.internal:no buildpackages task found 2024-09-06T14:27:36.492 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-06T14:27:36.498 INFO:teuthology.task.internal:Saving configuration 2024-09-06T14:27:36.518 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-06T14:27:36.526 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-06T14:27:36.557 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-06 14:22:31.753343', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIEeozXj893uJKrnNPx3uvI5GMyyrB5nNP6YMPKC8jkHWbASjSuOgbii7HAPJjivsyXKNPKhku1p4MwlNG7jDqU='} 2024-09-06T14:27:36.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-06 14:22:31.754338', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEfUudTkwuuUWGwHZ6segZF1TvrquYP2OwVG6vd2Y3qKV8QY21EPAOgcQ4PsanzE8MKWQYvTWcGozpMglU3iECU='} 2024-09-06T14:27:36.584 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-06T14:27:36.593 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-06T14:27:36.593 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-06T14:27:36.593 INFO:teuthology.run_tasks:Running task console_log... 2024-09-06T14:27:36.663 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f38c3fd3ac0>, signals=[15]) 2024-09-06T14:27:36.663 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-06T14:27:36.669 INFO:teuthology.task.internal:Opening connections... 2024-09-06T14:27:36.670 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:27:36.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:27:36.756 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-06T14:27:36.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:27:36.841 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-06T14:27:36.847 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-06T14:27:36.865 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-06T14:27:36.866 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-06T14:27:36.924 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-09-06T14:27:36.925 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-09-06T14:27:36.925 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-06T14:27:36.925 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-09-06T14:27:36.925 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-06T14:27:36.925 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-06T14:27:36.925 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-06T14:27:36.926 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-06T14:27:36.958 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-06T14:27:36.976 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-06T14:27:36.976 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-06T14:27:37.034 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-09-06T14:27:37.034 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-09-06T14:27:37.034 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-06T14:27:37.035 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-06T14:27:37.036 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-06T14:27:37.066 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-06T14:27:37.075 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-06T14:27:37.086 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-06T14:27:37.086 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-06T14:27:37.088 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-06T14:27:37.105 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-06T14:27:37.112 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-06T14:27:37.112 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-06T14:27:37.146 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-06T14:27:37.250 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-06T14:27:37.308 INFO:teuthology.run_tasks:Running task kernel... 2024-09-06T14:27:37.323 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-06T14:27:37.323 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-06T14:27:37.323 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-06T14:27:37.323 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-06T14:27:37.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:27:37.341 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-06T14:27:37.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:27:37.342 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-06T14:27:37.400 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-503.el9.x86_64 2024-09-06T14:27:37.400 INFO:teuthology.orchestra.run.smithi052.stdout:5.14.0-503.el9.x86_64 2024-09-06T14:27:37.400 INFO:teuthology.task.kernel:Running kernel on smithi165: 5.14.0-503.el9.x86_64 2024-09-06T14:27:37.401 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum install -y kernel 2024-09-06T14:27:37.401 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.14.0-503.el9.x86_64 2024-09-06T14:27:37.401 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum install -y kernel 2024-09-06T14:27:41.296 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-09-06T14:27:41.534 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-06T14:27:43.280 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-06T14:27:48.348 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.5 MB 00:01 2024-09-06T14:27:50.607 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-06T14:27:51.961 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-06T14:27:57.600 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-06T14:27:59.349 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-09-06T14:27:59.673 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-06T14:27:59.674 INFO:teuthology.orchestra.run.smithi052.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-06T14:27:59.756 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:27:59.757 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:27:59.757 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:27:59.861 DEBUG:teuthology.orchestra.run.smithi052:> echo no | sudo yum reinstall kernel || true 2024-09-06T14:28:00.456 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Sep 2024 02:27:57 PM UTC. 2024-09-06T14:28:00.607 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:28:00.619 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:28:00.619 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-06T14:28:00.619 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:28:00.619 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-09-06T14:28:00.619 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-06T14:28:00.619 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:28:00.620 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:28:00.620 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:28:00.620 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:28:00.620 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 1.9 M 2024-09-06T14:28:00.620 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-09-06T14:28:00.620 INFO:teuthology.orchestra.run.smithi052.stderr:Operation aborted. 2024-09-06T14:28:00.679 INFO:teuthology.orchestra.run.smithi052.stdout:Is this ok [y/N]: 2024-09-06T14:28:00.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum reinstall -y kernel || true 2024-09-06T14:28:01.228 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:04 ago on Fri 06 Sep 2024 02:27:57 PM UTC. 2024-09-06T14:28:01.360 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalling: 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 1.9 M 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 0 2024-09-06T14:28:01.361 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:28:01.710 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-503.el9.x86_64.rpm 6.5 MB/s | 1.9 MB 00:00 2024-09-06T14:28:01.710 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:28:01.710 INFO:teuthology.orchestra.run.smithi052.stdout:Total 5.4 MB/s | 1.9 MB 00:00 2024-09-06T14:28:01.740 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:28:01.991 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:28:01.991 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:28:02.023 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:28:02.024 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:28:02.202 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:28:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-06T14:28:02.271 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-06T14:28:02.964 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-06T14:28:02.964 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-06T14:28:03.656 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-06T14:28:03.656 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:28:03.656 INFO:teuthology.orchestra.run.smithi052.stdout:Reinstalled: 2024-09-06T14:28:03.656 INFO:teuthology.orchestra.run.smithi052.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-06T14:28:03.656 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:28:03.656 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:28:03.851 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q kernel | sort -rV | head -n 1 2024-09-06T14:28:03.909 INFO:teuthology.orchestra.run.smithi052.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-06T14:28:03.910 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-06T14:28:03.910 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-06T14:28:03.910 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-06T14:28:03.910 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-06T14:28:03.944 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-09-06T14:28:03.965 DEBUG:teuthology.parallel:result is None 2024-09-06T14:28:05.216 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-06T14:28:06.658 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-06T14:28:07.820 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-06T14:28:13.226 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-06T14:28:15.241 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-06T14:28:15.241 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-06T14:28:15.313 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:28:15.315 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:28:15.315 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:28:15.425 DEBUG:teuthology.orchestra.run.smithi165:> echo no | sudo yum reinstall kernel || true 2024-09-06T14:28:15.971 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Sep 2024 02:28:13 PM UTC. 2024-09-06T14:28:16.116 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout:Reinstalling: 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:28:16.128 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:28:16.129 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 1.9 M 2024-09-06T14:28:16.129 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 0 2024-09-06T14:28:16.129 INFO:teuthology.orchestra.run.smithi165.stderr:Operation aborted. 2024-09-06T14:28:16.187 INFO:teuthology.orchestra.run.smithi165.stdout:Is this ok [y/N]: 2024-09-06T14:28:16.188 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum reinstall -y kernel || true 2024-09-06T14:28:16.733 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Sep 2024 02:28:13 PM UTC. 2024-09-06T14:28:16.860 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:28:16.861 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout:Reinstalling: 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 1.9 M 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 0 2024-09-06T14:28:16.862 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:28:17.561 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-503.el9.x86_64.rpm 4.2 MB/s | 1.9 MB 00:00 2024-09-06T14:28:17.562 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:28:17.562 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.7 MB/s | 1.9 MB 00:00 2024-09-06T14:28:17.594 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:28:17.864 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:28:17.864 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:28:17.895 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:28:17.895 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:28:18.056 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:28:18.130 INFO:teuthology.orchestra.run.smithi165.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-06T14:28:18.130 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-06T14:28:18.847 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-09-06T14:28:18.848 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-09-06T14:28:19.544 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-09-06T14:28:19.544 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:28:19.544 INFO:teuthology.orchestra.run.smithi165.stdout:Reinstalled: 2024-09-06T14:28:19.544 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-5.14.0-503.el9.x86_64 2024-09-06T14:28:19.545 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:28:19.545 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:28:19.766 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-09-06T14:28:19.825 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-503.el9.x86_64 2024-09-06T14:28:19.825 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-09-06T14:28:19.825 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-09-06T14:28:19.825 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-06T14:28:19.826 DEBUG:teuthology.orchestra.run.smithi165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-06T14:28:19.869 INFO:teuthology.orchestra.run.smithi165.stdout:ttyS1 2024-09-06T14:28:19.886 DEBUG:teuthology.parallel:result is None 2024-09-06T14:28:19.886 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-06T14:28:19.894 INFO:teuthology.task.internal:Creating test directory... 2024-09-06T14:28:19.894 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-06T14:28:19.897 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-06T14:28:19.941 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-06T14:28:19.951 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-06T14:28:19.961 INFO:teuthology.task.internal:Creating archive directory... 2024-09-06T14:28:19.961 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-06T14:28:19.963 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-06T14:28:20.009 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-06T14:28:20.016 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-06T14:28:20.016 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-06T14:28:20.033 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-06T14:28:20.073 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:28:20.084 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:28:20.141 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:28:20.150 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-06T14:28:20.152 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-06T14:28:20.159 INFO:teuthology.task.internal:Configuring sudo... 2024-09-06T14:28:20.159 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-06T14:28:20.162 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-06T14:28:20.187 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-06T14:28:20.196 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-06T14:28:20.196 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-06T14:28:20.230 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-06T14:28:20.245 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-06T14:28:20.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-06T14:28:20.378 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-06T14:28:20.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-06T14:28:20.502 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:28:20.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-06T14:28:20.567 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-06T14:28:20.648 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-06T14:28:20.677 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-06T14:28:20.767 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-06T14:28:20.801 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:28:20.801 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-06T14:28:20.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-06T14:28:20.869 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-06T14:28:20.904 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-06T14:28:20.954 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-06T14:28:21.413 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-06T14:28:21.421 INFO:teuthology.task.internal:Starting timer... 2024-09-06T14:28:21.421 INFO:teuthology.run_tasks:Running task pcp... 2024-09-06T14:28:21.432 INFO:teuthology.run_tasks:Running task selinux... 2024-09-06T14:28:21.440 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-06T14:28:21.440 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-09-06T14:28:21.506 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-09-06T14:28:21.507 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-09-06T14:28:21.546 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-09-06T14:28:21.548 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-06T14:28:21.549 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-09-06T14:28:21.570 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-09-06T14:28:21.571 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-09-06T14:28:21.610 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-09-06T14:28:21.611 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2024-09-06T14:28:21.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-06T14:28:21.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:28:21.638 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-06T14:28:21.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:28:21.677 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-06T14:28:21.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-09-06T14:28:21.714 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-09-06T14:28:21.757 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-06T14:28:21.767 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-06T14:28:21.769 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-06T14:28:21.900 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-06T14:28:21.910 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-06T14:28:21.911 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-06T14:32:00.714 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-09-06T14:32:00.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-06T14:32:00.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:32:00.805 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-06T14:32:00.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-06T14:32:00.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-06T14:32:00.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-06T14:32:00.980 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-06T14:32:01.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-06T14:32:01.065 INFO:teuthology.run_tasks:Running task clock... 2024-09-06T14:32:01.074 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-06T14:32:01.074 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-06T14:32:01.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T14:32:01.077 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-06T14:32:01.078 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T14:32:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-06T14:32:01.121 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-06T14:32:01.135 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-06T14:32:01.147 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-09-06T14:32:01.149 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-06T14:32:01.158 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-09-06T14:32:01.173 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-06T14:32:01.174 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-09-06T14:32:01.185 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-09-06T14:32:01.186 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-06T14:32:01.199 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-06T14:32:01.213 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-06T14:32:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-06T14:32:01.251 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-06T14:32:01.251 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-06T14:32:01.251 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.251 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.252 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.252 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.270 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-06T14:32:01.274 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-06T14:32:01.275 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-06T14:32:01.275 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.275 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.275 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.275 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T14:32:01.275 INFO:teuthology.run_tasks:Running task install... 2024-09-06T14:32:01.283 DEBUG:teuthology.task.install:project ceph 2024-09-06T14:32:01.283 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'}} 2024-09-06T14:32:01.283 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'} 2024-09-06T14:32:01.283 INFO:teuthology.task.install:Using flavor: default 2024-09-06T14:32:01.289 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-06T14:32:01.289 INFO:teuthology.task.install:extra packages: [] 2024-09-06T14:32:01.290 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'tag': None, 'wait_for_package': False} 2024-09-06T14:32:01.290 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:32:01.290 INFO:teuthology.packaging:ref: None 2024-09-06T14:32:01.290 INFO:teuthology.packaging:tag: None 2024-09-06T14:32:01.290 INFO:teuthology.packaging:branch: squid 2024-09-06T14:32:01.290 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:32:01.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-06T14:32:01.292 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'tag': None, 'wait_for_package': False} 2024-09-06T14:32:01.293 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:32:01.293 INFO:teuthology.packaging:ref: None 2024-09-06T14:32:01.293 INFO:teuthology.packaging:tag: None 2024-09-06T14:32:01.293 INFO:teuthology.packaging:branch: squid 2024-09-06T14:32:01.293 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:32:01.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-06T14:32:01.520 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/ 2024-09-06T14:32:01.521 INFO:teuthology.task.install.rpm:Package version is 19.1.1-268.g635ed4cf 2024-09-06T14:32:01.536 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/ 2024-09-06T14:32:01.537 INFO:teuthology.task.install.rpm:Package version is 19.1.1-268.g635ed4cf 2024-09-06T14:32:01.644 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-06T14:32:01.645 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:32:01.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-06T14:32:01.653 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-06T14:32:01.654 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:32:01.654 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-06T14:32:01.672 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-06T14:32:01.672 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:32:01.672 INFO:teuthology.packaging:ref: None 2024-09-06T14:32:01.673 INFO:teuthology.packaging:tag: None 2024-09-06T14:32:01.673 INFO:teuthology.packaging:branch: squid 2024-09-06T14:32:01.673 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:32:01.673 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-06T14:32:01.679 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-06T14:32:01.679 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:32:01.680 INFO:teuthology.packaging:ref: None 2024-09-06T14:32:01.680 INFO:teuthology.packaging:tag: None 2024-09-06T14:32:01.680 INFO:teuthology.packaging:branch: squid 2024-09-06T14:32:01.680 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:32:01.680 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-06T14:32:01.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-06T14:32:01.746 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-06T14:32:01.817 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-06T14:32:01.821 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-06T14:32:01.881 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-09-06T14:32:01.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-09-06T14:32:01.886 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-09-06T14:32:01.887 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-09-06T14:32:02.113 INFO:teuthology.orchestra.run.smithi165.stdout:45 files removed 2024-09-06T14:32:02.115 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-09-06T14:32:02.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw 2024-09-06T14:32:02.142 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw 2024-09-06T14:32:02.680 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 312 kB/s | 83 kB 00:00 2024-09-06T14:32:02.682 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 322 kB/s | 83 kB 00:00 2024-09-06T14:32:02.949 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 53 kB/s | 12 kB 00:00 2024-09-06T14:32:02.964 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-06T14:32:03.216 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-06T14:32:03.231 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-06T14:32:04.116 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.2 MB 00:00 2024-09-06T14:32:04.832 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-06T14:32:07.201 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-06T14:32:09.416 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 20 MB 00:03 2024-09-06T14:32:11.893 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-06T14:32:13.378 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 19 kB 00:00 2024-09-06T14:32:14.498 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-06T14:32:16.150 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:02 2024-09-06T14:32:17.800 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-06T14:32:19.121 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-06T14:32:20.162 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-06T14:32:22.540 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 11 M 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 3.4 M 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 3.2 M 2024-09-06T14:32:22.543 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 5.4 M 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 21 M 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 25 k 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 751 k 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-06T14:32:22.544 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 506 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 5.3 M 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 45 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 136 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 162 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 321 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 301 k 2024-09-06T14:32:22.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 99 k 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout:Install 30 Packages 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 2 Packages 2024-09-06T14:32:22.546 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:22.547 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 60 M 2024-09-06T14:32:22.547 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:32:23.047 INFO:teuthology.orchestra.run.smithi052.stdout:(1/32): ceph-base-19.1.1-268.g635ed4cf.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-06T14:32:23.097 INFO:teuthology.orchestra.run.smithi052.stdout:(2/32): ceph-selinux-19.1.1-268.g635ed4cf.el9.x 503 kB/s | 25 kB 00:00 2024-09-06T14:32:23.189 INFO:teuthology.orchestra.run.smithi052.stdout:(3/32): libcephfs2-19.1.1-268.g635ed4cf.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-06T14:32:23.281 INFO:teuthology.orchestra.run.smithi052.stdout:(4/32): libradosstriper1-19.1.1-268.g635ed4cf.e 5.4 MB/s | 506 kB 00:00 2024-09-06T14:32:23.606 INFO:teuthology.orchestra.run.smithi052.stdout:(5/32): ceph-radosgw-19.1.1-268.g635ed4cf.el9.x 11 MB/s | 11 MB 00:00 2024-09-06T14:32:23.690 INFO:teuthology.orchestra.run.smithi052.stdout:(6/32): librgw2-19.1.1-268.g635ed4cf.el9.x86_64 13 MB/s | 5.3 MB 00:00 2024-09-06T14:32:23.715 INFO:teuthology.orchestra.run.smithi052.stdout:(7/32): python3-ceph-argparse-19.1.1-268.g635ed 416 kB/s | 45 kB 00:00 2024-09-06T14:32:23.740 INFO:teuthology.orchestra.run.smithi052.stdout:(8/32): python3-ceph-common-19.1.1-268.g635ed4c 2.6 MB/s | 136 kB 00:00 2024-09-06T14:32:23.780 INFO:teuthology.orchestra.run.smithi052.stdout:(9/32): python3-cephfs-19.1.1-268.g635ed4cf.el9 2.5 MB/s | 162 kB 00:00 2024-09-06T14:32:23.816 INFO:teuthology.orchestra.run.smithi052.stdout:(10/32): python3-rados-19.1.1-268.g635ed4cf.el9 4.2 MB/s | 321 kB 00:00 2024-09-06T14:32:23.841 INFO:teuthology.orchestra.run.smithi052.stdout:(11/32): python3-rbd-19.1.1-268.g635ed4cf.el9.x 4.8 MB/s | 301 kB 00:00 2024-09-06T14:32:23.883 INFO:teuthology.orchestra.run.smithi052.stdout:(12/32): python3-rgw-19.1.1-268.g635ed4cf.el9.x 1.5 MB/s | 99 kB 00:00 2024-09-06T14:32:24.083 INFO:teuthology.orchestra.run.smithi052.stdout:(13/32): ceph-common-19.1.1-268.g635ed4cf.el9.x 14 MB/s | 21 MB 00:01 2024-09-06T14:32:24.133 INFO:teuthology.orchestra.run.smithi052.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 366 kB/s | 107 kB 00:00 2024-09-06T14:32:24.184 INFO:teuthology.orchestra.run.smithi052.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-09-06T14:32:24.209 INFO:teuthology.orchestra.run.smithi052.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 491 kB/s | 160 kB 00:00 2024-09-06T14:32:24.243 INFO:teuthology.orchestra.run.smithi052.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-06T14:32:24.285 INFO:teuthology.orchestra.run.smithi052.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-06T14:32:24.301 INFO:teuthology.orchestra.run.smithi052.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 460 kB/s | 42 kB 00:00 2024-09-06T14:32:24.327 INFO:teuthology.orchestra.run.smithi052.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-06T14:32:24.369 INFO:teuthology.orchestra.run.smithi052.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 707 kB/s | 47 kB 00:00 2024-09-06T14:32:24.386 INFO:teuthology.orchestra.run.smithi052.stdout:(22/32): qatlib-service-24.02.0-1.el9.x86_64.rp 356 kB/s | 36 kB 00:00 2024-09-06T14:32:24.419 INFO:teuthology.orchestra.run.smithi052.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.3 MB/s | 309 kB 00:00 2024-09-06T14:32:24.444 INFO:teuthology.orchestra.run.smithi052.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 3.2 MB/s | 49 kB 00:00 2024-09-06T14:32:24.470 INFO:teuthology.orchestra.run.smithi052.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 342 kB/s | 26 kB 00:00 2024-09-06T14:32:24.495 INFO:teuthology.orchestra.run.smithi052.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-06T14:32:24.527 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-09-06T14:32:24.537 INFO:teuthology.orchestra.run.smithi052.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-06T14:32:24.595 INFO:teuthology.orchestra.run.smithi052.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-06T14:32:24.721 INFO:teuthology.orchestra.run.smithi052.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-09-06T14:32:24.779 INFO:teuthology.orchestra.run.smithi052.stdout:(30/32): librados2-19.1.1-268.g635ed4cf.el9.x86 19 MB/s | 3.4 MB 00:00 2024-09-06T14:32:24.846 INFO:teuthology.orchestra.run.smithi052.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-09-06T14:32:24.938 INFO:teuthology.orchestra.run.smithi052.stdout:(32/32): librbd1-19.1.1-268.g635ed4cf.el9.x86_6 15 MB/s | 3.2 MB 00:00 2024-09-06T14:32:24.943 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:32:24.943 INFO:teuthology.orchestra.run.smithi052.stdout:Total 25 MB/s | 60 MB 00:02 2024-09-06T14:32:25.044 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:32:25.082 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:32:25.083 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:32:25.575 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:32:25.577 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:32:26.862 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 11 M 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 3.4 M 2024-09-06T14:32:26.864 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 3.2 M 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 5.4 M 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 21 M 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 25 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 751 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-06T14:32:26.865 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 506 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 5.3 M 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 45 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 136 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 162 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 321 k 2024-09-06T14:32:26.866 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 301 k 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 99 k 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:32:26.867 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:32:26.868 INFO:teuthology.orchestra.run.smithi165.stdout:Install 30 Packages 2024-09-06T14:32:26.868 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 2 Packages 2024-09-06T14:32:26.868 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:26.868 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 60 M 2024-09-06T14:32:26.868 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:32:27.070 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:32:27.156 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-06T14:32:27.184 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-06T14:32:27.209 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-06T14:32:27.232 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-06T14:32:27.257 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-06T14:32:27.451 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-06T14:32:27.527 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-06T14:32:27.562 INFO:teuthology.orchestra.run.smithi165.stdout:(1/32): ceph-base-19.1.1-268.g635ed4cf.el9.x86_ 11 MB/s | 5.4 MB 00:00 2024-09-06T14:32:27.620 INFO:teuthology.orchestra.run.smithi165.stdout:(2/32): ceph-selinux-19.1.1-268.g635ed4cf.el9.x 433 kB/s | 25 kB 00:00 2024-09-06T14:32:27.712 INFO:teuthology.orchestra.run.smithi165.stdout:(3/32): libcephfs2-19.1.1-268.g635ed4cf.el9.x86 8.0 MB/s | 751 kB 00:00 2024-09-06T14:32:27.846 INFO:teuthology.orchestra.run.smithi165.stdout:(4/32): ceph-radosgw-19.1.1-268.g635ed4cf.el9.x 14 MB/s | 11 MB 00:00 2024-09-06T14:32:27.880 INFO:teuthology.orchestra.run.smithi165.stdout:(5/32): libradosstriper1-19.1.1-268.g635ed4cf.e 3.0 MB/s | 506 kB 00:00 2024-09-06T14:32:27.923 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-06T14:32:27.938 INFO:teuthology.orchestra.run.smithi165.stdout:(6/32): python3-ceph-argparse-19.1.1-268.g635ed 776 kB/s | 45 kB 00:00 2024-09-06T14:32:27.986 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 7/34 2024-09-06T14:32:28.079 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 7/34 2024-09-06T14:32:28.089 INFO:teuthology.orchestra.run.smithi165.stdout:(7/32): librgw2-19.1.1-268.g635ed4cf.el9.x86_64 22 MB/s | 5.3 MB 00:00 2024-09-06T14:32:28.114 INFO:teuthology.orchestra.run.smithi165.stdout:(8/32): python3-ceph-common-19.1.1-268.g635ed4c 774 kB/s | 136 kB 00:00 2024-09-06T14:32:28.139 INFO:teuthology.orchestra.run.smithi165.stdout:(9/32): python3-cephfs-19.1.1-268.g635ed4cf.el9 3.2 MB/s | 162 kB 00:00 2024-09-06T14:32:28.164 INFO:teuthology.orchestra.run.smithi165.stdout:(10/32): python3-rados-19.1.1-268.g635ed4cf.el9 6.2 MB/s | 321 kB 00:00 2024-09-06T14:32:28.169 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 8/34 2024-09-06T14:32:28.190 INFO:teuthology.orchestra.run.smithi165.stdout:(11/32): python3-rbd-19.1.1-268.g635ed4cf.el9.x 5.8 MB/s | 301 kB 00:00 2024-09-06T14:32:28.204 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 9/34 2024-09-06T14:32:28.215 INFO:teuthology.orchestra.run.smithi165.stdout:(12/32): python3-rgw-19.1.1-268.g635ed4cf.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-06T14:32:28.267 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 9/34 2024-09-06T14:32:28.296 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-06T14:32:28.340 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.1.1-268.g635ed4cf.el9.x 11/34 2024-09-06T14:32:28.410 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 12/34 2024-09-06T14:32:28.432 INFO:teuthology.orchestra.run.smithi165.stdout:(13/32): ceph-common-19.1.1-268.g635ed4cf.el9.x 16 MB/s | 21 MB 00:01 2024-09-06T14:32:28.439 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 13/34 2024-09-06T14:32:28.465 INFO:teuthology.orchestra.run.smithi165.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 388 kB/s | 107 kB 00:00 2024-09-06T14:32:28.499 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 13/34 2024-09-06T14:32:28.524 INFO:teuthology.orchestra.run.smithi165.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-06T14:32:28.532 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-06T14:32:28.575 INFO:teuthology.orchestra.run.smithi165.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 446 kB/s | 160 kB 00:00 2024-09-06T14:32:28.633 INFO:teuthology.orchestra.run.smithi165.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-06T14:32:28.640 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-06T14:32:28.650 INFO:teuthology.orchestra.run.smithi165.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 561 kB/s | 42 kB 00:00 2024-09-06T14:32:28.672 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-06T14:32:28.684 INFO:teuthology.orchestra.run.smithi165.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-06T14:32:28.712 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-06T14:32:28.717 INFO:teuthology.orchestra.run.smithi165.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-06T14:32:28.734 INFO:teuthology.orchestra.run.smithi165.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 429 kB/s | 36 kB 00:00 2024-09-06T14:32:28.737 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-06T14:32:28.767 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-06T14:32:28.768 INFO:teuthology.orchestra.run.smithi165.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 564 kB/s | 47 kB 00:00 2024-09-06T14:32:28.799 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-06T14:32:28.810 INFO:teuthology.orchestra.run.smithi165.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 3.3 MB/s | 309 kB 00:00 2024-09-06T14:32:28.827 INFO:teuthology.orchestra.run.smithi165.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 3.1 MB/s | 49 kB 00:00 2024-09-06T14:32:28.852 INFO:teuthology.orchestra.run.smithi165.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 316 kB/s | 26 kB 00:00 2024-09-06T14:32:28.878 INFO:teuthology.orchestra.run.smithi165.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-06T14:32:28.911 INFO:teuthology.orchestra.run.smithi165.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-06T14:32:28.970 INFO:teuthology.orchestra.run.smithi165.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-06T14:32:29.070 INFO:teuthology.orchestra.run.smithi165.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-06T14:32:29.127 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-06T14:32:29.146 INFO:teuthology.orchestra.run.smithi165.stdout:(30/32): librados2-19.1.1-268.g635ed4cf.el9.x86 20 MB/s | 3.4 MB 00:00 2024-09-06T14:32:29.171 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 22/34 2024-09-06T14:32:29.229 INFO:teuthology.orchestra.run.smithi165.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-06T14:32:29.252 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 22/34 2024-09-06T14:32:29.282 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 23/34 2024-09-06T14:32:29.304 INFO:teuthology.orchestra.run.smithi165.stdout:(32/32): librbd1-19.1.1-268.g635ed4cf.el9.x86_6 14 MB/s | 3.2 MB 00:00 2024-09-06T14:32:29.309 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:32:29.309 INFO:teuthology.orchestra.run.smithi165.stdout:Total 25 MB/s | 60 MB 00:02 2024-09-06T14:32:29.318 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-06T14:32:29.413 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:32:29.457 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:32:29.458 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:32:29.826 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-06T14:32:29.855 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 26/34 2024-09-06T14:32:29.922 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:32:29.923 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:32:29.926 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 26/34 2024-09-06T14:32:30.006 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 27/34 2024-09-06T14:32:30.032 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.1.1-268.g635ed4cf.el9.x86 28/34 2024-09-06T14:32:31.389 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:32:31.488 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-06T14:32:31.517 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-06T14:32:31.551 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-06T14:32:31.582 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-06T14:32:31.605 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-06T14:32:31.806 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-06T14:32:31.859 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-06T14:32:32.198 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-06T14:32:32.300 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 7/34 2024-09-06T14:32:32.392 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 7/34 2024-09-06T14:32:32.458 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 29/34 2024-09-06T14:32:32.482 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 8/34 2024-09-06T14:32:32.509 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 9/34 2024-09-06T14:32:32.545 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 29/34 2024-09-06T14:32:32.585 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 9/34 2024-09-06T14:32:32.618 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-06T14:32:32.669 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.1.1-268.g635ed4cf.el9.x 11/34 2024-09-06T14:32:32.748 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 12/34 2024-09-06T14:32:32.770 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 13/34 2024-09-06T14:32:32.835 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 13/34 2024-09-06T14:32:32.869 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-06T14:32:32.979 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-06T14:32:33.020 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-06T14:32:33.060 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-06T14:32:33.085 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-09-06T14:32:33.114 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-06T14:32:33.120 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 29/34 2024-09-06T14:32:33.147 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-06T14:32:33.157 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 30/34 2024-09-06T14:32:33.237 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 30/34 2024-09-06T14:32:33.238 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-06T14:32:33.238 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-06T14:32:33.238 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:33.275 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 31/34 2024-09-06T14:32:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-06T14:32:33.527 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 22/34 2024-09-06T14:32:33.618 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 22/34 2024-09-06T14:32:33.649 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 23/34 2024-09-06T14:32:33.684 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-06T14:32:34.169 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-06T14:32:34.197 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 26/34 2024-09-06T14:32:34.268 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 26/34 2024-09-06T14:32:34.356 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 27/34 2024-09-06T14:32:34.417 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.1.1-268.g635ed4cf.el9.x86 28/34 2024-09-06T14:32:36.733 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 29/34 2024-09-06T14:32:36.830 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 29/34 2024-09-06T14:32:37.382 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 29/34 2024-09-06T14:32:37.425 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 30/34 2024-09-06T14:32:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 30/34 2024-09-06T14:32:37.517 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-06T14:32:37.517 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-06T14:32:37.517 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:37.551 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 31/34 2024-09-06T14:32:43.658 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 31/34 2024-09-06T14:32:43.658 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-09-06T14:32:43.658 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-09-06T14:32:43.658 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-09-06T14:32:43.658 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-09-06T14:32:43.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-09-06T14:32:43.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-09-06T14:32:43.659 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-09-06T14:32:43.659 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:44.674 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 32/34 2024-09-06T14:32:44.698 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 32/34 2024-09-06T14:32:44.698 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:32:44.698 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-06T14:32:44.698 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-06T14:32:44.698 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-06T14:32:44.699 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:44.700 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-06T14:32:44.784 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-06T14:32:44.784 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-06T14:32:45.926 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 1/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 2/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 3/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 4/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 5/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 6/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 7/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.1.1-268.g635ed4cf.el9.x 8/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.1.1-268.g635ed4cf.el9.x86 9/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 10/34 2024-09-06T14:32:45.927 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 11/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 12/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 13/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-06T14:32:45.928 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-06T14:32:45.929 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-06T14:32:45.929 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-06T14:32:45.929 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-06T14:32:45.929 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-06T14:32:45.929 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-06T14:32:45.930 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-06T14:32:45.930 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 31/34 2024-09-06T14:32:45.930 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-06T14:32:45.930 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 33/34 2024-09-06T14:32:47.286 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-06T14:32:47.286 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:47.286 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-09-06T14:32:47.286 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-06T14:32:47.287 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-20.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:47.289 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:32:47.400 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 31/34 2024-09-06T14:32:47.400 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-09-06T14:32:47.400 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-09-06T14:32:47.400 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-09-06T14:32:47.400 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-09-06T14:32:47.400 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-09-06T14:32:47.401 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-09-06T14:32:47.401 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-09-06T14:32:47.401 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:47.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-test 2024-09-06T14:32:48.200 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:28 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:32:48.338 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:32:48.338 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:48.338 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 49 M 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 163 k 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout:Install 4 Packages 2024-09-06T14:32:48.339 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:48.340 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 49 M 2024-09-06T14:32:48.340 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 209 M 2024-09-06T14:32:48.340 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:32:48.403 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 32/34 2024-09-06T14:32:48.430 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 32/34 2024-09-06T14:32:48.430 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:32:48.430 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-06T14:32:48.430 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-06T14:32:48.430 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-06T14:32:48.431 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:48.432 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-06T14:32:48.522 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-06T14:32:48.522 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-06T14:32:48.822 INFO:teuthology.orchestra.run.smithi052.stdout:(1/4): libcephsqlite-19.1.1-268.g635ed4cf.el9.x 771 kB/s | 163 kB 00:00 2024-09-06T14:32:48.880 INFO:teuthology.orchestra.run.smithi052.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-09-06T14:32:49.014 INFO:teuthology.orchestra.run.smithi052.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 332 kB/s | 64 kB 00:00 2024-09-06T14:32:49.706 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 1/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 2/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 3/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 4/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 5/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 6/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 7/34 2024-09-06T14:32:49.707 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.1.1-268.g635ed4cf.el9.x 8/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.1.1-268.g635ed4cf.el9.x86 9/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 10/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 11/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 12/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 13/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-06T14:32:49.708 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-06T14:32:49.709 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-06T14:32:49.710 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-06T14:32:49.710 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-06T14:32:49.710 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-06T14:32:49.711 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 31/34 2024-09-06T14:32:49.711 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-06T14:32:49.711 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 33/34 2024-09-06T14:32:50.156 INFO:teuthology.orchestra.run.smithi052.stdout:(4/4): ceph-test-19.1.1-268.g635ed4cf.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-06T14:32:50.158 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:32:50.158 INFO:teuthology.orchestra.run.smithi052.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-06T14:32:50.185 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:32:50.208 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:32:50.208 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:32:50.595 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:32:50.595 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:32:50.814 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-06T14:32:50.814 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:50.814 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-09-06T14:32:50.814 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.814 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-06T14:32:50.815 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-06T14:32:50.816 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:50.817 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-06T14:32:50.818 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-06T14:32:50.818 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-06T14:32:50.818 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-20.el9.x86_64 2024-09-06T14:32:50.818 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-06T14:32:50.818 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:50.818 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:32:51.144 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:32:51.189 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-test 2024-09-06T14:32:51.215 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-06T14:32:51.255 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-06T14:32:51.282 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 3/4 2024-09-06T14:32:51.748 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:27 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:32:51.878 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:32:51.879 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:32:51.879 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:32:51.879 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:32:51.879 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:32:51.879 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 49 M 2024-09-06T14:32:51.879 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:32:51.879 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 163 k 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout:Install 4 Packages 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:32:51.880 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 49 M 2024-09-06T14:32:51.881 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 209 M 2024-09-06T14:32:51.881 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:32:52.132 INFO:teuthology.orchestra.run.smithi165.stdout:(1/4): libcephsqlite-19.1.1-268.g635ed4cf.el9.x 715 kB/s | 163 kB 00:00 2024-09-06T14:32:52.474 INFO:teuthology.orchestra.run.smithi165.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 186 kB/s | 64 kB 00:00 2024-09-06T14:32:52.524 INFO:teuthology.orchestra.run.smithi165.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 490 kB/s | 304 kB 00:00 2024-09-06T14:32:53.451 INFO:teuthology.orchestra.run.smithi165.stdout:(4/4): ceph-test-19.1.1-268.g635ed4cf.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-06T14:32:53.453 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:32:53.453 INFO:teuthology.orchestra.run.smithi165.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-06T14:32:53.481 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:32:53.501 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:32:53.501 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:32:53.872 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:32:53.872 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:32:54.392 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:32:54.475 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-06T14:32:54.524 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-06T14:32:54.551 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 3/4 2024-09-06T14:32:56.114 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 3/4 2024-09-06T14:32:56.201 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 4/4 2024-09-06T14:32:58.535 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 4/4 2024-09-06T14:32:58.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 1/4 2024-09-06T14:32:58.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 2/4 2024-09-06T14:32:58.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-06T14:32:58.828 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-06T14:32:58.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:58.828 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:32:58.828 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:58.829 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:32:58.829 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-06T14:32:58.829 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-06T14:32:58.829 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:58.829 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:32:59.079 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph 2024-09-06T14:32:59.102 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 3/4 2024-09-06T14:32:59.190 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 4/4 2024-09-06T14:32:59.667 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:39 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:32:59.810 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 6.5 k 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 2.4 M 2024-09-06T14:32:59.813 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 1.5 M 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 249 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 4.7 M 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 17 M 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-06T14:32:59.814 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-06T14:32:59.815 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout:Install 37 Packages 2024-09-06T14:32:59.816 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:32:59.817 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 30 M 2024-09-06T14:32:59.817 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 108 M 2024-09-06T14:32:59.817 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:00.251 INFO:teuthology.orchestra.run.smithi052.stdout:(1/37): ceph-19.1.1-268.g635ed4cf.el9.x86_64.rp 53 kB/s | 6.5 kB 00:00 2024-09-06T14:33:00.426 INFO:teuthology.orchestra.run.smithi052.stdout:(2/37): ceph-mgr-19.1.1-268.g635ed4cf.el9.x86_6 5.1 MB/s | 1.5 MB 00:00 2024-09-06T14:33:00.493 INFO:teuthology.orchestra.run.smithi052.stdout:(3/37): ceph-mds-19.1.1-268.g635ed4cf.el9.x86_6 6.5 MB/s | 2.4 MB 00:00 2024-09-06T14:33:00.585 INFO:teuthology.orchestra.run.smithi052.stdout:(4/37): ceph-mon-19.1.1-268.g635ed4cf.el9.x86_6 14 MB/s | 4.7 MB 00:00 2024-09-06T14:33:00.618 INFO:teuthology.orchestra.run.smithi052.stdout:(5/37): ceph-mgr-modules-core-19.1.1-268.g635ed 1.9 MB/s | 249 kB 00:00 2024-09-06T14:33:00.785 INFO:teuthology.orchestra.run.smithi052.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-06T14:33:00.836 INFO:teuthology.orchestra.run.smithi052.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-06T14:33:00.994 INFO:teuthology.orchestra.run.smithi052.stdout:(8/37): ceph-osd-19.1.1-268.g635ed4cf.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-06T14:33:01.019 INFO:teuthology.orchestra.run.smithi052.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 737 kB/s | 135 kB 00:00 2024-09-06T14:33:01.062 INFO:teuthology.orchestra.run.smithi052.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2024-09-06T14:33:01.103 INFO:teuthology.orchestra.run.smithi052.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-06T14:33:01.204 INFO:teuthology.orchestra.run.smithi052.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 598 kB/s | 125 kB 00:00 2024-09-06T14:33:01.229 INFO:teuthology.orchestra.run.smithi052.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-06T14:33:01.254 INFO:teuthology.orchestra.run.smithi052.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-06T14:33:01.296 INFO:teuthology.orchestra.run.smithi052.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.1 MB/s | 77 kB 00:00 2024-09-06T14:33:01.328 INFO:teuthology.orchestra.run.smithi052.stdout:(16/37): python3-markupsafe-1.1.1-12.el9.x86_64 279 kB/s | 35 kB 00:00 2024-09-06T14:33:01.354 INFO:teuthology.orchestra.run.smithi052.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 514 kB/s | 51 kB 00:00 2024-09-06T14:33:01.379 INFO:teuthology.orchestra.run.smithi052.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 505 kB/s | 42 kB 00:00 2024-09-06T14:33:01.404 INFO:teuthology.orchestra.run.smithi052.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 295 kB/s | 22 kB 00:00 2024-09-06T14:33:01.463 INFO:teuthology.orchestra.run.smithi052.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-06T14:33:01.488 INFO:teuthology.orchestra.run.smithi052.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 399 kB/s | 43 kB 00:00 2024-09-06T14:33:01.513 INFO:teuthology.orchestra.run.smithi052.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-09-06T14:33:01.538 INFO:teuthology.orchestra.run.smithi052.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 713 kB/s | 18 kB 00:00 2024-09-06T14:33:01.556 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 4/4 2024-09-06T14:33:01.556 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 1/4 2024-09-06T14:33:01.557 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 2/4 2024-09-06T14:33:01.557 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-06T14:33:01.564 INFO:teuthology.orchestra.run.smithi052.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-06T14:33:01.589 INFO:teuthology.orchestra.run.smithi052.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-06T14:33:01.614 INFO:teuthology.orchestra.run.smithi052.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-06T14:33:01.640 INFO:teuthology.orchestra.run.smithi052.stdout:(27/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-09-06T14:33:01.665 INFO:teuthology.orchestra.run.smithi052.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-09-06T14:33:01.690 INFO:teuthology.orchestra.run.smithi052.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 613 kB/s | 46 kB 00:00 2024-09-06T14:33:01.715 INFO:teuthology.orchestra.run.smithi052.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-06T14:33:01.741 INFO:teuthology.orchestra.run.smithi052.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-06T14:33:01.766 INFO:teuthology.orchestra.run.smithi052.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-06T14:33:01.791 INFO:teuthology.orchestra.run.smithi052.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 715 kB/s | 36 kB 00:00 2024-09-06T14:33:01.816 INFO:teuthology.orchestra.run.smithi052.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-06T14:33:01.842 INFO:teuthology.orchestra.run.smithi052.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-06T14:33:01.867 INFO:teuthology.orchestra.run.smithi052.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-09-06T14:33:01.892 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-06T14:33:01.892 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:01.892 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:01.892 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:01.893 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:01.893 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-06T14:33:01.893 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-06T14:33:01.893 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:01.893 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:01.893 INFO:teuthology.orchestra.run.smithi052.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-06T14:33:01.897 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:01.897 INFO:teuthology.orchestra.run.smithi052.stdout:Total 15 MB/s | 30 MB 00:02 2024-09-06T14:33:02.050 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:02.093 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:02.093 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:02.205 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph 2024-09-06T14:33:02.405 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:02.406 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:02.784 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:38 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:02.928 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:02.930 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 6.5 k 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 2.4 M 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 1.5 M 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 249 k 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 4.7 M 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 17 M 2024-09-06T14:33:02.931 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-06T14:33:02.932 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-06T14:33:02.933 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout:Install 37 Packages 2024-09-06T14:33:02.934 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:02.935 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 30 M 2024-09-06T14:33:02.935 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 108 M 2024-09-06T14:33:02.935 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:03.408 INFO:teuthology.orchestra.run.smithi165.stdout:(1/37): ceph-19.1.1-268.g635ed4cf.el9.x86_64.rp 49 kB/s | 6.5 kB 00:00 2024-09-06T14:33:03.567 INFO:teuthology.orchestra.run.smithi165.stdout:(2/37): ceph-mgr-19.1.1-268.g635ed4cf.el9.x86_6 5.2 MB/s | 1.5 MB 00:00 2024-09-06T14:33:03.617 INFO:teuthology.orchestra.run.smithi165.stdout:(3/37): ceph-mds-19.1.1-268.g635ed4cf.el9.x86_6 7.0 MB/s | 2.4 MB 00:00 2024-09-06T14:33:03.718 INFO:teuthology.orchestra.run.smithi165.stdout:(4/37): ceph-mgr-modules-core-19.1.1-268.g635ed 2.4 MB/s | 249 kB 00:00 2024-09-06T14:33:03.793 INFO:teuthology.orchestra.run.smithi165.stdout:(5/37): ceph-mon-19.1.1-268.g635ed4cf.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-06T14:33:03.903 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:03.978 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-06T14:33:04.012 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-06T14:33:04.047 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-06T14:33:04.121 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-06T14:33:04.135 INFO:teuthology.orchestra.run.smithi165.stdout:(6/37): ceph-osd-19.1.1-268.g635ed4cf.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-06T14:33:04.160 INFO:teuthology.orchestra.run.smithi165.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 572 kB/s | 253 kB 00:00 2024-09-06T14:33:04.171 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-06T14:33:04.204 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-06T14:33:04.219 INFO:teuthology.orchestra.run.smithi165.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-09-06T14:33:04.261 INFO:teuthology.orchestra.run.smithi165.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 2.6 MB/s | 1.2 MB 00:00 2024-09-06T14:33:04.286 INFO:teuthology.orchestra.run.smithi165.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.8 MB/s | 125 kB 00:00 2024-09-06T14:33:04.299 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-06T14:33:04.320 INFO:teuthology.orchestra.run.smithi165.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.5 MB/s | 215 kB 00:00 2024-09-06T14:33:04.345 INFO:teuthology.orchestra.run.smithi165.stdout:(12/37): python3-ply-3.11-14.el9.noarch.rpm 507 kB/s | 106 kB 00:00 2024-09-06T14:33:04.384 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-06T14:33:04.412 INFO:teuthology.orchestra.run.smithi165.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 523 kB/s | 35 kB 00:00 2024-09-06T14:33:04.432 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-06T14:33:04.437 INFO:teuthology.orchestra.run.smithi165.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-06T14:33:04.467 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-06T14:33:04.471 INFO:teuthology.orchestra.run.smithi165.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-06T14:33:04.497 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-06T14:33:04.497 INFO:teuthology.orchestra.run.smithi165.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 978 kB/s | 172 kB 00:00 2024-09-06T14:33:04.522 INFO:teuthology.orchestra.run.smithi165.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 606 kB/s | 51 kB 00:00 2024-09-06T14:33:04.531 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-06T14:33:04.547 INFO:teuthology.orchestra.run.smithi165.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 550 kB/s | 42 kB 00:00 2024-09-06T14:33:04.564 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-06T14:33:04.572 INFO:teuthology.orchestra.run.smithi165.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-09-06T14:33:04.605 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-06T14:33:04.631 INFO:teuthology.orchestra.run.smithi165.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 522 kB/s | 43 kB 00:00 2024-09-06T14:33:04.648 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-06T14:33:04.665 INFO:teuthology.orchestra.run.smithi165.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-06T14:33:04.683 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-06T14:33:04.690 INFO:teuthology.orchestra.run.smithi165.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-06T14:33:04.715 INFO:teuthology.orchestra.run.smithi165.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-09-06T14:33:04.732 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-06T14:33:04.740 INFO:teuthology.orchestra.run.smithi165.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-06T14:33:04.766 INFO:teuthology.orchestra.run.smithi165.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 459 kB/s | 23 kB 00:00 2024-09-06T14:33:04.771 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-06T14:33:04.808 INFO:teuthology.orchestra.run.smithi165.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 289 kB/s | 19 kB 00:00 2024-09-06T14:33:04.833 INFO:teuthology.orchestra.run.smithi165.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 294 kB/s | 20 kB 00:00 2024-09-06T14:33:04.847 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-06T14:33:04.858 INFO:teuthology.orchestra.run.smithi165.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 919 kB/s | 46 kB 00:00 2024-09-06T14:33:04.884 INFO:teuthology.orchestra.run.smithi165.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-06T14:33:04.918 INFO:teuthology.orchestra.run.smithi165.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-06T14:33:04.943 INFO:teuthology.orchestra.run.smithi165.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 279 kB/s | 16 kB 00:00 2024-09-06T14:33:04.968 INFO:teuthology.orchestra.run.smithi165.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-06T14:33:04.993 INFO:teuthology.orchestra.run.smithi165.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-06T14:33:05.019 INFO:teuthology.orchestra.run.smithi165.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-06T14:33:05.044 INFO:teuthology.orchestra.run.smithi165.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-06T14:33:05.077 INFO:teuthology.orchestra.run.smithi165.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-06T14:33:05.111 INFO:teuthology.orchestra.run.smithi165.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-06T14:33:05.115 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:05.115 INFO:teuthology.orchestra.run.smithi165.stdout:Total 14 MB/s | 30 MB 00:02 2024-09-06T14:33:05.133 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-06T14:33:05.228 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-06T14:33:05.262 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:05.303 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:05.303 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:05.409 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-06T14:33:05.446 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-06T14:33:05.504 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-06T14:33:05.576 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-06T14:33:05.603 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:05.604 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:05.777 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-06T14:33:05.825 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-06T14:33:05.905 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-06T14:33:05.994 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-06T14:33:06.032 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-06T14:33:06.153 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-06T14:33:06.327 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-268.g635ed4cf.el9.n 32/37 2024-09-06T14:33:06.358 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 33/37 2024-09-06T14:33:06.385 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 33/37 2024-09-06T14:33:06.385 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:06.385 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-06T14:33:06.385 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-06T14:33:06.385 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-06T14:33:06.385 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:06.998 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:07.065 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-06T14:33:07.097 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-06T14:33:07.133 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-06T14:33:07.206 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-06T14:33:07.249 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-06T14:33:07.282 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-06T14:33:07.383 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-06T14:33:07.461 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-06T14:33:07.502 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-06T14:33:07.536 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-06T14:33:07.567 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-06T14:33:07.610 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-06T14:33:07.643 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-06T14:33:07.684 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-06T14:33:07.727 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-06T14:33:07.761 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-06T14:33:07.810 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-06T14:33:07.842 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-06T14:33:07.909 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 34/37 2024-09-06T14:33:07.916 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-06T14:33:07.937 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 34/37 2024-09-06T14:33:07.937 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:07.937 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-06T14:33:07.938 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-06T14:33:07.938 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-06T14:33:07.938 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:08.055 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-06T14:33:08.143 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-06T14:33:08.212 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-06T14:33:08.251 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-06T14:33:08.308 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-06T14:33:08.364 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-06T14:33:08.395 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 35/37 2024-09-06T14:33:08.419 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 35/37 2024-09-06T14:33:08.419 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:08.419 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-06T14:33:08.420 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-06T14:33:08.420 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-06T14:33:08.420 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:08.554 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-06T14:33:08.605 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-06T14:33:08.654 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 36/37 2024-09-06T14:33:08.678 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 36/37 2024-09-06T14:33:08.678 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:08.678 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-06T14:33:08.679 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-06T14:33:08.679 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-06T14:33:08.679 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:08.701 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-06T14:33:08.761 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 37/37 2024-09-06T14:33:08.798 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-06T14:33:08.847 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-06T14:33:08.972 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-06T14:33:09.126 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-268.g635ed4cf.el9.n 32/37 2024-09-06T14:33:09.165 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 33/37 2024-09-06T14:33:09.192 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 33/37 2024-09-06T14:33:09.192 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:09.192 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-06T14:33:09.192 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-06T14:33:09.192 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-06T14:33:09.192 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:10.432 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 37/37 2024-09-06T14:33:10.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 1/37 2024-09-06T14:33:10.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 2/37 2024-09-06T14:33:10.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 3/37 2024-09-06T14:33:10.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 4/37 2024-09-06T14:33:10.433 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 5/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-268.g635ed4cf.el9.n 6/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-06T14:33:10.434 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-06T14:33:10.435 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-06T14:33:10.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-06T14:33:10.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-06T14:33:10.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-06T14:33:10.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-06T14:33:10.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-06T14:33:10.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-06T14:33:10.436 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-06T14:33:10.641 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 34/37 2024-09-06T14:33:10.669 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 34/37 2024-09-06T14:33:10.669 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:10.669 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-06T14:33:10.669 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-06T14:33:10.670 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-06T14:33:10.670 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:11.117 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 35/37 2024-09-06T14:33:11.141 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 35/37 2024-09-06T14:33:11.141 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:11.141 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-06T14:33:11.141 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-06T14:33:11.142 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-06T14:33:11.142 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:11.368 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 36/37 2024-09-06T14:33:11.392 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 36/37 2024-09-06T14:33:11.392 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:11.392 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-06T14:33:11.392 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-06T14:33:11.392 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-06T14:33:11.392 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:11.455 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 37/37 2024-09-06T14:33:11.467 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-06T14:33:11.467 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:11.467 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:11.467 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:11.467 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:11.467 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-06T14:33:11.468 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-09-06T14:33:11.469 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:11.470 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:11.830 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-base 2024-09-06T14:33:12.398 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:52 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:12.491 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:12.535 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:12.536 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:33:12.536 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:12.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install cephadm 2024-09-06T14:33:13.169 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:53 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:13.306 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:13.306 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:13.306 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 765 k 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 765 k 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 771 k 2024-09-06T14:33:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:13.337 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 37/37 2024-09-06T14:33:13.337 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 1/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 2/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 3/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 4/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 5/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-268.g635ed4cf.el9.n 6/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-06T14:33:13.338 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-06T14:33:13.339 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-06T14:33:13.340 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-06T14:33:13.340 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-06T14:33:13.340 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-06T14:33:13.341 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-06T14:33:13.560 INFO:teuthology.orchestra.run.smithi052.stdout:cephadm-19.1.1-268.g635ed4cf.el9.noarch.rpm 3.0 MB/s | 765 kB 00:00 2024-09-06T14:33:13.561 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:13.561 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-06T14:33:13.561 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:13.567 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:13.567 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:13.573 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:13.573 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:13.649 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:14.132 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:14.207 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-09-06T14:33:14.362 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-06T14:33:14.363 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-06T14:33:14.364 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-06T14:33:14.365 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-06T14:33:14.365 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-06T14:33:14.365 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-06T14:33:14.365 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:14.365 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:14.562 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:14.731 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-base 2024-09-06T14:33:14.779 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:14.779 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:14.780 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:14.780 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:14.780 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:14.780 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:15.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-immutable-object-cache 2024-09-06T14:33:15.287 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:51 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:15.376 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-base-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:15.418 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:15.419 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:15.419 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:15.498 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install cephadm 2024-09-06T14:33:15.591 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:55 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:15.730 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:15.730 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:15.730 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 145 k 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 145 k 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 435 k 2024-09-06T14:33:15.731 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:15.932 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-immutable-object-cache-19.1.1-268.g635ed4c 723 kB/s | 145 kB 00:00 2024-09-06T14:33:15.933 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:15.934 INFO:teuthology.orchestra.run.smithi052.stdout:Total 717 kB/s | 145 kB 00:00 2024-09-06T14:33:15.934 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:15.941 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:15.942 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:16.001 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:16.001 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:16.052 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:52 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:16.155 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:16.183 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:16.184 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:16.184 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:33:16.184 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 765 k 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 765 k 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 771 k 2024-09-06T14:33:16.185 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:16.225 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.e 1/1 2024-09-06T14:33:16.249 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.e 1/1 2024-09-06T14:33:16.250 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:16.250 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-06T14:33:16.250 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:16.443 INFO:teuthology.orchestra.run.smithi165.stdout:cephadm-19.1.1-268.g635ed4cf.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-06T14:33:16.444 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:16.444 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-06T14:33:16.444 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:16.449 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:16.449 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:16.455 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:16.455 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:16.552 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:17.013 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:17.096 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:17.113 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.e 1/1 2024-09-06T14:33:17.113 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:17.113 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:17.113 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:17.113 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:17.113 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:17.376 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr 2024-09-06T14:33:17.444 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:17.684 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/1 2024-09-06T14:33:17.685 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:17.685 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:17.685 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:17.685 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:17.685 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:17.897 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-immutable-object-cache 2024-09-06T14:33:17.943 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:57 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:18.034 INFO:teuthology.orchestra.run.smithi052.stdout:Package ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:18.079 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:18.080 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:33:18.080 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:18.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-dashboard 2024-09-06T14:33:18.460 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:54 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:18.592 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:18.593 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:18.593 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 145 k 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 145 k 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 435 k 2024-09-06T14:33:18.594 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:18.716 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:00:58 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:18.809 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-immutable-object-cache-19.1.1-268.g635ed4c 677 kB/s | 145 kB 00:00 2024-09-06T14:33:18.809 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:18.810 INFO:teuthology.orchestra.run.smithi165.stdout:Total 672 kB/s | 145 kB 00:00 2024-09-06T14:33:18.810 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:18.817 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:18.817 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:18.851 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 3.6 M 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 32 k 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 16 k 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-06T14:33:18.853 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout:Install 12 Packages 2024-09-06T14:33:18.854 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:18.855 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 8.7 M 2024-09-06T14:33:18.855 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 104 M 2024-09-06T14:33:18.855 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:18.875 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:18.875 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:19.023 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:19.118 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.e 1/1 2024-09-06T14:33:19.143 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.e 1/1 2024-09-06T14:33:19.144 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:33:19.144 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-06T14:33:19.144 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:19.702 INFO:teuthology.orchestra.run.smithi052.stdout:(1/12): ceph-grafana-dashboards-19.1.1-268.g635 214 kB/s | 32 kB 00:00 2024-09-06T14:33:19.727 INFO:teuthology.orchestra.run.smithi052.stdout:(2/12): ceph-prometheus-alerts-19.1.1-268.g635e 95 kB/s | 16 kB 00:00 2024-09-06T14:33:19.861 INFO:teuthology.orchestra.run.smithi052.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-06T14:33:19.969 INFO:teuthology.orchestra.run.smithi052.stdout:(4/12): ceph-mgr-dashboard-19.1.1-268.g635ed4cf 8.6 MB/s | 3.6 MB 00:00 2024-09-06T14:33:20.003 INFO:teuthology.orchestra.run.smithi052.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2024-09-06T14:33:20.062 INFO:teuthology.orchestra.run.smithi052.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-06T14:33:20.066 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.e 1/1 2024-09-06T14:33:20.067 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:20.067 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:20.067 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:20.067 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:20.067 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:20.096 INFO:teuthology.orchestra.run.smithi052.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.3 MB/s | 548 kB 00:00 2024-09-06T14:33:20.129 INFO:teuthology.orchestra.run.smithi052.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.1 MB/s | 863 kB 00:00 2024-09-06T14:33:20.154 INFO:teuthology.orchestra.run.smithi052.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-06T14:33:20.179 INFO:teuthology.orchestra.run.smithi052.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 613 kB/s | 31 kB 00:00 2024-09-06T14:33:20.205 INFO:teuthology.orchestra.run.smithi052.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.8 MB/s | 188 kB 00:00 2024-09-06T14:33:20.263 INFO:teuthology.orchestra.run.smithi052.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 10 MB/s | 2.0 MB 00:00 2024-09-06T14:33:20.268 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:20.268 INFO:teuthology.orchestra.run.smithi052.stdout:Total 6.1 MB/s | 8.7 MB 00:01 2024-09-06T14:33:20.320 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:20.338 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr 2024-09-06T14:33:20.339 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:20.339 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:20.506 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:20.506 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:20.904 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:56 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:20.996 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-mgr-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:21.042 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:21.043 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:21.043 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:21.046 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:21.108 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-dashboard 2024-09-06T14:33:21.123 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-06T14:33:21.158 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-06T14:33:21.206 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-06T14:33:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-06T14:33:21.314 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-06T14:33:21.449 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-06T14:33:21.542 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-06T14:33:21.599 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-06T14:33:21.625 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-06T14:33:21.658 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-268.g635ed4cf.el9. 10/12 2024-09-06T14:33:21.660 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:57 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:21.792 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 3.6 M 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 32 k 2024-09-06T14:33:21.793 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 16 k 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:21.794 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-09-06T14:33:21.795 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:21.795 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 8.7 M 2024-09-06T14:33:21.795 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 104 M 2024-09-06T14:33:21.795 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:22.164 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): ceph-prometheus-alerts-19.1.1-268.g635e 101 kB/s | 16 kB 00:00 2024-09-06T14:33:22.189 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): ceph-grafana-dashboards-19.1.1-268.g635 169 kB/s | 32 kB 00:00 2024-09-06T14:33:22.306 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-06T14:33:22.365 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): ceph-mgr-dashboard-19.1.1-268.g635ed4cf 9.8 MB/s | 3.6 MB 00:00 2024-09-06T14:33:22.398 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-09-06T14:33:22.449 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 448 kB/s | 19 kB 00:00 2024-09-06T14:33:22.482 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-06T14:33:22.507 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-06T14:33:22.533 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-06T14:33:22.566 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-06T14:33:22.642 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 11 MB/s | 2.0 MB 00:00 2024-09-06T14:33:22.736 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.0 MB/s | 863 kB 00:00 2024-09-06T14:33:22.738 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:22.738 INFO:teuthology.orchestra.run.smithi165.stdout:Total 9.2 MB/s | 8.7 MB 00:00 2024-09-06T14:33:22.775 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-268.g635ed4cf.el9 11/12 2024-09-06T14:33:22.785 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:22.802 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:22.803 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:22.816 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noar 12/12 2024-09-06T14:33:22.960 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:22.961 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:23.498 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:23.584 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-06T14:33:23.628 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-06T14:33:23.683 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-06T14:33:23.739 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-06T14:33:23.816 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-06T14:33:23.949 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-06T14:33:24.060 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-06T14:33:24.071 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noar 12/12 2024-09-06T14:33:24.071 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-268.g635ed4cf.el9 1/12 2024-09-06T14:33:24.071 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noar 2/12 2024-09-06T14:33:24.071 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-268.g635ed4cf.el9. 3/12 2024-09-06T14:33:24.071 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-06T14:33:24.072 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-06T14:33:24.072 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-06T14:33:24.072 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-06T14:33:24.072 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-06T14:33:24.072 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-06T14:33:24.072 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-06T14:33:24.072 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-06T14:33:24.110 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-06T14:33:24.139 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-06T14:33:24.170 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-268.g635ed4cf.el9. 10/12 2024-09-06T14:33:24.378 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-06T14:33:24.379 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-06T14:33:24.380 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-06T14:33:24.380 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-06T14:33:24.380 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-06T14:33:24.380 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:24.380 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:24.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-06T14:33:25.159 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:05 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:25.259 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-268.g635ed4cf.el9 11/12 2024-09-06T14:33:25.297 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:25.297 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noar 12/12 2024-09-06T14:33:25.297 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 7.4 M 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-06T14:33:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout:====================================================================================== 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout:Install 12 Packages 2024-09-06T14:33:25.299 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:25.300 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 38 M 2024-09-06T14:33:25.300 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 212 M 2024-09-06T14:33:25.300 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:25.729 INFO:teuthology.orchestra.run.smithi052.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-06T14:33:25.754 INFO:teuthology.orchestra.run.smithi052.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-06T14:33:25.804 INFO:teuthology.orchestra.run.smithi052.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-09-06T14:33:25.846 INFO:teuthology.orchestra.run.smithi052.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 438 kB/s | 18 kB 00:00 2024-09-06T14:33:25.896 INFO:teuthology.orchestra.run.smithi052.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-06T14:33:26.038 INFO:teuthology.orchestra.run.smithi052.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-26 16 MB/s | 7.4 MB 00:00 2024-09-06T14:33:26.163 INFO:teuthology.orchestra.run.smithi052.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-06T14:33:26.472 INFO:teuthology.orchestra.run.smithi052.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.2 MB/s | 3.0 MB 00:00 2024-09-06T14:33:26.556 INFO:teuthology.orchestra.run.smithi052.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-06T14:33:26.640 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noar 12/12 2024-09-06T14:33:26.640 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-268.g635ed4cf.el9 1/12 2024-09-06T14:33:26.640 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noar 2/12 2024-09-06T14:33:26.640 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-268.g635ed4cf.el9. 3/12 2024-09-06T14:33:26.640 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-06T14:33:26.641 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-06T14:33:26.641 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-06T14:33:26.641 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-06T14:33:26.641 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-06T14:33:26.641 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-06T14:33:26.641 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-06T14:33:26.641 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-06T14:33:26.957 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-06T14:33:26.958 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-06T14:33:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-06T14:33:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-06T14:33:26.959 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:26.959 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:27.148 INFO:teuthology.orchestra.run.smithi052.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.9 MB/s | 4.9 MB 00:01 2024-09-06T14:33:27.221 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-06T14:33:27.489 INFO:teuthology.orchestra.run.smithi052.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.8 MB/s | 5.1 MB 00:01 2024-09-06T14:33:27.781 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:03 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:27.912 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:27.913 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 7.4 M 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-06T14:33:27.914 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-09-06T14:33:27.915 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:27.916 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 38 M 2024-09-06T14:33:27.916 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 212 M 2024-09-06T14:33:27.916 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:28.343 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-06T14:33:28.401 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-06T14:33:28.443 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-06T14:33:28.561 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-06T14:33:28.669 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): ceph-mgr-diskprediction-local-19.1.1-26 16 MB/s | 7.4 MB 00:00 2024-09-06T14:33:28.694 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-06T14:33:28.761 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.3 MB/s | 3.0 MB 00:00 2024-09-06T14:33:28.803 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-06T14:33:28.912 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-06T14:33:28.937 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.8 MB/s | 250 kB 00:00 2024-09-06T14:33:29.004 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 15 MB/s | 4.9 MB 00:00 2024-09-06T14:33:29.388 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-06T14:33:29.389 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:29.389 INFO:teuthology.orchestra.run.smithi165.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-06T14:33:29.749 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:29.775 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:29.776 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:30.192 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:30.193 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:30.823 INFO:teuthology.orchestra.run.smithi052.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-06T14:33:30.824 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:30.824 INFO:teuthology.orchestra.run.smithi052.stdout:Total 6.9 MB/s | 38 MB 00:05 2024-09-06T14:33:30.947 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:31.009 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-06T14:33:31.044 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-06T14:33:31.143 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-06T14:33:31.187 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-06T14:33:31.194 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:31.221 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:31.221 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:31.372 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-06T14:33:31.403 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-06T14:33:31.480 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-06T14:33:31.663 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:31.663 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:32.122 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-06T14:33:32.249 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-06T14:33:32.450 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:32.519 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-06T14:33:32.555 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-06T14:33:32.670 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-06T14:33:32.706 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-06T14:33:32.899 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-06T14:33:32.929 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-06T14:33:33.008 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-06T14:33:33.473 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-06T14:33:33.696 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-06T14:33:33.822 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-06T14:33:34.512 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-06T14:33:34.545 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4 12/12 2024-09-06T14:33:35.133 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-06T14:33:36.209 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-06T14:33:36.236 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4 12/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4 12/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4 1/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-06T14:33:37.111 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-06T14:33:37.112 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-06T14:33:37.112 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-06T14:33:37.112 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-06T14:33:37.112 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-06T14:33:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-06T14:33:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:37.507 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-06T14:33:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-06T14:33:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:37.508 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:37.889 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-rook 2024-09-06T14:33:38.452 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:14 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:38.586 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:38.587 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:38.588 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:33:38.588 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:38.588 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:38.588 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 49 k 2024-09-06T14:33:38.588 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:33:38.588 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-06T14:33:38.589 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-06T14:33:38.589 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-06T14:33:38.589 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-06T14:33:38.589 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-06T14:33:38.589 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-06T14:33:38.589 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-06T14:33:38.590 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-06T14:33:38.590 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-06T14:33:38.590 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-06T14:33:38.590 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-06T14:33:38.590 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-06T14:33:38.590 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:38.591 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:38.591 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:38.591 INFO:teuthology.orchestra.run.smithi165.stdout:Install 13 Packages 2024-09-06T14:33:38.591 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:38.592 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 2.2 M 2024-09-06T14:33:38.592 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 26 M 2024-09-06T14:33:38.592 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:38.736 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4 12/12 2024-09-06T14:33:38.736 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4 1/12 2024-09-06T14:33:38.736 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-06T14:33:38.737 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-06T14:33:39.131 INFO:teuthology.orchestra.run.smithi165.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 192 kB/s | 19 kB 00:00 2024-09-06T14:33:39.156 INFO:teuthology.orchestra.run.smithi165.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 205 kB/s | 26 kB 00:00 2024-09-06T14:33:39.187 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-06T14:33:39.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:39.188 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:39.188 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:39.188 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-06T14:33:39.188 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-06T14:33:39.189 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-06T14:33:39.189 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-06T14:33:39.189 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-06T14:33:39.189 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-06T14:33:39.189 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-06T14:33:39.190 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-06T14:33:39.190 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-06T14:33:39.190 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-06T14:33:39.190 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-06T14:33:39.190 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:39.190 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:39.215 INFO:teuthology.orchestra.run.smithi165.stdout:(3/13): ceph-mgr-rook-19.1.1-268.g635ed4cf.el9. 268 kB/s | 49 kB 00:00 2024-09-06T14:33:39.265 INFO:teuthology.orchestra.run.smithi165.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-06T14:33:39.290 INFO:teuthology.orchestra.run.smithi165.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-06T14:33:39.316 INFO:teuthology.orchestra.run.smithi165.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-06T14:33:39.358 INFO:teuthology.orchestra.run.smithi165.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-06T14:33:39.383 INFO:teuthology.orchestra.run.smithi165.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-06T14:33:39.417 INFO:teuthology.orchestra.run.smithi165.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.8 MB/s | 220 kB 00:00 2024-09-06T14:33:39.442 INFO:teuthology.orchestra.run.smithi165.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.2 MB/s | 279 kB 00:00 2024-09-06T14:33:39.467 INFO:teuthology.orchestra.run.smithi165.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-06T14:33:39.517 INFO:teuthology.orchestra.run.smithi165.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-06T14:33:39.559 INFO:teuthology.orchestra.run.smithi165.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-09-06T14:33:39.562 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:39.562 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-06T14:33:39.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-rook 2024-09-06T14:33:39.627 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:39.642 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:39.643 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:39.730 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:39.731 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:40.137 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:20 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:40.233 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:40.274 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:40.275 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:40.275 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:33:40.275 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:40.275 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:40.275 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 49 k 2024-09-06T14:33:40.275 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-06T14:33:40.276 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-06T14:33:40.277 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-06T14:33:40.277 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:40.277 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:40.277 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:40.277 INFO:teuthology.orchestra.run.smithi052.stdout:Install 13 Packages 2024-09-06T14:33:40.277 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:40.278 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 2.2 M 2024-09-06T14:33:40.278 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 26 M 2024-09-06T14:33:40.278 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:40.414 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-06T14:33:40.478 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-06T14:33:40.534 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-06T14:33:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-06T14:33:40.612 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-06T14:33:40.714 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-06T14:33:40.795 INFO:teuthology.orchestra.run.smithi052.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 325 kB/s | 26 kB 00:00 2024-09-06T14:33:40.815 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-06T14:33:40.853 INFO:teuthology.orchestra.run.smithi052.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 139 kB/s | 19 kB 00:00 2024-09-06T14:33:40.872 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-06T14:33:40.878 INFO:teuthology.orchestra.run.smithi052.stdout:(3/13): ceph-mgr-rook-19.1.1-268.g635ed4cf.el9. 303 kB/s | 49 kB 00:00 2024-09-06T14:33:40.929 INFO:teuthology.orchestra.run.smithi052.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-06T14:33:40.954 INFO:teuthology.orchestra.run.smithi052.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-06T14:33:40.979 INFO:teuthology.orchestra.run.smithi052.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-06T14:33:41.029 INFO:teuthology.orchestra.run.smithi052.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 428 kB/s | 32 kB 00:00 2024-09-06T14:33:41.055 INFO:teuthology.orchestra.run.smithi052.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 209 kB/s | 14 kB 00:00 2024-09-06T14:33:41.088 INFO:teuthology.orchestra.run.smithi052.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-09-06T14:33:41.113 INFO:teuthology.orchestra.run.smithi052.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-06T14:33:41.156 INFO:teuthology.orchestra.run.smithi052.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-06T14:33:41.181 INFO:teuthology.orchestra.run.smithi052.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 642 kB/s | 59 kB 00:00 2024-09-06T14:33:41.222 INFO:teuthology.orchestra.run.smithi052.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-06T14:33:41.226 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:41.226 INFO:teuthology.orchestra.run.smithi052.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-06T14:33:41.295 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:41.311 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:41.311 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:41.402 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:41.402 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:41.597 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-06T14:33:41.645 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-06T14:33:41.679 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-06T14:33:41.726 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-06T14:33:41.748 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 13/13 2024-09-06T14:33:41.919 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:42.097 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-06T14:33:42.151 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-06T14:33:42.206 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-06T14:33:42.267 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-06T14:33:42.309 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-06T14:33:42.415 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-06T14:33:42.539 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 13/13 2024-09-06T14:33:42.539 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 1/13 2024-09-06T14:33:42.539 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-06T14:33:42.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-06T14:33:42.543 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-06T14:33:42.594 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-06T14:33:42.855 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-06T14:33:42.855 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:42.855 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:42.855 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:42.855 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-06T14:33:42.855 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-06T14:33:42.856 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:42.857 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:43.151 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-cephadm 2024-09-06T14:33:43.368 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-06T14:33:43.431 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-06T14:33:43.465 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-06T14:33:43.514 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-06T14:33:43.543 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 13/13 2024-09-06T14:33:43.714 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:19 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:43.849 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:43.849 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:43.849 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 146 k 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:43.850 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:43.851 INFO:teuthology.orchestra.run.smithi165.stdout:Install 6 Packages 2024-09-06T14:33:43.851 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:43.851 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 7.0 M 2024-09-06T14:33:43.851 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 33 M 2024-09-06T14:33:43.851 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:44.246 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 13/13 2024-09-06T14:33:44.246 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 1/13 2024-09-06T14:33:44.246 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-06T14:33:44.246 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-06T14:33:44.246 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-06T14:33:44.246 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-06T14:33:44.247 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-06T14:33:44.247 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-06T14:33:44.247 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-06T14:33:44.247 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-06T14:33:44.247 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-06T14:33:44.247 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-06T14:33:44.247 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-06T14:33:44.464 INFO:teuthology.orchestra.run.smithi165.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-06T14:33:44.577 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-06T14:33:44.577 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:44.577 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:44.577 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:44.577 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-06T14:33:44.577 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-06T14:33:44.577 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:44.578 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:44.580 INFO:teuthology.orchestra.run.smithi165.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-09-06T14:33:44.606 INFO:teuthology.orchestra.run.smithi165.stdout:(3/6): ceph-mgr-cephadm-19.1.1-268.g635ed4cf.el 473 kB/s | 146 kB 00:00 2024-09-06T14:33:44.639 INFO:teuthology.orchestra.run.smithi165.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.0 MB/s | 548 kB 00:00 2024-09-06T14:33:44.673 INFO:teuthology.orchestra.run.smithi165.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 627 kB/s | 58 kB 00:00 2024-09-06T14:33:44.698 INFO:teuthology.orchestra.run.smithi165.stdout:(6/6): python3-typing-extensions-4.12.2-2.el9.n 872 kB/s | 74 kB 00:00 2024-09-06T14:33:44.701 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:44.701 INFO:teuthology.orchestra.run.smithi165.stdout:Total 8.2 MB/s | 7.0 MB 00:00 2024-09-06T14:33:44.771 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:44.783 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:44.783 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:44.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-mgr-cephadm 2024-09-06T14:33:44.880 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:44.881 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:45.185 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:45.356 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-06T14:33:45.400 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:25 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:45.409 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-06T14:33:45.538 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.1.1-268.g635ed4cf.el9 ceph-noarch 146 k 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-06T14:33:45.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-06T14:33:45.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:45.540 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:45.540 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:45.540 INFO:teuthology.orchestra.run.smithi052.stdout:Install 6 Packages 2024-09-06T14:33:45.540 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:45.540 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 7.0 M 2024-09-06T14:33:45.540 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 33 M 2024-09-06T14:33:45.541 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:45.938 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-06T14:33:46.023 INFO:teuthology.orchestra.run.smithi052.stdout:(1/6): ceph-mgr-cephadm-19.1.1-268.g635ed4cf.el 764 kB/s | 146 kB 00:00 2024-09-06T14:33:46.028 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-06T14:33:46.090 INFO:teuthology.orchestra.run.smithi052.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 8.0 MB/s | 548 kB 00:00 2024-09-06T14:33:46.092 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-06T14:33:46.115 INFO:teuthology.orchestra.run.smithi052.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-06T14:33:46.121 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 6/6 2024-09-06T14:33:46.141 INFO:teuthology.orchestra.run.smithi052.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-06T14:33:46.408 INFO:teuthology.orchestra.run.smithi052.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 431 kB/s | 248 kB 00:00 2024-09-06T14:33:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 6/6 2024-09-06T14:33:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/6 2024-09-06T14:33:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-06T14:33:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-06T14:33:46.871 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-06T14:33:46.872 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-06T14:33:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-06T14:33:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:47.135 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-06T14:33:47.135 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-06T14:33:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-06T14:33:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-06T14:33:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-06T14:33:47.136 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:47.136 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:47.375 INFO:teuthology.orchestra.run.smithi052.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.9 MB/s | 6.0 MB 00:01 2024-09-06T14:33:47.376 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:47.377 INFO:teuthology.orchestra.run.smithi052.stdout:Total 3.8 MB/s | 7.0 MB 00:01 2024-09-06T14:33:47.418 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-fuse 2024-09-06T14:33:47.450 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:47.462 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:47.462 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:47.566 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:47.567 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:47.876 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:47.974 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:23 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:48.039 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-06T14:33:48.093 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-06T14:33:48.107 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:48.107 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:48.107 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-06T14:33:48.107 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 896 k 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout:Install 2 Packages 2024-09-06T14:33:48.108 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:48.109 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 976 k 2024-09-06T14:33:48.109 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 2.9 M 2024-09-06T14:33:48.109 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:48.409 INFO:teuthology.orchestra.run.smithi165.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-06T14:33:48.485 INFO:teuthology.orchestra.run.smithi165.stdout:(2/2): ceph-fuse-19.1.1-268.g635ed4cf.el9.x86_6 3.3 MB/s | 896 kB 00:00 2024-09-06T14:33:48.485 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:48.485 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.5 MB/s | 976 kB 00:00 2024-09-06T14:33:48.497 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:48.519 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:48.519 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:48.600 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:48.600 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:48.651 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-06T14:33:48.740 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-06T14:33:48.779 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:48.811 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-06T14:33:48.838 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 6/6 2024-09-06T14:33:48.920 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-06T14:33:48.998 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 2/2 2024-09-06T14:33:49.570 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 6/6 2024-09-06T14:33:49.570 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 1/6 2024-09-06T14:33:49.570 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-06T14:33:49.570 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-06T14:33:49.570 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-06T14:33:49.570 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-06T14:33:49.685 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 2/2 2024-09-06T14:33:49.686 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/2 2024-09-06T14:33:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-06T14:33:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:49.834 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.1.1-268.g635ed4cf.el9.noarch 2024-09-06T14:33:49.834 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-06T14:33:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-06T14:33:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-06T14:33:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-06T14:33:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-06T14:33:49.835 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:49.835 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:49.970 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-06T14:33:49.970 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:49.971 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:49.971 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-06T14:33:49.971 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:49.971 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:50.080 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-fuse 2024-09-06T14:33:50.299 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados-devel 2024-09-06T14:33:50.645 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:30 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:50.783 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:50.784 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:50.784 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-06T14:33:50.784 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:50.784 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:50.784 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 896 k 2024-09-06T14:33:50.784 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-06T14:33:50.784 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-06T14:33:50.785 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:50.785 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:50.785 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:50.785 INFO:teuthology.orchestra.run.smithi052.stdout:Install 2 Packages 2024-09-06T14:33:50.785 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:50.785 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 976 k 2024-09-06T14:33:50.785 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 2.9 M 2024-09-06T14:33:50.786 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:50.870 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:26 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:51.010 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:51.010 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 127 k 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-06T14:33:51.011 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:51.012 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 127 k 2024-09-06T14:33:51.012 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 456 k 2024-09-06T14:33:51.012 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:51.167 INFO:teuthology.orchestra.run.smithi052.stdout:(1/2): ceph-fuse-19.1.1-268.g635ed4cf.el9.x86_6 3.1 MB/s | 896 kB 00:00 2024-09-06T14:33:51.224 INFO:teuthology.orchestra.run.smithi165.stdout:librados-devel-19.1.1-268.g635ed4cf.el9.x86_64. 597 kB/s | 127 kB 00:00 2024-09-06T14:33:51.225 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:51.225 INFO:teuthology.orchestra.run.smithi165.stdout:Total 593 kB/s | 127 kB 00:00 2024-09-06T14:33:51.225 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:51.230 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:51.231 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:51.294 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:51.295 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:51.444 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:51.534 INFO:teuthology.orchestra.run.smithi052.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 123 kB/s | 80 kB 00:00 2024-09-06T14:33:51.535 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:51.535 INFO:teuthology.orchestra.run.smithi052.stdout:Total 1.3 MB/s | 976 kB 00:00 2024-09-06T14:33:51.548 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:51.562 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:51.571 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:51.571 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:51.655 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:51.655 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:51.843 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:51.974 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-06T14:33:52.021 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:52.043 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 2/2 2024-09-06T14:33:52.293 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:52.293 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:52.293 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:52.293 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:52.293 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:52.293 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:52.569 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs2 2024-09-06T14:33:52.680 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 2/2 2024-09-06T14:33:52.680 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/2 2024-09-06T14:33:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-06T14:33:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:52.948 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-06T14:33:52.948 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:52.948 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:53.142 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:29 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:53.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados-devel 2024-09-06T14:33:53.233 INFO:teuthology.orchestra.run.smithi165.stdout:Package libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:53.278 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:53.279 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:53.279 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:53.368 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs-devel 2024-09-06T14:33:53.792 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:33 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:53.927 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:29 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:53.929 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:53.929 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:53.929 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-06T14:33:53.929 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:53.929 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:53.929 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 127 k 2024-09-06T14:33:53.930 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:53.930 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:53.930 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:53.930 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-06T14:33:53.930 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:53.930 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 127 k 2024-09-06T14:33:53.930 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 456 k 2024-09-06T14:33:53.931 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:54.060 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:54.061 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:54.061 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-06T14:33:54.061 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 32 k 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 32 k 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 142 k 2024-09-06T14:33:54.062 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:33:54.129 INFO:teuthology.orchestra.run.smithi052.stdout:librados-devel-19.1.1-268.g635ed4cf.el9.x86_64. 637 kB/s | 127 kB 00:00 2024-09-06T14:33:54.130 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:54.130 INFO:teuthology.orchestra.run.smithi052.stdout:Total 633 kB/s | 127 kB 00:00 2024-09-06T14:33:54.130 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:54.136 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:54.137 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:54.203 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:54.203 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:54.221 INFO:teuthology.orchestra.run.smithi165.stdout:libcephfs-devel-19.1.1-268.g635ed4cf.el9.x86_64 200 kB/s | 32 kB 00:00 2024-09-06T14:33:54.221 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:54.222 INFO:teuthology.orchestra.run.smithi165.stdout:Total 198 kB/s | 32 kB 00:00 2024-09-06T14:33:54.222 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:33:54.225 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:33:54.225 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:33:54.230 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:33:54.230 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:33:54.319 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:33:54.360 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:54.432 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:54.445 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:54.790 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:54.859 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:55.008 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:55.008 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:55.008 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:33:55.008 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:55.008 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:33:55.008 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:55.161 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:55.161 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:55.161 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:55.161 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:55.161 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:55.161 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:55.219 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados2 2024-09-06T14:33:55.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs2 2024-09-06T14:33:55.775 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:31 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:55.866 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:55.909 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:55.910 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:55.910 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:55.975 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:35 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:55.989 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librbd1 2024-09-06T14:33:56.066 INFO:teuthology.orchestra.run.smithi052.stdout:Package libcephfs2-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:56.111 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:56.112 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:33:56.112 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:56.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install libcephfs-devel 2024-09-06T14:33:56.540 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:32 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:56.630 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:56.673 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:56.674 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:56.674 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:56.752 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rados 2024-09-06T14:33:56.753 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:36 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:56.891 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 32 k 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:33:56.892 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:33:56.893 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-06T14:33:56.893 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:56.893 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 32 k 2024-09-06T14:33:56.893 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 142 k 2024-09-06T14:33:56.893 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:33:57.041 INFO:teuthology.orchestra.run.smithi052.stdout:libcephfs-devel-19.1.1-268.g635ed4cf.el9.x86_64 215 kB/s | 32 kB 00:00 2024-09-06T14:33:57.042 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:33:57.042 INFO:teuthology.orchestra.run.smithi052.stdout:Total 212 kB/s | 32 kB 00:00 2024-09-06T14:33:57.042 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:33:57.045 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:33:57.045 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:33:57.050 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:33:57.050 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:33:57.154 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:33:57.256 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:57.305 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:33 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:57.394 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:57.436 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:57.437 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:57.437 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:57.528 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rgw 2024-09-06T14:33:57.614 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:57.823 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:33:57.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:57.824 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:33:57.824 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:33:57.824 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:33:57.824 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:58.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librados2 2024-09-06T14:33:58.085 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:34 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:58.173 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:58.216 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:58.217 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:58.217 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:58.294 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-cephfs 2024-09-06T14:33:58.570 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:38 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:58.663 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:58.709 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:58.710 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:33:58.710 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:58.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install librbd1 2024-09-06T14:33:58.847 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:34 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:58.937 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:58.980 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:58.981 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:58.981 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:59.072 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rbd 2024-09-06T14:33:59.348 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:39 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:33:59.441 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:59.486 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:33:59.488 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:33:59.488 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:33:59.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rados 2024-09-06T14:33:59.632 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:35 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:33:59.720 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:33:59.764 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:33:59.765 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-06T14:33:59.765 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:33:59.852 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-fuse 2024-09-06T14:34:00.125 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:40 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:34:00.217 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rados-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:34:00.262 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:34:00.263 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:34:00.263 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:34:00.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rgw 2024-09-06T14:34:00.413 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:36 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:34:00.547 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:34:00.548 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:00.548 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 85 k 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 85 k 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 231 k 2024-09-06T14:34:00.549 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:34:00.749 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-fuse-19.1.1-268.g635ed4cf.el9.x86_64.rpm 428 kB/s | 85 kB 00:00 2024-09-06T14:34:00.749 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:34:00.750 INFO:teuthology.orchestra.run.smithi165.stdout:Total 425 kB/s | 85 kB 00:00 2024-09-06T14:34:00.750 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:34:00.757 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:34:00.757 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:34:00.820 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:34:00.821 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:34:00.906 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:40 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:34:00.971 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:34:00.998 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rgw-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:34:01.043 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:34:01.045 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:34:01.045 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:34:01.069 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:01.118 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-cephfs 2024-09-06T14:34:01.453 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:01.683 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:41 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:34:01.718 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:01.718 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:01.718 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:34:01.718 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:34:01.718 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:01.718 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:34:01.776 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-cephfs-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:34:01.822 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:34:01.823 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:34:01.823 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:34:01.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install python3-rbd 2024-09-06T14:34:02.024 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-mirror 2024-09-06T14:34:02.469 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:42 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:34:02.561 INFO:teuthology.orchestra.run.smithi052.stdout:Package python3-rbd-2:19.1.1-268.g635ed4cf.el9.x86_64 is already installed. 2024-09-06T14:34:02.592 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:38 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:34:02.606 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:34:02.608 INFO:teuthology.orchestra.run.smithi052.stdout:Nothing to do. 2024-09-06T14:34:02.608 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:34:02.680 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-fuse 2024-09-06T14:34:02.728 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 3.1 M 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 3.1 M 2024-09-06T14:34:02.729 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 13 M 2024-09-06T14:34:02.730 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:34:03.070 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-mirror-19.1.1-268.g635ed4cf.el9.x86_64.rpm 9.1 MB/s | 3.1 MB 00:00 2024-09-06T14:34:03.070 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:34:03.071 INFO:teuthology.orchestra.run.smithi165.stdout:Total 9.1 MB/s | 3.1 MB 00:00 2024-09-06T14:34:03.071 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:34:03.080 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:34:03.080 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:34:03.161 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:34:03.161 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:34:03.249 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:43 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:34:03.388 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 85 k 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:03.389 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 85 k 2024-09-06T14:34:03.390 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 231 k 2024-09-06T14:34:03.390 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:34:03.577 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-fuse-19.1.1-268.g635ed4cf.el9.x86_64.rpm 454 kB/s | 85 kB 00:00 2024-09-06T14:34:03.578 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:34:03.578 INFO:teuthology.orchestra.run.smithi052.stdout:Total 451 kB/s | 85 kB 00:00 2024-09-06T14:34:03.578 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:34:03.585 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:34:03.585 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:34:03.588 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:34:03.652 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:34:03.653 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:34:03.654 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:03.678 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:03.679 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:34:03.679 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-06T14:34:03.679 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-06T14:34:03.679 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-06T14:34:03.679 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:03.804 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:34:03.901 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:04.238 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:04.470 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:04.470 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:04.470 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:34:04.470 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:34:04.470 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:04.470 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:34:04.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-mirror 2024-09-06T14:34:04.758 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:04.758 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:04.758 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:34:04.758 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:34:04.758 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:04.758 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:34:05.053 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-nbd 2024-09-06T14:34:05.312 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:45 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:34:05.451 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:34:05.451 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:05.451 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repo Size 2024-09-06T14:34:05.451 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 3.1 M 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:05.452 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 3.1 M 2024-09-06T14:34:05.453 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 13 M 2024-09-06T14:34:05.453 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:34:05.652 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:41 ago on Fri 06 Sep 2024 02:32:24 PM UTC. 2024-09-06T14:34:05.780 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-mirror-19.1.1-268.g635ed4cf.el9.x86_64.rpm 9.5 MB/s | 3.1 MB 00:00 2024-09-06T14:34:05.780 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:34:05.781 INFO:teuthology.orchestra.run.smithi052.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-06T14:34:05.781 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:34:05.790 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:34:05.791 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:34:05.792 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-06T14:34:05.792 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 170 k 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-06T14:34:05.793 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:05.794 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 170 k 2024-09-06T14:34:05.794 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 494 k 2024-09-06T14:34:05.794 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-06T14:34:05.875 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:34:05.875 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:34:06.025 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-nbd-19.1.1-268.g635ed4cf.el9.x86_64.rpm 736 kB/s | 170 kB 00:00 2024-09-06T14:34:06.026 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:34:06.026 INFO:teuthology.orchestra.run.smithi165.stdout:Total 731 kB/s | 170 kB 00:00 2024-09-06T14:34:06.027 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-06T14:34:06.035 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-06T14:34:06.035 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-06T14:34:06.102 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-06T14:34:06.102 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-06T14:34:06.259 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-06T14:34:06.329 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:34:06.371 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:06.389 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:06.413 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:06.414 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-06T14:34:06.414 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-06T14:34:06.414 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-06T14:34:06.414 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-06T14:34:06.414 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:06.879 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:07.157 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:07.158 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:07.158 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-06T14:34:07.158 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:34:07.158 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:34:07.158 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-06T14:34:07.426 DEBUG:teuthology.parallel:result is None 2024-09-06T14:34:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:07.490 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:34:07.491 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:34:07.491 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:07.491 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:34:07.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install rbd-nbd 2024-09-06T14:34:08.296 INFO:teuthology.orchestra.run.smithi052.stdout:Last metadata expiration check: 0:01:48 ago on Fri 06 Sep 2024 02:32:20 PM UTC. 2024-09-06T14:34:08.436 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout: Package Architecture Version Repository Size 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.1.1-268.g635ed4cf.el9 ceph 170 k 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout:================================================================================ 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout:Install 1 Package 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:08.437 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 170 k 2024-09-06T14:34:08.438 INFO:teuthology.orchestra.run.smithi052.stdout:Installed size: 494 k 2024-09-06T14:34:08.438 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-06T14:34:08.642 INFO:teuthology.orchestra.run.smithi052.stdout:rbd-nbd-19.1.1-268.g635ed4cf.el9.x86_64.rpm 835 kB/s | 170 kB 00:00 2024-09-06T14:34:08.642 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:34:08.643 INFO:teuthology.orchestra.run.smithi052.stdout:Total 829 kB/s | 170 kB 00:00 2024-09-06T14:34:08.643 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-06T14:34:08.651 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-06T14:34:08.651 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-06T14:34:08.720 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-06T14:34:08.720 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-06T14:34:08.880 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-06T14:34:08.982 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:09.410 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:09.654 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 1/1 2024-09-06T14:34:09.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:09.654 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-06T14:34:09.654 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.1.1-268.g635ed4cf.el9.x86_64 2024-09-06T14:34:09.654 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:34:09.654 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-06T14:34:09.880 DEBUG:teuthology.parallel:result is None 2024-09-06T14:34:09.881 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:34:09.881 INFO:teuthology.packaging:ref: None 2024-09-06T14:34:09.881 INFO:teuthology.packaging:tag: None 2024-09-06T14:34:09.881 INFO:teuthology.packaging:branch: squid 2024-09-06T14:34:09.881 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:34:09.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-06T14:34:10.120 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-06T14:34:10.144 INFO:teuthology.orchestra.run.smithi052.stdout:19.1.1-268.g635ed4cf.el9 2024-09-06T14:34:10.145 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-268.g635ed4cf.el9 2024-09-06T14:34:10.145 INFO:teuthology.task.install:The correct ceph version 19.1.1-268.g635ed4cf is installed. 2024-09-06T14:34:10.147 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-06T14:34:10.147 INFO:teuthology.packaging:ref: None 2024-09-06T14:34:10.147 INFO:teuthology.packaging:tag: None 2024-09-06T14:34:10.147 INFO:teuthology.packaging:branch: squid 2024-09-06T14:34:10.147 INFO:teuthology.packaging:sha1: 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:34:10.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-06T14:34:10.387 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-06T14:34:10.413 INFO:teuthology.orchestra.run.smithi165.stdout:19.1.1-268.g635ed4cf.el9 2024-09-06T14:34:10.414 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-268.g635ed4cf.el9 2024-09-06T14:34:10.414 INFO:teuthology.task.install:The correct ceph version 19.1.1-268.g635ed4cf is installed. 2024-09-06T14:34:10.416 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-06T14:34:10.416 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:34:10.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-06T14:34:10.447 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:34:10.447 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-06T14:34:10.484 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-06T14:34:10.484 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:34:10.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-06T14:34:10.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-06T14:34:10.593 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:34:10.593 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-06T14:34:10.622 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-06T14:34:10.692 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-06T14:34:10.693 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:34:10.693 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-06T14:34:10.720 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-06T14:34:10.787 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:34:10.787 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-06T14:34:10.816 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-06T14:34:10.884 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-06T14:34:10.884 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:34:10.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-06T14:34:10.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-06T14:34:10.978 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:34:10.978 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-06T14:34:11.006 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-06T14:34:11.073 INFO:teuthology.run_tasks:Running task print... 2024-09-06T14:34:11.083 INFO:teuthology.task.print:**** done install task... 2024-09-06T14:34:11.084 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-06T14:34:11.183 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'} 2024-09-06T14:34:11.183 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-06T14:34:11.184 INFO:tasks.cephadm:Cluster fsid is 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:34:11.184 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-06T14:34:11.184 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-06T14:34:11.184 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi052': '172.21.15.52', 'mon.smithi165': '172.21.15.165'} 2024-09-06T14:34:11.184 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-06T14:34:11.184 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname $(hostname -s) 2024-09-06T14:34:11.212 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname $(hostname -s) 2024-09-06T14:34:11.241 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-06T14:34:11.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:34:11.389 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82769/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4704-g8b38c33c', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4704.g8b38c33c'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-04 15:17:36.368221', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-athakkar-testing-2024-09-04-1837', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-athakkar-testing-2024-09-04-1837/8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-06T14:34:11.618 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 635ed4cf3404d66f56069c438a5e3af26e0ed5be from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-06T14:34:11.619 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/x86_64/flavors/default/cephadm 2024-09-06T14:34:11.619 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/x86_64/flavors/default/cephadm 2024-09-06T14:34:11.619 DEBUG:teuthology.orchestra.run.smithi052:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-06T14:34:12.005 INFO:teuthology.orchestra.run.smithi052.stdout:-rw-r--r--. 1 ubuntu ubuntu 784394 Sep 6 14:34 /home/ubuntu/cephtest/cephadm 2024-09-06T14:34:12.006 DEBUG:teuthology.orchestra.run.smithi165:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/635ed4cf3404d66f56069c438a5e3af26e0ed5be/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-06T14:34:12.386 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r--. 1 ubuntu ubuntu 784394 Sep 6 14:34 /home/ubuntu/cephtest/cephadm 2024-09-06T14:34:12.386 DEBUG:teuthology.orchestra.run.smithi052:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-06T14:34:12.405 DEBUG:teuthology.orchestra.run.smithi165:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-06T14:34:12.436 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-06T14:34:12.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-06T14:34:12.448 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-06T14:34:13.997 INFO:teuthology.orchestra.run.smithi165.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-06T14:34:14.060 INFO:teuthology.orchestra.run.smithi052.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-06T14:35:00.664 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-06T14:35:00.665 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_version": "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)", 2024-09-06T14:35:00.665 INFO:teuthology.orchestra.run.smithi165.stdout: "image_id": "b6db46a449e5842f9982c30ac1bfac15b0d85864d3f5607d6eb8c3dc5fa40582", 2024-09-06T14:35:00.665 INFO:teuthology.orchestra.run.smithi165.stdout: "repo_digests": [ 2024-09-06T14:35:00.665 INFO:teuthology.orchestra.run.smithi165.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0" 2024-09-06T14:35:00.665 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-06T14:35:00.665 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-06T14:35:02.642 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:35:02.642 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)", 2024-09-06T14:35:02.642 INFO:teuthology.orchestra.run.smithi052.stdout: "image_id": "b6db46a449e5842f9982c30ac1bfac15b0d85864d3f5607d6eb8c3dc5fa40582", 2024-09-06T14:35:02.643 INFO:teuthology.orchestra.run.smithi052.stdout: "repo_digests": [ 2024-09-06T14:35:02.643 INFO:teuthology.orchestra.run.smithi052.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0" 2024-09-06T14:35:02.643 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-06T14:35:02.643 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:35:02.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph 2024-09-06T14:35:02.720 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph 2024-09-06T14:35:02.752 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /etc/ceph 2024-09-06T14:35:02.777 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /etc/ceph 2024-09-06T14:35:02.818 INFO:tasks.cephadm:Writing seed config... 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-06T14:35:02.820 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-06T14:35:02.821 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-06T14:35:02.822 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-06T14:35:02.822 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-06T14:35:02.822 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-06T14:35:02.822 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:35:02.822 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-06T14:35:02.838 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 14ffcc96-6c5d-11ef-bce4-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-06T14:35:02.838 DEBUG:teuthology.orchestra.run.smithi052:mon.smithi052> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service 2024-09-06T14:35:02.881 INFO:tasks.cephadm:Bootstrapping... 2024-09-06T14:35:02.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.52 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-06T14:35:03.089 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-06T14:35:03.089 INFO:teuthology.orchestra.run.smithi052.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.52', '--skip-admin-label'] 2024-09-06T14:35:03.090 INFO:teuthology.orchestra.run.smithi052.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-06T14:35:03.090 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying podman|docker is present... 2024-09-06T14:35:03.113 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stdout 5.2.2 2024-09-06T14:35:03.113 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying lvm2 is present... 2024-09-06T14:35:03.113 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying time synchronization is in place... 2024-09-06T14:35:03.121 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-06T14:35:03.121 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-06T14:35:03.127 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-06T14:35:03.127 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-06T14:35:03.133 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout enabled 2024-09-06T14:35:03.140 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout active 2024-09-06T14:35:03.140 INFO:teuthology.orchestra.run.smithi052.stdout:Unit chronyd.service is enabled and running 2024-09-06T14:35:03.140 INFO:teuthology.orchestra.run.smithi052.stdout:Repeating the final host check... 2024-09-06T14:35:03.161 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stdout 5.2.2 2024-09-06T14:35:03.162 INFO:teuthology.orchestra.run.smithi052.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-06T14:35:03.162 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl is present 2024-09-06T14:35:03.162 INFO:teuthology.orchestra.run.smithi052.stdout:lvcreate is present 2024-09-06T14:35:03.168 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-06T14:35:03.168 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-06T14:35:03.174 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-06T14:35:03.174 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-06T14:35:03.181 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout enabled 2024-09-06T14:35:03.188 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout active 2024-09-06T14:35:03.188 INFO:teuthology.orchestra.run.smithi052.stdout:Unit chronyd.service is enabled and running 2024-09-06T14:35:03.188 INFO:teuthology.orchestra.run.smithi052.stdout:Host looks OK 2024-09-06T14:35:03.189 INFO:teuthology.orchestra.run.smithi052.stdout:Cluster fsid: 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:03.189 INFO:teuthology.orchestra.run.smithi052.stdout:Acquiring lock 139789903105328 on /run/cephadm/14ffcc96-6c5d-11ef-bce4-c7b262605968.lock 2024-09-06T14:35:03.189 INFO:teuthology.orchestra.run.smithi052.stdout:Lock 139789903105328 acquired on /run/cephadm/14ffcc96-6c5d-11ef-bce4-c7b262605968.lock 2024-09-06T14:35:03.189 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying IP 172.21.15.52 port 3300 ... 2024-09-06T14:35:03.189 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying IP 172.21.15.52 port 6789 ... 2024-09-06T14:35:03.189 INFO:teuthology.orchestra.run.smithi052.stdout:Base mon IP(s) is [172.21.15.52:3300, 172.21.15.52:6789], mon addrv is [v2:172.21.15.52:3300,v1:172.21.15.52:6789] 2024-09-06T14:35:03.192 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.52 metric 100 2024-09-06T14:35:03.192 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.52 metric 100 2024-09-06T14:35:03.194 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-06T14:35:03.194 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-09-06T14:35:03.194 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-09-06T14:35:03.197 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-06T14:35:03.197 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-06T14:35:03.197 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-06T14:35:03.197 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-06T14:35:03.197 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout inet6 fe80::b366:614:84d8:fe34/64 scope link noprefixroute 2024-09-06T14:35:03.197 INFO:teuthology.orchestra.run.smithi052.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-06T14:35:03.198 INFO:teuthology.orchestra.run.smithi052.stdout:Mon IP `172.21.15.52` is in CIDR network `172.21.0.0/20` 2024-09-06T14:35:03.198 INFO:teuthology.orchestra.run.smithi052.stdout:Mon IP `172.21.15.52` is in CIDR network `172.21.0.0/20` 2024-09-06T14:35:03.198 INFO:teuthology.orchestra.run.smithi052.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-06T14:35:03.198 INFO:teuthology.orchestra.run.smithi052.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-06T14:35:03.199 INFO:teuthology.orchestra.run.smithi052.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-06T14:35:03.695 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stdout b6db46a449e5842f9982c30ac1bfac15b0d85864d3f5607d6eb8c3dc5fa40582 2024-09-06T14:35:03.695 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-06T14:35:03.695 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Getting image source signatures 2024-09-06T14:35:03.695 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Copying blob sha256:d8d51f0faddbda0d549f797bd34f58714cfb04995f92629cc62238292f630e4a 2024-09-06T14:35:03.695 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-06T14:35:03.696 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Copying config sha256:b6db46a449e5842f9982c30ac1bfac15b0d85864d3f5607d6eb8c3dc5fa40582 2024-09-06T14:35:03.696 INFO:teuthology.orchestra.run.smithi052.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-06T14:35:04.558 INFO:teuthology.orchestra.run.smithi052.stdout:ceph: stdout ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable) 2024-09-06T14:35:04.559 INFO:teuthology.orchestra.run.smithi052.stdout:Ceph version: ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable) 2024-09-06T14:35:04.559 INFO:teuthology.orchestra.run.smithi052.stdout:Extracting ceph user uid/gid from container image... 2024-09-06T14:35:05.332 INFO:teuthology.orchestra.run.smithi052.stdout:stat: stdout 167 167 2024-09-06T14:35:05.332 INFO:teuthology.orchestra.run.smithi052.stdout:Creating initial keys... 2024-09-06T14:35:06.212 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph-authtool: stdout AQAZE9tmoo5aJRAALo5Wgon9hOdYT0YQYlPbZQ== 2024-09-06T14:35:07.135 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph-authtool: stdout AQAaE9tmfiTJHRAA0r+urAx625ZbN5Rb85SUbA== 2024-09-06T14:35:08.134 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph-authtool: stdout AQAbE9tm/4w3GhAAty+3au+jFMrXWK42c8y9nQ== 2024-09-06T14:35:08.135 INFO:teuthology.orchestra.run.smithi052.stdout:Creating initial monmap... 2024-09-06T14:35:09.645 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool for smithi052 [v2:172.21.15.52:3300,v1:172.21.15.52:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: set fsid to 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:35:09.646 INFO:teuthology.orchestra.run.smithi052.stdout:Creating mon... 2024-09-06T14:35:19.075 INFO:teuthology.orchestra.run.smithi052.stdout:create mon.smithi052 on 2024-09-06T14:35:19.496 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-06T14:35:19.807 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-06T14:35:20.036 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968.target → /etc/systemd/system/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968.target. 2024-09-06T14:35:20.037 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968.target → /etc/systemd/system/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968.target. 2024-09-06T14:35:20.269 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052 2024-09-06T14:35:20.269 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to reset failed state of unit ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service: Unit ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service not loaded. 2024-09-06T14:35:20.428 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968.target.wants/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service → /etc/systemd/system/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@.service. 2024-09-06T14:35:20.939 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-06T14:35:20.939 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-06T14:35:20.946 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-06T14:35:20.946 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-06T14:35:20.947 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-06T14:35:20.947 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to enable service . firewalld.service is not available 2024-09-06T14:35:20.947 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mon to start... 2024-09-06T14:35:20.947 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mon... 2024-09-06T14:35:21.053 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:20 smithi052 systemd[1]: Started Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:35:21.870 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout cluster: 2024-09-06T14:35:21.870 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout id: 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout services: 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi052 (age 0.530634s) 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout data: 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-06T14:35:21.871 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout pgs: 2024-09-06T14:35:21.872 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:21.872 INFO:teuthology.orchestra.run.smithi052.stdout:mon is available 2024-09-06T14:35:21.872 INFO:teuthology.orchestra.run.smithi052.stdout:Assimilating anything we can from ceph.conf... 2024-09-06T14:35:21.992 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: mon.smithi052 is new leader, mons smithi052 in quorum (ranks 0) 2024-09-06T14:35:21.993 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: monmap epoch 1 2024-09-06T14:35:21.993 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:21.993 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: last_changed 2024-09-06T14:35:08.459770+0000 2024-09-06T14:35:21.993 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:35:21.993 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: min_mon_release 19 (squid) 2024-09-06T14:35:21.994 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: election_strategy: 1 2024-09-06T14:35:21.994 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:35:21.994 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: fsmap 2024-09-06T14:35:21.994 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: osdmap e1: 0 total, 0 up, 0 in 2024-09-06T14:35:21.994 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: mgrmap e1: no daemons active 2024-09-06T14:35:21.994 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:21 smithi052 ceph-mon[28260]: from='client.? 172.21.15.52:0/3621348775' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-06T14:35:22.902 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [global] 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout fsid = 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.52:3300,v1:172.21.15.52:6789] 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-06T14:35:22.903 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:22.904 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [osd] 2024-09-06T14:35:22.904 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-06T14:35:22.904 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-06T14:35:22.904 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-06T14:35:22.904 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-06T14:35:22.904 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-06T14:35:22.904 INFO:teuthology.orchestra.run.smithi052.stdout:Generating new minimal ceph.conf... 2024-09-06T14:35:23.007 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:22 smithi052 ceph-mon[28260]: from='client.? 172.21.15.52:0/4199823425' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-06T14:35:23.007 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:22 smithi052 ceph-mon[28260]: from='client.? 172.21.15.52:0/4199823425' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-06T14:35:23.800 INFO:teuthology.orchestra.run.smithi052.stdout:Restarting the monitor... 2024-09-06T14:35:23.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:23 smithi052 systemd[1]: Stopping Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:35:24.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:23 smithi052 ceph-mon[28260]: from='client.? 172.21.15.52:0/3346042066' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:35:24.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:24 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[28256]: 2024-09-06T14:35:24.052+0000 7fef66f8f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi052 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:35:24.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:24 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[28256]: 2024-09-06T14:35:24.052+0000 7fef66f8f640 -1 mon.smithi052@0(leader) e1 *** Got Signal Terminated *** 2024-09-06T14:35:24.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:24 smithi052 podman[28501]: 2024-09-06 14:35:24.093815646 +0000 UTC m=+0.123288349 container died b82b8490b28ea8a68a5dcd3ce9eb9fc5e99dcf577024631d7e7c6de3db1f45a8 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-635ed4c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-06T14:35:24.700 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:24 smithi052 podman[28501]: 2024-09-06 14:35:24.427540183 +0000 UTC m=+0.457012926 container cleanup b82b8490b28ea8a68a5dcd3ce9eb9fc5e99dcf577024631d7e7c6de3db1f45a8 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-635ed4c, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-06T14:35:24.701 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:24 smithi052 bash[28501]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052 2024-09-06T14:35:24.984 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:24 smithi052 podman[28513]: 2024-09-06 14:35:24.703512741 +0000 UTC m=+0.611585462 container remove b82b8490b28ea8a68a5dcd3ce9eb9fc5e99dcf577024631d7e7c6de3db1f45a8 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.license=GPLv2, RELEASE=squid-635ed4c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:35:25.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:25 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service: Deactivated successfully. 2024-09-06T14:35:25.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:25 smithi052 systemd[1]: Stopped Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:35:25.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:25 smithi052 systemd[1]: Starting Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:35:25.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:25 smithi052 podman[28608]: 2024-09-06 14:35:25.110446641 +0000 UTC m=+0.016179561 image pull b6db46a449e5842f9982c30ac1bfac15b0d85864d3f5607d6eb8c3dc5fa40582 quay.ceph.io/ceph-ci/ceph:squid 2024-09-06T14:35:26.068 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:25 smithi052 podman[28608]: 2024-09-06 14:35:25.768233737 +0000 UTC m=+0.673966686 container create c729266bcb69489487eff41e9b530bd7f16c335f80f5fe930ce126991b6cdf71 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-635ed4c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-06T14:35:26.068 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:25 smithi052 podman[28608]: 2024-09-06 14:35:25.979708816 +0000 UTC m=+0.885441723 container init c729266bcb69489487eff41e9b530bd7f16c335f80f5fe930ce126991b6cdf71 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-635ed4c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-06T14:35:26.068 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:25 smithi052 podman[28608]: 2024-09-06 14:35:25.983110018 +0000 UTC m=+0.888842926 container start c729266bcb69489487eff41e9b530bd7f16c335f80f5fe930ce126991b6cdf71 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-635ed4c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T14:35:26.068 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: set uid:gid to 167:167 (ceph:ceph) 2024-09-06T14:35:26.068 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable), process ceph-mon, pid 2 2024-09-06T14:35:26.068 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: pidfile_write: ignore empty --pid-file 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: load: jerasure load: lrc 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: RocksDB version: 7.9.2 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Git sha 0 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Compile date 2024-09-05 21:09:15 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: DB SUMMARY 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: DB Session ID: I6M0NJRGKG63QBK1LGGJ 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: CURRENT file: CURRENT 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: IDENTITY file: IDENTITY 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi052/store.db dir, Total Num: 1, files: 000008.sst 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi052/store.db: 000009.log size: 95837 ; 2024-09-06T14:35:26.069 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.error_if_exists: 0 2024-09-06T14:35:26.070 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.create_if_missing: 0 2024-09-06T14:35:26.070 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.paranoid_checks: 1 2024-09-06T14:35:26.070 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-06T14:35:26.070 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-06T14:35:26.071 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.env: 0x559e61c79940 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.fs: PosixFileSystem 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.info_log: 0x559e638678c0 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_file_opening_threads: 16 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.statistics: (nil) 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.use_fsync: 0 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_log_file_size: 0 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.keep_log_file_num: 1000 2024-09-06T14:35:26.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.recycle_log_file_num: 0 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.allow_fallocate: 1 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.allow_mmap_reads: 0 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.allow_mmap_writes: 0 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.use_direct_reads: 0 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.create_missing_column_families: 0 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.db_log_dir: 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.wal_dir: 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-06T14:35:26.073 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.advise_random_on_open: 1 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.db_write_buffer_size: 0 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.write_buffer_manager: 0x559e63876dc0 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.rate_limiter: (nil) 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-06T14:35:26.074 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.wal_recovery_mode: 2 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.enable_thread_tracking: 0 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.enable_pipelined_write: 0 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.unordered_write: 0 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.row_cache: None 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.wal_filter: None 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.allow_ingest_behind: 0 2024-09-06T14:35:26.075 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.two_write_queues: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.manual_wal_flush: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.wal_compression: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.atomic_flush: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.log_readahead_size: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.best_efforts_recovery: 0 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-06T14:35:26.076 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.allow_data_in_errors: 0 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.db_host_id: __hostname__ 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_background_jobs: 2 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_background_compactions: -1 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_subcompactions: 1 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_total_wal_size: 0 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-06T14:35:26.077 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_open_files: -1 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bytes_per_sync: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_readahead_size: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_background_flushes: -1 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Compression algorithms supported: 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kZSTD supported: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kXpressCompression supported: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kBZip2Compression supported: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-06T14:35:26.078 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kLZ4Compression supported: 1 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kZlibCompression supported: 1 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kLZ4HCCompression supported: 1 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: kSnappyCompression supported: 1 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000010 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.merge_operator: 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_filter: None 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_filter_factory: None 2024-09-06T14:35:26.079 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.sst_partitioner_factory: None 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559e63867520) 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks: 1 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_top_level_index_and_filter: 1 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_type: 0 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_index_type: 0 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_shortening: 1 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: checksum: 4 2024-09-06T14:35:26.080 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: no_block_cache: 0 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache: 0x559e6385b1f0 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_name: BinnedLRUCache 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_options: 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: capacity : 536870912 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: num_shard_bits : 4 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: strict_capacity_limit : 0 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: high_pri_pool_ratio: 0.000 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_compressed: (nil) 2024-09-06T14:35:26.081 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: persistent_cache: (nil) 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size: 4096 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size_deviation: 10 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_restart_interval: 16 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_block_restart_interval: 1 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: metadata_block_size: 4096 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: partition_filters: 0 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: use_delta_encoding: 1 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: filter_policy: bloomfilter 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: whole_key_filtering: 1 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: verify_compression: 0 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: read_amp_bytes_per_bit: 0 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: format_version: 5 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_index_compression: 1 2024-09-06T14:35:26.082 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_align: 0 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_auto_readahead_size: 262144 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: prepopulate_block_cache: 0 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: initial_auto_readahead_size: 8192 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: num_file_reads_for_auto_readahead: 2 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.write_buffer_size: 33554432 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_write_buffer_number: 2 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression: NoCompression 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression: Disabled 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.prefix_extractor: nullptr 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.num_levels: 7 2024-09-06T14:35:26.083 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-06T14:35:26.084 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.level: 32767 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.strategy: 0 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.enabled: false 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.target_file_size_base: 67108864 2024-09-06T14:35:26.085 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-06T14:35:26.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.arena_block_size: 1048576 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.disable_auto_compactions: 0 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-06T14:35:26.087 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.inplace_update_support: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.bloom_locality: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.max_successive_merges: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.paranoid_file_checks: 0 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.force_consistency_checks: 1 2024-09-06T14:35:26.088 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.report_bg_io_stats: 0 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.ttl: 2592000 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.enable_blob_files: false 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.min_blob_size: 0 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.blob_file_size: 268435456 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-06T14:35:26.089 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.blob_file_starting_level: 0 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a3eb0917-611d-460b-a246-16eb9ad84046 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725633326011646, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725633326012783, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89879, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83247, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725633326, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a3eb0917-611d-460b-a246-16eb9ad84046", "db_session_id": "I6M0NJRGKG63QBK1LGGJ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725633326012902, "job": 1, "event": "recovery_finished"} 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi052/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559e63888e00 2024-09-06T14:35:26.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: DB pointer 0x559e63984000 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** DB Stats ** 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:35:26.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: L0 2/0 91.58 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Sum 2/0 91.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 136.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-06T14:35:26.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative compaction: 0.00 GB write, 24.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval compaction: 0.00 GB write, 24.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Block cache BinnedLRUCache@0x559e6385b1f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-06T14:35:26.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: starting mon.smithi052 rank 0 at public addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] at bind addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi052 fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???) e1 preinit fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???).mds e1 new map 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???).mds e1 print_map 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: e1 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: btime 2024-09-06T14:35:20:909518+0000 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: legacy client fscid: -1 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: No filesystems configured 2024-09-06T14:35:26.094 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 bash[28608]: c729266bcb69489487eff41e9b530bd7f16c335f80f5fe930ce126991b6cdf71 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mon.smithi052 is new leader, mons smithi052 in quorum (ranks 0) 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: monmap epoch 1 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: last_changed 2024-09-06T14:35:08.459770+0000 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: min_mon_release 19 (squid) 2024-09-06T14:35:26.095 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: election_strategy: 1 2024-09-06T14:35:26.096 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:35:26.096 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: fsmap 2024-09-06T14:35:26.096 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: osdmap e1: 0 total, 0 up, 0 in 2024-09-06T14:35:26.096 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 ceph-mon[28627]: mgrmap e1: no daemons active 2024-09-06T14:35:26.096 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:26 smithi052 systemd[1]: Started Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:35:26.096 INFO:teuthology.orchestra.run.smithi052.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-06T14:35:26.994 INFO:teuthology.orchestra.run.smithi052.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-06T14:35:27.015 INFO:teuthology.orchestra.run.smithi052.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-06T14:35:27.016 INFO:teuthology.orchestra.run.smithi052.stdout:Creating mgr... 2024-09-06T14:35:27.016 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-06T14:35:27.017 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-06T14:35:27.017 INFO:teuthology.orchestra.run.smithi052.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-06T14:35:27.240 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mgr.smithi052.vsthpq 2024-09-06T14:35:27.240 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Failed to reset failed state of unit ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mgr.smithi052.vsthpq.service: Unit ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mgr.smithi052.vsthpq.service not loaded. 2024-09-06T14:35:27.389 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968.target.wants/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mgr.smithi052.vsthpq.service → /etc/systemd/system/ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@.service. 2024-09-06T14:35:27.764 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:27 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3977882642' entity='client.admin' 2024-09-06T14:35:27.935 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-06T14:35:27.935 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-06T14:35:27.943 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-06T14:35:27.943 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-06T14:35:27.943 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-06T14:35:27.943 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to enable service . firewalld.service is not available 2024-09-06T14:35:27.951 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-06T14:35:27.951 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-06T14:35:27.959 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-06T14:35:27.959 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-06T14:35:27.959 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-06T14:35:27.959 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-06T14:35:27.959 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr to start... 2024-09-06T14:35:27.959 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr... 2024-09-06T14:35:28.777 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:28 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/17005737' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-06T14:35:29.092 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:29.092 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-06T14:35:29.092 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsid": "14ffcc96-6c5d-11ef-bce4-c7b262605968", 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "health": { 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 0 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "smithi052" 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:29.093 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-06T14:35:29.094 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:29.095 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-06T14:35:29.097 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:29.097 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "btime": "2024-09-06T14:35:20:909518+0000", 2024-09-06T14:35:29.097 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "restful" 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-06T14:35:29.098 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:29.099 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modified": "2024-09-06T14:35:20.910163+0000", 2024-09-06T14:35:29.099 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T14:35:29.099 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:29.099 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-06T14:35:29.099 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-06T14:35:29.099 INFO:teuthology.orchestra.run.smithi052.stdout:mgr not available, waiting (1/15)... 2024-09-06T14:35:32.034 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:31 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/439570729' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-06T14:35:32.363 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsid": "14ffcc96-6c5d-11ef-bce4-c7b262605968", 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "health": { 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 0 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:32.366 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "smithi052" 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-06T14:35:32.367 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-06T14:35:32.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-06T14:35:32.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-06T14:35:32.368 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-06T14:35:32.371 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "btime": "2024-09-06T14:35:20:909518+0000", 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-06T14:35:32.372 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "restful" 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modified": "2024-09-06T14:35:20.910163+0000", 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-06T14:35:32.373 INFO:teuthology.orchestra.run.smithi052.stdout:mgr not available, waiting (2/15)... 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: Activating manager daemon smithi052.vsthpq 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: mgrmap e2: smithi052.vsthpq(active, starting, since 0.00309547s) 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: Manager daemon smithi052.vsthpq is now available 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:35:33.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/trash_purge_schedule"}]: dispatch 2024-09-06T14:35:33.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:33.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:33.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:32 smithi052 ceph-mon[28627]: from='mgr.14100 172.21.15.52:0/4262448047' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:35.103 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:34 smithi052 ceph-mon[28627]: mgrmap e3: smithi052.vsthpq(active, since 1.00721s) 2024-09-06T14:35:35.680 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:35.680 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-06T14:35:35.680 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsid": "14ffcc96-6c5d-11ef-bce4-c7b262605968", 2024-09-06T14:35:35.680 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "health": { 2024-09-06T14:35:35.680 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 0 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "smithi052" 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-06T14:35:35.681 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-06T14:35:35.682 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-06T14:35:35.686 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "btime": "2024-09-06T14:35:20:909518+0000", 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-06T14:35:35.687 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "restful" 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ], 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "modified": "2024-09-06T14:35:20.910163+0000", 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout }, 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-06T14:35:35.688 INFO:teuthology.orchestra.run.smithi052.stdout:mgr is available 2024-09-06T14:35:36.311 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:35 smithi052 ceph-mon[28627]: mgrmap e4: smithi052.vsthpq(active, since 2s) 2024-09-06T14:35:36.311 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:35 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2029747787' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [global] 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout fsid = 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.52:3300,v1:172.21.15.52:6789] 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-06T14:35:36.863 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout [osd] 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-06T14:35:36.864 INFO:teuthology.orchestra.run.smithi052.stdout:Enabling cephadm module... 2024-09-06T14:35:37.098 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:36 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/527214126' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-06T14:35:38.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:37 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1177675433' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-06T14:35:39.007 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:38 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1177675433' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-06T14:35:39.007 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:38 smithi052 ceph-mon[28627]: mgrmap e5: smithi052.vsthpq(active, since 5s) 2024-09-06T14:35:39.726 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-06T14:35:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-06T14:35:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-06T14:35:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "active_name": "smithi052.vsthpq", 2024-09-06T14:35:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-06T14:35:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-06T14:35:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for the mgr to restart... 2024-09-06T14:35:39.727 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr epoch 5... 2024-09-06T14:35:39.972 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:39 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1563247659' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: Active manager daemon smithi052.vsthpq restarted 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: Activating manager daemon smithi052.vsthpq 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: osdmap e2: 0 total, 0 up, 0 in 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: mgrmap e6: smithi052.vsthpq(active, starting, since 0.00354121s) 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:35:43.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: Manager daemon smithi052.vsthpq is now available 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: Found migration_current of "None". Setting to last migration. 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:35:43.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:43 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/trash_purge_schedule"}]: dispatch 2024-09-06T14:35:44.506 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-06T14:35:44.507 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-06T14:35:44.507 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-06T14:35:44.507 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-06T14:35:44.507 INFO:teuthology.orchestra.run.smithi052.stdout:mgr epoch 5 is available 2024-09-06T14:35:44.507 INFO:teuthology.orchestra.run.smithi052.stdout:Setting orchestrator backend to cephadm... 2024-09-06T14:35:45.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:44 smithi052 ceph-mon[28627]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-06T14:35:45.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:44 smithi052 ceph-mon[28627]: mgrmap e7: smithi052.vsthpq(active, since 1.00516s) 2024-09-06T14:35:45.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:44 smithi052 ceph-mon[28627]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-06T14:35:46.021 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:45 smithi052 ceph-mon[28627]: mgrmap e8: smithi052.vsthpq(active, since 2s) 2024-09-06T14:35:46.021 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:45 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:46.022 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:45 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:35:46.022 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:45 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:46.022 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:45 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:46.769 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-06T14:35:46.769 INFO:teuthology.orchestra.run.smithi052.stdout:Generating ssh key... 2024-09-06T14:35:47.161 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:46 smithi052 ceph-mon[28627]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:48.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:47 smithi052 ceph-mon[28627]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:47 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:47 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:47 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:48 smithi052 ceph-mon[28627]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:48 smithi052 ceph-mon[28627]: Generating ssh key... 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:48 smithi052 ceph-mon[28627]: [06/Sep/2024:14:35:47] ENGINE Bus STARTING 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:48 smithi052 ceph-mon[28627]: [06/Sep/2024:14:35:47] ENGINE Serving on https://172.21.15.52:7150 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:48 smithi052 ceph-mon[28627]: [06/Sep/2024:14:35:47] ENGINE Error in HTTPServer.serve 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Traceback (most recent call last): 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._connections.run(self.expiration_interval) 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T14:35:49.261 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._run(expiration_interval) 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s = self.context.wrap_socket( 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: return self.sslsocket_class._create( 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self.do_handshake() 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._sslobj.do_handshake() 2024-09-06T14:35:49.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T14:35:49.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:48 smithi052 ceph-mon[28627]: [06/Sep/2024:14:35:47] ENGINE Serving on http://172.21.15.52:8765 2024-09-06T14:35:49.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:48 smithi052 ceph-mon[28627]: [06/Sep/2024:14:35:47] ENGINE Bus STARTED 2024-09-06T14:35:49.266 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwcNzuiqikSfMGC1pCICR1UUbYFdy0jXd6jO61rQ0ZtBYWuRoqwqZrMgHvCa5bk4m3wX0Fg51KG6KEU4Xm4ZBEhLMfrFhdDfCi0JhmR/j15G+u97spjaCZkqjXPG31/6Zl1ljpbsSK6OfgyzbpiDHYIjDptGDhob1tyA42n5bTSINmAdBj8xY9XOHJ803DaSN8fvcVffNOoqr0omz9xakj14XGBV4A3pYDyo9nj2R8kTJqcP09Kz12Bu3twzt10Z7JtOvCoilvxJgQewuwrnonv+MA3MAenAp/V11k4PCCNu818/LGu7bPCJO7jN9VbsvSH5wXFuZPvNLrqsY5fG8vWgykEijwD3kct835+bQBgmmMhJ7DmEScb7QCtxftxjuUXNyARtO2O6rAPmtsR0DFEgpR1oKzZDNw9w+g0MiaHlofh2HrNyKjSToZGLVpuIn7/qE3NpkFkVluobb/aCQikhlSzUUXLylu1kRC/3fD9pK/NeB2KirKUOIFbhSRMmE= ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:35:49.266 INFO:teuthology.orchestra.run.smithi052.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-06T14:35:49.266 INFO:teuthology.orchestra.run.smithi052.stdout:Adding key to root@localhost authorized_keys... 2024-09-06T14:35:49.267 INFO:teuthology.orchestra.run.smithi052.stdout:Adding host smithi052... 2024-09-06T14:35:50.243 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:49 smithi052 ceph-mon[28627]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:51.193 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:50 smithi052 ceph-mon[28627]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi052", "addr": "172.21.15.52", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:52.104 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:52 smithi052 ceph-mon[28627]: Deploying cephadm binary to smithi052 2024-09-06T14:35:54.282 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Added host 'smithi052' with addr '172.21.15.52' 2024-09-06T14:35:54.282 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying mon service with default placement... 2024-09-06T14:35:55.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:54 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:54 smithi052 ceph-mon[28627]: Added host smithi052 2024-09-06T14:35:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:54 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:35:55.438 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-06T14:35:55.438 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying mgr service with default placement... 2024-09-06T14:35:56.352 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:55 smithi052 ceph-mon[28627]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:56.353 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:55 smithi052 ceph-mon[28627]: Saving service mon spec with placement count:5 2024-09-06T14:35:56.353 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:55 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:56.800 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-06T14:35:56.800 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying crash service with default placement... 2024-09-06T14:35:57.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:57 smithi052 ceph-mon[28627]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:57.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:57 smithi052 ceph-mon[28627]: Saving service mgr spec with placement count:2 2024-09-06T14:35:57.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:57 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:57.910 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-06T14:35:57.910 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying ceph-exporter service with default placement... 2024-09-06T14:35:58.483 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:58 smithi052 ceph-mon[28627]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:58.483 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:58 smithi052 ceph-mon[28627]: Saving service crash spec with placement * 2024-09-06T14:35:58.483 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:58 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:59.510 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-06T14:35:59.510 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying prometheus service with default placement... 2024-09-06T14:35:59.617 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:59 smithi052 ceph-mon[28627]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:35:59.617 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:59 smithi052 ceph-mon[28627]: Saving service ceph-exporter spec with placement * 2024-09-06T14:35:59.617 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:59 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:59.617 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:59 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:35:59.617 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:35:59 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:01.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:01 smithi052 ceph-mon[28627]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:01.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:01 smithi052 ceph-mon[28627]: Saving service prometheus spec with placement count:1 2024-09-06T14:36:01.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:01 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:01.209 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:01 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:01.212 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-06T14:36:01.212 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying grafana service with default placement... 2024-09-06T14:36:02.360 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-06T14:36:02.361 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying node-exporter service with default placement... 2024-09-06T14:36:02.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:02 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:02.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:02 smithi052 ceph-mon[28627]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:02.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:02 smithi052 ceph-mon[28627]: Saving service grafana spec with placement count:1 2024-09-06T14:36:02.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:02 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:03.585 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-06T14:36:03.585 INFO:teuthology.orchestra.run.smithi052.stdout:Deploying alertmanager service with default placement... 2024-09-06T14:36:04.136 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:03 smithi052 ceph-mon[28627]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:04.137 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:03 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:04.877 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-06T14:36:05.277 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:04 smithi052 ceph-mon[28627]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:05.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:04 smithi052 ceph-mon[28627]: Saving service node-exporter spec with placement * 2024-09-06T14:36:05.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:04 smithi052 ceph-mon[28627]: from='mgr.14118 172.21.15.52:0/2964977426' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:06.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:05 smithi052 ceph-mon[28627]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:06.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:05 smithi052 ceph-mon[28627]: Saving service alertmanager spec with placement count:1 2024-09-06T14:36:06.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:05 smithi052 ceph-mon[28627]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:06.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:05 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/209225847' entity='client.admin' 2024-09-06T14:36:07.468 INFO:teuthology.orchestra.run.smithi052.stdout:Enabling the dashboard module... 2024-09-06T14:36:08.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:07 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1427707763' entity='client.admin' 2024-09-06T14:36:08.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:07 smithi052 ceph-mon[28627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:09.279 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:08 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1294639360' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-06T14:36:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:09 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1294639360' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-06T14:36:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:09 smithi052 ceph-mon[28627]: mgrmap e9: smithi052.vsthpq(active, since 25s) 2024-09-06T14:36:10.782 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-06T14:36:10.782 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-06T14:36:10.782 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-06T14:36:10.782 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "active_name": "smithi052.vsthpq", 2024-09-06T14:36:10.782 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-06T14:36:10.782 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-06T14:36:10.782 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for the mgr to restart... 2024-09-06T14:36:10.783 INFO:teuthology.orchestra.run.smithi052.stdout:Waiting for mgr epoch 9... 2024-09-06T14:36:11.029 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:10 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3232420079' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-06T14:36:14.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: Active manager daemon smithi052.vsthpq restarted 2024-09-06T14:36:14.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: Activating manager daemon smithi052.vsthpq 2024-09-06T14:36:14.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: osdmap e3: 0 total, 0 up, 0 in 2024-09-06T14:36:14.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: mgrmap e10: smithi052.vsthpq(active, starting, since 0.00322881s) 2024-09-06T14:36:14.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: Manager daemon smithi052.vsthpq is now available 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:36:14.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:14 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/trash_purge_schedule"}]: dispatch 2024-09-06T14:36:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout { 2024-09-06T14:36:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-06T14:36:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-06T14:36:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout } 2024-09-06T14:36:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:mgr epoch 9 is available 2024-09-06T14:36:15.901 INFO:teuthology.orchestra.run.smithi052.stdout:Generating a dashboard self-signed certificate... 2024-09-06T14:36:16.342 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:16 smithi052 ceph-mon[28627]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-06T14:36:16.342 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:16 smithi052 ceph-mon[28627]: mgrmap e11: smithi052.vsthpq(active, since 1.00537s) 2024-09-06T14:36:16.342 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:16 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:16.342 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:16 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:17.125 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-06T14:36:17.125 INFO:teuthology.orchestra.run.smithi052.stdout:Creating initial admin user... 2024-09-06T14:36:17.348 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:17 smithi052 ceph-mon[28627]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-06T14:36:17.349 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:17 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:17.349 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:17 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:17.349 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:17 smithi052 ceph-mon[28627]: mgrmap e12: smithi052.vsthpq(active, since 2s) 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:18 smithi052 ceph-mon[28627]: [06/Sep/2024:14:36:16] ENGINE Bus STARTING 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:18 smithi052 ceph-mon[28627]: [06/Sep/2024:14:36:16] ENGINE Serving on http://172.21.15.52:8765 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:18 smithi052 ceph-mon[28627]: [06/Sep/2024:14:36:16] ENGINE Serving on https://172.21.15.52:7150 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:18 smithi052 ceph-mon[28627]: [06/Sep/2024:14:36:16] ENGINE Bus STARTED 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:18 smithi052 ceph-mon[28627]: [06/Sep/2024:14:36:16] ENGINE Error in HTTPServer.serve 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Traceback (most recent call last): 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._connections.run(self.expiration_interval) 2024-09-06T14:36:18.249 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._run(expiration_interval) 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s = self.context.wrap_socket( 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: return self.sslsocket_class._create( 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self.do_handshake() 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._sslobj.do_handshake() 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T14:36:18.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:18 smithi052 ceph-mon[28627]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:19.445 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$m49VY0ZNqQJ886HF8mXiM.XPc/TOjcjdKirUCSXyQQZdiwpwu0J.O", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725633378, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-06T14:36:19.445 INFO:teuthology.orchestra.run.smithi052.stdout:Fetching dashboard port number... 2024-09-06T14:36:20.031 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:19 smithi052 ceph-mon[28627]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:20.031 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:19 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:20.576 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stdout 8443 2024-09-06T14:36:20.585 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-06T14:36:20.585 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout disabled 2024-09-06T14:36:20.592 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-06T14:36:20.592 INFO:teuthology.orchestra.run.smithi052.stdout:systemctl: stdout inactive 2024-09-06T14:36:20.592 INFO:teuthology.orchestra.run.smithi052.stdout:firewalld.service is not enabled 2024-09-06T14:36:20.592 INFO:teuthology.orchestra.run.smithi052.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-06T14:36:20.594 INFO:teuthology.orchestra.run.smithi052.stdout:Ceph Dashboard is now available at: 2024-09-06T14:36:20.594 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:20.594 INFO:teuthology.orchestra.run.smithi052.stdout: URL: https://smithi052:8443/ 2024-09-06T14:36:20.594 INFO:teuthology.orchestra.run.smithi052.stdout: User: admin 2024-09-06T14:36:20.594 INFO:teuthology.orchestra.run.smithi052.stdout: Password: u5g1r2ik43 2024-09-06T14:36:20.594 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:20.595 INFO:teuthology.orchestra.run.smithi052.stdout:Saving cluster configuration to /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config directory 2024-09-06T14:36:21.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:20 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2239111292' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-06T14:36:21.775 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-06T14:36:21.775 INFO:teuthology.orchestra.run.smithi052.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-06T14:36:21.775 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.775 INFO:teuthology.orchestra.run.smithi052.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-06T14:36:21.775 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout:Or, if you are only running a single cluster on this host: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: ceph telemetry on 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout:For more information see: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-06T14:36:21.776 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:21.777 INFO:teuthology.orchestra.run.smithi052.stdout:Bootstrap complete. 2024-09-06T14:36:21.817 INFO:tasks.cephadm:Fetching config... 2024-09-06T14:36:21.817 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:36:21.817 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-06T14:36:21.833 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-06T14:36:21.833 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:36:21.834 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-06T14:36:21.889 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-06T14:36:21.890 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:36:21.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/keyring of=/dev/stdout 2024-09-06T14:36:21.954 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-06T14:36:21.954 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:36:21.955 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-06T14:36:22.009 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-06T14:36:22.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwcNzuiqikSfMGC1pCICR1UUbYFdy0jXd6jO61rQ0ZtBYWuRoqwqZrMgHvCa5bk4m3wX0Fg51KG6KEU4Xm4ZBEhLMfrFhdDfCi0JhmR/j15G+u97spjaCZkqjXPG31/6Zl1ljpbsSK6OfgyzbpiDHYIjDptGDhob1tyA42n5bTSINmAdBj8xY9XOHJ803DaSN8fvcVffNOoqr0omz9xakj14XGBV4A3pYDyo9nj2R8kTJqcP09Kz12Bu3twzt10Z7JtOvCoilvxJgQewuwrnonv+MA3MAenAp/V11k4PCCNu818/LGu7bPCJO7jN9VbsvSH5wXFuZPvNLrqsY5fG8vWgykEijwD3kct835+bQBgmmMhJ7DmEScb7QCtxftxjuUXNyARtO2O6rAPmtsR0DFEgpR1oKzZDNw9w+g0MiaHlofh2HrNyKjSToZGLVpuIn7/qE3NpkFkVluobb/aCQikhlSzUUXLylu1kRC/3fD9pK/NeB2KirKUOIFbhSRMmE= ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-06T14:36:22.070 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:21 smithi052 ceph-mon[28627]: mgrmap e13: smithi052.vsthpq(active, since 6s) 2024-09-06T14:36:22.070 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:21 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4043041939' entity='client.admin' 2024-09-06T14:36:22.083 INFO:teuthology.orchestra.run.smithi052.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwcNzuiqikSfMGC1pCICR1UUbYFdy0jXd6jO61rQ0ZtBYWuRoqwqZrMgHvCa5bk4m3wX0Fg51KG6KEU4Xm4ZBEhLMfrFhdDfCi0JhmR/j15G+u97spjaCZkqjXPG31/6Zl1ljpbsSK6OfgyzbpiDHYIjDptGDhob1tyA42n5bTSINmAdBj8xY9XOHJ803DaSN8fvcVffNOoqr0omz9xakj14XGBV4A3pYDyo9nj2R8kTJqcP09Kz12Bu3twzt10Z7JtOvCoilvxJgQewuwrnonv+MA3MAenAp/V11k4PCCNu818/LGu7bPCJO7jN9VbsvSH5wXFuZPvNLrqsY5fG8vWgykEijwD3kct835+bQBgmmMhJ7DmEScb7QCtxftxjuUXNyARtO2O6rAPmtsR0DFEgpR1oKzZDNw9w+g0MiaHlofh2HrNyKjSToZGLVpuIn7/qE3NpkFkVluobb/aCQikhlSzUUXLylu1kRC/3fD9pK/NeB2KirKUOIFbhSRMmE= ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:36:22.094 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwcNzuiqikSfMGC1pCICR1UUbYFdy0jXd6jO61rQ0ZtBYWuRoqwqZrMgHvCa5bk4m3wX0Fg51KG6KEU4Xm4ZBEhLMfrFhdDfCi0JhmR/j15G+u97spjaCZkqjXPG31/6Zl1ljpbsSK6OfgyzbpiDHYIjDptGDhob1tyA42n5bTSINmAdBj8xY9XOHJ803DaSN8fvcVffNOoqr0omz9xakj14XGBV4A3pYDyo9nj2R8kTJqcP09Kz12Bu3twzt10Z7JtOvCoilvxJgQewuwrnonv+MA3MAenAp/V11k4PCCNu818/LGu7bPCJO7jN9VbsvSH5wXFuZPvNLrqsY5fG8vWgykEijwD3kct835+bQBgmmMhJ7DmEScb7QCtxftxjuUXNyARtO2O6rAPmtsR0DFEgpR1oKzZDNw9w+g0MiaHlofh2HrNyKjSToZGLVpuIn7/qE3NpkFkVluobb/aCQikhlSzUUXLylu1kRC/3fD9pK/NeB2KirKUOIFbhSRMmE= ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-06T14:36:22.135 INFO:teuthology.orchestra.run.smithi165.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwcNzuiqikSfMGC1pCICR1UUbYFdy0jXd6jO61rQ0ZtBYWuRoqwqZrMgHvCa5bk4m3wX0Fg51KG6KEU4Xm4ZBEhLMfrFhdDfCi0JhmR/j15G+u97spjaCZkqjXPG31/6Zl1ljpbsSK6OfgyzbpiDHYIjDptGDhob1tyA42n5bTSINmAdBj8xY9XOHJ803DaSN8fvcVffNOoqr0omz9xakj14XGBV4A3pYDyo9nj2R8kTJqcP09Kz12Bu3twzt10Z7JtOvCoilvxJgQewuwrnonv+MA3MAenAp/V11k4PCCNu818/LGu7bPCJO7jN9VbsvSH5wXFuZPvNLrqsY5fG8vWgykEijwD3kct835+bQBgmmMhJ7DmEScb7QCtxftxjuUXNyARtO2O6rAPmtsR0DFEgpR1oKzZDNw9w+g0MiaHlofh2HrNyKjSToZGLVpuIn7/qE3NpkFkVluobb/aCQikhlSzUUXLylu1kRC/3fD9pK/NeB2KirKUOIFbhSRMmE= ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:36:22.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-06T14:36:22.429 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:36:23.754 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-06T14:36:23.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-06T14:36:24.182 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:36:24.360 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:24 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3271918247' entity='client.admin' 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:36:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:26 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:36:26.434 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi165 2024-09-06T14:36:26.434 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:36:26.434 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.conf 2024-09-06T14:36:26.453 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:36:26.454 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:36:26.511 INFO:tasks.cephadm:Adding host smithi165 to orchestrator... 2024-09-06T14:36:26.512 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch host add smithi165 2024-09-06T14:36:26.764 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:36:27.744 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:36:27.744 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:36:27.744 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:27.744 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:27.744 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:27.744 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:36:27.745 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-06T14:36:27.745 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:36:27.745 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:27 smithi052 ceph-mon[28627]: Deploying daemon ceph-exporter.smithi052 on smithi052 2024-09-06T14:36:28.785 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:28 smithi052 ceph-mon[28627]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi165", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: Deploying cephadm binary to smithi165 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-06T14:36:29.839 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:29 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:36:30.642 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:30 smithi052 ceph-mon[28627]: Deploying daemon crash.smithi052 on smithi052 2024-09-06T14:36:31.371 INFO:teuthology.orchestra.run.smithi052.stdout:Added host 'smithi165' with addr '172.21.15.165' 2024-09-06T14:36:32.041 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch host ls --format=json 2024-09-06T14:36:32.313 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:36:32.544 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:32 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:32.544 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:32 smithi052 ceph-mon[28627]: Added host smithi165 2024-09-06T14:36:32.544 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:32 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:32.544 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:32 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:32.544 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:32 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:32.544 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:32 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:32.927 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:36:32.927 INFO:teuthology.orchestra.run.smithi052.stdout:[{"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}, {"addr": "172.21.15.165", "hostname": "smithi165", "labels": [], "status": ""}] 2024-09-06T14:36:33.510 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:33 smithi052 ceph-mon[28627]: Deploying daemon node-exporter.smithi052 on smithi052 2024-09-06T14:36:33.510 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:33 smithi052 ceph-mon[28627]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T14:36:33.538 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-06T14:36:33.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd crush tunables default 2024-09-06T14:36:33.804 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:36:34.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:34 smithi052 ceph-mon[28627]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:34.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:34 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:35.373 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-09-06T14:36:35.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:35 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1449882288' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-06T14:36:36.534 INFO:tasks.cephadm:Adding mon.smithi052 on smithi052 2024-09-06T14:36:36.534 INFO:tasks.cephadm:Adding mon.smithi165 on smithi165 2024-09-06T14:36:36.535 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch apply mon '2;smithi052:172.21.15.52=smithi052;smithi165:172.21.15.165=smithi165' 2024-09-06T14:36:36.733 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:36 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1449882288' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-06T14:36:36.733 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:36 smithi052 ceph-mon[28627]: osdmap e4: 0 total, 0 up, 0 in 2024-09-06T14:36:36.733 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:36 smithi052 ceph-mon[28627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:36.799 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:36.844 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:37.448 INFO:teuthology.orchestra.run.smithi165.stdout:Scheduled mon update... 2024-09-06T14:36:38.080 DEBUG:teuthology.orchestra.run.smithi165:mon.smithi165> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi165.service 2024-09-06T14:36:38.082 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:38.083 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:38.354 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:38.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:37 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:38.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:37 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:38.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:37 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:38.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:37 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:38.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:37 smithi052 ceph-mon[28627]: Deploying daemon alertmanager.smithi052 on smithi052 2024-09-06T14:36:38.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:37 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:38.398 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:39.068 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:39.068 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:39.069 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:39.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:38 smithi052 ceph-mon[28627]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi052:172.21.15.52=smithi052;smithi165:172.21.15.165=smithi165", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:36:39.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:38 smithi052 ceph-mon[28627]: Saving service mon spec with placement smithi052:172.21.15.52=smithi052;smithi165:172.21.15.165=smithi165;count:2 2024-09-06T14:36:39.248 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:38 smithi052 ceph-mon[28627]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:40.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:40 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:40.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:40 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/2907265078' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:40.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:40 smithi052 ceph-mon[28627]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:40.656 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:40.657 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:40.903 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:40.948 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:41.574 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:41.575 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:41.575 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:42.106 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:41 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/2802571118' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:43.110 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:42 smithi052 ceph-mon[28627]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:43.195 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:43.195 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:43.438 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:43.483 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:44.171 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:44.171 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:44.171 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:44.276 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:44 smithi052 ceph-mon[28627]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/1399673718' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:45 smithi052 ceph-mon[28627]: Deploying daemon grafana.smithi052 on smithi052 2024-09-06T14:36:45.797 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:45.797 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:46.042 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:46.086 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:46.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:46 smithi052 ceph-mon[28627]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:46.970 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:46.970 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:46.971 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:47.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:47 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/3757098277' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:48.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:48 smithi052 ceph-mon[28627]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:48.575 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:48.575 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:48.820 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:48.864 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:49.490 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:49.490 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:49.491 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:50 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:50 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/3456722444' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:50 smithi052 ceph-mon[28627]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:51.072 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:51.072 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:51.315 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:51.359 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:52.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:52 smithi052 ceph-mon[28627]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:52.372 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:52.372 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:52.373 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:53.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:53 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/1135295907' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:53.972 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:53.972 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:54.212 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:54.257 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:54.940 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:54.941 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:54.941 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:55.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:55.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:54 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:36:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:55 smithi052 ceph-mon[28627]: Deploying daemon prometheus.smithi052 on smithi052 2024-09-06T14:36:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:55 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/3118427295' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:56.509 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:56.509 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:56.754 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:56.799 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:57.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:56 smithi052 ceph-mon[28627]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:57.432 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:57.432 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:57.432 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:36:58.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:57 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/4006482483' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:36:59.041 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:36:59.041 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:36:59.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:58 smithi052 ceph-mon[28627]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:36:59.287 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:59.332 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:36:59.931 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:36:59.931 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:36:59.931 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:36:59 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/1319128944' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:01.121 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:00 smithi052 ceph-mon[28627]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:01.598 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:01.598 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:01.837 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:01.881 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:02.255 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:02 smithi052 ceph-mon[28627]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:02.545 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:02.546 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:02.546 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:03.246 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:03 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/2240137075' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:04.082 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:04.083 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:04.187 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:04 smithi052 ceph-mon[28627]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:04.317 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:04.362 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:05.070 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:05.070 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:05.070 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:05 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:05 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:05 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:05 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-06T14:37:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:05 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/2354193073' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:06.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:06 smithi052 ceph-mon[28627]: from='mgr.14162 172.21.15.52:0/1574547714' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-06T14:37:06.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:06 smithi052 ceph-mon[28627]: mgrmap e14: smithi052.vsthpq(active, since 51s) 2024-09-06T14:37:06.690 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:06.690 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:06.933 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:06.978 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:07.606 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:07.606 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:07.606 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:07.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:07 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/2342654210' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:09.211 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:09.212 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:09.457 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:09.501 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:10.142 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:10.143 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:10.143 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:10.485 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:10 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/498724087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:11.451 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: Active manager daemon smithi052.vsthpq restarted 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: Activating manager daemon smithi052.vsthpq 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: osdmap e5: 0 total, 0 up, 0 in 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: mgrmap e15: smithi052.vsthpq(active, starting, since 0.0034393s) 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: Manager daemon smithi052.vsthpq is now available 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:37:11.452 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:11.453 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:37:11.453 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:37:11.453 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/trash_purge_schedule"}]: dispatch 2024-09-06T14:37:11.453 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:11.803 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:11.803 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:12.047 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:12.093 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:12.580 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:12 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:12.580 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:12 smithi052 ceph-mon[28627]: mgrmap e16: smithi052.vsthpq(active, since 1.00516s) 2024-09-06T14:37:12.580 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:12 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:12.744 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:12.744 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:12.744 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:13.511 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:13 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/353282832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:14.527 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:14 smithi052 ceph-mon[28627]: [06/Sep/2024:14:37:12] ENGINE Bus STARTING 2024-09-06T14:37:14.527 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:14 smithi052 ceph-mon[28627]: [06/Sep/2024:14:37:12] ENGINE Serving on http://172.21.15.52:8765 2024-09-06T14:37:14.527 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:14 smithi052 ceph-mon[28627]: [06/Sep/2024:14:37:12] ENGINE Serving on https://172.21.15.52:7150 2024-09-06T14:37:14.527 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:14 smithi052 ceph-mon[28627]: [06/Sep/2024:14:37:12] ENGINE Bus STARTED 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:14 smithi052 ceph-mon[28627]: [06/Sep/2024:14:37:12] ENGINE Error in HTTPServer.serve 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Traceback (most recent call last): 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._connections.run(self.expiration_interval) 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._run(expiration_interval) 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T14:37:14.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s = self.context.wrap_socket( 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: return self.sslsocket_class._create( 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self.do_handshake() 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._sslobj.do_handshake() 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T14:37:14.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:14 smithi052 ceph-mon[28627]: mgrmap e17: smithi052.vsthpq(active, since 2s) 2024-09-06T14:37:14.708 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:14.709 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:14.977 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:15.034 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-06T14:37:15.962 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:15.962 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:15.963 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:16.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:16.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:16.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:16.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/541813832' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd/host:smithi165", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:37:17.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:16 smithi052 ceph-mon[28627]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-06T14:37:17.938 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:17.938 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:18.355 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:18.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:37:18.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-06T14:37:18.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:18.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:18 smithi052 ceph-mon[28627]: Deploying daemon ceph-exporter.smithi165 on smithi165 2024-09-06T14:37:19.172 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:19.173 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:19.173 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:19.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:19 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/3122861868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:20.856 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:20.857 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:21 smithi052 ceph-mon[28627]: Deploying daemon crash.smithi165 on smithi165 2024-09-06T14:37:21.751 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:22.512 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:22.513 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:22.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:22 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/3870459203' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:24.149 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:24.149 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:24.436 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:24.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:24 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:24.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:24 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:24.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:24 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:24.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:24 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:24.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:24 smithi052 ceph-mon[28627]: Deploying daemon node-exporter.smithi165 on smithi165 2024-09-06T14:37:25.161 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:25.162 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:25.162 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:25.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:25 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/760696057' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:25.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:25.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:37:27.367 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:27.368 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:27.639 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:28.323 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:28.324 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:28.324 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: Deploying daemon mgr.smithi165.hcexoi on smithi165 2024-09-06T14:37:28.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:28 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/397945113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:29.982 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:29.982 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:30.326 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:31.063 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:31.064 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:31.064 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:31.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:31 smithi052 ceph-mon[28627]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:31.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:31 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:31.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:31 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/2579911140' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: Deploying daemon mon.smithi165 on smithi165 2024-09-06T14:37:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:32 smithi052 ceph-mon[28627]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:32.908 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:32.908 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:33.707 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:35.005 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:35.006 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:35:08.459770Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-06T14:37:35.006 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-06T14:37:35.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:35 smithi052 ceph-mon[28627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:35.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:35 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/4217256003' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:35.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:36.250 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:35 smithi165 systemd[1]: Started Ceph mon.smithi165 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:37:36.729 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-06T14:37:36.729 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mon dump -f json 2024-09-06T14:37:36.975 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:37:41.299 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:37:41.299 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":2,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","modified":"2024-09-06T14:37:35.973434Z","created":"2024-09-06T14:35:08.459770Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi052","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi165","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3300","nonce":0},{"type":"v1","addr":"172.21.15.165:6789","nonce":0}]},"addr":"172.21.15.165:6789/0","public_addr":"172.21.15.165:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-06T14:37:41.299 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 2 2024-09-06T14:37:41.300 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:37:41.300 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: mon.smithi052 calling monitor election 2024-09-06T14:37:41.300 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.300 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:41.300 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:37:41.300 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.300 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: mon.smithi165 calling monitor election 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: mon.smithi052 is new leader, mons smithi052,smithi165 in quorum (ranks 0,1) 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: monmap epoch 2 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: last_changed 2024-09-06T14:37:35.973434+0000 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:37:41.301 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: min_mon_release 19 (squid) 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: election_strategy: 1 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: fsmap 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: osdmap e5: 0 total, 0 up, 0 in 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: mgrmap e17: smithi052.vsthpq(active, since 30s) 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: overall HEALTH_OK 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:37:41.302 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.303 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.303 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:37:41.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: mon.smithi052 calling monitor election 2024-09-06T14:37:41.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:41.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:37:41.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: mon.smithi165 calling monitor election 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: mon.smithi052 is new leader, mons smithi052,smithi165 in quorum (ranks 0,1) 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: monmap epoch 2 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: last_changed 2024-09-06T14:37:35.973434+0000 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:37:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: min_mon_release 19 (squid) 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: election_strategy: 1 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: fsmap 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: osdmap e5: 0 total, 0 up, 0 in 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: mgrmap e17: smithi052.vsthpq(active, since 30s) 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: overall HEALTH_OK 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:37:41.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/1764965688' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:37:41.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:41.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:42.030 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-06T14:37:42.031 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config generate-minimal-conf 2024-09-06T14:37:42.298 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:42 smithi165 ceph-mon[36229]: mgrmap e18: smithi052.vsthpq(active, since 30s), standbys: smithi165.hcexoi 2024-09-06T14:37:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi165.hcexoi", "id": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:37:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:37:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:42 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/818823713' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:42.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:42 smithi052 ceph-mon[28627]: mgrmap e18: smithi052.vsthpq(active, since 30s), standbys: smithi165.hcexoi 2024-09-06T14:37:42.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi165.hcexoi", "id": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:37:42.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:37:42.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:42 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/818823713' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-06T14:37:42.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:37:42.873 INFO:teuthology.orchestra.run.smithi052.stdout:# minimal ceph.conf for 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:37:42.873 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-06T14:37:42.873 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:37:42.874 INFO:teuthology.orchestra.run.smithi052.stdout: mon_host = [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] 2024-09-06T14:37:43.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:43 smithi165 ceph-mon[36229]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:43.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:43 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1096964352' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:43.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:43 smithi052 ceph-mon[28627]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:43.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:43 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1096964352' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:43.521 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-06T14:37:43.521 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:37:43.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.conf 2024-09-06T14:37:43.550 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:37:43.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:37:43.615 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:37:43.616 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.conf 2024-09-06T14:37:43.643 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:37:43.643 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:37:43.707 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-06T14:37:43.708 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-06T14:37:43.710 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-06T14:37:43.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set client debug_client 20 2024-09-06T14:37:43.753 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-06T14:37:43.753 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set client debug_ms 1 2024-09-06T14:37:43.796 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-06T14:37:43.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-06T14:37:43.839 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-06T14:37:43.840 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-06T14:37:43.887 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-06T14:37:43.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-06T14:37:43.934 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-06T14:37:43.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-06T14:37:43.989 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-06T14:37:43.990 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-06T14:37:44.035 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-06T14:37:44.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-06T14:37:44.067 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:44.070 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-06T14:37:44.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-06T14:37:44.127 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-06T14:37:44.127 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-06T14:37:44.172 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-06T14:37:44.172 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-06T14:37:44.217 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-06T14:37:44.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-06T14:37:44.260 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-06T14:37:44.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-06T14:37:44.305 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-06T14:37:44.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-06T14:37:44.349 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-06T14:37:44.349 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-06T14:37:44.411 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-06T14:37:44.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-06T14:37:44.459 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-06T14:37:44.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-06T14:37:44.510 DEBUG:tasks.cephadm:set 18 configs 2024-09-06T14:37:44.511 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi052') 2024-09-06T14:37:44.582 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.582 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.583 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:44.844 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:44.929 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:45.096 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:45.096 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:45.096 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:45.695 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:45 smithi052 ceph-mon[28627]: Reconfiguring mon.smithi052 (unknown last config time)... 2024-09-06T14:37:45.695 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:45 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:37:45.695 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:45 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:37:45.695 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:45 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:45.695 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:45 smithi052 ceph-mon[28627]: Reconfiguring daemon mon.smithi052 on smithi052 2024-09-06T14:37:45.695 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:45 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3907747096' entity='client.admin' 2024-09-06T14:37:45.696 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:45 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:45 smithi165 ceph-mon[36229]: Reconfiguring mon.smithi052 (unknown last config time)... 2024-09-06T14:37:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:45 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:37:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:45 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:37:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:45 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:45 smithi165 ceph-mon[36229]: Reconfiguring daemon mon.smithi052 on smithi052 2024-09-06T14:37:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:45 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3907747096' entity='client.admin' 2024-09-06T14:37:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:45 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:46.658 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:46.662 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:47 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/255348450' entity='client.admin' 2024-09-06T14:37:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:47 smithi052 ceph-mon[28627]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:47.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:47 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4018749021' entity='client.admin' 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.551+0000 7f102c79b640 1 -- 172.21.15.52:0/3765955199 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f101006deb0 msgr2=0x7f1010070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.551+0000 7f102c79b640 1 --2- 172.21.15.52:0/3765955199 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f101006deb0 0x7f1010070370 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f10200096c0 tx=0x7f1020004d60 comp rx=0 tx=0).stop 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.551+0000 7f102c79b640 1 -- 172.21.15.52:0/3765955199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1024196ef0 msgr2=0x7f102419bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.551+0000 7f102c79b640 1 --2- 172.21.15.52:0/3765955199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1024196ef0 0x7f102419bef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f101400b490 tx=0x7f101400b950 comp rx=0 tx=0).stop 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.551+0000 7f102c79b640 1 -- 172.21.15.52:0/3765955199 shutdown_connections 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.552+0000 7f102c79b640 1 --2- 172.21.15.52:0/3765955199 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f101006deb0 0x7f1010070370 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.552+0000 7f102c79b640 1 --2- 172.21.15.52:0/3765955199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1024196ef0 0x7f102419bef0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.552+0000 7f102c79b640 1 --2- 172.21.15.52:0/3765955199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1024100540 0x7f10241969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.552+0000 7f102c79b640 1 -- 172.21.15.52:0/3765955199 >> 172.21.15.52:0/3765955199 conn(0x7f10240fbcd0 msgr2=0x7f10240fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:47.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.552+0000 7f102c79b640 1 -- 172.21.15.52:0/3765955199 shutdown_connections 2024-09-06T14:37:47.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:47.552+0000 7f102c79b640 1 -- 172.21.15.52:0/3765955199 wait complete. 2024-09-06T14:37:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:47 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/255348450' entity='client.admin' 2024-09-06T14:37:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:47 smithi165 ceph-mon[36229]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:47 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/4018749021' entity='client.admin' 2024-09-06T14:37:48.458 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:48 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2086824549' entity='client.admin' 2024-09-06T14:37:48.458 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:48 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3765955199' entity='client.admin' 2024-09-06T14:37:48.458 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:48 smithi052 ceph-mon[28627]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:48 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2086824549' entity='client.admin' 2024-09-06T14:37:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:48 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3765955199' entity='client.admin' 2024-09-06T14:37:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:48 smithi165 ceph-mon[36229]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.868+0000 7fea4d630640 1 -- 172.21.15.52:0/1623728560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 msgr2=0x7fea48074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:49.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.868+0000 7fea4d630640 1 --2- 172.21.15.52:0/1623728560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48074680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fea40009c20 tx=0x7fea4002aa90 comp rx=0 tx=0).stop 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.868+0000 7fea4d630640 1 -- 172.21.15.52:0/1623728560 shutdown_connections 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.868+0000 7fea4d630640 1 --2- 172.21.15.52:0/1623728560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48074680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.868+0000 7fea4d630640 1 -- 172.21.15.52:0/1623728560 >> 172.21.15.52:0/1623728560 conn(0x7fea480fcdb0 msgr2=0x7fea480ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 -- 172.21.15.52:0/1623728560 shutdown_connections 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 -- 172.21.15.52:0/1623728560 wait complete. 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 Processor -- start 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 -- start start 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:49.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea481992d0 0x7fea4819e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea48109790 con 0x7fea48076220 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea4d630640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fea48109610 con 0x7fea481992d0 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.869+0000 7fea46ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea46ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33280/0 (socket says 172.21.15.52:33280) 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea46ffd640 1 -- 172.21.15.52:0/911432440 learned_addr learned my addr 172.21.15.52:0/911432440 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea46ffd640 1 -- 172.21.15.52:0/911432440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea481992d0 msgr2=0x7fea4819e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea467fc640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea481992d0 0x7fea4819e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea46ffd640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea481992d0 0x7fea4819e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea46ffd640 1 -- 172.21.15.52:0/911432440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea48199800 con 0x7fea48076220 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea467fc640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea481992d0 0x7fea4819e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:37:49.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea46ffd640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48198d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea40006010 tx=0x7fea4002f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea3ffff640 1 -- 172.21.15.52:0/911432440 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea40047070 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4819e7d0 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea3ffff640 1 -- 172.21.15.52:0/911432440 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fea40003e10 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea3ffff640 1 -- 172.21.15.52:0/911432440 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea40033050 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.870+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea4819eca0 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.871+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea48109f30 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.872+0000 7fea3ffff640 1 -- 172.21.15.52:0/911432440 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fea4004a070 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.872+0000 7fea3ffff640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fea3406deb0 0x7fea34070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.872+0000 7fea467fc640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fea3406deb0 0x7fea34070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.872+0000 7fea3ffff640 1 -- 172.21.15.52:0/911432440 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fea4003e030 con 0x7fea48076220 2024-09-06T14:37:49.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.872+0000 7fea467fc640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fea3406deb0 0x7fea34070370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea30007920 tx=0x7fea30008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:49.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:49.877+0000 7fea3ffff640 1 -- 172.21.15.52:0/911432440 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fea4007c9a0 con 0x7fea48076220 2024-09-06T14:37:50.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.053+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fea4802db50 con 0x7fea48076220 2024-09-06T14:37:50.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.056+0000 7fea3ffff640 1 -- 172.21.15.52:0/911432440 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v16)=0 v16) ==== 108+0+0 (secure 0 0 0) 0x7fea40080650 con 0x7fea48076220 2024-09-06T14:37:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fea3406deb0 msgr2=0x7fea34070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fea3406deb0 0x7fea34070370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fea30007920 tx=0x7fea30008040 comp rx=0 tx=0).stop 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 msgr2=0x7fea48198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48198d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea40006010 tx=0x7fea4002f9e0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 shutdown_connections 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fea3406deb0 0x7fea34070370 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea481992d0 0x7fea4819e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 --2- 172.21.15.52:0/911432440 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea48076220 0x7fea48198d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 >> 172.21.15.52:0/911432440 conn(0x7fea480fcdb0 msgr2=0x7fea480fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 shutdown_connections 2024-09-06T14:37:50.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.058+0000 7fea4d630640 1 -- 172.21.15.52:0/911432440 wait complete. 2024-09-06T14:37:50.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.061+0000 7f3e81f28640 1 -- 172.21.15.52:0/4201215733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 msgr2=0x7f3e7c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.061+0000 7f3e81f28640 1 --2- 172.21.15.52:0/4201215733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c100940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009880 tx=0x7f3e6c02a5d0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.061+0000 7f3e81f28640 1 -- 172.21.15.52:0/4201215733 shutdown_connections 2024-09-06T14:37:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.061+0000 7f3e81f28640 1 --2- 172.21.15.52:0/4201215733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c100940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.061+0000 7f3e81f28640 1 -- 172.21.15.52:0/4201215733 >> 172.21.15.52:0/4201215733 conn(0x7f3e7c0fbcd0 msgr2=0x7f3e7c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.062+0000 7f3e81f28640 1 -- 172.21.15.52:0/4201215733 shutdown_connections 2024-09-06T14:37:50.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.062+0000 7f3e81f28640 1 -- 172.21.15.52:0/4201215733 wait complete. 2024-09-06T14:37:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.062+0000 7f3e81f28640 1 Processor -- start 2024-09-06T14:37:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.062+0000 7f3e81f28640 1 -- start start 2024-09-06T14:37:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.062+0000 7f3e81f28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e81f28640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e7c1992d0 0x7f3e7c19e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e81f28640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c106460 con 0x7f3e7c100540 2024-09-06T14:37:50.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e81f28640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1062e0 con 0x7f3e7c1992d0 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33308/0 (socket says 172.21.15.52:33308) 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e7b7fe640 1 -- 172.21.15.52:0/547759590 learned_addr learned my addr 172.21.15.52:0/547759590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e73fff640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e7c1992d0 0x7f3e7c19e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e7b7fe640 1 -- 172.21.15.52:0/547759590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e7c1992d0 msgr2=0x7f3e7c19e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e7b7fe640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e7c1992d0 0x7f3e7c19e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e7b7fe640 1 -- 172.21.15.52:0/547759590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c199800 con 0x7f3e7c100540 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.063+0000 7f3e7b7fe640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c198d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c005940 tx=0x7f3e6c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.064+0000 7f3e797fa640 1 -- 172.21.15.52:0/547759590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e6c03f070 con 0x7f3e7c100540 2024-09-06T14:37:50.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.064+0000 7f3e797fa640 1 -- 172.21.15.52:0/547759590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f3e6c003a90 con 0x7f3e7c100540 2024-09-06T14:37:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.064+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c19e7d0 con 0x7f3e7c100540 2024-09-06T14:37:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.064+0000 7f3e797fa640 1 -- 172.21.15.52:0/547759590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e6c035030 con 0x7f3e7c100540 2024-09-06T14:37:50.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.064+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c19eca0 con 0x7f3e7c100540 2024-09-06T14:37:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.065+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7c106c00 con 0x7f3e7c100540 2024-09-06T14:37:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.065+0000 7f3e797fa640 1 -- 172.21.15.52:0/547759590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f3e6c042070 con 0x7f3e7c100540 2024-09-06T14:37:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.066+0000 7f3e797fa640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e6806df00 0x7f3e680703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.066+0000 7f3e797fa640 1 -- 172.21.15.52:0/547759590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3e6c0ad520 con 0x7f3e7c100540 2024-09-06T14:37:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.066+0000 7f3e73fff640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e6806df00 0x7f3e680703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:50.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.066+0000 7f3e73fff640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e6806df00 0x7f3e680703c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009950 tx=0x7f3e64008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:50.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.073+0000 7f3e797fa640 1 -- 172.21.15.52:0/547759590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e6c07c220 con 0x7f3e7c100540 2024-09-06T14:37:50.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.251+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f3e7c02db50 con 0x7f3e7c100540 2024-09-06T14:37:50.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.255+0000 7f3e797fa640 1 -- 172.21.15.52:0/547759590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f3e6c07fed0 con 0x7f3e7c100540 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e6806df00 msgr2=0x7f3e680703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e6806df00 0x7f3e680703c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009950 tx=0x7f3e64008040 comp rx=0 tx=0).stop 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 msgr2=0x7f3e7c198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c198d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c005940 tx=0x7f3e6c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 shutdown_connections 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e6806df00 0x7f3e680703c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e7c1992d0 0x7f3e7c19e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 --2- 172.21.15.52:0/547759590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e7c100540 0x7f3e7c198d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 >> 172.21.15.52:0/547759590 conn(0x7f3e7c0fbcd0 msgr2=0x7f3e7c18ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:50.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 shutdown_connections 2024-09-06T14:37:50.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.258+0000 7f3e81f28640 1 -- 172.21.15.52:0/547759590 wait complete. 2024-09-06T14:37:50.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 -- 172.21.15.52:0/2534684761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c8101600 msgr2=0x7f40c8101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 --2- 172.21.15.52:0/2534684761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c8101600 0x7f40c8101a00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009880 tx=0x7f40c402a5d0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 -- 172.21.15.52:0/2534684761 shutdown_connections 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 --2- 172.21.15.52:0/2534684761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c8101600 0x7f40c8101a00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 -- 172.21.15.52:0/2534684761 >> 172.21.15.52:0/2534684761 conn(0x7f40c80fcdb0 msgr2=0x7f40c80ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 -- 172.21.15.52:0/2534684761 shutdown_connections 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 -- 172.21.15.52:0/2534684761 wait complete. 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 Processor -- start 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.656+0000 7f40d0522640 1 -- start start 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40d0522640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c8101600 0x7f40c8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40d0522640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c80745e0 0x7f40c8074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40d0522640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40c8107590 con 0x7f40c80745e0 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40d0522640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40c8107410 con 0x7f40c8101600 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40cdabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c80745e0 0x7f40c8074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40cdabd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c80745e0 0x7f40c8074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53584/0 (socket says 172.21.15.52:53584) 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40cdabd640 1 -- 172.21.15.52:0/2119641842 learned_addr learned my addr 172.21.15.52:0/2119641842 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40ce2be640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c8101600 0x7f40c8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40cdabd640 1 -- 172.21.15.52:0/2119641842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c8101600 msgr2=0x7f40c8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40cdabd640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c8101600 0x7f40c8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40cdabd640 1 -- 172.21.15.52:0/2119641842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c8074fa0 con 0x7f40c80745e0 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40cdabd640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c80745e0 0x7f40c8074a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40b800b4a0 tx=0x7f40b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.657+0000 7f40bf7fe640 1 -- 172.21.15.52:0/2119641842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40b8014070 con 0x7f40c80745e0 2024-09-06T14:37:50.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.658+0000 7f40bf7fe640 1 -- 172.21.15.52:0/2119641842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f40b8010ab0 con 0x7f40c80745e0 2024-09-06T14:37:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.658+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c8075290 con 0x7f40c80745e0 2024-09-06T14:37:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.658+0000 7f40bf7fe640 1 -- 172.21.15.52:0/2119641842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40b8017c80 con 0x7f40c80745e0 2024-09-06T14:37:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.658+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c819ed90 con 0x7f40c80745e0 2024-09-06T14:37:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.659+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c8101a80 con 0x7f40c80745e0 2024-09-06T14:37:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.659+0000 7f40bf7fe640 1 -- 172.21.15.52:0/2119641842 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f40b8017070 con 0x7f40c80745e0 2024-09-06T14:37:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.660+0000 7f40bf7fe640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f40b406df00 0x7f40b40703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.660+0000 7f40bf7fe640 1 -- 172.21.15.52:0/2119641842 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f40b800d040 con 0x7f40c80745e0 2024-09-06T14:37:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.660+0000 7f40ce2be640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f40b406df00 0x7f40b40703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:50.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.660+0000 7f40ce2be640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f40b406df00 0x7f40b40703c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40c40096c0 tx=0x7f40c4005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:50.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.666+0000 7f40bf7fe640 1 -- 172.21.15.52:0/2119641842 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40b801e030 con 0x7f40c80745e0 2024-09-06T14:37:50.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.849+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f40c8062df0 con 0x7f40c80745e0 2024-09-06T14:37:50.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.852+0000 7f40bf7fe640 1 -- 172.21.15.52:0/2119641842 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v18)=0 v18) ==== 117+0+0 (secure 0 0 0) 0x7f40b805ae20 con 0x7f40c80745e0 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f40b406df00 msgr2=0x7f40b40703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f40b406df00 0x7f40b40703c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40c40096c0 tx=0x7f40c4005d50 comp rx=0 tx=0).stop 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c80745e0 msgr2=0x7f40c8074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c80745e0 0x7f40c8074a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40b800b4a0 tx=0x7f40b800b960 comp rx=0 tx=0).stop 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 shutdown_connections 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f40b406df00 0x7f40b40703c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40c80745e0 0x7f40c8074a60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 --2- 172.21.15.52:0/2119641842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40c8101600 0x7f40c8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 >> 172.21.15.52:0/2119641842 conn(0x7f40c80fcdb0 msgr2=0x7f40c80fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 shutdown_connections 2024-09-06T14:37:50.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:50.855+0000 7f40d0522640 1 -- 172.21.15.52:0/2119641842 wait complete. 2024-09-06T14:37:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:51 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/911432440' entity='client.admin' 2024-09-06T14:37:51.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:51 smithi052 ceph-mon[28627]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:51.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:51 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/547759590' entity='client.admin' 2024-09-06T14:37:51.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:51 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2119641842' entity='client.admin' 2024-09-06T14:37:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:51 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/911432440' entity='client.admin' 2024-09-06T14:37:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:51 smithi165 ceph-mon[36229]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:51 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/547759590' entity='client.admin' 2024-09-06T14:37:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:51 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2119641842' entity='client.admin' 2024-09-06T14:37:51.606 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:51.608 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:51.610 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:51.651 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi052') 2024-09-06T14:37:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 -- 172.21.15.52:0/3921607008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 msgr2=0x7f86a8100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 --2- 172.21.15.52:0/3921607008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a8100940 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8698009880 tx=0x7f869802a5d0 comp rx=0 tx=0).stop 2024-09-06T14:37:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 -- 172.21.15.52:0/3921607008 shutdown_connections 2024-09-06T14:37:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 --2- 172.21.15.52:0/3921607008 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a8100940 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:52.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 -- 172.21.15.52:0/3921607008 >> 172.21.15.52:0/3921607008 conn(0x7f86a80fbcd0 msgr2=0x7f86a80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 -- 172.21.15.52:0/3921607008 shutdown_connections 2024-09-06T14:37:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 -- 172.21.15.52:0/3921607008 wait complete. 2024-09-06T14:37:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 Processor -- start 2024-09-06T14:37:52.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.869+0000 7f86accdc640 1 -- start start 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86accdc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a80fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86accdc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a80fc2c0 0x7f86a80fc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86accdc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f86a8106460 con 0x7f86a8100540 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86accdc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86a81062e0 con 0x7f86a80fc2c0 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86a659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a80fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86a659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a80fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53602/0 (socket says 172.21.15.52:53602) 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86a659c640 1 -- 172.21.15.52:0/1674433721 learned_addr learned my addr 172.21.15.52:0/1674433721 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:52.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86a659c640 1 -- 172.21.15.52:0/1674433721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a80fc2c0 msgr2=0x7f86a80fc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86a659c640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a80fc2c0 0x7f86a80fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86a659c640 1 -- 172.21.15.52:0/1674433721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a80fcc80 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86a659c640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a80fdc00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8698005940 tx=0x7f86980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f869f7fe640 1 -- 172.21.15.52:0/1674433721 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f869803f070 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f869f7fe640 1 -- 172.21.15.52:0/1674433721 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f8698003a90 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a80fcf10 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.870+0000 7f869f7fe640 1 -- 172.21.15.52:0/1674433721 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8698035030 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.871+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a819ed90 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.872+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a81009c0 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.872+0000 7f869f7fe640 1 -- 172.21.15.52:0/1674433721 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f8698042070 con 0x7f86a8100540 2024-09-06T14:37:52.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.872+0000 7f869f7fe640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f869406deb0 0x7f8694070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:52.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.872+0000 7f869f7fe640 1 -- 172.21.15.52:0/1674433721 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f86980ad680 con 0x7f86a8100540 2024-09-06T14:37:52.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.872+0000 7f869ffff640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f869406deb0 0x7f8694070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:52.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.873+0000 7f869ffff640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f869406deb0 0x7f8694070370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8690006fd0 tx=0x7f8690006d40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:52.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:52.877+0000 7f869f7fe640 1 -- 172.21.15.52:0/1674433721 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f869807c270 con 0x7f86a8100540 2024-09-06T14:37:53.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.056+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f86a8062df0 con 0x7f86a8100540 2024-09-06T14:37:53.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.060+0000 7f869f7fe640 1 -- 172.21.15.52:0/1674433721 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f869807ff20 con 0x7f86a8100540 2024-09-06T14:37:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f869406deb0 msgr2=0x7f8694070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f869406deb0 0x7f8694070370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8690006fd0 tx=0x7f8690006d40 comp rx=0 tx=0).stop 2024-09-06T14:37:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 msgr2=0x7f86a80fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a80fdc00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8698005940 tx=0x7f86980048f0 comp rx=0 tx=0).stop 2024-09-06T14:37:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 shutdown_connections 2024-09-06T14:37:53.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f869406deb0 0x7f8694070370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86a80fc2c0 0x7f86a80fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 --2- 172.21.15.52:0/1674433721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f86a8100540 0x7f86a80fdc00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 >> 172.21.15.52:0/1674433721 conn(0x7f86a80fbcd0 msgr2=0x7f86a8069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 shutdown_connections 2024-09-06T14:37:53.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.062+0000 7f86accdc640 1 -- 172.21.15.52:0/1674433721 wait complete. 2024-09-06T14:37:53.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:53 smithi165 ceph-mon[36229]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:53.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:53 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1674433721' entity='client.admin' 2024-09-06T14:37:53.617 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:53 smithi052 ceph-mon[28627]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:53.618 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:53 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1674433721' entity='client.admin' 2024-09-06T14:37:53.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.813+0000 7fd7173d1640 1 -- 172.21.15.52:0/2494092096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 msgr2=0x7fd710101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.813+0000 7fd7173d1640 1 --2- 172.21.15.52:0/2494092096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710101ea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009880 tx=0x7fd70c02a5d0 comp rx=0 tx=0).stop 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.813+0000 7fd7173d1640 1 -- 172.21.15.52:0/2494092096 shutdown_connections 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.813+0000 7fd7173d1640 1 --2- 172.21.15.52:0/2494092096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710101ea0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.813+0000 7fd7173d1640 1 -- 172.21.15.52:0/2494092096 >> 172.21.15.52:0/2494092096 conn(0x7fd7100fb400 msgr2=0x7fd7100fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.813+0000 7fd7173d1640 1 -- 172.21.15.52:0/2494092096 shutdown_connections 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.813+0000 7fd7173d1640 1 -- 172.21.15.52:0/2494092096 wait complete. 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd7173d1640 1 Processor -- start 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd7173d1640 1 -- start start 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd7173d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:53.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd7173d1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd710197080 0x7fd71019c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd7173d1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd710106490 con 0x7fd710101aa0 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd7173d1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd710106310 con 0x7fd710197080 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd71516d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd71516d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53608/0 (socket says 172.21.15.52:53608) 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd71516d640 1 -- 172.21.15.52:0/3254188874 learned_addr learned my addr 172.21.15.52:0/3254188874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd71496c640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd710197080 0x7fd71019c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd71516d640 1 -- 172.21.15.52:0/3254188874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd710197080 msgr2=0x7fd71019c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.814+0000 7fd71516d640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd710197080 0x7fd71019c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd71516d640 1 -- 172.21.15.52:0/3254188874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7101975b0 con 0x7fd710101aa0 2024-09-06T14:37:53.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd71496c640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd710197080 0x7fd71019c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd71516d640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710196b40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd70c005940 tx=0x7fd70c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd7067fc640 1 -- 172.21.15.52:0/3254188874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd70c03f070 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71019c5c0 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd7067fc640 1 -- 172.21.15.52:0/3254188874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fd70c003a90 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd7067fc640 1 -- 172.21.15.52:0/3254188874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd70c035030 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.815+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71019ca90 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.816+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd710101f20 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.816+0000 7fd7067fc640 1 -- 172.21.15.52:0/3254188874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fd70c042070 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.817+0000 7fd7067fc640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd6fc06deb0 0x7fd6fc070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.817+0000 7fd7067fc640 1 -- 172.21.15.52:0/3254188874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd70c0ad6b0 con 0x7fd710101aa0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.817+0000 7fd71496c640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd6fc06deb0 0x7fd6fc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:53.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.817+0000 7fd71496c640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd6fc06deb0 0x7fd6fc070370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd710197ff0 tx=0x7fd700008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:53.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.821+0000 7fd7067fc640 1 -- 172.21.15.52:0/3254188874 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd70c07c2a0 con 0x7fd710101aa0 2024-09-06T14:37:53.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:53.999+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd710190380 con 0x7fd710101aa0 2024-09-06T14:37:53.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.002+0000 7fd7067fc640 1 -- 172.21.15.52:0/3254188874 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7fd710190380 con 0x7fd710101aa0 2024-09-06T14:37:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd6fc06deb0 msgr2=0x7fd6fc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd6fc06deb0 0x7fd6fc070370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd710197ff0 tx=0x7fd700008040 comp rx=0 tx=0).stop 2024-09-06T14:37:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 msgr2=0x7fd710196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710196b40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd70c005940 tx=0x7fd70c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:37:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 shutdown_connections 2024-09-06T14:37:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd6fc06deb0 0x7fd6fc070370 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:54.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd710197080 0x7fd71019c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 --2- 172.21.15.52:0/3254188874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd710101aa0 0x7fd710196b40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 >> 172.21.15.52:0/3254188874 conn(0x7fd7100fb400 msgr2=0x7fd7100ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 shutdown_connections 2024-09-06T14:37:54.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:54.004+0000 7fd7173d1640 1 -- 172.21.15.52:0/3254188874 wait complete. 2024-09-06T14:37:54.140 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:54.140 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:54.141 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:54.141 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:54.320 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:37:55.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3254188874' entity='client.admin' 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: Reconfiguring mgr.smithi052.vsthpq (unknown last config time)... 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.vsthpq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: Reconfiguring daemon mgr.smithi052.vsthpq on smithi052 2024-09-06T14:37:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:55 smithi165 ceph-mon[36229]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3254188874' entity='client.admin' 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: Reconfiguring mgr.smithi052.vsthpq (unknown last config time)... 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.vsthpq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: Reconfiguring daemon mgr.smithi052.vsthpq on smithi052 2024-09-06T14:37:55.296 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:55 smithi052 ceph-mon[28627]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:56.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi052') 2024-09-06T14:37:56.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi052') 2024-09-06T14:37:56.083 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi052') 2024-09-06T14:37:56.442 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:56 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:37:56.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:56 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:37:57.350 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:57 smithi052 ceph-mon[28627]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:57.350 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:57 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2609687350' entity='client.admin' 2024-09-06T14:37:57.350 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:57 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1924865072' entity='client.admin' 2024-09-06T14:37:57.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/1773227347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98101a60 msgr2=0x7fcf98101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/1773227347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98101a60 0x7fcf98101ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009880 tx=0x7fcf8c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/1773227347 shutdown_connections 2024-09-06T14:37:57.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/1773227347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98101a60 0x7fcf98101ee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/1773227347 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf98100860 0x7fcf98100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/1773227347 >> 172.21.15.52:0/1773227347 conn(0x7fcf980fc010 msgr2=0x7fcf980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/1773227347 shutdown_connections 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.469+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/1773227347 wait complete. 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf9e5cf640 1 Processor -- start 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf9e5cf640 1 -- start start 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf9e5cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98100860 0x7fcf98197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf9e5cf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf98101a60 0x7fcf98197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf9e5cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98109720 con 0x7fcf98100860 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf9e5cf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcf981095a0 con 0x7fcf98101a60 2024-09-06T14:37:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98100860 0x7fcf98197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98100860 0x7fcf98197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53690/0 (socket says 172.21.15.52:53690) 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf97fff640 1 -- 172.21.15.52:0/738236901 learned_addr learned my addr 172.21.15.52:0/738236901 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.470+0000 7fcf977fe640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf98101a60 0x7fcf98197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf97fff640 1 -- 172.21.15.52:0/738236901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf98101a60 msgr2=0x7fcf98197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf97fff640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf98101a60 0x7fcf98197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf97fff640 1 -- 172.21.15.52:0/738236901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf98198150 con 0x7fcf98100860 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf977fe640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf98101a60 0x7fcf98197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf97fff640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98100860 0x7fcf98197590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800b3d0 tx=0x7fcf8800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf957fa640 1 -- 172.21.15.52:0/738236901 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf88015020 con 0x7fcf98100860 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9819cb90 con 0x7fcf98100860 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf957fa640 1 -- 172.21.15.52:0/738236901 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf88011af0 con 0x7fcf98100860 2024-09-06T14:37:57.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf957fa640 1 -- 172.21.15.52:0/738236901 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf88010da0 con 0x7fcf98100860 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.471+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9819d120 con 0x7fcf98100860 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.472+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf98100c60 con 0x7fcf98100860 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.473+0000 7fcf957fa640 1 -- 172.21.15.52:0/738236901 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fcf88018020 con 0x7fcf98100860 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.473+0000 7fcf957fa640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fcf8006ddb0 0x7fcf80070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.473+0000 7fcf957fa640 1 -- 172.21.15.52:0/738236901 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcf8808c610 con 0x7fcf98100860 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.473+0000 7fcf977fe640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fcf8006ddb0 0x7fcf80070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.474+0000 7fcf977fe640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fcf8006ddb0 0x7fcf80070270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0096c0 tx=0x7fcf8c009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.478+0000 7fcf957fa640 1 -- 172.21.15.52:0/738236901 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf8801f020 con 0x7fcf98100860 2024-09-06T14:37:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:57 smithi165 ceph-mon[36229]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:57 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2609687350' entity='client.admin' 2024-09-06T14:37:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:57 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1924865072' entity='client.admin' 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 -- 172.21.15.52:0/348143472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230102b60 msgr2=0x7f2230102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 --2- 172.21.15.52:0/348143472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230102b60 0x7f2230102fe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2224009880 tx=0x7f222402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 -- 172.21.15.52:0/348143472 shutdown_connections 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 --2- 172.21.15.52:0/348143472 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230102b60 0x7f2230102fe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 --2- 172.21.15.52:0/348143472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2230101960 0x7f2230101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 -- 172.21.15.52:0/348143472 >> 172.21.15.52:0/348143472 conn(0x7f22300fd0f0 msgr2=0x7f22300ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 -- 172.21.15.52:0/348143472 shutdown_connections 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 -- 172.21.15.52:0/348143472 wait complete. 2024-09-06T14:37:57.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 Processor -- start 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.057+0000 7f22369c4640 1 -- start start 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f22369c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230101960 0x7f22301973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f22369c4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2230102b60 0x7f22301978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f22369c4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f223010a640 con 0x7f2230101960 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f22369c4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f223010a4c0 con 0x7f2230102b60 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230101960 0x7f22301973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230101960 0x7f22301973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53666/0 (socket says 172.21.15.52:53666) 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222ffff640 1 -- 172.21.15.52:0/1186765874 learned_addr learned my addr 172.21.15.52:0/1186765874 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222f7fe640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2230102b60 0x7f22301978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:57.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222ffff640 1 -- 172.21.15.52:0/1186765874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2230102b60 msgr2=0x7f22301978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222ffff640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2230102b60 0x7f22301978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222ffff640 1 -- 172.21.15.52:0/1186765874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2230197f70 con 0x7f2230101960 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222f7fe640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2230102b60 0x7f22301978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222ffff640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230101960 0x7f22301973b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f222000c8f0 tx=0x7f222000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22200079b0 con 0x7f2230101960 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f222000f450 con 0x7f2230101960 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f223019c9b0 con 0x7f2230101960 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.058+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22200185f0 con 0x7f2230101960 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.059+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f223019cfc0 con 0x7f2230101960 2024-09-06T14:37:57.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.060+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2230101d60 con 0x7f2230101960 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.060+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f2220007b50 con 0x7f2230101960 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.060+0000 7f222d7fa640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f221806de00 0x7f22180702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.060+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f222008cc40 con 0x7f2230101960 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.060+0000 7f222f7fe640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f221806de00 0x7f22180702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.061+0000 7f222f7fe640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f221806de00 0x7f22180702c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f22240096c0 tx=0x7f2224000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.065+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2220014030 con 0x7f2230101960 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.246+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f2230191450 con 0x7f2230101960 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.248+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 123+0+0 (secure 0 0 0) 0x7f222005b940 con 0x7f2230101960 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.249+0000 7f222d7fa640 1 -- 172.21.15.52:0/1186765874 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2220007e40 con 0x7f2230101960 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.250+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f221806de00 msgr2=0x7f22180702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.250+0000 7f22369c4640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f221806de00 0x7f22180702c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f22240096c0 tx=0x7f2224000bc0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.250+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230101960 msgr2=0x7f22301973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.250+0000 7f22369c4640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230101960 0x7f22301973b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f222000c8f0 tx=0x7f222000cdb0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.251+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 shutdown_connections 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.251+0000 7f22369c4640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f221806de00 0x7f22180702c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.251+0000 7f22369c4640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2230102b60 0x7f22301978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.251+0000 7f22369c4640 1 --2- 172.21.15.52:0/1186765874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2230101960 0x7f22301973b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.251+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 >> 172.21.15.52:0/1186765874 conn(0x7f22300fd0f0 msgr2=0x7f2230106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.251+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 shutdown_connections 2024-09-06T14:37:57.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.251+0000 7f22369c4640 1 -- 172.21.15.52:0/1186765874 wait complete. 2024-09-06T14:37:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.657+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fcf9819d3e0 con 0x7fcf98100860 2024-09-06T14:37:57.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.660+0000 7fcf957fa640 1 -- 172.21.15.52:0/738236901 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7fcf8805b290 con 0x7fcf98100860 2024-09-06T14:37:57.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fcf8006ddb0 msgr2=0x7fcf80070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fcf8006ddb0 0x7fcf80070270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0096c0 tx=0x7fcf8c009650 comp rx=0 tx=0).stop 2024-09-06T14:37:57.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98100860 msgr2=0x7fcf98197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:57.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98100860 0x7fcf98197590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf8800b3d0 tx=0x7fcf8800b890 comp rx=0 tx=0).stop 2024-09-06T14:37:57.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 shutdown_connections 2024-09-06T14:37:57.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fcf8006ddb0 0x7fcf80070270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcf98101a60 0x7fcf98197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 --2- 172.21.15.52:0/738236901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcf98100860 0x7fcf98197590 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:57.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 >> 172.21.15.52:0/738236901 conn(0x7fcf980fc010 msgr2=0x7fcf98069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:57.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 shutdown_connections 2024-09-06T14:37:57.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.662+0000 7fcf9e5cf640 1 -- 172.21.15.52:0/738236901 wait complete. 2024-09-06T14:37:58.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1025841065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 msgr2=0x7f26bc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1025841065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc100c80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009880 tx=0x7f26b002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1025841065 shutdown_connections 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1025841065 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26bc101a80 0x7f26bc101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1025841065 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc100c80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1025841065 >> 172.21.15.52:0/1025841065 conn(0x7f26bc0fc030 msgr2=0x7f26bc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1025841065 shutdown_connections 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.535+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1025841065 wait complete. 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c2ccc640 1 Processor -- start 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c2ccc640 1 -- start start 2024-09-06T14:37:58.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c2ccc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c2ccc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26bc101a80 0x7f26bc197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c2ccc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc109580 con 0x7f26bc100880 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c2ccc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc109400 con 0x7f26bc101a80 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c0a68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c0a68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53642/0 (socket says 172.21.15.52:53642) 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c0a68640 1 -- 172.21.15.52:0/1924865072 learned_addr learned my addr 172.21.15.52:0/1924865072 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26bbfff640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26bc101a80 0x7f26bc197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c0a68640 1 -- 172.21.15.52:0/1924865072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26bc101a80 msgr2=0x7f26bc197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c0a68640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26bc101a80 0x7f26bc197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26c0a68640 1 -- 172.21.15.52:0/1924865072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc198010 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.536+0000 7f26bbfff640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26bc101a80 0x7f26bc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.537+0000 7f26c0a68640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc197450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006010 tx=0x7f26b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.537+0000 7f26b9ffb640 1 -- 172.21.15.52:0/1924865072 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26b003f070 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.537+0000 7f26b9ffb640 1 -- 172.21.15.52:0/1924865072 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f26b00044d0 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.537+0000 7f26b9ffb640 1 -- 172.21.15.52:0/1924865072 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26b0035030 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.537+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc19c9f0 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.537+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26bc19d000 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.538+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26bc100c80 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.539+0000 7f26b9ffb640 1 -- 172.21.15.52:0/1924865072 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f26b0042070 con 0x7f26bc100880 2024-09-06T14:37:58.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.539+0000 7f26b9ffb640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f26ac06de00 0x7f26ac0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.539+0000 7f26b9ffb640 1 -- 172.21.15.52:0/1924865072 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f26b00ad590 con 0x7f26bc100880 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.539+0000 7f26bbfff640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f26ac06de00 0x7f26ac0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.540+0000 7f26bbfff640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f26ac06de00 0x7f26ac0702c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f26a8005fd0 tx=0x7f26a8005ea0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.544+0000 7f26b9ffb640 1 -- 172.21.15.52:0/1924865072 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26b007c1f0 con 0x7f26bc100880 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.728+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f26bc19d260 con 0x7f26bc100880 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.732+0000 7f26b9ffb640 1 -- 172.21.15.52:0/1924865072 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7f26b007fea0 con 0x7f26bc100880 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f26ac06de00 msgr2=0x7f26ac0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f26ac06de00 0x7f26ac0702c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f26a8005fd0 tx=0x7f26a8005ea0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 msgr2=0x7f26bc197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc197450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006010 tx=0x7f26b00048f0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 shutdown_connections 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f26ac06de00 0x7f26ac0702c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26bc101a80 0x7f26bc197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 --2- 172.21.15.52:0/1924865072 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26bc100880 0x7f26bc197450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 >> 172.21.15.52:0/1924865072 conn(0x7f26bc0fc030 msgr2=0x7f26bc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 shutdown_connections 2024-09-06T14:37:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.734+0000 7f26c2ccc640 1 -- 172.21.15.52:0/1924865072 wait complete. 2024-09-06T14:37:58.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:58 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1186765874' entity='client.admin' 2024-09-06T14:37:58.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:58 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3969971703' entity='client.admin' 2024-09-06T14:37:58.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:58 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/738236901' entity='client.admin' 2024-09-06T14:37:58.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.444+0000 7f15a6caf640 1 -- 172.21.15.52:0/512223859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0100860 msgr2=0x7f15a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.444+0000 7f15a6caf640 1 --2- 172.21.15.52:0/512223859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0100860 0x7f15a0100c60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1598009880 tx=0x7f159802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.444+0000 7f15a6caf640 1 -- 172.21.15.52:0/512223859 shutdown_connections 2024-09-06T14:37:58.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.444+0000 7f15a6caf640 1 --2- 172.21.15.52:0/512223859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a0101a60 0x7f15a0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.444+0000 7f15a6caf640 1 --2- 172.21.15.52:0/512223859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0100860 0x7f15a0100c60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.444+0000 7f15a6caf640 1 -- 172.21.15.52:0/512223859 >> 172.21.15.52:0/512223859 conn(0x7f15a00fc010 msgr2=0x7f15a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.444+0000 7f15a6caf640 1 -- 172.21.15.52:0/512223859 shutdown_connections 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f15a6caf640 1 -- 172.21.15.52:0/512223859 wait complete. 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f15a6caf640 1 Processor -- start 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f15a6caf640 1 -- start start 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f15a6caf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a0100860 0x7f15a0104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f15a6caf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0101a60 0x7f15a0102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f15a6caf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01095c0 con 0x7f15a0101a60 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f15a6caf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0109440 con 0x7f15a0100860 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f159ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0101a60 0x7f15a0102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f159ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0101a60 0x7f15a0102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53620/0 (socket says 172.21.15.52:53620) 2024-09-06T14:37:58.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.445+0000 7f159ffff640 1 -- 172.21.15.52:0/2609687350 learned_addr learned my addr 172.21.15.52:0/2609687350 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f15a4a4b640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a0100860 0x7f15a0104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f159ffff640 1 -- 172.21.15.52:0/2609687350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a0100860 msgr2=0x7f15a0104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f159ffff640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a0100860 0x7f15a0104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f159ffff640 1 -- 172.21.15.52:0/2609687350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a0103380 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f159ffff640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0101a60 0x7f15a0102e40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f159000ba50 tx=0x7f159000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f159dffb640 1 -- 172.21.15.52:0/2609687350 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1590019070 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f159dffb640 1 -- 172.21.15.52:0/2609687350 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f159000ce00 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a0103670 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f159dffb640 1 -- 172.21.15.52:0/2609687350 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15900075a0 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.446+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a0103c80 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.447+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a0100ce0 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.448+0000 7f159dffb640 1 -- 172.21.15.52:0/2609687350 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f159001c070 con 0x7f15a0101a60 2024-09-06T14:37:58.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.449+0000 7f159dffb640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f158c06de00 0x7f158c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.449+0000 7f159dffb640 1 -- 172.21.15.52:0/2609687350 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f159008c350 con 0x7f15a0101a60 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.449+0000 7f15a4a4b640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f158c06de00 0x7f158c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.449+0000 7f15a4a4b640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f158c06de00 0x7f158c0702c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1598006010 tx=0x7f1598005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.453+0000 7f159dffb640 1 -- 172.21.15.52:0/2609687350 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f159005ed00 con 0x7f15a0101a60 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.641+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f15a019f7e0 con 0x7f15a0101a60 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.645+0000 7f159dffb640 1 -- 172.21.15.52:0/2609687350 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f1590063530 con 0x7f15a0101a60 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f158c06de00 msgr2=0x7f158c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f158c06de00 0x7f158c0702c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1598006010 tx=0x7f1598005d50 comp rx=0 tx=0).stop 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0101a60 msgr2=0x7f15a0102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0101a60 0x7f15a0102e40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f159000ba50 tx=0x7f159000bf10 comp rx=0 tx=0).stop 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 shutdown_connections 2024-09-06T14:37:58.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f158c06de00 0x7f158c0702c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15a0101a60 0x7f15a0102e40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 --2- 172.21.15.52:0/2609687350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15a0100860 0x7f15a0104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 >> 172.21.15.52:0/2609687350 conn(0x7f15a00fc010 msgr2=0x7f15a0069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:58.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 shutdown_connections 2024-09-06T14:37:58.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:56.648+0000 7f15a6caf640 1 -- 172.21.15.52:0/2609687350 wait complete. 2024-09-06T14:37:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:58 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1186765874' entity='client.admin' 2024-09-06T14:37:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:58 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3969971703' entity='client.admin' 2024-09-06T14:37:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:58 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/738236901' entity='client.admin' 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 -- 172.21.15.52:0/3817514126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 msgr2=0x7efd04102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 --2- 172.21.15.52:0/3817514126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd04102fe0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efcec009880 tx=0x7efcec02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 -- 172.21.15.52:0/3817514126 shutdown_connections 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 --2- 172.21.15.52:0/3817514126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd04102fe0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 --2- 172.21.15.52:0/3817514126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd04101960 0x7efd04101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 -- 172.21.15.52:0/3817514126 >> 172.21.15.52:0/3817514126 conn(0x7efd040fd0f0 msgr2=0x7efd040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 -- 172.21.15.52:0/3817514126 shutdown_connections 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.352+0000 7efd094ad640 1 -- 172.21.15.52:0/3817514126 wait complete. 2024-09-06T14:37:58.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efd094ad640 1 Processor -- start 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efd094ad640 1 -- start start 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efd094ad640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd04101960 0x7efd04075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efd094ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd040745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efd094ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410a820 con 0x7efd04102b60 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efd094ad640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410a6a0 con 0x7efd04101960 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efcfbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd040745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efcfbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd040745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53676/0 (socket says 172.21.15.52:53676) 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efcfbfff640 1 -- 172.21.15.52:0/3969971703 learned_addr learned my addr 172.21.15.52:0/3969971703 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efd02ffd640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd04101960 0x7efd04075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efcfbfff640 1 -- 172.21.15.52:0/3969971703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd04101960 msgr2=0x7efd04075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efcfbfff640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd04101960 0x7efd04075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.353+0000 7efcfbfff640 1 -- 172.21.15.52:0/3969971703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd04074b20 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.354+0000 7efcfbfff640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd040745e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efcec006010 tx=0x7efcec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.354+0000 7efd00ff9640 1 -- 172.21.15.52:0/3969971703 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcec03f070 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.354+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd04074db0 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.354+0000 7efd00ff9640 1 -- 172.21.15.52:0/3969971703 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcec0044d0 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.354+0000 7efd00ff9640 1 -- 172.21.15.52:0/3969971703 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcec035030 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.354+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd04075360 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.355+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd04101d40 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.355+0000 7efd00ff9640 1 -- 172.21.15.52:0/3969971703 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7efcec042070 con 0x7efd04102b60 2024-09-06T14:37:58.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.356+0000 7efd00ff9640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7efcf006ddb0 0x7efcf0070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.356+0000 7efd00ff9640 1 -- 172.21.15.52:0/3969971703 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efcec0ad7b0 con 0x7efd04102b60 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.356+0000 7efd02ffd640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7efcf006ddb0 0x7efcf0070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.356+0000 7efd02ffd640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7efcf006ddb0 0x7efcf0070270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd041029c0 tx=0x7efcf4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.360+0000 7efd00ff9640 1 -- 172.21.15.52:0/3969971703 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcec07c430 con 0x7efd04102b60 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.537+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7efd0402d7c0 con 0x7efd04102b60 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.540+0000 7efd00ff9640 1 -- 172.21.15.52:0/3969971703 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) ==== 106+0+0 (secure 0 0 0) 0x7efcec0800e0 con 0x7efd04102b60 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7efcf006ddb0 msgr2=0x7efcf0070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7efcf006ddb0 0x7efcf0070270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efd041029c0 tx=0x7efcf4008040 comp rx=0 tx=0).stop 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 msgr2=0x7efd040745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd040745e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efcec006010 tx=0x7efcec0048f0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 shutdown_connections 2024-09-06T14:37:58.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7efcf006ddb0 0x7efcf0070270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efd04102b60 0x7efd040745e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 --2- 172.21.15.52:0/3969971703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efd04101960 0x7efd04075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 >> 172.21.15.52:0/3969971703 conn(0x7efd040fd0f0 msgr2=0x7efd04106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 shutdown_connections 2024-09-06T14:37:58.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:57.543+0000 7efd094ad640 1 -- 172.21.15.52:0/3969971703 wait complete. 2024-09-06T14:37:59.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 -- 172.21.15.52:0/2658021624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 msgr2=0x7f6298100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2658021624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f6298100c60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6288009880 tx=0x7f628802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 -- 172.21.15.52:0/2658021624 shutdown_connections 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2658021624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6298101a60 0x7f6298101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2658021624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f6298100c60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 -- 172.21.15.52:0/2658021624 >> 172.21.15.52:0/2658021624 conn(0x7f62980fc010 msgr2=0x7f62980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 -- 172.21.15.52:0/2658021624 shutdown_connections 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.995+0000 7f629c8c5640 1 -- 172.21.15.52:0/2658021624 wait complete. 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629c8c5640 1 Processor -- start 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629c8c5640 1 -- start start 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629c8c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f629806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:59.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629c8c5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6298101a60 0x7f629819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629c8c5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f62981096a0 con 0x7f6298100860 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629c8c5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6298109520 con 0x7f6298101a60 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f629806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f629806aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53710/0 (socket says 172.21.15.52:53710) 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f629659c640 1 -- 172.21.15.52:0/2151748299 learned_addr learned my addr 172.21.15.52:0/2151748299 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.996+0000 7f6295d9b640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6298101a60 0x7f629819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f629659c640 1 -- 172.21.15.52:0/2151748299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6298101a60 msgr2=0x7f629819c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f629659c640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6298101a60 0x7f629819c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f629659c640 1 -- 172.21.15.52:0/2151748299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629819c7f0 con 0x7f6298100860 2024-09-06T14:37:59.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f629659c640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f629806aca0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6288006010 tx=0x7f62880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f62877fe640 1 -- 172.21.15.52:0/2151748299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f628803f070 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f62877fe640 1 -- 172.21.15.52:0/2151748299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6288004a50 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629819ca80 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f62877fe640 1 -- 172.21.15.52:0/2151748299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6288035030 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.997+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f629819cfb0 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.998+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6298100c60 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.998+0000 7f62877fe640 1 -- 172.21.15.52:0/2151748299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f6288042070 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.999+0000 7f62877fe640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f628006ddb0 0x7f6280070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.999+0000 7f62877fe640 1 -- 172.21.15.52:0/2151748299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f62880ad6a0 con 0x7f6298100860 2024-09-06T14:37:59.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.999+0000 7f6295d9b640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f628006ddb0 0x7f6280070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:37:59.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:58.999+0000 7f6295d9b640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f628006ddb0 0x7f6280070270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f629806aa20 tx=0x7f628c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:37:59.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.003+0000 7f62877fe640 1 -- 172.21.15.52:0/2151748299 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6288004c00 con 0x7f6298100860 2024-09-06T14:37:59.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.179+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f62981904b0 con 0x7f6298100860 2024-09-06T14:37:59.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.183+0000 7f62877fe640 1 -- 172.21.15.52:0/2151748299 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f628807ff40 con 0x7f6298100860 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f628006ddb0 msgr2=0x7f6280070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f628006ddb0 0x7f6280070270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f629806aa20 tx=0x7f628c00b390 comp rx=0 tx=0).stop 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 msgr2=0x7f629806aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f629806aca0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6288006010 tx=0x7f62880045e0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 shutdown_connections 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f628006ddb0 0x7f6280070270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6298101a60 0x7f629819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 --2- 172.21.15.52:0/2151748299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6298100860 0x7f629806aca0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 >> 172.21.15.52:0/2151748299 conn(0x7f62980fc010 msgr2=0x7f6298104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:37:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 shutdown_connections 2024-09-06T14:37:59.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:37:59.185+0000 7f629c8c5640 1 -- 172.21.15.52:0/2151748299 wait complete. 2024-09-06T14:37:59.554 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:59 smithi052 ceph-mon[28627]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:59.555 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:37:59 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2151748299' entity='client.admin' 2024-09-06T14:37:59.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:59 smithi165 ceph-mon[36229]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:37:59.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:37:59 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2151748299' entity='client.admin' 2024-09-06T14:38:00.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 -- 172.21.15.52:0/1765361028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30100860 msgr2=0x7fba30100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:00.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 --2- 172.21.15.52:0/1765361028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30100860 0x7fba30100c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fba20009880 tx=0x7fba2002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 -- 172.21.15.52:0/1765361028 shutdown_connections 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 --2- 172.21.15.52:0/1765361028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba30101a60 0x7fba30101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 --2- 172.21.15.52:0/1765361028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30100860 0x7fba30100c60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 -- 172.21.15.52:0/1765361028 >> 172.21.15.52:0/1765361028 conn(0x7fba300fc010 msgr2=0x7fba300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 -- 172.21.15.52:0/1765361028 shutdown_connections 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.361+0000 7fba35c09640 1 -- 172.21.15.52:0/1765361028 wait complete. 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba35c09640 1 Processor -- start 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba35c09640 1 -- start start 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba35c09640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba30100860 0x7fba30197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba35c09640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30101a60 0x7fba30197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:00.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba35c09640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba30109700 con 0x7fba30101a60 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba35c09640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba30109580 con 0x7fba30100860 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30101a60 0x7fba30197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba2effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30101a60 0x7fba30197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60076/0 (socket says 172.21.15.52:60076) 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba2effd640 1 -- 172.21.15.52:0/4183687849 learned_addr learned my addr 172.21.15.52:0/4183687849 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.362+0000 7fba2f7fe640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba30100860 0x7fba30197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba2effd640 1 -- 172.21.15.52:0/4183687849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba30100860 msgr2=0x7fba30197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba2effd640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba30100860 0x7fba30197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba2effd640 1 -- 172.21.15.52:0/4183687849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba30198130 con 0x7fba30101a60 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba2effd640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30101a60 0x7fba30197ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba2400b420 tx=0x7fba2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba2cff9640 1 -- 172.21.15.52:0/4183687849 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba24011630 con 0x7fba30101a60 2024-09-06T14:38:00.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba2cff9640 1 -- 172.21.15.52:0/4183687849 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba24016070 con 0x7fba30101a60 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3019cb70 con 0x7fba30101a60 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba2cff9640 1 -- 172.21.15.52:0/4183687849 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba24010d40 con 0x7fba30101a60 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.363+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3019d180 con 0x7fba30101a60 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.364+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba30100c60 con 0x7fba30101a60 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.364+0000 7fba2cff9640 1 -- 172.21.15.52:0/4183687849 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fba2401b460 con 0x7fba30101a60 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.365+0000 7fba2cff9640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fba1806de00 0x7fba180702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.365+0000 7fba2f7fe640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fba1806de00 0x7fba180702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.365+0000 7fba2cff9640 1 -- 172.21.15.52:0/4183687849 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fba2408c2b0 con 0x7fba30101a60 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.365+0000 7fba2f7fe640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fba1806de00 0x7fba180702c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba20000c00 tx=0x7fba20005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:00.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.369+0000 7fba2cff9640 1 -- 172.21.15.52:0/4183687849 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba2405afb0 con 0x7fba30101a60 2024-09-06T14:38:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.545+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fba3019d9c0 con 0x7fba30101a60 2024-09-06T14:38:00.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.548+0000 7fba2cff9640 1 -- 172.21.15.52:0/4183687849 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v27)=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7fba2405ec60 con 0x7fba30101a60 2024-09-06T14:38:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fba1806de00 msgr2=0x7fba180702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fba1806de00 0x7fba180702c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba20000c00 tx=0x7fba20005a20 comp rx=0 tx=0).stop 2024-09-06T14:38:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30101a60 msgr2=0x7fba30197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30101a60 0x7fba30197ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba2400b420 tx=0x7fba2400b8e0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 shutdown_connections 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fba1806de00 0x7fba180702c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba30101a60 0x7fba30197ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 --2- 172.21.15.52:0/4183687849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba30100860 0x7fba30197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 >> 172.21.15.52:0/4183687849 conn(0x7fba300fc010 msgr2=0x7fba3006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 shutdown_connections 2024-09-06T14:38:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:00.550+0000 7fba35c09640 1 -- 172.21.15.52:0/4183687849 wait complete. 2024-09-06T14:38:01.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:01 smithi052 ceph-mon[28627]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:01.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:01 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4183687849' entity='client.admin' 2024-09-06T14:38:01.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:01 smithi165 ceph-mon[36229]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:01.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:01 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/4183687849' entity='client.admin' 2024-09-06T14:38:03.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:03 smithi052 ceph-mon[28627]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:03.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:03 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:03.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:03 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:03.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:03 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:38:03.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:03 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:03.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:03 smithi165 ceph-mon[36229]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:03.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:03 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:03.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:03 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:03.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:03 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:38:03.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:03 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 -- 172.21.15.52:0/1553115379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4100860 msgr2=0x7f33f4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/1553115379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4100860 0x7f33f4100c60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009880 tx=0x7f33e402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 -- 172.21.15.52:0/1553115379 shutdown_connections 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/1553115379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f4101a60 0x7f33f4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/1553115379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4100860 0x7f33f4100c60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 -- 172.21.15.52:0/1553115379 >> 172.21.15.52:0/1553115379 conn(0x7f33f40fc010 msgr2=0x7f33f40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 -- 172.21.15.52:0/1553115379 shutdown_connections 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.342+0000 7f33f8e9d640 1 -- 172.21.15.52:0/1553115379 wait complete. 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33f8e9d640 1 Processor -- start 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33f8e9d640 1 -- start start 2024-09-06T14:38:03.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33f8e9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f4100860 0x7f33f406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33f8e9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4101a60 0x7f33f419e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33f8e9d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4109700 con 0x7f33f4101a60 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33f8e9d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f33f4109580 con 0x7f33f4100860 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33ebfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4101a60 0x7f33f419e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33ebfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4101a60 0x7f33f419e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60100/0 (socket says 172.21.15.52:60100) 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33ebfff640 1 -- 172.21.15.52:0/3912122964 learned_addr learned my addr 172.21.15.52:0/3912122964 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33f259c640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f4100860 0x7f33f406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33ebfff640 1 -- 172.21.15.52:0/3912122964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f4100860 msgr2=0x7f33f406a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33ebfff640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f4100860 0x7f33f406a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.343+0000 7f33ebfff640 1 -- 172.21.15.52:0/3912122964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f419ebb0 con 0x7f33f4101a60 2024-09-06T14:38:03.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.344+0000 7f33ebfff640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4101a60 0x7f33f419e670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b420 tx=0x7f33dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.344+0000 7f33eb7fe640 1 -- 172.21.15.52:0/3912122964 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33dc011630 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.344+0000 7f33eb7fe640 1 -- 172.21.15.52:0/3912122964 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33dc016070 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.344+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f419ed80 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.344+0000 7f33eb7fe640 1 -- 172.21.15.52:0/3912122964 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33dc010d30 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.344+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f419f330 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.345+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4100c60 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.345+0000 7f33eb7fe640 1 -- 172.21.15.52:0/3912122964 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f33dc01b460 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.346+0000 7f33eb7fe640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f33e006ddb0 0x7f33e0070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.346+0000 7f33eb7fe640 1 -- 172.21.15.52:0/3912122964 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f33dc08c310 con 0x7f33f4101a60 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.346+0000 7f33f259c640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f33e006ddb0 0x7f33e0070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:03.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.346+0000 7f33f259c640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f33e006ddb0 0x7f33e0070270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000c00 tx=0x7f33e4005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.350+0000 7f33eb7fe640 1 -- 172.21.15.52:0/3912122964 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33dc05af00 con 0x7f33f4101a60 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.526+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f33f4062df0 con 0x7f33f4101a60 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.530+0000 7f33eb7fe640 1 -- 172.21.15.52:0/3912122964 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v28)=0 v28) ==== 125+0+0 (secure 0 0 0) 0x7f33dc05ebb0 con 0x7f33f4101a60 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f33e006ddb0 msgr2=0x7f33e0070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f33e006ddb0 0x7f33e0070270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33e4000c00 tx=0x7f33e4005a20 comp rx=0 tx=0).stop 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4101a60 msgr2=0x7f33f419e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4101a60 0x7f33f419e670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00b420 tx=0x7f33dc00b8e0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 shutdown_connections 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f33e006ddb0 0x7f33e0070270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f33f4101a60 0x7f33f419e670 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 --2- 172.21.15.52:0/3912122964 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f33f4100860 0x7f33f406a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:03.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 >> 172.21.15.52:0/3912122964 conn(0x7f33f40fc010 msgr2=0x7f33f4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:38:03.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.532+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 shutdown_connections 2024-09-06T14:38:03.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:03.533+0000 7f33f8e9d640 1 -- 172.21.15.52:0/3912122964 wait complete. 2024-09-06T14:38:04.344 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:04 smithi052 ceph-mon[28627]: Reconfiguring ceph-exporter.smithi052 (monmap changed)... 2024-09-06T14:38:04.344 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:04 smithi052 ceph-mon[28627]: Reconfiguring daemon ceph-exporter.smithi052 on smithi052 2024-09-06T14:38:04.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:04 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3912122964' entity='client.admin' 2024-09-06T14:38:04.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:04 smithi165 ceph-mon[36229]: Reconfiguring ceph-exporter.smithi052 (monmap changed)... 2024-09-06T14:38:04.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:04 smithi165 ceph-mon[36229]: Reconfiguring daemon ceph-exporter.smithi052 on smithi052 2024-09-06T14:38:04.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:04 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3912122964' entity='client.admin' 2024-09-06T14:38:04.772 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.773 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '14ffcc96-6c5d-11ef-bce4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi052') 2024-09-06T14:38:04.774 INFO:tasks.cephadm:Deploying OSDs... 2024-09-06T14:38:04.775 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:38:04.775 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-06T14:38:04.794 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-06T14:38:04.794 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-06 14:37:03.659250348 +0000 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-06 14:31:39.772152027 +0000 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-06 14:31:39.772152027 +0000 2024-09-06T14:38:04.852 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-06 14:31:39.772152027 +0000 2024-09-06T14:38:04.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-06T14:38:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-06T14:38:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-06T14:38:04.921 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000110865 s, 4.6 MB/s 2024-09-06T14:38:04.922 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-06T14:38:04.980 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-06T14:38:05.035 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-06T14:38:05.035 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:05.035 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-06T14:38:05.035 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:05.035 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:05.036 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-06 14:37:03.659250348 +0000 2024-09-06T14:38:05.036 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-06 14:31:40.099148006 +0000 2024-09-06T14:38:05.036 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-06 14:31:40.099148006 +0000 2024-09-06T14:38:05.036 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-06 14:31:40.099148006 +0000 2024-09-06T14:38:05.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-06T14:38:05.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-06T14:38:05.100 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-06T14:38:05.100 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.00010497 s, 4.9 MB/s 2024-09-06T14:38:05.101 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-06T14:38:05.158 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-06T14:38:05.216 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-06T14:38:05.216 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:05.216 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-06T14:38:05.217 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:05.217 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:05.217 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-06 14:37:03.660250334 +0000 2024-09-06T14:38:05.217 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-06 14:31:40.418144083 +0000 2024-09-06T14:38:05.217 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-06 14:31:40.418144083 +0000 2024-09-06T14:38:05.217 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-06 14:31:40.418144083 +0000 2024-09-06T14:38:05.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-06T14:38:05.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-06T14:38:05.281 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-06T14:38:05.281 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.7454e-05 s, 5.3 MB/s 2024-09-06T14:38:05.282 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-06T14:38:05.339 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-06 14:37:03.660250334 +0000 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-06 14:31:40.737140161 +0000 2024-09-06T14:38:05.395 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-06 14:31:40.737140161 +0000 2024-09-06T14:38:05.396 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-06 14:31:40.737140161 +0000 2024-09-06T14:38:05.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-06T14:38:05.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-06T14:38:05.459 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-06T14:38:05.459 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000105391 s, 4.9 MB/s 2024-09-06T14:38:05.460 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-06T14:38:05.517 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:38:05.517 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-06T14:38:05.538 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-06T14:38:05.539 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-06T14:38:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:05 smithi165 ceph-mon[36229]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-06T14:38:05.591 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:05.591 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-06T14:38:05.591 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:05.591 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:05.591 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-06 14:37:34.465424785 +0000 2024-09-06T14:38:05.591 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-06 14:31:39.776435975 +0000 2024-09-06T14:38:05.592 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-06 14:31:39.776435975 +0000 2024-09-06T14:38:05.592 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-06 14:31:39.776435975 +0000 2024-09-06T14:38:05.592 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-06T14:38:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:05 smithi052 ceph-mon[28627]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-06T14:38:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-06T14:38:05.660 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000769791 s, 665 kB/s 2024-09-06T14:38:05.662 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-06T14:38:05.721 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-06 14:37:34.465424785 +0000 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-06 14:31:40.103431314 +0000 2024-09-06T14:38:05.778 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-06 14:31:40.103431314 +0000 2024-09-06T14:38:05.779 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-06 14:31:40.103431314 +0000 2024-09-06T14:38:05.779 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-06T14:38:05.844 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-06T14:38:05.844 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-06T14:38:05.844 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.00024494 s, 2.1 MB/s 2024-09-06T14:38:05.845 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-06T14:38:05.902 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-06 14:37:34.466424770 +0000 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-06 14:31:40.435426581 +0000 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-06 14:31:40.435426581 +0000 2024-09-06T14:38:05.959 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-06 14:31:40.435426581 +0000 2024-09-06T14:38:05.960 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-06T14:38:06.024 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-06T14:38:06.024 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-06T14:38:06.024 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000196555 s, 2.6 MB/s 2024-09-06T14:38:06.025 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-06T14:38:06.082 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-06T14:38:06.138 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-06T14:38:06.138 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-06T14:38:06.138 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-06T14:38:06.139 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:38:06.139 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-06T14:38:06.139 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-06 14:37:34.466424770 +0000 2024-09-06T14:38:06.139 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-06 14:31:40.754422034 +0000 2024-09-06T14:38:06.139 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-06 14:31:40.754422034 +0000 2024-09-06T14:38:06.139 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-06 14:31:40.754422034 +0000 2024-09-06T14:38:06.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-06T14:38:06.201 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-06T14:38:06.202 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-06T14:38:06.202 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000200001 s, 2.6 MB/s 2024-09-06T14:38:06.203 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-06T14:38:06.260 INFO:tasks.cephadm:Deploying osd.0 on smithi052 with /dev/vg_nvme/lv_4... 2024-09-06T14:38:06.260 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-06T14:38:06.619 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:38:06.959 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:06.959 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:06.959 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:06 smithi052 ceph-mon[28627]: Reconfiguring crash.smithi052 (monmap changed)... 2024-09-06T14:38:06.959 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-06T14:38:06.959 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:06.959 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:06 smithi052 ceph-mon[28627]: Reconfiguring daemon crash.smithi052 on smithi052 2024-09-06T14:38:06.960 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:06 smithi052 ceph-mon[28627]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:07.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:07.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:07.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:06 smithi165 ceph-mon[36229]: Reconfiguring crash.smithi052 (monmap changed)... 2024-09-06T14:38:07.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-06T14:38:07.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:07.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:06 smithi165 ceph-mon[36229]: Reconfiguring daemon crash.smithi052 on smithi052 2024-09-06T14:38:07.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:06 smithi165 ceph-mon[36229]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:08.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:08 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:08.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:08 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:08.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:08 smithi052 ceph-mon[28627]: Reconfiguring alertmanager.smithi052 (dependencies changed)... 2024-09-06T14:38:08.225 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:08 smithi052 ceph-mon[28627]: Reconfiguring daemon alertmanager.smithi052 on smithi052 2024-09-06T14:38:08.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:08 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:08.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:08 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:08.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:08 smithi165 ceph-mon[36229]: Reconfiguring alertmanager.smithi052 (dependencies changed)... 2024-09-06T14:38:08.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:08 smithi165 ceph-mon[36229]: Reconfiguring daemon alertmanager.smithi052 on smithi052 2024-09-06T14:38:09.289 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:09 smithi052 ceph-mon[28627]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:09.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:09 smithi165 ceph-mon[36229]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:10.522 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:10 smithi052 ceph-mon[28627]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:10.522 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:10 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:10.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:10 smithi165 ceph-mon[36229]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:10.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:10 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:13 smithi165 ceph-mon[36229]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:13.605 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:13 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:13.605 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:13 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:13.606 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:13 smithi052 ceph-mon[28627]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:13.606 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:13 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:13.606 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:13 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:13.817 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:38:13.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_4 2024-09-06T14:38:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:14 smithi052 ceph-mon[28627]: Reconfiguring grafana.smithi052 (dependencies changed)... 2024-09-06T14:38:14.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:14 smithi052 ceph-mon[28627]: Reconfiguring daemon grafana.smithi052 on smithi052 2024-09-06T14:38:14.512 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:38:14.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:14 smithi165 ceph-mon[36229]: Reconfiguring grafana.smithi052 (dependencies changed)... 2024-09-06T14:38:14.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:14 smithi165 ceph-mon[36229]: Reconfiguring daemon grafana.smithi052 on smithi052 2024-09-06T14:38:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 -- 172.21.15.52:0/2873315231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4101a80 msgr2=0x7fafe4101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 --2- 172.21.15.52:0/2873315231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4101a80 0x7fafe4101f00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009880 tx=0x7fafd802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:38:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 -- 172.21.15.52:0/2873315231 shutdown_connections 2024-09-06T14:38:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 --2- 172.21.15.52:0/2873315231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4101a80 0x7fafe4101f00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 --2- 172.21.15.52:0/2873315231 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafe4100880 0x7fafe4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:14.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 -- 172.21.15.52:0/2873315231 >> 172.21.15.52:0/2873315231 conn(0x7fafe40fc030 msgr2=0x7fafe40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 -- 172.21.15.52:0/2873315231 shutdown_connections 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 -- 172.21.15.52:0/2873315231 wait complete. 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 Processor -- start 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 -- start start 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4100880 0x7fafe41047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.941+0000 7fafec78b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafe4101a80 0x7fafe4102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafec78b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fafe41096c0 con 0x7fafe4100880 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafec78b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fafe4109540 con 0x7fafe4101a80 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafea527640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4100880 0x7fafe41047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafea527640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4100880 0x7fafe41047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49042/0 (socket says 172.21.15.52:49042) 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafea527640 1 -- 172.21.15.52:0/1713619313 learned_addr learned my addr 172.21.15.52:0/1713619313 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafe9d26640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafe4101a80 0x7fafe4102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:14.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafea527640 1 -- 172.21.15.52:0/1713619313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafe4101a80 msgr2=0x7fafe4102e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafea527640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafe4101a80 0x7fafe4102e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafea527640 1 -- 172.21.15.52:0/1713619313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe41033a0 con 0x7fafe4100880 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafe9d26640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafe4101a80 0x7fafe4102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafea527640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4100880 0x7fafe41047a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00ea20 tx=0x7fafdc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafe37fe640 1 -- 172.21.15.52:0/1713619313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafdc016070 con 0x7fafe4100880 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafe37fe640 1 -- 172.21.15.52:0/1713619313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafdc003e30 con 0x7fafe4100880 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe4103690 con 0x7fafe4100880 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafe37fe640 1 -- 172.21.15.52:0/1713619313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafdc011470 con 0x7fafe4100880 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.942+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe4103c20 con 0x7fafe4100880 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.943+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe4100c80 con 0x7fafe4100880 2024-09-06T14:38:14.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.944+0000 7fafe37fe640 1 -- 172.21.15.52:0/1713619313 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fafdc019070 con 0x7fafe4100880 2024-09-06T14:38:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.944+0000 7fafe37fe640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fafcc06de00 0x7fafcc0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.944+0000 7fafe9d26640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fafcc06de00 0x7fafcc0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.944+0000 7fafe37fe640 1 -- 172.21.15.52:0/1713619313 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fafdc08cc60 con 0x7fafe4100880 2024-09-06T14:38:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.945+0000 7fafe9d26640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fafcc06de00 0x7fafcc0702c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fafd80096c0 tx=0x7fafd8009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:14.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:14.949+0000 7fafe37fe640 1 -- 172.21.15.52:0/1713619313 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafdc05b960 con 0x7fafe4100880 2024-09-06T14:38:15.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:15.134+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fafe419f5d0 con 0x7fafcc06de00 2024-09-06T14:38:15.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:15 smithi165 ceph-mon[36229]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:38:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:38:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:15.585 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:15 smithi052 ceph-mon[28627]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:15.586 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:38:15.586 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:38:15.586 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:16.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:16 smithi052 ceph-mon[28627]: from='client.14330 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:38:16.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:16 smithi165 ceph-mon[36229]: from='client.14330 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:38:17.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:17 smithi052 ceph-mon[28627]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:17.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:17 smithi165 ceph-mon[36229]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:19.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:19 smithi052 ceph-mon[28627]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:19.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:19.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:19.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:19 smithi165 ceph-mon[36229]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:19.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:19.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:20 smithi165 ceph-mon[36229]: Reconfiguring prometheus.smithi052 (dependencies changed)... 2024-09-06T14:38:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:20 smithi165 ceph-mon[36229]: Reconfiguring daemon prometheus.smithi052 on smithi052 2024-09-06T14:38:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:20 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2444700456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ae61513-7d97-42fb-9086-4d24ca8fece0"}]: dispatch 2024-09-06T14:38:20.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:20 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2444700456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ae61513-7d97-42fb-9086-4d24ca8fece0"}]': finished 2024-09-06T14:38:20.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:20 smithi165 ceph-mon[36229]: osdmap e6: 1 total, 0 up, 1 in 2024-09-06T14:38:20.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:20 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:20.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:20 smithi052 ceph-mon[28627]: Reconfiguring prometheus.smithi052 (dependencies changed)... 2024-09-06T14:38:20.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:20 smithi052 ceph-mon[28627]: Reconfiguring daemon prometheus.smithi052 on smithi052 2024-09-06T14:38:20.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:20 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2444700456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6ae61513-7d97-42fb-9086-4d24ca8fece0"}]: dispatch 2024-09-06T14:38:20.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:20 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2444700456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6ae61513-7d97-42fb-9086-4d24ca8fece0"}]': finished 2024-09-06T14:38:20.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:20 smithi052 ceph-mon[28627]: osdmap e6: 1 total, 0 up, 1 in 2024-09-06T14:38:20.599 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:20 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:21.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:21 smithi052 ceph-mon[28627]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:21.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:21 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/285665041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:38:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:21 smithi165 ceph-mon[36229]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:21 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/285665041' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:38:23.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:23 smithi052 ceph-mon[28627]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:23.625 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:23 smithi165 ceph-mon[36229]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:25.563 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:25 smithi052 ceph-mon[28627]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:25.564 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:25 smithi165 ceph-mon[36229]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:27 smithi052 ceph-mon[28627]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:27.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:27 smithi165 ceph-mon[36229]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:28.421 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:28 smithi052 ceph-mon[28627]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:28.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:28 smithi165 ceph-mon[36229]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:31.463 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:31 smithi052 ceph-mon[28627]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:31.463 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:31 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:31.463 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:31 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:31.463 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:31 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:38:31.463 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:31 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:31.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:31 smithi165 ceph-mon[36229]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:31.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:31 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:31.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:31 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:31.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:31 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:38:31.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:31 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:32.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:32 smithi165 ceph-mon[36229]: Reconfiguring ceph-exporter.smithi165 (monmap changed)... 2024-09-06T14:38:32.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:32 smithi165 ceph-mon[36229]: Reconfiguring daemon ceph-exporter.smithi165 on smithi165 2024-09-06T14:38:32.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-06T14:38:32.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:32.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:32 smithi052 ceph-mon[28627]: Reconfiguring ceph-exporter.smithi165 (monmap changed)... 2024-09-06T14:38:32.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:32 smithi052 ceph-mon[28627]: Reconfiguring daemon ceph-exporter.smithi165 on smithi165 2024-09-06T14:38:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-06T14:38:32.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:33.437 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:33 smithi165 ceph-mon[36229]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:33.437 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:33 smithi165 ceph-mon[36229]: Deploying daemon osd.0 on smithi052 2024-09-06T14:38:33.437 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:33.437 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:33.437 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-06T14:38:33.437 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:33.597 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:33 smithi052 ceph-mon[28627]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:33.597 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:33 smithi052 ceph-mon[28627]: Deploying daemon osd.0 on smithi052 2024-09-06T14:38:33.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:33.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:33.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-06T14:38:33.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:34.465 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:34 smithi165 ceph-mon[36229]: Reconfiguring crash.smithi165 (monmap changed)... 2024-09-06T14:38:34.465 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:34 smithi165 ceph-mon[36229]: Reconfiguring daemon crash.smithi165 on smithi165 2024-09-06T14:38:34.465 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:34 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:34.465 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:34 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:34.465 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:34 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:38:34.465 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:34 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:38:34.466 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:34 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:34.501 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:34 smithi052 ceph-mon[28627]: Reconfiguring crash.smithi165 (monmap changed)... 2024-09-06T14:38:34.501 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:34 smithi052 ceph-mon[28627]: Reconfiguring daemon crash.smithi165 on smithi165 2024-09-06T14:38:34.501 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:34 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:34.501 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:34 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:34.501 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:34 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:38:34.501 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:34 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:38:34.501 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:34 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: Reconfiguring mgr.smithi165.hcexoi (monmap changed)... 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: Reconfiguring daemon mgr.smithi165.hcexoi on smithi165 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:38:35.519 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:35.602 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: Reconfiguring mgr.smithi165.hcexoi (monmap changed)... 2024-09-06T14:38:35.602 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: Reconfiguring daemon mgr.smithi165.hcexoi on smithi165 2024-09-06T14:38:35.602 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:35.602 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:35.602 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:35.602 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:38:35.603 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:38:35.603 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:36.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:36 smithi165 ceph-mon[36229]: Reconfiguring mon.smithi165 (monmap changed)... 2024-09-06T14:38:36.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:36 smithi165 ceph-mon[36229]: Reconfiguring daemon mon.smithi165 on smithi165 2024-09-06T14:38:36.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:36 smithi052 ceph-mon[28627]: Reconfiguring mon.smithi165 (monmap changed)... 2024-09-06T14:38:36.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:36 smithi052 ceph-mon[28627]: Reconfiguring daemon mon.smithi165 on smithi165 2024-09-06T14:38:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi052:9093"}]: dispatch 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi052:3000"}]: dispatch 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi052:9095"}]: dispatch 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:38:37.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:37.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:38:37.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi052:9093"}]: dispatch 2024-09-06T14:38:37.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:38:37.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi052:3000"}]: dispatch 2024-09-06T14:38:37.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:38:37.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi052:9095"}]: dispatch 2024-09-06T14:38:37.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:37.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:38:38.581 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:38:38.581 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi052:9093"}]: dispatch 2024-09-06T14:38:38.581 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:38:38.582 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi052:3000"}]: dispatch 2024-09-06T14:38:38.582 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:38:38.582 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi052:9095"}]: dispatch 2024-09-06T14:38:38.582 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:38.582 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:38 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:38:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi052:9093"}]: dispatch 2024-09-06T14:38:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:38:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi052:3000"}]: dispatch 2024-09-06T14:38:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:38:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi052:9095"}]: dispatch 2024-09-06T14:38:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:38 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:39.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:39 smithi052 ceph-mon[28627]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:39.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:39 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:39.479 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:39 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:39 smithi165 ceph-mon[36229]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:39 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:39 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:40.518 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:40 smithi052 ceph-mon[28627]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:40.518 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:40.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:40 smithi165 ceph-mon[36229]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:40.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:42.252 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 0 on host 'smithi052' 2024-09-06T14:38:42.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.253+0000 7fafe37fe640 1 -- 172.21.15.52:0/1713619313 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fafe419f5d0 con 0x7fafcc06de00 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fafcc06de00 msgr2=0x7fafcc0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fafcc06de00 0x7fafcc0702c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fafd80096c0 tx=0x7fafd8009650 comp rx=0 tx=0).stop 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4100880 msgr2=0x7fafe41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4100880 0x7fafe41047a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00ea20 tx=0x7fafdc00eee0 comp rx=0 tx=0).stop 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 shutdown_connections 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fafcc06de00 0x7fafcc0702c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fafe4101a80 0x7fafe4102e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 --2- 172.21.15.52:0/1713619313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fafe4100880 0x7fafe41047a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 >> 172.21.15.52:0/1713619313 conn(0x7fafe40fc030 msgr2=0x7fafe406a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:38:42.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 shutdown_connections 2024-09-06T14:38:42.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:42.255+0000 7fafec78b640 1 -- 172.21.15.52:0/1713619313 wait complete. 2024-09-06T14:38:42.838 DEBUG:teuthology.orchestra.run.smithi052:osd.0> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.0.service 2024-09-06T14:38:42.840 INFO:tasks.cephadm:Deploying osd.1 on smithi052 with /dev/vg_nvme/lv_3... 2024-09-06T14:38:42.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-06T14:38:43.520 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:38:43.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:43.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:43.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:43 smithi165 ceph-mon[36229]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:43.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:43.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:43 smithi052 ceph-mon[28627]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:43.935 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:38:43 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[50108]: 2024-09-06T14:38:43.855+0000 7f7a3e3d0640 -1 osd.0 0 log_to_monitors true 2024-09-06T14:38:44.689 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:44.689 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:44.689 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:44 smithi052 ceph-mon[28627]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-06T14:38:44.689 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:44 smithi052 ceph-mon[28627]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:44 smithi165 ceph-mon[36229]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-06T14:38:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:44 smithi165 ceph-mon[36229]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:45 smithi165 ceph-mon[36229]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T14:38:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:45 smithi165 ceph-mon[36229]: osdmap e7: 1 total, 0 up, 1 in 2024-09-06T14:38:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:45 smithi165 ceph-mon[36229]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-06T14:38:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:45 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:45.796 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:45 smithi052 ceph-mon[28627]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T14:38:45.796 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:45 smithi052 ceph-mon[28627]: osdmap e7: 1 total, 0 up, 1 in 2024-09-06T14:38:45.796 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:45 smithi052 ceph-mon[28627]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-06T14:38:45.796 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:45 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:45.797 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:38:45 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[50108]: 2024-09-06T14:38:45.518+0000 7f7a39b30640 -1 osd.0 0 waiting for initial osdmap 2024-09-06T14:38:45.797 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:38:45 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[50108]: 2024-09-06T14:38:45.522+0000 7f7a3616a640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:38:46.819 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:46 smithi052 ceph-mon[28627]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-06T14:38:46.819 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:46 smithi052 ceph-mon[28627]: osdmap e8: 1 total, 0 up, 1 in 2024-09-06T14:38:46.819 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:46.819 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:46.819 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:46 smithi052 ceph-mon[28627]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:46.821 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:38:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:46 smithi165 ceph-mon[36229]: from='osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-06T14:38:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:46 smithi165 ceph-mon[36229]: osdmap e8: 1 total, 0 up, 1 in 2024-09-06T14:38:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:46 smithi165 ceph-mon[36229]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-06T14:38:46.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_3 2024-09-06T14:38:47.362 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:38:47.767 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:47 smithi052 ceph-mon[28627]: purged_snaps scrub starts 2024-09-06T14:38:47.767 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:47 smithi052 ceph-mon[28627]: purged_snaps scrub ok 2024-09-06T14:38:47.767 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:47 smithi052 ceph-mon[28627]: osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] boot 2024-09-06T14:38:47.767 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:47 smithi052 ceph-mon[28627]: osdmap e9: 1 total, 1 up, 1 in 2024-09-06T14:38:47.767 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:47 smithi165 ceph-mon[36229]: purged_snaps scrub starts 2024-09-06T14:38:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:47 smithi165 ceph-mon[36229]: purged_snaps scrub ok 2024-09-06T14:38:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:47 smithi165 ceph-mon[36229]: osd.0 [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] boot 2024-09-06T14:38:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:47 smithi165 ceph-mon[36229]: osdmap e9: 1 total, 1 up, 1 in 2024-09-06T14:38:47.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:38:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.863+0000 7f2cb96cf640 1 -- 172.21.15.52:0/3421798244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4102450 msgr2=0x7f2cb4104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:47.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.863+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/3421798244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4102450 0x7f2cb4104840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009880 tx=0x7f2ca402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.863+0000 7f2cb96cf640 1 -- 172.21.15.52:0/3421798244 shutdown_connections 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.863+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/3421798244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cb4104d80 0x7f2cb4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.863+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/3421798244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4102450 0x7f2cb4104840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.863+0000 7f2cb96cf640 1 -- 172.21.15.52:0/3421798244 >> 172.21.15.52:0/3421798244 conn(0x7f2cb40fc010 msgr2=0x7f2cb40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.864+0000 7f2cb96cf640 1 -- 172.21.15.52:0/3421798244 shutdown_connections 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.864+0000 7f2cb96cf640 1 -- 172.21.15.52:0/3421798244 wait complete. 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.864+0000 7f2cb96cf640 1 Processor -- start 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.864+0000 7f2cb96cf640 1 -- start start 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb96cf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cb4102450 0x7f2cb4101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb96cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4104d80 0x7f2cb4100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb96cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410a750 con 0x7f2cb4104d80 2024-09-06T14:38:47.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb96cf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410a5d0 con 0x7f2cb4102450 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4104d80 0x7f2cb4100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4104d80 0x7f2cb4100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38756/0 (socket says 172.21.15.52:38756) 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb27fc640 1 -- 172.21.15.52:0/2813072776 learned_addr learned my addr 172.21.15.52:0/2813072776 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb2ffd640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cb4102450 0x7f2cb4101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb27fc640 1 -- 172.21.15.52:0/2813072776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cb4102450 msgr2=0x7f2cb4101d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb27fc640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cb4102450 0x7f2cb4101d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb27fc640 1 -- 172.21.15.52:0/2813072776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb4100940 con 0x7f2cb4104d80 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb2ffd640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cb4102450 0x7f2cb4101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb27fc640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4104d80 0x7f2cb4100400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c8f0 tx=0x7f2ca800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2c9bfff640 1 -- 172.21.15.52:0/2813072776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ca80079b0 con 0x7f2cb4104d80 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.865+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb4100c30 con 0x7f2cb4104d80 2024-09-06T14:38:47.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.866+0000 7f2c9bfff640 1 -- 172.21.15.52:0/2813072776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ca80054e0 con 0x7f2cb4104d80 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.866+0000 7f2c9bfff640 1 -- 172.21.15.52:0/2813072776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ca8004e50 con 0x7f2cb4104d80 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.866+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb41011c0 con 0x7f2cb4104d80 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.867+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb4102830 con 0x7f2cb4104d80 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.867+0000 7f2c9bfff640 1 -- 172.21.15.52:0/2813072776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f2ca800f4a0 con 0x7f2cb4104d80 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.867+0000 7f2c9bfff640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2c9c06dee0 0x7f2c9c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.868+0000 7f2c9bfff640 1 -- 172.21.15.52:0/2813072776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f2ca808ccc0 con 0x7f2cb4104d80 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.868+0000 7f2cb2ffd640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2c9c06dee0 0x7f2c9c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:38:47.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.869+0000 7f2cb2ffd640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2c9c06dee0 0x7f2c9c0703a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005ab0 tx=0x7f2ca4005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:38:47.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:47.874+0000 7f2c9bfff640 1 -- 172.21.15.52:0/2813072776 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2ca8014030 con 0x7f2cb4104d80 2024-09-06T14:38:48.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:38:48.063+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2cb419f560 con 0x7f2c9c06dee0 2024-09-06T14:38:48.822 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:48 smithi052 ceph-mon[28627]: osdmap e10: 1 total, 1 up, 1 in 2024-09-06T14:38:48.822 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:48 smithi052 ceph-mon[28627]: from='client.14348 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:38:48.822 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:48 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:38:48.822 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:48 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:38:48.822 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:48 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:48.822 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:48 smithi052 ceph-mon[28627]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:48 smithi165 ceph-mon[36229]: osdmap e10: 1 total, 1 up, 1 in 2024-09-06T14:38:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:48 smithi165 ceph-mon[36229]: from='client.14348 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:38:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:48 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:38:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:48 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:38:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:48 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:48.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:48 smithi165 ceph-mon[36229]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:49.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: Detected new or changed devices on smithi052 2024-09-06T14:38:49.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:38:49.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi052 to 11844M 2024-09-06T14:38:49.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.787 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:49.787 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:38:49.787 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.787 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:38:49.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: Detected new or changed devices on smithi052 2024-09-06T14:38:49.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:38:49.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi052 to 11844M 2024-09-06T14:38:49.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:49.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:38:49.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:49.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:38:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:51 smithi165 ceph-mon[36229]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:51 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:51 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:51 smithi052 ceph-mon[28627]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:51 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:51 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:52.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:52 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/446294427' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0266d9c3-3a34-4274-b6b8-7b31b8179010"}]: dispatch 2024-09-06T14:38:52.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:52 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/446294427' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0266d9c3-3a34-4274-b6b8-7b31b8179010"}]': finished 2024-09-06T14:38:52.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:52 smithi165 ceph-mon[36229]: osdmap e11: 2 total, 1 up, 2 in 2024-09-06T14:38:52.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:52 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:38:52.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:52 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/22623936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:38:52.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:52 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/446294427' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0266d9c3-3a34-4274-b6b8-7b31b8179010"}]: dispatch 2024-09-06T14:38:52.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:52 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/446294427' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0266d9c3-3a34-4274-b6b8-7b31b8179010"}]': finished 2024-09-06T14:38:52.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:52 smithi052 ceph-mon[28627]: osdmap e11: 2 total, 1 up, 2 in 2024-09-06T14:38:52.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:52 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:38:52.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:52 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/22623936' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:38:53.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:53 smithi165 ceph-mon[36229]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:53.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:53 smithi052 ceph-mon[28627]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:55.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:55.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:55.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:38:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:54 smithi165 ceph-mon[36229]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:55.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:55.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:55.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:38:55.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:38:55.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:38:55.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:54 smithi052 ceph-mon[28627]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:56.279 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:38:57.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:56 smithi052 ceph-mon[28627]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:57.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:56 smithi165 ceph-mon[36229]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:59.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:38:59 smithi052 ceph-mon[28627]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:38:59.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:38:59 smithi165 ceph-mon[36229]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:00.567 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-06T14:39:00.567 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:00.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-06T14:39:00.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:01.448 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:01 smithi052 ceph-mon[28627]: Deploying daemon osd.1 on smithi052 2024-09-06T14:39:01.448 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:01 smithi052 ceph-mon[28627]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:01.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:01 smithi165 ceph-mon[36229]: Deploying daemon osd.1 on smithi052 2024-09-06T14:39:01.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:01 smithi165 ceph-mon[36229]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:03.493 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:03 smithi052 ceph-mon[28627]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:03.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:03 smithi165 ceph-mon[36229]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:05 smithi165 ceph-mon[36229]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:05 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:05 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:05.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:05 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:05.611 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:05 smithi052 ceph-mon[28627]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:05 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:05 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:05 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:07.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:07 smithi052 ceph-mon[28627]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:07.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:07.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:07 smithi165 ceph-mon[36229]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:07.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:07.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.312+0000 7f2c9bfff640 1 -- 172.21.15.52:0/2813072776 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2cb419f560 con 0x7f2c9c06dee0 2024-09-06T14:39:08.310 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 1 on host 'smithi052' 2024-09-06T14:39:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2c9c06dee0 msgr2=0x7f2c9c0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2c9c06dee0 0x7f2c9c0703a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4005ab0 tx=0x7f2ca4005a20 comp rx=0 tx=0).stop 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4104d80 msgr2=0x7f2cb4100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4104d80 0x7f2cb4100400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c8f0 tx=0x7f2ca800cdb0 comp rx=0 tx=0).stop 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 shutdown_connections 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2c9c06dee0 0x7f2c9c0703a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cb4104d80 0x7f2cb4100400 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 --2- 172.21.15.52:0/2813072776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cb4102450 0x7f2cb4101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.314+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 >> 172.21.15.52:0/2813072776 conn(0x7f2cb40fc010 msgr2=0x7f2cb40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.315+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 shutdown_connections 2024-09-06T14:39:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:08.315+0000 7f2cb96cf640 1 -- 172.21.15.52:0/2813072776 wait complete. 2024-09-06T14:39:08.968 DEBUG:teuthology.orchestra.run.smithi052:osd.1> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.1.service 2024-09-06T14:39:08.971 INFO:tasks.cephadm:Deploying osd.2 on smithi052 with /dev/vg_nvme/lv_2... 2024-09-06T14:39:08.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-06T14:39:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:09 smithi165 ceph-mon[36229]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:09 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:09 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:09 smithi052 ceph-mon[28627]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:09 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:09.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:09 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:09.707 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:39:10.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:10 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:10.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:10 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:11.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:11 smithi052 ceph-mon[28627]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:11.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:11 smithi165 ceph-mon[36229]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:11.642 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:11 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[57376]: 2024-09-06T14:39:11.392+0000 7efedfd05640 -1 osd.1 0 log_to_monitors true 2024-09-06T14:39:12.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:12 smithi165 ceph-mon[36229]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-06T14:39:12.587 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:12 smithi052 ceph-mon[28627]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-06T14:39:13.418 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:13 smithi052 ceph-mon[28627]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:13.418 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:13 smithi052 ceph-mon[28627]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T14:39:13.418 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:13 smithi052 ceph-mon[28627]: osdmap e12: 2 total, 1 up, 2 in 2024-09-06T14:39:13.418 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:13 smithi052 ceph-mon[28627]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-06T14:39:13.419 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:13 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:13 smithi165 ceph-mon[36229]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:13 smithi165 ceph-mon[36229]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T14:39:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:13 smithi165 ceph-mon[36229]: osdmap e12: 2 total, 1 up, 2 in 2024-09-06T14:39:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:13 smithi165 ceph-mon[36229]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-06T14:39:13.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:13 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:13.688 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:39:13.723 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_2 2024-09-06T14:39:14.066 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:39:14.299 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[57376]: 2024-09-06T14:39:14.054+0000 7efedb465640 -1 osd.1 0 waiting for initial osdmap 2024-09-06T14:39:14.300 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[57376]: 2024-09-06T14:39:14.059+0000 7efed3a97640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:39:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.508+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/423902932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 msgr2=0x7fa7e4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.508+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/423902932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4101ee0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009880 tx=0x7fa7d402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:39:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/423902932 shutdown_connections 2024-09-06T14:39:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/423902932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4101ee0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/423902932 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4100860 0x7fa7e4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/423902932 >> 172.21.15.52:0/423902932 conn(0x7fa7e40fc010 msgr2=0x7fa7e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:39:14.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/423902932 shutdown_connections 2024-09-06T14:39:14.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/423902932 wait complete. 2024-09-06T14:39:14.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 Processor -- start 2024-09-06T14:39:14.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 -- start start 2024-09-06T14:39:14.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4100860 0x7fa7e4104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:39:14.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:39:14.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e41096a0 con 0x7fa7e4101a60 2024-09-06T14:39:14.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.509+0000 7fa7ec3c0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4109520 con 0x7fa7e4100860 2024-09-06T14:39:14.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7e995b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:39:14.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7e995b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48188/0 (socket says 172.21.15.52:48188) 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7e995b640 1 -- 172.21.15.52:0/2628610205 learned_addr learned my addr 172.21.15.52:0/2628610205 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7ea15c640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4100860 0x7fa7e4104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7e995b640 1 -- 172.21.15.52:0/2628610205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4100860 msgr2=0x7fa7e4104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7e995b640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4100860 0x7fa7e4104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7e995b640 1 -- 172.21.15.52:0/2628610205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e4103380 con 0x7fa7e4101a60 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7e995b640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4102e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4006010 tx=0x7fa7d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7db7fe640 1 -- 172.21.15.52:0/2628610205 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7d403f070 con 0x7fa7e4101a60 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e4103610 con 0x7fa7e4101a60 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7db7fe640 1 -- 172.21.15.52:0/2628610205 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7d4004ac0 con 0x7fa7e4101a60 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7db7fe640 1 -- 172.21.15.52:0/2628610205 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7d403f070 con 0x7fa7e4101a60 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.510+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e4103b40 con 0x7fa7e4101a60 2024-09-06T14:39:14.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.511+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e4100c60 con 0x7fa7e4101a60 2024-09-06T14:39:14.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.512+0000 7fa7db7fe640 1 -- 172.21.15.52:0/2628610205 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7fa7d4042070 con 0x7fa7e4101a60 2024-09-06T14:39:14.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.513+0000 7fa7db7fe640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa7d006dfc0 0x7fa7d0070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:39:14.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.513+0000 7fa7db7fe640 1 -- 172.21.15.52:0/2628610205 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2134+0+0 (secure 0 0 0) 0x7fa7d40ad570 con 0x7fa7e4101a60 2024-09-06T14:39:14.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.513+0000 7fa7ea15c640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa7d006dfc0 0x7fa7d0070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:39:14.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.513+0000 7fa7ea15c640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa7d006dfc0 0x7fa7d0070480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005fd0 tx=0x7fa7e000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:39:14.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.518+0000 7fa7db7fe640 1 -- 172.21.15.52:0/2628610205 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7d407fba0 con 0x7fa7e4101a60 2024-09-06T14:39:14.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:14 smithi165 ceph-mon[36229]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-06T14:39:14.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:14 smithi165 ceph-mon[36229]: osdmap e13: 2 total, 1 up, 2 in 2024-09-06T14:39:14.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:14 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:14.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:14 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:14.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:14 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:14.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:14 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:14.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:14 smithi165 ceph-mon[36229]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' 2024-09-06T14:39:14.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-mon[28627]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-06T14:39:14.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-mon[28627]: osdmap e13: 2 total, 1 up, 2 in 2024-09-06T14:39:14.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:14.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:14.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:14.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:14.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:14 smithi052 ceph-mon[28627]: from='osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109]' entity='osd.1' 2024-09-06T14:39:14.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:14.724+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa7e406a9b0 con 0x7fa7d006dfc0 2024-09-06T14:39:15.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: purged_snaps scrub starts 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: purged_snaps scrub ok 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] boot 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: osdmap e14: 2 total, 2 up, 2 in 2024-09-06T14:39:15.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:15 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: purged_snaps scrub starts 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: purged_snaps scrub ok 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: osd.1 [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] boot 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: osdmap e14: 2 total, 2 up, 2 in 2024-09-06T14:39:15.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:15 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:39:16.609 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:16 smithi052 ceph-mon[28627]: from='client.14366 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:39:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:16 smithi165 ceph-mon[36229]: from='client.14366 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:39:17.604 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:17 smithi052 ceph-mon[28627]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:17.604 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:17 smithi052 ceph-mon[28627]: osdmap e15: 2 total, 2 up, 2 in 2024-09-06T14:39:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:17 smithi165 ceph-mon[36229]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:17 smithi165 ceph-mon[36229]: osdmap e15: 2 total, 2 up, 2 in 2024-09-06T14:39:19.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:19.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: Detected new or changed devices on smithi052 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi052 to 5922M 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: Detected new or changed devices on smithi052 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi052 to 5922M 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:19.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:19.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:19.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:20 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2448423140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f74510c1-d48f-4813-9d2a-294a5b8c1c5e"}]: dispatch 2024-09-06T14:39:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:20 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2448423140' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f74510c1-d48f-4813-9d2a-294a5b8c1c5e"}]': finished 2024-09-06T14:39:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:20 smithi165 ceph-mon[36229]: osdmap e16: 3 total, 2 up, 3 in 2024-09-06T14:39:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:20 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:20.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:20 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1918397680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:39:20.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:20 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2448423140' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f74510c1-d48f-4813-9d2a-294a5b8c1c5e"}]: dispatch 2024-09-06T14:39:20.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:20 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2448423140' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f74510c1-d48f-4813-9d2a-294a5b8c1c5e"}]': finished 2024-09-06T14:39:20.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:20 smithi052 ceph-mon[28627]: osdmap e16: 3 total, 2 up, 3 in 2024-09-06T14:39:20.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:20 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:20.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:20 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1918397680' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:39:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:21 smithi165 ceph-mon[36229]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:21 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:21 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:21.598 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:21 smithi052 ceph-mon[28627]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:21.599 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:21.599 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:21 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:23.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:23 smithi165 ceph-mon[36229]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:23.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:23 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:23.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:23 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:23.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:23 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:23.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:23 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:23.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:23 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:23.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:23 smithi052 ceph-mon[28627]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:23.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:23 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:23.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:23 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:23.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:23 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:23.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:23 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:23.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:23 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:25 smithi165 ceph-mon[36229]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:25.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:25 smithi052 ceph-mon[28627]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:26 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:26.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:26 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:27 smithi052 ceph-mon[28627]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:27.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:27 smithi165 ceph-mon[36229]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:28.563 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-06T14:39:28.563 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:28.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:28 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-06T14:39:28.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:28 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:29 smithi165 ceph-mon[36229]: Deploying daemon osd.2 on smithi052 2024-09-06T14:39:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:29 smithi165 ceph-mon[36229]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:29.585 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:29 smithi052 ceph-mon[28627]: Deploying daemon osd.2 on smithi052 2024-09-06T14:39:29.586 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:29 smithi052 ceph-mon[28627]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:31.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:31 smithi052 ceph-mon[28627]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:31.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:31 smithi165 ceph-mon[36229]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:33.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:33 smithi165 ceph-mon[36229]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:33.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:33.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:33.581 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:33 smithi052 ceph-mon[28627]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:33.581 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:33.581 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:33.581 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:35 smithi165 ceph-mon[36229]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:35.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:35 smithi052 ceph-mon[28627]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:37.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.040+0000 7fa7db7fe640 1 -- 172.21.15.52:0/2628610205 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa7e406a9b0 con 0x7fa7d006dfc0 2024-09-06T14:39:37.038 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 2 on host 'smithi052' 2024-09-06T14:39:37.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa7d006dfc0 msgr2=0x7fa7d0070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:37.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa7d006dfc0 0x7fa7d0070480 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0005fd0 tx=0x7fa7e000b390 comp rx=0 tx=0).stop 2024-09-06T14:39:37.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 msgr2=0x7fa7e4102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4102e40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4006010 tx=0x7fa7d40046c0 comp rx=0 tx=0).stop 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 shutdown_connections 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa7d006dfc0 0x7fa7d0070480 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4101a60 0x7fa7e4102e40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 --2- 172.21.15.52:0/2628610205 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4100860 0x7fa7e4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 >> 172.21.15.52:0/2628610205 conn(0x7fa7e40fc010 msgr2=0x7fa7e406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.042+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 shutdown_connections 2024-09-06T14:39:37.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:39:37.043+0000 7fa7ec3c0640 1 -- 172.21.15.52:0/2628610205 wait complete. 2024-09-06T14:39:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:37 smithi165 ceph-mon[36229]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:37.608 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:37 smithi052 ceph-mon[28627]: pgmap v77: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:37.609 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:37.609 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:38.313 DEBUG:teuthology.orchestra.run.smithi052:osd.2> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.2.service 2024-09-06T14:39:38.315 INFO:tasks.cephadm:Deploying osd.3 on smithi165 with /dev/vg_nvme/lv_4... 2024-09-06T14:39:38.316 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-06T14:39:38.573 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:39:39.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:39 smithi165 ceph-mon[36229]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:39.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:39 smithi052 ceph-mon[28627]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:39.624 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:39 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[65048]: 2024-09-06T14:39:39.415+0000 7f805a4cf640 -1 osd.2 0 log_to_monitors true 2024-09-06T14:39:40.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:40 smithi165 ceph-mon[36229]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-06T14:39:40.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:40.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:40.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:40.611 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:40 smithi052 ceph-mon[28627]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-06T14:39:40.611 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:40.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:40.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:40.992 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:39:41.018 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_4 2024-09-06T14:39:41.268 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:39:41.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:41 smithi052 ceph-mon[28627]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:41.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:41 smithi052 ceph-mon[28627]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T14:39:41.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:41 smithi052 ceph-mon[28627]: osdmap e17: 3 total, 2 up, 3 in 2024-09-06T14:39:41.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:41 smithi052 ceph-mon[28627]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-06T14:39:41.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:41 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:41.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:41 smithi165 ceph-mon[36229]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:41.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:41 smithi165 ceph-mon[36229]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T14:39:41.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:41 smithi165 ceph-mon[36229]: osdmap e17: 3 total, 2 up, 3 in 2024-09-06T14:39:41.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:41 smithi165 ceph-mon[36229]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]: dispatch 2024-09-06T14:39:41.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:41 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:41.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 -- 172.21.15.165:0/2202682177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc101960 msgr2=0x7f12dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:41.760 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 --2- 172.21.15.165:0/2202682177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc101960 0x7f12dc101d60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f12cc009c20 tx=0x7f12cc02a970 comp rx=0 tx=0).stop 2024-09-06T14:39:41.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 -- 172.21.15.165:0/2202682177 shutdown_connections 2024-09-06T14:39:41.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 --2- 172.21.15.165:0/2202682177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12dc102b60 0x7f12dc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:41.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 --2- 172.21.15.165:0/2202682177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc101960 0x7f12dc101d60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:41.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 -- 172.21.15.165:0/2202682177 >> 172.21.15.165:0/2202682177 conn(0x7f12dc0fd0f0 msgr2=0x7f12dc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:39:41.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 -- 172.21.15.165:0/2202682177 shutdown_connections 2024-09-06T14:39:41.761 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.762+0000 7f12e0ece640 1 -- 172.21.15.165:0/2202682177 wait complete. 2024-09-06T14:39:41.763 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.763+0000 7f12e0ece640 1 Processor -- start 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.763+0000 7f12e0ece640 1 -- start start 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.763+0000 7f12e0ece640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12dc101960 0x7f12dc1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.763+0000 7f12e0ece640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc102b60 0x7f12dc197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.763+0000 7f12e0ece640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc10a7a0 con 0x7f12dc101960 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.763+0000 7f12e0ece640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc10a620 con 0x7f12dc102b60 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d9d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc102b60 0x7f12dc197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d9d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc102b60 0x7f12dc197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:56366/0 (socket says 172.21.15.165:56366) 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d9d9b640 1 -- 172.21.15.165:0/1024077262 learned_addr learned my addr 172.21.15.165:0/1024077262 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12da59c640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12dc101960 0x7f12dc1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:39:41.764 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d9d9b640 1 -- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12dc101960 msgr2=0x7f12dc1974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d9d9b640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12dc101960 0x7f12dc1974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d9d9b640 1 -- 172.21.15.165:0/1024077262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc1980a0 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d9d9b640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc102b60 0x7f12dc197a20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f12c400d6f0 tx=0x7f12c400dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12c4017070 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc19cae0 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12c400de00 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12c4004bb0 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.764+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc19d0f0 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.765+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12dc101d60 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.766+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 18) ==== 92147+0+0 (secure 0 0 0) 0x7f12c4009a30 con 0x7f12dc102b60 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.766+0000 7f12d37fe640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f12c806ddb0 0x7f12c8070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:39:41.765 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.766+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2566+0+0 (secure 0 0 0) 0x7f12c408cac0 con 0x7f12dc102b60 2024-09-06T14:39:41.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.766+0000 7f12da59c640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f12c806ddb0 0x7f12c8070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:39:41.766 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.767+0000 7f12da59c640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f12c806ddb0 0x7f12c8070270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f12cc000f80 tx=0x7f12cc03c040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:39:41.769 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.771+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12c405ef40 con 0x7f12dc102b60 2024-09-06T14:39:41.941 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:41.944+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f12dc062630 con 0x7f12c806ddb0 2024-09-06T14:39:42.321 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[65048]: 2024-09-06T14:39:42.066+0000 7f8055c2f640 -1 osd.2 0 waiting for initial osdmap 2024-09-06T14:39:42.321 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[65048]: 2024-09-06T14:39:42.072+0000 7f804e261640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:39:42.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-06T14:39:42.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: osdmap e18: 3 total, 2 up, 3 in 2024-09-06T14:39:42.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:42.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:42.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:39:42.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:39:42.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:42.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:42 smithi165 ceph-mon[36229]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' 2024-09-06T14:39:42.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-06T14:39:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: osdmap e18: 3 total, 2 up, 3 in 2024-09-06T14:39:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:39:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:39:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:42 smithi052 ceph-mon[28627]: from='osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143]' entity='osd.2' 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: purged_snaps scrub starts 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: purged_snaps scrub ok 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:43.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] boot 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: osdmap e19: 3 total, 3 up, 3 in 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:43.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:43 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:43.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: purged_snaps scrub starts 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: purged_snaps scrub ok 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:43.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: osd.2 [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] boot 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: osdmap e19: 3 total, 3 up, 3 in 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:39:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:43 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:44.493 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:44 smithi052 ceph-mon[28627]: Detected new or changed devices on smithi052 2024-09-06T14:39:44.493 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:44 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi052 to 3948M 2024-09-06T14:39:44.493 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:44 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/344229605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c53c54-ee2c-4cd0-a296-816e7c90bfae"}]: dispatch 2024-09-06T14:39:44.493 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:44 smithi052 ceph-mon[28627]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c53c54-ee2c-4cd0-a296-816e7c90bfae"}]: dispatch 2024-09-06T14:39:44.493 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:44 smithi052 ceph-mon[28627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69c53c54-ee2c-4cd0-a296-816e7c90bfae"}]': finished 2024-09-06T14:39:44.493 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:44 smithi052 ceph-mon[28627]: osdmap e20: 4 total, 3 up, 4 in 2024-09-06T14:39:44.494 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:44 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:44.712 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:44 smithi165 ceph-mon[36229]: Detected new or changed devices on smithi052 2024-09-06T14:39:44.712 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:44 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi052 to 3948M 2024-09-06T14:39:44.712 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:44 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/344229605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c53c54-ee2c-4cd0-a296-816e7c90bfae"}]: dispatch 2024-09-06T14:39:44.712 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:44 smithi165 ceph-mon[36229]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c53c54-ee2c-4cd0-a296-816e7c90bfae"}]: dispatch 2024-09-06T14:39:44.712 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:44 smithi165 ceph-mon[36229]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69c53c54-ee2c-4cd0-a296-816e7c90bfae"}]': finished 2024-09-06T14:39:44.713 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:44 smithi165 ceph-mon[36229]: osdmap e20: 4 total, 3 up, 4 in 2024-09-06T14:39:44.713 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:44 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:45 smithi165 ceph-mon[36229]: pgmap v85: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:45 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-06T14:39:45.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:45 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/1959045097' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:39:45.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:45 smithi052 ceph-mon[28627]: pgmap v85: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:45.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:45 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-06T14:39:45.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:45 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/1959045097' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:39:46.687 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T14:39:46.687 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:46 smithi052 ceph-mon[28627]: osdmap e21: 4 total, 3 up, 4 in 2024-09-06T14:39:46.687 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:46.687 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-06T14:39:46.688 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:46 smithi052 ceph-mon[28627]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-06T14:39:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:46 smithi165 ceph-mon[36229]: osdmap e21: 4 total, 3 up, 4 in 2024-09-06T14:39:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-06T14:39:46.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:46 smithi165 ceph-mon[36229]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:47.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T14:39:47.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T14:39:47.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: osdmap e22: 4 total, 3 up, 4 in 2024-09-06T14:39:47.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:47.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:47.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:47.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:47.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:47.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:47 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T14:39:47.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-06T14:39:47.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: osdmap e22: 4 total, 3 up, 4 in 2024-09-06T14:39:47.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:47.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:47.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:47.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:47.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:39:47.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:47 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:48.023 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:47 smithi052 sudo[70424]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-06T14:39:48.023 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:47 smithi052 sudo[70424]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:48.023 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:47 smithi052 sudo[70424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:48.023 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:47 smithi052 sudo[70424]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:48.302 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70427]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-06T14:39:48.302 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70427]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:48.302 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:48.302 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70427]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:48.570 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70430]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-06T14:39:48.571 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70430]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:48.571 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:48.571 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70430]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:48.829 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70433]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-06T14:39:48.829 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70433]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:48.829 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:48.829 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70433]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:49.057 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:39:49.059+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f12c40572b0 con 0x7f12dc102b60 2024-09-06T14:39:49.099 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 ceph-mon[28627]: osdmap e23: 4 total, 3 up, 4 in 2024-09-06T14:39:49.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:49.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:49.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 ceph-mon[28627]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:49.100 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70436]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-06T14:39:49.100 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70436]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:49.100 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:49.100 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:48 smithi052 sudo[70436]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 ceph-mon[36229]: osdmap e23: 4 total, 3 up, 4 in 2024-09-06T14:39:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:39:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 ceph-mon[36229]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:49.355 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70439]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-06T14:39:49.356 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70439]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:49.356 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:49.356 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70439]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:49.621 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70442]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-06T14:39:49.621 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70442]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:49.621 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:49.621 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70442]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:49.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70445]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-06T14:39:49.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70445]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:49.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:49.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:49 smithi052 sudo[70445]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:50.128 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 sudo[41393]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-06T14:39:50.128 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 sudo[41393]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:50.128 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 sudo[41393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:50.128 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:49 smithi165 sudo[41393]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:50.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 sudo[41396]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 sudo[41396]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 sudo[41396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 sudo[41396]: pam_unix(sudo:session): session closed for user root 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: Cluster is now healthy 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: mgrmap e19: smithi052.vsthpq(active, since 2m), standbys: smithi165.hcexoi 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:39:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:39:50.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:39:50.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: Cluster is now healthy 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: mgrmap e19: smithi052.vsthpq(active, since 2m), standbys: smithi165.hcexoi 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:39:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:39:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:51 smithi165 ceph-mon[36229]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T14:39:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:51 smithi165 ceph-mon[36229]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T14:39:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:51 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:51.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:51 smithi165 ceph-mon[36229]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:51 smithi052 ceph-mon[28627]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-06T14:39:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:51 smithi052 ceph-mon[28627]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-06T14:39:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:51 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:51 smithi052 ceph-mon[28627]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:53.411 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:53 smithi165 ceph-mon[36229]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:53.411 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:53 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-06T14:39:53.411 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:53 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:53 smithi052 ceph-mon[28627]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:53 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-06T14:39:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:53 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:39:54.592 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:54 smithi165 ceph-mon[36229]: Deploying daemon osd.3 on smithi165 2024-09-06T14:39:54.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:54 smithi052 ceph-mon[28627]: Deploying daemon osd.3 on smithi165 2024-09-06T14:39:55.369 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:55 smithi165 ceph-mon[36229]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:55.369 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:55.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:55 smithi052 ceph-mon[28627]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:55.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:39:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:57 smithi165 ceph-mon[36229]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:57 smithi052 ceph-mon[28627]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:58 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:58 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:58 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:58.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:58 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:39:58.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:58 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:58.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:58 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:39:59.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:39:59 smithi165 ceph-mon[36229]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:39:59.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:39:59 smithi052 ceph-mon[28627]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:00.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:00 smithi165 ceph-mon[36229]: overall HEALTH_OK 2024-09-06T14:40:00.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:00 smithi052 ceph-mon[28627]: overall HEALTH_OK 2024-09-06T14:40:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:01 smithi052 ceph-mon[28627]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:01.723 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:01 smithi165 ceph-mon[36229]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:01.723 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:01.723 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:01.723 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:01.724 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:01.724 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:02.137 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.140+0000 7f12d37fe640 1 -- 172.21.15.165:0/1024077262 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f12dc062630 con 0x7f12c806ddb0 2024-09-06T14:40:02.138 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 3 on host 'smithi165' 2024-09-06T14:40:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.142+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f12c806ddb0 msgr2=0x7f12c8070270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.142+0000 7f12e0ece640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f12c806ddb0 0x7f12c8070270 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f12cc000f80 tx=0x7f12cc03c040 comp rx=0 tx=0).stop 2024-09-06T14:40:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.142+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc102b60 msgr2=0x7f12dc197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.142+0000 7f12e0ece640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc102b60 0x7f12dc197a20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f12c400d6f0 tx=0x7f12c400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:40:02.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.143+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 shutdown_connections 2024-09-06T14:40:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.143+0000 7f12e0ece640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f12c806ddb0 0x7f12c8070270 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.143+0000 7f12e0ece640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12dc102b60 0x7f12dc197a20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.143+0000 7f12e0ece640 1 --2- 172.21.15.165:0/1024077262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12dc101960 0x7f12dc1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.143+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 >> 172.21.15.165:0/1024077262 conn(0x7f12dc0fd0f0 msgr2=0x7f12dc106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.143+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 shutdown_connections 2024-09-06T14:40:02.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:02.143+0000 7f12e0ece640 1 -- 172.21.15.165:0/1024077262 wait complete. 2024-09-06T14:40:02.444 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:02.444 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:02.444 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:02.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:02.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:02.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:02.753 DEBUG:teuthology.orchestra.run.smithi165:osd.3> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.3.service 2024-09-06T14:40:02.756 INFO:tasks.cephadm:Deploying osd.4 on smithi165 with /dev/vg_nvme/lv_3... 2024-09-06T14:40:02.756 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-06T14:40:03.562 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:40:03.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:03 smithi165 ceph-mon[36229]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:03.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:03 smithi052 ceph-mon[28627]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:04.212 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:40:04 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[42111]: 2024-09-06T14:40:04.138+0000 7fe339b71640 -1 osd.3 0 log_to_monitors true 2024-09-06T14:40:04.468 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:04 smithi165 ceph-mon[36229]: from='osd.3 [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-06T14:40:04.469 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:04 smithi165 ceph-mon[36229]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-06T14:40:04.469 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:04 smithi165 ceph-mon[36229]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:04.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:04 smithi052 ceph-mon[28627]: from='osd.3 [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-06T14:40:04.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:04 smithi052 ceph-mon[28627]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-06T14:40:04.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:04 smithi052 ceph-mon[28627]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:05 smithi052 ceph-mon[28627]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T14:40:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:05 smithi052 ceph-mon[28627]: osdmap e24: 4 total, 3 up, 4 in 2024-09-06T14:40:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:05 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:05 smithi052 ceph-mon[28627]: from='osd.3 [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:05.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:05 smithi052 ceph-mon[28627]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:05.648 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:05 smithi165 ceph-mon[36229]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T14:40:05.648 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:05 smithi165 ceph-mon[36229]: osdmap e24: 4 total, 3 up, 4 in 2024-09-06T14:40:05.648 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:05 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:05.649 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:05 smithi165 ceph-mon[36229]: from='osd.3 [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:05.649 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:05 smithi165 ceph-mon[36229]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:06.357 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[42111]: 2024-09-06T14:40:06.132+0000 7fe3352d1640 -1 osd.3 0 waiting for initial osdmap 2024-09-06T14:40:06.357 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[42111]: 2024-09-06T14:40:06.138+0000 7fe32d903640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:40:06.615 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-06T14:40:06.615 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: osdmap e25: 4 total, 3 up, 4 in 2024-09-06T14:40:06.615 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: osdmap e26: 4 total, 3 up, 4 in 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='osd.3 ' entity='osd.3' 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: Detected new or changed devices on smithi165 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi165 to 14912M 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:06.616 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:06.617 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.617 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:06 smithi165 ceph-mon[36229]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: osdmap e25: 4 total, 3 up, 4 in 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: osdmap e26: 4 total, 3 up, 4 in 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='osd.3 ' entity='osd.3' 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: Detected new or changed devices on smithi165 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:40:06.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi165 to 14912M 2024-09-06T14:40:06.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:06.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:06.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:06.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:06 smithi052 ceph-mon[28627]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-09-06T14:40:07.552 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:07 smithi165 ceph-mon[36229]: purged_snaps scrub starts 2024-09-06T14:40:07.552 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:07 smithi165 ceph-mon[36229]: purged_snaps scrub ok 2024-09-06T14:40:07.552 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:07.552 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:07 smithi165 ceph-mon[36229]: osd.3 [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] boot 2024-09-06T14:40:07.552 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:07 smithi165 ceph-mon[36229]: osdmap e27: 4 total, 4 up, 4 in 2024-09-06T14:40:07.552 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:07.555 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:40:07.581 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_3 2024-09-06T14:40:07.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:07 smithi052 ceph-mon[28627]: purged_snaps scrub starts 2024-09-06T14:40:07.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:07 smithi052 ceph-mon[28627]: purged_snaps scrub ok 2024-09-06T14:40:07.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:07.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:07 smithi052 ceph-mon[28627]: osd.3 [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] boot 2024-09-06T14:40:07.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:07 smithi052 ceph-mon[28627]: osdmap e27: 4 total, 4 up, 4 in 2024-09-06T14:40:07.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:40:07.828 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:40:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 -- 172.21.15.165:0/4069800252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c102f40 msgr2=0x7f512c103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 --2- 172.21.15.165:0/4069800252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c102f40 0x7f512c103340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5128009880 tx=0x7f512802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:40:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 -- 172.21.15.165:0/4069800252 shutdown_connections 2024-09-06T14:40:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 --2- 172.21.15.165:0/4069800252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c103910 0x7f512c0ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:08.313 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 --2- 172.21.15.165:0/4069800252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c102f40 0x7f512c103340 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 -- 172.21.15.165:0/4069800252 >> 172.21.15.165:0/4069800252 conn(0x7f512c0fb770 msgr2=0x7f512c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 -- 172.21.15.165:0/4069800252 shutdown_connections 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.265+0000 7f51340fb640 1 -- 172.21.15.165:0/4069800252 wait complete. 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f51340fb640 1 Processor -- start 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f51340fb640 1 -- start start 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f51340fb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c102f40 0x7f512c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f51340fb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c103910 0x7f512c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f51340fb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f512c10a7d0 con 0x7f512c102f40 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f51340fb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f512c10a650 con 0x7f512c103910 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131696640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c103910 0x7f512c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:08.314 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131696640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c103910 0x7f512c197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:36778/0 (socket says 172.21.15.165:36778) 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131696640 1 -- 172.21.15.165:0/1271744692 learned_addr learned my addr 172.21.15.165:0/1271744692 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131e97640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c102f40 0x7f512c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131696640 1 -- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c102f40 msgr2=0x7f512c197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131696640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c102f40 0x7f512c197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131696640 1 -- 172.21.15.165:0/1271744692 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c1980d0 con 0x7f512c103910 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.266+0000 7f5131696640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c103910 0x7f512c197a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f512000d6c0 tx=0x7f512000db80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.267+0000 7f511effd640 1 -- 172.21.15.165:0/1271744692 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5120017070 con 0x7f512c103910 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.267+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c19cb10 con 0x7f512c103910 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.267+0000 7f511effd640 1 -- 172.21.15.165:0/1271744692 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51200054e0 con 0x7f512c103910 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.267+0000 7f511effd640 1 -- 172.21.15.165:0/1271744692 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5120004b70 con 0x7f512c103910 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.267+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c19d0a0 con 0x7f512c103910 2024-09-06T14:40:08.315 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.268+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f512c103340 con 0x7f512c103910 2024-09-06T14:40:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.268+0000 7f511effd640 1 -- 172.21.15.165:0/1271744692 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f5120009820 con 0x7f512c103910 2024-09-06T14:40:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.269+0000 7f511effd640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f511806de30 0x7f51180702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.269+0000 7f511effd640 1 -- 172.21.15.165:0/1271744692 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3803+0+0 (secure 0 0 0) 0x7f512008d0a0 con 0x7f512c103910 2024-09-06T14:40:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.269+0000 7f5131e97640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f511806de30 0x7f51180702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.269+0000 7f5131e97640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f511806de30 0x7f51180702f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5128009230 tx=0x7f51280058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:08.316 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.273+0000 7f511effd640 1 -- 172.21.15.165:0/1271744692 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f512005ef70 con 0x7f512c103910 2024-09-06T14:40:08.450 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:08.452+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f512c062630 con 0x7f511806de30 2024-09-06T14:40:09.199 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:09 smithi165 ceph-mon[36229]: osdmap e28: 4 total, 4 up, 4 in 2024-09-06T14:40:09.199 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:09 smithi165 ceph-mon[36229]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:09.199 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:09 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:40:09.199 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:09 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:40:09.199 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:09 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:09.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:09 smithi052 ceph-mon[28627]: osdmap e28: 4 total, 4 up, 4 in 2024-09-06T14:40:09.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:09 smithi052 ceph-mon[28627]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:09.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:09 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:40:09.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:09 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:40:09.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:09 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:10.246 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:10 smithi165 ceph-mon[36229]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:40:10.246 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:10 smithi165 ceph-mon[36229]: osdmap e29: 4 total, 4 up, 4 in 2024-09-06T14:40:10.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:10 smithi052 ceph-mon[28627]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:40:10.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:10 smithi052 ceph-mon[28627]: osdmap e29: 4 total, 4 up, 4 in 2024-09-06T14:40:11.262 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: osdmap e30: 4 total, 4 up, 4 in 2024-09-06T14:40:11.263 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:11.263 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:11.263 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/1318779112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8a96f98-f41f-40ed-8987-df5ee66c5763"}]: dispatch 2024-09-06T14:40:11.263 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8a96f98-f41f-40ed-8987-df5ee66c5763"}]: dispatch 2024-09-06T14:40:11.263 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8a96f98-f41f-40ed-8987-df5ee66c5763"}]': finished 2024-09-06T14:40:11.263 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: osdmap e31: 5 total, 4 up, 5 in 2024-09-06T14:40:11.263 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:11 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:11.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: osdmap e30: 4 total, 4 up, 4 in 2024-09-06T14:40:11.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:11.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:11.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/1318779112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8a96f98-f41f-40ed-8987-df5ee66c5763"}]: dispatch 2024-09-06T14:40:11.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8a96f98-f41f-40ed-8987-df5ee66c5763"}]: dispatch 2024-09-06T14:40:11.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8a96f98-f41f-40ed-8987-df5ee66c5763"}]': finished 2024-09-06T14:40:11.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: osdmap e31: 5 total, 4 up, 5 in 2024-09-06T14:40:11.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:12.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:12 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/3351878359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:40:12.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:12 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/3351878359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:40:13.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:13 smithi052 ceph-mon[28627]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-06T14:40:13.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:13 smithi165 ceph-mon[36229]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-06T14:40:15.569 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:15 smithi165 ceph-mon[36229]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-06T14:40:15.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:15 smithi052 ceph-mon[28627]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-06T14:40:17.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:17 smithi052 ceph-mon[28627]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-06T14:40:17.690 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:17 smithi165 ceph-mon[36229]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-06T14:40:19.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:19 smithi165 ceph-mon[36229]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-06T14:40:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-06T14:40:19.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:19 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:19.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:19 smithi052 ceph-mon[28627]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-06T14:40:19.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-06T14:40:19.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:19 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:20 smithi165 ceph-mon[36229]: Deploying daemon osd.4 on smithi165 2024-09-06T14:40:20.593 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:20 smithi052 ceph-mon[28627]: Deploying daemon osd.4 on smithi165 2024-09-06T14:40:21.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:21 smithi052 ceph-mon[28627]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T14:40:21.756 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:21 smithi165 ceph-mon[36229]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-06T14:40:23.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:23 smithi052 ceph-mon[28627]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:23.653 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:23 smithi165 ceph-mon[36229]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:25.549 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:25 smithi165 ceph-mon[36229]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:25.549 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:25.549 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:25.550 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:25.550 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:25.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:25 smithi052 ceph-mon[28627]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:25.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:25.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:25.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:25.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:27.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:27 smithi165 ceph-mon[36229]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:27.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:27 smithi052 ceph-mon[28627]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:28.387 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.388+0000 7f511effd640 1 -- 172.21.15.165:0/1271744692 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f512c062630 con 0x7f511806de30 2024-09-06T14:40:28.387 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 4 on host 'smithi165' 2024-09-06T14:40:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f511806de30 msgr2=0x7f51180702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f511806de30 0x7f51180702f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5128009230 tx=0x7f51280058d0 comp rx=0 tx=0).stop 2024-09-06T14:40:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c103910 msgr2=0x7f512c197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c103910 0x7f512c197a50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f512000d6c0 tx=0x7f512000db80 comp rx=0 tx=0).stop 2024-09-06T14:40:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 shutdown_connections 2024-09-06T14:40:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f511806de30 0x7f51180702f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:28.390 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f512c103910 0x7f512c197a50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:28.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 --2- 172.21.15.165:0/1271744692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f512c102f40 0x7f512c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:28.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 >> 172.21.15.165:0/1271744692 conn(0x7f512c0fb770 msgr2=0x7f512c106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:28.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 shutdown_connections 2024-09-06T14:40:28.391 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:28.391+0000 7f51340fb640 1 -- 172.21.15.165:0/1271744692 wait complete. 2024-09-06T14:40:28.695 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:28 smithi165 ceph-mon[36229]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:28.696 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:28 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:28.696 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:28 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:28 smithi052 ceph-mon[28627]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:28.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:28 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:28.998 DEBUG:teuthology.orchestra.run.smithi165:osd.4> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.4.service 2024-09-06T14:40:29.000 INFO:tasks.cephadm:Deploying osd.5 on smithi165 with /dev/vg_nvme/lv_2... 2024-09-06T14:40:29.000 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-06T14:40:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:29 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:29.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:29 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:29.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:29 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:29.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:29 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:30.529 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:30 smithi165 ceph-mon[36229]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:30.617 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:40:30.735 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:30 smithi052 ceph-mon[28627]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:31.139 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:40:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[48835]: 2024-09-06T14:40:30.902+0000 7f8ce7733640 -1 osd.4 0 log_to_monitors true 2024-09-06T14:40:31.759 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:31 smithi165 ceph-mon[36229]: from='osd.4 [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-06T14:40:31.759 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:31 smithi165 ceph-mon[36229]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-06T14:40:31.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:31 smithi052 ceph-mon[28627]: from='osd.4 [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-06T14:40:31.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:31 smithi052 ceph-mon[28627]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-06T14:40:32.631 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T14:40:32.631 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: osdmap e32: 5 total, 4 up, 5 in 2024-09-06T14:40:32.631 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:32.632 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='osd.4 [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:32.632 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:32.632 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:32.632 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:32.632 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:32.632 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:40:32.632 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:40:32.633 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:32.633 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:32.633 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:32.633 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:32 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:32.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T14:40:32.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: osdmap e32: 5 total, 4 up, 5 in 2024-09-06T14:40:32.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:32.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='osd.4 [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:32.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:32.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:32.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:32.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:32.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:40:32.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:40:32.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:32.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:32.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:32.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:32 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:33.309 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[48835]: 2024-09-06T14:40:33.221+0000 7f8ce3eca640 -1 osd.4 0 waiting for initial osdmap 2024-09-06T14:40:33.310 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[48835]: 2024-09-06T14:40:33.229+0000 7f8cdb4c5640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:40:33.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: Detected new or changed devices on smithi165 2024-09-06T14:40:33.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi165 to 7456M 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: osdmap e33: 5 total, 4 up, 5 in 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:33.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:33 smithi165 ceph-mon[36229]: from='osd.4 ' entity='osd.4' 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: Detected new or changed devices on smithi165 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi165 to 7456M 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: osdmap e33: 5 total, 4 up, 5 in 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:33.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:40:33.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:33.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:33 smithi052 ceph-mon[28627]: from='osd.4 ' entity='osd.4' 2024-09-06T14:40:33.898 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-06T14:40:33.925 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_2 2024-09-06T14:40:34.170 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:40:34.543 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:34 smithi165 ceph-mon[36229]: purged_snaps scrub starts 2024-09-06T14:40:34.543 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:34 smithi165 ceph-mon[36229]: purged_snaps scrub ok 2024-09-06T14:40:34.544 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:34 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:34.544 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:34 smithi165 ceph-mon[36229]: osd.4 [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] boot 2024-09-06T14:40:34.544 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:34 smithi165 ceph-mon[36229]: osdmap e34: 5 total, 5 up, 5 in 2024-09-06T14:40:34.544 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:34 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:34.544 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:34 smithi165 ceph-mon[36229]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:34.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 -- 172.21.15.165:0/3492230856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094100860 msgr2=0x7f4094100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:34.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 --2- 172.21.15.165:0/3492230856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094100860 0x7f4094100c60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4090009880 tx=0x7f409002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:40:34.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 -- 172.21.15.165:0/3492230856 shutdown_connections 2024-09-06T14:40:34.656 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 --2- 172.21.15.165:0/3492230856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094101a60 0x7f4094101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 --2- 172.21.15.165:0/3492230856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094100860 0x7f4094100c60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 -- 172.21.15.165:0/3492230856 >> 172.21.15.165:0/3492230856 conn(0x7f40940fc010 msgr2=0x7f40940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 -- 172.21.15.165:0/3492230856 shutdown_connections 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 -- 172.21.15.165:0/3492230856 wait complete. 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 Processor -- start 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.624+0000 7f409bf2e640 1 -- start start 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f409bf2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094100860 0x7f4094104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f409bf2e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094101a60 0x7f4094102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f409bf2e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4094109700 con 0x7f4094100860 2024-09-06T14:40:34.657 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f409bf2e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4094109580 con 0x7f4094101a60 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f40994c9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094101a60 0x7f4094102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f40994c9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094101a60 0x7f4094102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:33550/0 (socket says 172.21.15.165:33550) 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f40994c9640 1 -- 172.21.15.165:0/1751612523 learned_addr learned my addr 172.21.15.165:0/1751612523 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f4099cca640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094100860 0x7f4094104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f40994c9640 1 -- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094100860 msgr2=0x7f4094104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f40994c9640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094100860 0x7f4094104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f40994c9640 1 -- 172.21.15.165:0/1751612523 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4094103380 con 0x7f4094101a60 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f40994c9640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094101a60 0x7f4094102e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f408400b420 tx=0x7f408400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f408affd640 1 -- 172.21.15.165:0/1751612523 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4084011630 con 0x7f4094101a60 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4094103670 con 0x7f4094101a60 2024-09-06T14:40:34.658 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f408affd640 1 -- 172.21.15.165:0/1751612523 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4084016070 con 0x7f4094101a60 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f408affd640 1 -- 172.21.15.165:0/1751612523 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4084010d40 con 0x7f4094101a60 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.625+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4094103c80 con 0x7f4094101a60 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.626+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40941025d0 con 0x7f4094101a60 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.627+0000 7f408affd640 1 -- 172.21.15.165:0/1751612523 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f408401b460 con 0x7f4094101a60 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.627+0000 7f408affd640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f408006de30 0x7f40800702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.627+0000 7f408affd640 1 -- 172.21.15.165:0/1751612523 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4206+0+0 (secure 0 0 0) 0x7f408408ce60 con 0x7f4094101a60 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.628+0000 7f4099cca640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f408006de30 0x7f40800702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.628+0000 7f4099cca640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f408006de30 0x7f40800702f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4090009230 tx=0x7f40900058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:34.659 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.632+0000 7f408affd640 1 -- 172.21.15.165:0/1751612523 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f408405aef0 con 0x7f4094101a60 2024-09-06T14:40:34.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:34.807+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f409419f680 con 0x7f408006de30 2024-09-06T14:40:34.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:34 smithi052 ceph-mon[28627]: purged_snaps scrub starts 2024-09-06T14:40:34.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:34 smithi052 ceph-mon[28627]: purged_snaps scrub ok 2024-09-06T14:40:34.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:34 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:34.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:34 smithi052 ceph-mon[28627]: osd.4 [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] boot 2024-09-06T14:40:34.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:34 smithi052 ceph-mon[28627]: osdmap e34: 5 total, 5 up, 5 in 2024-09-06T14:40:34.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:34 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:40:34.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:34 smithi052 ceph-mon[28627]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-06T14:40:35.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:35 smithi052 ceph-mon[28627]: osdmap e35: 5 total, 5 up, 5 in 2024-09-06T14:40:35.807 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:35 smithi052 ceph-mon[28627]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:40:35.807 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:40:35.807 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:40:35.807 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:35 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:35 smithi165 ceph-mon[36229]: osdmap e35: 5 total, 5 up, 5 in 2024-09-06T14:40:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:35 smithi165 ceph-mon[36229]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:40:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-06T14:40:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-06T14:40:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:35 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:36.590 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:36 smithi165 ceph-mon[36229]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:36.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:36 smithi052 ceph-mon[28627]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:37.717 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:37 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/1570130592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94a49ace-0375-4404-a72e-dc0d1db13f93"}]: dispatch 2024-09-06T14:40:37.718 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:37 smithi165 ceph-mon[36229]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94a49ace-0375-4404-a72e-dc0d1db13f93"}]: dispatch 2024-09-06T14:40:37.718 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:37 smithi165 ceph-mon[36229]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94a49ace-0375-4404-a72e-dc0d1db13f93"}]': finished 2024-09-06T14:40:37.718 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:37 smithi165 ceph-mon[36229]: osdmap e36: 6 total, 5 up, 6 in 2024-09-06T14:40:37.718 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:37 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:40:37.797 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:37 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/1570130592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94a49ace-0375-4404-a72e-dc0d1db13f93"}]: dispatch 2024-09-06T14:40:37.797 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:37 smithi052 ceph-mon[28627]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "94a49ace-0375-4404-a72e-dc0d1db13f93"}]: dispatch 2024-09-06T14:40:37.797 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:37 smithi052 ceph-mon[28627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "94a49ace-0375-4404-a72e-dc0d1db13f93"}]': finished 2024-09-06T14:40:37.797 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:37 smithi052 ceph-mon[28627]: osdmap e36: 6 total, 5 up, 6 in 2024-09-06T14:40:37.797 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:37 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:40:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:38 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/3907455335' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:40:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:38 smithi165 ceph-mon[36229]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:38.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:38 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/3907455335' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-06T14:40:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:38 smithi052 ceph-mon[28627]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:40.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:40.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:41.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:41 smithi052 ceph-mon[28627]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:41 smithi165 ceph-mon[36229]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:43.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:43 smithi165 ceph-mon[36229]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:43.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:43 smithi052 ceph-mon[28627]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:45.554 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:45 smithi165 ceph-mon[36229]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:45.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:45 smithi052 ceph-mon[28627]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:46.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-06T14:40:46.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:46.691 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-06T14:40:46.691 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:40:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:47 smithi165 ceph-mon[36229]: Deploying daemon osd.5 on smithi165 2024-09-06T14:40:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:47 smithi165 ceph-mon[36229]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:47.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:47 smithi052 ceph-mon[28627]: Deploying daemon osd.5 on smithi165 2024-09-06T14:40:47.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:47 smithi052 ceph-mon[28627]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:48.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:48 smithi165 ceph-mon[36229]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:48.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:48 smithi052 ceph-mon[28627]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:51 smithi165 ceph-mon[36229]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:51 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:51 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:51 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:51.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:51 smithi052 ceph-mon[28627]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:51.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:51 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:40:51.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:51 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:51.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:51 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:53.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:53 smithi052 ceph-mon[28627]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:53.681 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:53 smithi165 ceph-mon[36229]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:55.157 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.159+0000 7f408affd640 1 -- 172.21.15.165:0/1751612523 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f409419f680 con 0x7f408006de30 2024-09-06T14:40:55.157 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 5 on host 'smithi165' 2024-09-06T14:40:55.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.161+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f408006de30 msgr2=0x7f40800702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:55.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.161+0000 7f409bf2e640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f408006de30 0x7f40800702f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4090009230 tx=0x7f40900058d0 comp rx=0 tx=0).stop 2024-09-06T14:40:55.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094101a60 msgr2=0x7f4094102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:55.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094101a60 0x7f4094102e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f408400b420 tx=0x7f408400b8e0 comp rx=0 tx=0).stop 2024-09-06T14:40:55.159 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 shutdown_connections 2024-09-06T14:40:55.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f408006de30 0x7f40800702f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:55.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4094101a60 0x7f4094102e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:55.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 --2- 172.21.15.165:0/1751612523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4094100860 0x7f4094104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:55.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 >> 172.21.15.165:0/1751612523 conn(0x7f40940fc010 msgr2=0x7f40940fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:55.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 shutdown_connections 2024-09-06T14:40:55.160 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:40:55.162+0000 7f409bf2e640 1 -- 172.21.15.165:0/1751612523 wait complete. 2024-09-06T14:40:55.523 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:55 smithi165 ceph-mon[36229]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:55.523 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:55.523 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:55.523 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:55.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:55 smithi052 ceph-mon[28627]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:55.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:55.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:55.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:40:55.817 DEBUG:teuthology.orchestra.run.smithi165:osd.5> sudo journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.5.service 2024-09-06T14:40:55.820 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-06T14:40:55.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd stat -f json 2024-09-06T14:40:56.090 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:40:56.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 -- 172.21.15.52:0/2694812335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 msgr2=0x7f6784100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:56.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 --2- 172.21.15.52:0/2694812335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784100020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6774009880 tx=0x7f677402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 -- 172.21.15.52:0/2694812335 shutdown_connections 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 --2- 172.21.15.52:0/2694812335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6784102c00 0x7f6784103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 --2- 172.21.15.52:0/2694812335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784100020 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 -- 172.21.15.52:0/2694812335 >> 172.21.15.52:0/2694812335 conn(0x7f67840fb770 msgr2=0x7f67840fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 -- 172.21.15.52:0/2694812335 shutdown_connections 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.548+0000 7f6789e54640 1 -- 172.21.15.52:0/2694812335 wait complete. 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f6789e54640 1 Processor -- start 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f6789e54640 1 -- start start 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f6789e54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f6789e54640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6784102c00 0x7f6784197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:56.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f6789e54640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f678410a7b0 con 0x7f67840ffc20 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f6789e54640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f678410a630 con 0x7f6784102c00 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f67837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f67837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56328/0 (socket says 172.21.15.52:56328) 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f67837fe640 1 -- 172.21.15.52:0/234489940 learned_addr learned my addr 172.21.15.52:0/234489940 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f677affd640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6784102c00 0x7f6784197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f67837fe640 1 -- 172.21.15.52:0/234489940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6784102c00 msgr2=0x7f6784197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f67837fe640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6784102c00 0x7f6784197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.549+0000 7f67837fe640 1 -- 172.21.15.52:0/234489940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6784198140 con 0x7f67840ffc20 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.550+0000 7f67837fe640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784197580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6774006010 tx=0x7f67740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.550+0000 7f67817fa640 1 -- 172.21.15.52:0/234489940 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f677403f070 con 0x7f67840ffc20 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.550+0000 7f67817fa640 1 -- 172.21.15.52:0/234489940 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67740044d0 con 0x7f67840ffc20 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.550+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f678419cab0 con 0x7f67840ffc20 2024-09-06T14:40:56.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.550+0000 7f67817fa640 1 -- 172.21.15.52:0/234489940 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6774035030 con 0x7f67840ffc20 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.550+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f678419d040 con 0x7f67840ffc20 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.551+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6784100020 con 0x7f67840ffc20 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.551+0000 7f67817fa640 1 -- 172.21.15.52:0/234489940 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f6774042070 con 0x7f67840ffc20 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.552+0000 7f67817fa640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f677006de30 0x7f67700702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.552+0000 7f67817fa640 1 -- 172.21.15.52:0/234489940 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4321+0+0 (secure 0 0 0) 0x7f67740ae3d0 con 0x7f67840ffc20 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.552+0000 7f677affd640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f677006de30 0x7f67700702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.552+0000 7f677affd640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f677006de30 0x7f67700702f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f676c005fd0 tx=0x7f676c005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:56.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.556+0000 7f67817fa640 1 -- 172.21.15.52:0/234489940 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f677407c3e0 con 0x7f67840ffc20 2024-09-06T14:40:56.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.732+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6784062df0 con 0x7f67840ffc20 2024-09-06T14:40:56.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.732+0000 7f67817fa640 1 -- 172.21.15.52:0/234489940 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) ==== 74+0+130 (secure 0 0 0) 0x7f6774080090 con 0x7f67840ffc20 2024-09-06T14:40:56.730 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f677006de30 msgr2=0x7f67700702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f677006de30 0x7f67700702f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f676c005fd0 tx=0x7f676c005e20 comp rx=0 tx=0).stop 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 msgr2=0x7f6784197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784197580 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6774006010 tx=0x7f67740048f0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 shutdown_connections 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f677006de30 0x7f67700702f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6784102c00 0x7f6784197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 --2- 172.21.15.52:0/234489940 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67840ffc20 0x7f6784197580 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 >> 172.21.15.52:0/234489940 conn(0x7f67840fb770 msgr2=0x7f6784106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 shutdown_connections 2024-09-06T14:40:56.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:56.735+0000 7f6789e54640 1 -- 172.21.15.52:0/234489940 wait complete. 2024-09-06T14:40:57.067 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:56 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:57.068 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:56 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:57.068 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:56 smithi165 ceph-mon[36229]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:57.068 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:56 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/234489940' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-06T14:40:57.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:56 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:57.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:56 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:40:57.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:56 smithi052 ceph-mon[28627]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:57.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:56 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/234489940' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-06T14:40:57.506 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1725633633,"num_in_osds":6,"osd_in_since":1725633637,"num_remapped_pgs":0} 2024-09-06T14:40:57.764 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:40:57 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[55621]: 2024-09-06T14:40:57.503+0000 7f7d35d0a640 -1 osd.5 0 log_to_monitors true 2024-09-06T14:40:58.071 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:57 smithi165 ceph-mon[36229]: from='osd.5 [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-06T14:40:58.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:57 smithi165 ceph-mon[36229]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-06T14:40:58.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:57 smithi052 ceph-mon[28627]: from='osd.5 [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-06T14:40:58.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:57 smithi052 ceph-mon[28627]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-06T14:40:58.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd stat -f json 2024-09-06T14:40:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:40:59.157 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:59 smithi052 ceph-mon[28627]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T14:40:59.157 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:59 smithi052 ceph-mon[28627]: osdmap e37: 6 total, 5 up, 6 in 2024-09-06T14:40:59.157 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:59 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:40:59.157 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:59 smithi052 ceph-mon[28627]: from='osd.5 [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:59.157 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:59 smithi052 ceph-mon[28627]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:59.157 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:40:59 smithi052 ceph-mon[28627]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:59.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 -- 172.21.15.52:0/763377367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc74102c20 msgr2=0x7fbc741030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:59.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 --2- 172.21.15.52:0/763377367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc74102c20 0x7fbc741030a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009880 tx=0x7fbc5c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 -- 172.21.15.52:0/763377367 shutdown_connections 2024-09-06T14:40:59.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 --2- 172.21.15.52:0/763377367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc74102c20 0x7fbc741030a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 --2- 172.21.15.52:0/763377367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc740ffc40 0x7fbc74100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 -- 172.21.15.52:0/763377367 >> 172.21.15.52:0/763377367 conn(0x7fbc740fb790 msgr2=0x7fbc740fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 -- 172.21.15.52:0/763377367 shutdown_connections 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.240+0000 7fbc7953a640 1 -- 172.21.15.52:0/763377367 wait complete. 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc7953a640 1 Processor -- start 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc7953a640 1 -- start start 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc7953a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc740ffc40 0x7fbc74197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc7953a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc74102c20 0x7fbc74197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc7953a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7410a7c0 con 0x7fbc740ffc40 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc7953a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7410a640 con 0x7fbc74102c20 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc72ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc740ffc40 0x7fbc74197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:59.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc72ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc740ffc40 0x7fbc74197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56350/0 (socket says 172.21.15.52:56350) 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.241+0000 7fbc72ffd640 1 -- 172.21.15.52:0/3849102245 learned_addr learned my addr 172.21.15.52:0/3849102245 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc727fc640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc74102c20 0x7fbc74197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc72ffd640 1 -- 172.21.15.52:0/3849102245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc74102c20 msgr2=0x7fbc74197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc72ffd640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc74102c20 0x7fbc74197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc72ffd640 1 -- 172.21.15.52:0/3849102245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc74198150 con 0x7fbc740ffc40 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc72ffd640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc740ffc40 0x7fbc74197590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400eaf0 tx=0x7fbc6400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc6bfff640 1 -- 172.21.15.52:0/3849102245 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc6400cd10 con 0x7fbc740ffc40 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc7419cb20 con 0x7fbc740ffc40 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc6bfff640 1 -- 172.21.15.52:0/3849102245 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc64003e30 con 0x7fbc740ffc40 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc6bfff640 1 -- 172.21.15.52:0/3849102245 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc64010660 con 0x7fbc740ffc40 2024-09-06T14:40:59.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.242+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc7419d0b0 con 0x7fbc740ffc40 2024-09-06T14:40:59.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.243+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc74100040 con 0x7fbc740ffc40 2024-09-06T14:40:59.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.244+0000 7fbc6bfff640 1 -- 172.21.15.52:0/3849102245 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fbc64003970 con 0x7fbc740ffc40 2024-09-06T14:40:59.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.244+0000 7fbc6bfff640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbc6006de30 0x7fbc600702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:40:59.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.244+0000 7fbc6bfff640 1 -- 172.21.15.52:0/3849102245 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4358+0+0 (secure 0 0 0) 0x7fbc6408e070 con 0x7fbc740ffc40 2024-09-06T14:40:59.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.244+0000 7fbc727fc640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbc6006de30 0x7fbc600702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:40:59.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.245+0000 7fbc727fc640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbc6006de30 0x7fbc600702f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc741989d0 tx=0x7fbc5c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:40:59.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.249+0000 7fbc6bfff640 1 -- 172.21.15.52:0/3849102245 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc6405c060 con 0x7fbc740ffc40 2024-09-06T14:40:59.323 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[55621]: 2024-09-06T14:40:59.003+0000 7f7d324a1640 -1 osd.5 0 waiting for initial osdmap 2024-09-06T14:40:59.323 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[55621]: 2024-09-06T14:40:59.009+0000 7f7d2daa4640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:40:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-mon[36229]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T14:40:59.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-mon[36229]: osdmap e37: 6 total, 5 up, 6 in 2024-09-06T14:40:59.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:40:59.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-mon[36229]: from='osd.5 [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:59.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-mon[36229]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-06T14:40:59.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:40:59 smithi165 ceph-mon[36229]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:40:59.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.430+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbc741915d0 con 0x7fbc740ffc40 2024-09-06T14:40:59.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.431+0000 7fbc6bfff640 1 -- 172.21.15.52:0/3849102245 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7fbc6405fd10 con 0x7fbc740ffc40 2024-09-06T14:40:59.428 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:40:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.432+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbc6006de30 msgr2=0x7fbc600702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.432+0000 7fbc7953a640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbc6006de30 0x7fbc600702f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc741989d0 tx=0x7fbc5c005a20 comp rx=0 tx=0).stop 2024-09-06T14:40:59.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.432+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc740ffc40 msgr2=0x7fbc74197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.432+0000 7fbc7953a640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc740ffc40 0x7fbc74197590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400eaf0 tx=0x7fbc6400c2d0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.433+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 shutdown_connections 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.433+0000 7fbc7953a640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbc6006de30 0x7fbc600702f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.433+0000 7fbc7953a640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc74102c20 0x7fbc74197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.433+0000 7fbc7953a640 1 --2- 172.21.15.52:0/3849102245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc740ffc40 0x7fbc74197590 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.433+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 >> 172.21.15.52:0/3849102245 conn(0x7fbc740fb790 msgr2=0x7fbc74106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.433+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 shutdown_connections 2024-09-06T14:40:59.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:40:59.433+0000 7fbc7953a640 1 -- 172.21.15.52:0/3849102245 wait complete. 2024-09-06T14:41:00.123 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1725633633,"num_in_osds":6,"osd_in_since":1725633637,"num_remapped_pgs":0} 2024-09-06T14:41:00.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-06T14:41:00.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: osdmap e38: 6 total, 5 up, 6 in 2024-09-06T14:41:00.288 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:41:00.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:41:00.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:41:00.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:41:00.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:41:00.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:00.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:00.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3849102245' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-06T14:41:00.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:41:00.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:00.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:00.291 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: osdmap e38: 6 total, 5 up, 6 in 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:41:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:41:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3849102245' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-06T14:41:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:41:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:01.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd stat -f json 2024-09-06T14:41:01.277 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: purged_snaps scrub starts 2024-09-06T14:41:01.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: purged_snaps scrub ok 2024-09-06T14:41:01.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: Detected new or changed devices on smithi165 2024-09-06T14:41:01.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi165 to 4970M 2024-09-06T14:41:01.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: osd.5 [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] boot 2024-09-06T14:41:01.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: osdmap e39: 6 total, 6 up, 6 in 2024-09-06T14:41:01.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:41:01.278 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:01 smithi052 ceph-mon[28627]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:41:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: purged_snaps scrub starts 2024-09-06T14:41:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: purged_snaps scrub ok 2024-09-06T14:41:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: Detected new or changed devices on smithi165 2024-09-06T14:41:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi165 to 4970M 2024-09-06T14:41:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: osd.5 [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] boot 2024-09-06T14:41:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: osdmap e39: 6 total, 6 up, 6 in 2024-09-06T14:41:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:41:01.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:01 smithi165 ceph-mon[36229]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-06T14:41:01.395 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:01.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 -- 172.21.15.52:0/3215676756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 msgr2=0x7f8a18101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 --2- 172.21.15.52:0/3215676756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a18101d60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009880 tx=0x7f8a1402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 -- 172.21.15.52:0/3215676756 shutdown_connections 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 --2- 172.21.15.52:0/3215676756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18102b60 0x7f8a18102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 --2- 172.21.15.52:0/3215676756 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a18101d60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 -- 172.21.15.52:0/3215676756 >> 172.21.15.52:0/3215676756 conn(0x7f8a180fd0f0 msgr2=0x7f8a180ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 -- 172.21.15.52:0/3215676756 shutdown_connections 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.790+0000 7f8a1faae640 1 -- 172.21.15.52:0/3215676756 wait complete. 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1faae640 1 Processor -- start 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1faae640 1 -- start start 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1faae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a181974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:01.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1faae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18102b60 0x7f8a18197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1faae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810a7a0 con 0x7f8a18101960 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1faae640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810a620 con 0x7f8a18102b60 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d84a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a181974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d84a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a181974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41534/0 (socket says 172.21.15.52:41534) 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d84a640 1 -- 172.21.15.52:0/4205587770 learned_addr learned my addr 172.21.15.52:0/4205587770 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d049640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18102b60 0x7f8a18197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d84a640 1 -- 172.21.15.52:0/4205587770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18102b60 msgr2=0x7f8a18197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d84a640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18102b60 0x7f8a18197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d84a640 1 -- 172.21.15.52:0/4205587770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a18198090 con 0x7f8a18101960 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a1d84a640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a181974d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a14006010 tx=0x7f8a140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a0effd640 1 -- 172.21.15.52:0/4205587770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a1403f070 con 0x7f8a18101960 2024-09-06T14:41:01.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.792+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1819ca70 con 0x7f8a18101960 2024-09-06T14:41:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.791+0000 7f8a0effd640 1 -- 172.21.15.52:0/4205587770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a14004a50 con 0x7f8a18101960 2024-09-06T14:41:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.792+0000 7f8a0effd640 1 -- 172.21.15.52:0/4205587770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a14035030 con 0x7f8a18101960 2024-09-06T14:41:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.792+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1819d000 con 0x7f8a18101960 2024-09-06T14:41:01.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.793+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a18101d60 con 0x7f8a18101960 2024-09-06T14:41:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.793+0000 7f8a0effd640 1 -- 172.21.15.52:0/4205587770 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f8a14042070 con 0x7f8a18101960 2024-09-06T14:41:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.794+0000 7f8a0effd640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.794+0000 7f8a0effd640 1 -- 172.21.15.52:0/4205587770 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f8a140ae4a0 con 0x7f8a18101960 2024-09-06T14:41:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.794+0000 7f8a1d049640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:01.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.794+0000 7f8a1d049640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a08005fd0 tx=0x7f8a08005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.798+0000 7f8a0effd640 1 -- 172.21.15.52:0/4205587770 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a14004c00 con 0x7f8a18101960 2024-09-06T14:41:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.980+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f8a181915b0 con 0x7f8a18101960 2024-09-06T14:41:01.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.981+0000 7f8a0effd640 1 -- 172.21.15.52:0/4205587770 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) ==== 74+0+130 (secure 0 0 0) 0x7f8a1407c2e0 con 0x7f8a18101960 2024-09-06T14:41:01.978 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:01.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.982+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 msgr2=0x7f8a040702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:01.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.982+0000 7f8a1faae640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a08005fd0 tx=0x7f8a08005850 comp rx=0 tx=0).stop 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.982+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 msgr2=0x7f8a181974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.982+0000 7f8a1faae640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a181974d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a14006010 tx=0x7f8a140045e0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.983+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 shutdown_connections 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.983+0000 7f8a1faae640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.983+0000 7f8a1faae640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18102b60 0x7f8a18197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.983+0000 7f8a1faae640 1 --2- 172.21.15.52:0/4205587770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101960 0x7f8a181974d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.983+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 >> 172.21.15.52:0/4205587770 conn(0x7f8a180fd0f0 msgr2=0x7f8a18106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.983+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 shutdown_connections 2024-09-06T14:41:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:01.983+0000 7f8a1faae640 1 -- 172.21.15.52:0/4205587770 wait complete. 2024-09-06T14:41:02.293 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:02 smithi052 ceph-mon[28627]: osdmap e40: 6 total, 6 up, 6 in 2024-09-06T14:41:02.294 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:02 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4205587770' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-06T14:41:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:02 smithi165 ceph-mon[36229]: osdmap e40: 6 total, 6 up, 6 in 2024-09-06T14:41:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:02 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/4205587770' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-06T14:41:02.688 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1725633660,"num_in_osds":6,"osd_in_since":1725633637,"num_remapped_pgs":0} 2024-09-06T14:41:02.688 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd dump --format=json 2024-09-06T14:41:02.947 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:03.289 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:03 smithi052 ceph-mon[28627]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:03.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:03 smithi165 ceph-mon[36229]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:03.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.372+0000 7f04282ec640 1 -- 172.21.15.52:0/3179986992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201067f0 msgr2=0x7f0420106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:03.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.372+0000 7f04282ec640 1 --2- 172.21.15.52:0/3179986992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201067f0 0x7f0420106bd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0410009c20 tx=0x7f041002a970 comp rx=0 tx=0).stop 2024-09-06T14:41:03.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.372+0000 7f04282ec640 1 -- 172.21.15.52:0/3179986992 shutdown_connections 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.372+0000 7f04282ec640 1 --2- 172.21.15.52:0/3179986992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04201007f0 0x7f0420100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.372+0000 7f04282ec640 1 --2- 172.21.15.52:0/3179986992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201067f0 0x7f0420106bd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.372+0000 7f04282ec640 1 -- 172.21.15.52:0/3179986992 >> 172.21.15.52:0/3179986992 conn(0x7f04200fc550 msgr2=0x7f04200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 -- 172.21.15.52:0/3179986992 shutdown_connections 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 -- 172.21.15.52:0/3179986992 wait complete. 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 Processor -- start 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 -- start start 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201007f0 0x7f042019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04201067f0 0x7f042019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f042010ede0 con 0x7f04201007f0 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f04282ec640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f042010ec60 con 0x7f04201067f0 2024-09-06T14:41:03.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f0426088640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201007f0 0x7f042019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f0426088640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201007f0 0x7f042019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41560/0 (socket says 172.21.15.52:41560) 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.373+0000 7f0426088640 1 -- 172.21.15.52:0/332782453 learned_addr learned my addr 172.21.15.52:0/332782453 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f0425887640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04201067f0 0x7f042019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f0426088640 1 -- 172.21.15.52:0/332782453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04201067f0 msgr2=0x7f042019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f0426088640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04201067f0 0x7f042019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f0426088640 1 -- 172.21.15.52:0/332782453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04201977f0 con 0x7f04201007f0 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f0426088640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201007f0 0x7f042019d670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f041002ae90 tx=0x7f041002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f041f7fe640 1 -- 172.21.15.52:0/332782453 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0410047070 con 0x7f04201007f0 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f041f7fe640 1 -- 172.21.15.52:0/332782453 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f041002f7e0 con 0x7f04201007f0 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0420197a80 con 0x7f04201007f0 2024-09-06T14:41:03.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f041f7fe640 1 -- 172.21.15.52:0/332782453 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0410034070 con 0x7f04201007f0 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.374+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0420197fb0 con 0x7f04201007f0 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.375+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0420101f30 con 0x7f04201007f0 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.376+0000 7f041f7fe640 1 -- 172.21.15.52:0/332782453 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f041004a070 con 0x7f04201007f0 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.376+0000 7f041f7fe640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f040806de30 0x7f04080702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.376+0000 7f0425887640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f040806de30 0x7f04080702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.376+0000 7f041f7fe640 1 -- 172.21.15.52:0/332782453 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f04100ae6b0 con 0x7f04201007f0 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.377+0000 7f0425887640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f040806de30 0x7f04080702f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0414005fd0 tx=0x7f0414005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:03.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.381+0000 7f041f7fe640 1 -- 172.21.15.52:0/332782453 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f041003f070 con 0x7f04201007f0 2024-09-06T14:41:03.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.557+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0420108d60 con 0x7f04201007f0 2024-09-06T14:41:03.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.558+0000 7f041f7fe640 1 -- 172.21.15.52:0/332782453 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11369 (secure 0 0 0) 0x7f041007c6b0 con 0x7f04201007f0 2024-09-06T14:41:03.556 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:03.556 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","created":"2024-09-06T14:35:20.909688+0000","modified":"2024-09-06T14:41:01.009024+0000","last_up_change":"2024-09-06T14:41:00.000591+0000","last_in_change":"2024-09-06T14:40:37.158597+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-06T14:39:44.581703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ae61513-7d97-42fb-9086-4d24ca8fece0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6803","nonce":1153165475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6805","nonce":1153165475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6809","nonce":1153165475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6807","nonce":1153165475}]},"public_addr":"172.21.15.52:6803/1153165475","cluster_addr":"172.21.15.52:6805/1153165475","heartbeat_back_addr":"172.21.15.52:6809/1153165475","heartbeat_front_addr":"172.21.15.52:6807/1153165475","state":["exists","up"]},{"osd":1,"uuid":"0266d9c3-3a34-4274-b6b8-7b31b8179010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6811","nonce":209057109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6813","nonce":209057109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6817","nonce":209057109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6815","nonce":209057109}]},"public_addr":"172.21.15.52:6811/209057109","cluster_addr":"172.21.15.52:6813/209057109","heartbeat_back_addr":"172.21.15.52:6817/209057109","heartbeat_front_addr":"172.21.15.52:6815/209057109","state":["exists","up"]},{"osd":2,"uuid":"f74510c1-d48f-4813-9d2a-294a5b8c1c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6819","nonce":4265125143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6821","nonce":4265125143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6825","nonce":4265125143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6823","nonce":4265125143}]},"public_addr":"172.21.15.52:6819/4265125143","cluster_addr":"172.21.15.52:6821/4265125143","heartbeat_back_addr":"172.21.15.52:6825/4265125143","heartbeat_front_addr":"172.21.15.52:6823/4265125143","state":["exists","up"]},{"osd":3,"uuid":"69c53c54-ee2c-4cd0-a296-816e7c90bfae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6801","nonce":897558016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6803","nonce":897558016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6807","nonce":897558016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6805","nonce":897558016}]},"public_addr":"172.21.15.165:6801/897558016","cluster_addr":"172.21.15.165:6803/897558016","heartbeat_back_addr":"172.21.15.165:6807/897558016","heartbeat_front_addr":"172.21.15.165:6805/897558016","state":["exists","up"]},{"osd":4,"uuid":"c8a96f98-f41f-40ed-8987-df5ee66c5763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6809","nonce":751152610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6811","nonce":751152610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6815","nonce":751152610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6813","nonce":751152610}]},"public_addr":"172.21.15.165:6809/751152610","cluster_addr":"172.21.15.165:6811/751152610","heartbeat_back_addr":"172.21.15.165:6815/751152610","heartbeat_front_addr":"172.21.15.165:6813/751152610","state":["exists","up"]},{"osd":5,"uuid":"94a49ace-0375-4404-a72e-dc0d1db13f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6817","nonce":2430931177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6819","nonce":2430931177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6823","nonce":2430931177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6821","nonce":2430931177}]},"public_addr":"172.21.15.165:6817/2430931177","cluster_addr":"172.21.15.165:6819/2430931177","heartbeat_back_addr":"172.21.15.165:6823/2430931177","heartbeat_front_addr":"172.21.15.165:6821/2430931177","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:38:44.835353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:39:12.390430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:39:40.367838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:05.129169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:31.876842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:58.534610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/1082422739":"2024-09-07T14:37:10.243661+0000","172.21.15.52:0/88542092":"2024-09-07T14:37:10.243661+0000","172.21.15.52:0/1634284377":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6801/175246929":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3779039706":"2024-09-07T14:35:42.967245+0000","172.21.15.52:0/3578956532":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3157720548":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6800/175246929":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/4210640305":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3105657816":"2024-09-07T14:36:14.010074+0000","172.21.15.52:6800/3628559436":"2024-09-07T14:37:10.243661+0000","172.21.15.52:6801/3628559436":"2024-09-07T14:37:10.243661+0000","172.21.15.52:6800/2567430039":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6801/2567430039":"2024-09-07T14:35:42.967245+0000","172.21.15.52:0/2579445121":"2024-09-07T14:37:10.243661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-06T14:41:03.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.560+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f040806de30 msgr2=0x7f04080702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:03.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.560+0000 7f04282ec640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f040806de30 0x7f04080702f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0414005fd0 tx=0x7f0414005850 comp rx=0 tx=0).stop 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.560+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201007f0 msgr2=0x7f042019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.560+0000 7f04282ec640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201007f0 0x7f042019d670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f041002ae90 tx=0x7f041002f5f0 comp rx=0 tx=0).stop 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.561+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 shutdown_connections 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.561+0000 7f04282ec640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f040806de30 0x7f04080702f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.561+0000 7f04282ec640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04201067f0 0x7f042019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.561+0000 7f04282ec640 1 --2- 172.21.15.52:0/332782453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04201007f0 0x7f042019d670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.561+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 >> 172.21.15.52:0/332782453 conn(0x7f04200fc550 msgr2=0x7f04200fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.561+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 shutdown_connections 2024-09-06T14:41:03.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:03.561+0000 7f04282ec640 1 -- 172.21.15.52:0/332782453 wait complete. 2024-09-06T14:41:04.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:04 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/332782453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-06T14:41:04.276 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-06T14:39:44.581703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-06T14:41:04.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-06T14:41:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:04 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/332782453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-06T14:41:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 -- 172.21.15.52:0/454083446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 msgr2=0x7f5934106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 --2- 172.21.15.52:0/454083446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f5934106be0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5924009880 tx=0x7f592402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 -- 172.21.15.52:0/454083446 shutdown_connections 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 --2- 172.21.15.52:0/454083446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5934100800 0x7f5934100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 --2- 172.21.15.52:0/454083446 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f5934106be0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 -- 172.21.15.52:0/454083446 >> 172.21.15.52:0/454083446 conn(0x7f59340fc520 msgr2=0x7f59340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 -- 172.21.15.52:0/454083446 shutdown_connections 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.925+0000 7f593a7ab640 1 -- 172.21.15.52:0/454083446 wait complete. 2024-09-06T14:41:04.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.926+0000 7f593a7ab640 1 Processor -- start 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.926+0000 7f593a7ab640 1 -- start start 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.926+0000 7f593a7ab640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5934100800 0x7f593419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.926+0000 7f593a7ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f593419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.926+0000 7f593a7ab640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f593410dcb0 con 0x7f5934106800 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.926+0000 7f593a7ab640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f593410db30 con 0x7f5934100800 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59337fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f593419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59337fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f593419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41586/0 (socket says 172.21.15.52:41586) 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59337fe640 1 -- 172.21.15.52:0/15140473 learned_addr learned my addr 172.21.15.52:0/15140473 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f5933fff640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5934100800 0x7f593419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59337fe640 1 -- 172.21.15.52:0/15140473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5934100800 msgr2=0x7f593419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:04.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59337fe640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5934100800 0x7f593419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59337fe640 1 -- 172.21.15.52:0/15140473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59341977b0 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f5933fff640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5934100800 0x7f593419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59337fe640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f593419db70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f592800c810 tx=0x7f592800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59317fa640 1 -- 172.21.15.52:0/15140473 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5928004020 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59317fa640 1 -- 172.21.15.52:0/15140473 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59280041c0 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5934197aa0 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f59317fa640 1 -- 172.21.15.52:0/15140473 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59280047a0 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.927+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5934198030 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.928+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5934101f40 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.929+0000 7f59317fa640 1 -- 172.21.15.52:0/15140473 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f59280079b0 con 0x7f5934106800 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.929+0000 7f59317fa640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f591c06de30 0x7f591c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:04.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.929+0000 7f59317fa640 1 -- 172.21.15.52:0/15140473 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f592808d750 con 0x7f5934106800 2024-09-06T14:41:04.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.929+0000 7f5933fff640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f591c06de30 0x7f591c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:04.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.930+0000 7f5933fff640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f591c06de30 0x7f591c0702f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5924006010 tx=0x7f59240095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:04.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:04.934+0000 7f59317fa640 1 -- 172.21.15.52:0/15140473 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5928014030 con 0x7f5934106800 2024-09-06T14:41:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.110+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5934198340 con 0x7f5934106800 2024-09-06T14:41:05.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.111+0000 7f59317fa640 1 -- 172.21.15.52:0/15140473 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f592805b630 con 0x7f5934106800 2024-09-06T14:41:05.108 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f591c06de30 msgr2=0x7f591c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f591c06de30 0x7f591c0702f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5924006010 tx=0x7f59240095f0 comp rx=0 tx=0).stop 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 msgr2=0x7f593419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f593419db70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f592800c810 tx=0x7f592800ccd0 comp rx=0 tx=0).stop 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 shutdown_connections 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f591c06de30 0x7f591c0702f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5934106800 0x7f593419db70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 --2- 172.21.15.52:0/15140473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5934100800 0x7f593419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 >> 172.21.15.52:0/15140473 conn(0x7f59340fc520 msgr2=0x7f5934109ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 shutdown_connections 2024-09-06T14:41:05.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:05.113+0000 7f593a7ab640 1 -- 172.21.15.52:0/15140473 wait complete. 2024-09-06T14:41:05.289 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:05 smithi165 ceph-mon[36229]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:05.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:05 smithi052 ceph-mon[28627]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:05.870 INFO:tasks.cephadm:Setting up client nodes... 2024-09-06T14:41:05.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-06T14:41:06.131 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:06.240 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:06 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/15140473' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-06T14:41:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:06 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/15140473' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-06T14:41:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 -- 172.21.15.52:0/2133940673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 msgr2=0x7f8a18101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/2133940673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18101ee0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009880 tx=0x7f8a0002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 -- 172.21.15.52:0/2133940673 shutdown_connections 2024-09-06T14:41:06.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/2133940673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18101ee0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/2133940673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18100860 0x7f8a18100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 -- 172.21.15.52:0/2133940673 >> 172.21.15.52:0/2133940673 conn(0x7f8a180fc010 msgr2=0x7f8a180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 -- 172.21.15.52:0/2133940673 shutdown_connections 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.581+0000 7f8a1dd60640 1 -- 172.21.15.52:0/2133940673 wait complete. 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a1dd60640 1 Processor -- start 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a1dd60640 1 -- start start 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a1dd60640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18100860 0x7f8a18197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a1dd60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a1dd60640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18109720 con 0x7f8a18101a60 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a1dd60640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a181095a0 con 0x7f8a18100860 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a0effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:06.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a0effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41604/0 (socket says 172.21.15.52:41604) 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a0effd640 1 -- 172.21.15.52:0/549842568 learned_addr learned my addr 172.21.15.52:0/549842568 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a177fe640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18100860 0x7f8a18197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a0effd640 1 -- 172.21.15.52:0/549842568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18100860 msgr2=0x7f8a18197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a0effd640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18100860 0x7f8a18197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.582+0000 7f8a0effd640 1 -- 172.21.15.52:0/549842568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a18198110 con 0x7f8a18101a60 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.583+0000 7f8a0effd640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18197a90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009230 tx=0x7f8a000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.583+0000 7f8a157fa640 1 -- 172.21.15.52:0/549842568 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a0003f070 con 0x7f8a18101a60 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.583+0000 7f8a157fa640 1 -- 172.21.15.52:0/549842568 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a000044d0 con 0x7f8a18101a60 2024-09-06T14:41:06.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.583+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1819caf0 con 0x7f8a18101a60 2024-09-06T14:41:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.583+0000 7f8a157fa640 1 -- 172.21.15.52:0/549842568 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a00035030 con 0x7f8a18101a60 2024-09-06T14:41:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.583+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1819d100 con 0x7f8a18101a60 2024-09-06T14:41:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.584+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a18100c40 con 0x7f8a18101a60 2024-09-06T14:41:06.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.584+0000 7f8a157fa640 1 -- 172.21.15.52:0/549842568 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f8a00042070 con 0x7f8a18101a60 2024-09-06T14:41:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.585+0000 7f8a157fa640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.585+0000 7f8a157fa640 1 -- 172.21.15.52:0/549842568 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f8a000ae470 con 0x7f8a18101a60 2024-09-06T14:41:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.585+0000 7f8a177fe640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:06.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.586+0000 7f8a177fe640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8a181018c0 tx=0x7f8a08009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:06.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.589+0000 7f8a157fa640 1 -- 172.21.15.52:0/549842568 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a0007c350 con 0x7f8a18101a60 2024-09-06T14:41:06.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.832+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8a1819d8e0 con 0x7f8a18101a60 2024-09-06T14:41:06.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.835+0000 7f8a157fa640 1 -- 172.21.15.52:0/549842568 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f8a00080000 con 0x7f8a18101a60 2024-09-06T14:41:06.832 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-06T14:41:06.833 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCCFNtmJMK4MRAAi9fmdgESkWyBgmTY/or9lQ== 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 msgr2=0x7f8a040702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8a181018c0 tx=0x7f8a08009110 comp rx=0 tx=0).stop 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 msgr2=0x7f8a18197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18197a90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009230 tx=0x7f8a000048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 shutdown_connections 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8a0406de30 0x7f8a040702f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a18101a60 0x7f8a18197a90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 --2- 172.21.15.52:0/549842568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a18100860 0x7f8a18197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 >> 172.21.15.52:0/549842568 conn(0x7f8a180fc010 msgr2=0x7f8a180fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 shutdown_connections 2024-09-06T14:41:06.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:06.837+0000 7f8a1dd60640 1 -- 172.21.15.52:0/549842568 wait complete. 2024-09-06T14:41:07.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:07 smithi052 ceph-mon[28627]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:07.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:07 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/549842568' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-06T14:41:07.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:07 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/549842568' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T14:41:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:07 smithi165 ceph-mon[36229]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:07 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/549842568' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-06T14:41:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:07 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/549842568' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T14:41:07.542 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:41:07.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-06T14:41:07.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-06T14:41:07.579 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-06T14:41:07.841 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T14:41:08.328 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 -- 172.21.15.165:0/1777049355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 msgr2=0x7f7880102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 --2- 172.21.15.165:0/1777049355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880102fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7874009880 tx=0x7f787402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 -- 172.21.15.165:0/1777049355 shutdown_connections 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 --2- 172.21.15.165:0/1777049355 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880102fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 --2- 172.21.15.165:0/1777049355 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7880101960 0x7f7880101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 -- 172.21.15.165:0/1777049355 >> 172.21.15.165:0/1777049355 conn(0x7f78800fd0f0 msgr2=0x7f78800ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 -- 172.21.15.165:0/1777049355 shutdown_connections 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.328+0000 7f7885966640 1 -- 172.21.15.165:0/1777049355 wait complete. 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.329+0000 7f7885966640 1 Processor -- start 2024-09-06T14:41:08.329 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.329+0000 7f7885966640 1 -- start start 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.329+0000 7f7885966640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7880101960 0x7f7880197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.329+0000 7f7885966640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.329+0000 7f7885966640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f788010a7a0 con 0x7f7880101960 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.329+0000 7f7885966640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f788010a620 con 0x7f7880102b60 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787e7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787e7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:33372/0 (socket says 172.21.15.165:33372) 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787e7fc640 1 -- 172.21.15.165:0/1852798361 learned_addr learned my addr 172.21.15.165:0/1852798361 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787effd640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7880101960 0x7f7880197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787e7fc640 1 -- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7880101960 msgr2=0x7f7880197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787e7fc640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7880101960 0x7f7880197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787e7fc640 1 -- 172.21.15.165:0/1852798361 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78801980c0 con 0x7f7880102b60 2024-09-06T14:41:08.330 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f787e7fc640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880197a40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f78740048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f7884964640 1 -- 172.21.15.165:0/1852798361 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f787403f070 con 0x7f7880102b60 2024-09-06T14:41:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f788019caa0 con 0x7f7880102b60 2024-09-06T14:41:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f7884964640 1 -- 172.21.15.165:0/1852798361 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78740044d0 con 0x7f7880102b60 2024-09-06T14:41:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f7884964640 1 -- 172.21.15.165:0/1852798361 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7874035030 con 0x7f7880102b60 2024-09-06T14:41:08.331 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.330+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f788019d030 con 0x7f7880102b60 2024-09-06T14:41:08.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.331+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7880101d60 con 0x7f7880102b60 2024-09-06T14:41:08.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.332+0000 7f7884964640 1 -- 172.21.15.165:0/1852798361 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f7874042070 con 0x7f7880102b60 2024-09-06T14:41:08.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.332+0000 7f7884964640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f786806de30 0x7f78680702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:08.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.332+0000 7f7884964640 1 -- 172.21.15.165:0/1852798361 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f78740ae5a0 con 0x7f7880102b60 2024-09-06T14:41:08.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.333+0000 7f787effd640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f786806de30 0x7f78680702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:08.332 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.333+0000 7f787effd640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f786806de30 0x7f78680702f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78700058c0 tx=0x7f787000a4c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:08.334 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.337+0000 7f7884964640 1 -- 172.21.15.165:0/1852798361 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f787407c480 con 0x7f7880102b60 2024-09-06T14:41:08.562 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.564+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f78801915b0 con 0x7f7880102b60 2024-09-06T14:41:08.566 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.569+0000 7f7884964640 1 -- 172.21.15.165:0/1852798361 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f78740ae3c0 con 0x7f7880102b60 2024-09-06T14:41:08.566 INFO:teuthology.orchestra.run.smithi165.stdout:[client.1] 2024-09-06T14:41:08.566 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCEFNtm6Ty/IRAAKMCvkQdMrsBDTD2CTLJ2Vg== 2024-09-06T14:41:08.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f786806de30 msgr2=0x7f78680702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:08.568 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f786806de30 0x7f78680702f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f78700058c0 tx=0x7f787000a4c0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 msgr2=0x7f7880197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880197a40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7874006010 tx=0x7f78740048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 shutdown_connections 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f786806de30 0x7f78680702f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7880102b60 0x7f7880197a40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 --2- 172.21.15.165:0/1852798361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7880101960 0x7f7880197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 >> 172.21.15.165:0/1852798361 conn(0x7f78800fd0f0 msgr2=0x7f7880106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 shutdown_connections 2024-09-06T14:41:08.569 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:41:08.571+0000 7f7885966640 1 -- 172.21.15.165:0/1852798361 wait complete. 2024-09-06T14:41:09.218 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:41:09.218 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-06T14:41:09.218 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-06T14:41:09.255 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph config log 1 --format=json 2024-09-06T14:41:09.520 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:09 smithi165 ceph-mon[36229]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:09 smithi165 ceph-mon[36229]: from='client.? 172.21.15.165:0/1852798361' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-06T14:41:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:09 smithi165 ceph-mon[36229]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-06T14:41:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:09 smithi165 ceph-mon[36229]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T14:41:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:09 smithi052 ceph-mon[28627]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:09.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:09 smithi052 ceph-mon[28627]: from='client.? 172.21.15.165:0/1852798361' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-06T14:41:09.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:09 smithi052 ceph-mon[28627]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-06T14:41:09.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:09 smithi052 ceph-mon[28627]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-06T14:41:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 -- 172.21.15.52:0/4123975346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3254102ac0 msgr2=0x7f3254102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:09.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 --2- 172.21.15.52:0/4123975346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3254102ac0 0x7f3254102ea0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3250009880 tx=0x7f325002a530 comp rx=0 tx=0).stop 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 -- 172.21.15.52:0/4123975346 shutdown_connections 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 --2- 172.21.15.52:0/4123975346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32541033e0 0x7f325410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 --2- 172.21.15.52:0/4123975346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3254102ac0 0x7f3254102ea0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 -- 172.21.15.52:0/4123975346 >> 172.21.15.52:0/4123975346 conn(0x7f32540fc520 msgr2=0x7f32540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 -- 172.21.15.52:0/4123975346 shutdown_connections 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.911+0000 7f325b333640 1 -- 172.21.15.52:0/4123975346 wait complete. 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f325b333640 1 Processor -- start 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f325b333640 1 -- start start 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f325b333640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254102ac0 0x7f3254100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f325b333640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32541033e0 0x7f3254100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f325b333640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f325410edf0 con 0x7f32541033e0 2024-09-06T14:41:09.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f325b333640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f325410ec70 con 0x7f3254102ac0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f32588ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32541033e0 0x7f3254100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f32590cf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254102ac0 0x7f3254100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f32588ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32541033e0 0x7f3254100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41624/0 (socket says 172.21.15.52:41624) 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.912+0000 7f32588ce640 1 -- 172.21.15.52:0/2109208642 learned_addr learned my addr 172.21.15.52:0/2109208642 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f32588ce640 1 -- 172.21.15.52:0/2109208642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254102ac0 msgr2=0x7f3254100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f32588ce640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254102ac0 0x7f3254100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f32588ce640 1 -- 172.21.15.52:0/2109208642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32541011a0 con 0x7f32541033e0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f32588ce640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32541033e0 0x7f3254100c60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f324400c8f0 tx=0x7f324400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f324a7fc640 1 -- 172.21.15.52:0/2109208642 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f324400ae50 con 0x7f32541033e0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3254101490 con 0x7f32541033e0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f324a7fc640 1 -- 172.21.15.52:0/2109208642 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3244005020 con 0x7f32541033e0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f324a7fc640 1 -- 172.21.15.52:0/2109208642 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3244004d70 con 0x7f32541033e0 2024-09-06T14:41:09.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.913+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32541a3e40 con 0x7f32541033e0 2024-09-06T14:41:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.914+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325406aa90 con 0x7f32541033e0 2024-09-06T14:41:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.915+0000 7f324a7fc640 1 -- 172.21.15.52:0/2109208642 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f32440051d0 con 0x7f32541033e0 2024-09-06T14:41:09.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.915+0000 7f324a7fc640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f324006dfd0 0x7f3240070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.915+0000 7f324a7fc640 1 -- 172.21.15.52:0/2109208642 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f324408d5f0 con 0x7f32541033e0 2024-09-06T14:41:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.915+0000 7f32590cf640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f324006dfd0 0x7f3240070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:09.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.916+0000 7f32590cf640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f324006dfd0 0x7f3240070490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3250000c00 tx=0x7f3250031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:09.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:09.920+0000 7f324a7fc640 1 -- 172.21.15.52:0/2109208642 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3244014030 con 0x7f32541033e0 2024-09-06T14:41:10.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.095+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f32541a4160 con 0x7f32541033e0 2024-09-06T14:41:10.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.095+0000 7f324a7fc640 1 -- 172.21.15.52:0/2109208642 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v41) ==== 86+0+187 (secure 0 0 0) 0x7f324405f180 con 0x7f32541033e0 2024-09-06T14:41:10.094 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f324006dfd0 msgr2=0x7f3240070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f324006dfd0 0x7f3240070490 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3250000c00 tx=0x7f3250031400 comp rx=0 tx=0).stop 2024-09-06T14:41:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32541033e0 msgr2=0x7f3254100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32541033e0 0x7f3254100c60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f324400c8f0 tx=0x7f324400cdb0 comp rx=0 tx=0).stop 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 shutdown_connections 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f324006dfd0 0x7f3240070490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32541033e0 0x7f3254100c60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 --2- 172.21.15.52:0/2109208642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254102ac0 0x7f3254100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 >> 172.21.15.52:0/2109208642 conn(0x7f32540fc520 msgr2=0x7f325410af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 shutdown_connections 2024-09-06T14:41:10.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:10.098+0000 7f325b333640 1 -- 172.21.15.52:0/2109208642 wait complete. 2024-09-06T14:41:10.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:10 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2109208642' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-06T14:41:10.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:10 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:10.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:10 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2109208642' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-06T14:41:10.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:10 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:10.798 INFO:teuthology.orchestra.run.smithi052.stdout:[{"version":41,"timestamp":"2024-09-06T14:40:59.393965+0000","name":"","changes":[{"name":"osd/host:smithi165/osd_memory_target","previous_value":"7818266009","new_value":"5212177339"}]}] 2024-09-06T14:41:10.799 INFO:tasks.ceph_manager:config epoch is 41 2024-09-06T14:41:10.799 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-06T14:41:10.799 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-06T14:41:10.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph mgr dump --format=json 2024-09-06T14:41:11.060 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:11.421 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:11 smithi052 ceph-mon[28627]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:11.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 -- 172.21.15.52:0/2264816363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 msgr2=0x7f32a0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 --2- 172.21.15.52:0/2264816363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a0101d60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3294009880 tx=0x7f329402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 -- 172.21.15.52:0/2264816363 shutdown_connections 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 --2- 172.21.15.52:0/2264816363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a0101d60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 --2- 172.21.15.52:0/2264816363 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a0107900 0x7f32a0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 -- 172.21.15.52:0/2264816363 >> 172.21.15.52:0/2264816363 conn(0x7f32a00fd600 msgr2=0x7f32a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 -- 172.21.15.52:0/2264816363 shutdown_connections 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.502+0000 7f32a678e640 1 -- 172.21.15.52:0/2264816363 wait complete. 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f32a678e640 1 Processor -- start 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f32a678e640 1 -- start start 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f32a678e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:11.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f32a678e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a0107900 0x7f32a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:11.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f32a678e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32a010ee30 con 0x7f32a0101900 2024-09-06T14:41:11.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f32a678e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f32a010ecb0 con 0x7f32a0107900 2024-09-06T14:41:11.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f329ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:11.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f329ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34712/0 (socket says 172.21.15.52:34712) 2024-09-06T14:41:11.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.503+0000 7f329ffff640 1 -- 172.21.15.52:0/498250491 learned_addr learned my addr 172.21.15.52:0/498250491 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:11.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329f7fe640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a0107900 0x7f32a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329ffff640 1 -- 172.21.15.52:0/498250491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a0107900 msgr2=0x7f32a0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329ffff640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a0107900 0x7f32a0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329ffff640 1 -- 172.21.15.52:0/498250491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a0074f70 con 0x7f32a0101900 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329f7fe640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a0107900 0x7f32a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329ffff640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a00744f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f329000b420 tx=0x7f329000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329d7fa640 1 -- 172.21.15.52:0/498250491 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3290011630 con 0x7f32a0101900 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a0075260 con 0x7f32a0101900 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329d7fa640 1 -- 172.21.15.52:0/498250491 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3290016070 con 0x7f32a0101900 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f329d7fa640 1 -- 172.21.15.52:0/498250491 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3290010d40 con 0x7f32a0101900 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.504+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a01a3ec0 con 0x7f32a0101900 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.505+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a0103040 con 0x7f32a0101900 2024-09-06T14:41:11.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.506+0000 7f329d7fa640 1 -- 172.21.15.52:0/498250491 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f329001b460 con 0x7f32a0101900 2024-09-06T14:41:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.506+0000 7f329d7fa640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f328806de30 0x7f32880702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.506+0000 7f329d7fa640 1 -- 172.21.15.52:0/498250491 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f329008d0b0 con 0x7f32a0101900 2024-09-06T14:41:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.506+0000 7f329f7fe640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f328806de30 0x7f32880702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:11.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.507+0000 7f329f7fe640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f328806de30 0x7f32880702f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32a0075f80 tx=0x7f3294031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:11.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.511+0000 7f329d7fa640 1 -- 172.21.15.52:0/498250491 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f329005af90 con 0x7f32a0101900 2024-09-06T14:41:11.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.748+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f32a0109e90 con 0x7f32a0101900 2024-09-06T14:41:11.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.751+0000 7f329d7fa640 1 -- 172.21.15.52:0/498250491 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176000 (secure 0 0 0) 0x7f329005ec40 con 0x7f32a0101900 2024-09-06T14:41:11.753 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:11.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f328806de30 msgr2=0x7f32880702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f328806de30 0x7f32880702f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32a0075f80 tx=0x7f3294031400 comp rx=0 tx=0).stop 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 msgr2=0x7f32a00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a00744f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f329000b420 tx=0x7f329000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 shutdown_connections 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f328806de30 0x7f32880702f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32a0107900 0x7f32a0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 --2- 172.21.15.52:0/498250491 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32a0101900 0x7f32a00744f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 >> 172.21.15.52:0/498250491 conn(0x7f32a00fd600 msgr2=0x7f32a00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 shutdown_connections 2024-09-06T14:41:11.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:11.754+0000 7f32a678e640 1 -- 172.21.15.52:0/498250491 wait complete. 2024-09-06T14:41:11.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:11 smithi165 ceph-mon[36229]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:12.431 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi052.vsthpq","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1895569249},{"type":"v1","addr":"172.21.15.52:6801","nonce":1895569249}]},"active_addr":"172.21.15.52:6801/1895569249","active_change":"2024-09-06T14:37:10.243816+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14244,"name":"smithi165.hcexoi","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.52:8443/","prometheus":"http://172.21.15.52:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":3329824106}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2195954396}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2372702164}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2230692890}]}]} 2024-09-06T14:41:12.435 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-06T14:41:12.435 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-06T14:41:12.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd dump --format=json 2024-09-06T14:41:12.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:12 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/498250491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-06T14:41:12.690 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:12.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:12 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/498250491' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-06T14:41:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.118+0000 7f0325ec3640 1 -- 172.21.15.52:0/2007497227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 msgr2=0x7f0320100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.118+0000 7f0325ec3640 1 --2- 172.21.15.52:0/2007497227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f0320100c60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0314009880 tx=0x7f031402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 -- 172.21.15.52:0/2007497227 shutdown_connections 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 --2- 172.21.15.52:0/2007497227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f0320100c60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 --2- 172.21.15.52:0/2007497227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0320106800 0x7f0320106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 -- 172.21.15.52:0/2007497227 >> 172.21.15.52:0/2007497227 conn(0x7f03200fc520 msgr2=0x7f03200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 -- 172.21.15.52:0/2007497227 shutdown_connections 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 -- 172.21.15.52:0/2007497227 wait complete. 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 Processor -- start 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.119+0000 7f0325ec3640 1 -- start start 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f0325ec3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f032019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f0325ec3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0320106800 0x7f032019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f0325ec3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f032010dcd0 con 0x7f0320100800 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f0325ec3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f032010db50 con 0x7f0320106800 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f032019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f032019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34738/0 (socket says 172.21.15.52:34738) 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031f7fe640 1 -- 172.21.15.52:0/933073585 learned_addr learned my addr 172.21.15.52:0/933073585 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031effd640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0320106800 0x7f032019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031f7fe640 1 -- 172.21.15.52:0/933073585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0320106800 msgr2=0x7f032019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031f7fe640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0320106800 0x7f032019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031f7fe640 1 -- 172.21.15.52:0/933073585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03201977d0 con 0x7f0320100800 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031f7fe640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f032019d650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f031000ea00 tx=0x7f031000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f031cff9640 1 -- 172.21.15.52:0/933073585 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f031000cb80 con 0x7f0320100800 2024-09-06T14:41:13.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.120+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0320197ac0 con 0x7f0320100800 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.121+0000 7f031cff9640 1 -- 172.21.15.52:0/933073585 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f031000cd20 con 0x7f0320100800 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.121+0000 7f031cff9640 1 -- 172.21.15.52:0/933073585 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0310011470 con 0x7f0320100800 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.121+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0320198020 con 0x7f0320100800 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.121+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0320101f40 con 0x7f0320100800 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.122+0000 7f031cff9640 1 -- 172.21.15.52:0/933073585 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f0310011750 con 0x7f0320100800 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.122+0000 7f031cff9640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f030806de30 0x7f03080702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.122+0000 7f031cff9640 1 -- 172.21.15.52:0/933073585 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f031008dc30 con 0x7f0320100800 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.122+0000 7f031effd640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f030806de30 0x7f03080702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.123+0000 7f031effd640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f030806de30 0x7f03080702f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0320198b20 tx=0x7f0314031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.127+0000 7f031cff9640 1 -- 172.21.15.52:0/933073585 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0310016030 con 0x7f0320100800 2024-09-06T14:41:13.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.303+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0320198330 con 0x7f0320100800 2024-09-06T14:41:13.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.304+0000 7f031cff9640 1 -- 172.21.15.52:0/933073585 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11369 (secure 0 0 0) 0x7f031005f7c0 con 0x7f0320100800 2024-09-06T14:41:13.303 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:13.303 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","created":"2024-09-06T14:35:20.909688+0000","modified":"2024-09-06T14:41:01.009024+0000","last_up_change":"2024-09-06T14:41:00.000591+0000","last_in_change":"2024-09-06T14:40:37.158597+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-06T14:39:44.581703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ae61513-7d97-42fb-9086-4d24ca8fece0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6803","nonce":1153165475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6805","nonce":1153165475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6809","nonce":1153165475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6807","nonce":1153165475}]},"public_addr":"172.21.15.52:6803/1153165475","cluster_addr":"172.21.15.52:6805/1153165475","heartbeat_back_addr":"172.21.15.52:6809/1153165475","heartbeat_front_addr":"172.21.15.52:6807/1153165475","state":["exists","up"]},{"osd":1,"uuid":"0266d9c3-3a34-4274-b6b8-7b31b8179010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6811","nonce":209057109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6813","nonce":209057109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6817","nonce":209057109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6815","nonce":209057109}]},"public_addr":"172.21.15.52:6811/209057109","cluster_addr":"172.21.15.52:6813/209057109","heartbeat_back_addr":"172.21.15.52:6817/209057109","heartbeat_front_addr":"172.21.15.52:6815/209057109","state":["exists","up"]},{"osd":2,"uuid":"f74510c1-d48f-4813-9d2a-294a5b8c1c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6819","nonce":4265125143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6821","nonce":4265125143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6825","nonce":4265125143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6823","nonce":4265125143}]},"public_addr":"172.21.15.52:6819/4265125143","cluster_addr":"172.21.15.52:6821/4265125143","heartbeat_back_addr":"172.21.15.52:6825/4265125143","heartbeat_front_addr":"172.21.15.52:6823/4265125143","state":["exists","up"]},{"osd":3,"uuid":"69c53c54-ee2c-4cd0-a296-816e7c90bfae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6801","nonce":897558016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6803","nonce":897558016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6807","nonce":897558016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6805","nonce":897558016}]},"public_addr":"172.21.15.165:6801/897558016","cluster_addr":"172.21.15.165:6803/897558016","heartbeat_back_addr":"172.21.15.165:6807/897558016","heartbeat_front_addr":"172.21.15.165:6805/897558016","state":["exists","up"]},{"osd":4,"uuid":"c8a96f98-f41f-40ed-8987-df5ee66c5763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6809","nonce":751152610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6811","nonce":751152610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6815","nonce":751152610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6813","nonce":751152610}]},"public_addr":"172.21.15.165:6809/751152610","cluster_addr":"172.21.15.165:6811/751152610","heartbeat_back_addr":"172.21.15.165:6815/751152610","heartbeat_front_addr":"172.21.15.165:6813/751152610","state":["exists","up"]},{"osd":5,"uuid":"94a49ace-0375-4404-a72e-dc0d1db13f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6817","nonce":2430931177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6819","nonce":2430931177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6823","nonce":2430931177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6821","nonce":2430931177}]},"public_addr":"172.21.15.165:6817/2430931177","cluster_addr":"172.21.15.165:6819/2430931177","heartbeat_back_addr":"172.21.15.165:6823/2430931177","heartbeat_front_addr":"172.21.15.165:6821/2430931177","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:38:44.835353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:39:12.390430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:39:40.367838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:05.129169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:31.876842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:58.534610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/1082422739":"2024-09-07T14:37:10.243661+0000","172.21.15.52:0/88542092":"2024-09-07T14:37:10.243661+0000","172.21.15.52:0/1634284377":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6801/175246929":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3779039706":"2024-09-07T14:35:42.967245+0000","172.21.15.52:0/3578956532":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3157720548":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6800/175246929":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/4210640305":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3105657816":"2024-09-07T14:36:14.010074+0000","172.21.15.52:6800/3628559436":"2024-09-07T14:37:10.243661+0000","172.21.15.52:6801/3628559436":"2024-09-07T14:37:10.243661+0000","172.21.15.52:6800/2567430039":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6801/2567430039":"2024-09-07T14:35:42.967245+0000","172.21.15.52:0/2579445121":"2024-09-07T14:37:10.243661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-06T14:41:13.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f030806de30 msgr2=0x7f03080702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:13.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f030806de30 0x7f03080702f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0320198b20 tx=0x7f0314031400 comp rx=0 tx=0).stop 2024-09-06T14:41:13.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 msgr2=0x7f032019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:13.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f032019d650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f031000ea00 tx=0x7f031000eec0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 shutdown_connections 2024-09-06T14:41:13.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f030806de30 0x7f03080702f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0320106800 0x7f032019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 --2- 172.21.15.52:0/933073585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0320100800 0x7f032019d650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:13.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.306+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 >> 172.21.15.52:0/933073585 conn(0x7f03200fc520 msgr2=0x7f03201045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:13.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.307+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 shutdown_connections 2024-09-06T14:41:13.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:13.307+0000 7f0325ec3640 1 -- 172.21.15.52:0/933073585 wait complete. 2024-09-06T14:41:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:13 smithi052 ceph-mon[28627]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:13 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/933073585' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-06T14:41:13.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:13 smithi165 ceph-mon[36229]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:13.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:13 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/933073585' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-06T14:41:13.943 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-06T14:41:13.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd dump --format=json 2024-09-06T14:41:14.196 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:14.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 -- 172.21.15.52:0/1715970865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 msgr2=0x7f9e40101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:14.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 --2- 172.21.15.52:0/1715970865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e40101d60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009880 tx=0x7f9e3002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 -- 172.21.15.52:0/1715970865 shutdown_connections 2024-09-06T14:41:14.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 --2- 172.21.15.52:0/1715970865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e40101d60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 --2- 172.21.15.52:0/1715970865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e40107900 0x7f9e40107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 -- 172.21.15.52:0/1715970865 >> 172.21.15.52:0/1715970865 conn(0x7f9e400fd600 msgr2=0x7f9e400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 -- 172.21.15.52:0/1715970865 shutdown_connections 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 -- 172.21.15.52:0/1715970865 wait complete. 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.625+0000 7f9e45f17640 1 Processor -- start 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e45f17640 1 -- start start 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e45f17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e4019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e45f17640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e40107900 0x7f9e4019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e45f17640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4010ee30 con 0x7f9e40101900 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e45f17640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4010ecb0 con 0x7f9e40107900 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e4019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:14.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e4019f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34762/0 (socket says 172.21.15.52:34762) 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3f7fe640 1 -- 172.21.15.52:0/2650664458 learned_addr learned my addr 172.21.15.52:0/2650664458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3f7fe640 1 -- 172.21.15.52:0/2650664458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e40107900 msgr2=0x7f9e4019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3f7fe640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e40107900 0x7f9e4019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3f7fe640 1 -- 172.21.15.52:0/2650664458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e40199a50 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3f7fe640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e4019f890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800b420 tx=0x7f9e2800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3cff9640 1 -- 172.21.15.52:0/2650664458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e28011630 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e40199d40 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3cff9640 1 -- 172.21.15.52:0/2650664458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e28016070 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.626+0000 7f9e3cff9640 1 -- 172.21.15.52:0/2650664458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e28010d40 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.627+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4019a2d0 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.627+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e40103040 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.628+0000 7f9e3cff9640 1 -- 172.21.15.52:0/2650664458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f9e2801b460 con 0x7f9e40101900 2024-09-06T14:41:14.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.628+0000 7f9e3cff9640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f9e2c06de30 0x7f9e2c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:14.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.629+0000 7f9e3cff9640 1 -- 172.21.15.52:0/2650664458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f9e2808d140 con 0x7f9e40101900 2024-09-06T14:41:14.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.629+0000 7f9e3effd640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f9e2c06de30 0x7f9e2c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:14.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.629+0000 7f9e3effd640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f9e2c06de30 0x7f9e2c0702f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e300096c0 tx=0x7f9e30000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:14.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.633+0000 7f9e3cff9640 1 -- 172.21.15.52:0/2650664458 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e2805af80 con 0x7f9e40101900 2024-09-06T14:41:14.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.808+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e4019a5e0 con 0x7f9e40101900 2024-09-06T14:41:14.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.809+0000 7f9e3cff9640 1 -- 172.21.15.52:0/2650664458 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11369 (secure 0 0 0) 0x7f9e2808be20 con 0x7f9e40101900 2024-09-06T14:41:14.809 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:14.809 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":40,"fsid":"14ffcc96-6c5d-11ef-bce4-c7b262605968","created":"2024-09-06T14:35:20.909688+0000","modified":"2024-09-06T14:41:01.009024+0000","last_up_change":"2024-09-06T14:41:00.000591+0000","last_in_change":"2024-09-06T14:40:37.158597+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-06T14:39:44.581703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6ae61513-7d97-42fb-9086-4d24ca8fece0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6803","nonce":1153165475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6805","nonce":1153165475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6809","nonce":1153165475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1153165475},{"type":"v1","addr":"172.21.15.52:6807","nonce":1153165475}]},"public_addr":"172.21.15.52:6803/1153165475","cluster_addr":"172.21.15.52:6805/1153165475","heartbeat_back_addr":"172.21.15.52:6809/1153165475","heartbeat_front_addr":"172.21.15.52:6807/1153165475","state":["exists","up"]},{"osd":1,"uuid":"0266d9c3-3a34-4274-b6b8-7b31b8179010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6811","nonce":209057109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6813","nonce":209057109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6817","nonce":209057109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":209057109},{"type":"v1","addr":"172.21.15.52:6815","nonce":209057109}]},"public_addr":"172.21.15.52:6811/209057109","cluster_addr":"172.21.15.52:6813/209057109","heartbeat_back_addr":"172.21.15.52:6817/209057109","heartbeat_front_addr":"172.21.15.52:6815/209057109","state":["exists","up"]},{"osd":2,"uuid":"f74510c1-d48f-4813-9d2a-294a5b8c1c5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6819","nonce":4265125143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6821","nonce":4265125143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6825","nonce":4265125143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":4265125143},{"type":"v1","addr":"172.21.15.52:6823","nonce":4265125143}]},"public_addr":"172.21.15.52:6819/4265125143","cluster_addr":"172.21.15.52:6821/4265125143","heartbeat_back_addr":"172.21.15.52:6825/4265125143","heartbeat_front_addr":"172.21.15.52:6823/4265125143","state":["exists","up"]},{"osd":3,"uuid":"69c53c54-ee2c-4cd0-a296-816e7c90bfae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6801","nonce":897558016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6803","nonce":897558016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6807","nonce":897558016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":897558016},{"type":"v1","addr":"172.21.15.165:6805","nonce":897558016}]},"public_addr":"172.21.15.165:6801/897558016","cluster_addr":"172.21.15.165:6803/897558016","heartbeat_back_addr":"172.21.15.165:6807/897558016","heartbeat_front_addr":"172.21.15.165:6805/897558016","state":["exists","up"]},{"osd":4,"uuid":"c8a96f98-f41f-40ed-8987-df5ee66c5763","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6809","nonce":751152610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6811","nonce":751152610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6815","nonce":751152610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":751152610},{"type":"v1","addr":"172.21.15.165:6813","nonce":751152610}]},"public_addr":"172.21.15.165:6809/751152610","cluster_addr":"172.21.15.165:6811/751152610","heartbeat_back_addr":"172.21.15.165:6815/751152610","heartbeat_front_addr":"172.21.15.165:6813/751152610","state":["exists","up"]},{"osd":5,"uuid":"94a49ace-0375-4404-a72e-dc0d1db13f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6817","nonce":2430931177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6819","nonce":2430931177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6823","nonce":2430931177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":2430931177},{"type":"v1","addr":"172.21.15.165:6821","nonce":2430931177}]},"public_addr":"172.21.15.165:6817/2430931177","cluster_addr":"172.21.15.165:6819/2430931177","heartbeat_back_addr":"172.21.15.165:6823/2430931177","heartbeat_front_addr":"172.21.15.165:6821/2430931177","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:38:44.835353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:39:12.390430+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:39:40.367838+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:05.129169+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:31.876842+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-06T14:40:58.534610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/1082422739":"2024-09-07T14:37:10.243661+0000","172.21.15.52:0/88542092":"2024-09-07T14:37:10.243661+0000","172.21.15.52:0/1634284377":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6801/175246929":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3779039706":"2024-09-07T14:35:42.967245+0000","172.21.15.52:0/3578956532":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3157720548":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6800/175246929":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/4210640305":"2024-09-07T14:36:14.010074+0000","172.21.15.52:0/3105657816":"2024-09-07T14:36:14.010074+0000","172.21.15.52:6800/3628559436":"2024-09-07T14:37:10.243661+0000","172.21.15.52:6801/3628559436":"2024-09-07T14:37:10.243661+0000","172.21.15.52:6800/2567430039":"2024-09-07T14:35:42.967245+0000","172.21.15.52:6801/2567430039":"2024-09-07T14:35:42.967245+0000","172.21.15.52:0/2579445121":"2024-09-07T14:37:10.243661+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f9e2c06de30 msgr2=0x7f9e2c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f9e2c06de30 0x7f9e2c0702f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e300096c0 tx=0x7f9e30000bc0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 msgr2=0x7f9e4019f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e4019f890 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800b420 tx=0x7f9e2800b8e0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 shutdown_connections 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f9e2c06de30 0x7f9e2c0702f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e40107900 0x7f9e4019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 --2- 172.21.15.52:0/2650664458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9e40101900 0x7f9e4019f890 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:14.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 >> 172.21.15.52:0/2650664458 conn(0x7f9e400fd600 msgr2=0x7f9e400744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:14.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 shutdown_connections 2024-09-06T14:41:14.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:14.811+0000 7f9e45f17640 1 -- 172.21.15.52:0/2650664458 wait complete. 2024-09-06T14:41:15.548 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:15 smithi052 ceph-mon[28627]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:15.548 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:15 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2650664458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-06T14:41:15.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:15 smithi165 ceph-mon[36229]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:15.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:15 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2650664458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-06T14:41:15.582 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-06T14:41:15.582 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-06T14:41:15.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-06T14:41:15.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-06T14:41:15.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-06T14:41:15.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-06T14:41:15.878 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:15.879 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:16.588 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:16 smithi052 ceph-mon[28627]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:16.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.595+0000 7f74badb3640 1 -- 172.21.15.52:0/3100106618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41007f0 msgr2=0x7f74b4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.595+0000 7f74badb3640 1 --2- 172.21.15.52:0/3100106618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41007f0 0x7f74b4100c50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009880 tx=0x7f74a002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 -- 172.21.15.52:0/3100106618 shutdown_connections 2024-09-06T14:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 --2- 172.21.15.52:0/3100106618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41007f0 0x7f74b4100c50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 --2- 172.21.15.52:0/3100106618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b41067f0 0x7f74b4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 -- 172.21.15.52:0/3100106618 >> 172.21.15.52:0/3100106618 conn(0x7f74b40fc550 msgr2=0x7f74b40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 -- 172.21.15.52:0/3100106618 shutdown_connections 2024-09-06T14:41:16.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 -- 172.21.15.52:0/3100106618 wait complete. 2024-09-06T14:41:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 Processor -- start 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 -- start start 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b41007f0 0x7f74b419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41067f0 0x7f74b419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f74b410dcc0 con 0x7f74b41067f0 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74badb3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f74b410db40 con 0x7f74b41007f0 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41067f0 0x7f74b419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.596+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41067f0 0x7f74b419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34782/0 (socket says 172.21.15.52:34782) 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b3fff640 1 -- 172.21.15.52:0/3577769675 learned_addr learned my addr 172.21.15.52:0/3577769675 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b8b4f640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b41007f0 0x7f74b419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b3fff640 1 -- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b41007f0 msgr2=0x7f74b419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b3fff640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b41007f0 0x7f74b419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b3fff640 1 -- 172.21.15.52:0/3577769675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b41999b0 con 0x7f74b41067f0 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b3fff640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41067f0 0x7f74b419fd30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f74a0031460 tx=0x7f74a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74a003f070 con 0x7f74b41067f0 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b4199c40 con 0x7f74b41067f0 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74a0004cf0 con 0x7f74b41067f0 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74a0035030 con 0x7f74b41067f0 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.597+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b419a170 con 0x7f74b41067f0 2024-09-06T14:41:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.598+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74b419a7f0 con 0x7f74b41067f0 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.599+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f74a0042070 con 0x7f74b41067f0 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.599+0000 7f74b1ffb640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f74a406de30 0x7f74a40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.599+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f74a00ae290 con 0x7f74b41067f0 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.599+0000 7f74b8b4f640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f74a406de30 0x7f74a40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.599+0000 7f74b1ffb640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] conn(0x7f74a4073c20 0x7f74a4076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.599+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 --> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74a40766f0 con 0x7f74a4073c20 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.599+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f74a00b5050 con 0x7f74b41067f0 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.600+0000 7f74b8b4f640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f74a406de30 0x7f74a40702f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f74a8005fd0 tx=0x7f74a8005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.600+0000 7f74b9350640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] conn(0x7f74a4073c20 0x7f74a4076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.600+0000 7f74b9350640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] conn(0x7f74a4073c20 0x7f74a4076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.601+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== osd.3 v2:172.21.15.165:6800/897558016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74a40766f0 con 0x7f74a4073c20 2024-09-06T14:41:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.615+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 --> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74b406a6c0 con 0x7f74a4073c20 2024-09-06T14:41:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74b1ffb640 1 -- 172.21.15.52:0/3577769675 <== osd.3 v2:172.21.15.165:6800/897558016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f74b406a6c0 con 0x7f74a4073c20 2024-09-06T14:41:16.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] conn(0x7f74a4073c20 msgr2=0x7f74a4076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] conn(0x7f74a4073c20 0x7f74a4076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f74a406de30 msgr2=0x7f74a40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f74a406de30 0x7f74a40702f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f74a8005fd0 tx=0x7f74a8005e20 comp rx=0 tx=0).stop 2024-09-06T14:41:16.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41067f0 msgr2=0x7f74b419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41067f0 0x7f74b419fd30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f74a0031460 tx=0x7f74a00048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 shutdown_connections 2024-09-06T14:41:16.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:6800/897558016,v1:172.21.15.165:6801/897558016] conn(0x7f74a4073c20 0x7f74a4076040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f74a406de30 0x7f74a40702f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f74b41067f0 0x7f74b419fd30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 --2- 172.21.15.52:0/3577769675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b41007f0 0x7f74b419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 >> 172.21.15.52:0/3577769675 conn(0x7f74b40fc550 msgr2=0x7f74b4069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:16.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 shutdown_connections 2024-09-06T14:41:16.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.616+0000 7f74badb3640 1 -- 172.21.15.52:0/3577769675 wait complete. 2024-09-06T14:41:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 -- 172.21.15.52:0/90750102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 msgr2=0x7f5950100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 --2- 172.21.15.52:0/90750102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f5950100a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f594c009880 tx=0x7f594c02a490 comp rx=0 tx=0).stop 2024-09-06T14:41:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 -- 172.21.15.52:0/90750102 shutdown_connections 2024-09-06T14:41:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 --2- 172.21.15.52:0/90750102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5950100ff0 0x7f595010dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 --2- 172.21.15.52:0/90750102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f5950100a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 -- 172.21.15.52:0/90750102 >> 172.21.15.52:0/90750102 conn(0x7f59500fc550 msgr2=0x7f59500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 -- 172.21.15.52:0/90750102 shutdown_connections 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.805+0000 7f59575eb640 1 -- 172.21.15.52:0/90750102 wait complete. 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f59575eb640 1 Processor -- start 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f59575eb640 1 -- start start 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f59575eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f595019f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f59575eb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5950100ff0 0x7f595019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f59575eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5950110f80 con 0x7f5950100640 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f59575eb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5950110e00 con 0x7f5950100ff0 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f5955387640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f595019f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.806+0000 7f5955387640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f595019f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34806/0 (socket says 172.21.15.52:34806) 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.807+0000 7f5955387640 1 -- 172.21.15.52:0/3279873677 learned_addr learned my addr 172.21.15.52:0/3279873677 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.807+0000 7f5954b86640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5950100ff0 0x7f595019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.807+0000 7f5955387640 1 -- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5950100ff0 msgr2=0x7f595019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.807+0000 7f5955387640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5950100ff0 0x7f595019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.807+0000 7f5955387640 1 -- 172.21.15.52:0/3279873677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5950199970 con 0x7f5950100640 2024-09-06T14:41:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.807+0000 7f5954b86640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5950100ff0 0x7f595019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:41:16.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.807+0000 7f5955387640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f595019f7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f594c031460 tx=0x7f594c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:16.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.808+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f594c03f070 con 0x7f5950100640 2024-09-06T14:41:16.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.808+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f594c004cf0 con 0x7f5950100640 2024-09-06T14:41:16.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.808+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f594c035030 con 0x7f5950100640 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.808+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5950199c00 con 0x7f5950100640 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.808+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595019a190 con 0x7f5950100640 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.809+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f595006a580 con 0x7f5950100640 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.809+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f594c042070 con 0x7f5950100640 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f59467fc640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f593c06ded0 0x7f593c070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f594c0ae140 con 0x7f5950100640 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f5954b86640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f593c06ded0 0x7f593c070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f59467fc640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] conn(0x7f593c073cc0 0x7f593c0760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 --> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f594c009080 con 0x7f593c073cc0 2024-09-06T14:41:16.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f594c0b5050 con 0x7f5950100640 2024-09-06T14:41:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f5954b86640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f593c06ded0 0x7f593c070390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59500fef70 tx=0x7f5940005d30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.810+0000 7f5955b88640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] conn(0x7f593c073cc0 0x7f593c0760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.811+0000 7f5955b88640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] conn(0x7f593c073cc0 0x7f593c0760e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:16.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.812+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== osd.4 v2:172.21.15.165:6808/751152610 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f594c009080 con 0x7f593c073cc0 2024-09-06T14:41:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:16 smithi165 ceph-mon[36229]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.825+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 --> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f595019a7d0 con 0x7f593c073cc0 2024-09-06T14:41:16.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59467fc640 1 -- 172.21.15.52:0/3279873677 <== osd.4 v2:172.21.15.165:6808/751152610 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f595019a7d0 con 0x7f593c073cc0 2024-09-06T14:41:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] conn(0x7f593c073cc0 msgr2=0x7f593c0760e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] conn(0x7f593c073cc0 0x7f593c0760e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f593c06ded0 msgr2=0x7f593c070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f593c06ded0 0x7f593c070390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f59500fef70 tx=0x7f5940005d30 comp rx=0 tx=0).stop 2024-09-06T14:41:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 msgr2=0x7f595019f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f595019f7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f594c031460 tx=0x7f594c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 shutdown_connections 2024-09-06T14:41:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:6808/751152610,v1:172.21.15.165:6809/751152610] conn(0x7f593c073cc0 0x7f593c0760e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f593c06ded0 0x7f593c070390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5950100ff0 0x7f595019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 --2- 172.21.15.52:0/3279873677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5950100640 0x7f595019f7b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 >> 172.21.15.52:0/3279873677 conn(0x7f59500fc550 msgr2=0x7f59500fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 shutdown_connections 2024-09-06T14:41:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:16.826+0000 7f59575eb640 1 -- 172.21.15.52:0/3279873677 wait complete. 2024-09-06T14:41:17.796 INFO:teuthology.orchestra.run.smithi052.stdout:115964117009 2024-09-06T14:41:17.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-06T14:41:18.213 INFO:teuthology.orchestra.run.smithi052.stdout:146028888076 2024-09-06T14:41:18.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-06T14:41:18.218 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:18.242 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:18.252 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:18.265 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 -- 172.21.15.52:0/36034159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca681033e0 msgr2=0x7fca6810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 --2- 172.21.15.52:0/36034159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca681033e0 0x7fca6810b8d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca50009880 tx=0x7fca5002a530 comp rx=0 tx=0).stop 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 -- 172.21.15.52:0/36034159 shutdown_connections 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 --2- 172.21.15.52:0/36034159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca681033e0 0x7fca6810b8d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 --2- 172.21.15.52:0/36034159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca68102ac0 0x7fca68102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 -- 172.21.15.52:0/36034159 >> 172.21.15.52:0/36034159 conn(0x7fca680fc520 msgr2=0x7fca680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 -- 172.21.15.52:0/36034159 shutdown_connections 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 -- 172.21.15.52:0/36034159 wait complete. 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 Processor -- start 2024-09-06T14:41:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.972+0000 7fca6e022640 1 -- start start 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca6e022640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca68102ac0 0x7fca68100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca6e022640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca681033e0 0x7fca68100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca6e022640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca6810ee50 con 0x7fca68102ac0 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca6e022640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca6810ecd0 con 0x7fca681033e0 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca677fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca68102ac0 0x7fca68100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca677fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca68102ac0 0x7fca68100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34826/0 (socket says 172.21.15.52:34826) 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca677fe640 1 -- 172.21.15.52:0/1214652697 learned_addr learned my addr 172.21.15.52:0/1214652697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca5effd640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca681033e0 0x7fca68100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca677fe640 1 -- 172.21.15.52:0/1214652697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca681033e0 msgr2=0x7fca68100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca677fe640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca681033e0 0x7fca68100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca677fe640 1 -- 172.21.15.52:0/1214652697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca681011a0 con 0x7fca68102ac0 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca5effd640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca681033e0 0x7fca68100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.973+0000 7fca677fe640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca68102ac0 0x7fca68100720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b420 tx=0x7fca5800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.974+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca58011630 con 0x7fca68102ac0 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.974+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca68101490 con 0x7fca68102ac0 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.974+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca58016070 con 0x7fca68102ac0 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.974+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca58010d40 con 0x7fca68102ac0 2024-09-06T14:41:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.974+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca681a3ee0 con 0x7fca68102ac0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.975+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca68062880 con 0x7fca68102ac0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.975+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fca5801b460 con 0x7fca68102ac0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca657fa640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fca5406de30 0x7fca540702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fca5808d100 con 0x7fca68102ac0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca5effd640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fca5406de30 0x7fca540702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca657fa640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] conn(0x7fca54073c20 0x7fca54076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 --> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca540766f0 con 0x7fca54073c20 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fca58094050 con 0x7fca68102ac0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca67fff640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] conn(0x7fca54073c20 0x7fca54076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.976+0000 7fca5effd640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fca5406de30 0x7fca540702f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca50006010 tx=0x7fca500095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.977+0000 7fca67fff640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] conn(0x7fca54073c20 0x7fca54076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:18.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.977+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== osd.0 v2:172.21.15.52:6802/1153165475 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca540766f0 con 0x7fca54073c20 2024-09-06T14:41:18.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 --> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca68062d00 con 0x7fca54073c20 2024-09-06T14:41:18.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca657fa640 1 -- 172.21.15.52:0/1214652697 <== osd.0 v2:172.21.15.52:6802/1153165475 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca68062d00 con 0x7fca54073c20 2024-09-06T14:41:18.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] conn(0x7fca54073c20 msgr2=0x7fca54076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:18.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] conn(0x7fca54073c20 0x7fca54076040 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fca5406de30 msgr2=0x7fca540702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fca5406de30 0x7fca540702f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca50006010 tx=0x7fca500095f0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca68102ac0 msgr2=0x7fca68100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca68102ac0 0x7fca68100720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b420 tx=0x7fca5800b8e0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 shutdown_connections 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fca5406de30 0x7fca540702f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.991+0000 7fca6e022640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca681033e0 0x7fca68100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.992+0000 7fca6e022640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:6802/1153165475,v1:172.21.15.52:6803/1153165475] conn(0x7fca54073c20 0x7fca54076040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.992+0000 7fca6e022640 1 --2- 172.21.15.52:0/1214652697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca68102ac0 0x7fca68100720 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.992+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 >> 172.21.15.52:0/1214652697 conn(0x7fca680fc520 msgr2=0x7fca68108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.992+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 shutdown_connections 2024-09-06T14:41:18.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:18.992+0000 7fca6e022640 1 -- 172.21.15.52:0/1214652697 wait complete. 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 -- 172.21.15.52:0/3866667722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da80ffdc0 msgr2=0x7f6da8100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 --2- 172.21.15.52:0/3866667722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da80ffdc0 0x7f6da8100220 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009880 tx=0x7f6d9402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 -- 172.21.15.52:0/3866667722 shutdown_connections 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 --2- 172.21.15.52:0/3866667722 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da80ffdc0 0x7f6da8100220 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 --2- 172.21.15.52:0/3866667722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6da81069a0 0x7f6da8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 -- 172.21.15.52:0/3866667722 >> 172.21.15.52:0/3866667722 conn(0x7f6da80fbc90 msgr2=0x7f6da80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 -- 172.21.15.52:0/3866667722 shutdown_connections 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.187+0000 7f6daef92640 1 -- 172.21.15.52:0/3866667722 wait complete. 2024-09-06T14:41:19.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6daef92640 1 Processor -- start 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6daef92640 1 -- start start 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6daef92640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6da80ffdc0 0x7f6da819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6daef92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81069a0 0x7f6da819dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6daef92640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810ef20 con 0x7f6da81069a0 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6daef92640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6da810eda0 con 0x7f6da80ffdc0 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6da7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81069a0 0x7f6da819dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6da7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81069a0 0x7f6da819dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34838/0 (socket says 172.21.15.52:34838) 2024-09-06T14:41:19.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6da7fff640 1 -- 172.21.15.52:0/3417262013 learned_addr learned my addr 172.21.15.52:0/3417262013 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6dacd2e640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6da80ffdc0 0x7f6da819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6da7fff640 1 -- 172.21.15.52:0/3417262013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6da80ffdc0 msgr2=0x7f6da819d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6da7fff640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6da80ffdc0 0x7f6da819d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.188+0000 7f6da7fff640 1 -- 172.21.15.52:0/3417262013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81978b0 con 0x7f6da81069a0 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.189+0000 7f6da7fff640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81069a0 0x7f6da819dc30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d94031460 tx=0x7f6d940045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.189+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d9403f070 con 0x7f6da81069a0 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.189+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d940035f0 con 0x7f6da81069a0 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.189+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da8197b40 con 0x7f6da81069a0 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.189+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d94035030 con 0x7f6da81069a0 2024-09-06T14:41:19.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.189+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da8198070 con 0x7f6da81069a0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.190+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6da8198570 con 0x7f6da81069a0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.191+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f6d94042070 con 0x7f6da81069a0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.191+0000 7f6da5ffb640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f6d9806de30 0x7f6d980702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.191+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f6d940ae310 con 0x7f6da81069a0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.191+0000 7f6dacd2e640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f6d9806de30 0x7f6d980702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.191+0000 7f6da5ffb640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] conn(0x7f6d98073c20 0x7f6d98076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.191+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 --> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d940054e0 con 0x7f6d98073c20 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.191+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6d940b5050 con 0x7f6da81069a0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.192+0000 7f6dad52f640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] conn(0x7f6d98073c20 0x7f6d98076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.192+0000 7f6dacd2e640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f6d9806de30 0x7f6d980702f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c005fd0 tx=0x7f6d9c005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.192+0000 7f6dad52f640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] conn(0x7f6d98073c20 0x7f6d98076040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:19.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.193+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== osd.1 v2:172.21.15.52:6810/209057109 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d940054e0 con 0x7f6d98073c20 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.206+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 --> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6da80628b0 con 0x7f6d98073c20 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.206+0000 7f6da5ffb640 1 -- 172.21.15.52:0/3417262013 <== osd.1 v2:172.21.15.52:6810/209057109 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6da80628b0 con 0x7f6d98073c20 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.206+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] conn(0x7f6d98073c20 msgr2=0x7f6d98076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.206+0000 7f6daef92640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] conn(0x7f6d98073c20 0x7f6d98076040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f6d9806de30 msgr2=0x7f6d980702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f6d9806de30 0x7f6d980702f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c005fd0 tx=0x7f6d9c005850 comp rx=0 tx=0).stop 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81069a0 msgr2=0x7f6da819dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81069a0 0x7f6da819dc30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d94031460 tx=0x7f6d940045e0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 shutdown_connections 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6810/209057109,v1:172.21.15.52:6811/209057109] conn(0x7f6d98073c20 0x7f6d98076040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f6d9806de30 0x7f6d980702f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6da81069a0 0x7f6da819dc30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 --2- 172.21.15.52:0/3417262013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6da80ffdc0 0x7f6da819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 >> 172.21.15.52:0/3417262013 conn(0x7f6da80fbc90 msgr2=0x7f6da80fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 shutdown_connections 2024-09-06T14:41:19.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:19.207+0000 7f6daef92640 1 -- 172.21.15.52:0/3417262013 wait complete. 2024-09-06T14:41:19.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:19 smithi052 ceph-mon[28627]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:19.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:19 smithi165 ceph-mon[36229]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 -- 172.21.15.52:0/3111962035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0100800 msgr2=0x7f18a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 --2- 172.21.15.52:0/3111962035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0100800 0x7f18a0100c60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1888009880 tx=0x7f188802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 -- 172.21.15.52:0/3111962035 shutdown_connections 2024-09-06T14:41:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 --2- 172.21.15.52:0/3111962035 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0100800 0x7f18a0100c60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 --2- 172.21.15.52:0/3111962035 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a0106800 0x7f18a0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 -- 172.21.15.52:0/3111962035 >> 172.21.15.52:0/3111962035 conn(0x7f18a00fc520 msgr2=0x7f18a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 -- 172.21.15.52:0/3111962035 shutdown_connections 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.077+0000 7f18a6bde640 1 -- 172.21.15.52:0/3111962035 wait complete. 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f18a6bde640 1 Processor -- start 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f18a6bde640 1 -- start start 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f18a6bde640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a0100800 0x7f18a019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f18a6bde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0106800 0x7f18a019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f18a6bde640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18a010edd0 con 0x7f18a0106800 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f18a6bde640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f18a010ec50 con 0x7f18a0100800 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f189ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0106800 0x7f18a019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f189ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0106800 0x7f18a019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34848/0 (socket says 172.21.15.52:34848) 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.078+0000 7f189ffff640 1 -- 172.21.15.52:0/2297901339 learned_addr learned my addr 172.21.15.52:0/2297901339 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f18a497a640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a0100800 0x7f18a019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f189ffff640 1 -- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a0100800 msgr2=0x7f18a019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f189ffff640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a0100800 0x7f18a019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f189ffff640 1 -- 172.21.15.52:0/2297901339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a01977a0 con 0x7f18a0106800 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f189ffff640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0106800 0x7f18a019db60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1888031460 tx=0x7f18880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f188803f070 con 0x7f18a0106800 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18880035f0 con 0x7f18a0106800 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a0197a30 con 0x7f18a0106800 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1888035030 con 0x7f18a0106800 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.079+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a0197f60 con 0x7f18a0106800 2024-09-06T14:41:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.080+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18a0198520 con 0x7f18a0106800 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.081+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f1888042070 con 0x7f18a0106800 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.081+0000 7f189dffb640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f188c06de30 0x7f188c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.081+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f18880ae210 con 0x7f18a0106800 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.081+0000 7f18a497a640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f188c06de30 0x7f188c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.081+0000 7f189dffb640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] conn(0x7f188c073c20 0x7f188c076040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.081+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 --> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18880054e0 con 0x7f188c073c20 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.081+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f18880b5050 con 0x7f18a0106800 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.082+0000 7f18a497a640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f188c06de30 0x7f188c0702f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1890005fd0 tx=0x7f1890005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.082+0000 7f18a517b640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] conn(0x7f188c073c20 0x7f188c076040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.082+0000 7f18a517b640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] conn(0x7f188c073c20 0x7f188c076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.083+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== osd.5 v2:172.21.15.165:6816/2430931177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18880054e0 con 0x7f188c073c20 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.096+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 --> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18a0062900 con 0x7f188c073c20 2024-09-06T14:41:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.097+0000 7f189dffb640 1 -- 172.21.15.52:0/2297901339 <== osd.5 v2:172.21.15.165:6816/2430931177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f18a0062900 con 0x7f188c073c20 2024-09-06T14:41:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.097+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] conn(0x7f188c073c20 msgr2=0x7f188c076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.097+0000 7f18a6bde640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] conn(0x7f188c073c20 0x7f188c076040 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f188c06de30 msgr2=0x7f188c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f188c06de30 0x7f188c0702f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1890005fd0 tx=0x7f1890005850 comp rx=0 tx=0).stop 2024-09-06T14:41:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0106800 msgr2=0x7f18a019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0106800 0x7f18a019db60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1888031460 tx=0x7f18880045e0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 shutdown_connections 2024-09-06T14:41:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f188c06de30 0x7f188c0702f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:6816/2430931177,v1:172.21.15.165:6817/2430931177] conn(0x7f188c073c20 0x7f188c076040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18a0106800 0x7f18a019db60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 --2- 172.21.15.52:0/2297901339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18a0100800 0x7f18a019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 >> 172.21.15.52:0/2297901339 conn(0x7f18a00fc520 msgr2=0x7f18a00fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 shutdown_connections 2024-09-06T14:41:20.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:20.098+0000 7f18a6bde640 1 -- 172.21.15.52:0/2297901339 wait complete. 2024-09-06T14:41:20.764 INFO:teuthology.orchestra.run.smithi052.stdout:167503724551 2024-09-06T14:41:20.764 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-06T14:41:21.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 -- 172.21.15.52:0/448462709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 msgr2=0x7f94cc10b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/448462709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc10b930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94c00098b0 tx=0x7f94c002a560 comp rx=0 tx=0).stop 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 -- 172.21.15.52:0/448462709 shutdown_connections 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/448462709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc10b930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/448462709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94cc102b20 0x7f94cc102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 -- 172.21.15.52:0/448462709 >> 172.21.15.52:0/448462709 conn(0x7f94cc0fc520 msgr2=0x7f94cc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 -- 172.21.15.52:0/448462709 shutdown_connections 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.055+0000 7f94d1d8c640 1 -- 172.21.15.52:0/448462709 wait complete. 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94d1d8c640 1 Processor -- start 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94d1d8c640 1 -- start start 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94d1d8c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94cc102b20 0x7f94cc19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:21.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94d1d8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc19dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94d1d8c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc10ee50 con 0x7f94cc103440 2024-09-06T14:41:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94d1d8c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc10ecd0 con 0x7f94cc102b20 2024-09-06T14:41:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc19dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc19dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59130/0 (socket says 172.21.15.52:59130) 2024-09-06T14:41:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.056+0000 7f94caffd640 1 -- 172.21.15.52:0/2465156431 learned_addr learned my addr 172.21.15.52:0/2465156431 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:21.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94cb7fe640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94cc102b20 0x7f94cc19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94caffd640 1 -- 172.21.15.52:0/2465156431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94cc102b20 msgr2=0x7f94cc19d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94caffd640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94cc102b20 0x7f94cc19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94caffd640 1 -- 172.21.15.52:0/2465156431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc197900 con 0x7f94cc103440 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94caffd640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc19dc80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94c0031460 tx=0x7f94c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94c003f070 con 0x7f94cc103440 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94c00044d0 con 0x7f94cc103440 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc197b90 con 0x7f94cc103440 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94c0035030 con 0x7f94cc103440 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.057+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc1980c0 con 0x7f94cc103440 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.058+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f94cc198600 con 0x7f94cc103440 2024-09-06T14:41:21.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.058+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f94c0042070 con 0x7f94cc103440 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94c8ff9640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f94b406de90 0x7f94b4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f94c00ae210 con 0x7f94cc103440 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94cb7fe640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f94b406de90 0x7f94b4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94c8ff9640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] conn(0x7f94b4073c80 0x7f94b40760a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 --> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94c00054e0 con 0x7f94b4073c80 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f94c00b5050 con 0x7f94cc103440 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94cbfff640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] conn(0x7f94b4073c80 0x7f94b40760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.059+0000 7f94cb7fe640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f94b406de90 0x7f94b4070350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94cc198a40 tx=0x7f94bc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.060+0000 7f94cbfff640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] conn(0x7f94b4073c80 0x7f94b40760a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:21.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.060+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== osd.2 v2:172.21.15.52:6818/4265125143 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94c00054e0 con 0x7f94b4073c80 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 --> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f94cc0628b0 con 0x7f94b4073c80 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94c8ff9640 1 -- 172.21.15.52:0/2465156431 <== osd.2 v2:172.21.15.52:6818/4265125143 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f94cc0628b0 con 0x7f94b4073c80 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] conn(0x7f94b4073c80 msgr2=0x7f94b40760a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] conn(0x7f94b4073c80 0x7f94b40760a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f94b406de90 msgr2=0x7f94b4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f94b406de90 0x7f94b4070350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f94cc198a40 tx=0x7f94bc008040 comp rx=0 tx=0).stop 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 msgr2=0x7f94cc19dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc19dc80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94c0031460 tx=0x7f94c00048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 shutdown_connections 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6818/4265125143,v1:172.21.15.52:6819/4265125143] conn(0x7f94b4073c80 0x7f94b40760a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f94b406de90 0x7f94b4070350 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94cc103440 0x7f94cc19dc80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 --2- 172.21.15.52:0/2465156431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94cc102b20 0x7f94cc19d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 >> 172.21.15.52:0/2465156431 conn(0x7f94cc0fc520 msgr2=0x7f94cc103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 shutdown_connections 2024-09-06T14:41:21.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:21.074+0000 7f94d1d8c640 1 -- 172.21.15.52:0/2465156431 wait complete. 2024-09-06T14:41:21.547 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:21.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:21 smithi052 ceph-mon[28627]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:21 smithi165 ceph-mon[36229]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:22.026 INFO:teuthology.orchestra.run.smithi052.stdout:38654705697 2024-09-06T14:41:22.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-06T14:41:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/804339328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 msgr2=0x7fd5f010dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/804339328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f010dc80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8009880 tx=0x7fd5d802a530 comp rx=0 tx=0).stop 2024-09-06T14:41:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/804339328 shutdown_connections 2024-09-06T14:41:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/804339328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f010dc80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/804339328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0074510 0x7fd5f00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/804339328 >> 172.21.15.52:0/804339328 conn(0x7fd5f00fd5e0 msgr2=0x7fd5f00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/804339328 shutdown_connections 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.489+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/804339328 wait complete. 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5f5bcd640 1 Processor -- start 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5f5bcd640 1 -- start start 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5f5bcd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0074510 0x7fd5f019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5f5bcd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5f5bcd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0111040 con 0x7fd5f0074e30 2024-09-06T14:41:22.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5f5bcd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f0110ec0 con 0x7fd5f0074510 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5eeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5eeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f019fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59154/0 (socket says 172.21.15.52:59154) 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.490+0000 7fd5eeffd640 1 -- 172.21.15.52:0/1189586936 learned_addr learned my addr 172.21.15.52:0/1189586936 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5ef7fe640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0074510 0x7fd5f019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5eeffd640 1 -- 172.21.15.52:0/1189586936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0074510 msgr2=0x7fd5f019f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5eeffd640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0074510 0x7fd5f019f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5eeffd640 1 -- 172.21.15.52:0/1189586936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f0199a90 con 0x7fd5f0074e30 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5eeffd640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f019fe10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8031460 tx=0x7fd5d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5ecff9640 1 -- 172.21.15.52:0/1189586936 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5d803f070 con 0x7fd5f0074e30 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5ecff9640 1 -- 172.21.15.52:0/1189586936 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5d8004cf0 con 0x7fd5f0074e30 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f0199d20 con 0x7fd5f0074e30 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5ecff9640 1 -- 172.21.15.52:0/1189586936 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5d8035030 con 0x7fd5f0074e30 2024-09-06T14:41:22.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.491+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f019a250 con 0x7fd5f0074e30 2024-09-06T14:41:22.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.492+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f0075c50 con 0x7fd5f0074e30 2024-09-06T14:41:22.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.492+0000 7fd5ecff9640 1 -- 172.21.15.52:0/1189586936 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fd5d8042070 con 0x7fd5f0074e30 2024-09-06T14:41:22.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.493+0000 7fd5ecff9640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd5dc06de30 0x7fd5dc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:22.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.493+0000 7fd5ecff9640 1 -- 172.21.15.52:0/1189586936 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fd5d80ae330 con 0x7fd5f0074e30 2024-09-06T14:41:22.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.493+0000 7fd5ef7fe640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd5dc06de30 0x7fd5dc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:22.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.493+0000 7fd5ef7fe640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd5dc06de30 0x7fd5dc0702f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5f019abd0 tx=0x7fd5e00094f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:22.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.497+0000 7fd5ecff9640 1 -- 172.21.15.52:0/1189586936 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5d807c210 con 0x7fd5f0074e30 2024-09-06T14:41:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.674+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd5f0108370 con 0x7fd5f0074e30 2024-09-06T14:41:22.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.675+0000 7fd5ecff9640 1 -- 172.21.15.52:0/1189586936 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd5d80ae150 con 0x7fd5f0074e30 2024-09-06T14:41:22.673 INFO:teuthology.orchestra.run.smithi052.stdout:115964117010 2024-09-06T14:41:22.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd5dc06de30 msgr2=0x7fd5dc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd5dc06de30 0x7fd5dc0702f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd5f019abd0 tx=0x7fd5e00094f0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 msgr2=0x7fd5f019fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f019fe10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8031460 tx=0x7fd5d80048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 shutdown_connections 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd5dc06de30 0x7fd5dc0702f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5f0074e30 0x7fd5f019fe10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 --2- 172.21.15.52:0/1189586936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5f0074510 0x7fd5f019f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 >> 172.21.15.52:0/1189586936 conn(0x7fd5f00fd5e0 msgr2=0x7fd5f010b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 shutdown_connections 2024-09-06T14:41:22.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:22.677+0000 7fd5f5bcd640 1 -- 172.21.15.52:0/1189586936 wait complete. 2024-09-06T14:41:22.956 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:22.958 INFO:teuthology.orchestra.run.smithi052.stdout:60129542172 2024-09-06T14:41:22.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-06T14:41:23.487 INFO:teuthology.orchestra.run.smithi052.stdout:81604378645 2024-09-06T14:41:23.488 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-06T14:41:23.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:23 smithi052 ceph-mon[28627]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:23.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:23 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1189586936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-06T14:41:23.625 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:23 smithi165 ceph-mon[36229]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:23.625 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:23 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1189586936' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-06T14:41:24.069 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117009 got 115964117010 for osd.3 2024-09-06T14:41:24.069 DEBUG:teuthology.parallel:result is None 2024-09-06T14:41:24.091 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:24.092 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:24.135 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:24.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.635+0000 7f58283a7640 1 -- 172.21.15.52:0/497227056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820107900 msgr2=0x7f5820107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:24.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.635+0000 7f58283a7640 1 --2- 172.21.15.52:0/497227056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820107900 0x7f5820107ce0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f581c009c20 tx=0x7f581c02a970 comp rx=0 tx=0).stop 2024-09-06T14:41:24.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 -- 172.21.15.52:0/497227056 shutdown_connections 2024-09-06T14:41:24.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 --2- 172.21.15.52:0/497227056 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5820101900 0x7f5820101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:24.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 --2- 172.21.15.52:0/497227056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820107900 0x7f5820107ce0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 -- 172.21.15.52:0/497227056 >> 172.21.15.52:0/497227056 conn(0x7f58200fd5e0 msgr2=0x7f58200ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 -- 172.21.15.52:0/497227056 shutdown_connections 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 -- 172.21.15.52:0/497227056 wait complete. 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 Processor -- start 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 -- start start 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820101900 0x7f582019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5820107900 0x7f582019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f582010edd0 con 0x7f5820101900 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.636+0000 7f58283a7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f582010ec50 con 0x7f5820107900 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5826143640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820101900 0x7f582019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5826143640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820101900 0x7f582019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59170/0 (socket says 172.21.15.52:59170) 2024-09-06T14:41:24.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5826143640 1 -- 172.21.15.52:0/209084398 learned_addr learned my addr 172.21.15.52:0/209084398 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5825942640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5820107900 0x7f582019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5826143640 1 -- 172.21.15.52:0/209084398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5820107900 msgr2=0x7f582019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5826143640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5820107900 0x7f582019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5826143640 1 -- 172.21.15.52:0/209084398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58201977c0 con 0x7f5820101900 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f5826143640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820101900 0x7f582019d640 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f581c02ae90 tx=0x7f581c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f58177fe640 1 -- 172.21.15.52:0/209084398 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f581c047070 con 0x7f5820101900 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f58177fe640 1 -- 172.21.15.52:0/209084398 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f581c02f7e0 con 0x7f5820101900 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5820197a50 con 0x7f5820101900 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f58177fe640 1 -- 172.21.15.52:0/209084398 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f581c034070 con 0x7f5820101900 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.637+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5820197f80 con 0x7f5820101900 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.638+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5820103040 con 0x7f5820101900 2024-09-06T14:41:24.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.639+0000 7f58177fe640 1 -- 172.21.15.52:0/209084398 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f581c04a070 con 0x7f5820101900 2024-09-06T14:41:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.639+0000 7f58177fe640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f580c06de30 0x7f580c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.639+0000 7f58177fe640 1 -- 172.21.15.52:0/209084398 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f581c0ae600 con 0x7f5820101900 2024-09-06T14:41:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.639+0000 7f5825942640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f580c06de30 0x7f580c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.640+0000 7f5825942640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f580c06de30 0x7f580c0702f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58200ffc60 tx=0x7f581000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:24.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.644+0000 7f58177fe640 1 -- 172.21.15.52:0/209084398 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f581c03f070 con 0x7f5820101900 2024-09-06T14:41:24.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.821+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5820109e70 con 0x7f5820101900 2024-09-06T14:41:24.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.821+0000 7f58177fe640 1 -- 172.21.15.52:0/209084398 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f581c0802b0 con 0x7f5820101900 2024-09-06T14:41:24.819 INFO:teuthology.orchestra.run.smithi052.stdout:167503724552 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f580c06de30 msgr2=0x7f580c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f580c06de30 0x7f580c0702f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58200ffc60 tx=0x7f581000b390 comp rx=0 tx=0).stop 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820101900 msgr2=0x7f582019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820101900 0x7f582019d640 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f581c02ae90 tx=0x7f581c02f5f0 comp rx=0 tx=0).stop 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 shutdown_connections 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f580c06de30 0x7f580c0702f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5820107900 0x7f582019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:24.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 --2- 172.21.15.52:0/209084398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5820101900 0x7f582019d640 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 >> 172.21.15.52:0/209084398 conn(0x7f58200fd5e0 msgr2=0x7f58200fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 shutdown_connections 2024-09-06T14:41:24.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:24.823+0000 7f58283a7640 1 -- 172.21.15.52:0/209084398 wait complete. 2024-09-06T14:41:25.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.375+0000 7fd8776a2640 1 -- 172.21.15.52:0/1026990248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870101900 msgr2=0x7fd870101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.375+0000 7fd8776a2640 1 --2- 172.21.15.52:0/1026990248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870101900 0x7fd870101d60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd864009880 tx=0x7fd86402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.375+0000 7fd8776a2640 1 -- 172.21.15.52:0/1026990248 shutdown_connections 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.375+0000 7fd8776a2640 1 --2- 172.21.15.52:0/1026990248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870101900 0x7fd870101d60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.375+0000 7fd8776a2640 1 --2- 172.21.15.52:0/1026990248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd870107900 0x7fd870107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.375+0000 7fd8776a2640 1 -- 172.21.15.52:0/1026990248 >> 172.21.15.52:0/1026990248 conn(0x7fd8700fd600 msgr2=0x7fd8700ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.375+0000 7fd8776a2640 1 -- 172.21.15.52:0/1026990248 shutdown_connections 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.376+0000 7fd8776a2640 1 -- 172.21.15.52:0/1026990248 wait complete. 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.376+0000 7fd8776a2640 1 Processor -- start 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.376+0000 7fd8776a2640 1 -- start start 2024-09-06T14:41:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd8776a2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd870101900 0x7fd87019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd8776a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870107900 0x7fd87019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd8776a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd87010edb0 con 0x7fd870107900 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd8776a2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd87010ec30 con 0x7fd870101900 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd874c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870107900 0x7fd87019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd874c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870107900 0x7fd87019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59180/0 (socket says 172.21.15.52:59180) 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd874c3d640 1 -- 172.21.15.52:0/611367090 learned_addr learned my addr 172.21.15.52:0/611367090 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd87543e640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd870101900 0x7fd87019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd874c3d640 1 -- 172.21.15.52:0/611367090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd870101900 msgr2=0x7fd87019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd874c3d640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd870101900 0x7fd87019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd874c3d640 1 -- 172.21.15.52:0/611367090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8701977d0 con 0x7fd870107900 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd874c3d640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870107900 0x7fd87019db90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd864031460 tx=0x7fd8640045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd86e7fc640 1 -- 172.21.15.52:0/611367090 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd86403f070 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd86e7fc640 1 -- 172.21.15.52:0/611367090 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd864004b10 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd870197a60 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.377+0000 7fd86e7fc640 1 -- 172.21.15.52:0/611367090 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd864035030 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.378+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd870197f90 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.379+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd870103040 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.379+0000 7fd86e7fc640 1 -- 172.21.15.52:0/611367090 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fd864042070 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.379+0000 7fd86e7fc640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd85806de80 0x7fd858070340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.379+0000 7fd87543e640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd85806de80 0x7fd858070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.379+0000 7fd86e7fc640 1 -- 172.21.15.52:0/611367090 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fd8640ae220 con 0x7fd870107900 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.380+0000 7fd87543e640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd85806de80 0x7fd858070340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd860005fd0 tx=0x7fd860009680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:25.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.384+0000 7fd86e7fc640 1 -- 172.21.15.52:0/611367090 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd86407fe30 con 0x7fd870107900 2024-09-06T14:41:25.486 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:25 smithi052 ceph-mon[28627]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:25.486 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:25 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/209084398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-06T14:41:25.486 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:25.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.561+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd870109e90 con 0x7fd870107900 2024-09-06T14:41:25.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.561+0000 7fd86e7fc640 1 -- 172.21.15.52:0/611367090 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd864084660 con 0x7fd870107900 2024-09-06T14:41:25.559 INFO:teuthology.orchestra.run.smithi052.stdout:38654705698 2024-09-06T14:41:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.563+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd85806de80 msgr2=0x7fd858070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.563+0000 7fd8776a2640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd85806de80 0x7fd858070340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd860005fd0 tx=0x7fd860009680 comp rx=0 tx=0).stop 2024-09-06T14:41:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.563+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870107900 msgr2=0x7fd87019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.563+0000 7fd8776a2640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870107900 0x7fd87019db90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd864031460 tx=0x7fd8640045e0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.564+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 shutdown_connections 2024-09-06T14:41:25.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.564+0000 7fd8776a2640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd85806de80 0x7fd858070340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.564+0000 7fd8776a2640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd870107900 0x7fd87019db90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.564+0000 7fd8776a2640 1 --2- 172.21.15.52:0/611367090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd870101900 0x7fd87019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.564+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 >> 172.21.15.52:0/611367090 conn(0x7fd8700fd600 msgr2=0x7fd8700fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.564+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 shutdown_connections 2024-09-06T14:41:25.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.564+0000 7fd8776a2640 1 -- 172.21.15.52:0/611367090 wait complete. 2024-09-06T14:41:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:25 smithi165 ceph-mon[36229]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:25 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/209084398' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-06T14:41:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:25.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.570+0000 7faa42ad9640 1 -- 172.21.15.52:0/1023875161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 msgr2=0x7faa3c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.570+0000 7faa42ad9640 1 --2- 172.21.15.52:0/1023875161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c106bd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faa30009880 tx=0x7faa3002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 -- 172.21.15.52:0/1023875161 shutdown_connections 2024-09-06T14:41:25.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 --2- 172.21.15.52:0/1023875161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa3c1007f0 0x7faa3c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 --2- 172.21.15.52:0/1023875161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c106bd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 -- 172.21.15.52:0/1023875161 >> 172.21.15.52:0/1023875161 conn(0x7faa3c0fc550 msgr2=0x7faa3c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:25.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 -- 172.21.15.52:0/1023875161 shutdown_connections 2024-09-06T14:41:25.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 -- 172.21.15.52:0/1023875161 wait complete. 2024-09-06T14:41:25.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 Processor -- start 2024-09-06T14:41:25.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 -- start start 2024-09-06T14:41:25.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa3c1007f0 0x7faa3c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:25.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:25.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10dcc0 con 0x7faa3c1067f0 2024-09-06T14:41:25.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.571+0000 7faa42ad9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c10db40 con 0x7faa3c1007f0 2024-09-06T14:41:25.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa3bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:25.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa40875640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa3c1007f0 0x7faa3c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:25.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa3bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c19fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59202/0 (socket says 172.21.15.52:59202) 2024-09-06T14:41:25.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa3bfff640 1 -- 172.21.15.52:0/2869944411 learned_addr learned my addr 172.21.15.52:0/2869944411 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:25.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa3bfff640 1 -- 172.21.15.52:0/2869944411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa3c1007f0 msgr2=0x7faa3c19f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa3bfff640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa3c1007f0 0x7faa3c19f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa3bfff640 1 -- 172.21.15.52:0/2869944411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c1999d0 con 0x7faa3c1067f0 2024-09-06T14:41:25.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa3bfff640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c19fd50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa2800e970 tx=0x7faa2800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:25.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa39ffb640 1 -- 172.21.15.52:0/2869944411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa2800cac0 con 0x7faa3c1067f0 2024-09-06T14:41:25.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa39ffb640 1 -- 172.21.15.52:0/2869944411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa280054e0 con 0x7faa3c1067f0 2024-09-06T14:41:25.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c199cc0 con 0x7faa3c1067f0 2024-09-06T14:41:25.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.572+0000 7faa39ffb640 1 -- 172.21.15.52:0/2869944411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa28010430 con 0x7faa3c1067f0 2024-09-06T14:41:25.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.573+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c19a250 con 0x7faa3c1067f0 2024-09-06T14:41:25.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.574+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c101f30 con 0x7faa3c1067f0 2024-09-06T14:41:25.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.574+0000 7faa39ffb640 1 -- 172.21.15.52:0/2869944411 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7faa28004f00 con 0x7faa3c1067f0 2024-09-06T14:41:25.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.575+0000 7faa39ffb640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faa2c06de90 0x7faa2c070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:25.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.575+0000 7faa39ffb640 1 -- 172.21.15.52:0/2869944411 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7faa2808dd90 con 0x7faa3c1067f0 2024-09-06T14:41:25.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.575+0000 7faa40875640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faa2c06de90 0x7faa2c070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:25.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.575+0000 7faa40875640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faa2c06de90 0x7faa2c070350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa30000c00 tx=0x7faa30031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:25.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.579+0000 7faa39ffb640 1 -- 172.21.15.52:0/2869944411 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa2805bcf0 con 0x7faa3c1067f0 2024-09-06T14:41:25.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.766+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faa3c19a560 con 0x7faa3c1067f0 2024-09-06T14:41:25.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.766+0000 7faa39ffb640 1 -- 172.21.15.52:0/2869944411 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa2805f9a0 con 0x7faa3c1067f0 2024-09-06T14:41:25.765 INFO:teuthology.orchestra.run.smithi052.stdout:81604378646 2024-09-06T14:41:25.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faa2c06de90 msgr2=0x7faa2c070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faa2c06de90 0x7faa2c070350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa30000c00 tx=0x7faa30031400 comp rx=0 tx=0).stop 2024-09-06T14:41:25.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 msgr2=0x7faa3c19fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:25.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c19fd50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa2800e970 tx=0x7faa2800ed70 comp rx=0 tx=0).stop 2024-09-06T14:41:25.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 shutdown_connections 2024-09-06T14:41:25.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faa2c06de90 0x7faa2c070350 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faa3c1067f0 0x7faa3c19fd50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 --2- 172.21.15.52:0/2869944411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faa3c1007f0 0x7faa3c19f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:25.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 >> 172.21.15.52:0/2869944411 conn(0x7faa3c0fc550 msgr2=0x7faa3c0fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:25.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 shutdown_connections 2024-09-06T14:41:25.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:25.768+0000 7faa42ad9640 1 -- 172.21.15.52:0/2869944411 wait complete. 2024-09-06T14:41:26.472 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724551 got 167503724552 for osd.5 2024-09-06T14:41:26.472 DEBUG:teuthology.parallel:result is None 2024-09-06T14:41:26.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:26 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/611367090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-06T14:41:26.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:26 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2869944411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-06T14:41:26.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:26 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/611367090' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-06T14:41:26.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:26 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2869944411' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-06T14:41:27.609 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:27 smithi052 ceph-mon[28627]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:27.611 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378645 got 81604378646 for osd.2 2024-09-06T14:41:27.612 DEBUG:teuthology.parallel:result is None 2024-09-06T14:41:27.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:27 smithi165 ceph-mon[36229]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:27.986 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705698 for osd.0 2024-09-06T14:41:27.986 DEBUG:teuthology.parallel:result is None 2024-09-06T14:41:28.118 INFO:teuthology.orchestra.run.smithi052.stdout:146028888078 2024-09-06T14:41:28.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 -- 172.21.15.52:0/3526872201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa498102ab0 msgr2=0x7fa498102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 --2- 172.21.15.52:0/3526872201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa498102ab0 0x7fa498102e90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009880 tx=0x7fa48c02a530 comp rx=0 tx=0).stop 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 -- 172.21.15.52:0/3526872201 shutdown_connections 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 --2- 172.21.15.52:0/3526872201 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4981033d0 0x7fa49810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 --2- 172.21.15.52:0/3526872201 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa498102ab0 0x7fa498102e90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 -- 172.21.15.52:0/3526872201 >> 172.21.15.52:0/3526872201 conn(0x7fa4980fc550 msgr2=0x7fa4980fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 -- 172.21.15.52:0/3526872201 shutdown_connections 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 -- 172.21.15.52:0/3526872201 wait complete. 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.184+0000 7fa49fd25640 1 Processor -- start 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49fd25640 1 -- start start 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49fd25640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa498102ab0 0x7fa498100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:28.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49fd25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4981033d0 0x7fa498100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49fd25640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810ee40 con 0x7fa4981033d0 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49fd25640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810ecc0 con 0x7fa498102ab0 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49d2c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4981033d0 0x7fa498100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49d2c0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4981033d0 0x7fa498100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59226/0 (socket says 172.21.15.52:59226) 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49d2c0640 1 -- 172.21.15.52:0/571446140 learned_addr learned my addr 172.21.15.52:0/571446140 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49dac1640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa498102ab0 0x7fa498100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49d2c0640 1 -- 172.21.15.52:0/571446140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa498102ab0 msgr2=0x7fa498100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49d2c0640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa498102ab0 0x7fa498100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49d2c0640 1 -- 172.21.15.52:0/571446140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa498101190 con 0x7fa4981033d0 2024-09-06T14:41:28.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa49d2c0640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4981033d0 0x7fa498100c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa49400b370 tx=0x7fa49400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.185+0000 7fa48affd640 1 -- 172.21.15.52:0/571446140 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa494015020 con 0x7fa4981033d0 2024-09-06T14:41:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.186+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa498101480 con 0x7fa4981033d0 2024-09-06T14:41:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.186+0000 7fa48affd640 1 -- 172.21.15.52:0/571446140 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa494011af0 con 0x7fa4981033d0 2024-09-06T14:41:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.186+0000 7fa48affd640 1 -- 172.21.15.52:0/571446140 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa494010d60 con 0x7fa4981033d0 2024-09-06T14:41:28.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.186+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4981a3e90 con 0x7fa4981033d0 2024-09-06T14:41:28.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.187+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49806a580 con 0x7fa4981033d0 2024-09-06T14:41:28.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.187+0000 7fa48affd640 1 -- 172.21.15.52:0/571446140 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fa494018020 con 0x7fa4981033d0 2024-09-06T14:41:28.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.188+0000 7fa48affd640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa48406de30 0x7fa4840702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:28.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.188+0000 7fa48affd640 1 -- 172.21.15.52:0/571446140 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fa49408d2b0 con 0x7fa4981033d0 2024-09-06T14:41:28.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.188+0000 7fa49dac1640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa48406de30 0x7fa4840702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:28.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.188+0000 7fa49dac1640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa48406de30 0x7fa4840702f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0096c0 tx=0x7fa48c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:28.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.192+0000 7fa48affd640 1 -- 172.21.15.52:0/571446140 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa49401f020 con 0x7fa4981033d0 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.371+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa498102e90 con 0x7fa4981033d0 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.372+0000 7fa48affd640 1 -- 172.21.15.52:0/571446140 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa498102e90 con 0x7fa4981033d0 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.373+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa48406de30 msgr2=0x7fa4840702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa48406de30 0x7fa4840702f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0096c0 tx=0x7fa48c031400 comp rx=0 tx=0).stop 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4981033d0 msgr2=0x7fa498100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4981033d0 0x7fa498100c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa49400b370 tx=0x7fa49400b830 comp rx=0 tx=0).stop 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 shutdown_connections 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fa48406de30 0x7fa4840702f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4981033d0 0x7fa498100c50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 --2- 172.21.15.52:0/571446140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa498102ab0 0x7fa498100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:28.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 >> 172.21.15.52:0/571446140 conn(0x7fa4980fc550 msgr2=0x7fa498108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 shutdown_connections 2024-09-06T14:41:28.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:27.374+0000 7fa49fd25640 1 -- 172.21.15.52:0/571446140 wait complete. 2024-09-06T14:41:28.291 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:28.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:28 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/571446140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-06T14:41:28.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:28 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/571446140' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-06T14:41:28.985 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888076 got 146028888078 for osd.4 2024-09-06T14:41:28.986 DEBUG:teuthology.parallel:result is None 2024-09-06T14:41:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.186+0000 7fb4f3c74640 1 -- 172.21.15.52:0/1744904439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec100800 msgr2=0x7fb4ec100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.186+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/1744904439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec100800 0x7fb4ec100c60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009880 tx=0x7fb4dc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 -- 172.21.15.52:0/1744904439 shutdown_connections 2024-09-06T14:41:29.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/1744904439 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec100800 0x7fb4ec100c60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/1744904439 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec106800 0x7fb4ec106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 -- 172.21.15.52:0/1744904439 >> 172.21.15.52:0/1744904439 conn(0x7fb4ec0fc520 msgr2=0x7fb4ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 -- 172.21.15.52:0/1744904439 shutdown_connections 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 -- 172.21.15.52:0/1744904439 wait complete. 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 Processor -- start 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 -- start start 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec100800 0x7fb4ec0fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec106800 0x7fb4ec0fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec10dcd0 con 0x7fb4ec106800 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.187+0000 7fb4f3c74640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec10db50 con 0x7fb4ec100800 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f120f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec106800 0x7fb4ec0fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f120f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec106800 0x7fb4ec0fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59252/0 (socket says 172.21.15.52:59252) 2024-09-06T14:41:29.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f120f640 1 -- 172.21.15.52:0/3357210024 learned_addr learned my addr 172.21.15.52:0/3357210024 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f1a10640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec100800 0x7fb4ec0fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f120f640 1 -- 172.21.15.52:0/3357210024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec100800 msgr2=0x7fb4ec0fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f120f640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec100800 0x7fb4ec0fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f120f640 1 -- 172.21.15.52:0/3357210024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec0fd690 con 0x7fb4ec106800 2024-09-06T14:41:29.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f120f640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec106800 0x7fb4ec0fd150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc031460 tx=0x7fb4dc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:29.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4e2ffd640 1 -- 172.21.15.52:0/3357210024 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4dc03f070 con 0x7fb4ec106800 2024-09-06T14:41:29.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4ec0fd920 con 0x7fb4ec106800 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4e2ffd640 1 -- 172.21.15.52:0/3357210024 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4dc004cf0 con 0x7fb4ec106800 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4e2ffd640 1 -- 172.21.15.52:0/3357210024 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4dc035030 con 0x7fb4ec106800 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.188+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4ec1a3d50 con 0x7fb4ec106800 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.189+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4ec101f40 con 0x7fb4ec106800 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.190+0000 7fb4e2ffd640 1 -- 172.21.15.52:0/3357210024 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fb4dc042070 con 0x7fb4ec106800 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.190+0000 7fb4e2ffd640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb4d806de30 0x7fb4d80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.190+0000 7fb4e2ffd640 1 -- 172.21.15.52:0/3357210024 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fb4dc0ae210 con 0x7fb4ec106800 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.190+0000 7fb4f1a10640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb4d806de30 0x7fb4d80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:29.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.191+0000 7fb4f1a10640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb4d806de30 0x7fb4d80702f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80058c0 tx=0x7fb4e800a250 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:29.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.195+0000 7fb4e2ffd640 1 -- 172.21.15.52:0/3357210024 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4dc07fda0 con 0x7fb4ec106800 2024-09-06T14:41:29.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.374+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb4ec109d80 con 0x7fb4ec106800 2024-09-06T14:41:29.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.374+0000 7fb4e2ffd640 1 -- 172.21.15.52:0/3357210024 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb4dc0845d0 con 0x7fb4ec106800 2024-09-06T14:41:29.372 INFO:teuthology.orchestra.run.smithi052.stdout:60129542174 2024-09-06T14:41:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb4d806de30 msgr2=0x7fb4d80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb4d806de30 0x7fb4d80702f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80058c0 tx=0x7fb4e800a250 comp rx=0 tx=0).stop 2024-09-06T14:41:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec106800 msgr2=0x7fb4ec0fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec106800 0x7fb4ec0fd150 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc031460 tx=0x7fb4dc0048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 shutdown_connections 2024-09-06T14:41:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb4d806de30 0x7fb4d80702f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb4ec106800 0x7fb4ec0fd150 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 --2- 172.21.15.52:0/3357210024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb4ec100800 0x7fb4ec0fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:29.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.376+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 >> 172.21.15.52:0/3357210024 conn(0x7fb4ec0fc520 msgr2=0x7fb4ec06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:29.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.377+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 shutdown_connections 2024-09-06T14:41:29.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:29.377+0000 7fb4f3c74640 1 -- 172.21.15.52:0/3357210024 wait complete. 2024-09-06T14:41:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:29 smithi052 ceph-mon[28627]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:29 smithi165 ceph-mon[36229]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:29.960 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542174 for osd.1 2024-09-06T14:41:29.960 DEBUG:teuthology.parallel:result is None 2024-09-06T14:41:29.960 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-06T14:41:29.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph pg dump --format=json 2024-09-06T14:41:30.214 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:30.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:30 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3357210024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-06T14:41:30.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:30 smithi165 ceph-mon[36229]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:30.594 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:30 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3357210024' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-06T14:41:30.594 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:30 smithi052 ceph-mon[28627]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:30.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 -- 172.21.15.52:0/1928562685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 msgr2=0x7f5aa4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:30.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1928562685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa4100c60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009880 tx=0x7f5a8c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:30.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 -- 172.21.15.52:0/1928562685 shutdown_connections 2024-09-06T14:41:30.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1928562685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa4100c60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:30.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1928562685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aa4106800 0x7f5aa4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:30.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 -- 172.21.15.52:0/1928562685 >> 172.21.15.52:0/1928562685 conn(0x7f5aa40fc520 msgr2=0x7f5aa40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 -- 172.21.15.52:0/1928562685 shutdown_connections 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 -- 172.21.15.52:0/1928562685 wait complete. 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.677+0000 7f5aa927b640 1 Processor -- start 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa927b640 1 -- start start 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa927b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa927b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aa4106800 0x7f5aa419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa927b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa410dd30 con 0x7f5aa4100800 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa927b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa410dbb0 con 0x7f5aa4106800 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa419f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58988/0 (socket says 172.21.15.52:58988) 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa2ffd640 1 -- 172.21.15.52:0/1467818227 learned_addr learned my addr 172.21.15.52:0/1467818227 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa27fc640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aa4106800 0x7f5aa419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:30.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa2ffd640 1 -- 172.21.15.52:0/1467818227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aa4106800 msgr2=0x7f5aa419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa2ffd640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aa4106800 0x7f5aa419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa2ffd640 1 -- 172.21.15.52:0/1467818227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa4199aa0 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa27fc640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aa4106800 0x7f5aa419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.678+0000 7f5aa2ffd640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa419f8e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400ba50 tx=0x7f5a9400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.679+0000 7f5a9bfff640 1 -- 172.21.15.52:0/1467818227 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a94019070 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.679+0000 7f5a9bfff640 1 -- 172.21.15.52:0/1467818227 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a9400ce20 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.679+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa4199d90 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.679+0000 7f5a9bfff640 1 -- 172.21.15.52:0/1467818227 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a940075a0 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.679+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aa419a2f0 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.680+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa4101f40 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.680+0000 7f5a9bfff640 1 -- 172.21.15.52:0/1467818227 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f5a9401c070 con 0x7f5aa4100800 2024-09-06T14:41:30.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.681+0000 7f5a9bfff640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5a9006de30 0x7f5a900702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:30.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.681+0000 7f5aa27fc640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5a9006de30 0x7f5a900702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:30.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.681+0000 7f5a9bfff640 1 -- 172.21.15.52:0/1467818227 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f5a9408d230 con 0x7f5aa4100800 2024-09-06T14:41:30.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.681+0000 7f5aa27fc640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5a9006de30 0x7f5a900702f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5aa419b290 tx=0x7f5a8c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:30.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.685+0000 7f5a9bfff640 1 -- 172.21.15.52:0/1467818227 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5a9405b110 con 0x7f5aa4100800 2024-09-06T14:41:30.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.857+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5aa419b070 con 0x7f5a9006de30 2024-09-06T14:41:30.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.858+0000 7f5a9bfff640 1 -- 172.21.15.52:0/1467818227 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f5aa419b070 con 0x7f5a9006de30 2024-09-06T14:41:30.856 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:30.856 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-06T14:41:30.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5a9006de30 msgr2=0x7f5a900702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:30.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5a9006de30 0x7f5a900702f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5aa419b290 tx=0x7f5a8c031400 comp rx=0 tx=0).stop 2024-09-06T14:41:30.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 msgr2=0x7f5aa419f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:30.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa419f8e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400ba50 tx=0x7f5a9400bf10 comp rx=0 tx=0).stop 2024-09-06T14:41:30.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 shutdown_connections 2024-09-06T14:41:30.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5a9006de30 0x7f5a900702f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:30.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aa4106800 0x7f5aa419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:30.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 --2- 172.21.15.52:0/1467818227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aa4100800 0x7f5aa419f8e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:30.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 >> 172.21.15.52:0/1467818227 conn(0x7f5aa40fc520 msgr2=0x7f5aa406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:30.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 shutdown_connections 2024-09-06T14:41:30.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:30.860+0000 7f5aa927b640 1 -- 172.21.15.52:0/1467818227 wait complete. 2024-09-06T14:41:31.589 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:31 smithi052 ceph-mon[28627]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T14:41:31.657 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-06T14:41:30.291716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":195184,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":562275728,"statfs":{"total":575970213888,"available":575770345472,"internally_reserved":0,"allocated":3969024,"data_stored":2608182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":195746465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002206"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-06T14:41:01.021997+0000","last_change":"2024-09-06T14:40:33.476632+0000","last_active":"2024-09-06T14:41:01.021997+0000","last_peered":"2024-09-06T14:41:01.021997+0000","last_clean":"2024-09-06T14:41:01.021997+0000","last_became_active":"2024-09-06T14:40:33.476293+0000","last_became_peered":"2024-09-06T14:40:33.476293+0000","last_unstale":"2024-09-06T14:41:01.021997+0000","last_undegraded":"2024-09-06T14:41:01.021997+0000","last_fullsized":"2024-09-06T14:41:01.021997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T14:39:45.326378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T14:39:45.326378+0000","last_clean_scrub_stamp":"2024-09-06T14:39:45.326378+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:15:32.225721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31548,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713604,"statfs":{"total":95995035648,"available":95962730496,"internally_reserved":0,"allocated":364544,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117012,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":729881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93705280,"statfs":{"total":95995035648,"available":95954206720,"internally_reserved":0,"allocated":364544,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":958464,"data_stored":729881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":729881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-06T14:41:31.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph pg dump --format=json 2024-09-06T14:41:31.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:31 smithi165 ceph-mon[36229]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T14:41:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 -- 172.21.15.52:0/4116545511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c1033d0 msgr2=0x7f5c4c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 --2- 172.21.15.52:0/4116545511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c1033d0 0x7f5c4c10b8c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009880 tx=0x7f5c3402a530 comp rx=0 tx=0).stop 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 -- 172.21.15.52:0/4116545511 shutdown_connections 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 --2- 172.21.15.52:0/4116545511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c1033d0 0x7f5c4c10b8c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 --2- 172.21.15.52:0/4116545511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c4c102ab0 0x7f5c4c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 -- 172.21.15.52:0/4116545511 >> 172.21.15.52:0/4116545511 conn(0x7f5c4c0fc550 msgr2=0x7f5c4c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 -- 172.21.15.52:0/4116545511 shutdown_connections 2024-09-06T14:41:32.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.377+0000 7f5c50901640 1 -- 172.21.15.52:0/4116545511 wait complete. 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c50901640 1 Processor -- start 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c50901640 1 -- start start 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c50901640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c102ab0 0x7f5c4c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c50901640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c4c1033d0 0x7f5c4c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c50901640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10edc0 con 0x7f5c4c102ab0 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c50901640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c10ec40 con 0x7f5c4c1033d0 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c4a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c102ab0 0x7f5c4c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c4a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c102ab0 0x7f5c4c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59002/0 (socket says 172.21.15.52:59002) 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c4a59c640 1 -- 172.21.15.52:0/1414036501 learned_addr learned my addr 172.21.15.52:0/1414036501 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.378+0000 7f5c41d9b640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c4c1033d0 0x7f5c4c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c4a59c640 1 -- 172.21.15.52:0/1414036501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c4c1033d0 msgr2=0x7f5c4c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:32.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c4a59c640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c4c1033d0 0x7f5c4c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c4a59c640 1 -- 172.21.15.52:0/1414036501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c101190 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c41d9b640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c4c1033d0 0x7f5c4c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c4a59c640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c102ab0 0x7f5c4c100710 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00cc60 tx=0x7f5c3c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c43fff640 1 -- 172.21.15.52:0/1414036501 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c3c00ad30 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c43fff640 1 -- 172.21.15.52:0/1414036501 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c3c005020 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c101480 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c43fff640 1 -- 172.21.15.52:0/1414036501 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c3c00f660 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.379+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1a3e10 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.380+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c4c06a580 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.380+0000 7f5c43fff640 1 -- 172.21.15.52:0/1414036501 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f5c3c0051d0 con 0x7f5c4c102ab0 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.381+0000 7f5c43fff640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5c3806de30 0x7f5c380702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:32.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.381+0000 7f5c43fff640 1 -- 172.21.15.52:0/1414036501 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f5c3c08de40 con 0x7f5c4c102ab0 2024-09-06T14:41:32.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.381+0000 7f5c41d9b640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5c3806de30 0x7f5c380702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:32.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.381+0000 7f5c41d9b640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5c3806de30 0x7f5c380702f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c1021a0 tx=0x7f5c34009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:32.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.385+0000 7f5c43fff640 1 -- 172.21.15.52:0/1414036501 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c3c014030 con 0x7f5c4c102ab0 2024-09-06T14:41:32.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.556+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c4c10b5c0 con 0x7f5c3806de30 2024-09-06T14:41:32.555 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:32 smithi052 ceph-mon[28627]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:32.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.557+0000 7f5c43fff640 1 -- 172.21.15.52:0/1414036501 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f5c4c10b5c0 con 0x7f5c3806de30 2024-09-06T14:41:32.555 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:32.556 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5c3806de30 msgr2=0x7f5c380702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5c3806de30 0x7f5c380702f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c1021a0 tx=0x7f5c34009560 comp rx=0 tx=0).stop 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c102ab0 msgr2=0x7f5c4c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c102ab0 0x7f5c4c100710 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00cc60 tx=0x7f5c3c00a620 comp rx=0 tx=0).stop 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 shutdown_connections 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5c3806de30 0x7f5c380702f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5c4c1033d0 0x7f5c4c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 --2- 172.21.15.52:0/1414036501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5c4c102ab0 0x7f5c4c100710 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 >> 172.21.15.52:0/1414036501 conn(0x7f5c4c0fc550 msgr2=0x7f5c4c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 shutdown_connections 2024-09-06T14:41:32.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:32.559+0000 7f5c50901640 1 -- 172.21.15.52:0/1414036501 wait complete. 2024-09-06T14:41:32.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:32 smithi165 ceph-mon[36229]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:33.271 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-06T14:41:32.292159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":195184,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":191158,"kb_avail":562275728,"statfs":{"total":575970213888,"available":575770345472,"internally_reserved":0,"allocated":3969024,"data_stored":2608182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":195746465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002240"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-06T14:41:01.021997+0000","last_change":"2024-09-06T14:40:33.476632+0000","last_active":"2024-09-06T14:41:01.021997+0000","last_peered":"2024-09-06T14:41:01.021997+0000","last_clean":"2024-09-06T14:41:01.021997+0000","last_became_active":"2024-09-06T14:40:33.476293+0000","last_became_peered":"2024-09-06T14:40:33.476293+0000","last_unstale":"2024-09-06T14:41:01.021997+0000","last_undegraded":"2024-09-06T14:41:01.021997+0000","last_fullsized":"2024-09-06T14:41:01.021997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-06T14:39:45.326378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-06T14:39:45.326378+0000","last_clean_scrub_stamp":"2024-09-06T14:39:45.326378+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-08T01:15:32.225721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31548,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713604,"statfs":{"total":95995035648,"available":95962730496,"internally_reserved":0,"allocated":364544,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117012,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":729881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378647,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":39872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93705280,"statfs":{"total":95995035648,"available":95954206720,"internally_reserved":0,"allocated":364544,"data_stored":139513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":958464,"data_stored":729881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":729881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-06T14:41:33.272 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-06T14:41:33.272 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-06T14:41:33.272 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-06T14:41:33.272 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph health --format=json 2024-09-06T14:41:33.527 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:33.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:33 smithi052 ceph-mon[28627]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T14:41:33.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:33 smithi165 ceph-mon[36229]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 -- 172.21.15.52:0/1122443012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 msgr2=0x7fab1410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 --2- 172.21.15.52:0/1122443012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1410b8d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fab08009880 tx=0x7fab0802a530 comp rx=0 tx=0).stop 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 -- 172.21.15.52:0/1122443012 shutdown_connections 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 --2- 172.21.15.52:0/1122443012 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1410b8d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 --2- 172.21.15.52:0/1122443012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab14102ac0 0x7fab14102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 -- 172.21.15.52:0/1122443012 >> 172.21.15.52:0/1122443012 conn(0x7fab140fc520 msgr2=0x7fab140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 -- 172.21.15.52:0/1122443012 shutdown_connections 2024-09-06T14:41:33.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.970+0000 7fab18ef6640 1 -- 172.21.15.52:0/1122443012 wait complete. 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab18ef6640 1 Processor -- start 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab18ef6640 1 -- start start 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab18ef6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab14102ac0 0x7fab1419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab18ef6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab18ef6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fab1410ee50 con 0x7fab141033e0 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab18ef6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab1410ecd0 con 0x7fab14102ac0 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab11d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab11d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59022/0 (socket says 172.21.15.52:59022) 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab11d9b640 1 -- 172.21.15.52:0/320724614 learned_addr learned my addr 172.21.15.52:0/320724614 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:33.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab1259c640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab14102ac0 0x7fab1419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab11d9b640 1 -- 172.21.15.52:0/320724614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab14102ac0 msgr2=0x7fab1419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.971+0000 7fab11d9b640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab14102ac0 0x7fab1419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.972+0000 7fab11d9b640 1 -- 172.21.15.52:0/320724614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab14197860 con 0x7fab141033e0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.972+0000 7fab11d9b640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1419dbe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab08031460 tx=0x7fab080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.972+0000 7fab037fe640 1 -- 172.21.15.52:0/320724614 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab0803f070 con 0x7fab141033e0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.972+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab14197af0 con 0x7fab141033e0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.972+0000 7fab037fe640 1 -- 172.21.15.52:0/320724614 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab08004ac0 con 0x7fab141033e0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.972+0000 7fab037fe640 1 -- 172.21.15.52:0/320724614 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab08035030 con 0x7fab141033e0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.972+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab14198020 con 0x7fab141033e0 2024-09-06T14:41:34.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.973+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1406aa90 con 0x7fab141033e0 2024-09-06T14:41:34.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.973+0000 7fab037fe640 1 -- 172.21.15.52:0/320724614 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fab08042070 con 0x7fab141033e0 2024-09-06T14:41:34.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.974+0000 7fab037fe640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faafc06de30 0x7faafc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:34.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.974+0000 7fab037fe640 1 -- 172.21.15.52:0/320724614 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fab080ae2e0 con 0x7fab141033e0 2024-09-06T14:41:34.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.974+0000 7fab1259c640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faafc06de30 0x7faafc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:34.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.974+0000 7fab1259c640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faafc06de30 0x7faafc0702f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab141989a0 tx=0x7fab04007310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:34.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:33.978+0000 7fab037fe640 1 -- 172.21.15.52:0/320724614 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab0807c1c0 con 0x7fab141033e0 2024-09-06T14:41:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.193+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fab14198d90 con 0x7fab141033e0 2024-09-06T14:41:34.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.194+0000 7fab037fe640 1 -- 172.21.15.52:0/320724614 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fab0807fe70 con 0x7fab141033e0 2024-09-06T14:41:34.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:34.192 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-06T14:41:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faafc06de30 msgr2=0x7faafc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faafc06de30 0x7faafc0702f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab141989a0 tx=0x7fab04007310 comp rx=0 tx=0).stop 2024-09-06T14:41:34.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 msgr2=0x7fab1419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1419dbe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab08031460 tx=0x7fab080046c0 comp rx=0 tx=0).stop 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 shutdown_connections 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faafc06de30 0x7faafc0702f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab141033e0 0x7fab1419dbe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 --2- 172.21.15.52:0/320724614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab14102ac0 0x7fab1419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 >> 172.21.15.52:0/320724614 conn(0x7fab140fc520 msgr2=0x7fab14108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 shutdown_connections 2024-09-06T14:41:34.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:34.196+0000 7fab18ef6640 1 -- 172.21.15.52:0/320724614 wait complete. 2024-09-06T14:41:34.817 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:34 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/320724614' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-06T14:41:34.817 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:34 smithi052 ceph-mon[28627]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:34.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:34 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/320724614' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-06T14:41:34.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:34 smithi165 ceph-mon[36229]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:34.845 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-06T14:41:34.846 INFO:tasks.cephadm:Setup complete, yielding 2024-09-06T14:41:34.846 INFO:teuthology.run_tasks:Running task print... 2024-09-06T14:41:34.856 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-06T14:41:34.856 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T14:41:34.864 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:41:34.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-06T14:41:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:35.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 -- 172.21.15.52:0/2423290526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 msgr2=0x7f1d2c101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2423290526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c101d80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009880 tx=0x7f1d1c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 -- 172.21.15.52:0/2423290526 shutdown_connections 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2423290526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d2c102b80 0x7f1d2c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2423290526 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c101d80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 -- 172.21.15.52:0/2423290526 >> 172.21.15.52:0/2423290526 conn(0x7f1d2c0fd110 msgr2=0x7f1d2c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 -- 172.21.15.52:0/2423290526 shutdown_connections 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.533+0000 7f1d31e60640 1 -- 172.21.15.52:0/2423290526 wait complete. 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.534+0000 7f1d31e60640 1 Processor -- start 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.534+0000 7f1d31e60640 1 -- start start 2024-09-06T14:41:35.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.534+0000 7f1d31e60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.534+0000 7f1d31e60640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d2c102b80 0x7f1d2c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.534+0000 7f1d31e60640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c10a7c0 con 0x7f1d2c101980 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.534+0000 7f1d31e60640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c10a640 con 0x7f1d2c102b80 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59050/0 (socket says 172.21.15.52:59050) 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2b7fe640 1 -- 172.21.15.52:0/2917878375 learned_addr learned my addr 172.21.15.52:0/2917878375 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2b7fe640 1 -- 172.21.15.52:0/2917878375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d2c102b80 msgr2=0x7f1d2c197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2affd640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d2c102b80 0x7f1d2c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2b7fe640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d2c102b80 0x7f1d2c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2b7fe640 1 -- 172.21.15.52:0/2917878375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c198090 con 0x7f1d2c101980 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d2b7fe640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c1974d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006010 tx=0x7f1d1c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d28ff9640 1 -- 172.21.15.52:0/2917878375 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d1c03f070 con 0x7f1d2c101980 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d28ff9640 1 -- 172.21.15.52:0/2917878375 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d1c0044d0 con 0x7f1d2c101980 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d28ff9640 1 -- 172.21.15.52:0/2917878375 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d1c035030 con 0x7f1d2c101980 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c19ca70 con 0x7f1d2c101980 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.535+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c19d000 con 0x7f1d2c101980 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.537+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c101d80 con 0x7f1d2c101980 2024-09-06T14:41:35.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.537+0000 7f1d28ff9640 1 -- 172.21.15.52:0/2917878375 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f1d1c042070 con 0x7f1d2c101980 2024-09-06T14:41:35.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.537+0000 7f1d28ff9640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f1d1406de30 0x7f1d140702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:35.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.537+0000 7f1d28ff9640 1 -- 172.21.15.52:0/2917878375 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f1d1c0ae500 con 0x7f1d2c101980 2024-09-06T14:41:35.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.537+0000 7f1d2affd640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f1d1406de30 0x7f1d140702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:35.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.538+0000 7f1d2affd640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f1d1406de30 0x7f1d140702f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c198980 tx=0x7f1d20005c60 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:35.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.542+0000 7f1d28ff9640 1 -- 172.21.15.52:0/2917878375 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1d1c07c3e0 con 0x7f1d2c101980 2024-09-06T14:41:35.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.716+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f1d2c062df0 con 0x7f1d2c101980 2024-09-06T14:41:35.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.720+0000 7f1d28ff9640 1 -- 172.21.15.52:0/2917878375 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v42)=0 v42) ==== 143+0+0 (secure 0 0 0) 0x7f1d1c080090 con 0x7f1d2c101980 2024-09-06T14:41:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f1d1406de30 msgr2=0x7f1d140702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f1d1406de30 0x7f1d140702f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c198980 tx=0x7f1d20005c60 comp rx=0 tx=0).stop 2024-09-06T14:41:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 msgr2=0x7f1d2c1974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:35.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c1974d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006010 tx=0x7f1d1c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 shutdown_connections 2024-09-06T14:41:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f1d1406de30 0x7f1d140702f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d2c102b80 0x7f1d2c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 --2- 172.21.15.52:0/2917878375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d2c101980 0x7f1d2c1974d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 >> 172.21.15.52:0/2917878375 conn(0x7f1d2c0fd110 msgr2=0x7f1d2c106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 shutdown_connections 2024-09-06T14:41:35.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:35.722+0000 7f1d31e60640 1 -- 172.21.15.52:0/2917878375 wait complete. 2024-09-06T14:41:36.526 INFO:teuthology.run_tasks:Running task print... 2024-09-06T14:41:36.535 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-06T14:41:36.535 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T14:41:36.543 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:41:36.543 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph orch status' 2024-09-06T14:41:36.813 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:36.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:36 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2917878375' entity='client.admin' 2024-09-06T14:41:36.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:36 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:41:36.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:36 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:36.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:36 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:36.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:36 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:36.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:36 smithi052 ceph-mon[28627]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:37.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:36 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2917878375' entity='client.admin' 2024-09-06T14:41:37.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:36 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:41:37.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:36 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:37.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:36 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:37.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:36 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:37.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:36 smithi165 ceph-mon[36229]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:37.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 -- 172.21.15.52:0/4060578562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c104d20 msgr2=0x7f8f3c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:37.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/4060578562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c104d20 0x7f8f3c107110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f300098b0 tx=0x7f8f3002a4d0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 -- 172.21.15.52:0/4060578562 shutdown_connections 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/4060578562 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c104d20 0x7f8f3c107110 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/4060578562 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f3c1023f0 0x7f8f3c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 -- 172.21.15.52:0/4060578562 >> 172.21.15.52:0/4060578562 conn(0x7f8f3c0fc010 msgr2=0x7f8f3c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 -- 172.21.15.52:0/4060578562 shutdown_connections 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 -- 172.21.15.52:0/4060578562 wait complete. 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.272+0000 7f8f41dcb640 1 Processor -- start 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f41dcb640 1 -- start start 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f41dcb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c1023f0 0x7f8f3c197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f41dcb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f3c104d20 0x7f8f3c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f41dcb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c10a7b0 con 0x7f8f3c1023f0 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f41dcb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c10a630 con 0x7f8f3c104d20 2024-09-06T14:41:37.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f3b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c1023f0 0x7f8f3c197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f3b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c1023f0 0x7f8f3c197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59064/0 (socket says 172.21.15.52:59064) 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f3b7fe640 1 -- 172.21.15.52:0/813062754 learned_addr learned my addr 172.21.15.52:0/813062754 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f3b7fe640 1 -- 172.21.15.52:0/813062754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f3c104d20 msgr2=0x7f8f3c197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f3b7fe640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f3c104d20 0x7f8f3c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f3b7fe640 1 -- 172.21.15.52:0/813062754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c198100 con 0x7f8f3c1023f0 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f3b7fe640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c1023f0 0x7f8f3c197540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00cc60 tx=0x7f8f2c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f38ff9640 1 -- 172.21.15.52:0/813062754 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c00ad30 con 0x7f8f3c1023f0 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f38ff9640 1 -- 172.21.15.52:0/813062754 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f2c005020 con 0x7f8f3c1023f0 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.273+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c19cb40 con 0x7f8f3c1023f0 2024-09-06T14:41:37.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.274+0000 7f8f38ff9640 1 -- 172.21.15.52:0/813062754 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f2c00f640 con 0x7f8f3c1023f0 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.274+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c19d0d0 con 0x7f8f3c1023f0 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.275+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f3c1027d0 con 0x7f8f3c1023f0 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.275+0000 7f8f38ff9640 1 -- 172.21.15.52:0/813062754 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f8f2c0051d0 con 0x7f8f3c1023f0 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.276+0000 7f8f38ff9640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8f2406de90 0x7f8f24070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.276+0000 7f8f38ff9640 1 -- 172.21.15.52:0/813062754 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f8f2c08daa0 con 0x7f8f3c1023f0 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.276+0000 7f8f3affd640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8f2406de90 0x7f8f24070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.276+0000 7f8f3affd640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8f2406de90 0x7f8f24070350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f300096c0 tx=0x7f8f30000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:37.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.280+0000 7f8f38ff9640 1 -- 172.21.15.52:0/813062754 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f2c014030 con 0x7f8f3c1023f0 2024-09-06T14:41:37.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.470+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8f3c105700 con 0x7f8f2406de90 2024-09-06T14:41:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.471+0000 7f8f38ff9640 1 -- 172.21.15.52:0/813062754 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8f3c105700 con 0x7f8f2406de90 2024-09-06T14:41:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:Backend: cephadm 2024-09-06T14:41:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:Available: Yes 2024-09-06T14:41:37.468 INFO:teuthology.orchestra.run.smithi052.stdout:Paused: No 2024-09-06T14:41:37.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.472+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8f2406de90 msgr2=0x7f8f24070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:37.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.472+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8f2406de90 0x7f8f24070350 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f300096c0 tx=0x7f8f30000bc0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.472+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c1023f0 msgr2=0x7f8f3c197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:37.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.472+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c1023f0 0x7f8f3c197540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00cc60 tx=0x7f8f2c00a620 comp rx=0 tx=0).stop 2024-09-06T14:41:37.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.473+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 shutdown_connections 2024-09-06T14:41:37.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.473+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8f2406de90 0x7f8f24070350 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.473+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f3c104d20 0x7f8f3c197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.473+0000 7f8f41dcb640 1 --2- 172.21.15.52:0/813062754 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f3c1023f0 0x7f8f3c197540 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:37.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.473+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 >> 172.21.15.52:0/813062754 conn(0x7f8f3c0fc010 msgr2=0x7f8f3c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:37.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.473+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 shutdown_connections 2024-09-06T14:41:37.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:37.473+0000 7f8f41dcb640 1 -- 172.21.15.52:0/813062754 wait complete. 2024-09-06T14:41:38.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-06T14:41:38.369 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 -- 172.21.15.52:0/3725974615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc100b30 msgr2=0x7f87bc100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/3725974615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc100b30 0x7f87bc100fb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009880 tx=0x7f87b002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 -- 172.21.15.52:0/3725974615 shutdown_connections 2024-09-06T14:41:38.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/3725974615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc100b30 0x7f87bc100fb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/3725974615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87bc101df0 0x7f87bc1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 -- 172.21.15.52:0/3725974615 >> 172.21.15.52:0/3725974615 conn(0x7f87bc0fb770 msgr2=0x7f87bc0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 -- 172.21.15.52:0/3725974615 shutdown_connections 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 -- 172.21.15.52:0/3725974615 wait complete. 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.813+0000 7f87c1f9a640 1 Processor -- start 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87c1f9a640 1 -- start start 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87c1f9a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87bc100b30 0x7f87bc104b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:38.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87c1f9a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc101df0 0x7f87bc1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87c1f9a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc109720 con 0x7f87bc101df0 2024-09-06T14:41:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87c1f9a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc1095a0 con 0x7f87bc100b30 2024-09-06T14:41:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc101df0 0x7f87bc1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc101df0 0x7f87bc1031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59082/0 (socket says 172.21.15.52:59082) 2024-09-06T14:41:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87baffd640 1 -- 172.21.15.52:0/2985702393 learned_addr learned my addr 172.21.15.52:0/2985702393 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87bb7fe640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87bc100b30 0x7f87bc104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:38.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87baffd640 1 -- 172.21.15.52:0/2985702393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87bc100b30 msgr2=0x7f87bc104b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87baffd640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87bc100b30 0x7f87bc104b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87baffd640 1 -- 172.21.15.52:0/2985702393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc103730 con 0x7f87bc101df0 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87bb7fe640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87bc100b30 0x7f87bc104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.814+0000 7f87baffd640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc101df0 0x7f87bc1031f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87b0006010 tx=0x7f87b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.815+0000 7f87b8ff9640 1 -- 172.21.15.52:0/2985702393 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87b003f070 con 0x7f87bc101df0 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.815+0000 7f87b8ff9640 1 -- 172.21.15.52:0/2985702393 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87b00044d0 con 0x7f87bc101df0 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.815+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87bc1039c0 con 0x7f87bc101df0 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.815+0000 7f87b8ff9640 1 -- 172.21.15.52:0/2985702393 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87b0035030 con 0x7f87bc101df0 2024-09-06T14:41:38.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.815+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87bc103f70 con 0x7f87bc101df0 2024-09-06T14:41:38.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.816+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87bc100fb0 con 0x7f87bc101df0 2024-09-06T14:41:38.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.817+0000 7f87b8ff9640 1 -- 172.21.15.52:0/2985702393 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f87b0042070 con 0x7f87bc101df0 2024-09-06T14:41:38.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.817+0000 7f87b8ff9640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f87a406de90 0x7f87a4070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:38.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.817+0000 7f87bb7fe640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f87a406de90 0x7f87a4070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:38.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.817+0000 7f87b8ff9640 1 -- 172.21.15.52:0/2985702393 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f87b00ae520 con 0x7f87bc101df0 2024-09-06T14:41:38.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.818+0000 7f87bb7fe640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f87a406de90 0x7f87a4070350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87ac006fd0 tx=0x7f87ac008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:38.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:38.822+0000 7f87b8ff9640 1 -- 172.21.15.52:0/2985702393 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87b007c480 con 0x7f87bc101df0 2024-09-06T14:41:39.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.005+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f87bc062630 con 0x7f87a406de90 2024-09-06T14:41:39.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.013+0000 7f87b8ff9640 1 -- 172.21.15.52:0/2985702393 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7f87bc062630 con 0x7f87a406de90 2024-09-06T14:41:39.012 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:41:39.012 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (3m) 112s ago 4m 25.1M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:41:39.012 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (5m) 112s ago 5m 7738k - 19.1.1-268-g635ed4cf b6db46a449e5 9152c789e0ae 2024-09-06T14:41:39.012 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (4m) 43s ago 4m 5268k - 19.1.1-268-g635ed4cf b6db46a449e5 92f6280b935c 2024-09-06T14:41:39.012 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (5m) 112s ago 5m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:41:39.013 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (4m) 43s ago 4m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:41:39.013 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (3m) 112s ago 4m 76.3M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:41:39.013 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:9283,8765,8443 running (6m) 112s ago 6m 490M - 19.1.1-268-g635ed4cf b6db46a449e5 39e44f4c0904 2024-09-06T14:41:39.013 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (4m) 43s ago 4m 441M - 19.1.1-268-g635ed4cf b6db46a449e5 b3f6405384f6 2024-09-06T14:41:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (6m) 112s ago 6m 46.1M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:41:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (4m) 43s ago 4m 39.5M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:41:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (5m) 112s ago 5m 16.0M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:41:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (4m) 43s ago 4m 15.4M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:41:39.014 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (3m) 112s ago 3m 37.6M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:41:39.015 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (2m) 112s ago 2m 47.8M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:41:39.015 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (2m) 112s ago 2m 45.4M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:41:39.015 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (101s) 43s ago 101s 46.4M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:41:39.015 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (74s) 43s ago 74s 44.6M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:41:39.016 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (48s) 43s ago 47s 11.7M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:41:39.016 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (3m) 112s ago 4m 40.3M - 2.43.0 a07b618ecd1d 1b767954d6f6 2024-09-06T14:41:39.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f87a406de90 msgr2=0x7f87a4070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f87a406de90 0x7f87a4070350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87ac006fd0 tx=0x7f87ac008040 comp rx=0 tx=0).stop 2024-09-06T14:41:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc101df0 msgr2=0x7f87bc1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc101df0 0x7f87bc1031f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87b0006010 tx=0x7f87b00048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 shutdown_connections 2024-09-06T14:41:39.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f87a406de90 0x7f87a4070350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87bc101df0 0x7f87bc1031f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 --2- 172.21.15.52:0/2985702393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87bc100b30 0x7f87bc104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 >> 172.21.15.52:0/2985702393 conn(0x7f87bc0fb770 msgr2=0x7f87bc0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:39.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 shutdown_connections 2024-09-06T14:41:39.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:39.015+0000 7f87c1f9a640 1 -- 172.21.15.52:0/2985702393 wait complete. 2024-09-06T14:41:39.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:39 smithi052 ceph-mon[28627]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:39.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:39 smithi052 ceph-mon[28627]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:39.679 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-06T14:41:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:39 smithi165 ceph-mon[36229]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:39 smithi165 ceph-mon[36229]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:39.931 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:40.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 -- 172.21.15.52:0/1759853979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4102b30 msgr2=0x7fc2e4104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:40.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/1759853979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4102b30 0x7fc2e4104fa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009880 tx=0x7fc2d402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 -- 172.21.15.52:0/1759853979 shutdown_connections 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/1759853979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e4102b30 0x7fc2e4104fa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/1759853979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2e41001e0 0x7fc2e41025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 -- 172.21.15.52:0/1759853979 >> 172.21.15.52:0/1759853979 conn(0x7fc2e40fc010 msgr2=0x7fc2e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 -- 172.21.15.52:0/1759853979 shutdown_connections 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.379+0000 7fc2ebea1640 1 -- 172.21.15.52:0/1759853979 wait complete. 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2ebea1640 1 Processor -- start 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2ebea1640 1 -- start start 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2ebea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e41001e0 0x7fc2e419db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2ebea1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2e4102b30 0x7fc2e419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:40.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2ebea1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4110df0 con 0x7fc2e41001e0 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2ebea1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e4110c70 con 0x7fc2e4102b30 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e9c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e41001e0 0x7fc2e419db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e9c3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e41001e0 0x7fc2e419db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42080/0 (socket says 172.21.15.52:42080) 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e9c3d640 1 -- 172.21.15.52:0/3332229501 learned_addr learned my addr 172.21.15.52:0/3332229501 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e943c640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2e4102b30 0x7fc2e419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e9c3d640 1 -- 172.21.15.52:0/3332229501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2e4102b30 msgr2=0x7fc2e419e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e9c3d640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2e4102b30 0x7fc2e419e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e9c3d640 1 -- 172.21.15.52:0/3332229501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e419e6d0 con 0x7fc2e41001e0 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e943c640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2e4102b30 0x7fc2e419e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2e9c3d640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e41001e0 0x7fc2e419db10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000b420 tx=0x7fc2e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2daffd640 1 -- 172.21.15.52:0/3332229501 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2e0011630 con 0x7fc2e41001e0 2024-09-06T14:41:40.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.380+0000 7fc2daffd640 1 -- 172.21.15.52:0/3332229501 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2e0016070 con 0x7fc2e41001e0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.381+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e41a3110 con 0x7fc2e41001e0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.381+0000 7fc2daffd640 1 -- 172.21.15.52:0/3332229501 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2e0010d40 con 0x7fc2e41001e0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.381+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e41a3720 con 0x7fc2e41001e0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.381+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e41005e0 con 0x7fc2e41001e0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.382+0000 7fc2daffd640 1 -- 172.21.15.52:0/3332229501 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fc2e001b460 con 0x7fc2e41001e0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.382+0000 7fc2daffd640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fc2d006de90 0x7fc2d0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.383+0000 7fc2daffd640 1 -- 172.21.15.52:0/3332229501 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fc2e008d070 con 0x7fc2e41001e0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.383+0000 7fc2e943c640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fc2d006de90 0x7fc2d0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.383+0000 7fc2e943c640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fc2d006de90 0x7fc2d0070350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40096c0 tx=0x7fc2d4009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:40.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.387+0000 7fc2daffd640 1 -- 172.21.15.52:0/3332229501 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2e005afd0 con 0x7fc2e41001e0 2024-09-06T14:41:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.570+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fc2e4103510 con 0x7fc2d006de90 2024-09-06T14:41:40.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.575+0000 7fc2daffd640 1 -- 172.21.15.52:0/3332229501 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1300 (secure 0 0 0) 0x7fc2e4103510 con 0x7fc2d006de90 2024-09-06T14:41:40.572 INFO:teuthology.orchestra.run.smithi052.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-06T14:41:40.572 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager ?:9093,9094 1/1 113s ago 5m count:1 2024-09-06T14:41:40.572 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter 2/2 113s ago 5m * 2024-09-06T14:41:40.573 INFO:teuthology.orchestra.run.smithi052.stdout:crash 2/2 113s ago 5m * 2024-09-06T14:41:40.573 INFO:teuthology.orchestra.run.smithi052.stdout:grafana ?:3000 1/1 113s ago 5m count:1 2024-09-06T14:41:40.573 INFO:teuthology.orchestra.run.smithi052.stdout:mgr 2/2 113s ago 5m count:2 2024-09-06T14:41:40.573 INFO:teuthology.orchestra.run.smithi052.stdout:mon 2/2 113s ago 5m smithi052:172.21.15.52=smithi052;smithi165:172.21.15.165=smithi165;count:2 2024-09-06T14:41:40.573 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter ?:9100 2/2 113s ago 5m * 2024-09-06T14:41:40.573 INFO:teuthology.orchestra.run.smithi052.stdout:osd 6 113s ago - 2024-09-06T14:41:40.573 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus ?:9095 1/1 113s ago 5m count:1 2024-09-06T14:41:40.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:40 smithi165 ceph-mon[36229]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:40.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fc2d006de90 msgr2=0x7fc2d0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:40.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fc2d006de90 0x7fc2d0070350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40096c0 tx=0x7fc2d4009650 comp rx=0 tx=0).stop 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e41001e0 msgr2=0x7fc2e419db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e41001e0 0x7fc2e419db10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000b420 tx=0x7fc2e000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 shutdown_connections 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fc2d006de90 0x7fc2d0070350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2e4102b30 0x7fc2e419e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 --2- 172.21.15.52:0/3332229501 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2e41001e0 0x7fc2e419db10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 >> 172.21.15.52:0/3332229501 conn(0x7fc2e40fc010 msgr2=0x7fc2e40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 shutdown_connections 2024-09-06T14:41:40.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:40.577+0000 7fc2ebea1640 1 -- 172.21.15.52:0/3332229501 wait complete. 2024-09-06T14:41:40.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:40 smithi052 ceph-mon[28627]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:40.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:41.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-06T14:41:41.556 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:41.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:41 smithi052 ceph-mon[28627]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:41 smithi165 ceph-mon[36229]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:41.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1447715303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 msgr2=0x7ff1e00ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:41.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1447715303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e00ffa00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009880 tx=0x7ff1c802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1447715303 shutdown_connections 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1447715303 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e00ffa00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1447715303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e0102f60 0x7ff1e0103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1447715303 >> 172.21.15.52:0/1447715303 conn(0x7ff1e00fb790 msgr2=0x7ff1e00fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1447715303 shutdown_connections 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.987+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1447715303 wait complete. 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.988+0000 7ff1e49d2640 1 Processor -- start 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.988+0000 7ff1e49d2640 1 -- start start 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.988+0000 7ff1e49d2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e0102f60 0x7ff1e01025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.988+0000 7ff1e49d2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e0100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1e49d2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010a850 con 0x7ff1e0103930 2024-09-06T14:41:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1e49d2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e010a6d0 con 0x7ff1e0102f60 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1ddd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e0100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1ddd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e0100cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42100/0 (socket says 172.21.15.52:42100) 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1ddd9b640 1 -- 172.21.15.52:0/1510065807 learned_addr learned my addr 172.21.15.52:0/1510065807 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1de59c640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e0102f60 0x7ff1e01025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1ddd9b640 1 -- 172.21.15.52:0/1510065807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e0102f60 msgr2=0x7ff1e01025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1ddd9b640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e0102f60 0x7ff1e01025f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1ddd9b640 1 -- 172.21.15.52:0/1510065807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e01011f0 con 0x7ff1e0103930 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.989+0000 7ff1de59c640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e0102f60 0x7ff1e01025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.990+0000 7ff1ddd9b640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e0100cb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8006010 tx=0x7ff1c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.990+0000 7ff1d77fe640 1 -- 172.21.15.52:0/1510065807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1c803f070 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.990+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e0101480 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.990+0000 7ff1d77fe640 1 -- 172.21.15.52:0/1510065807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1c80044d0 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.990+0000 7ff1d77fe640 1 -- 172.21.15.52:0/1510065807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff1c8035030 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.990+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e0101a30 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.991+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e0103340 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.991+0000 7ff1d77fe640 1 -- 172.21.15.52:0/1510065807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7ff1c8042070 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.992+0000 7ff1d77fe640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff1cc06de30 0x7ff1cc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.992+0000 7ff1d77fe640 1 -- 172.21.15.52:0/1510065807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7ff1c80ae4c0 con 0x7ff1e0103930 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.992+0000 7ff1de59c640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff1cc06de30 0x7ff1cc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.992+0000 7ff1de59c640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff1cc06de30 0x7ff1cc0702f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0006fd0 tx=0x7ff1d0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:41.994 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:41.996+0000 7ff1d77fe640 1 -- 172.21.15.52:0/1510065807 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1c807c3a0 con 0x7ff1e0103930 2024-09-06T14:41:42.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.175+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ff1e0062630 con 0x7ff1cc06de30 2024-09-06T14:41:42.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.177+0000 7ff1d77fe640 1 -- 172.21.15.52:0/1510065807 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7ff1e0062630 con 0x7ff1cc06de30 2024-09-06T14:41:42.174 INFO:teuthology.orchestra.run.smithi052.stdout:HOST ADDR LABELS STATUS 2024-09-06T14:41:42.174 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052 172.21.15.52 2024-09-06T14:41:42.174 INFO:teuthology.orchestra.run.smithi052.stdout:smithi165 172.21.15.165 2024-09-06T14:41:42.175 INFO:teuthology.orchestra.run.smithi052.stdout:2 hosts in cluster 2024-09-06T14:41:42.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff1cc06de30 msgr2=0x7ff1cc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:42.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff1cc06de30 0x7ff1cc0702f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0006fd0 tx=0x7ff1d0008040 comp rx=0 tx=0).stop 2024-09-06T14:41:42.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 msgr2=0x7ff1e0100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:42.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e0100cb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8006010 tx=0x7ff1c80048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:42.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 shutdown_connections 2024-09-06T14:41:42.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff1cc06de30 0x7ff1cc0702f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:42.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1e0103930 0x7ff1e0100cb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:42.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 --2- 172.21.15.52:0/1510065807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff1e0102f60 0x7ff1e01025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:42.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 >> 172.21.15.52:0/1510065807 conn(0x7ff1e00fb790 msgr2=0x7ff1e01062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:42.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 shutdown_connections 2024-09-06T14:41:42.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:42.179+0000 7ff1e49d2640 1 -- 172.21.15.52:0/1510065807 wait complete. 2024-09-06T14:41:42.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:42 smithi052 ceph-mon[28627]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:42.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:42 smithi165 ceph-mon[36229]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:42.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-06T14:41:43.172 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:43.611 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:43 smithi052 ceph-mon[28627]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:43.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:43 smithi052 ceph-mon[28627]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:43.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 -- 172.21.15.52:0/3796277483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 msgr2=0x7f508c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 --2- 172.21.15.52:0/3796277483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1047e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f507c0098b0 tx=0x7f507c02a4d0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 -- 172.21.15.52:0/3796277483 shutdown_connections 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 --2- 172.21.15.52:0/3796277483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f508c104d20 0x7f508c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 --2- 172.21.15.52:0/3796277483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1047e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 -- 172.21.15.52:0/3796277483 >> 172.21.15.52:0/3796277483 conn(0x7f508c0fc010 msgr2=0x7f508c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 -- 172.21.15.52:0/3796277483 shutdown_connections 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.613+0000 7f5092099640 1 -- 172.21.15.52:0/3796277483 wait complete. 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f5092099640 1 Processor -- start 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f5092099640 1 -- start start 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f5092099640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f5092099640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f508c104d20 0x7f508c194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f5092099640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f508c10a7c0 con 0x7f508c1023f0 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f5092099640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f508c10a640 con 0x7f508c104d20 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f508b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f508b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42118/0 (socket says 172.21.15.52:42118) 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.614+0000 7f508b7fe640 1 -- 172.21.15.52:0/1372504477 learned_addr learned my addr 172.21.15.52:0/1372504477 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f508affd640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f508c104d20 0x7f508c194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f508b7fe640 1 -- 172.21.15.52:0/1372504477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f508c104d20 msgr2=0x7f508c194be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f508b7fe640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f508c104d20 0x7f508c194be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f508b7fe640 1 -- 172.21.15.52:0/1372504477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c195260 con 0x7f508c1023f0 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f508b7fe640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1946a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f507c0099d0 tx=0x7f507c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f5088ff9640 1 -- 172.21.15.52:0/1372504477 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f507c03f070 con 0x7f508c1023f0 2024-09-06T14:41:43.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c199c40 con 0x7f508c1023f0 2024-09-06T14:41:43.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f5088ff9640 1 -- 172.21.15.52:0/1372504477 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f507c004a40 con 0x7f508c1023f0 2024-09-06T14:41:43.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c19a1d0 con 0x7f508c1023f0 2024-09-06T14:41:43.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.615+0000 7f5088ff9640 1 -- 172.21.15.52:0/1372504477 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f507c035030 con 0x7f508c1023f0 2024-09-06T14:41:43.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.616+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508c1027d0 con 0x7f508c1023f0 2024-09-06T14:41:43.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.617+0000 7f5088ff9640 1 -- 172.21.15.52:0/1372504477 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f507c042070 con 0x7f508c1023f0 2024-09-06T14:41:43.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.617+0000 7f5088ff9640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f507406de90 0x7f5074070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:43.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.618+0000 7f508affd640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f507406de90 0x7f5074070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:43.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.618+0000 7f5088ff9640 1 -- 172.21.15.52:0/1372504477 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f507c0ae2e0 con 0x7f508c1023f0 2024-09-06T14:41:43.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.618+0000 7f508affd640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f507406de90 0x7f5074070350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f508c195b50 tx=0x7f508000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:43.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.622+0000 7f5088ff9640 1 -- 172.21.15.52:0/1372504477 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f507c07fef0 con 0x7f508c1023f0 2024-09-06T14:41:43.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.803+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f508c062630 con 0x7f507406de90 2024-09-06T14:41:43.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.805+0000 7f5088ff9640 1 -- 172.21.15.52:0/1372504477 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f508c062630 con 0x7f507406de90 2024-09-06T14:41:43.802 INFO:teuthology.orchestra.run.smithi052.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-06T14:41:43.802 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513010N480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-06T14:41:43.803 INFO:teuthology.orchestra.run.smithi052.stdout:smithi165 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CE400BGN 372G No 44s ago Has a FileSystem, LVM detected 2024-09-06T14:41:43.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f507406de90 msgr2=0x7f5074070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:43.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f507406de90 0x7f5074070350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f508c195b50 tx=0x7f508000b390 comp rx=0 tx=0).stop 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 msgr2=0x7f508c1946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1946a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f507c0099d0 tx=0x7f507c0046c0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 shutdown_connections 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f507406de90 0x7f5074070350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f508c104d20 0x7f508c194be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 --2- 172.21.15.52:0/1372504477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f508c1023f0 0x7f508c1946a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 >> 172.21.15.52:0/1372504477 conn(0x7f508c0fc010 msgr2=0x7f508c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 shutdown_connections 2024-09-06T14:41:43.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:43.807+0000 7f5092099640 1 -- 172.21.15.52:0/1372504477 wait complete. 2024-09-06T14:41:43.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:43 smithi165 ceph-mon[36229]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:43.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:43 smithi165 ceph-mon[36229]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:44.449 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:44 smithi052 ceph-mon[28627]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:44.449 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:44 smithi052 ceph-mon[28627]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:44.477 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T14:41:44.487 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:41:44.488 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-06T14:41:44.738 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:44 smithi165 ceph-mon[36229]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:44.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:44 smithi165 ceph-mon[36229]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:45.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 -- 172.21.15.52:0/513845896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 msgr2=0x7fd838101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 --2- 172.21.15.52:0/513845896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd838101ee0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009880 tx=0x7fd82c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 -- 172.21.15.52:0/513845896 shutdown_connections 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 --2- 172.21.15.52:0/513845896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd838101ee0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 --2- 172.21.15.52:0/513845896 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd838100860 0x7fd838100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 -- 172.21.15.52:0/513845896 >> 172.21.15.52:0/513845896 conn(0x7fd8380fc010 msgr2=0x7fd8380fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 -- 172.21.15.52:0/513845896 shutdown_connections 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.197+0000 7fd83da2d640 1 -- 172.21.15.52:0/513845896 wait complete. 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.198+0000 7fd83da2d640 1 Processor -- start 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.198+0000 7fd83da2d640 1 -- start start 2024-09-06T14:41:45.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.198+0000 7fd83da2d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd838100860 0x7fd8381963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.198+0000 7fd83da2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd8381968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.198+0000 7fd83da2d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd838109680 con 0x7fd838101a60 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.198+0000 7fd83da2d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd838109500 con 0x7fd838100860 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd8367fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd8381968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd8367fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd8381968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42140/0 (socket says 172.21.15.52:42140) 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd8367fc640 1 -- 172.21.15.52:0/18810877 learned_addr learned my addr 172.21.15.52:0/18810877 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd836ffd640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd838100860 0x7fd8381963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd8367fc640 1 -- 172.21.15.52:0/18810877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd838100860 msgr2=0x7fd8381963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd8367fc640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd838100860 0x7fd8381963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd8367fc640 1 -- 172.21.15.52:0/18810877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd838196f60 con 0x7fd838101a60 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd8367fc640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd8381968e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd82c006010 tx=0x7fd82c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd83ca2b640 1 -- 172.21.15.52:0/18810877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd82c03f070 con 0x7fd838101a60 2024-09-06T14:41:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83819b940 con 0x7fd838101a60 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd83ca2b640 1 -- 172.21.15.52:0/18810877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd82c0044d0 con 0x7fd838101a60 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd83ca2b640 1 -- 172.21.15.52:0/18810877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd82c035030 con 0x7fd838101a60 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.199+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83819bed0 con 0x7fd838101a60 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.200+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd838100c60 con 0x7fd838101a60 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.201+0000 7fd83ca2b640 1 -- 172.21.15.52:0/18810877 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fd82c042070 con 0x7fd838101a60 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.201+0000 7fd83ca2b640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd82006de30 0x7fd8200702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.201+0000 7fd836ffd640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd82006de30 0x7fd8200702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.201+0000 7fd83ca2b640 1 -- 172.21.15.52:0/18810877 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fd82c0ae5e0 con 0x7fd838101a60 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.202+0000 7fd836ffd640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd82006de30 0x7fd8200702f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8381018c0 tx=0x7fd82800a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.206+0000 7fd83ca2b640 1 -- 172.21.15.52:0/18810877 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd82c0800d0 con 0x7fd838101a60 2024-09-06T14:41:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:45.405+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7fd838062630 con 0x7fd82006de30 2024-09-06T14:41:46.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:45 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-06T14:41:46.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:45 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-06T14:41:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.738+0000 7fd83ca2b640 1 -- 172.21.15.52:0/18810877 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd838062630 con 0x7fd82006de30 2024-09-06T14:41:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.741+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd82006de30 msgr2=0x7fd8200702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.741+0000 7fd83da2d640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd82006de30 0x7fd8200702f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd8381018c0 tx=0x7fd82800a2d0 comp rx=0 tx=0).stop 2024-09-06T14:41:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.741+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 msgr2=0x7fd8381968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.741+0000 7fd83da2d640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd8381968e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd82c006010 tx=0x7fd82c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:41:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.742+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 shutdown_connections 2024-09-06T14:41:46.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.742+0000 7fd83da2d640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd82006de30 0x7fd8200702f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.742+0000 7fd83da2d640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838101a60 0x7fd8381968e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.742+0000 7fd83da2d640 1 --2- 172.21.15.52:0/18810877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd838100860 0x7fd8381963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.742+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 >> 172.21.15.52:0/18810877 conn(0x7fd8380fc010 msgr2=0x7fd838104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.742+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 shutdown_connections 2024-09-06T14:41:46.740 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:46.742+0000 7fd83da2d640 1 -- 172.21.15.52:0/18810877 wait complete. 2024-09-06T14:41:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[28623]: 2024-09-06T14:41:46.712+0000 7ff386c97640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-06T14:41:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-06T14:41:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: osdmap e41: 6 total, 6 up, 6 in 2024-09-06T14:41:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-06T14:41:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: pgmap v167: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: osdmap e42: 6 total, 6 up, 6 in 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: osdmap e43: 6 total, 6 up, 6 in 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: fsmap cephfs:0 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:47.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dfprfm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dfprfm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:46 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:47.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:41:47.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-06T14:41:47.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: osdmap e41: 6 total, 6 up, 6 in 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: pgmap v167: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: osdmap e42: 6 total, 6 up, 6 in 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: osdmap e43: 6 total, 6 up, 6 in 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: fsmap cephfs:0 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:47.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:41:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:41:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dfprfm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dfprfm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:46 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:47.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-06T14:41:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:47 smithi052 ceph-mon[28627]: Saving service mds.cephfs spec with placement count:4 2024-09-06T14:41:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:47 smithi052 ceph-mon[28627]: Deploying daemon mds.cephfs.smithi052.dfprfm on smithi052 2024-09-06T14:41:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:47 smithi052 ceph-mon[28627]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T14:41:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:47 smithi052 ceph-mon[28627]: osdmap e44: 6 total, 6 up, 6 in 2024-09-06T14:41:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:48.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:47 smithi165 ceph-mon[36229]: Saving service mds.cephfs spec with placement count:4 2024-09-06T14:41:48.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:47 smithi165 ceph-mon[36229]: Deploying daemon mds.cephfs.smithi052.dfprfm on smithi052 2024-09-06T14:41:48.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:47 smithi165 ceph-mon[36229]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-06T14:41:48.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:47 smithi165 ceph-mon[36229]: osdmap e44: 6 total, 6 up, 6 in 2024-09-06T14:41:49.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:48 smithi052 ceph-mon[28627]: pgmap v171: 65 pgs: 13 active+clean, 17 creating+peering, 35 unknown; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:49.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:48 smithi052 ceph-mon[28627]: osdmap e45: 6 total, 6 up, 6 in 2024-09-06T14:41:49.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/1888594499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d28104d20 msgr2=0x7f7d28107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:49.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/1888594499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d28104d20 0x7f7d28107110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7d140098b0 tx=0x7f7d1402a4d0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/1888594499 shutdown_connections 2024-09-06T14:41:49.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/1888594499 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d28104d20 0x7f7d28107110 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/1888594499 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d281023f0 0x7f7d281047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/1888594499 >> 172.21.15.52:0/1888594499 conn(0x7f7d280fc010 msgr2=0x7f7d280fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/1888594499 shutdown_connections 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.088+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/1888594499 wait complete. 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2f0d3640 1 Processor -- start 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2f0d3640 1 -- start start 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2f0d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d281023f0 0x7f7d28199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2f0d3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d28104d20 0x7f7d28199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2f0d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810a7b0 con 0x7f7d281023f0 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2f0d3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2810a630 con 0x7f7d28104d20 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2ce6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d281023f0 0x7f7d28199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2ce6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d281023f0 0x7f7d28199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42146/0 (socket says 172.21.15.52:42146) 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2ce6f640 1 -- 172.21.15.52:0/2865146592 learned_addr learned my addr 172.21.15.52:0/2865146592 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:49.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d27fff640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d28104d20 0x7f7d28199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2ce6f640 1 -- 172.21.15.52:0/2865146592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d28104d20 msgr2=0x7f7d28199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2ce6f640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d28104d20 0x7f7d28199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2ce6f640 1 -- 172.21.15.52:0/2865146592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2819a320 con 0x7f7d281023f0 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.089+0000 7f7d2ce6f640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d281023f0 0x7f7d28199760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c8f0 tx=0x7f7d1c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.090+0000 7f7d25ffb640 1 -- 172.21.15.52:0/2865146592 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d1c0079b0 con 0x7f7d281023f0 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.090+0000 7f7d25ffb640 1 -- 172.21.15.52:0/2865146592 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d1c0054e0 con 0x7f7d281023f0 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.090+0000 7f7d25ffb640 1 -- 172.21.15.52:0/2865146592 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d1c004dd0 con 0x7f7d281023f0 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.090+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d2819ed60 con 0x7f7d281023f0 2024-09-06T14:41:49.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.090+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d2819f260 con 0x7f7d281023f0 2024-09-06T14:41:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.091+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d281027d0 con 0x7f7d281023f0 2024-09-06T14:41:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.092+0000 7f7d25ffb640 1 -- 172.21.15.52:0/2865146592 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f7d1c005020 con 0x7f7d281023f0 2024-09-06T14:41:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.092+0000 7f7d25ffb640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f7d1806de30 0x7f7d180702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.092+0000 7f7d25ffb640 1 -- 172.21.15.52:0/2865146592 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f7d1c08da60 con 0x7f7d281023f0 2024-09-06T14:41:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.092+0000 7f7d27fff640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f7d1806de30 0x7f7d180702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.093+0000 7f7d27fff640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f7d1806de30 0x7f7d180702f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d14006010 tx=0x7f7d14000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:49.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.097+0000 7f7d25ffb640 1 -- 172.21.15.52:0/2865146592 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d1c014030 con 0x7f7d281023f0 2024-09-06T14:41:49.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.315+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7d280fdb00 con 0x7f7d281023f0 2024-09-06T14:41:49.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.316+0000 7f7d25ffb640 1 -- 172.21.15.52:0/2865146592 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f7d1c05b680 con 0x7f7d281023f0 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:e2 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:41:46:713312+0000 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 2 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:41:49.314 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:41:46.713227+0000 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 0 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 1 2024-09-06T14:41:49.315 INFO:teuthology.orchestra.run.smithi052.stdout:in 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data disabled 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 0 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:41:49.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:49.317 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:49.317 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-09-06T14:41:49.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f7d1806de30 msgr2=0x7f7d180702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:49.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f7d1806de30 0x7f7d180702f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7d14006010 tx=0x7f7d14000bc0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d281023f0 msgr2=0x7f7d28199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d281023f0 0x7f7d28199760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c8f0 tx=0x7f7d1c00cdb0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 shutdown_connections 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f7d1806de30 0x7f7d180702f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d28104d20 0x7f7d28199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 --2- 172.21.15.52:0/2865146592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d281023f0 0x7f7d28199760 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 >> 172.21.15.52:0/2865146592 conn(0x7f7d280fc010 msgr2=0x7f7d28101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 shutdown_connections 2024-09-06T14:41:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:49.318+0000 7f7d2f0d3640 1 -- 172.21.15.52:0/2865146592 wait complete. 2024-09-06T14:41:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:48 smithi165 ceph-mon[36229]: pgmap v171: 65 pgs: 13 active+clean, 17 creating+peering, 35 unknown; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:48 smithi165 ceph-mon[36229]: osdmap e45: 6 total, 6 up, 6 in 2024-09-06T14:41:50.028 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:49 smithi052 ceph-mon[28627]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T14:41:50.028 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:49 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2865146592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-06T14:41:50.053 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T14:41:50.063 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:41:50.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-06T14:41:50.291 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:49 smithi165 ceph-mon[36229]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-06T14:41:50.291 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:49 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2865146592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-06T14:41:50.766 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:51.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:50 smithi052 ceph-mon[28627]: pgmap v173: 65 pgs: 28 active+clean, 17 creating+peering, 20 unknown; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:51.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:51.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:51.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:51.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.nmjcsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:51.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.nmjcsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:51.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 -- 172.21.15.52:0/2583810962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 msgr2=0x7f94b4103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 --2- 172.21.15.52:0/2583810962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b4103080 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009880 tx=0x7f94a802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 -- 172.21.15.52:0/2583810962 shutdown_connections 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 --2- 172.21.15.52:0/2583810962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b4103080 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 --2- 172.21.15.52:0/2583810962 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94b40ffc20 0x7f94b4100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 -- 172.21.15.52:0/2583810962 >> 172.21.15.52:0/2583810962 conn(0x7f94b40fb770 msgr2=0x7f94b40fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 -- 172.21.15.52:0/2583810962 shutdown_connections 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 -- 172.21.15.52:0/2583810962 wait complete. 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.220+0000 7f94b9083640 1 Processor -- start 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b9083640 1 -- start start 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b9083640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94b40ffc20 0x7f94b419dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b9083640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b9083640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f94b410a7a0 con 0x7f94b4102c00 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b9083640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f94b410a620 con 0x7f94b40ffc20 2024-09-06T14:41:51.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b419e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44046/0 (socket says 172.21.15.52:44046) 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b259c640 1 -- 172.21.15.52:0/2504508793 learned_addr learned my addr 172.21.15.52:0/2504508793 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b2d9d640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94b40ffc20 0x7f94b419dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b259c640 1 -- 172.21.15.52:0/2504508793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94b40ffc20 msgr2=0x7f94b419dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b259c640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94b40ffc20 0x7f94b419dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.221+0000 7f94b259c640 1 -- 172.21.15.52:0/2504508793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b419e6a0 con 0x7f94b4102c00 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.222+0000 7f94b259c640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b419e020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f94a8006010 tx=0x7f94a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.222+0000 7f949bfff640 1 -- 172.21.15.52:0/2504508793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a803f070 con 0x7f94b4102c00 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.222+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b41a3080 con 0x7f94b4102c00 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.222+0000 7f949bfff640 1 -- 172.21.15.52:0/2504508793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94a8004ac0 con 0x7f94b4102c00 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.222+0000 7f949bfff640 1 -- 172.21.15.52:0/2504508793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94a8035030 con 0x7f94b4102c00 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.222+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b41a3610 con 0x7f94b4102c00 2024-09-06T14:41:51.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.223+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b4100020 con 0x7f94b4102c00 2024-09-06T14:41:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.223+0000 7f949bfff640 1 -- 172.21.15.52:0/2504508793 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f94a8042070 con 0x7f94b4102c00 2024-09-06T14:41:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.224+0000 7f949bfff640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f949c06de30 0x7f949c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.224+0000 7f949bfff640 1 -- 172.21.15.52:0/2504508793 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f94a80ae740 con 0x7f94b4102c00 2024-09-06T14:41:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.224+0000 7f94b2d9d640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f949c06de30 0x7f949c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.224+0000 7f94b2d9d640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f949c06de30 0x7f949c0702f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005fd0 tx=0x7f94a400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:51.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.228+0000 7f949bfff640 1 -- 172.21.15.52:0/2504508793 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94a807ff90 con 0x7f94b4102c00 2024-09-06T14:41:51.296 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:50 smithi165 ceph-mon[36229]: pgmap v173: 65 pgs: 28 active+clean, 17 creating+peering, 20 unknown; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:51.297 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:51.297 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:51.297 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:51.297 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.nmjcsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:51.297 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.nmjcsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:51.297 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:51.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.443+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7f94b4062df0 con 0x7f94b4102c00 2024-09-06T14:41:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.979+0000 7f949bfff640 1 -- 172.21.15.52:0/2504508793 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7f94a80847c0 con 0x7f94b4102c00 2024-09-06T14:41:51.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.982+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f949c06de30 msgr2=0x7f949c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:51.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.982+0000 7f94b9083640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f949c06de30 0x7f949c0702f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005fd0 tx=0x7f94a400b390 comp rx=0 tx=0).stop 2024-09-06T14:41:51.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.982+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 msgr2=0x7f94b419e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:51.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.982+0000 7f94b9083640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b419e020 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f94a8006010 tx=0x7f94a80046c0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.982+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 shutdown_connections 2024-09-06T14:41:51.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.983+0000 7f94b9083640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f949c06de30 0x7f949c0702f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.983+0000 7f94b9083640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f94b4102c00 0x7f94b419e020 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.983+0000 7f94b9083640 1 --2- 172.21.15.52:0/2504508793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f94b40ffc20 0x7f94b419dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:51.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.983+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 >> 172.21.15.52:0/2504508793 conn(0x7f94b40fb770 msgr2=0x7f94b41040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:51.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.983+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 shutdown_connections 2024-09-06T14:41:51.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:51.983+0000 7f94b9083640 1 -- 172.21.15.52:0/2504508793 wait complete. 2024-09-06T14:41:52.250 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: Deploying daemon mds.cephfs.smithi165.nmjcsh on smithi165 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6826/974570891,v1:172.21.15.52:6827/974570891] up:boot 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: daemon mds.cephfs.smithi052.dfprfm assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: Cluster is now healthy 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: fsmap cephfs:0 1 up:standby 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: fsmap cephfs:1 {0=cephfs.smithi052.dfprfm=up:creating} 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: daemon mds.cephfs.smithi052.dfprfm is now active in filesystem cephfs as rank 0 2024-09-06T14:41:52.251 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:51 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2504508793' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-06T14:41:52.337 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: Deploying daemon mds.cephfs.smithi165.nmjcsh on smithi165 2024-09-06T14:41:52.337 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6826/974570891,v1:172.21.15.52:6827/974570891] up:boot 2024-09-06T14:41:52.337 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: daemon mds.cephfs.smithi052.dfprfm assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-06T14:41:52.337 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-06T14:41:52.337 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-06T14:41:52.337 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: Cluster is now healthy 2024-09-06T14:41:52.338 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: fsmap cephfs:0 1 up:standby 2024-09-06T14:41:52.338 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:41:52.338 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: fsmap cephfs:1 {0=cephfs.smithi052.dfprfm=up:creating} 2024-09-06T14:41:52.338 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: daemon mds.cephfs.smithi052.dfprfm is now active in filesystem cephfs as rank 0 2024-09-06T14:41:52.338 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:51 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2504508793' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-06T14:41:52.804 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T14:41:52.819 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:41:52.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-06T14:41:53.079 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:53.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:52 smithi052 ceph-mon[28627]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-06T14:41:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:52 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2504508793' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-06T14:41:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:52 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6826/974570891,v1:172.21.15.52:6827/974570891] up:active 2024-09-06T14:41:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:52 smithi052 ceph-mon[28627]: fsmap cephfs:1 {0=cephfs.smithi052.dfprfm=up:active} 2024-09-06T14:41:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:52 smithi052 ceph-mon[28627]: pgmap v174: 65 pgs: 53 active+clean, 12 creating+peering; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:53.197 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:52 smithi165 ceph-mon[36229]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-06T14:41:53.197 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:52 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2504508793' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-06T14:41:53.197 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:52 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6826/974570891,v1:172.21.15.52:6827/974570891] up:active 2024-09-06T14:41:53.197 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:52 smithi165 ceph-mon[36229]: fsmap cephfs:1 {0=cephfs.smithi052.dfprfm=up:active} 2024-09-06T14:41:53.197 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:52 smithi165 ceph-mon[36229]: pgmap v174: 65 pgs: 53 active+clean, 12 creating+peering; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:41:53.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 -- 172.21.15.52:0/2839333796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 msgr2=0x7fed08103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:53.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/2839333796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08103070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009880 tx=0x7fecf002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 -- 172.21.15.52:0/2839333796 shutdown_connections 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/2839333796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08103070 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/2839333796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed080ffc10 0x7fed08100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 -- 172.21.15.52:0/2839333796 >> 172.21.15.52:0/2839333796 conn(0x7fed080fb760 msgr2=0x7fed080fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 -- 172.21.15.52:0/2839333796 shutdown_connections 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.537+0000 7fed0d9fa640 1 -- 172.21.15.52:0/2839333796 wait complete. 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fed0d9fa640 1 Processor -- start 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fed0d9fa640 1 -- start start 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fed0d9fa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed080ffc10 0x7fed081974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:53.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fed0d9fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fed0d9fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed0810a790 con 0x7fed08102bf0 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fed0d9fa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fed0810a610 con 0x7fed080ffc10 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fecfffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.538+0000 7fecfffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44058/0 (socket says 172.21.15.52:44058) 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fecfffff640 1 -- 172.21.15.52:0/359386197 learned_addr learned my addr 172.21.15.52:0/359386197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fed06ffd640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed080ffc10 0x7fed081974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fecfffff640 1 -- 172.21.15.52:0/359386197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed080ffc10 msgr2=0x7fed081974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fecfffff640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed080ffc10 0x7fed081974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fecfffff640 1 -- 172.21.15.52:0/359386197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed08198080 con 0x7fed08102bf0 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fecfffff640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08197a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fecf0006010 tx=0x7fecf0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fed0c9f8640 1 -- 172.21.15.52:0/359386197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fecf003f070 con 0x7fed08102bf0 2024-09-06T14:41:53.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0819ca60 con 0x7fed08102bf0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fed0c9f8640 1 -- 172.21.15.52:0/359386197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fecf00049d0 con 0x7fed08102bf0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fed0c9f8640 1 -- 172.21.15.52:0/359386197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fecf0035030 con 0x7fed08102bf0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.539+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0819cff0 con 0x7fed08102bf0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.541+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed08100010 con 0x7fed08102bf0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.541+0000 7fed0c9f8640 1 -- 172.21.15.52:0/359386197 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fecf0042070 con 0x7fed08102bf0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.542+0000 7fed0c9f8640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fecf406de30 0x7fecf40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.542+0000 7fed0c9f8640 1 -- 172.21.15.52:0/359386197 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fecf00ae6f0 con 0x7fed08102bf0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.542+0000 7fed06ffd640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fecf406de30 0x7fecf40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.542+0000 7fed06ffd640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fecf406de30 0x7fecf40702f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed08069aa0 tx=0x7fecf8005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:53.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.546+0000 7fed0c9f8640 1 -- 172.21.15.52:0/359386197 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fecf007ff40 con 0x7fed08102bf0 2024-09-06T14:41:53.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.763+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fed08062df0 con 0x7fed08102bf0 2024-09-06T14:41:53.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.981+0000 7fed0c9f8640 1 -- 172.21.15.52:0/359386197 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v6) ==== 121+0+0 (secure 0 0 0) 0x7fecf0084770 con 0x7fed08102bf0 2024-09-06T14:41:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fecf406de30 msgr2=0x7fecf40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fecf406de30 0x7fecf40702f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fed08069aa0 tx=0x7fecf8005f90 comp rx=0 tx=0).stop 2024-09-06T14:41:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 msgr2=0x7fed08197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08197a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fecf0006010 tx=0x7fecf0004570 comp rx=0 tx=0).stop 2024-09-06T14:41:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 shutdown_connections 2024-09-06T14:41:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fecf406de30 0x7fecf40702f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:53.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed08102bf0 0x7fed08197a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:53.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 --2- 172.21.15.52:0/359386197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fed080ffc10 0x7fed081974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:53.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 >> 172.21.15.52:0/359386197 conn(0x7fed080fb760 msgr2=0x7fed08106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:53.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 shutdown_connections 2024-09-06T14:41:53.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:53.983+0000 7fed0d9fa640 1 -- 172.21.15.52:0/359386197 wait complete. 2024-09-06T14:41:54.326 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:54.326 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:54.326 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:54.326 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.eqtxfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:54.326 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.eqtxfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:54.326 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:54.326 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: Deploying daemon mds.cephfs.smithi052.eqtxfx on smithi052 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/359386197' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/359386197' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] up:boot 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: daemon mds.cephfs.smithi165.nmjcsh assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: fsmap cephfs:1 {0=cephfs.smithi052.dfprfm=up:active} 1 up:standby 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"}]: dispatch 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:creating} 2024-09-06T14:41:54.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:54 smithi052 ceph-mon[28627]: daemon mds.cephfs.smithi165.nmjcsh is now active in filesystem cephfs as rank 1 2024-09-06T14:41:54.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:54.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:54.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:54.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.eqtxfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.eqtxfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: Deploying daemon mds.cephfs.smithi052.eqtxfx on smithi052 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/359386197' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/359386197' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] up:boot 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: daemon mds.cephfs.smithi165.nmjcsh assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: fsmap cephfs:1 {0=cephfs.smithi052.dfprfm=up:active} 1 up:standby 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"}]: dispatch 2024-09-06T14:41:54.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:creating} 2024-09-06T14:41:54.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:54 smithi165 ceph-mon[36229]: daemon mds.cephfs.smithi165.nmjcsh is now active in filesystem cephfs as rank 1 2024-09-06T14:41:54.938 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T14:41:54.947 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:41:54.947 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-06T14:41:55.438 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:55.560 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:55 smithi052 ceph-mon[28627]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-06T14:41:55.560 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:55 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] up:active 2024-09-06T14:41:55.560 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:55 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2024-09-06T14:41:55.560 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:55.560 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:55 smithi165 ceph-mon[36229]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-06T14:41:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:55 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] up:active 2024-09-06T14:41:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:55 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2024-09-06T14:41:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:41:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 -- 172.21.15.52:0/2894155798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 msgr2=0x7fb8581003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 --2- 172.21.15.52:0/2894155798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb8581003e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb84800a990 tx=0x7fb84802b7d0 comp rx=0 tx=0).stop 2024-09-06T14:41:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 -- 172.21.15.52:0/2894155798 shutdown_connections 2024-09-06T14:41:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 --2- 172.21.15.52:0/2894155798 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8581011e0 0x7fb858101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 --2- 172.21.15.52:0/2894155798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb8581003e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 -- 172.21.15.52:0/2894155798 >> 172.21.15.52:0/2894155798 conn(0x7fb8580fb770 msgr2=0x7fb8580fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 -- 172.21.15.52:0/2894155798 shutdown_connections 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 -- 172.21.15.52:0/2894155798 wait complete. 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 Processor -- start 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.071+0000 7fb85e925640 1 -- start start 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb85e925640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb858197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb85e925640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8581011e0 0x7fb8581979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb85e925640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb858108520 con 0x7fb8580fffe0 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb85e925640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb8581083a0 con 0x7fb8581011e0 2024-09-06T14:41:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb857fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb858197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb857fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb858197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44080/0 (socket says 172.21.15.52:44080) 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb857fff640 1 -- 172.21.15.52:0/4168644252 learned_addr learned my addr 172.21.15.52:0/4168644252 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb857fff640 1 -- 172.21.15.52:0/4168644252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8581011e0 msgr2=0x7fb8581979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb857fff640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8581011e0 0x7fb8581979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb857fff640 1 -- 172.21.15.52:0/4168644252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb858197fa0 con 0x7fb8580fffe0 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb857fff640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb858197470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb848036040 tx=0x7fb848004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb855ffb640 1 -- 172.21.15.52:0/4168644252 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb848044020 con 0x7fb8580fffe0 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb855ffb640 1 -- 172.21.15.52:0/4168644252 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8480044d0 con 0x7fb8580fffe0 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.072+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85819c9b0 con 0x7fb8580fffe0 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.073+0000 7fb855ffb640 1 -- 172.21.15.52:0/4168644252 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb848003820 con 0x7fb8580fffe0 2024-09-06T14:41:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.073+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85819cf90 con 0x7fb8580fffe0 2024-09-06T14:41:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.074+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb858108d00 con 0x7fb8580fffe0 2024-09-06T14:41:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.074+0000 7fb855ffb640 1 -- 172.21.15.52:0/4168644252 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fb848047020 con 0x7fb8580fffe0 2024-09-06T14:41:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.074+0000 7fb855ffb640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb84406de90 0x7fb844070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.075+0000 7fb84ffff640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb84406de90 0x7fb844070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.075+0000 7fb855ffb640 1 -- 172.21.15.52:0/4168644252 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fb8480af010 con 0x7fb8580fffe0 2024-09-06T14:41:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.075+0000 7fb84ffff640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb84406de90 0x7fb844070350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb858198920 tx=0x7fb840005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:56.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.079+0000 7fb855ffb640 1 -- 172.21.15.52:0/4168644252 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb84804e020 con 0x7fb8580fffe0 2024-09-06T14:41:56.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.297+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb85802db00 con 0x7fb8580fffe0 2024-09-06T14:41:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.311+0000 7fb855ffb640 1 -- 172.21.15.52:0/4168644252 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) ==== 168+0+0 (secure 0 0 0) 0x7fb84807cc30 con 0x7fb8580fffe0 2024-09-06T14:41:56.308 INFO:teuthology.orchestra.run.smithi052.stderr:inline data enabled 2024-09-06T14:41:56.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb84406de90 msgr2=0x7fb844070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:56.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb84406de90 0x7fb844070350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb858198920 tx=0x7fb840005c70 comp rx=0 tx=0).stop 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 msgr2=0x7fb858197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb858197470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb848036040 tx=0x7fb848004270 comp rx=0 tx=0).stop 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 shutdown_connections 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fb84406de90 0x7fb844070350 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb8581011e0 0x7fb8581979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 --2- 172.21.15.52:0/4168644252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8580fffe0 0x7fb858197470 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 >> 172.21.15.52:0/4168644252 conn(0x7fb8580fb770 msgr2=0x7fb8581046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 shutdown_connections 2024-09-06T14:41:56.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:56.313+0000 7fb85e925640 1 -- 172.21.15.52:0/4168644252 wait complete. 2024-09-06T14:41:56.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:56 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/4168644252' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-06T14:41:56.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:56 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4168644252' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-06T14:41:57.299 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T14:41:57.309 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:41:57.309 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-06T14:41:57.567 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s wr, 7 op/s 2024-09-06T14:41:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/4168644252' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.zpunux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.zpunux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:57.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s wr, 7 op/s 2024-09-06T14:41:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4168644252' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.zpunux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.zpunux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-06T14:41:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:41:58.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 -- 172.21.15.52:0/3627608442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 msgr2=0x7ff3cc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:58.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 --2- 172.21.15.52:0/3627608442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc100c60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009880 tx=0x7ff3c802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 -- 172.21.15.52:0/3627608442 shutdown_connections 2024-09-06T14:41:58.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 --2- 172.21.15.52:0/3627608442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3cc101a60 0x7ff3cc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 --2- 172.21.15.52:0/3627608442 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc100c60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 -- 172.21.15.52:0/3627608442 >> 172.21.15.52:0/3627608442 conn(0x7ff3cc0fc010 msgr2=0x7ff3cc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 -- 172.21.15.52:0/3627608442 shutdown_connections 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.002+0000 7ff3d4772640 1 -- 172.21.15.52:0/3627608442 wait complete. 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d4772640 1 Processor -- start 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d4772640 1 -- start start 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d4772640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d4772640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3cc101a60 0x7ff3cc197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d4772640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1096a0 con 0x7ff3cc100860 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d4772640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc109520 con 0x7ff3cc101a60 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d250e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d250e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44118/0 (socket says 172.21.15.52:44118) 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d250e640 1 -- 172.21.15.52:0/2798544786 learned_addr learned my addr 172.21.15.52:0/2798544786 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d1d0d640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3cc101a60 0x7ff3cc197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d250e640 1 -- 172.21.15.52:0/2798544786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3cc101a60 msgr2=0x7ff3cc197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d250e640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3cc101a60 0x7ff3cc197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d250e640 1 -- 172.21.15.52:0/2798544786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc198110 con 0x7ff3cc100860 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d1d0d640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3cc101a60 0x7ff3cc197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.003+0000 7ff3d250e640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc197550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009230 tx=0x7ff3c80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.004+0000 7ff3c37fe640 1 -- 172.21.15.52:0/2798544786 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3c803f070 con 0x7ff3cc100860 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.004+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc19ca80 con 0x7ff3cc100860 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.004+0000 7ff3c37fe640 1 -- 172.21.15.52:0/2798544786 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3c8004a50 con 0x7ff3cc100860 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.004+0000 7ff3c37fe640 1 -- 172.21.15.52:0/2798544786 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff3c8035030 con 0x7ff3cc100860 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.004+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc19d010 con 0x7ff3cc100860 2024-09-06T14:41:58.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.005+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc100c60 con 0x7ff3cc100860 2024-09-06T14:41:58.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.005+0000 7ff3c37fe640 1 -- 172.21.15.52:0/2798544786 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7ff3c8042070 con 0x7ff3cc100860 2024-09-06T14:41:58.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.006+0000 7ff3c37fe640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff3b806de30 0x7ff3b80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:58.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.006+0000 7ff3c37fe640 1 -- 172.21.15.52:0/2798544786 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7ff3c80ae890 con 0x7ff3cc100860 2024-09-06T14:41:58.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.006+0000 7ff3d1d0d640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff3b806de30 0x7ff3b80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:58.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.006+0000 7ff3d1d0d640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff3b806de30 0x7ff3b80702f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc198990 tx=0x7ff3bc005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:58.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.010+0000 7ff3c37fe640 1 -- 172.21.15.52:0/2798544786 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3c807c390 con 0x7ff3cc100860 2024-09-06T14:41:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.221+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff3cc1068a0 con 0x7ff3cc100860 2024-09-06T14:41:58.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.222+0000 7ff3c37fe640 1 -- 172.21.15.52:0/2798544786 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) ==== 76+0+1821 (secure 0 0 0) 0x7ff3c8080040 con 0x7ff3cc100860 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:e11 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:41:57:315072+0000 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 11 2024-09-06T14:41:58.220 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:41:57.315058+0000 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:41:58.221 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 0 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14564,1=24277} 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:41:58.222 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14564 members: 24277,14564 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14564} state up:active seq 2 addr [v2:172.21.15.52:6826/974570891,v1:172.21.15.52:6827/974570891] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:standby-replay seq 1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 2 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:58.223 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:41:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 11 2024-09-06T14:41:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.223+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff3b806de30 msgr2=0x7ff3b80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.223+0000 7ff3d4772640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff3b806de30 0x7ff3b80702f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc198990 tx=0x7ff3bc005e50 comp rx=0 tx=0).stop 2024-09-06T14:41:58.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.223+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 msgr2=0x7ff3cc197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.223+0000 7ff3d4772640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc197550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009230 tx=0x7ff3c80045c0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.223+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 shutdown_connections 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.223+0000 7ff3d4772640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7ff3b806de30 0x7ff3b80702f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.223+0000 7ff3d4772640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3cc101a60 0x7ff3cc197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.224+0000 7ff3d4772640 1 --2- 172.21.15.52:0/2798544786 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3cc100860 0x7ff3cc197550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.224+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 >> 172.21.15.52:0/2798544786 conn(0x7ff3cc0fc010 msgr2=0x7ff3cc0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.224+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 shutdown_connections 2024-09-06T14:41:58.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:58.224+0000 7ff3d4772640 1 -- 172.21.15.52:0/2798544786 wait complete. 2024-09-06T14:41:58.505 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:58 smithi052 ceph-mon[28627]: Deploying daemon mds.cephfs.smithi165.zpunux on smithi165 2024-09-06T14:41:58.505 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:58 smithi052 ceph-mon[28627]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-06T14:41:58.505 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:58 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:boot 2024-09-06T14:41:58.505 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:58 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby 2024-09-06T14:41:58.505 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:58 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"}]: dispatch 2024-09-06T14:41:58.505 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:58 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 2024-09-06T14:41:58.506 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:58 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2798544786' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-06T14:41:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:58 smithi165 ceph-mon[36229]: Deploying daemon mds.cephfs.smithi165.zpunux on smithi165 2024-09-06T14:41:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:58 smithi165 ceph-mon[36229]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-06T14:41:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:58 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:boot 2024-09-06T14:41:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:58 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby 2024-09-06T14:41:58.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:58 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"}]: dispatch 2024-09-06T14:41:58.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:58 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 2024-09-06T14:41:58.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:58 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2798544786' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-06T14:41:58.892 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-06T14:41:59.160 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:41:59.398 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:41:59 smithi165 ceph-mon[36229]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-06T14:41:59.537 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:41:59 smithi052 ceph-mon[28627]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 716 B/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-06T14:41:59.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.780+0000 7fd8992f8640 1 -- 172.21.15.52:0/307837302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894102b70 msgr2=0x7fd894102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.780+0000 7fd8992f8640 1 --2- 172.21.15.52:0/307837302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894102b70 0x7fd894102ff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd888009880 tx=0x7fd88802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 -- 172.21.15.52:0/307837302 shutdown_connections 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 --2- 172.21.15.52:0/307837302 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894102b70 0x7fd894102ff0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 --2- 172.21.15.52:0/307837302 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd894101970 0x7fd894101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 -- 172.21.15.52:0/307837302 >> 172.21.15.52:0/307837302 conn(0x7fd8940fd140 msgr2=0x7fd8940ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 -- 172.21.15.52:0/307837302 shutdown_connections 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 -- 172.21.15.52:0/307837302 wait complete. 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 Processor -- start 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 -- start start 2024-09-06T14:41:59.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.781+0000 7fd8992f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894101970 0x7fd894075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd8992f8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd894102b70 0x7fd8940745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd8992f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd89410a7b0 con 0x7fd894101970 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd8992f8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd89410a630 con 0x7fd894102b70 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd892ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894101970 0x7fd894075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd892ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894101970 0x7fd894075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44132/0 (socket says 172.21.15.52:44132) 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd892ffd640 1 -- 172.21.15.52:0/3161358988 learned_addr learned my addr 172.21.15.52:0/3161358988 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd8927fc640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd894102b70 0x7fd8940745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd892ffd640 1 -- 172.21.15.52:0/3161358988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd894102b70 msgr2=0x7fd8940745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd892ffd640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd894102b70 0x7fd8940745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd892ffd640 1 -- 172.21.15.52:0/3161358988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd894074b20 con 0x7fd894101970 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd892ffd640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894101970 0x7fd894075f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd88400e940 tx=0x7fd88400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:59.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd87bfff640 1 -- 172.21.15.52:0/3161358988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd88400cac0 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd87bfff640 1 -- 172.21.15.52:0/3161358988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd88400cc60 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd894074e10 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd87bfff640 1 -- 172.21.15.52:0/3161358988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd884003e30 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.782+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd894075370 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.783+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd894101d70 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.784+0000 7fd87bfff640 1 -- 172.21.15.52:0/3161358988 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fd884004000 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.784+0000 7fd87bfff640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd87c06de30 0x7fd87c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.785+0000 7fd8927fc640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd87c06de30 0x7fd87c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.785+0000 7fd87bfff640 1 -- 172.21.15.52:0/3161358988 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fd88408e160 con 0x7fd894101970 2024-09-06T14:41:59.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.785+0000 7fd8927fc640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd87c06de30 0x7fd87c0702f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd888000c00 tx=0x7fd8880058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:41:59.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:41:59.789+0000 7fd87bfff640 1 -- 172.21.15.52:0/3161358988 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd88405bc60 con 0x7fd894101970 2024-09-06T14:42:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.009+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd89402db50 con 0x7fd894101970 2024-09-06T14:42:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.010+0000 7fd87bfff640 1 -- 172.21.15.52:0/3161358988 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+4500 (secure 0 0 0) 0x7fd88405f910 con 0x7fd894101970 2024-09-06T14:42:00.007 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 11 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd87c06de30 msgr2=0x7fd87c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd87c06de30 0x7fd87c0702f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd888000c00 tx=0x7fd8880058d0 comp rx=0 tx=0).stop 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894101970 msgr2=0x7fd894075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894101970 0x7fd894075f20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd88400e940 tx=0x7fd88400ee00 comp rx=0 tx=0).stop 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 shutdown_connections 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fd87c06de30 0x7fd87c0702f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd894102b70 0x7fd8940745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 --2- 172.21.15.52:0/3161358988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd894101970 0x7fd894075f20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 >> 172.21.15.52:0/3161358988 conn(0x7fd8940fd140 msgr2=0x7fd894106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 shutdown_connections 2024-09-06T14:42:00.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:00.012+0000 7fd8992f8640 1 -- 172.21.15.52:0/3161358988 wait complete. 2024-09-06T14:42:00.018 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3161358988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 707 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] up:boot 2024-09-06T14:42:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:00.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"}]: dispatch 2024-09-06T14:42:00.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:00 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:42:00.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3161358988' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 707 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] up:boot 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"}]: dispatch 2024-09-06T14:42:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:00 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:42:01.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-06T14:42:01.729 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:01 smithi052 ceph-mon[28627]: Dropping low affinity active daemon mds.cephfs.smithi052.dfprfm in favor of higher affinity standby. 2024-09-06T14:42:01.729 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:01 smithi052 ceph-mon[28627]: Replacing daemon mds.cephfs.smithi052.dfprfm as rank 0 with standby daemon mds.cephfs.smithi052.eqtxfx 2024-09-06T14:42:01.729 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:01 smithi052 ceph-mon[28627]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-06T14:42:01.729 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:01 smithi052 ceph-mon[28627]: osdmap e46: 6 total, 6 up, 6 in 2024-09-06T14:42:01.729 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:01 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:standby-replay 2024-09-06T14:42:01.730 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:01 smithi052 ceph-mon[28627]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:replay,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 2024-09-06T14:42:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:01 smithi165 ceph-mon[36229]: Dropping low affinity active daemon mds.cephfs.smithi052.dfprfm in favor of higher affinity standby. 2024-09-06T14:42:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:01 smithi165 ceph-mon[36229]: Replacing daemon mds.cephfs.smithi052.dfprfm as rank 0 with standby daemon mds.cephfs.smithi052.eqtxfx 2024-09-06T14:42:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:01 smithi165 ceph-mon[36229]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-06T14:42:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:01 smithi165 ceph-mon[36229]: osdmap e46: 6 total, 6 up, 6 in 2024-09-06T14:42:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:01 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:standby-replay 2024-09-06T14:42:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:01 smithi165 ceph-mon[36229]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:replay,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 2024-09-06T14:42:02.263 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:02.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:02.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:02.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] up:boot 2024-09-06T14:42:02.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:resolve 2024-09-06T14:42:02.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] up:active 2024-09-06T14:42:02.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:resolve,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:02.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:42:02.807 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:02 smithi052 ceph-mon[28627]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-06T14:42:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] up:boot 2024-09-06T14:42:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:resolve 2024-09-06T14:42:03.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] up:active 2024-09-06T14:42:03.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:resolve,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:03.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:42:03.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:02 smithi165 ceph-mon[36229]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-09-06T14:42:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2405530373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 msgr2=0x7fbc10101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2405530373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc10101650 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8009880 tx=0x7fbbf802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2405530373 shutdown_connections 2024-09-06T14:42:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2405530373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc10101650 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2405530373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc100fffd0 0x7fbc101003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2405530373 >> 172.21.15.52:0/2405530373 conn(0x7fbc100fb760 msgr2=0x7fbc100fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2405530373 shutdown_connections 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.333+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2405530373 wait complete. 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc16a5a640 1 Processor -- start 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc16a5a640 1 -- start start 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc16a5a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc100fffd0 0x7fbc100fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc16a5a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc1019c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc16a5a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10108df0 con 0x7fbc101011d0 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc16a5a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10108c70 con 0x7fbc100fffd0 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc07fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc1019c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc07fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc1019c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50418/0 (socket says 172.21.15.52:50418) 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc07fff640 1 -- 172.21.15.52:0/2210604243 learned_addr learned my addr 172.21.15.52:0/2210604243 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:03.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.334+0000 7fbc0ffff640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc100fffd0 0x7fbc100fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc07fff640 1 -- 172.21.15.52:0/2210604243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc100fffd0 msgr2=0x7fbc100fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc07fff640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc100fffd0 0x7fbc100fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc07fff640 1 -- 172.21.15.52:0/2210604243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1019c7e0 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc07fff640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc1019c220 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8006010 tx=0x7fbbf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc0dffb640 1 -- 172.21.15.52:0/2210604243 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbf803f070 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1019ca70 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc0dffb640 1 -- 172.21.15.52:0/2210604243 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbbf8004ac0 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc0dffb640 1 -- 172.21.15.52:0/2210604243 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbf8035030 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.335+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1019cfa0 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.336+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc101003d0 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.337+0000 7fbc0dffb640 1 -- 172.21.15.52:0/2210604243 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fbbf8042070 con 0x7fbc101011d0 2024-09-06T14:42:03.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.337+0000 7fbc0dffb640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbbfc06de30 0x7fbbfc0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:03.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.337+0000 7fbc0ffff640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbbfc06de30 0x7fbbfc0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:03.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.337+0000 7fbc0dffb640 1 -- 172.21.15.52:0/2210604243 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fbbf80ae790 con 0x7fbc101011d0 2024-09-06T14:42:03.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.337+0000 7fbc0ffff640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbbfc06de30 0x7fbbfc0702f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005fd0 tx=0x7fbc0000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:03.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.341+0000 7fbc0dffb640 1 -- 172.21.15.52:0/2210604243 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbf807fef0 con 0x7fbc101011d0 2024-09-06T14:42:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.591+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7fbc10062df0 con 0x7fbc101011d0 2024-09-06T14:42:03.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.591+0000 7fbc0dffb640 1 -- 172.21.15.52:0/2210604243 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) ==== 78+0+98 (secure 0 0 0) 0x7fbbf8084720 con 0x7fbc101011d0 2024-09-06T14:42:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.593+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbbfc06de30 msgr2=0x7fbbfc0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.593+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbbfc06de30 0x7fbbfc0702f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005fd0 tx=0x7fbc0000b410 comp rx=0 tx=0).stop 2024-09-06T14:42:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.593+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 msgr2=0x7fbc1019c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:03.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.593+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc1019c220 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8006010 tx=0x7fbbf80046c0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.594+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 shutdown_connections 2024-09-06T14:42:03.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.594+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fbbfc06de30 0x7fbbfc0702f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.594+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc101011d0 0x7fbc1019c220 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.594+0000 7fbc16a5a640 1 --2- 172.21.15.52:0/2210604243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc100fffd0 0x7fbc100fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:03.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.594+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 >> 172.21.15.52:0/2210604243 conn(0x7fbc100fb760 msgr2=0x7fbc10104c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:03.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.594+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 shutdown_connections 2024-09-06T14:42:03.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:03.594+0000 7fbc16a5a640 1 -- 172.21.15.52:0/2210604243 wait complete. 2024-09-06T14:42:03.600 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:42:04.276 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:04 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:reconnect 2024-09-06T14:42:04.277 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:04 smithi052 ceph-mon[28627]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:reconnect,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:04.277 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:04 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2210604243' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-06T14:42:04.306 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-06T14:42:04.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 2024-09-06T14:42:04.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:04 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:reconnect 2024-09-06T14:42:04.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:04 smithi165 ceph-mon[36229]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:reconnect,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:04.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:04 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2210604243' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-06T14:42:04.660 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:05.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:05 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:rejoin 2024-09-06T14:42:05.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:05 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] up:standby-replay 2024-09-06T14:42:05.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:05 smithi052 ceph-mon[28627]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:rejoin,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:05.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:05 smithi052 ceph-mon[28627]: daemon mds.cephfs.smithi052.eqtxfx is now active in filesystem cephfs as rank 0 2024-09-06T14:42:05.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:05 smithi052 ceph-mon[28627]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-06T14:42:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:05 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:rejoin 2024-09-06T14:42:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:05 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] up:standby-replay 2024-09-06T14:42:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:05 smithi165 ceph-mon[36229]: fsmap cephfs:2/2 {0=cephfs.smithi052.eqtxfx=up:rejoin,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:05 smithi165 ceph-mon[36229]: daemon mds.cephfs.smithi052.eqtxfx is now active in filesystem cephfs as rank 0 2024-09-06T14:42:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:05 smithi165 ceph-mon[36229]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.793+0000 7f8d71760640 1 -- 172.21.15.52:0/251615485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c1033d0 msgr2=0x7f8d6c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.793+0000 7f8d71760640 1 --2- 172.21.15.52:0/251615485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c1033d0 0x7f8d6c10b8c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009880 tx=0x7f8d5402a530 comp rx=0 tx=0).stop 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.793+0000 7f8d71760640 1 -- 172.21.15.52:0/251615485 shutdown_connections 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.793+0000 7f8d71760640 1 --2- 172.21.15.52:0/251615485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c1033d0 0x7f8d6c10b8c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.793+0000 7f8d71760640 1 --2- 172.21.15.52:0/251615485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d6c102ab0 0x7f8d6c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.793+0000 7f8d71760640 1 -- 172.21.15.52:0/251615485 >> 172.21.15.52:0/251615485 conn(0x7f8d6c0fc550 msgr2=0x7f8d6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 -- 172.21.15.52:0/251615485 shutdown_connections 2024-09-06T14:42:05.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 -- 172.21.15.52:0/251615485 wait complete. 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 Processor -- start 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 -- start start 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c102ab0 0x7f8d6c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d6c1033d0 0x7f8d6c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c10edc0 con 0x7f8d6c102ab0 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.794+0000 7f8d71760640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c10ec40 con 0x7f8d6c1033d0 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c102ab0 0x7f8d6c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c102ab0 0x7f8d6c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50446/0 (socket says 172.21.15.52:50446) 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6affd640 1 -- 172.21.15.52:0/73465510 learned_addr learned my addr 172.21.15.52:0/73465510 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6a7fc640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d6c1033d0 0x7f8d6c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6affd640 1 -- 172.21.15.52:0/73465510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d6c1033d0 msgr2=0x7f8d6c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:05.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6affd640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d6c1033d0 0x7f8d6c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6affd640 1 -- 172.21.15.52:0/73465510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c101190 con 0x7f8d6c102ab0 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d6affd640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c102ab0 0x7f8d6c100710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c810 tx=0x7f8d6400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d63fff640 1 -- 172.21.15.52:0/73465510 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d64004020 con 0x7f8d6c102ab0 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d63fff640 1 -- 172.21.15.52:0/73465510 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d640041c0 con 0x7f8d6c102ab0 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c101480 con 0x7f8d6c102ab0 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d63fff640 1 -- 172.21.15.52:0/73465510 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d640047a0 con 0x7f8d6c102ab0 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.795+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1a3e10 con 0x7f8d6c102ab0 2024-09-06T14:42:05.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.796+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c06a580 con 0x7f8d6c102ab0 2024-09-06T14:42:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.797+0000 7f8d63fff640 1 -- 172.21.15.52:0/73465510 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f8d640079b0 con 0x7f8d6c102ab0 2024-09-06T14:42:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.797+0000 7f8d63fff640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8d5806de30 0x7f8d580702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.797+0000 7f8d63fff640 1 -- 172.21.15.52:0/73465510 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f8d6408db80 con 0x7f8d6c102ab0 2024-09-06T14:42:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.797+0000 7f8d6a7fc640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8d5806de30 0x7f8d580702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:05.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.798+0000 7f8d6a7fc640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8d5806de30 0x7f8d580702f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c1021a0 tx=0x7f8d54031420 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:05.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:05.802+0000 7f8d63fff640 1 -- 172.21.15.52:0/73465510 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d64014030 con 0x7f8d6c102ab0 2024-09-06T14:42:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.025+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d6c102e90 con 0x7f8d6c102ab0 2024-09-06T14:42:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.025+0000 7f8d63fff640 1 -- 172.21.15.52:0/73465510 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5353 (secure 0 0 0) 0x7f8d6405b620 con 0x7f8d6c102ab0 2024-09-06T14:42:06.023 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:42:06.023 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":19,"btime":"2024-09-06T14:42:05:098083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:42:05.098067+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14584,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14584":{"gid":14584,"name":"cephfs.smithi052.eqtxfx","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.52:6829/1318417598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1318417598},{"type":"v1","addr":"172.21.15.52:6829","nonce":1318417598}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14600":{"gid":14600,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6827/125679698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":125679698},{"type":"v1","addr":"172.21.15.52:6827","nonce":125679698}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi165.nmjcsh","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.165:6825/3417309574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3417309574},{"type":"v1","addr":"172.21.15.165:6825","nonce":3417309574}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24287":{"gid":24287,"name":"cephfs.smithi165.zpunux","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.165:6827/373761611","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":373761611},{"type":"v1","addr":"172.21.15.165:6827","nonce":373761611}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14584,"qdb_cluster":[24277,14584]},"id":1}]} 2024-09-06T14:42:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:42:06.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8d5806de30 msgr2=0x7f8d580702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:06.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8d5806de30 0x7f8d580702f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c1021a0 tx=0x7f8d54031420 comp rx=0 tx=0).stop 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c102ab0 msgr2=0x7f8d6c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c102ab0 0x7f8d6c100710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c810 tx=0x7f8d6400ccd0 comp rx=0 tx=0).stop 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 shutdown_connections 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f8d5806de30 0x7f8d580702f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d6c1033d0 0x7f8d6c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 --2- 172.21.15.52:0/73465510 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d6c102ab0 0x7f8d6c100710 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 >> 172.21.15.52:0/73465510 conn(0x7f8d6c0fc550 msgr2=0x7f8d6c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 shutdown_connections 2024-09-06T14:42:06.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:06.028+0000 7f8d71760640 1 -- 172.21.15.52:0/73465510 wait complete. 2024-09-06T14:42:06.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:06 smithi052 ceph-mon[28627]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-06T14:42:06.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:06 smithi052 ceph-mon[28627]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:active 2024-09-06T14:42:06.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:06 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:06.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:06 smithi052 ceph-mon[28627]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:42:06.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:06.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:06 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:06.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:06 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/73465510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-06T14:42:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:06 smithi165 ceph-mon[36229]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-06T14:42:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:06 smithi165 ceph-mon[36229]: mds.? [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] up:active 2024-09-06T14:42:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:06 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 1 up:standby-replay 1 up:standby 2024-09-06T14:42:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:06 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:42:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:06 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:06 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/73465510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-06T14:42:06.702 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-06T14:42:06.702 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-06T14:42:06.775 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-06T14:42:06.775 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-06T14:42:06.776 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-06T14:42:06.776 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-06T14:42:06.776 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:06.776 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-06T14:42:06.776 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-06T14:42:06.776 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:06.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:06.776 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-06T14:42:06.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:06.793 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link delete ceph-brx 2024-09-06T14:42:06.864 INFO:teuthology.orchestra.run.smithi165.stderr:Cannot find device "ceph-brx" 2024-09-06T14:42:06.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:42:06.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:06.865 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-06T14:42:06.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:06.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link delete ceph-brx 2024-09-06T14:42:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:Cannot find device "ceph-brx" 2024-09-06T14:42:06.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T14:42:06.951 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-06T14:42:06.951 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-06T14:42:06.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs ls 2024-09-06T14:42:07.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:07 smithi165 ceph-mon[36229]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-06T14:42:07.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:42:07.153 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:42:07.154 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:07.154 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:07 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:42:07.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:07 smithi052 ceph-mon[28627]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-06T14:42:07.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:42:07.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:42:07.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:07.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:07 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:42:07.621 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:08.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 -- 172.21.15.52:0/434602268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38101010 msgr2=0x7f4e38101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:08.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 --2- 172.21.15.52:0/434602268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38101010 0x7f4e38101450 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009880 tx=0x7f4e2c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:42:08.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 -- 172.21.15.52:0/434602268 shutdown_connections 2024-09-06T14:42:08.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 --2- 172.21.15.52:0/434602268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38101010 0x7f4e38101450 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:08.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 --2- 172.21.15.52:0/434602268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e38105860 0x7f4e38105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:08.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 -- 172.21.15.52:0/434602268 >> 172.21.15.52:0/434602268 conn(0x7f4e380fbc90 msgr2=0x7f4e380fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:08.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 -- 172.21.15.52:0/434602268 shutdown_connections 2024-09-06T14:42:08.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.022+0000 7f4e3f788640 1 -- 172.21.15.52:0/434602268 wait complete. 2024-09-06T14:42:08.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3f788640 1 Processor -- start 2024-09-06T14:42:08.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3f788640 1 -- start start 2024-09-06T14:42:08.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3f788640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e38101010 0x7f4e3819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:08.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3f788640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38105860 0x7f4e3819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:08.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3f788640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3810de40 con 0x7f4e38105860 2024-09-06T14:42:08.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3f788640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3810dcc0 con 0x7f4e38101010 2024-09-06T14:42:08.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3cd23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38105860 0x7f4e3819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:08.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3cd23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38105860 0x7f4e3819dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50464/0 (socket says 172.21.15.52:50464) 2024-09-06T14:42:08.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3cd23640 1 -- 172.21.15.52:0/3218690952 learned_addr learned my addr 172.21.15.52:0/3218690952 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:08.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.023+0000 7f4e3d524640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e38101010 0x7f4e3819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:08.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e3cd23640 1 -- 172.21.15.52:0/3218690952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e38101010 msgr2=0x7f4e3819d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:08.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e3cd23640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e38101010 0x7f4e3819d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:08.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e3cd23640 1 -- 172.21.15.52:0/3218690952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e38197930 con 0x7f4e38105860 2024-09-06T14:42:08.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e3cd23640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38105860 0x7f4e3819dcb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c031460 tx=0x7f4e2c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:08.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e367fc640 1 -- 172.21.15.52:0/3218690952 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e2c03f070 con 0x7f4e38105860 2024-09-06T14:42:08.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e367fc640 1 -- 172.21.15.52:0/3218690952 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e2c0035f0 con 0x7f4e38105860 2024-09-06T14:42:08.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e38197bc0 con 0x7f4e38105860 2024-09-06T14:42:08.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e367fc640 1 -- 172.21.15.52:0/3218690952 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e2c035030 con 0x7f4e38105860 2024-09-06T14:42:08.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.024+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e381980f0 con 0x7f4e38105860 2024-09-06T14:42:08.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.025+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e38102020 con 0x7f4e38105860 2024-09-06T14:42:08.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.026+0000 7f4e367fc640 1 -- 172.21.15.52:0/3218690952 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f4e2c042070 con 0x7f4e38105860 2024-09-06T14:42:08.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.026+0000 7f4e367fc640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f4e20072240 0x7f4e20074700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:08.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.026+0000 7f4e367fc640 1 -- 172.21.15.52:0/3218690952 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f4e2c0ae580 con 0x7f4e38105860 2024-09-06T14:42:08.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.026+0000 7f4e3d524640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f4e20072240 0x7f4e20074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:08.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.027+0000 7f4e3d524640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f4e20072240 0x7f4e20074700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e38198a70 tx=0x7f4e28009500 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:08.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.031+0000 7f4e367fc640 1 -- 172.21.15.52:0/3218690952 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e2c07fd70 con 0x7f4e38105860 2024-09-06T14:42:08.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.253+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e38109d90 con 0x7f4e38105860 2024-09-06T14:42:08.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.253+0000 7f4e367fc640 1 -- 172.21.15.52:0/3218690952 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+83 (secure 0 0 0) 0x7f4e2c0845a0 con 0x7f4e38105860 2024-09-06T14:42:08.251 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-06T14:42:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f4e20072240 msgr2=0x7f4e20074700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f4e20072240 0x7f4e20074700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4e38198a70 tx=0x7f4e28009500 comp rx=0 tx=0).stop 2024-09-06T14:42:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38105860 msgr2=0x7f4e3819dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38105860 0x7f4e3819dcb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c031460 tx=0x7f4e2c004530 comp rx=0 tx=0).stop 2024-09-06T14:42:08.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 shutdown_connections 2024-09-06T14:42:08.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f4e20072240 0x7f4e20074700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:08.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e38105860 0x7f4e3819dcb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:08.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 --2- 172.21.15.52:0/3218690952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e38101010 0x7f4e3819d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:08.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 >> 172.21.15.52:0/3218690952 conn(0x7f4e380fbc90 msgr2=0x7f4e381001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:08.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 shutdown_connections 2024-09-06T14:42:08.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:08.255+0000 7f4e3f788640 1 -- 172.21.15.52:0/3218690952 wait complete. 2024-09-06T14:42:08.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:08 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3218690952' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-06T14:42:08.601 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:08 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3218690952' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi052.front.sepia.ceph.com 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-06T14:42:09.323 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-06T14:42:09.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:09.324 DEBUG:teuthology.orchestra.run.smithi052:> ip addr 2024-09-06T14:42:09.342 INFO:teuthology.orchestra.run.smithi052.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: inet 127.0.0.1/8 scope host lo 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 ::1/128 scope host 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d2 brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f0 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:6b:fd:d3 brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp7s0f1 2024-09-06T14:42:09.343 INFO:teuthology.orchestra.run.smithi052.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:de brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f0 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: inet 172.21.15.52/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft 42273sec preferred_lft 42273sec 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: inet6 fe80::b366:614:84d8:fe34/64 scope link noprefixroute 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: valid_lft forever preferred_lft forever 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: link/ether 0c:c4:7a:bd:15:df brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:09.344 INFO:teuthology.orchestra.run.smithi052.stdout: altname enp1s0f1 2024-09-06T14:42:09.345 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-06T14:42:09.345 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:09.345 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-06T14:42:09.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add name ceph-brx type bridge 2024-09-06T14:42:09.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr flush dev ceph-brx 2024-09-06T14:42:09.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set ceph-brx up 2024-09-06T14:42:09.345 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-06T14:42:09.345 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-06T14:42:09.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:09.540 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:09 smithi052 ceph-mon[28627]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T14:42:09.540 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:09 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:09.541 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:09 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:09.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:09.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:09.581 DEBUG:teuthology.orchestra.run.smithi052:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-06T14:42:09.608 INFO:teuthology.orchestra.run.smithi052.stdout:1 2024-09-06T14:42:09.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:09.610 DEBUG:teuthology.orchestra.run.smithi052:> route 2024-09-06T14:42:09.711 INFO:teuthology.orchestra.run.smithi052.stdout:Kernel IP routing table 2024-09-06T14:42:09.711 INFO:teuthology.orchestra.run.smithi052.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-06T14:42:09.711 INFO:teuthology.orchestra.run.smithi052.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-06T14:42:09.711 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-06T14:42:09.711 INFO:teuthology.orchestra.run.smithi052.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-06T14:42:09.711 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:09.712 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-06T14:42:09.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-06T14:42:09.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-06T14:42:09.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-06T14:42:09.712 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-06T14:42:09.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:09.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:09 smithi165 ceph-mon[36229]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 6.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-06T14:42:09.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:09 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:09.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:09 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:10.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:10.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:10.268 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list 2024-09-06T14:42:10.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:10.285 DEBUG:teuthology.orchestra.run.smithi052:> ip netns list-id 2024-09-06T14:42:10.342 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:10.342 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-06T14:42:10.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-06T14:42:10.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-06T14:42:10.342 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-06T14:42:10.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:10.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:10.464 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-06T14:42:10.464 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:10.464 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-06T14:42:10.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-06T14:42:10.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-06T14:42:10.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-06T14:42:10.465 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-06T14:42:10.465 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-06T14:42:10.465 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-06T14:42:10.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:10.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:10.597 DEBUG:teuthology.orchestra.run.smithi052:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:10.597 DEBUG:teuthology.orchestra.run.smithi052:> set -e 2024-09-06T14:42:10.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set brx.0 up 2024-09-06T14:42:10.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo ip link set dev brx.0 master ceph-brx 2024-09-06T14:42:10.597 DEBUG:teuthology.orchestra.run.smithi052:> ') 2024-09-06T14:42:10.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:10.674 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-06T14:42:10.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-06T14:42:10.674 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:10.689 INFO:teuthology.orchestra.run.smithi052.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-06T14:42:10.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-06T14:42:10.689 DEBUG:teuthology.orchestra.run.smithi052:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:10.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-09-06T14:42:10.812 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-09-06T14:42:10.867 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-09-06T14:42:10.868 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-06T14:42:10.869 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/382804debf5aab38e817bdce3df059dbae886092f8a2b183a5d07bce1c06d50c/merged 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/eaf7d1f778b6bd865d79ef1e62d76a9023df560b69d9e654f62ddc058c631f2f/merged 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/0 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/6faff96c705659df2585f76a431b07945accf4cfd9cfe1e4ce1480a45bb9ea9b/merged 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/9bfb5c94c1af9f31160917a35d043df355114ba9252dcb8a15b61b53c90262b5/merged 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/ec59e2595c9c03d39cdd3444cc2d74af5e4a17c6af4752e37235dc535bd9c92f/merged 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/d7004cd589bcaaf94e564e0efaa00af65baad0b4e288510ddb003b302d6ee602/merged 2024-09-06T14:42:10.870 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/9d20f969de454d12196a874323f2caa4e66340f167325feca2049b347e566f5e/merged 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/ce6c1a8c42de907b7a684ce2d3e71d4dcce06fa48a8a29be552e1f9187636b5d/merged 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/e904c89607410bf9dea0bebca0bee30e29b76ad4443f55d5334af039c8f58223/merged 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/579e7cd649d0434bbf4be56a3d448237c87899e2b05544efe42982eaddb36467/merged 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/4ed03e4052694579103d6e5477201af0c6a1da982d67239a707012b1206bc346/merged 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/e5f8bef7e6b2bc3f7f86ea6373c63f61997e3de95a818cdb99ed47c35e0ab013/merged 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/035d7f623fb45e6902c9755b7710bd48136fa3139e6114b34b399b7a2a8be688/merged 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-06T14:42:10.871 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-06T14:42:10.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:10.872 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-09-06T14:42:10.928 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-06T14:42:10.929 DEBUG:teuthology.orchestra.run.smithi052:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-06T14:42:10.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-09-06T14:42:10.996 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-09-06T14:42:11.052 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-09-06T14:42:11.052 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-09-06T14:42:11.052 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-09-06T14:42:11.052 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-09-06T14:42:11.052 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-09-06T14:42:11.053 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/382804debf5aab38e817bdce3df059dbae886092f8a2b183a5d07bce1c06d50c/merged 2024-09-06T14:42:11.054 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/eaf7d1f778b6bd865d79ef1e62d76a9023df560b69d9e654f62ddc058c631f2f/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/0 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/6faff96c705659df2585f76a431b07945accf4cfd9cfe1e4ce1480a45bb9ea9b/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/9bfb5c94c1af9f31160917a35d043df355114ba9252dcb8a15b61b53c90262b5/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/ec59e2595c9c03d39cdd3444cc2d74af5e4a17c6af4752e37235dc535bd9c92f/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/d7004cd589bcaaf94e564e0efaa00af65baad0b4e288510ddb003b302d6ee602/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/9d20f969de454d12196a874323f2caa4e66340f167325feca2049b347e566f5e/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/ce6c1a8c42de907b7a684ce2d3e71d4dcce06fa48a8a29be552e1f9187636b5d/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/e904c89607410bf9dea0bebca0bee30e29b76ad4443f55d5334af039c8f58223/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/579e7cd649d0434bbf4be56a3d448237c87899e2b05544efe42982eaddb36467/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/4ed03e4052694579103d6e5477201af0c6a1da982d67239a707012b1206bc346/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/e5f8bef7e6b2bc3f7f86ea6373c63f61997e3de95a818cdb99ed47c35e0ab013/merged 2024-09-06T14:42:11.055 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/035d7f623fb45e6902c9755b7710bd48136fa3139e6114b34b399b7a2a8be688/merged 2024-09-06T14:42:11.056 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-09-06T14:42:11.056 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-06T14:42:11.056 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-06T14:42:11.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:11.056 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-09-06T14:42:11.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:2024-09-06T14:42:11.122+0000 7effa983d480 -1 init, newargv = 0x558818221080 newargc=15 2024-09-06T14:42:11.120 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[77835]: starting ceph client 2024-09-06T14:42:11.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[77835]: starting fuse 2024-09-06T14:42:11.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:11 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:11.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:11 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:11.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:11 smithi165 ceph-mon[36229]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T14:42:11.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:11.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:11 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:11.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:11 smithi052 ceph-mon[28627]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-06T14:42:12.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo modprobe fuse 2024-09-06T14:42:12.238 DEBUG:teuthology.orchestra.run.smithi052:> cat /proc/self/mounts | awk '{print $2}' 2024-09-06T14:42:12.295 INFO:teuthology.orchestra.run.smithi052.stdout:/proc 2024-09-06T14:42:12.295 INFO:teuthology.orchestra.run.smithi052.stdout:/sys 2024-09-06T14:42:12.295 INFO:teuthology.orchestra.run.smithi052.stdout:/dev 2024-09-06T14:42:12.295 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/security 2024-09-06T14:42:12.295 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/shm 2024-09-06T14:42:12.295 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/pts 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/run 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/cgroup 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/pstore 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/bpf 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/ 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/selinux 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/hugepages 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/dev/mqueue 2024-09-06T14:42:12.296 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/debug 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/tracing 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/kernel/config 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysusers.service 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/sys/fs/fuse/connections 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-sysctl.service 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/nfs/rpc_pipefs 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/1000 2024-09-06T14:42:12.297 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/ceph 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/382804debf5aab38e817bdce3df059dbae886092f8a2b183a5d07bce1c06d50c/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/eaf7d1f778b6bd865d79ef1e62d76a9023df560b69d9e654f62ddc058c631f2f/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/run/user/0 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/6faff96c705659df2585f76a431b07945accf4cfd9cfe1e4ce1480a45bb9ea9b/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/9bfb5c94c1af9f31160917a35d043df355114ba9252dcb8a15b61b53c90262b5/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/ec59e2595c9c03d39cdd3444cc2d74af5e4a17c6af4752e37235dc535bd9c92f/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/d7004cd589bcaaf94e564e0efaa00af65baad0b4e288510ddb003b302d6ee602/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/9d20f969de454d12196a874323f2caa4e66340f167325feca2049b347e566f5e/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/ce6c1a8c42de907b7a684ce2d3e71d4dcce06fa48a8a29be552e1f9187636b5d/merged 2024-09-06T14:42:12.298 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/e904c89607410bf9dea0bebca0bee30e29b76ad4443f55d5334af039c8f58223/merged 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/579e7cd649d0434bbf4be56a3d448237c87899e2b05544efe42982eaddb36467/merged 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/4ed03e4052694579103d6e5477201af0c6a1da982d67239a707012b1206bc346/merged 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/e5f8bef7e6b2bc3f7f86ea6373c63f61997e3de95a818cdb99ed47c35e0ab013/merged 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/var/lib/containers/storage/overlay/035d7f623fb45e6902c9755b7710bd48136fa3139e6114b34b399b7a2a8be688/merged 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run.smithi052.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:12.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:12.300 DEBUG:teuthology.orchestra.run.smithi052:> ls /sys/fs/fuse/connections 2024-09-06T14:42:12.351 INFO:teuthology.orchestra.run.smithi052.stdout:154 2024-09-06T14:42:12.352 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [154] 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> sudo stdin-killer -- python3 -c ' 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> import glob 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> import re 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> import os 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> import subprocess 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> def _find_admin_socket(client_name): 2024-09-06T14:42:12.352 DEBUG:teuthology.orchestra.run.smithi052:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> files = glob.glob(asok_path) 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> # Given a non-glob path, it better be there 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> if "*" not in asok_path: 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> assert(len(files) == 1) 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> return files[0] 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> for f in files: 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-06T14:42:12.353 DEBUG:teuthology.orchestra.run.smithi052:> contents = proc_f.read() 2024-09-06T14:42:12.354 DEBUG:teuthology.orchestra.run.smithi052:> if mountpoint in contents: 2024-09-06T14:42:12.354 DEBUG:teuthology.orchestra.run.smithi052:> return f 2024-09-06T14:42:12.354 DEBUG:teuthology.orchestra.run.smithi052:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-06T14:42:12.354 DEBUG:teuthology.orchestra.run.smithi052:> 2024-09-06T14:42:12.354 DEBUG:teuthology.orchestra.run.smithi052:> print(_find_admin_socket("client.0")) 2024-09-06T14:42:12.354 DEBUG:teuthology.orchestra.run.smithi052:> ' 2024-09-06T14:42:12.472 INFO:teuthology.orchestra.run.smithi052.stdout:/var/run/ceph/ceph-client.0.77835.asok 2024-09-06T14:42:12.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:12.486 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.77835.asok 2024-09-06T14:42:12.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:12.487 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.77835.asok status 2024-09-06T14:42:12.622 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:42:12.622 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": { 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_sha1": "635ed4cf3404d66f56069c438a5e3af26e0ed5be", 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)", 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "entity_id": "0", 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "hostname": "smithi052", 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "pid": "77835", 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "root": "/" 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_count": 0, 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "dentry_pinned_count": 0, 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 14616, 2024-09-06T14:42:12.623 INFO:teuthology.orchestra.run.smithi052.stdout: "inst": { 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "name": { 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "client", 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "num": 14616 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3950046951 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": { 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-09-06T14:42:12.624 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "192.168.0.1:0", 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 3950046951 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "inst_str": "client.14616 192.168.0.1:0/3950046951", 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "addr_str": "192.168.0.1:0/3950046951", 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "inode_count": 1, 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_epoch": 19, 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch": 46, 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_epoch_barrier": 0, 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklisted": false, 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs" 2024-09-06T14:42:12.625 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:42:12.631 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-06T14:42:12.631 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs ls 2024-09-06T14:42:12.882 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:13.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:12 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:13.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:12 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:13.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:12 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:42:13.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:12 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:42:13.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:12 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:13.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:12 smithi052 ceph-mon[28627]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-06T14:42:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:12 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:12 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:12 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:42:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:12 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:42:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:12 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:12 smithi165 ceph-mon[36229]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.9 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 -- 172.21.15.52:0/2374243218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c103450 msgr2=0x7fda6c10b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 --2- 172.21.15.52:0/2374243218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c103450 0x7fda6c10b940 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda54009880 tx=0x7fda5402a530 comp rx=0 tx=0).stop 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 -- 172.21.15.52:0/2374243218 shutdown_connections 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 --2- 172.21.15.52:0/2374243218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c103450 0x7fda6c10b940 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 --2- 172.21.15.52:0/2374243218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c102b30 0x7fda6c102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 -- 172.21.15.52:0/2374243218 >> 172.21.15.52:0/2374243218 conn(0x7fda6c0fc550 msgr2=0x7fda6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 -- 172.21.15.52:0/2374243218 shutdown_connections 2024-09-06T14:42:13.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.330+0000 7fda711e0640 1 -- 172.21.15.52:0/2374243218 wait complete. 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.331+0000 7fda711e0640 1 Processor -- start 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.331+0000 7fda711e0640 1 -- start start 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda711e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c102b30 0x7fda6c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda711e0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c103450 0x7fda6c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda711e0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c10ede0 con 0x7fda6c102b30 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda711e0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c10ec60 con 0x7fda6c103450 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c102b30 0x7fda6c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c102b30 0x7fda6c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57934/0 (socket says 172.21.15.52:57934) 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6ad9d640 1 -- 172.21.15.52:0/1729222122 learned_addr learned my addr 172.21.15.52:0/1729222122 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6a59c640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c103450 0x7fda6c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:13.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6ad9d640 1 -- 172.21.15.52:0/1729222122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c103450 msgr2=0x7fda6c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6ad9d640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c103450 0x7fda6c19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6ad9d640 1 -- 172.21.15.52:0/1729222122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c1977b0 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda6ad9d640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c102b30 0x7fda6c19d630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00eb10 tx=0x7fda5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda63fff640 1 -- 172.21.15.52:0/1729222122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda5c00cce0 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda63fff640 1 -- 172.21.15.52:0/1729222122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda5c005020 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c197aa0 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.332+0000 7fda63fff640 1 -- 172.21.15.52:0/1729222122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda5c010660 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.333+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6c198000 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.334+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6c06a500 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.334+0000 7fda63fff640 1 -- 172.21.15.52:0/1729222122 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fda5c0051d0 con 0x7fda6c102b30 2024-09-06T14:42:13.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.335+0000 7fda63fff640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fda5806de90 0x7fda58070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:13.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.335+0000 7fda6a59c640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fda5806de90 0x7fda58070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:13.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.335+0000 7fda63fff640 1 -- 172.21.15.52:0/1729222122 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fda5c08e2d0 con 0x7fda6c102b30 2024-09-06T14:42:13.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.335+0000 7fda6a59c640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fda5806de90 0x7fda58070350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda6c198b00 tx=0x7fda54004f30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:13.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.339+0000 7fda63fff640 1 -- 172.21.15.52:0/1729222122 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda5c05be90 con 0x7fda6c102b30 2024-09-06T14:42:13.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.550+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fda6c105fc0 con 0x7fda6c102b30 2024-09-06T14:42:13.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.550+0000 7fda63fff640 1 -- 172.21.15.52:0/1729222122 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+83 (secure 0 0 0) 0x7fda5c05fb40 con 0x7fda6c102b30 2024-09-06T14:42:13.548 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-06T14:42:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fda5806de90 msgr2=0x7fda58070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fda5806de90 0x7fda58070350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda6c198b00 tx=0x7fda54004f30 comp rx=0 tx=0).stop 2024-09-06T14:42:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c102b30 msgr2=0x7fda6c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c102b30 0x7fda6c19d630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00eb10 tx=0x7fda5c00c2d0 comp rx=0 tx=0).stop 2024-09-06T14:42:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 shutdown_connections 2024-09-06T14:42:13.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fda5806de90 0x7fda58070350 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda6c103450 0x7fda6c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 --2- 172.21.15.52:0/1729222122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda6c102b30 0x7fda6c19d630 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.552+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 >> 172.21.15.52:0/1729222122 conn(0x7fda6c0fc550 msgr2=0x7fda6c103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.553+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 shutdown_connections 2024-09-06T14:42:13.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:13.553+0000 7fda711e0640 1 -- 172.21.15.52:0/1729222122 wait complete. 2024-09-06T14:42:14.117 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:13 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1729222122' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi165.front.sepia.ceph.com 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-06T14:42:14.145 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-06T14:42:14.146 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-06T14:42:14.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:14.146 DEBUG:teuthology.orchestra.run.smithi165:> ip addr 2024-09-06T14:42:14.165 INFO:teuthology.orchestra.run.smithi165.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout: inet 127.0.0.1/8 scope host lo 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 ::1/128 scope host 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:94 brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:14.168 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f0 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:d9:3a:95 brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: altname enp7s0f1 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:62 brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: link/ether 0c:c4:7a:88:7f:63 brd ff:ff:ff:ff:ff:ff 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: inet 172.21.15.165/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft 42294sec preferred_lft 42294sec 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: inet6 fe80::ec4:7aff:fe88:7f63/64 scope link noprefixroute 2024-09-06T14:42:14.169 INFO:teuthology.orchestra.run.smithi165.stdout: valid_lft forever preferred_lft forever 2024-09-06T14:42:14.170 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-06T14:42:14.170 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:14.170 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-06T14:42:14.171 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add name ceph-brx type bridge 2024-09-06T14:42:14.171 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr flush dev ceph-brx 2024-09-06T14:42:14.171 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set ceph-brx up 2024-09-06T14:42:14.171 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-06T14:42:14.171 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-06T14:42:14.266 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:14.275 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:13 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1729222122' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-06T14:42:14.370 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:14.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:14.377 DEBUG:teuthology.orchestra.run.smithi165:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-06T14:42:14.401 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-06T14:42:14.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:14.403 DEBUG:teuthology.orchestra.run.smithi165:> route 2024-09-06T14:42:14.472 INFO:teuthology.orchestra.run.smithi165.stdout:Kernel IP routing table 2024-09-06T14:42:14.472 INFO:teuthology.orchestra.run.smithi165.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-06T14:42:14.472 INFO:teuthology.orchestra.run.smithi165.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-06T14:42:14.472 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-06T14:42:14.472 INFO:teuthology.orchestra.run.smithi165.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-06T14:42:14.473 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:14.473 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-06T14:42:14.473 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-06T14:42:14.473 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-06T14:42:14.473 DEBUG:teuthology.orchestra.run.smithi165:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-06T14:42:14.473 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-06T14:42:14.560 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:14.746 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:14.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:14.752 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list 2024-09-06T14:42:14.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:14.767 DEBUG:teuthology.orchestra.run.smithi165:> ip netns list-id 2024-09-06T14:42:14.822 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:14.822 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-06T14:42:14.822 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-06T14:42:14.823 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-06T14:42:14.823 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-06T14:42:14.910 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:14.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:14.939 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-06T14:42:14.940 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-06T14:42:14.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:15.064 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:15.071 DEBUG:teuthology.orchestra.run.smithi165:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-06T14:42:15.071 DEBUG:teuthology.orchestra.run.smithi165:> set -e 2024-09-06T14:42:15.071 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set brx.0 up 2024-09-06T14:42:15.071 DEBUG:teuthology.orchestra.run.smithi165:> sudo ip link set dev brx.0 master ceph-brx 2024-09-06T14:42:15.071 DEBUG:teuthology.orchestra.run.smithi165:> ') 2024-09-06T14:42:15.120 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-06T14:42:15.142 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:15.149 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-06T14:42:15.149 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-06T14:42:15.149 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:15.164 INFO:teuthology.orchestra.run.smithi165.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-06T14:42:15.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-06T14:42:15.164 DEBUG:teuthology.orchestra.run.smithi165:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:15.220 DEBUG:teuthology.orchestra.run.smithi165:> sudo modprobe fuse 2024-09-06T14:42:15.282 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:14 smithi165 ceph-mon[36229]: pgmap v186: 65 pgs: 65 active+clean; 581 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-06T14:42:15.286 DEBUG:teuthology.orchestra.run.smithi165:> cat /proc/self/mounts | awk '{print $2}' 2024-09-06T14:42:15.346 INFO:teuthology.orchestra.run.smithi165.stdout:/proc 2024-09-06T14:42:15.346 INFO:teuthology.orchestra.run.smithi165.stdout:/sys 2024-09-06T14:42:15.346 INFO:teuthology.orchestra.run.smithi165.stdout:/dev 2024-09-06T14:42:15.346 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/security 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/shm 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/pts 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/run 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/cgroup 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/pstore 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/bpf 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/ 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/selinux 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/mqueue 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/hugepages 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/debug 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/tracing 2024-09-06T14:42:15.347 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/config 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-sysusers.service 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/fuse/connections 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-sysctl.service 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/nfs/rpc_pipefs 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/1000 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/ceph 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/0 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay 2024-09-06T14:42:15.348 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/31a7aa0d21e49beca6a7616eae793403b498abf571ddd5e571966776d20fc26c/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/7830d9b7ef7f6a0b4dd71a35caab4cf94d883186dc16cab26b3dbd466214cb82/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/1302eaa95a01c77a85bb95317e55c1bcef941868d02955beb35d94212c8e4807/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/cc4f663c5241ee28d67a9a2326dfeeafa3f674ecc10b314688b095d50bcf2ef8/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/23b544ca7ecd5b28b88765b7137256764ce19dc84f56910446a201445ce519ea/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/87e9b53a5f6a7448d53f291419854cff5db9025829111e7fef373afa6e1cb974/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/4b90712eb4e80c7ffaa434041e895f2c798acf49d7f17d8c090f9d35ab410263/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/815ecb0168699993334b1fe0de810dc0c48aca76cfc672f285d4394f77bf1340/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/5869661436ab67e65ba872c4567bf427368526637ae498a7e25b9c22e35d8f0b/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/5d5c5133ce01c1ad54faa1d6ac0c871324d420b6f8cf38d6a99116ad638ae78b/merged 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-06T14:42:15.349 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-06T14:42:15.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:15.350 DEBUG:teuthology.orchestra.run.smithi165:> ls /sys/fs/fuse/connections 2024-09-06T14:42:15.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:14 smithi052 ceph-mon[28627]: pgmap v186: 65 pgs: 65 active+clean; 581 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-06T14:42:15.403 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-06T14:42:15.403 DEBUG:teuthology.orchestra.run.smithi165:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-06T14:42:15.445 DEBUG:teuthology.orchestra.run.smithi165:> sudo modprobe fuse 2024-09-06T14:42:15.470 DEBUG:teuthology.orchestra.run.smithi165:> cat /proc/self/mounts | awk '{print $2}' 2024-09-06T14:42:15.526 INFO:teuthology.orchestra.run.smithi165.stdout:/proc 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/sys 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/dev 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/security 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/shm 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/pts 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/run 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/cgroup 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/pstore 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/bpf 2024-09-06T14:42:15.527 INFO:teuthology.orchestra.run.smithi165.stdout:/ 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/selinux 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/mqueue 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/dev/hugepages 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/debug 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/tracing 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/kernel/config 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-sysusers.service 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/sys/fs/fuse/connections 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-sysctl.service 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-06T14:42:15.528 INFO:teuthology.orchestra.run.smithi165.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/nfs/rpc_pipefs 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/1000 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/ceph 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/run/user/0 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/proc/sys/fs/binfmt_misc 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/31a7aa0d21e49beca6a7616eae793403b498abf571ddd5e571966776d20fc26c/merged 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/7830d9b7ef7f6a0b4dd71a35caab4cf94d883186dc16cab26b3dbd466214cb82/merged 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/1302eaa95a01c77a85bb95317e55c1bcef941868d02955beb35d94212c8e4807/merged 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/cc4f663c5241ee28d67a9a2326dfeeafa3f674ecc10b314688b095d50bcf2ef8/merged 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/23b544ca7ecd5b28b88765b7137256764ce19dc84f56910446a201445ce519ea/merged 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/87e9b53a5f6a7448d53f291419854cff5db9025829111e7fef373afa6e1cb974/merged 2024-09-06T14:42:15.529 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/4b90712eb4e80c7ffaa434041e895f2c798acf49d7f17d8c090f9d35ab410263/merged 2024-09-06T14:42:15.530 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/815ecb0168699993334b1fe0de810dc0c48aca76cfc672f285d4394f77bf1340/merged 2024-09-06T14:42:15.530 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/5869661436ab67e65ba872c4567bf427368526637ae498a7e25b9c22e35d8f0b/merged 2024-09-06T14:42:15.530 INFO:teuthology.orchestra.run.smithi165.stdout:/var/lib/containers/storage/overlay/5d5c5133ce01c1ad54faa1d6ac0c871324d420b6f8cf38d6a99116ad638ae78b/merged 2024-09-06T14:42:15.530 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns 2024-09-06T14:42:15.530 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-06T14:42:15.530 INFO:teuthology.orchestra.run.smithi165.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-06T14:42:15.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:15.530 DEBUG:teuthology.orchestra.run.smithi165:> ls /sys/fs/fuse/connections 2024-09-06T14:42:15.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi165.stderr:2024-09-06T14:42:15.544+0000 7fb7ee0af480 -1 init, newargv = 0x555ce8ade1a0 newargc=15 2024-09-06T14:42:15.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi165.stderr:ceph-fuse[62313]: starting ceph client 2024-09-06T14:42:15.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi165.stderr:ceph-fuse[62313]: starting fuse 2024-09-06T14:42:15.558 INFO:teuthology.orchestra.run.smithi165.stdout:130 2024-09-06T14:42:15.558 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [130] 2024-09-06T14:42:15.558 DEBUG:teuthology.orchestra.run.smithi165:> sudo stdin-killer -- python3 -c ' 2024-09-06T14:42:15.558 DEBUG:teuthology.orchestra.run.smithi165:> import glob 2024-09-06T14:42:15.558 DEBUG:teuthology.orchestra.run.smithi165:> import re 2024-09-06T14:42:15.558 DEBUG:teuthology.orchestra.run.smithi165:> import os 2024-09-06T14:42:15.558 DEBUG:teuthology.orchestra.run.smithi165:> import subprocess 2024-09-06T14:42:15.558 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-06T14:42:15.558 DEBUG:teuthology.orchestra.run.smithi165:> def _find_admin_socket(client_name): 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> files = glob.glob(asok_path) 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> # Given a non-glob path, it better be there 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> if "*" not in asok_path: 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> assert(len(files) == 1) 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> return files[0] 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> for f in files: 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> contents = proc_f.read() 2024-09-06T14:42:15.559 DEBUG:teuthology.orchestra.run.smithi165:> if mountpoint in contents: 2024-09-06T14:42:15.560 DEBUG:teuthology.orchestra.run.smithi165:> return f 2024-09-06T14:42:15.560 DEBUG:teuthology.orchestra.run.smithi165:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-06T14:42:15.560 DEBUG:teuthology.orchestra.run.smithi165:> 2024-09-06T14:42:15.560 DEBUG:teuthology.orchestra.run.smithi165:> print(_find_admin_socket("client.1")) 2024-09-06T14:42:15.560 DEBUG:teuthology.orchestra.run.smithi165:> ' 2024-09-06T14:42:15.676 INFO:teuthology.orchestra.run.smithi165.stdout:/var/run/ceph/ceph-client.1.62313.asok 2024-09-06T14:42:15.679 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-06T14:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-06T14:42:15.686 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.62313.asok 2024-09-06T14:42:15.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:15.686 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.62313.asok status 2024-09-06T14:42:15.820 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-06T14:42:15.820 INFO:teuthology.orchestra.run.smithi165.stdout: "metadata": { 2024-09-06T14:42:15.820 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_sha1": "635ed4cf3404d66f56069c438a5e3af26e0ed5be", 2024-09-06T14:42:15.820 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_version": "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)", 2024-09-06T14:42:15.820 INFO:teuthology.orchestra.run.smithi165.stdout: "entity_id": "1", 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "hostname": "smithi165", 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "pid": "62313", 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "root": "/" 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "dentry_count": 0, 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "dentry_pinned_count": 0, 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "id": 24315, 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "inst": { 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "name": { 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "type": "client", 2024-09-06T14:42:15.821 INFO:teuthology.orchestra.run.smithi165.stdout: "num": 24315 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": { 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "type": "v1", 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": "192.168.0.1:0", 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "nonce": 4209345592 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": { 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "type": "v1", 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "addr": "192.168.0.1:0", 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "nonce": 4209345592 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-06T14:42:15.822 INFO:teuthology.orchestra.run.smithi165.stdout: "inst_str": "client.24315 192.168.0.1:0/4209345592", 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout: "addr_str": "192.168.0.1:0/4209345592", 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout: "inode_count": 1, 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_epoch": 19, 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_epoch": 46, 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_epoch_barrier": 0, 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout: "blocklisted": false, 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout: "fs_name": "cephfs" 2024-09-06T14:42:15.823 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-06T14:42:15.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:15.828 DEBUG:teuthology.orchestra.run.smithi052:> stat --file-system '--printf=%T 2024-09-06T14:42:15.829 DEBUG:teuthology.orchestra.run.smithi052:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:15.850 INFO:teuthology.orchestra.run.smithi052.stdout:fuseblk 2024-09-06T14:42:15.850 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:15.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:15.850 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:15.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:15.924 DEBUG:teuthology.orchestra.run.smithi165:> stat --file-system '--printf=%T 2024-09-06T14:42:15.924 DEBUG:teuthology.orchestra.run.smithi165:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:15.940 INFO:teuthology.orchestra.run.smithi165.stdout:fuseblk 2024-09-06T14:42:15.940 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:15.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T14:42:15.940 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:16.770 INFO:teuthology.run_tasks:Running task print... 2024-09-06T14:42:16.784 INFO:teuthology.task.print:**** done client 2024-09-06T14:42:16.784 INFO:teuthology.run_tasks:Running task parallel... 2024-09-06T14:42:16.804 INFO:teuthology.task.parallel:starting parallel... 2024-09-06T14:42:16.804 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-06T14:42:16.805 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-06T14:42:16.805 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:42:16.805 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-06T14:42:16.806 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-06T14:42:16.806 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-06T14:42:16.811 INFO:tasks.workunit:Pulling workunits from ref 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:42:16.811 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-06T14:42:16.811 INFO:tasks.workunit:timeout=3h 2024-09-06T14:42:16.812 INFO:tasks.workunit:cleanup=True 2024-09-06T14:42:16.812 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:16.833 INFO:teuthology.orchestra.run.smithi052.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 9ah/154d Inode: 1 Links: 2 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-06 14:41:50.979976018 +0000 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-06 14:42:15.923147506 +0000 2024-09-06T14:42:16.834 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-06T14:42:16.834 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-06T14:42:16.834 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-06T14:42:16.905 DEBUG:teuthology.orchestra.run.smithi165:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:16.923 INFO:teuthology.orchestra.run.smithi165.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:16.923 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-06T14:42:16.923 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 82h/130d Inode: 1 Links: 3 2024-09-06T14:42:16.924 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-06T14:42:16.924 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-06T14:42:16.924 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-06T14:42:16.924 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-06 14:42:16.901714350 +0000 2024-09-06T14:42:16.924 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-06 14:42:16.901714350 +0000 2024-09-06T14:42:16.924 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2024-09-06T14:42:16.924 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-06T14:42:16.924 DEBUG:teuthology.orchestra.run.smithi165:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-06T14:42:16.997 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:42:16.998 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:42:17.014 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-06T14:42:17.054 INFO:tasks.workunit.client.1.smithi165.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-06T14:42:17.079 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:17.472 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:17 smithi052 ceph-mon[28627]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-06T14:42:17.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 -- 172.21.15.52:0/72155544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 msgr2=0x7f6270100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 --2- 172.21.15.52:0/72155544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270100f80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6264009880 tx=0x7f626402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 -- 172.21.15.52:0/72155544 shutdown_connections 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 --2- 172.21.15.52:0/72155544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270100f80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 --2- 172.21.15.52:0/72155544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62701001e0 0x7f62701005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 -- 172.21.15.52:0/72155544 >> 172.21.15.52:0/72155544 conn(0x7f62700fc010 msgr2=0x7f62700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 -- 172.21.15.52:0/72155544 shutdown_connections 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 -- 172.21.15.52:0/72155544 wait complete. 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.562+0000 7f627743b640 1 Processor -- start 2024-09-06T14:42:17.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f627743b640 1 -- start start 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f627743b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62701001e0 0x7f6270199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f627743b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f627743b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f627010c9f0 con 0x7f6270100b20 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f627743b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f627010c870 con 0x7f62701001e0 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62749d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62749d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57946/0 (socket says 172.21.15.52:57946) 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62749d6640 1 -- 172.21.15.52:0/3256067700 learned_addr learned my addr 172.21.15.52:0/3256067700 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62751d7640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62701001e0 0x7f6270199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62749d6640 1 -- 172.21.15.52:0/3256067700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62701001e0 msgr2=0x7f6270199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62749d6640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62701001e0 0x7f6270199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62749d6640 1 -- 172.21.15.52:0/3256067700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627019a2e0 con 0x7f6270100b20 2024-09-06T14:42:17.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62751d7640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62701001e0 0x7f6270199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.563+0000 7f62749d6640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270199c60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6264006010 tx=0x7f62640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.564+0000 7f626e7fc640 1 -- 172.21.15.52:0/3256067700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f626403f070 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.564+0000 7f626e7fc640 1 -- 172.21.15.52:0/3256067700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62640044d0 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.564+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627019ecc0 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.564+0000 7f626e7fc640 1 -- 172.21.15.52:0/3256067700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6264035030 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.564+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627019f270 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.565+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62701005e0 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.565+0000 7f626e7fc640 1 -- 172.21.15.52:0/3256067700 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f6264042070 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.566+0000 7f626e7fc640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f625806de90 0x7f6258070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.566+0000 7f62751d7640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f625806de90 0x7f6258070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.566+0000 7f626e7fc640 1 -- 172.21.15.52:0/3256067700 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f62640ae870 con 0x7f6270100b20 2024-09-06T14:42:17.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.566+0000 7f62751d7640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f625806de90 0x7f6258070350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6268009930 tx=0x7f6268008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:17.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.570+0000 7f626e7fc640 1 -- 172.21.15.52:0/3256067700 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f626407c430 con 0x7f6270100b20 2024-09-06T14:42:17.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.746+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f6270062df0 con 0x7f6270100b20 2024-09-06T14:42:17.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.747+0000 7f626e7fc640 1 -- 172.21.15.52:0/3256067700 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v43)=0 v43) ==== 155+0+0 (secure 0 0 0) 0x7f62640800e0 con 0x7f6270100b20 2024-09-06T14:42:17.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f625806de90 msgr2=0x7f6258070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:17.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f625806de90 0x7f6258070350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6268009930 tx=0x7f6268008040 comp rx=0 tx=0).stop 2024-09-06T14:42:17.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 msgr2=0x7f6270199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:17.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270199c60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6264006010 tx=0x7f62640048f0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 shutdown_connections 2024-09-06T14:42:17.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f625806de90 0x7f6258070350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6270100b20 0x7f6270199c60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 --2- 172.21.15.52:0/3256067700 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f62701001e0 0x7f6270199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:17.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 >> 172.21.15.52:0/3256067700 conn(0x7f62700fc010 msgr2=0x7f6270108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:17.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 shutdown_connections 2024-09-06T14:42:17.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:17.749+0000 7f627743b640 1 -- 172.21.15.52:0/3256067700 wait complete. 2024-09-06T14:42:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:17 smithi165 ceph-mon[36229]: pgmap v187: 65 pgs: 65 active+clean; 581 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-06T14:42:18.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-06T14:42:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1009573159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0103950 msgr2=0x7faeb00ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1009573159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0103950 0x7faeb00ffa00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae98009880 tx=0x7fae9802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1009573159 shutdown_connections 2024-09-06T14:42:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1009573159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0103950 0x7faeb00ffa00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1009573159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faeb0102f80 0x7faeb0103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1009573159 >> 172.21.15.52:0/1009573159 conn(0x7faeb00fb770 msgr2=0x7faeb00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1009573159 shutdown_connections 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.100+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1009573159 wait complete. 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeb4ebb640 1 Processor -- start 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeb4ebb640 1 -- start start 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeb4ebb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0102f80 0x7faeb0197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeb4ebb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faeb0103950 0x7faeb01979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeb4ebb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faeb010a790 con 0x7faeb0102f80 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeb4ebb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faeb010a610 con 0x7faeb0103950 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0102f80 0x7faeb0197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0102f80 0x7faeb0197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57960/0 (socket says 172.21.15.52:57960) 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faeae59c640 1 -- 172.21.15.52:0/1613990034 learned_addr learned my addr 172.21.15.52:0/1613990034 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:19.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.101+0000 7faea7fff640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faeb0103950 0x7faeb01979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faeae59c640 1 -- 172.21.15.52:0/1613990034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faeb0103950 msgr2=0x7faeb01979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faeae59c640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faeb0103950 0x7faeb01979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faeae59c640 1 -- 172.21.15.52:0/1613990034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb0197fc0 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faeae59c640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0102f80 0x7faeb0197490 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faea000c8f0 tx=0x7faea000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faea77fe640 1 -- 172.21.15.52:0/1613990034 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faea0004020 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb019ca30 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faea77fe640 1 -- 172.21.15.52:0/1613990034 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faea0007e10 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faea77fe640 1 -- 172.21.15.52:0/1613990034 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faea0003e10 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.102+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb019cf90 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.103+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb0103380 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.104+0000 7faea77fe640 1 -- 172.21.15.52:0/1613990034 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7faea00041c0 con 0x7faeb0102f80 2024-09-06T14:42:19.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.104+0000 7faea77fe640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fae9c06de30 0x7fae9c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:19.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.105+0000 7faea77fe640 1 -- 172.21.15.52:0/1613990034 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7faea008dd70 con 0x7faeb0102f80 2024-09-06T14:42:19.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.105+0000 7faea7fff640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fae9c06de30 0x7fae9c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:19.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.105+0000 7faea7fff640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fae9c06de30 0x7fae9c0702f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae98000c00 tx=0x7fae98005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:19.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.109+0000 7faea77fe640 1 -- 172.21.15.52:0/1613990034 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faea0015330 con 0x7faeb0102f80 2024-09-06T14:42:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.287+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7faeb01915a0 con 0x7faeb0102f80 2024-09-06T14:42:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.288+0000 7faea77fe640 1 -- 172.21.15.52:0/1613990034 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v43)=0 v43) ==== 163+0+0 (secure 0 0 0) 0x7faea005b8b0 con 0x7faeb0102f80 2024-09-06T14:42:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.289+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fae9c06de30 msgr2=0x7fae9c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fae9c06de30 0x7fae9c0702f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae98000c00 tx=0x7fae98005a20 comp rx=0 tx=0).stop 2024-09-06T14:42:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0102f80 msgr2=0x7faeb0197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0102f80 0x7faeb0197490 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faea000c8f0 tx=0x7faea000cdb0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 shutdown_connections 2024-09-06T14:42:19.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fae9c06de30 0x7fae9c0702f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faeb0103950 0x7faeb01979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 --2- 172.21.15.52:0/1613990034 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faeb0102f80 0x7faeb0197490 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:19.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 >> 172.21.15.52:0/1613990034 conn(0x7faeb00fb770 msgr2=0x7faeb0106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:19.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 shutdown_connections 2024-09-06T14:42:19.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:19.290+0000 7faeb4ebb640 1 -- 172.21.15.52:0/1613990034 wait complete. 2024-09-06T14:42:19.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:19 smithi052 ceph-mon[28627]: pgmap v188: 65 pgs: 65 active+clean; 586 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-06T14:42:19.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:19 smithi165 ceph-mon[36229]: pgmap v188: 65 pgs: 65 active+clean; 586 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 8.5 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-06T14:42:19.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-06T14:42:20.136 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:20.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.609+0000 7f0548d92640 1 -- 172.21.15.52:0/3932070800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544100b30 msgr2=0x7f0544100fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:20.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.609+0000 7f0548d92640 1 --2- 172.21.15.52:0/3932070800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544100b30 0x7f0544100fb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f052c009880 tx=0x7f052c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 -- 172.21.15.52:0/3932070800 shutdown_connections 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 --2- 172.21.15.52:0/3932070800 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544100b30 0x7f0544100fb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 --2- 172.21.15.52:0/3932070800 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0544101df0 0x7f05441021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 -- 172.21.15.52:0/3932070800 >> 172.21.15.52:0/3932070800 conn(0x7f05440fb770 msgr2=0x7f05440fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 -- 172.21.15.52:0/3932070800 shutdown_connections 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 -- 172.21.15.52:0/3932070800 wait complete. 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 Processor -- start 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.610+0000 7f0548d92640 1 -- start start 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0548d92640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0544100b30 0x7f0544197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0548d92640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544101df0 0x7f05441979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0548d92640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0544109680 con 0x7f0544101df0 2024-09-06T14:42:20.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0548d92640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0544109500 con 0x7f0544100b30 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0541d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544101df0 0x7f05441979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0541d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544101df0 0x7f05441979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48576/0 (socket says 172.21.15.52:48576) 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0541d9b640 1 -- 172.21.15.52:0/68400177 learned_addr learned my addr 172.21.15.52:0/68400177 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0541d9b640 1 -- 172.21.15.52:0/68400177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0544100b30 msgr2=0x7f0544197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0541d9b640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0544100b30 0x7f0544197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0541d9b640 1 -- 172.21.15.52:0/68400177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0544197fb0 con 0x7f0544101df0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0541d9b640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544101df0 0x7f05441979c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f052c006010 tx=0x7f052c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f053b7fe640 1 -- 172.21.15.52:0/68400177 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f052c03f070 con 0x7f0544101df0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054419c9c0 con 0x7f0544101df0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f053b7fe640 1 -- 172.21.15.52:0/68400177 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f052c0044d0 con 0x7f0544101df0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f053b7fe640 1 -- 172.21.15.52:0/68400177 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f052c035030 con 0x7f0544101df0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.611+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054419cec0 con 0x7f0544101df0 2024-09-06T14:42:20.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.612+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0544100fb0 con 0x7f0544101df0 2024-09-06T14:42:20.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.613+0000 7f053b7fe640 1 -- 172.21.15.52:0/68400177 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f052c042070 con 0x7f0544101df0 2024-09-06T14:42:20.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.613+0000 7f053b7fe640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f053006de30 0x7f05300702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:20.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.613+0000 7f053b7fe640 1 -- 172.21.15.52:0/68400177 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f052c0ae8f0 con 0x7f0544101df0 2024-09-06T14:42:20.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.613+0000 7f054259c640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f053006de30 0x7f05300702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:20.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.614+0000 7f054259c640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f053006de30 0x7f05300702f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0544069f30 tx=0x7f05340071e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:20.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.618+0000 7f053b7fe640 1 -- 172.21.15.52:0/68400177 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f052c07c430 con 0x7f0544101df0 2024-09-06T14:42:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.793+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f05441068e0 con 0x7f0544101df0 2024-09-06T14:42:20.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.793+0000 7f053b7fe640 1 -- 172.21.15.52:0/68400177 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v43)=0 v43) ==== 135+0+0 (secure 0 0 0) 0x7f052c0800e0 con 0x7f0544101df0 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f053006de30 msgr2=0x7f05300702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f053006de30 0x7f05300702f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0544069f30 tx=0x7f05340071e0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544101df0 msgr2=0x7f05441979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544101df0 0x7f05441979c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f052c006010 tx=0x7f052c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 shutdown_connections 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f053006de30 0x7f05300702f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0544101df0 0x7f05441979c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 --2- 172.21.15.52:0/68400177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0544100b30 0x7f0544197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 >> 172.21.15.52:0/68400177 conn(0x7f05440fb770 msgr2=0x7f05440fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:20.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 shutdown_connections 2024-09-06T14:42:20.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:20.795+0000 7f0548d92640 1 -- 172.21.15.52:0/68400177 wait complete. 2024-09-06T14:42:21.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:21 smithi052 ceph-mon[28627]: pgmap v189: 65 pgs: 65 active+clean; 586 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 5.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-06T14:42:21.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-06T14:42:21.697 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:42:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:21 smithi165 ceph-mon[36229]: pgmap v189: 65 pgs: 65 active+clean; 586 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 5.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 -- 172.21.15.52:0/1406431731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74101960 msgr2=0x7faf74101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 --2- 172.21.15.52:0/1406431731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74101960 0x7faf74101d60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faf68009880 tx=0x7faf6802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 -- 172.21.15.52:0/1406431731 shutdown_connections 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 --2- 172.21.15.52:0/1406431731 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf74102b60 0x7faf74102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 --2- 172.21.15.52:0/1406431731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74101960 0x7faf74101d60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 -- 172.21.15.52:0/1406431731 >> 172.21.15.52:0/1406431731 conn(0x7faf740fd0f0 msgr2=0x7faf740ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 -- 172.21.15.52:0/1406431731 shutdown_connections 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 -- 172.21.15.52:0/1406431731 wait complete. 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 Processor -- start 2024-09-06T14:42:22.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.175+0000 7faf7af62640 1 -- start start 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf7af62640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf74101960 0x7faf74197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf7af62640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74102b60 0x7faf74197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf7af62640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf7410a800 con 0x7faf74102b60 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf7af62640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf7410a680 con 0x7faf74101960 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf73fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74102b60 0x7faf74197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf73fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74102b60 0x7faf74197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48580/0 (socket says 172.21.15.52:48580) 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf73fff640 1 -- 172.21.15.52:0/1533177427 learned_addr learned my addr 172.21.15.52:0/1533177427 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf73fff640 1 -- 172.21.15.52:0/1533177427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf74101960 msgr2=0x7faf74197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf78cfe640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf74101960 0x7faf74197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf73fff640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf74101960 0x7faf74197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf73fff640 1 -- 172.21.15.52:0/1533177427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf741980f0 con 0x7faf74102b60 2024-09-06T14:42:22.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf73fff640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74102b60 0x7faf74197a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf6000b420 tx=0x7faf6000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf71ffb640 1 -- 172.21.15.52:0/1533177427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf60011630 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7419cb30 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf71ffb640 1 -- 172.21.15.52:0/1533177427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf60016070 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.176+0000 7faf71ffb640 1 -- 172.21.15.52:0/1533177427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf60010d40 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.177+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7419d140 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.178+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf74101d60 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.178+0000 7faf71ffb640 1 -- 172.21.15.52:0/1533177427 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7faf6001b460 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.178+0000 7faf71ffb640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faf6406de30 0x7faf640702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.179+0000 7faf71ffb640 1 -- 172.21.15.52:0/1533177427 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7faf6008d4f0 con 0x7faf74102b60 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.179+0000 7faf78cfe640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faf6406de30 0x7faf640702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.179+0000 7faf78cfe640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faf6406de30 0x7faf640702f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf6802a9c0 tx=0x7faf68000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:42:22.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.183+0000 7faf71ffb640 1 -- 172.21.15.52:0/1533177427 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf6005b030 con 0x7faf74102b60 2024-09-06T14:42:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:22.376+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7faf740626e0 con 0x7faf6406de30 2024-09-06T14:42:23.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:23 smithi052 ceph-mon[28627]: pgmap v190: 65 pgs: 65 active+clean; 587 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-06T14:42:23.625 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:23 smithi165 ceph-mon[36229]: pgmap v190: 65 pgs: 65 active+clean; 587 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-06T14:42:24.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:24 smithi052 ceph-mon[28627]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:42:24.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:24 smithi165 ceph-mon[36229]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:42:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:25 smithi165 ceph-mon[36229]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-06T14:42:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:25.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:25 smithi052 ceph-mon[28627]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-06T14:42:25.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:26.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:26 smithi052 ceph-mon[28627]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-06T14:42:26.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:26 smithi165 ceph-mon[36229]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-06T14:42:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:29 smithi052 ceph-mon[28627]: pgmap v193: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-06T14:42:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:29 smithi165 ceph-mon[36229]: pgmap v193: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-06T14:42:31.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:31 smithi052 ceph-mon[28627]: pgmap v194: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-06T14:42:31.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:31 smithi165 ceph-mon[36229]: pgmap v194: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-06T14:42:33.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:33 smithi052 ceph-mon[28627]: pgmap v195: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-06T14:42:33.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:33 smithi165 ceph-mon[36229]: pgmap v195: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-06T14:42:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:35 smithi165 ceph-mon[36229]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-06T14:42:35.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:35 smithi052 ceph-mon[28627]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-06T14:42:37.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:37 smithi052 ceph-mon[28627]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-06T14:42:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:37 smithi165 ceph-mon[36229]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-06T14:42:39.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:39 smithi052 ceph-mon[28627]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-06T14:42:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:39 smithi165 ceph-mon[36229]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-06T14:42:40.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:40.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:41.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:41 smithi052 ceph-mon[28627]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:42:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:41 smithi165 ceph-mon[36229]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:42:42.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:42 smithi052 ceph-mon[28627]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:42.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:42 smithi165 ceph-mon[36229]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:45 smithi165 ceph-mon[36229]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:45.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:45 smithi052 ceph-mon[28627]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:47.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:47 smithi052 ceph-mon[28627]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:47 smithi165 ceph-mon[36229]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:49.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:49 smithi052 ceph-mon[28627]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:49.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:49 smithi165 ceph-mon[36229]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:51.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:51 smithi052 ceph-mon[28627]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:42:51.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:51 smithi165 ceph-mon[36229]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:42:53.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:53 smithi052 ceph-mon[28627]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:53.624 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:53 smithi165 ceph-mon[36229]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:54.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:54 smithi165 ceph-mon[36229]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:54 smithi052 ceph-mon[28627]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:55.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:42:56.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:56 smithi165 ceph-mon[36229]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:56 smithi052 ceph-mon[28627]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:58.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.987+0000 7faf71ffb640 1 -- 172.21.15.52:0/1533177427 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7faf740626e0 con 0x7faf6406de30 2024-09-06T14:42:58.985 INFO:teuthology.orchestra.run.smithi052.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faf6406de30 msgr2=0x7faf640702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faf6406de30 0x7faf640702f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf6802a9c0 tx=0x7faf68000bc0 comp rx=0 tx=0).stop 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74102b60 msgr2=0x7faf74197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74102b60 0x7faf74197a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf6000b420 tx=0x7faf6000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 shutdown_connections 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7faf6406de30 0x7faf640702f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf74102b60 0x7faf74197a70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 --2- 172.21.15.52:0/1533177427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf74101960 0x7faf74197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:42:58.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 >> 172.21.15.52:0/1533177427 conn(0x7faf740fd0f0 msgr2=0x7faf74106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:42:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 shutdown_connections 2024-09-06T14:42:58.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:42:58.990+0000 7faf7af62640 1 -- 172.21.15.52:0/1533177427 wait complete. 2024-09-06T14:42:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:59 smithi052 ceph-mon[28627]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:59 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:59 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:42:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:59 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:42:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:59 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:42:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:42:59 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:59.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-06T14:42:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:59 smithi165 ceph-mon[36229]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:42:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:59 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:42:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:59 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:42:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:59 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:42:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:59 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:42:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:42:59 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:00.168 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:43:00.557 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:00 smithi052 ceph-mon[28627]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:43:00.558 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:00 smithi052 ceph-mon[28627]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:43:00.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:00 smithi165 ceph-mon[36229]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:43:00.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:00 smithi165 ceph-mon[36229]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:43:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 -- 172.21.15.52:0/4180000902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe050100860 msgr2=0x7fe050100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 --2- 172.21.15.52:0/4180000902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe050100860 0x7fe050100c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe040009880 tx=0x7fe04002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 -- 172.21.15.52:0/4180000902 shutdown_connections 2024-09-06T14:43:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 --2- 172.21.15.52:0/4180000902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050101a60 0x7fe050101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:00.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 --2- 172.21.15.52:0/4180000902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe050100860 0x7fe050100c60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:00.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 -- 172.21.15.52:0/4180000902 >> 172.21.15.52:0/4180000902 conn(0x7fe0500fc010 msgr2=0x7fe0500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:00.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 -- 172.21.15.52:0/4180000902 shutdown_connections 2024-09-06T14:43:00.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.833+0000 7fe054d4b640 1 -- 172.21.15.52:0/4180000902 wait complete. 2024-09-06T14:43:00.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.834+0000 7fe054d4b640 1 Processor -- start 2024-09-06T14:43:00.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.834+0000 7fe054d4b640 1 -- start start 2024-09-06T14:43:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.834+0000 7fe054d4b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050100860 0x7fe0501987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.834+0000 7fe054d4b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe050101a60 0x7fe050198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe04e59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050100860 0x7fe0501987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe054d4b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe050108570 con 0x7fe050101a60 2024-09-06T14:43:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe054d4b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0501083f0 con 0x7fe050100860 2024-09-06T14:43:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe04e59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050100860 0x7fe0501987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:34642/0 (socket says 172.21.15.52:34642) 2024-09-06T14:43:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe04e59c640 1 -- 172.21.15.52:0/2810665734 learned_addr learned my addr 172.21.15.52:0/2810665734 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe04e59c640 1 -- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe050101a60 msgr2=0x7fe050198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe04e59c640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe050101a60 0x7fe050198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe04e59c640 1 -- 172.21.15.52:0/2810665734 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe050195330 con 0x7fe050100860 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.835+0000 7fe04e59c640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050100860 0x7fe0501987b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe040006010 tx=0x7fe0400045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.836+0000 7fe03f7fe640 1 -- 172.21.15.52:0/2810665734 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe04003f070 con 0x7fe050100860 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.836+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0501955c0 con 0x7fe050100860 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.836+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe050195af0 con 0x7fe050100860 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.836+0000 7fe03f7fe640 1 -- 172.21.15.52:0/2810665734 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0400049d0 con 0x7fe050100860 2024-09-06T14:43:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.837+0000 7fe03f7fe640 1 -- 172.21.15.52:0/2810665734 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe040035030 con 0x7fe050100860 2024-09-06T14:43:00.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.837+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0300052c0 con 0x7fe050100860 2024-09-06T14:43:00.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.839+0000 7fe03f7fe640 1 -- 172.21.15.52:0/2810665734 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7fe040042070 con 0x7fe050100860 2024-09-06T14:43:00.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.840+0000 7fe03f7fe640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fe03806ded0 0x7fe038070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:00.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.840+0000 7fe03f7fe640 1 -- 172.21.15.52:0/2810665734 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fe0400aeb00 con 0x7fe050100860 2024-09-06T14:43:00.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.840+0000 7fe04dd9b640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fe03806ded0 0x7fe038070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:00.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.841+0000 7fe04dd9b640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fe03806ded0 0x7fe038070390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe0440058c0 tx=0x7fe044005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:00.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:00.848+0000 7fe03f7fe640 1 -- 172.21.15.52:0/2810665734 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe04007c6a0 con 0x7fe050100860 2024-09-06T14:43:01.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.054+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe030000bf0 con 0x7fe03806ded0 2024-09-06T14:43:01.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.056+0000 7fe03f7fe640 1 -- 172.21.15.52:0/2810665734 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fe030000bf0 con 0x7fe03806ded0 2024-09-06T14:43:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fe03806ded0 msgr2=0x7fe038070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fe03806ded0 0x7fe038070390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe0440058c0 tx=0x7fe044005850 comp rx=0 tx=0).stop 2024-09-06T14:43:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050100860 msgr2=0x7fe0501987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050100860 0x7fe0501987b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe040006010 tx=0x7fe0400045e0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 shutdown_connections 2024-09-06T14:43:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7fe03806ded0 0x7fe038070390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe050101a60 0x7fe050198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 --2- 172.21.15.52:0/2810665734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe050100860 0x7fe0501987b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 >> 172.21.15.52:0/2810665734 conn(0x7fe0500fc010 msgr2=0x7fe050104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.058+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 shutdown_connections 2024-09-06T14:43:01.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.059+0000 7fe054d4b640 1 -- 172.21.15.52:0/2810665734 wait complete. 2024-09-06T14:43:01.065 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:43:01.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.161+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2366305346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 msgr2=0x7f05c8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.162+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2366305346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 0x7f05c8102fe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009880 tx=0x7f05bc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.162+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2366305346 shutdown_connections 2024-09-06T14:43:01.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.162+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2366305346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 0x7f05c8102fe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.162+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2366305346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 0x7f05c8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.163+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2366305346 >> 172.21.15.52:0/2366305346 conn(0x7f05c80fd0f0 msgr2=0x7f05c80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:01.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.163+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2366305346 shutdown_connections 2024-09-06T14:43:01.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.163+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2366305346 wait complete. 2024-09-06T14:43:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.164+0000 7f05ce9b9640 1 Processor -- start 2024-09-06T14:43:01.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.165+0000 7f05ce9b9640 1 -- start start 2024-09-06T14:43:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.166+0000 7f05ce9b9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 0x7f05c81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:01.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.166+0000 7f05ce9b9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 0x7f05c81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.166+0000 7f05c7fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 0x7f05c81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.166+0000 7f05c7fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 0x7f05c81974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:34658/0 (socket says 172.21.15.52:34658) 2024-09-06T14:43:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.166+0000 7f05c7fff640 1 -- 172.21.15.52:0/2382297275 learned_addr learned my addr 172.21.15.52:0/2382297275 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.166+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f05c810a7a0 con 0x7f05c8102b60 2024-09-06T14:43:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.167+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f05c810a620 con 0x7f05c8101960 2024-09-06T14:43:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.167+0000 7f05c77fe640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 0x7f05c81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:01.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.167+0000 7f05c7fff640 1 -- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 msgr2=0x7f05c81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.167+0000 7f05c7fff640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 0x7f05c81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.167+0000 7f05c7fff640 1 -- 172.21.15.52:0/2382297275 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c8198060 con 0x7f05c8101960 2024-09-06T14:43:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.167+0000 7f05c77fe640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 0x7f05c81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:43:01.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.168+0000 7f05c7fff640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 0x7f05c81974a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f05c000eaf0 tx=0x7f05c000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.168+0000 7f05c57fa640 1 -- 172.21.15.52:0/2382297275 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05c000cd10 con 0x7f05c8101960 2024-09-06T14:43:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.168+0000 7f05c57fa640 1 -- 172.21.15.52:0/2382297275 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05c0003e30 con 0x7f05c8101960 2024-09-06T14:43:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.168+0000 7f05c57fa640 1 -- 172.21.15.52:0/2382297275 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05c0010660 con 0x7f05c8101960 2024-09-06T14:43:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.168+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c819caa0 con 0x7f05c8101960 2024-09-06T14:43:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.168+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c819d000 con 0x7f05c8101960 2024-09-06T14:43:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.170+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c8101d60 con 0x7f05c8101960 2024-09-06T14:43:01.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.170+0000 7f05c57fa640 1 -- 172.21.15.52:0/2382297275 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f05c0003970 con 0x7f05c8101960 2024-09-06T14:43:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.171+0000 7f05c57fa640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f05b006de90 0x7f05b0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.171+0000 7f05c77fe640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f05b006de90 0x7f05b0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.172+0000 7f05c57fa640 1 -- 172.21.15.52:0/2382297275 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f05c008e410 con 0x7f05c8101960 2024-09-06T14:43:01.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.172+0000 7f05c77fe640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f05b006de90 0x7f05b0070350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f05bc000c00 tx=0x7f05bc0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:01.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.179+0000 7f05c57fa640 1 -- 172.21.15.52:0/2382297275 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05c005bf30 con 0x7f05c8101960 2024-09-06T14:43:01.369 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:01 smithi052 ceph-mon[28627]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:43:01.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.578+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f05c8062740 con 0x7f05b006de90 2024-09-06T14:43:01.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.580+0000 7f05c57fa640 1 -- 172.21.15.52:0/2382297275 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f05c8062740 con 0x7f05b006de90 2024-09-06T14:43:01.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.583+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f05b006de90 msgr2=0x7f05b0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.583+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f05b006de90 0x7f05b0070350 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f05bc000c00 tx=0x7f05bc0058d0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.583+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 msgr2=0x7f05c81974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.583+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 0x7f05c81974a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f05c000eaf0 tx=0x7f05c000c2d0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.584+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 shutdown_connections 2024-09-06T14:43:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.584+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f05b006de90 0x7f05b0070350 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.584+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f05c8102b60 0x7f05c81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.584+0000 7f05ce9b9640 1 --2- 172.21.15.52:0/2382297275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f05c8101960 0x7f05c81974a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.584+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 >> 172.21.15.52:0/2382297275 conn(0x7f05c80fd0f0 msgr2=0x7f05c8106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.584+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 shutdown_connections 2024-09-06T14:43:01.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.584+0000 7f05ce9b9640 1 -- 172.21.15.52:0/2382297275 wait complete. 2024-09-06T14:43:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.723+0000 7f5ecce9e640 1 -- 172.21.15.52:0/1654413471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec8101a50 msgr2=0x7f5ec8101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.723+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/1654413471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec8101a50 0x7f5ec8101ed0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009880 tx=0x7f5ebc02a4b0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.724+0000 7f5ecce9e640 1 -- 172.21.15.52:0/1654413471 shutdown_connections 2024-09-06T14:43:01.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.724+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/1654413471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec8101a50 0x7f5ec8101ed0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.724+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/1654413471 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 0x7f5ec8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.724+0000 7f5ecce9e640 1 -- 172.21.15.52:0/1654413471 >> 172.21.15.52:0/1654413471 conn(0x7f5ec80fbfe0 msgr2=0x7f5ec80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:01.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.724+0000 7f5ecce9e640 1 -- 172.21.15.52:0/1654413471 shutdown_connections 2024-09-06T14:43:01.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.724+0000 7f5ecce9e640 1 -- 172.21.15.52:0/1654413471 wait complete. 2024-09-06T14:43:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.725+0000 7f5ecce9e640 1 Processor -- start 2024-09-06T14:43:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.725+0000 7f5ecce9e640 1 -- start start 2024-09-06T14:43:01.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ecce9e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 0x7f5ec8107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ecce9e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec81084d0 0x7f5ec810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ecce9e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec806d4e0 con 0x7f5ec81084d0 2024-09-06T14:43:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ecce9e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec806d360 con 0x7f5ec8100850 2024-09-06T14:43:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ec659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 0x7f5ec8107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ec659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 0x7f5ec8107f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:34680/0 (socket says 172.21.15.52:34680) 2024-09-06T14:43:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ec659c640 1 -- 172.21.15.52:0/473055763 learned_addr learned my addr 172.21.15.52:0/473055763 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:01.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.726+0000 7f5ec5d9b640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec81084d0 0x7f5ec810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.727+0000 7f5ec659c640 1 -- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec81084d0 msgr2=0x7f5ec810d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.727+0000 7f5ec659c640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec81084d0 0x7f5ec810d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.727+0000 7f5ec659c640 1 -- 172.21.15.52:0/473055763 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec8108a00 con 0x7f5ec8100850 2024-09-06T14:43:01.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.727+0000 7f5ec659c640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 0x7f5ec8107f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5eb801fa90 tx=0x7f5eb801ff50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:01.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.727+0000 7f5eb77fe640 1 -- 172.21.15.52:0/473055763 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5eb801dcb0 con 0x7f5ec8100850 2024-09-06T14:43:01.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.728+0000 7f5eb77fe640 1 -- 172.21.15.52:0/473055763 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5eb801de50 con 0x7f5ec8100850 2024-09-06T14:43:01.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.728+0000 7f5eb77fe640 1 -- 172.21.15.52:0/473055763 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5eb8021460 con 0x7f5ec8100850 2024-09-06T14:43:01.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.730+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec810da10 con 0x7f5ec8100850 2024-09-06T14:43:01.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.730+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec810df70 con 0x7f5ec8100850 2024-09-06T14:43:01.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.732+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec806dcc0 con 0x7f5ec8100850 2024-09-06T14:43:01.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.733+0000 7f5eb77fe640 1 -- 172.21.15.52:0/473055763 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f5eb8004070 con 0x7f5ec8100850 2024-09-06T14:43:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.734+0000 7f5eb77fe640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5eb006df20 0x7f5eb00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.734+0000 7f5eb77fe640 1 -- 172.21.15.52:0/473055763 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f5eb8019030 con 0x7f5ec8100850 2024-09-06T14:43:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.734+0000 7f5ec5d9b640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5eb006df20 0x7f5eb00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.735+0000 7f5ec5d9b640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5eb006df20 0x7f5eb00703e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009850 tx=0x7f5ebc000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:01.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.742+0000 7f5eb77fe640 1 -- 172.21.15.52:0/473055763 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5eb802f2e0 con 0x7f5ec8100850 2024-09-06T14:43:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:01 smithi165 ceph-mon[36229]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:43:01.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:01.977+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5ec810e8d0 con 0x7f5eb006df20 2024-09-06T14:43:01.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.000+0000 7f5eb77fe640 1 -- 172.21.15.52:0/473055763 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f5ec810e8d0 con 0x7f5eb006df20 2024-09-06T14:43:01.997 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:43:01.997 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (4m) 50s ago 6m 25.1M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (6m) 50s ago 6m 8186k - 19.1.1-268-g635ed4cf b6db46a449e5 9152c789e0ae 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (5m) 53s ago 5m 5268k - 19.1.1-268-g635ed4cf b6db46a449e5 92f6280b935c 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (6m) 50s ago 6m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (5m) 53s ago 5m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (4m) 50s ago 6m 80.9M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (71s) 50s ago 71s 12.4M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (65s) 50s ago 65s 15.1M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:43:01.998 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (69s) 53s ago 68s 17.1M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (62s) 53s ago 62s 13.9M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:9283,8765,8443 running (7m) 50s ago 7m 498M - 19.1.1-268-g635ed4cf b6db46a449e5 39e44f4c0904 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (5m) 53s ago 5m 441M - 19.1.1-268-g635ed4cf b6db46a449e5 b3f6405384f6 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (7m) 50s ago 7m 47.2M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (5m) 53s ago 5m 34.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (6m) 50s ago 6m 16.2M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (5m) 53s ago 5m 15.8M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (4m) 50s ago 4m 46.6M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (3m) 50s ago 3m 57.4M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (3m) 50s ago 3m 54.1M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (3m) 53s ago 3m 50.9M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (2m) 53s ago 2m 48.5M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:43:01.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (2m) 53s ago 2m 42.2M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:43:02.000 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (4m) 50s ago 5m 59.2M - 2.43.0 a07b618ecd1d 1b767954d6f6 2024-09-06T14:43:02.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.002+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5eb006df20 msgr2=0x7f5eb00703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.002+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5eb006df20 0x7f5eb00703e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009850 tx=0x7f5ebc000bc0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.002+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 msgr2=0x7f5ec8107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.002+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 0x7f5ec8107f90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5eb801fa90 tx=0x7f5eb801ff50 comp rx=0 tx=0).stop 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.003+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 shutdown_connections 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.003+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5eb006df20 0x7f5eb00703e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.003+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ec81084d0 0x7f5ec810d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.003+0000 7f5ecce9e640 1 --2- 172.21.15.52:0/473055763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ec8100850 0x7f5ec8107f90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.003+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 >> 172.21.15.52:0/473055763 conn(0x7f5ec80fbfe0 msgr2=0x7f5ec80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.003+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 shutdown_connections 2024-09-06T14:43:02.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.003+0000 7f5ecce9e640 1 -- 172.21.15.52:0/473055763 wait complete. 2024-09-06T14:43:02.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.088+0000 7f3c3a7fc640 1 -- 172.21.15.52:0/1983862148 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c2c031740 con 0x7f3c3c100860 2024-09-06T14:43:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.089+0000 7f3c41b1c640 1 -- 172.21.15.52:0/1983862148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 msgr2=0x7f3c3c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.089+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/1983862148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 0x7f3c3c100c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009880 tx=0x7f3c2c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.089+0000 7f3c41b1c640 1 -- 172.21.15.52:0/1983862148 shutdown_connections 2024-09-06T14:43:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.089+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/1983862148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 0x7f3c3c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.089+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/1983862148 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 0x7f3c3c100c60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.089+0000 7f3c41b1c640 1 -- 172.21.15.52:0/1983862148 >> 172.21.15.52:0/1983862148 conn(0x7f3c3c0fc010 msgr2=0x7f3c3c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.089+0000 7f3c41b1c640 1 -- 172.21.15.52:0/1983862148 shutdown_connections 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.090+0000 7f3c41b1c640 1 -- 172.21.15.52:0/1983862148 wait complete. 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.090+0000 7f3c41b1c640 1 Processor -- start 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c41b1c640 1 -- start start 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c41b1c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 0x7f3c3c1087a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c41b1c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 0x7f3c3c106e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c41b1c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c10a7a0 con 0x7f3c3c100860 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c41b1c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c10a620 con 0x7f3c3c101a60 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c3affd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 0x7f3c3c106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c3affd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 0x7f3c3c106e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:34694/0 (socket says 172.21.15.52:34694) 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c3affd640 1 -- 172.21.15.52:0/4287319597 learned_addr learned my addr 172.21.15.52:0/4287319597 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:02.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.091+0000 7f3c3b7fe640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 0x7f3c3c1087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c3affd640 1 -- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 msgr2=0x7f3c3c1087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c3affd640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 0x7f3c3c1087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c3affd640 1 -- 172.21.15.52:0/4287319597 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c19b130 con 0x7f3c3c101a60 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c3affd640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 0x7f3c3c106e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000e970 tx=0x7f3c3000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c38ff9640 1 -- 172.21.15.52:0/4287319597 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c3000cac0 con 0x7f3c3c101a60 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c38ff9640 1 -- 172.21.15.52:0/4287319597 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c300054e0 con 0x7f3c3c101a60 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c1073a0 con 0x7f3c3c101a60 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c38ff9640 1 -- 172.21.15.52:0/4287319597 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3c30010430 con 0x7f3c3c101a60 2024-09-06T14:43:02.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.092+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c107930 con 0x7f3c3c101a60 2024-09-06T14:43:02.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.094+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3c10af80 con 0x7f3c3c101a60 2024-09-06T14:43:02.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.094+0000 7f3c38ff9640 1 -- 172.21.15.52:0/4287319597 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f3c30004f00 con 0x7f3c3c101a60 2024-09-06T14:43:02.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.095+0000 7f3c38ff9640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3c2406dee0 0x7f3c240703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:02.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.095+0000 7f3c38ff9640 1 -- 172.21.15.52:0/4287319597 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f3c3008e1d0 con 0x7f3c3c101a60 2024-09-06T14:43:02.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.095+0000 7f3c3b7fe640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3c2406dee0 0x7f3c240703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:02.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.096+0000 7f3c3b7fe640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3c2406dee0 0x7f3c240703a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009230 tx=0x7f3c2c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:02.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.103+0000 7f3c38ff9640 1 -- 172.21.15.52:0/4287319597 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c3005bcf0 con 0x7f3c3c101a60 2024-09-06T14:43:02.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.391+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3c3c02d7c0 con 0x7f3c3c101a60 2024-09-06T14:43:02.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.392+0000 7f3c38ff9640 1 -- 172.21.15.52:0/4287319597 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f3c3005f9a0 con 0x7f3c3c101a60 2024-09-06T14:43:02.390 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:43:02.390 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:43:02.390 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:43:02.390 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 14 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:43:02.391 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:43:02.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3c2406dee0 msgr2=0x7f3c240703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3c2406dee0 0x7f3c240703a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009230 tx=0x7f3c2c0058d0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 msgr2=0x7f3c3c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 0x7f3c3c106e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000e970 tx=0x7f3c3000ed70 comp rx=0 tx=0).stop 2024-09-06T14:43:02.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 shutdown_connections 2024-09-06T14:43:02.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3c2406dee0 0x7f3c240703a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c3c101a60 0x7f3c3c106e60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 --2- 172.21.15.52:0/4287319597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c3c100860 0x7f3c3c1087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.394+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 >> 172.21.15.52:0/4287319597 conn(0x7f3c3c0fc010 msgr2=0x7f3c3c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:02.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.395+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 shutdown_connections 2024-09-06T14:43:02.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.395+0000 7f3c41b1c640 1 -- 172.21.15.52:0/4287319597 wait complete. 2024-09-06T14:43:02.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 -- 172.21.15.52:0/3529861202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63101023f0 msgr2=0x7f63101047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 --2- 172.21.15.52:0/3529861202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63101023f0 0x7f63101047e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f63000098b0 tx=0x7f630002a4d0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 -- 172.21.15.52:0/3529861202 shutdown_connections 2024-09-06T14:43:02.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 --2- 172.21.15.52:0/3529861202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310104d20 0x7f6310107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 --2- 172.21.15.52:0/3529861202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63101023f0 0x7f63101047e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 -- 172.21.15.52:0/3529861202 >> 172.21.15.52:0/3529861202 conn(0x7f63100fc010 msgr2=0x7f63100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:02.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 -- 172.21.15.52:0/3529861202 shutdown_connections 2024-09-06T14:43:02.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.487+0000 7f63160f4640 1 -- 172.21.15.52:0/3529861202 wait complete. 2024-09-06T14:43:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.488+0000 7f63160f4640 1 Processor -- start 2024-09-06T14:43:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.488+0000 7f63160f4640 1 -- start start 2024-09-06T14:43:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f63160f4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310104d20 0x7f6310197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f63160f4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310197cd0 0x7f631019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f63160f4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f631010a7c0 con 0x7f6310104d20 2024-09-06T14:43:02.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f63160f4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f631010a640 con 0x7f6310197cd0 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f630effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310197cd0 0x7f631019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f630effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310197cd0 0x7f631019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:34720/0 (socket says 172.21.15.52:34720) 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f630effd640 1 -- 172.21.15.52:0/1757792640 learned_addr learned my addr 172.21.15.52:0/1757792640 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.489+0000 7f630f7fe640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310104d20 0x7f6310197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f630effd640 1 -- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310104d20 msgr2=0x7f6310197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f630effd640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310104d20 0x7f6310197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f630effd640 1 -- 172.21.15.52:0/1757792640 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6310198200 con 0x7f6310197cd0 2024-09-06T14:43:02.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f630f7fe640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310104d20 0x7f6310197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:43:02.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f630effd640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310197cd0 0x7f631019ccd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f630400d6f0 tx=0x7f630400dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:02.490 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:02.490 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:02.490 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:02.490 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:02.490 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: Upgrade: Target is version 19.3.0-4704-g8b38c33c (squid) 2024-09-06T14:43:02.490 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30'] 2024-09-06T14:43:02.490 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:43:02.491 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: Upgrade: Need to upgrade myself (mgr.smithi052.vsthpq) 2024-09-06T14:43:02.491 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:02 smithi052 ceph-mon[28627]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:02.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f630cff9640 1 -- 172.21.15.52:0/1757792640 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6304017070 con 0x7f6310197cd0 2024-09-06T14:43:02.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f631019d210 con 0x7f6310197cd0 2024-09-06T14:43:02.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f631019d710 con 0x7f6310197cd0 2024-09-06T14:43:02.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.490+0000 7f630cff9640 1 -- 172.21.15.52:0/1757792640 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f630400de00 con 0x7f6310197cd0 2024-09-06T14:43:02.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.492+0000 7f630cff9640 1 -- 172.21.15.52:0/1757792640 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f630400f3c0 con 0x7f6310197cd0 2024-09-06T14:43:02.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.493+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63101027d0 con 0x7f6310197cd0 2024-09-06T14:43:02.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.493+0000 7f630cff9640 1 -- 172.21.15.52:0/1757792640 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f630401a070 con 0x7f6310197cd0 2024-09-06T14:43:02.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.494+0000 7f630cff9640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f62f806dc80 0x7f62f8070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:02.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.494+0000 7f630f7fe640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f62f806dc80 0x7f62f8070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:02.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.495+0000 7f630f7fe640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f62f806dc80 0x7f62f8070140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6300009230 tx=0x7f63000041e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:02.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.495+0000 7f630cff9640 1 -- 172.21.15.52:0/1757792640 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f630408d900 con 0x7f6310197cd0 2024-09-06T14:43:02.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.502+0000 7f630cff9640 1 -- 172.21.15.52:0/1757792640 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6304021030 con 0x7f6310197cd0 2024-09-06T14:43:02.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.717+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f63101055e0 con 0x7f62f806dc80 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.718+0000 7f630cff9640 1 -- 172.21.15.52:0/1757792640 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f63101055e0 con 0x7f62f806dc80 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [], 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "0/2 daemons upgraded", 2024-09-06T14:43:02.716 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 image on host smithi165", 2024-09-06T14:43:02.717 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:43:02.717 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:43:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f62f806dc80 msgr2=0x7f62f8070140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f62f806dc80 0x7f62f8070140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6300009230 tx=0x7f63000041e0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310197cd0 msgr2=0x7f631019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:02.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310197cd0 0x7f631019ccd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f630400d6f0 tx=0x7f630400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 shutdown_connections 2024-09-06T14:43:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f62f806dc80 0x7f62f8070140 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6310197cd0 0x7f631019ccd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 --2- 172.21.15.52:0/1757792640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6310104d20 0x7f6310197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.721+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 >> 172.21.15.52:0/1757792640 conn(0x7f63100fc010 msgr2=0x7f63100fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.722+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 shutdown_connections 2024-09-06T14:43:02.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:02.722+0000 7f63160f4640 1 -- 172.21.15.52:0/1757792640 wait complete. 2024-09-06T14:43:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: Upgrade: Target is version 19.3.0-4704-g8b38c33c (squid) 2024-09-06T14:43:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30'] 2024-09-06T14:43:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:43:02.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: Upgrade: Need to upgrade myself (mgr.smithi052.vsthpq) 2024-09-06T14:43:02.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:02 smithi165 ceph-mon[36229]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:03.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:03 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4287319597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:43:03.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:03 smithi052 ceph-mon[28627]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 on smithi165 2024-09-06T14:43:03.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:03 smithi052 ceph-mon[28627]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:03.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:03 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/4287319597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:43:03.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:03 smithi165 ceph-mon[36229]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 on smithi165 2024-09-06T14:43:03.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:03 smithi165 ceph-mon[36229]: from='client.24339 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:04.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:04 smithi165 ceph-mon[36229]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:04.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:04 smithi052 ceph-mon[28627]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:07.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:07 smithi052 ceph-mon[28627]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:07 smithi165 ceph-mon[36229]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:09 smithi052 ceph-mon[28627]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:09.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:09 smithi165 ceph-mon[36229]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:10.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:10 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:10.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:10 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:11.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:11 smithi052 ceph-mon[28627]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:43:11.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:11 smithi165 ceph-mon[36229]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:43:12.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:12 smithi052 ceph-mon[28627]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:12.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:12 smithi165 ceph-mon[36229]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:15.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:15 smithi165 ceph-mon[36229]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:15.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:15 smithi052 ceph-mon[28627]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:17.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:17 smithi052 ceph-mon[28627]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:17 smithi165 ceph-mon[36229]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:19.263 INFO:tasks.workunit.client.1.smithi165.stderr:Updating files: 92% (11697/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-06T14:43:19.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:19 smithi052 ceph-mon[28627]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:19.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:19 smithi165 ceph-mon[36229]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:19.837 INFO:tasks.workunit.client.1.smithi165.stderr:Note: switching to '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'. 2024-09-06T14:43:19.837 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-06T14:43:19.837 INFO:tasks.workunit.client.1.smithi165.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-06T14:43:19.837 INFO:tasks.workunit.client.1.smithi165.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-06T14:43:19.837 INFO:tasks.workunit.client.1.smithi165.stderr:state without impacting any branches by switching back to a branch. 2024-09-06T14:43:19.837 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr: git switch -c 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr:Or undo this operation with: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr: git switch - 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr: 2024-09-06T14:43:19.838 INFO:tasks.workunit.client.1.smithi165.stderr:HEAD is now at 8b38c33cecf Merge branch 'earmark-subvol/grp' of https://github.com/avanthakkar/ceph into wip-athakkar-testing-2024-09-04-1837 2024-09-06T14:43:19.843 DEBUG:teuthology.orchestra.run.smithi165:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-06T14:43:19.907 INFO:tasks.workunit.client.1.smithi165.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-06T14:43:19.909 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-06T14:43:19.909 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-06T14:43:20.543 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-06T14:43:20.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:20 smithi165 ceph-mon[36229]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:43:20.610 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-06T14:43:20.650 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-06T14:43:20.651 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-06T14:43:20.652 INFO:tasks.workunit.client.1.smithi165.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-06T14:43:20.693 INFO:tasks.workunit.client.1.smithi165.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-06T14:43:20.697 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-06T14:43:20.697 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-06T14:43:20.754 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-06T14:43:20.757 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-06T14:43:20.757 DEBUG:teuthology.orchestra.run.smithi165:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-06T14:43:20.820 INFO:tasks.workunit.client.1.smithi165.stderr:+ mkdir -p fsstress 2024-09-06T14:43:20.823 INFO:tasks.workunit.client.1.smithi165.stderr:+ pushd fsstress 2024-09-06T14:43:20.824 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-06T14:43:20.824 INFO:tasks.workunit.client.1.smithi165.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-06T14:43:20.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:20 smithi052 ceph-mon[28627]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T14:43:21.378 INFO:tasks.workunit.client.1.smithi165.stderr:+ tar xzf ltp-full.tgz 2024-09-06T14:43:22.817 INFO:tasks.workunit.client.0.smithi052.stderr:Updating files: 85% (10809/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-06T14:43:23.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:23 smithi052 ceph-mon[28627]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:23.807 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to '8b38c33cecf4b0b7a9b3116eb9089e21e444ac73'. 2024-09-06T14:43:23.807 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-06T14:43:23.808 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-09-06T14:43:23.809 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-06T14:43:23.809 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-06T14:43:23.809 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-06T14:43:23.809 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at 8b38c33cecf Merge branch 'earmark-subvol/grp' of https://github.com/avanthakkar/ceph into wip-athakkar-testing-2024-09-04-1837 2024-09-06T14:43:23.814 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-06T14:43:23.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:23 smithi165 ceph-mon[36229]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-06T14:43:24.067 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-06T14:43:24.069 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-06T14:43:24.069 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-06T14:43:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:25 smithi165 ceph-mon[36229]: pgmap v221: 65 pgs: 65 active+clean; 1.5 MiB data, 207 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 83 KiB/s wr, 11 op/s 2024-09-06T14:43:25.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:25 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:25.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:25 smithi052 ceph-mon[28627]: pgmap v221: 65 pgs: 65 active+clean; 1.5 MiB data, 207 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 83 KiB/s wr, 11 op/s 2024-09-06T14:43:25.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:25 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:27.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:27 smithi052 ceph-mon[28627]: pgmap v222: 65 pgs: 65 active+clean; 13 MiB data, 235 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 34 op/s 2024-09-06T14:43:27.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:27 smithi165 ceph-mon[36229]: pgmap v222: 65 pgs: 65 active+clean; 13 MiB data, 235 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 1.1 MiB/s wr, 34 op/s 2024-09-06T14:43:28.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:28 smithi165 ceph-mon[36229]: pgmap v223: 65 pgs: 65 active+clean; 18 MiB data, 241 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.4 MiB/s wr, 51 op/s 2024-09-06T14:43:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:28 smithi052 ceph-mon[28627]: pgmap v223: 65 pgs: 65 active+clean; 18 MiB data, 241 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 1.4 MiB/s wr, 51 op/s 2024-09-06T14:43:29.547 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-06T14:43:29.817 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-06T14:43:29.862 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-06T14:43:29.863 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-06T14:43:29.864 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-06T14:43:29.907 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-06T14:43:29.910 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T14:43:29.910 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-06T14:43:29.926 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-06T14:43:29.928 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-06T14:43:29.929 DEBUG:teuthology.orchestra.run.smithi052:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-06T14:43:29.993 INFO:tasks.workunit.client.0.smithi052.stderr:+ mkdir -p fsstress 2024-09-06T14:43:29.997 INFO:tasks.workunit.client.0.smithi052.stderr:+ pushd fsstress 2024-09-06T14:43:29.998 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-06T14:43:29.998 INFO:tasks.workunit.client.0.smithi052.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-06T14:43:30.858 INFO:tasks.workunit.client.0.smithi052.stderr:+ tar xzf ltp-full.tgz 2024-09-06T14:43:31.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:31 smithi052 ceph-mon[28627]: pgmap v224: 65 pgs: 65 active+clean; 18 MiB data, 251 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1.5 MiB/s wr, 62 op/s 2024-09-06T14:43:31.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:31 smithi165 ceph-mon[36229]: pgmap v224: 65 pgs: 65 active+clean; 18 MiB data, 251 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1.5 MiB/s wr, 62 op/s 2024-09-06T14:43:32.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.832+0000 7f18c9ffb640 1 -- 172.21.15.52:0/2582001018 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18c0031740 con 0x7f18cc104d60 2024-09-06T14:43:32.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.833+0000 7f18d127d640 1 -- 172.21.15.52:0/2582001018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc104d60 msgr2=0x7f18cc1051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.833+0000 7f18d127d640 1 --2- 172.21.15.52:0/2582001018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc104d60 0x7f18cc1051e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009880 tx=0x7f18c002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.833+0000 7f18d127d640 1 -- 172.21.15.52:0/2582001018 shutdown_connections 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.833+0000 7f18d127d640 1 --2- 172.21.15.52:0/2582001018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc104d60 0x7f18cc1051e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.833+0000 7f18d127d640 1 --2- 172.21.15.52:0/2582001018 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18cc103b60 0x7f18cc103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.833+0000 7f18d127d640 1 -- 172.21.15.52:0/2582001018 >> 172.21.15.52:0/2582001018 conn(0x7f18cc0ff2f0 msgr2=0x7f18cc101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.834+0000 7f18d127d640 1 -- 172.21.15.52:0/2582001018 shutdown_connections 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.834+0000 7f18d127d640 1 -- 172.21.15.52:0/2582001018 wait complete. 2024-09-06T14:43:32.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.834+0000 7f18d127d640 1 Processor -- start 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.834+0000 7f18d127d640 1 -- start start 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18d127d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc103b60 0x7f18cc199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18d127d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18cc104d60 0x7f18cc199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18d127d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc10c980 con 0x7f18cc103b60 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18d127d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc10c800 con 0x7f18cc104d60 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc103b60 0x7f18cc199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18ca7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18cc104d60 0x7f18cc199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc103b60 0x7f18cc199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55498/0 (socket says 172.21.15.52:55498) 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18ca7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18cc104d60 0x7f18cc199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:58118/0 (socket says 172.21.15.52:58118) 2024-09-06T14:43:32.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18caffd640 1 -- 172.21.15.52:0/3870055971 learned_addr learned my addr 172.21.15.52:0/3870055971 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18caffd640 1 -- 172.21.15.52:0/3870055971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18cc104d60 msgr2=0x7f18cc199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18caffd640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18cc104d60 0x7f18cc199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.835+0000 7f18caffd640 1 -- 172.21.15.52:0/3870055971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc19a230 con 0x7f18cc103b60 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.836+0000 7f18caffd640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc103b60 0x7f18cc199670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e940 tx=0x7f18bc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.836+0000 7f18b3fff640 1 -- 172.21.15.52:0/3870055971 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18bc00cac0 con 0x7f18cc103b60 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.836+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc19ec70 con 0x7f18cc103b60 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.836+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc19f180 con 0x7f18cc103b60 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.836+0000 7f18b3fff640 1 -- 172.21.15.52:0/3870055971 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18bc00cc60 con 0x7f18cc103b60 2024-09-06T14:43:32.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.836+0000 7f18b3fff640 1 -- 172.21.15.52:0/3870055971 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18bc003de0 con 0x7f18cc103b60 2024-09-06T14:43:32.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.837+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc103f60 con 0x7f18cc103b60 2024-09-06T14:43:32.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.839+0000 7f18b3fff640 1 -- 172.21.15.52:0/3870055971 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f18bc003f80 con 0x7f18cc103b60 2024-09-06T14:43:32.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.839+0000 7f18b3fff640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f18b40766a0 0x7f18b4078b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.839+0000 7f18b3fff640 1 -- 172.21.15.52:0/3870055971 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f18bc08e2c0 con 0x7f18cc103b60 2024-09-06T14:43:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.839+0000 7f18ca7fc640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f18b40766a0 0x7f18b4078b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:32.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.840+0000 7f18ca7fc640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f18b40766a0 0x7f18b4078b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18c0000c00 tx=0x7f18c00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:32.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:32.846+0000 7f18b3fff640 1 -- 172.21.15.52:0/3870055971 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f18bc05bf20 con 0x7f18cc103b60 2024-09-06T14:43:33.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.136+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f18cc1092f0 con 0x7f18b40766a0 2024-09-06T14:43:33.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.137+0000 7f18b3fff640 1 -- 172.21.15.52:0/3870055971 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f18cc1092f0 con 0x7f18b40766a0 2024-09-06T14:43:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f18b40766a0 msgr2=0x7f18b4078b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f18b40766a0 0x7f18b4078b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18c0000c00 tx=0x7f18c00058d0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc103b60 msgr2=0x7f18cc199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc103b60 0x7f18cc199670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e940 tx=0x7f18bc00ee00 comp rx=0 tx=0).stop 2024-09-06T14:43:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 shutdown_connections 2024-09-06T14:43:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f18b40766a0 0x7f18b4078b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f18cc104d60 0x7f18cc199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 --2- 172.21.15.52:0/3870055971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18cc103b60 0x7f18cc199670 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.139+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 >> 172.21.15.52:0/3870055971 conn(0x7f18cc0ff2f0 msgr2=0x7f18cc1014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:33.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.140+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 shutdown_connections 2024-09-06T14:43:33.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.140+0000 7f18d127d640 1 -- 172.21.15.52:0/3870055971 wait complete. 2024-09-06T14:43:33.146 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:43:33.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2994322836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8100860 msgr2=0x7f15b8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2994322836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8100860 0x7f15b8100c60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009880 tx=0x7f15a802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2994322836 shutdown_connections 2024-09-06T14:43:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2994322836 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8101a60 0x7f15b8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2994322836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8100860 0x7f15b8100c60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2994322836 >> 172.21.15.52:0/2994322836 conn(0x7f15b80fc010 msgr2=0x7f15b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2994322836 shutdown_connections 2024-09-06T14:43:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.244+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2994322836 wait complete. 2024-09-06T14:43:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15bd4bd640 1 Processor -- start 2024-09-06T14:43:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15bd4bd640 1 -- start start 2024-09-06T14:43:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15bd4bd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8100860 0x7f15b8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:33.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15bd4bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8101a60 0x7f15b8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15bd4bd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15b8109680 con 0x7f15b8101a60 2024-09-06T14:43:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15bd4bd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15b8109500 con 0x7f15b8100860 2024-09-06T14:43:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15b6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8100860 0x7f15b8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15b67fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8101a60 0x7f15b8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15b6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8100860 0x7f15b8104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:58136/0 (socket says 172.21.15.52:58136) 2024-09-06T14:43:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.245+0000 7f15b6ffd640 1 -- 172.21.15.52:0/2018778713 learned_addr learned my addr 172.21.15.52:0/2018778713 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:33.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f15b6ffd640 1 -- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8101a60 msgr2=0x7f15b8102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f15b6ffd640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8101a60 0x7f15b8102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f15b6ffd640 1 -- 172.21.15.52:0/2018778713 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b8103380 con 0x7f15b8100860 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f15b67fc640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8101a60 0x7f15b8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f15b6ffd640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8100860 0x7f15b8104780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006010 tx=0x7f15a80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f159ffff640 1 -- 172.21.15.52:0/2018778713 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15a803f070 con 0x7f15b8100860 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b8103610 con 0x7f15b8100860 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f159ffff640 1 -- 172.21.15.52:0/2018778713 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15a8004a50 con 0x7f15b8100860 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f159ffff640 1 -- 172.21.15.52:0/2018778713 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15a8035030 con 0x7f15b8100860 2024-09-06T14:43:33.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.246+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b8103b40 con 0x7f15b8100860 2024-09-06T14:43:33.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.248+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b8100c60 con 0x7f15b8100860 2024-09-06T14:43:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.248+0000 7f159ffff640 1 -- 172.21.15.52:0/2018778713 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f15a8042070 con 0x7f15b8100860 2024-09-06T14:43:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.249+0000 7f159ffff640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f15a006de90 0x7f15a0070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.249+0000 7f159ffff640 1 -- 172.21.15.52:0/2018778713 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f15a80ae6d0 con 0x7f15b8100860 2024-09-06T14:43:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.249+0000 7f15b67fc640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f15a006de90 0x7f15a0070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:33.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.250+0000 7f15b67fc640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f15a006de90 0x7f15a0070350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f15b8104500 tx=0x7f15ac00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:33.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.256+0000 7f159ffff640 1 -- 172.21.15.52:0/2018778713 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15a8004c00 con 0x7f15b8100860 2024-09-06T14:43:33.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.555+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f15b806a400 con 0x7f15a006de90 2024-09-06T14:43:33.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.556+0000 7f159ffff640 1 -- 172.21.15.52:0/2018778713 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f15b806a400 con 0x7f15a006de90 2024-09-06T14:43:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.558+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f15a006de90 msgr2=0x7f15a0070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.558+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f15a006de90 0x7f15a0070350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f15b8104500 tx=0x7f15ac00b390 comp rx=0 tx=0).stop 2024-09-06T14:43:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.558+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8100860 msgr2=0x7f15b8104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.558+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8100860 0x7f15b8104780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006010 tx=0x7f15a80045e0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.559+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 shutdown_connections 2024-09-06T14:43:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.559+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f15a006de90 0x7f15a0070350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.559+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15b8101a60 0x7f15b8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.559+0000 7f15bd4bd640 1 --2- 172.21.15.52:0/2018778713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15b8100860 0x7f15b8104780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.559+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 >> 172.21.15.52:0/2018778713 conn(0x7f15b80fc010 msgr2=0x7f15b8069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:33.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.559+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 shutdown_connections 2024-09-06T14:43:33.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.559+0000 7f15bd4bd640 1 -- 172.21.15.52:0/2018778713 wait complete. 2024-09-06T14:43:33.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:33 smithi052 ceph-mon[28627]: pgmap v225: 65 pgs: 65 active+clean; 28 MiB data, 265 MiB used, 536 GiB / 536 GiB avail; 362 KiB/s rd, 2.4 MiB/s wr, 79 op/s 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 -- 172.21.15.52:0/690212393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc100860 msgr2=0x7f2ddc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 --2- 172.21.15.52:0/690212393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc100860 0x7f2ddc100c60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009880 tx=0x7f2dd802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 -- 172.21.15.52:0/690212393 shutdown_connections 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 --2- 172.21.15.52:0/690212393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc101a60 0x7f2ddc101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 --2- 172.21.15.52:0/690212393 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc100860 0x7f2ddc100c60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 -- 172.21.15.52:0/690212393 >> 172.21.15.52:0/690212393 conn(0x7f2ddc0fc010 msgr2=0x7f2ddc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 -- 172.21.15.52:0/690212393 shutdown_connections 2024-09-06T14:43:33.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.674+0000 7f2de3d86640 1 -- 172.21.15.52:0/690212393 wait complete. 2024-09-06T14:43:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de3d86640 1 Processor -- start 2024-09-06T14:43:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de3d86640 1 -- start start 2024-09-06T14:43:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de3d86640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc100860 0x7f2ddc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de3d86640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc101a60 0x7f2ddc199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de3d86640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc109680 con 0x7f2ddc101a60 2024-09-06T14:43:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de3d86640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2ddc109500 con 0x7f2ddc100860 2024-09-06T14:43:33.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de1b22640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc100860 0x7f2ddc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de1321640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc101a60 0x7f2ddc199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de1b22640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc100860 0x7f2ddc1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:58148/0 (socket says 172.21.15.52:58148) 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de1b22640 1 -- 172.21.15.52:0/85290910 learned_addr learned my addr 172.21.15.52:0/85290910 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.675+0000 7f2de1321640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc101a60 0x7f2ddc199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55536/0 (socket says 172.21.15.52:55536) 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2de1b22640 1 -- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc101a60 msgr2=0x7f2ddc199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2de1b22640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc101a60 0x7f2ddc199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2de1b22640 1 -- 172.21.15.52:0/85290910 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ddc19a290 con 0x7f2ddc100860 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2de1b22640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc100860 0x7f2ddc1996d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8006010 tx=0x7f2dd80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2dd2ffd640 1 -- 172.21.15.52:0/85290910 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dd803f070 con 0x7f2ddc100860 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2dd2ffd640 1 -- 172.21.15.52:0/85290910 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2dd80049d0 con 0x7f2ddc100860 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ddc19ec70 con 0x7f2ddc100860 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2dd2ffd640 1 -- 172.21.15.52:0/85290910 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2dd8035030 con 0x7f2ddc100860 2024-09-06T14:43:33.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.676+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ddc19f1b0 con 0x7f2ddc100860 2024-09-06T14:43:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.678+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ddc100c60 con 0x7f2ddc100860 2024-09-06T14:43:33.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.679+0000 7f2dd2ffd640 1 -- 172.21.15.52:0/85290910 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f2dd8042070 con 0x7f2ddc100860 2024-09-06T14:43:33.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.679+0000 7f2dd2ffd640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2dc806de90 0x7f2dc8070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:33.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.679+0000 7f2dd2ffd640 1 -- 172.21.15.52:0/85290910 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f2dd80ae710 con 0x7f2ddc100860 2024-09-06T14:43:33.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.680+0000 7f2de1321640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2dc806de90 0x7f2dc8070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:33.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.680+0000 7f2de1321640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2dc806de90 0x7f2dc8070350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc19ab80 tx=0x7f2dcc005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:33.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:33.685+0000 7f2dd2ffd640 1 -- 172.21.15.52:0/85290910 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2dd807fe60 con 0x7f2ddc100860 2024-09-06T14:43:33.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:33 smithi165 ceph-mon[36229]: pgmap v225: 65 pgs: 65 active+clean; 28 MiB data, 265 MiB used, 536 GiB / 536 GiB avail; 362 KiB/s rd, 2.4 MiB/s wr, 79 op/s 2024-09-06T14:43:34.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.027+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2ddc06a400 con 0x7f2dc806de90 2024-09-06T14:43:34.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.041+0000 7f2dd2ffd640 1 -- 172.21.15.52:0/85290910 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f2ddc06a400 con 0x7f2dc806de90 2024-09-06T14:43:34.040 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:43:34.040 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (5m) 82s ago 6m 25.1M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:43:34.040 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (7m) 82s ago 7m 8186k - 19.1.1-268-g635ed4cf b6db46a449e5 9152c789e0ae 2024-09-06T14:43:34.040 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (6m) 85s ago 6m 5268k - 19.1.1-268-g635ed4cf b6db46a449e5 92f6280b935c 2024-09-06T14:43:34.040 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (7m) 82s ago 7m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (6m) 85s ago 6m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (5m) 82s ago 6m 80.9M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (103s) 82s ago 103s 12.4M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (97s) 82s ago 97s 15.1M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (101s) 85s ago 100s 17.1M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (95s) 85s ago 94s 13.9M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:9283,8765,8443 running (8m) 82s ago 8m 498M - 19.1.1-268-g635ed4cf b6db46a449e5 39e44f4c0904 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (6m) 85s ago 6m 441M - 19.1.1-268-g635ed4cf b6db46a449e5 b3f6405384f6 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (8m) 82s ago 8m 47.2M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (5m) 85s ago 5m 34.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (6m) 82s ago 6m 16.2M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:43:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 85s ago 6m 15.8M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:43:34.042 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (4m) 82s ago 4m 46.6M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:43:34.042 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (4m) 82s ago 4m 57.4M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:43:34.042 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (4m) 82s ago 4m 54.1M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:43:34.042 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (3m) 85s ago 3m 50.9M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:43:34.042 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (3m) 85s ago 3m 48.5M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:43:34.042 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (2m) 85s ago 2m 42.2M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:43:34.042 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (5m) 82s ago 6m 59.2M - 2.43.0 a07b618ecd1d 1b767954d6f6 2024-09-06T14:43:34.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2dc806de90 msgr2=0x7f2dc8070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2dc806de90 0x7f2dc8070350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc19ab80 tx=0x7f2dcc005f90 comp rx=0 tx=0).stop 2024-09-06T14:43:34.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc100860 msgr2=0x7f2ddc1996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc100860 0x7f2ddc1996d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8006010 tx=0x7f2dd80045e0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 shutdown_connections 2024-09-06T14:43:34.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f2dc806de90 0x7f2dc8070350 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2ddc101a60 0x7f2ddc199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 --2- 172.21.15.52:0/85290910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2ddc100860 0x7f2ddc1996d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 >> 172.21.15.52:0/85290910 conn(0x7f2ddc0fc010 msgr2=0x7f2ddc069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:34.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 shutdown_connections 2024-09-06T14:43:34.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.044+0000 7f2de3d86640 1 -- 172.21.15.52:0/85290910 wait complete. 2024-09-06T14:43:34.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 -- 172.21.15.52:0/765575750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 msgr2=0x7f3ea81022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 --2- 172.21.15.52:0/765575750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 0x7f3ea81022d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009880 tx=0x7f3e9802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 -- 172.21.15.52:0/765575750 shutdown_connections 2024-09-06T14:43:34.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 --2- 172.21.15.52:0/765575750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 0x7f3ea80ffe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 --2- 172.21.15.52:0/765575750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 0x7f3ea81022d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 -- 172.21.15.52:0/765575750 >> 172.21.15.52:0/765575750 conn(0x7f3ea80fb760 msgr2=0x7f3ea80fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:34.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 -- 172.21.15.52:0/765575750 shutdown_connections 2024-09-06T14:43:34.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.144+0000 7f3ead612640 1 -- 172.21.15.52:0/765575750 wait complete. 2024-09-06T14:43:34.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.145+0000 7f3ead612640 1 Processor -- start 2024-09-06T14:43:34.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.145+0000 7f3ead612640 1 -- start start 2024-09-06T14:43:34.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.145+0000 7f3ead612640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 0x7f3ea81996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:34.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ead612640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 0x7f3ea8199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:34.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 0x7f3ea81996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:34.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ead612640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea810ca10 con 0x7f3ea8101ed0 2024-09-06T14:43:34.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ead612640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea810c890 con 0x7f3ea80ff9d0 2024-09-06T14:43:34.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 0x7f3ea81996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:58164/0 (socket says 172.21.15.52:58164) 2024-09-06T14:43:34.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea6ffd640 1 -- 172.21.15.52:0/3671815385 learned_addr learned my addr 172.21.15.52:0/3671815385 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:34.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea67fc640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 0x7f3ea8199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:34.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea67fc640 1 -- 172.21.15.52:0/3671815385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 msgr2=0x7f3ea81996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea67fc640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 0x7f3ea81996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea67fc640 1 -- 172.21.15.52:0/3671815385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea819a260 con 0x7f3ea8101ed0 2024-09-06T14:43:34.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.146+0000 7f3ea6ffd640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 0x7f3ea81996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:43:34.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.147+0000 7f3ea67fc640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 0x7f3ea8199be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8102c80 tx=0x7f3e9c00dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:34.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.147+0000 7f3e8ffff640 1 -- 172.21.15.52:0/3671815385 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c017070 con 0x7f3ea8101ed0 2024-09-06T14:43:34.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.147+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea819eca0 con 0x7f3ea8101ed0 2024-09-06T14:43:34.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.147+0000 7f3e8ffff640 1 -- 172.21.15.52:0/3671815385 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e9c00be10 con 0x7f3ea8101ed0 2024-09-06T14:43:34.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.147+0000 7f3e8ffff640 1 -- 172.21.15.52:0/3671815385 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e9c00f3c0 con 0x7f3ea8101ed0 2024-09-06T14:43:34.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.147+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea819f1d0 con 0x7f3ea8101ed0 2024-09-06T14:43:34.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.149+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea80ffe50 con 0x7f3ea8101ed0 2024-09-06T14:43:34.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.149+0000 7f3e8ffff640 1 -- 172.21.15.52:0/3671815385 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f3e9c01a070 con 0x7f3ea8101ed0 2024-09-06T14:43:34.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.150+0000 7f3e8ffff640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e9006de90 0x7f3e90070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:34.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.150+0000 7f3e8ffff640 1 -- 172.21.15.52:0/3671815385 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f3e9c08d2d0 con 0x7f3ea8101ed0 2024-09-06T14:43:34.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.150+0000 7f3ea6ffd640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e9006de90 0x7f3e90070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:34.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.150+0000 7f3ea6ffd640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e9006de90 0x7f3e90070350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009230 tx=0x7f3e98005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:34.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.156+0000 7f3e8ffff640 1 -- 172.21.15.52:0/3671815385 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e9c05ebe0 con 0x7f3ea8101ed0 2024-09-06T14:43:34.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.515+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3ea8062df0 con 0x7f3ea8101ed0 2024-09-06T14:43:34.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.516+0000 7f3e8ffff640 1 -- 172.21.15.52:0/3671815385 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f3e9c063410 con 0x7f3ea8101ed0 2024-09-06T14:43:34.513 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:43:34.514 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:43:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:43:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 14 2024-09-06T14:43:34.515 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:43:34.515 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:43:34.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e9006de90 msgr2=0x7f3e90070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e9006de90 0x7f3e90070350 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009230 tx=0x7f3e98005a20 comp rx=0 tx=0).stop 2024-09-06T14:43:34.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 msgr2=0x7f3ea8199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 0x7f3ea8199be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8102c80 tx=0x7f3e9c00dd60 comp rx=0 tx=0).stop 2024-09-06T14:43:34.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 shutdown_connections 2024-09-06T14:43:34.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f3e9006de90 0x7f3e90070350 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea8101ed0 0x7f3ea8199be0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 --2- 172.21.15.52:0/3671815385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ea80ff9d0 0x7f3ea81996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.518+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 >> 172.21.15.52:0/3671815385 conn(0x7f3ea80fb760 msgr2=0x7f3ea8109400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:34.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.519+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 shutdown_connections 2024-09-06T14:43:34.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.519+0000 7f3ead612640 1 -- 172.21.15.52:0/3671815385 wait complete. 2024-09-06T14:43:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.621+0000 7f5fee7fc640 1 -- 172.21.15.52:0/54920626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe4035020 con 0x7f5ff0102c10 2024-09-06T14:43:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/54920626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff0102c10 msgr2=0x7f5ff0103090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/54920626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff0102c10 0x7f5ff0103090 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009880 tx=0x7f5fe402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/54920626 shutdown_connections 2024-09-06T14:43:34.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/54920626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff0102c10 0x7f5ff0103090 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/54920626 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff00ffc30 0x7f5ff0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/54920626 >> 172.21.15.52:0/54920626 conn(0x7f5ff00fb7a0 msgr2=0x7f5ff00fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/54920626 shutdown_connections 2024-09-06T14:43:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/54920626 wait complete. 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.622+0000 7f5ff5d0d640 1 Processor -- start 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5ff5d0d640 1 -- start start 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5ff5d0d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff00ffc30 0x7f5ff0110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5ff5d0d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff0102c10 0x7f5ff0110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5ff5d0d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0108590 con 0x7f5ff00ffc30 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5ff5d0d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff0108410 con 0x7f5ff0102c10 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5fef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff00ffc30 0x7f5ff0110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5fef7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff00ffc30 0x7f5ff0110570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55566/0 (socket says 172.21.15.52:55566) 2024-09-06T14:43:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5fef7fe640 1 -- 172.21.15.52:0/1129267831 learned_addr learned my addr 172.21.15.52:0/1129267831 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5feeffd640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff0102c10 0x7f5ff0110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5fef7fe640 1 -- 172.21.15.52:0/1129267831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff0102c10 msgr2=0x7f5ff0110ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5fef7fe640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff0102c10 0x7f5ff0110ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.623+0000 7f5fef7fe640 1 -- 172.21.15.52:0/1129267831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff0111130 con 0x7f5ff00ffc30 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.624+0000 7f5fef7fe640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff00ffc30 0x7f5ff0110570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000e940 tx=0x7f5fe000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.624+0000 7f5fecff9640 1 -- 172.21.15.52:0/1129267831 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe000cac0 con 0x7f5ff00ffc30 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.624+0000 7f5fecff9640 1 -- 172.21.15.52:0/1129267831 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fe000cc60 con 0x7f5ff00ffc30 2024-09-06T14:43:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.624+0000 7f5fecff9640 1 -- 172.21.15.52:0/1129267831 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe0003de0 con 0x7f5ff00ffc30 2024-09-06T14:43:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.624+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff0113b60 con 0x7f5ff00ffc30 2024-09-06T14:43:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.624+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff01140f0 con 0x7f5ff00ffc30 2024-09-06T14:43:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.626+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff010a480 con 0x7f5ff00ffc30 2024-09-06T14:43:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.626+0000 7f5fecff9640 1 -- 172.21.15.52:0/1129267831 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 19) ==== 92203+0+0 (secure 0 0 0) 0x7f5fe0003fe0 con 0x7f5ff00ffc30 2024-09-06T14:43:34.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:34 smithi052 ceph-mon[28627]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.627+0000 7f5fecff9640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5fd806dee0 0x7f5fd80703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:43:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.627+0000 7f5fecff9640 1 -- 172.21.15.52:0/1129267831 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f5fe008e260 con 0x7f5ff00ffc30 2024-09-06T14:43:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.627+0000 7f5feeffd640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5fd806dee0 0x7f5fd80703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:43:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.628+0000 7f5feeffd640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5fd806dee0 0x7f5fd80703a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0111a20 tx=0x7f5fe4004f20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:43:34.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.632+0000 7f5fecff9640 1 -- 172.21.15.52:0/1129267831 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5fe005bd80 con 0x7f5ff00ffc30 2024-09-06T14:43:34.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:34 smithi165 ceph-mon[36229]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:34.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.878+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 --> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ff0114460 con 0x7f5fd806dee0 2024-09-06T14:43:34.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.879+0000 7f5fecff9640 1 -- 172.21.15.52:0/1129267831 <== mgr.14217 v2:172.21.15.52:6800/1895569249 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f5ff0114460 con 0x7f5fd806dee0 2024-09-06T14:43:34.877 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:43:34.877 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:43:34.877 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:43:34.877 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:43:34.877 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [], 2024-09-06T14:43:34.877 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "0/2 daemons upgraded", 2024-09-06T14:43:34.878 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 image on host smithi165", 2024-09-06T14:43:34.878 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:43:34.878 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:43:34.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5fd806dee0 msgr2=0x7f5fd80703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5fd806dee0 0x7f5fd80703a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0111a20 tx=0x7f5fe4004f20 comp rx=0 tx=0).stop 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff00ffc30 msgr2=0x7f5ff0110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff00ffc30 0x7f5ff0110570 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000e940 tx=0x7f5fe000ee00 comp rx=0 tx=0).stop 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 shutdown_connections 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:6800/1895569249,v1:172.21.15.52:6801/1895569249] conn(0x7f5fd806dee0 0x7f5fd80703a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ff0102c10 0x7f5ff0110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 --2- 172.21.15.52:0/1129267831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ff00ffc30 0x7f5ff0110570 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:43:34.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.882+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 >> 172.21.15.52:0/1129267831 conn(0x7f5ff00fb7a0 msgr2=0x7f5ff0106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:43:34.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.883+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 shutdown_connections 2024-09-06T14:43:34.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:43:34.883+0000 7f5ff5d0d640 1 -- 172.21.15.52:0/1129267831 wait complete. 2024-09-06T14:43:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:35 smithi165 ceph-mon[36229]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:35 smithi165 ceph-mon[36229]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:35 smithi165 ceph-mon[36229]: pgmap v226: 65 pgs: 65 active+clean; 43 MiB data, 309 MiB used, 536 GiB / 536 GiB avail; 610 KiB/s rd, 3.6 MiB/s wr, 110 op/s 2024-09-06T14:43:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:35 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3671815385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:43:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:35 smithi165 ceph-mon[36229]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:35.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:35 smithi052 ceph-mon[28627]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:35.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:35 smithi052 ceph-mon[28627]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:35.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:35 smithi052 ceph-mon[28627]: pgmap v226: 65 pgs: 65 active+clean; 43 MiB data, 309 MiB used, 536 GiB / 536 GiB avail; 610 KiB/s rd, 3.6 MiB/s wr, 110 op/s 2024-09-06T14:43:35.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:35 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3671815385' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:43:35.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:35 smithi052 ceph-mon[28627]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:43:36.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:36 smithi165 ceph-mon[36229]: pgmap v227: 65 pgs: 65 active+clean; 50 MiB data, 358 MiB used, 536 GiB / 536 GiB avail; 904 KiB/s rd, 4.1 MiB/s wr, 147 op/s 2024-09-06T14:43:36.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:36 smithi052 ceph-mon[28627]: pgmap v227: 65 pgs: 65 active+clean; 50 MiB data, 358 MiB used, 536 GiB / 536 GiB avail; 904 KiB/s rd, 4.1 MiB/s wr, 147 op/s 2024-09-06T14:43:39.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:39 smithi052 ceph-mon[28627]: pgmap v228: 65 pgs: 65 active+clean; 59 MiB data, 384 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 157 op/s 2024-09-06T14:43:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:39 smithi165 ceph-mon[36229]: pgmap v228: 65 pgs: 65 active+clean; 59 MiB data, 384 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.9 MiB/s wr, 157 op/s 2024-09-06T14:43:40.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:40 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:40.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:40 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:41.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:41 smithi052 ceph-mon[28627]: pgmap v229: 65 pgs: 65 active+clean; 65 MiB data, 404 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 157 op/s 2024-09-06T14:43:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:41 smithi165 ceph-mon[36229]: pgmap v229: 65 pgs: 65 active+clean; 65 MiB data, 404 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 157 op/s 2024-09-06T14:43:42.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:42 smithi165 ceph-mon[36229]: pgmap v230: 65 pgs: 65 active+clean; 66 MiB data, 412 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 169 op/s 2024-09-06T14:43:42.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:42 smithi052 ceph-mon[28627]: pgmap v230: 65 pgs: 65 active+clean; 66 MiB data, 412 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 169 op/s 2024-09-06T14:43:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:45 smithi165 ceph-mon[36229]: pgmap v231: 65 pgs: 65 active+clean; 80 MiB data, 424 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 188 op/s 2024-09-06T14:43:45.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:45 smithi052 ceph-mon[28627]: pgmap v231: 65 pgs: 65 active+clean; 80 MiB data, 424 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.4 MiB/s wr, 188 op/s 2024-09-06T14:43:47.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:47 smithi052 ceph-mon[28627]: pgmap v232: 65 pgs: 65 active+clean; 86 MiB data, 447 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-09-06T14:43:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:47 smithi165 ceph-mon[36229]: pgmap v232: 65 pgs: 65 active+clean; 86 MiB data, 447 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 184 op/s 2024-09-06T14:43:48.683 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:48 smithi165 ceph-mon[36229]: pgmap v233: 65 pgs: 65 active+clean; 98 MiB data, 484 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 172 op/s 2024-09-06T14:43:48.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:48 smithi052 ceph-mon[28627]: pgmap v233: 65 pgs: 65 active+clean; 98 MiB data, 484 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 172 op/s 2024-09-06T14:43:50.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:50 smithi165 ceph-mon[36229]: Upgrade: Updating mgr.smithi165.hcexoi 2024-09-06T14:43:50.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:50.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:43:50.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:43:50.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:50 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:43:50.537 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:50 smithi165 ceph-mon[36229]: Deploying daemon mgr.smithi165.hcexoi on smithi165 2024-09-06T14:43:50.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:50 smithi052 ceph-mon[28627]: Upgrade: Updating mgr.smithi165.hcexoi 2024-09-06T14:43:50.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:50.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:43:50.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:43:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:50 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:43:50.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:50 smithi052 ceph-mon[28627]: Deploying daemon mgr.smithi165.hcexoi on smithi165 2024-09-06T14:43:51.543 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:51 smithi165 ceph-mon[36229]: pgmap v234: 65 pgs: 65 active+clean; 101 MiB data, 504 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 153 op/s 2024-09-06T14:43:51.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:51 smithi052 ceph-mon[28627]: pgmap v234: 65 pgs: 65 active+clean; 101 MiB data, 504 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 153 op/s 2024-09-06T14:43:53.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:53 smithi052 ceph-mon[28627]: pgmap v235: 65 pgs: 65 active+clean; 108 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 173 op/s 2024-09-06T14:43:53.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:53 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:53.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:53 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:53 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:43:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:53 smithi165 ceph-mon[36229]: pgmap v235: 65 pgs: 65 active+clean; 108 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 173 op/s 2024-09-06T14:43:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:53 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:53 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:53 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:43:54.691 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:54 smithi165 ceph-mon[36229]: pgmap v236: 65 pgs: 65 active+clean; 121 MiB data, 561 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 198 op/s 2024-09-06T14:43:54.746 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:54 smithi052 ceph-mon[28627]: pgmap v236: 65 pgs: 65 active+clean; 121 MiB data, 561 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.7 MiB/s wr, 198 op/s 2024-09-06T14:43:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:55 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:55.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:55 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:43:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:57 smithi165 ceph-mon[36229]: pgmap v237: 65 pgs: 65 active+clean; 132 MiB data, 594 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.4 MiB/s wr, 215 op/s 2024-09-06T14:43:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:57 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:57 smithi052 ceph-mon[28627]: pgmap v237: 65 pgs: 65 active+clean; 132 MiB data, 594 MiB used, 536 GiB / 536 GiB avail; 2.9 MiB/s rd, 4.4 MiB/s wr, 215 op/s 2024-09-06T14:43:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:57 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:43:59.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:59 smithi052 ceph-mon[28627]: pgmap v238: 65 pgs: 65 active+clean; 133 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 222 op/s 2024-09-06T14:43:59.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:59 smithi052 ceph-mon[28627]: Standby manager daemon smithi165.hcexoi restarted 2024-09-06T14:43:59.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:59 smithi052 ceph-mon[28627]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:43:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:59 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:43:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:59 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:43:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:59 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:43:59.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:43:59 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:43:59.737 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:59 smithi165 ceph-mon[36229]: pgmap v238: 65 pgs: 65 active+clean; 133 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.0 MiB/s wr, 222 op/s 2024-09-06T14:43:59.737 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:59 smithi165 ceph-mon[36229]: Standby manager daemon smithi165.hcexoi restarted 2024-09-06T14:43:59.737 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:59 smithi165 ceph-mon[36229]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:43:59.737 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:59 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:43:59.738 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:59 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:43:59.738 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:59 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:43:59.738 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:43:59 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:44:00.611 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:00 smithi052 ceph-mon[28627]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:44:00.611 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:00 smithi052 ceph-mon[28627]: mgrmap e20: smithi052.vsthpq(active, since 6m), standbys: smithi165.hcexoi 2024-09-06T14:44:00.620 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:00 smithi165 ceph-mon[36229]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:44:00.620 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:00 smithi165 ceph-mon[36229]: mgrmap e20: smithi052.vsthpq(active, since 6m), standbys: smithi165.hcexoi 2024-09-06T14:44:01.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: pgmap v239: 65 pgs: 65 active+clean; 134 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 204 op/s 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr fail", "who": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: Activating manager daemon smithi165.hcexoi 2024-09-06T14:44:01.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "mgr fail", "who": "smithi052.vsthpq"}]': finished 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: osdmap e47: 6 total, 6 up, 6 in 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: mgrmap e21: smithi165.hcexoi(active, starting, since 0.00780928s) 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr metadata", "who": "smithi165.hcexoi", "id": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:44:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:44:01.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:44:01.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:44:01.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:44:01.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:44:01.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:01 smithi165 ceph-mon[36229]: Manager daemon smithi165.hcexoi is now available 2024-09-06T14:44:01.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: pgmap v239: 65 pgs: 65 active+clean; 134 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 204 op/s 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr fail", "who": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: Activating manager daemon smithi165.hcexoi 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.14217 172.21.15.52:0/1514439258' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "mgr fail", "who": "smithi052.vsthpq"}]': finished 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: osdmap e47: 6 total, 6 up, 6 in 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:44:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: mgrmap e21: smithi165.hcexoi(active, starting, since 0.00780928s) 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr metadata", "who": "smithi165.hcexoi", "id": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:44:01.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:44:01.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:44:01.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:44:01.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:44:01.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:01 smithi052 ceph-mon[28627]: Manager daemon smithi165.hcexoi is now available 2024-09-06T14:44:03.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:03.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:03.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:03.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:44:03.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:03.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/trash_purge_schedule"}]: dispatch 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/trash_purge_schedule"}]: dispatch 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: mgrmap e22: smithi165.hcexoi(active, since 1.49622s) 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: Deploying cephadm binary to smithi165 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: Deploying cephadm binary to smithi052 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: pgmap v4: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:44:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:02 smithi165 ceph-mon[36229]: [06/Sep/2024:14:44:02] ENGINE Bus STARTING 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/trash_purge_schedule"}]: dispatch 2024-09-06T14:44:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi165.hcexoi/trash_purge_schedule"}]: dispatch 2024-09-06T14:44:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: mgrmap e22: smithi165.hcexoi(active, since 1.49622s) 2024-09-06T14:44:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: Deploying cephadm binary to smithi165 2024-09-06T14:44:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: Deploying cephadm binary to smithi052 2024-09-06T14:44:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: pgmap v4: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:44:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:02 smithi052 ceph-mon[28627]: [06/Sep/2024:14:44:02] ENGINE Bus STARTING 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:03 smithi165 ceph-mon[36229]: [06/Sep/2024:14:44:03] ENGINE Serving on https://172.21.15.165:7150 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:03 smithi165 ceph-mon[36229]: [06/Sep/2024:14:44:03] ENGINE Error in HTTPServer.serve 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Traceback (most recent call last): 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._connections.run(self.expiration_interval) 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._run(expiration_interval) 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T14:44:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s = self.context.wrap_socket( 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: return self.sslsocket_class._create( 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self.do_handshake() 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._sslobj.do_handshake() 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T14:44:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:03 smithi165 ceph-mon[36229]: Health check failed: Module 'volumes' has failed dependency: No module named 'ceph.fs' (MGR_MODULE_DEPENDENCY) 2024-09-06T14:44:04.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:03 smithi165 ceph-mon[36229]: [06/Sep/2024:14:44:03] ENGINE Serving on http://172.21.15.165:8765 2024-09-06T14:44:04.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:03 smithi165 ceph-mon[36229]: [06/Sep/2024:14:44:03] ENGINE Bus STARTED 2024-09-06T14:44:04.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:03 smithi052 ceph-mon[28627]: [06/Sep/2024:14:44:03] ENGINE Serving on https://172.21.15.165:7150 2024-09-06T14:44:04.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:03 smithi052 ceph-mon[28627]: [06/Sep/2024:14:44:03] ENGINE Error in HTTPServer.serve 2024-09-06T14:44:04.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Traceback (most recent call last): 2024-09-06T14:44:04.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._connections.run(self.expiration_interval) 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._run(expiration_interval) 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s = self.context.wrap_socket( 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: return self.sslsocket_class._create( 2024-09-06T14:44:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T14:44:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self.do_handshake() 2024-09-06T14:44:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T14:44:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._sslobj.do_handshake() 2024-09-06T14:44:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T14:44:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:03 smithi052 ceph-mon[28627]: Health check failed: Module 'volumes' has failed dependency: No module named 'ceph.fs' (MGR_MODULE_DEPENDENCY) 2024-09-06T14:44:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:03 smithi052 ceph-mon[28627]: [06/Sep/2024:14:44:03] ENGINE Serving on http://172.21.15.165:8765 2024-09-06T14:44:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:03 smithi052 ceph-mon[28627]: [06/Sep/2024:14:44:03] ENGINE Bus STARTED 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.008+0000 7f2da2a35640 1 -- 172.21.15.52:0/2871080899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c103b60 msgr2=0x7f2d9c103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.008+0000 7f2da2a35640 1 --2- 172.21.15.52:0/2871080899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c103b60 0x7f2d9c103f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2d900097e0 tx=0x7f2d9002a3f0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.008+0000 7f2da2a35640 1 -- 172.21.15.52:0/2871080899 shutdown_connections 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.008+0000 7f2da2a35640 1 --2- 172.21.15.52:0/2871080899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 0x7f2d9c1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.008+0000 7f2da2a35640 1 --2- 172.21.15.52:0/2871080899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c103b60 0x7f2d9c103f60 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2d900097e0 tx=0x7f2d9002a3f0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.008+0000 7f2da2a35640 1 -- 172.21.15.52:0/2871080899 >> 172.21.15.52:0/2871080899 conn(0x7f2d9c0ff2f0 msgr2=0x7f2d9c101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.009+0000 7f2da2a35640 1 -- 172.21.15.52:0/2871080899 shutdown_connections 2024-09-06T14:44:05.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.009+0000 7f2da2a35640 1 -- 172.21.15.52:0/2871080899 wait complete. 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.010+0000 7f2da2a35640 1 Processor -- start 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.010+0000 7f2da2a35640 1 -- start start 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.010+0000 7f2da2a35640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 0x7f2d9c06bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.011+0000 7f2da2a35640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c06c520 0x7f2d9c071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.011+0000 7f2da2a35640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c10c980 con 0x7f2d9c06c520 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.011+0000 7f2da2a35640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d9c10c800 con 0x7f2d9c104d60 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.011+0000 7f2d9bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 0x7f2d9c06bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.011+0000 7f2d9bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 0x7f2d9c06bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:46898/0 (socket says 172.21.15.52:46898) 2024-09-06T14:44:05.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.011+0000 7f2d9bfff640 1 -- 172.21.15.52:0/340217555 learned_addr learned my addr 172.21.15.52:0/340217555 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:05.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.011+0000 7f2d9b7fe640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c06c520 0x7f2d9c071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.012+0000 7f2d9b7fe640 1 -- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 msgr2=0x7f2d9c06bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.012+0000 7f2d9b7fe640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 0x7f2d9c06bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.012+0000 7f2d9b7fe640 1 -- 172.21.15.52:0/340217555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9c06ca50 con 0x7f2d9c06c520 2024-09-06T14:44:05.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.012+0000 7f2d9bfff640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 0x7f2d9c06bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:44:05.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.012+0000 7f2d9b7fe640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c06c520 0x7f2d9c071520 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00e710 tx=0x7f2d8c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:05.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.012+0000 7f2d997fa640 1 -- 172.21.15.52:0/340217555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d8c00c8b0 con 0x7f2d9c06c520 2024-09-06T14:44:05.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.013+0000 7f2d997fa640 1 -- 172.21.15.52:0/340217555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d8c010430 con 0x7f2d9c06c520 2024-09-06T14:44:05.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.013+0000 7f2da2a35640 1 -- 172.21.15.52:0/340217555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9c071a60 con 0x7f2d9c06c520 2024-09-06T14:44:05.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.013+0000 7f2da2a35640 1 -- 172.21.15.52:0/340217555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9c071f30 con 0x7f2d9c06c520 2024-09-06T14:44:05.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.013+0000 7f2d997fa640 1 -- 172.21.15.52:0/340217555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d8c018650 con 0x7f2d9c06c520 2024-09-06T14:44:05.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.015+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7c005290 con 0x7f2d9c06c520 2024-09-06T14:44:05.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.015+0000 7f2d997fa640 1 -- 172.21.15.52:0/340217555 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 23) ==== 50240+0+0 (secure 0 0 0) 0x7f2d8c00ca50 con 0x7f2d9c06c520 2024-09-06T14:44:05.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.015+0000 7f2d997fa640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f2d8403dcc0 0x7f2d84040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.016+0000 7f2d997fa640 1 -- 172.21.15.52:0/340217555 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f2d8c0535f0 con 0x7f2d9c06c520 2024-09-06T14:44:05.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.016+0000 7f2d9bfff640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f2d8403dcc0 0x7f2d84040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.018+0000 7f2d9bfff640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f2d8403dcc0 0x7f2d84040180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d900308f0 tx=0x7f2d900094d0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.024+0000 7f2d997fa640 1 -- 172.21.15.52:0/340217555 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f2d8c014230 con 0x7f2d9c06c520 2024-09-06T14:44:05.260 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:05 smithi052 ceph-mon[28627]: mgrmap e23: smithi165.hcexoi(active, since 3s) 2024-09-06T14:44:05.260 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:05 smithi052 ceph-mon[28627]: pgmap v5: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:44:05.277 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:05 smithi165 ceph-mon[36229]: mgrmap e23: smithi165.hcexoi(active, since 3s) 2024-09-06T14:44:05.277 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:05 smithi165 ceph-mon[36229]: pgmap v5: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:44:05.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.322+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2d7c000bc0 con 0x7f2d8403dcc0 2024-09-06T14:44:05.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.323+0000 7f2d997fa640 1 -- 172.21.15.52:0/340217555 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f2d7c000bc0 con 0x7f2d8403dcc0 2024-09-06T14:44:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.325+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f2d8403dcc0 msgr2=0x7f2d84040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.325+0000 7f2d82ffd640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f2d8403dcc0 0x7f2d84040180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d900308f0 tx=0x7f2d900094d0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.325+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c06c520 msgr2=0x7f2d9c071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.325+0000 7f2d82ffd640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c06c520 0x7f2d9c071520 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2d8c00e710 tx=0x7f2d8c00ebd0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.326+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 shutdown_connections 2024-09-06T14:44:05.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.326+0000 7f2d82ffd640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f2d8403dcc0 0x7f2d84040180 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.326+0000 7f2d82ffd640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2d9c06c520 0x7f2d9c071520 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.326+0000 7f2d82ffd640 1 --2- 172.21.15.52:0/340217555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d9c104d60 0x7f2d9c06bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.326+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 >> 172.21.15.52:0/340217555 conn(0x7f2d9c0ff2f0 msgr2=0x7f2d9c1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:05.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.326+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 shutdown_connections 2024-09-06T14:44:05.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.326+0000 7f2d82ffd640 1 -- 172.21.15.52:0/340217555 wait complete. 2024-09-06T14:44:05.333 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:44:05.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 -- 172.21.15.52:0/1235017743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c100860 msgr2=0x7f666c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 --2- 172.21.15.52:0/1235017743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c100860 0x7f666c100c60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6668009880 tx=0x7f666802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 -- 172.21.15.52:0/1235017743 shutdown_connections 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 --2- 172.21.15.52:0/1235017743 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666c101a60 0x7f666c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 --2- 172.21.15.52:0/1235017743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c100860 0x7f666c100c60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 -- 172.21.15.52:0/1235017743 >> 172.21.15.52:0/1235017743 conn(0x7f666c0fc010 msgr2=0x7f666c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 -- 172.21.15.52:0/1235017743 shutdown_connections 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 -- 172.21.15.52:0/1235017743 wait complete. 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 Processor -- start 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.416+0000 7f6673a3b640 1 -- start start 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6673a3b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666c100860 0x7f666c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6673a3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c101a60 0x7f666c199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6673a3b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f666c1096a0 con 0x7f666c101a60 2024-09-06T14:44:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6673a3b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f666c109520 con 0x7f666c100860 2024-09-06T14:44:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6670fd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c101a60 0x7f666c199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6670fd6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c101a60 0x7f666c199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42064/0 (socket says 172.21.15.52:42064) 2024-09-06T14:44:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6670fd6640 1 -- 172.21.15.52:0/225243332 learned_addr learned my addr 172.21.15.52:0/225243332 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f66717d7640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666c100860 0x7f666c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6670fd6640 1 -- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666c100860 msgr2=0x7f666c199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6670fd6640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666c100860 0x7f666c199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6670fd6640 1 -- 172.21.15.52:0/225243332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c19a2d0 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.417+0000 7f6670fd6640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c101a60 0x7f666c199c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f666000e970 tx=0x7f666000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.418+0000 7f665e7fc640 1 -- 172.21.15.52:0/225243332 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f666000cac0 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.418+0000 7f665e7fc640 1 -- 172.21.15.52:0/225243332 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66600054e0 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.418+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c19ed10 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.418+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c19f240 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.418+0000 7f665e7fc640 1 -- 172.21.15.52:0/225243332 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6660010430 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.419+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6650005290 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.419+0000 7f665e7fc640 1 -- 172.21.15.52:0/225243332 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 23) ==== 50240+0+0 (secure 0 0 0) 0x7f66600105d0 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.420+0000 7f665e7fc640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f665803dcc0 0x7f6658040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.420+0000 7f665e7fc640 1 -- 172.21.15.52:0/225243332 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f6660053680 con 0x7f666c101a60 2024-09-06T14:44:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.420+0000 7f66717d7640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f665803dcc0 0x7f6658040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.421+0000 7f66717d7640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f665803dcc0 0x7f6658040180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6668000c00 tx=0x7f6668005a20 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:05.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.429+0000 7f665e7fc640 1 -- 172.21.15.52:0/225243332 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f666001fda0 con 0x7f666c101a60 2024-09-06T14:44:05.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.730+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6650000bc0 con 0x7f665803dcc0 2024-09-06T14:44:05.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.731+0000 7f665e7fc640 1 -- 172.21.15.52:0/225243332 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f6650000bc0 con 0x7f665803dcc0 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.733+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f665803dcc0 msgr2=0x7f6658040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.733+0000 7f6673a3b640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f665803dcc0 0x7f6658040180 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6668000c00 tx=0x7f6668005a20 comp rx=0 tx=0).stop 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.733+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c101a60 msgr2=0x7f666c199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.733+0000 7f6673a3b640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c101a60 0x7f666c199c50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f666000e970 tx=0x7f666000ed70 comp rx=0 tx=0).stop 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.733+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 shutdown_connections 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.733+0000 7f6673a3b640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f665803dcc0 0x7f6658040180 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.733+0000 7f6673a3b640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f666c101a60 0x7f666c199c50 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f666000e970 tx=0x7f666000ed70 comp rx=0 tx=0).stop 2024-09-06T14:44:05.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.734+0000 7f6673a3b640 1 --2- 172.21.15.52:0/225243332 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f666c100860 0x7f666c199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.734+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 >> 172.21.15.52:0/225243332 conn(0x7f666c0fc010 msgr2=0x7f666c069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.734+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 shutdown_connections 2024-09-06T14:44:05.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.734+0000 7f6673a3b640 1 -- 172.21.15.52:0/225243332 wait complete. 2024-09-06T14:44:05.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.847+0000 7f3d9ee76640 1 -- 172.21.15.52:0/2928928517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98102470 msgr2=0x7f3d98104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.847+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/2928928517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98102470 0x7f3d98104860 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009880 tx=0x7f3d8c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.847+0000 7f3d9ee76640 1 -- 172.21.15.52:0/2928928517 shutdown_connections 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.847+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/2928928517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d98104da0 0x7f3d98107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.847+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/2928928517 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98102470 0x7f3d98104860 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.847+0000 7f3d9ee76640 1 -- 172.21.15.52:0/2928928517 >> 172.21.15.52:0/2928928517 conn(0x7f3d980fc010 msgr2=0x7f3d980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.848+0000 7f3d9ee76640 1 -- 172.21.15.52:0/2928928517 shutdown_connections 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.848+0000 7f3d9ee76640 1 -- 172.21.15.52:0/2928928517 wait complete. 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.848+0000 7f3d9ee76640 1 Processor -- start 2024-09-06T14:44:05.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.848+0000 7f3d9ee76640 1 -- start start 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d9ee76640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d98102470 0x7f3d98197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d9ee76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98104da0 0x7f3d98197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d9ee76640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9810a7d0 con 0x7f3d98104da0 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d9ee76640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9810a650 con 0x7f3d98102470 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98104da0 0x7f3d98197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98104da0 0x7f3d98197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42076/0 (socket says 172.21.15.52:42076) 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d97fff640 1 -- 172.21.15.52:0/564348431 learned_addr learned my addr 172.21.15.52:0/564348431 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d9cc12640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d98102470 0x7f3d98197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d97fff640 1 -- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d98102470 msgr2=0x7f3d98197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d97fff640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d98102470 0x7f3d98197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d97fff640 1 -- 172.21.15.52:0/564348431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d981980e0 con 0x7f3d98104da0 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.849+0000 7f3d97fff640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98104da0 0x7f3d98197a60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e970 tx=0x7f3d8400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.850+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d8400cac0 con 0x7f3d98104da0 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.850+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d840054e0 con 0x7f3d98104da0 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.850+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9819cb20 con 0x7f3d98104da0 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.850+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d84010430 con 0x7f3d98104da0 2024-09-06T14:44:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.850+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9819d0b0 con 0x7f3d98104da0 2024-09-06T14:44:05.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.851+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d98102850 con 0x7f3d98104da0 2024-09-06T14:44:05.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.852+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 23) ==== 50240+0+0 (secure 0 0 0) 0x7f3d84004ee0 con 0x7f3d98104da0 2024-09-06T14:44:05.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.852+0000 7f3d95ffb640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f3d8803dcc0 0x7f3d88040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:05.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.852+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f3d840535f0 con 0x7f3d98104da0 2024-09-06T14:44:05.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.852+0000 7f3d9cc12640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f3d8803dcc0 0x7f3d88040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:05.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.853+0000 7f3d9cc12640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f3d8803dcc0 0x7f3d88040180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c000c00 tx=0x7f3d8c0058d0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:05.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:05.861+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f3d8400a250 con 0x7f3d98104da0 2024-09-06T14:44:06.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.122+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mgrmap(e 24) ==== 50296+0+0 (secure 0 0 0) 0x7f3d840051d0 con 0x7f3d98104da0 2024-09-06T14:44:06.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.140+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3d98105720 con 0x7f3d8803dcc0 2024-09-06T14:44:06.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.155+0000 7f3d95ffb640 1 -- 172.21.15.52:0/564348431 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3d98105720 con 0x7f3d8803dcc0 2024-09-06T14:44:06.153 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:44:06.153 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (5m) 114s ago 7m 25.1M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:44:06.153 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (7m) 114s ago 7m 8186k - 19.1.1-268-g635ed4cf b6db46a449e5 9152c789e0ae 2024-09-06T14:44:06.153 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (6m) 9s ago 6m 5268k - 19.1.1-268-g635ed4cf b6db46a449e5 92f6280b935c 2024-09-06T14:44:06.153 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (7m) 114s ago 7m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:44:06.153 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (6m) 9s ago 6m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (5m) 114s ago 7m 80.9M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (2m) 114s ago 2m 12.4M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (2m) 114s ago 2m 15.1M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (2m) 9s ago 2m 21.8M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (2m) 9s ago 2m 19.1M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:9283,8765,8443 running (8m) 114s ago 8m 498M - 19.1.1-268-g635ed4cf b6db46a449e5 39e44f4c0904 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (13s) 9s ago 6m 71.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a 53aea8d00134 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (8m) 114s ago 8m 47.2M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (6m) 9s ago 6m 36.4M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (7m) 114s ago 7m 16.2M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:44:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 9s ago 6m 14.9M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:44:06.155 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (5m) 114s ago 5m 46.6M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:44:06.155 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (5m) 114s ago 5m 57.4M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:44:06.155 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (4m) 114s ago 4m 54.1M 3948M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:44:06.155 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (4m) 9s ago 4m 86.3M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:44:06.155 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (3m) 9s ago 3m 79.3M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:44:06.155 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (3m) 9s ago 3m 69.5M 4970M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:44:06.155 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (5m) 114s ago 7m 59.2M - 2.43.0 a07b618ecd1d 1b767954d6f6 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f3d8803dcc0 msgr2=0x7f3d88040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f3d8803dcc0 0x7f3d88040180 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c000c00 tx=0x7f3d8c0058d0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98104da0 msgr2=0x7f3d98197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98104da0 0x7f3d98197a60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400e970 tx=0x7f3d8400ee30 comp rx=0 tx=0).stop 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 shutdown_connections 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f3d8803dcc0 0x7f3d88040180 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d98104da0 0x7f3d98197a60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 --2- 172.21.15.52:0/564348431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d98102470 0x7f3d98197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 >> 172.21.15.52:0/564348431 conn(0x7f3d980fc010 msgr2=0x7f3d980fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:06.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 shutdown_connections 2024-09-06T14:44:06.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.158+0000 7f3d9ee76640 1 -- 172.21.15.52:0/564348431 wait complete. 2024-09-06T14:44:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.266+0000 7f7aee4af640 1 -- 172.21.15.52:0/1218052922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 msgr2=0x7f7ae8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.266+0000 7f7aee4af640 1 --2- 172.21.15.52:0/1218052922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 0x7f7ae8102fe0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009880 tx=0x7f7adc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.266+0000 7f7aee4af640 1 -- 172.21.15.52:0/1218052922 shutdown_connections 2024-09-06T14:44:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.267+0000 7f7aee4af640 1 --2- 172.21.15.52:0/1218052922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 0x7f7ae8102fe0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.267+0000 7f7aee4af640 1 --2- 172.21.15.52:0/1218052922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 0x7f7ae8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.267+0000 7f7aee4af640 1 -- 172.21.15.52:0/1218052922 >> 172.21.15.52:0/1218052922 conn(0x7f7ae80fd0d0 msgr2=0x7f7ae80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.267+0000 7f7aee4af640 1 -- 172.21.15.52:0/1218052922 shutdown_connections 2024-09-06T14:44:06.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.267+0000 7f7aee4af640 1 -- 172.21.15.52:0/1218052922 wait complete. 2024-09-06T14:44:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.267+0000 7f7aee4af640 1 Processor -- start 2024-09-06T14:44:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.267+0000 7f7aee4af640 1 -- start start 2024-09-06T14:44:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7aee4af640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 0x7f7ae8197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7aee4af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 0x7f7ae81979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7aee4af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae810a7a0 con 0x7f7ae8102b60 2024-09-06T14:44:06.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7aee4af640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae810a620 con 0x7f7ae8101960 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 0x7f7ae8197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7ae77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 0x7f7ae81979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7ae7fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 0x7f7ae8197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:46952/0 (socket says 172.21.15.52:46952) 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.268+0000 7f7ae7fff640 1 -- 172.21.15.52:0/2195498064 learned_addr learned my addr 172.21.15.52:0/2195498064 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7ae77fe640 1 -- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 msgr2=0x7f7ae8197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7ae77fe640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 0x7f7ae8197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7ae77fe640 1 -- 172.21.15.52:0/2195498064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae8198050 con 0x7f7ae8102b60 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7ae7fff640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 0x7f7ae8197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7ae77fe640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 0x7f7ae81979d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009230 tx=0x7f7adc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:06.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7ae57fa640 1 -- 172.21.15.52:0/2195498064 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7adc03f070 con 0x7f7ae8102b60 2024-09-06T14:44:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae819ca30 con 0x7f7ae8102b60 2024-09-06T14:44:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae819cfc0 con 0x7f7ae8102b60 2024-09-06T14:44:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.269+0000 7f7ae57fa640 1 -- 172.21.15.52:0/2195498064 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7adc0054e0 con 0x7f7ae8102b60 2024-09-06T14:44:06.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.270+0000 7f7ae57fa640 1 -- 172.21.15.52:0/2195498064 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7adc049060 con 0x7f7ae8102b60 2024-09-06T14:44:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.270+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad40052c0 con 0x7f7ae8102b60 2024-09-06T14:44:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.271+0000 7f7ae57fa640 1 -- 172.21.15.52:0/2195498064 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) ==== 50296+0+0 (secure 0 0 0) 0x7f7adc042070 con 0x7f7ae8102b60 2024-09-06T14:44:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.271+0000 7f7ae57fa640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7ad003dcc0 0x7f7ad0040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.271+0000 7f7ae57fa640 1 -- 172.21.15.52:0/2195498064 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f7adc073840 con 0x7f7ae8102b60 2024-09-06T14:44:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.272+0000 7f7ae7fff640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7ad003dcc0 0x7f7ad0040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:06.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.272+0000 7f7ae7fff640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7ad003dcc0 0x7f7ad0040180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80058c0 tx=0x7f7ad8005f90 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:06.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.279+0000 7f7ae57fa640 1 -- 172.21.15.52:0/2195498064 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f7adc0412c0 con 0x7f7ae8102b60 2024-09-06T14:44:06.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:06 smithi052 ceph-mon[28627]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:06.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:06 smithi052 ceph-mon[28627]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:06 smithi165 ceph-mon[36229]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:06 smithi165 ceph-mon[36229]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.614+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7ad4005dc0 con 0x7f7ae8102b60 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.615+0000 7f7ae57fa640 1 -- 172.21.15.52:0/2195498064 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f7adc003db0 con 0x7f7ae8102b60 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:44:06.613 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 12, 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:44:06.614 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:44:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7ad003dcc0 msgr2=0x7f7ad0040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7ad003dcc0 0x7f7ad0040180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80058c0 tx=0x7f7ad8005f90 comp rx=0 tx=0).stop 2024-09-06T14:44:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 msgr2=0x7f7ae81979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 0x7f7ae81979d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009230 tx=0x7f7adc0045e0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 shutdown_connections 2024-09-06T14:44:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7ad003dcc0 0x7f7ad0040180 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ae8102b60 0x7f7ae81979d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 --2- 172.21.15.52:0/2195498064 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ae8101960 0x7f7ae8197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.619+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 >> 172.21.15.52:0/2195498064 conn(0x7f7ae80fd0d0 msgr2=0x7f7ae8105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.620+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 shutdown_connections 2024-09-06T14:44:06.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.620+0000 7f7aee4af640 1 -- 172.21.15.52:0/2195498064 wait complete. 2024-09-06T14:44:06.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.711+0000 7f56c9432640 1 -- 172.21.15.52:0/73680665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4101a60 msgr2=0x7f56c4101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.711+0000 7f56c9432640 1 --2- 172.21.15.52:0/73680665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4101a60 0x7f56c4101ee0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f56b8009880 tx=0x7f56b802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.711+0000 7f56c9432640 1 -- 172.21.15.52:0/73680665 shutdown_connections 2024-09-06T14:44:06.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.711+0000 7f56c9432640 1 --2- 172.21.15.52:0/73680665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4101a60 0x7f56c4101ee0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.711+0000 7f56c9432640 1 --2- 172.21.15.52:0/73680665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c4100860 0x7f56c4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.711+0000 7f56c9432640 1 -- 172.21.15.52:0/73680665 >> 172.21.15.52:0/73680665 conn(0x7f56c40fc010 msgr2=0x7f56c40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:06.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.711+0000 7f56c9432640 1 -- 172.21.15.52:0/73680665 shutdown_connections 2024-09-06T14:44:06.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.712+0000 7f56c9432640 1 -- 172.21.15.52:0/73680665 wait complete. 2024-09-06T14:44:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.712+0000 7f56c9432640 1 Processor -- start 2024-09-06T14:44:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.712+0000 7f56c9432640 1 -- start start 2024-09-06T14:44:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c9432640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4100860 0x7f56c4197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c9432640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c4101a60 0x7f56c4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:06.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c9432640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56c41096a0 con 0x7f56c4100860 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c9432640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f56c4109520 con 0x7f56c4101a60 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4100860 0x7f56c4197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4100860 0x7f56c4197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42096/0 (socket says 172.21.15.52:42096) 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c2ffd640 1 -- 172.21.15.52:0/3900735281 learned_addr learned my addr 172.21.15.52:0/3900735281 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c27fc640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c4101a60 0x7f56c4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c2ffd640 1 -- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c4101a60 msgr2=0x7f56c4197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c2ffd640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c4101a60 0x7f56c4197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c2ffd640 1 -- 172.21.15.52:0/3900735281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c41980d0 con 0x7f56c4100860 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.713+0000 7f56c2ffd640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4100860 0x7f56c4197510 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f56b400e940 tx=0x7f56b400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.714+0000 7f56abfff640 1 -- 172.21.15.52:0/3900735281 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56b400cac0 con 0x7f56c4100860 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.714+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c4102ce0 con 0x7f56c4100860 2024-09-06T14:44:06.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.714+0000 7f56abfff640 1 -- 172.21.15.52:0/3900735281 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56b400cc60 con 0x7f56c4100860 2024-09-06T14:44:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.714+0000 7f56abfff640 1 -- 172.21.15.52:0/3900735281 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56b4003e30 con 0x7f56c4100860 2024-09-06T14:44:06.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.714+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c4103240 con 0x7f56c4100860 2024-09-06T14:44:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.715+0000 7f56abfff640 1 -- 172.21.15.52:0/3900735281 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 24) ==== 50296+0+0 (secure 0 0 0) 0x7f56b4010550 con 0x7f56c4100860 2024-09-06T14:44:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.715+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c4100c60 con 0x7f56c4100860 2024-09-06T14:44:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.715+0000 7f56abfff640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f56ac03dcc0 0x7f56ac040180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.715+0000 7f56abfff640 1 -- 172.21.15.52:0/3900735281 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f56b4053690 con 0x7f56c4100860 2024-09-06T14:44:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.716+0000 7f56c27fc640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f56ac03dcc0 0x7f56ac040180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:06.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.716+0000 7f56c27fc640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f56ac03dcc0 0x7f56ac040180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f56b8000c00 tx=0x7f56b80058d0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:06.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.720+0000 7f56abfff640 1 -- 172.21.15.52:0/3900735281 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f56b4020e10 con 0x7f56c4100860 2024-09-06T14:44:06.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.993+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f56c406a3e0 con 0x7f56ac03dcc0 2024-09-06T14:44:06.992 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:44:06.992 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [], 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "1/2 daemons upgraded", 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:44:06.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.995+0000 7f56abfff640 1 -- 172.21.15.52:0/3900735281 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f56c406a3e0 con 0x7f56ac03dcc0 2024-09-06T14:44:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f56ac03dcc0 msgr2=0x7f56ac040180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f56ac03dcc0 0x7f56ac040180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f56b8000c00 tx=0x7f56b80058d0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4100860 msgr2=0x7f56c4197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:06.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4100860 0x7f56c4197510 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f56b400e940 tx=0x7f56b400ee00 comp rx=0 tx=0).stop 2024-09-06T14:44:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 shutdown_connections 2024-09-06T14:44:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f56ac03dcc0 0x7f56ac040180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f56c4101a60 0x7f56c4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 --2- 172.21.15.52:0/3900735281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56c4100860 0x7f56c4197510 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 >> 172.21.15.52:0/3900735281 conn(0x7f56c40fc010 msgr2=0x7f56c4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.998+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 shutdown_connections 2024-09-06T14:44:06.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:06.999+0000 7f56c9432640 1 -- 172.21.15.52:0/3900735281 wait complete. 2024-09-06T14:44:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:07 smithi165 ceph-mon[36229]: mgrmap e24: smithi165.hcexoi(active, since 5s) 2024-09-06T14:44:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:07 smithi165 ceph-mon[36229]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:07 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2195498064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:44:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:07 smithi165 ceph-mon[36229]: pgmap v6: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:44:07.349 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:07 smithi052 ceph-mon[28627]: mgrmap e24: smithi165.hcexoi(active, since 5s) 2024-09-06T14:44:07.349 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:07 smithi052 ceph-mon[28627]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:07.350 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:07 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2195498064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:44:07.350 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:07 smithi052 ceph-mon[28627]: pgmap v6: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail 2024-09-06T14:44:09.064 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:09.064 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: Standby manager daemon smithi052.vsthpq started 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/crt"}]: dispatch 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/key"}]: dispatch 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:09.065 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:08 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:09.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:09.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:09.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:09.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: Standby manager daemon smithi052.vsthpq started 2024-09-06T14:44:09.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/crt"}]: dispatch 2024-09-06T14:44:09.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:44:09.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/key"}]: dispatch 2024-09-06T14:44:09.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/2154971556' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:44:09.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:09.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:08 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:10.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:09 smithi165 ceph-mon[36229]: pgmap v7: 65 pgs: 65 active+clean; 171 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 240 op/s 2024-09-06T14:44:10.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:09 smithi165 ceph-mon[36229]: mgrmap e25: smithi165.hcexoi(active, since 8s), standbys: smithi052.vsthpq 2024-09-06T14:44:10.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:09 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:44:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:09 smithi052 ceph-mon[28627]: pgmap v7: 65 pgs: 65 active+clean; 171 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 240 op/s 2024-09-06T14:44:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:09 smithi052 ceph-mon[28627]: mgrmap e25: smithi165.hcexoi(active, since 8s), standbys: smithi052.vsthpq 2024-09-06T14:44:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:09 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:44:12.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:11 smithi165 ceph-mon[36229]: pgmap v8: 65 pgs: 65 active+clean; 171 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 986 KiB/s rd, 2.3 MiB/s wr, 183 op/s 2024-09-06T14:44:12.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:11 smithi052 ceph-mon[28627]: pgmap v8: 65 pgs: 65 active+clean; 171 MiB data, 734 MiB used, 536 GiB / 536 GiB avail; 986 KiB/s rd, 2.3 MiB/s wr, 183 op/s 2024-09-06T14:44:12.628 INFO:tasks.workunit.client.1.smithi165.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-06T14:44:12.634 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-06T14:44:12.634 INFO:tasks.workunit.client.1.smithi165.stderr:+ make 2024-09-06T14:44:13.103 INFO:tasks.workunit.client.1.smithi165.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-06T14:44:14.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:13 smithi165 ceph-mon[36229]: pgmap v9: 65 pgs: 65 active+clean; 190 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-09-06T14:44:14.115 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:13 smithi052 ceph-mon[28627]: pgmap v9: 65 pgs: 65 active+clean; 190 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-09-06T14:44:15.137 INFO:tasks.workunit.client.1.smithi165.stderr:++ readlink -f fsstress 2024-09-06T14:44:15.138 INFO:tasks.workunit.client.1.smithi165.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-06T14:44:15.139 INFO:tasks.workunit.client.1.smithi165.stderr:+ popd 2024-09-06T14:44:15.139 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-06T14:44:15.139 INFO:tasks.workunit.client.1.smithi165.stderr:+ popd 2024-09-06T14:44:15.140 INFO:tasks.workunit.client.1.smithi165.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-06T14:44:15.140 INFO:tasks.workunit.client.1.smithi165.stderr:++ mktemp -d -p . 2024-09-06T14:44:15.142 INFO:tasks.workunit.client.1.smithi165.stderr:+ T=./tmp.3WERSMCe1f 2024-09-06T14:44:15.142 INFO:tasks.workunit.client.1.smithi165.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.3WERSMCe1f -l 1 -n 1000 -p 10 -v 2024-09-06T14:44:15.146 INFO:tasks.workunit.client.1.smithi165.stdout:seed = 1725520132 2024-09-06T14:44:15.153 INFO:tasks.workunit.client.1.smithi165.stdout:1/0: truncate - no filename 2024-09-06T14:44:15.153 INFO:tasks.workunit.client.1.smithi165.stdout:1/1: unlink - no file 2024-09-06T14:44:15.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/2: write - no filename 2024-09-06T14:44:15.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/3: dread - no filename 2024-09-06T14:44:15.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/4: chown . 48679 1 2024-09-06T14:44:15.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/5: dwrite - no filename 2024-09-06T14:44:15.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/6: dwrite - no filename 2024-09-06T14:44:15.155 INFO:tasks.workunit.client.1.smithi165.stdout:2/0: dread - no filename 2024-09-06T14:44:15.156 INFO:tasks.workunit.client.1.smithi165.stdout:0/0: creat f0 x:0 0 0 2024-09-06T14:44:15.157 INFO:tasks.workunit.client.1.smithi165.stdout:0/1: write f0 [397655,48770] 0 2024-09-06T14:44:15.157 INFO:tasks.workunit.client.1.smithi165.stdout:0/2: write f0 [786435,6242] 0 2024-09-06T14:44:15.159 INFO:tasks.workunit.client.1.smithi165.stdout:3/0: dwrite - no filename 2024-09-06T14:44:15.161 INFO:tasks.workunit.client.1.smithi165.stdout:1/7: mkdir d0 0 2024-09-06T14:44:15.161 INFO:tasks.workunit.client.1.smithi165.stdout:1/8: chown d0 12287848 1 2024-09-06T14:44:15.161 INFO:tasks.workunit.client.1.smithi165.stdout:2/1: mknod c0 0 2024-09-06T14:44:15.163 INFO:tasks.workunit.client.1.smithi165.stdout:0/3: rename f0 to f1 0 2024-09-06T14:44:15.165 INFO:tasks.workunit.client.1.smithi165.stdout:4/0: write - no filename 2024-09-06T14:44:15.165 INFO:tasks.workunit.client.1.smithi165.stdout:4/1: dread - no filename 2024-09-06T14:44:15.168 INFO:tasks.workunit.client.1.smithi165.stdout:0/4: creat f2 x:0 0 0 2024-09-06T14:44:15.168 INFO:tasks.workunit.client.1.smithi165.stdout:0/5: chown f1 4 1 2024-09-06T14:44:15.169 INFO:tasks.workunit.client.1.smithi165.stdout:5/0: readlink - no filename 2024-09-06T14:44:15.169 INFO:tasks.workunit.client.1.smithi165.stdout:5/1: link - no file 2024-09-06T14:44:15.170 INFO:tasks.workunit.client.1.smithi165.stdout:5/2: chown . 2 1 2024-09-06T14:44:15.170 INFO:tasks.workunit.client.1.smithi165.stdout:5/3: chown . 1925 1 2024-09-06T14:44:15.170 INFO:tasks.workunit.client.1.smithi165.stdout:5/4: dwrite - no filename 2024-09-06T14:44:15.170 INFO:tasks.workunit.client.1.smithi165.stdout:5/5: chown . 141 1 2024-09-06T14:44:15.170 INFO:tasks.workunit.client.1.smithi165.stdout:5/6: truncate - no filename 2024-09-06T14:44:15.170 INFO:tasks.workunit.client.1.smithi165.stdout:3/1: creat f0 x:0 0 0 2024-09-06T14:44:15.171 INFO:tasks.workunit.client.1.smithi165.stdout:3/2: chown f0 91667 1 2024-09-06T14:44:15.171 INFO:tasks.workunit.client.1.smithi165.stdout:3/3: dread - f0 zero size 2024-09-06T14:44:15.172 INFO:tasks.workunit.client.1.smithi165.stdout:1/9: creat d0/f1 x:0 0 0 2024-09-06T14:44:15.172 INFO:tasks.workunit.client.1.smithi165.stdout:1/10: chown d0 703 1 2024-09-06T14:44:15.173 INFO:tasks.workunit.client.1.smithi165.stdout:1/11: write d0/f1 [41818,66038] 0 2024-09-06T14:44:15.174 INFO:tasks.workunit.client.1.smithi165.stdout:1/12: write d0/f1 [667356,85085] 0 2024-09-06T14:44:15.177 INFO:tasks.workunit.client.1.smithi165.stdout:6/0: link - no file 2024-09-06T14:44:15.178 INFO:tasks.workunit.client.1.smithi165.stdout:6/1: write - no filename 2024-09-06T14:44:15.178 INFO:tasks.workunit.client.1.smithi165.stdout:6/2: read - no filename 2024-09-06T14:44:15.178 INFO:tasks.workunit.client.1.smithi165.stdout:3/4: unlink f0 0 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/5: unlink - no file 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/6: truncate - no filename 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/7: write - no filename 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/8: fsync - no filename 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/9: truncate - no filename 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/10: dread - no filename 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/11: readlink - no filename 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/12: link - no file 2024-09-06T14:44:15.179 INFO:tasks.workunit.client.1.smithi165.stdout:3/13: dread - no filename 2024-09-06T14:44:15.180 INFO:tasks.workunit.client.1.smithi165.stdout:3/14: dwrite - no filename 2024-09-06T14:44:15.180 INFO:tasks.workunit.client.1.smithi165.stdout:4/2: creat f0 x:0 0 0 2024-09-06T14:44:15.182 INFO:tasks.workunit.client.1.smithi165.stdout:0/6: dwrite f1 [0,4194304] 0 2024-09-06T14:44:15.182 INFO:tasks.workunit.client.1.smithi165.stdout:1/13: creat d0/f2 x:0 0 0 2024-09-06T14:44:15.183 INFO:tasks.workunit.client.1.smithi165.stdout:1/14: truncate d0/f2 85731 0 2024-09-06T14:44:15.185 INFO:tasks.workunit.client.1.smithi165.stdout:0/7: dread f1 [0,4194304] 0 2024-09-06T14:44:15.186 INFO:tasks.workunit.client.1.smithi165.stdout:0/8: chown f1 4690 1 2024-09-06T14:44:15.186 INFO:tasks.workunit.client.1.smithi165.stdout:5/7: symlink l0 0 2024-09-06T14:44:15.187 INFO:tasks.workunit.client.1.smithi165.stdout:0/9: write f1 [153573,49805] 0 2024-09-06T14:44:15.187 INFO:tasks.workunit.client.1.smithi165.stdout:0/10: truncate f2 237092 0 2024-09-06T14:44:15.189 INFO:tasks.workunit.client.1.smithi165.stdout:7/0: read - no filename 2024-09-06T14:44:15.189 INFO:tasks.workunit.client.1.smithi165.stdout:7/1: readlink - no filename 2024-09-06T14:44:15.190 INFO:tasks.workunit.client.1.smithi165.stdout:7/2: dwrite - no filename 2024-09-06T14:44:15.190 INFO:tasks.workunit.client.1.smithi165.stdout:7/3: chown . 15557 1 2024-09-06T14:44:15.190 INFO:tasks.workunit.client.1.smithi165.stdout:7/4: link - no file 2024-09-06T14:44:15.191 INFO:tasks.workunit.client.1.smithi165.stdout:3/15: mkdir d1 0 2024-09-06T14:44:15.191 INFO:tasks.workunit.client.1.smithi165.stdout:3/16: readlink - no filename 2024-09-06T14:44:15.191 INFO:tasks.workunit.client.1.smithi165.stdout:3/17: chown d1 970 1 2024-09-06T14:44:15.195 INFO:tasks.workunit.client.1.smithi165.stdout:4/3: symlink l1 0 2024-09-06T14:44:15.197 INFO:tasks.workunit.client.1.smithi165.stdout:1/15: mkdir d0/d3 0 2024-09-06T14:44:15.201 INFO:tasks.workunit.client.1.smithi165.stdout:0/11: creat f3 x:0 0 0 2024-09-06T14:44:15.203 INFO:tasks.workunit.client.1.smithi165.stdout:8/0: dread - no filename 2024-09-06T14:44:15.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/1: dread - no filename 2024-09-06T14:44:15.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/2: write - no filename 2024-09-06T14:44:15.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/3: dwrite - no filename 2024-09-06T14:44:15.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/4: write - no filename 2024-09-06T14:44:15.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/5: rmdir - no directory 2024-09-06T14:44:15.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/6: rename - no filename 2024-09-06T14:44:15.204 INFO:tasks.workunit.client.1.smithi165.stdout:6/3: creat f0 x:0 0 0 2024-09-06T14:44:15.205 INFO:tasks.workunit.client.1.smithi165.stdout:4/4: dwrite f0 [0,4194304] 0 2024-09-06T14:44:15.206 INFO:tasks.workunit.client.1.smithi165.stdout:6/4: write f0 [795311,62946] 0 2024-09-06T14:44:15.209 INFO:tasks.workunit.client.1.smithi165.stdout:6/5: fdatasync f0 0 2024-09-06T14:44:15.213 INFO:tasks.workunit.client.1.smithi165.stdout:1/16: dwrite d0/f2 [0,4194304] 0 2024-09-06T14:44:15.213 INFO:tasks.workunit.client.1.smithi165.stdout:0/12: mknod c4 0 2024-09-06T14:44:15.216 INFO:tasks.workunit.client.1.smithi165.stdout:7/5: creat f0 x:0 0 0 2024-09-06T14:44:15.216 INFO:tasks.workunit.client.1.smithi165.stdout:3/18: creat d1/f2 x:0 0 0 2024-09-06T14:44:15.217 INFO:tasks.workunit.client.1.smithi165.stdout:0/13: chown f3 25203560 1 2024-09-06T14:44:15.219 INFO:tasks.workunit.client.1.smithi165.stdout:5/8: link l0 l1 0 2024-09-06T14:44:15.222 INFO:tasks.workunit.client.1.smithi165.stdout:8/7: mkdir d0 0 2024-09-06T14:44:15.222 INFO:tasks.workunit.client.1.smithi165.stdout:8/8: fsync - no filename 2024-09-06T14:44:15.222 INFO:tasks.workunit.client.1.smithi165.stdout:8/9: dwrite - no filename 2024-09-06T14:44:15.223 INFO:tasks.workunit.client.1.smithi165.stdout:3/19: truncate d1/f2 926918 0 2024-09-06T14:44:15.224 INFO:tasks.workunit.client.1.smithi165.stdout:6/6: dread f0 [0,4194304] 0 2024-09-06T14:44:15.224 INFO:tasks.workunit.client.1.smithi165.stdout:8/10: rename d0 to d0/d1 22 2024-09-06T14:44:15.224 INFO:tasks.workunit.client.1.smithi165.stdout:8/11: dread - no filename 2024-09-06T14:44:15.224 INFO:tasks.workunit.client.1.smithi165.stdout:8/12: unlink - no file 2024-09-06T14:44:15.225 INFO:tasks.workunit.client.1.smithi165.stdout:4/5: dwrite f0 [0,4194304] 0 2024-09-06T14:44:15.225 INFO:tasks.workunit.client.1.smithi165.stdout:9/0: creat f0 x:0 0 0 2024-09-06T14:44:15.227 INFO:tasks.workunit.client.1.smithi165.stdout:6/7: chown f0 99909 1 2024-09-06T14:44:15.230 INFO:tasks.workunit.client.1.smithi165.stdout:3/20: creat d1/f3 x:0 0 0 2024-09-06T14:44:15.231 INFO:tasks.workunit.client.1.smithi165.stdout:5/9: chown l1 1 1 2024-09-06T14:44:15.231 INFO:tasks.workunit.client.1.smithi165.stdout:5/10: rmdir - no directory 2024-09-06T14:44:15.231 INFO:tasks.workunit.client.1.smithi165.stdout:5/11: dread - no filename 2024-09-06T14:44:15.232 INFO:tasks.workunit.client.1.smithi165.stdout:4/6: rename f0 to f2 0 2024-09-06T14:44:15.235 INFO:tasks.workunit.client.1.smithi165.stdout:6/8: truncate f0 1399643 0 2024-09-06T14:44:15.239 INFO:tasks.workunit.client.1.smithi165.stdout:8/13: mkdir d0/d2 0 2024-09-06T14:44:15.239 INFO:tasks.workunit.client.1.smithi165.stdout:8/14: dwrite - no filename 2024-09-06T14:44:15.244 INFO:tasks.workunit.client.1.smithi165.stdout:1/17: dwrite d0/f1 [0,4194304] 0 2024-09-06T14:44:15.246 INFO:tasks.workunit.client.1.smithi165.stdout:0/14: dwrite f3 [0,4194304] 0 2024-09-06T14:44:15.248 INFO:tasks.workunit.client.1.smithi165.stdout:1/18: stat d0/d3 0 2024-09-06T14:44:15.254 INFO:tasks.workunit.client.1.smithi165.stdout:1/19: write d0/f2 [2559819,41064] 0 2024-09-06T14:44:15.256 INFO:tasks.workunit.client.1.smithi165.stdout:9/1: dwrite f0 [0,4194304] 0 2024-09-06T14:44:15.257 INFO:tasks.workunit.client.1.smithi165.stdout:3/21: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:15.263 INFO:tasks.workunit.client.1.smithi165.stdout:9/2: dread f0 [0,4194304] 0 2024-09-06T14:44:15.394 INFO:tasks.workunit.client.1.smithi165.stdout:5/12: stat l0 0 2024-09-06T14:44:15.397 INFO:tasks.workunit.client.1.smithi165.stdout:8/15: symlink d0/l3 0 2024-09-06T14:44:15.399 INFO:tasks.workunit.client.1.smithi165.stdout:0/15: mkdir d5 0 2024-09-06T14:44:15.404 INFO:tasks.workunit.client.1.smithi165.stdout:1/20: creat d0/f4 x:0 0 0 2024-09-06T14:44:15.407 INFO:tasks.workunit.client.1.smithi165.stdout:3/22: unlink d1/f3 0 2024-09-06T14:44:15.411 INFO:tasks.workunit.client.1.smithi165.stdout:9/3: symlink l1 0 2024-09-06T14:44:15.430 INFO:tasks.workunit.client.1.smithi165.stdout:3/23: creat d1/f4 x:0 0 0 2024-09-06T14:44:15.430 INFO:tasks.workunit.client.1.smithi165.stdout:3/24: read - d1/f4 zero size 2024-09-06T14:44:15.432 INFO:tasks.workunit.client.1.smithi165.stdout:9/4: rename l1 to l2 0 2024-09-06T14:44:15.435 INFO:tasks.workunit.client.1.smithi165.stdout:3/25: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:15.436 INFO:tasks.workunit.client.1.smithi165.stdout:3/26: rename d1 to d1/d5 22 2024-09-06T14:44:15.436 INFO:tasks.workunit.client.1.smithi165.stdout:3/27: rename d1 to d1/d6 22 2024-09-06T14:44:15.437 INFO:tasks.workunit.client.1.smithi165.stdout:5/13: stat l1 0 2024-09-06T14:44:15.437 INFO:tasks.workunit.client.1.smithi165.stdout:5/14: write - no filename 2024-09-06T14:44:15.439 INFO:tasks.workunit.client.1.smithi165.stdout:8/16: creat d0/d2/f4 x:0 0 0 2024-09-06T14:44:15.443 INFO:tasks.workunit.client.1.smithi165.stdout:1/21: link d0/f1 d0/d3/f5 0 2024-09-06T14:44:15.444 INFO:tasks.workunit.client.1.smithi165.stdout:3/28: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:15.454 INFO:tasks.workunit.client.1.smithi165.stdout:5/15: symlink l2 0 2024-09-06T14:44:15.455 INFO:tasks.workunit.client.1.smithi165.stdout:9/5: dwrite f0 [0,4194304] 0 2024-09-06T14:44:15.457 INFO:tasks.workunit.client.1.smithi165.stdout:8/17: symlink d0/d2/l5 0 2024-09-06T14:44:15.458 INFO:tasks.workunit.client.1.smithi165.stdout:8/18: stat d0/d2/l5 0 2024-09-06T14:44:15.459 INFO:tasks.workunit.client.1.smithi165.stdout:3/29: symlink d1/l7 0 2024-09-06T14:44:15.460 INFO:tasks.workunit.client.1.smithi165.stdout:3/30: stat d1/l7 0 2024-09-06T14:44:15.464 INFO:tasks.workunit.client.1.smithi165.stdout:3/31: dread d1/f2 [0,4194304] 0 2024-09-06T14:44:15.465 INFO:tasks.workunit.client.1.smithi165.stdout:1/22: link d0/f1 d0/d3/f6 0 2024-09-06T14:44:15.467 INFO:tasks.workunit.client.1.smithi165.stdout:8/19: creat d0/f6 x:0 0 0 2024-09-06T14:44:15.467 INFO:tasks.workunit.client.1.smithi165.stdout:8/20: write d0/f6 [675997,74574] 0 2024-09-06T14:44:15.468 INFO:tasks.workunit.client.1.smithi165.stdout:8/21: truncate d0/d2/f4 252542 0 2024-09-06T14:44:15.469 INFO:tasks.workunit.client.1.smithi165.stdout:8/22: fdatasync d0/d2/f4 0 2024-09-06T14:44:15.473 INFO:tasks.workunit.client.1.smithi165.stdout:5/16: chown l1 0 1 2024-09-06T14:44:15.477 INFO:tasks.workunit.client.1.smithi165.stdout:3/32: rename d1/f4 to d1/f8 0 2024-09-06T14:44:15.482 INFO:tasks.workunit.client.1.smithi165.stdout:8/23: creat d0/d2/f7 x:0 0 0 2024-09-06T14:44:15.482 INFO:tasks.workunit.client.1.smithi165.stdout:3/33: dread d1/f2 [0,4194304] 0 2024-09-06T14:44:15.483 INFO:tasks.workunit.client.1.smithi165.stdout:8/24: rename d0/d2 to d0/d2/d8 22 2024-09-06T14:44:15.483 INFO:tasks.workunit.client.1.smithi165.stdout:3/34: chown d1/l7 1402742133 1 2024-09-06T14:44:15.484 INFO:tasks.workunit.client.1.smithi165.stdout:1/23: dwrite d0/d3/f6 [0,4194304] 0 2024-09-06T14:44:15.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/17: stat l0 0 2024-09-06T14:44:15.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/18: rmdir - no directory 2024-09-06T14:44:15.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/19: dread - no filename 2024-09-06T14:44:15.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/20: fdatasync - no filename 2024-09-06T14:44:15.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/21: fsync - no filename 2024-09-06T14:44:15.486 INFO:tasks.workunit.client.1.smithi165.stdout:3/35: symlink d1/l9 0 2024-09-06T14:44:15.487 INFO:tasks.workunit.client.1.smithi165.stdout:8/25: unlink d0/d2/l5 0 2024-09-06T14:44:15.488 INFO:tasks.workunit.client.1.smithi165.stdout:3/36: read - d1/f8 zero size 2024-09-06T14:44:15.488 INFO:tasks.workunit.client.1.smithi165.stdout:8/26: dread - d0/d2/f7 zero size 2024-09-06T14:44:15.489 INFO:tasks.workunit.client.1.smithi165.stdout:3/37: dread - d1/f8 zero size 2024-09-06T14:44:15.490 INFO:tasks.workunit.client.1.smithi165.stdout:8/27: dread - d0/d2/f7 zero size 2024-09-06T14:44:15.491 INFO:tasks.workunit.client.1.smithi165.stdout:1/24: creat d0/f7 x:0 0 0 2024-09-06T14:44:15.492 INFO:tasks.workunit.client.1.smithi165.stdout:3/38: mkdir d1/da 0 2024-09-06T14:44:15.495 INFO:tasks.workunit.client.1.smithi165.stdout:3/39: symlink d1/lb 0 2024-09-06T14:44:15.497 INFO:tasks.workunit.client.1.smithi165.stdout:8/28: link d0/d2/f7 d0/f9 0 2024-09-06T14:44:15.498 INFO:tasks.workunit.client.1.smithi165.stdout:1/25: mknod d0/d3/c8 0 2024-09-06T14:44:15.500 INFO:tasks.workunit.client.1.smithi165.stdout:3/40: mkdir d1/da/dc 0 2024-09-06T14:44:15.502 INFO:tasks.workunit.client.1.smithi165.stdout:3/41: mkdir d1/da/dd 0 2024-09-06T14:44:15.504 INFO:tasks.workunit.client.1.smithi165.stdout:8/29: dwrite d0/d2/f4 [0,4194304] 0 2024-09-06T14:44:15.507 INFO:tasks.workunit.client.1.smithi165.stdout:8/30: creat d0/d2/fa x:0 0 0 2024-09-06T14:44:15.508 INFO:tasks.workunit.client.1.smithi165.stdout:8/31: write d0/f6 [1387067,83066] 0 2024-09-06T14:44:15.509 INFO:tasks.workunit.client.1.smithi165.stdout:8/32: dread - d0/d2/f7 zero size 2024-09-06T14:44:15.511 INFO:tasks.workunit.client.1.smithi165.stdout:3/42: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:15.514 INFO:tasks.workunit.client.1.smithi165.stdout:8/33: creat d0/d2/fb x:0 0 0 2024-09-06T14:44:15.519 INFO:tasks.workunit.client.1.smithi165.stdout:8/34: rename d0/d2/f4 to d0/fc 0 2024-09-06T14:44:15.833 INFO:tasks.workunit.client.1.smithi165.stdout:2/2: getdents . 0 2024-09-06T14:44:15.833 INFO:tasks.workunit.client.1.smithi165.stdout:2/3: truncate - no filename 2024-09-06T14:44:15.834 INFO:tasks.workunit.client.1.smithi165.stdout:2/4: fdatasync - no filename 2024-09-06T14:44:15.834 INFO:tasks.workunit.client.1.smithi165.stdout:2/5: write - no filename 2024-09-06T14:44:15.834 INFO:tasks.workunit.client.1.smithi165.stdout:2/6: write - no filename 2024-09-06T14:44:15.840 INFO:tasks.workunit.client.1.smithi165.stdout:2/7: link c0 c1 0 2024-09-06T14:44:15.840 INFO:tasks.workunit.client.1.smithi165.stdout:2/8: write - no filename 2024-09-06T14:44:15.840 INFO:tasks.workunit.client.1.smithi165.stdout:2/9: rmdir - no directory 2024-09-06T14:44:15.842 INFO:tasks.workunit.client.1.smithi165.stdout:2/10: symlink l2 0 2024-09-06T14:44:15.842 INFO:tasks.workunit.client.1.smithi165.stdout:2/11: dwrite - no filename 2024-09-06T14:44:15.842 INFO:tasks.workunit.client.1.smithi165.stdout:2/12: truncate - no filename 2024-09-06T14:44:15.843 INFO:tasks.workunit.client.1.smithi165.stdout:2/13: symlink l3 0 2024-09-06T14:44:15.843 INFO:tasks.workunit.client.1.smithi165.stdout:2/14: rmdir - no directory 2024-09-06T14:44:15.847 INFO:tasks.workunit.client.1.smithi165.stdout:2/15: rename l3 to l4 0 2024-09-06T14:44:15.849 INFO:tasks.workunit.client.1.smithi165.stdout:2/16: creat f5 x:0 0 0 2024-09-06T14:44:15.851 INFO:tasks.workunit.client.1.smithi165.stdout:2/17: unlink l2 0 2024-09-06T14:44:15.851 INFO:tasks.workunit.client.1.smithi165.stdout:2/18: truncate f5 792217 0 2024-09-06T14:44:15.852 INFO:tasks.workunit.client.1.smithi165.stdout:2/19: dread f5 [0,4194304] 0 2024-09-06T14:44:15.857 INFO:tasks.workunit.client.1.smithi165.stdout:2/20: write f5 [863478,113665] 0 2024-09-06T14:44:15.862 INFO:tasks.workunit.client.1.smithi165.stdout:2/21: dread f5 [0,4194304] 0 2024-09-06T14:44:15.865 INFO:tasks.workunit.client.1.smithi165.stdout:6/9: getdents . 0 2024-09-06T14:44:15.870 INFO:tasks.workunit.client.1.smithi165.stdout:6/10: rename f0 to f1 0 2024-09-06T14:44:15.870 INFO:tasks.workunit.client.1.smithi165.stdout:6/11: readlink - no filename 2024-09-06T14:44:15.872 INFO:tasks.workunit.client.1.smithi165.stdout:2/22: rename c1 to c6 0 2024-09-06T14:44:15.874 INFO:tasks.workunit.client.1.smithi165.stdout:6/12: fdatasync f1 0 2024-09-06T14:44:15.882 INFO:tasks.workunit.client.1.smithi165.stdout:2/23: dwrite f5 [0,4194304] 0 2024-09-06T14:44:15.886 INFO:tasks.workunit.client.1.smithi165.stdout:2/24: symlink l7 0 2024-09-06T14:44:15.888 INFO:tasks.workunit.client.1.smithi165.stdout:2/25: write f5 [670745,1742] 0 2024-09-06T14:44:15.893 INFO:tasks.workunit.client.1.smithi165.stdout:0/16: dwrite f3 [4194304,4194304] 0 2024-09-06T14:44:15.900 INFO:tasks.workunit.client.1.smithi165.stdout:0/17: rmdir d5 0 2024-09-06T14:44:15.991 INFO:tasks.workunit.client.1.smithi165.stdout:4/7: truncate f2 3861575 0 2024-09-06T14:44:15.996 INFO:tasks.workunit.client.1.smithi165.stdout:4/8: unlink l1 0 2024-09-06T14:44:16.005 INFO:tasks.workunit.client.1.smithi165.stdout:9/6: rename l2 to l3 0 2024-09-06T14:44:16.009 INFO:tasks.workunit.client.1.smithi165.stdout:9/7: creat f4 x:0 0 0 2024-09-06T14:44:16.011 INFO:tasks.workunit.client.1.smithi165.stdout:5/22: getdents . 0 2024-09-06T14:44:16.011 INFO:tasks.workunit.client.1.smithi165.stdout:5/23: dread - no filename 2024-09-06T14:44:16.015 INFO:tasks.workunit.client.1.smithi165.stdout:5/24: mknod c3 0 2024-09-06T14:44:16.019 INFO:tasks.workunit.client.1.smithi165.stdout:1/26: write d0/d3/f5 [4508153,90562] 0 2024-09-06T14:44:16.020 INFO:tasks.workunit.client.1.smithi165.stdout:1/27: truncate d0/f2 4497429 0 2024-09-06T14:44:16.020 INFO:tasks.workunit.client.1.smithi165.stdout:5/25: creat f4 x:0 0 0 2024-09-06T14:44:16.024 INFO:tasks.workunit.client.1.smithi165.stdout:1/28: dread d0/f2 [0,4194304] 0 2024-09-06T14:44:16.027 INFO:tasks.workunit.client.1.smithi165.stdout:5/26: dwrite f4 [0,4194304] 0 2024-09-06T14:44:16.028 INFO:tasks.workunit.client.1.smithi165.stdout:5/27: readlink l2 0 2024-09-06T14:44:16.032 INFO:tasks.workunit.client.1.smithi165.stdout:1/29: symlink d0/l9 0 2024-09-06T14:44:16.036 INFO:tasks.workunit.client.1.smithi165.stdout:1/30: link d0/f7 d0/fa 0 2024-09-06T14:44:16.037 INFO:tasks.workunit.client.1.smithi165.stdout:5/28: dwrite f4 [0,4194304] 0 2024-09-06T14:44:16.041 INFO:tasks.workunit.client.1.smithi165.stdout:8/35: dwrite d0/fc [4194304,4194304] 0 2024-09-06T14:44:16.043 INFO:tasks.workunit.client.1.smithi165.stdout:5/29: mknod c5 0 2024-09-06T14:44:16.047 INFO:tasks.workunit.client.1.smithi165.stdout:1/31: dwrite d0/d3/f5 [0,4194304] 0 2024-09-06T14:44:16.048 INFO:tasks.workunit.client.1.smithi165.stdout:1/32: readlink d0/l9 0 2024-09-06T14:44:16.049 INFO:tasks.workunit.client.1.smithi165.stdout:1/33: read - d0/f4 zero size 2024-09-06T14:44:16.050 INFO:tasks.workunit.client.1.smithi165.stdout:1/34: chown d0/f1 5424 1 2024-09-06T14:44:16.050 INFO:tasks.workunit.client.1.smithi165.stdout:8/36: creat d0/fd x:0 0 0 2024-09-06T14:44:16.051 INFO:tasks.workunit.client.1.smithi165.stdout:5/30: dread f4 [0,4194304] 0 2024-09-06T14:44:16.054 INFO:tasks.workunit.client.1.smithi165.stdout:8/37: truncate d0/f6 1802718 0 2024-09-06T14:44:16.056 INFO:tasks.workunit.client.1.smithi165.stdout:1/35: write d0/fa [175642,108377] 0 2024-09-06T14:44:16.059 INFO:tasks.workunit.client.1.smithi165.stdout:5/31: mkdir d6 0 2024-09-06T14:44:16.063 INFO:tasks.workunit.client.1.smithi165.stdout:1/36: dwrite d0/d3/f5 [4194304,4194304] 0 2024-09-06T14:44:16.064 INFO:tasks.workunit.client.1.smithi165.stdout:5/32: unlink f4 0 2024-09-06T14:44:16.067 INFO:tasks.workunit.client.1.smithi165.stdout:1/37: creat d0/d3/fb x:0 0 0 2024-09-06T14:44:16.072 INFO:tasks.workunit.client.1.smithi165.stdout:8/38: link d0/f9 d0/d2/fe 0 2024-09-06T14:44:16.076 INFO:tasks.workunit.client.1.smithi165.stdout:5/33: symlink d6/l7 0 2024-09-06T14:44:16.076 INFO:tasks.workunit.client.1.smithi165.stdout:5/34: dwrite - no filename 2024-09-06T14:44:16.082 INFO:tasks.workunit.client.1.smithi165.stdout:5/35: creat d6/f8 x:0 0 0 2024-09-06T14:44:16.083 INFO:tasks.workunit.client.1.smithi165.stdout:8/39: stat d0/f9 0 2024-09-06T14:44:16.084 INFO:tasks.workunit.client.1.smithi165.stdout:8/40: write d0/d2/fb [91202,95456] 0 2024-09-06T14:44:16.089 INFO:tasks.workunit.client.1.smithi165.stdout:8/41: fsync d0/fc 0 2024-09-06T14:44:16.090 INFO:tasks.workunit.client.1.smithi165.stdout:8/42: write d0/fd [776271,59845] 0 2024-09-06T14:44:16.095 INFO:tasks.workunit.client.1.smithi165.stdout:8/43: creat d0/ff x:0 0 0 2024-09-06T14:44:16.096 INFO:tasks.workunit.client.1.smithi165.stdout:5/36: link l2 d6/l9 0 2024-09-06T14:44:16.102 INFO:tasks.workunit.client.1.smithi165.stdout:5/37: dwrite d6/f8 [0,4194304] 0 2024-09-06T14:44:16.104 INFO:tasks.workunit.client.1.smithi165.stdout:2/26: chown l4 5339 1 2024-09-06T14:44:16.107 INFO:tasks.workunit.client.1.smithi165.stdout:5/38: symlink d6/la 0 2024-09-06T14:44:16.109 INFO:tasks.workunit.client.1.smithi165.stdout:2/27: dread f5 [0,4194304] 0 2024-09-06T14:44:16.109 INFO:tasks.workunit.client.1.smithi165.stdout:2/28: readlink l4 0 2024-09-06T14:44:16.149 INFO:tasks.workunit.client.1.smithi165.stdout:0/18: getdents . 0 2024-09-06T14:44:16.150 INFO:tasks.workunit.client.1.smithi165.stdout:0/19: mknod c6 0 2024-09-06T14:44:16.150 INFO:tasks.workunit.client.1.smithi165.stdout:0/20: readlink - no filename 2024-09-06T14:44:16.150 INFO:tasks.workunit.client.1.smithi165.stdout:0/21: mknod c7 0 2024-09-06T14:44:16.196 INFO:tasks.workunit.client.1.smithi165.stdout:9/8: truncate f0 368222 0 2024-09-06T14:44:16.198 INFO:tasks.workunit.client.1.smithi165.stdout:9/9: symlink l5 0 2024-09-06T14:44:16.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/10: creat f6 x:0 0 0 2024-09-06T14:44:16.218 INFO:tasks.workunit.client.1.smithi165.stdout:1/38: getdents d0/d3 0 2024-09-06T14:44:16.220 INFO:tasks.workunit.client.1.smithi165.stdout:1/39: symlink d0/d3/lc 0 2024-09-06T14:44:16.220 INFO:tasks.workunit.client.1.smithi165.stdout:1/40: readlink d0/d3/lc 0 2024-09-06T14:44:16.223 INFO:tasks.workunit.client.1.smithi165.stdout:1/41: rename d0/f1 to d0/d3/fd 0 2024-09-06T14:44:16.233 INFO:tasks.workunit.client.1.smithi165.stdout:5/39: getdents d6 0 2024-09-06T14:44:16.234 INFO:tasks.workunit.client.1.smithi165.stdout:2/29: truncate f5 1640195 0 2024-09-06T14:44:16.235 INFO:tasks.workunit.client.1.smithi165.stdout:5/40: symlink d6/lb 0 2024-09-06T14:44:16.237 INFO:tasks.workunit.client.1.smithi165.stdout:8/44: dwrite d0/d2/fe [0,4194304] 0 2024-09-06T14:44:16.273 INFO:tasks.workunit.client.1.smithi165.stdout:0/22: truncate f3 1731166 0 2024-09-06T14:44:16.289 INFO:tasks.workunit.client.1.smithi165.stdout:9/11: getdents . 0 2024-09-06T14:44:16.289 INFO:tasks.workunit.client.1.smithi165.stdout:9/12: fsync f6 0 2024-09-06T14:44:16.290 INFO:tasks.workunit.client.1.smithi165.stdout:1/42: truncate d0/f2 4978725 0 2024-09-06T14:44:16.298 INFO:tasks.workunit.client.1.smithi165.stdout:2/30: write f5 [2474969,129757] 0 2024-09-06T14:44:16.299 INFO:tasks.workunit.client.1.smithi165.stdout:2/31: write f5 [1300066,83594] 0 2024-09-06T14:44:16.305 INFO:tasks.workunit.client.1.smithi165.stdout:4/9: truncate f2 542182 0 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: pgmap v10: 65 pgs: 65 active+clean; 190 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: pgmap v10: 65 pgs: 65 active+clean; 190 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-09-06T14:44:16.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:16.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:16.406 INFO:tasks.workunit.client.1.smithi165.stdout:0/23: creat f8 x:0 0 0 2024-09-06T14:44:16.406 INFO:tasks.workunit.client.1.smithi165.stdout:9/13: mknod c7 0 2024-09-06T14:44:16.406 INFO:tasks.workunit.client.1.smithi165.stdout:9/14: readlink l5 0 2024-09-06T14:44:16.407 INFO:tasks.workunit.client.1.smithi165.stdout:9/15: fsync f6 0 2024-09-06T14:44:16.409 INFO:tasks.workunit.client.1.smithi165.stdout:2/32: creat f8 x:0 0 0 2024-09-06T14:44:16.412 INFO:tasks.workunit.client.1.smithi165.stdout:1/43: dwrite d0/d3/f6 [8388608,4194304] 0 2024-09-06T14:44:16.414 INFO:tasks.workunit.client.1.smithi165.stdout:8/45: link d0/l3 d0/d2/l10 0 2024-09-06T14:44:16.414 INFO:tasks.workunit.client.1.smithi165.stdout:8/46: chown d0/d2/fb 10225 1 2024-09-06T14:44:16.417 INFO:tasks.workunit.client.1.smithi165.stdout:8/47: dread d0/d2/fb [0,4194304] 0 2024-09-06T14:44:16.417 INFO:tasks.workunit.client.1.smithi165.stdout:5/41: getdents d6 0 2024-09-06T14:44:16.418 INFO:tasks.workunit.client.1.smithi165.stdout:0/24: creat f9 x:0 0 0 2024-09-06T14:44:16.419 INFO:tasks.workunit.client.1.smithi165.stdout:9/16: symlink l8 0 2024-09-06T14:44:16.419 INFO:tasks.workunit.client.1.smithi165.stdout:8/48: truncate d0/d2/fa 284115 0 2024-09-06T14:44:16.420 INFO:tasks.workunit.client.1.smithi165.stdout:8/49: write d0/f6 [393488,120980] 0 2024-09-06T14:44:16.421 INFO:tasks.workunit.client.1.smithi165.stdout:2/33: mkdir d9 0 2024-09-06T14:44:16.422 INFO:tasks.workunit.client.1.smithi165.stdout:2/34: read f5 [246192,86631] 0 2024-09-06T14:44:16.424 INFO:tasks.workunit.client.1.smithi165.stdout:1/44: rename d0/f4 to d0/d3/fe 0 2024-09-06T14:44:16.427 INFO:tasks.workunit.client.1.smithi165.stdout:0/25: mknod ca 0 2024-09-06T14:44:16.428 INFO:tasks.workunit.client.1.smithi165.stdout:2/35: dwrite f5 [0,4194304] 0 2024-09-06T14:44:16.439 INFO:tasks.workunit.client.1.smithi165.stdout:1/45: unlink d0/d3/lc 0 2024-09-06T14:44:16.440 INFO:tasks.workunit.client.1.smithi165.stdout:1/46: chown d0/d3/fb 873 1 2024-09-06T14:44:16.442 INFO:tasks.workunit.client.1.smithi165.stdout:0/26: write f1 [1639355,6756] 0 2024-09-06T14:44:16.448 INFO:tasks.workunit.client.1.smithi165.stdout:5/42: rename l2 to d6/lc 0 2024-09-06T14:44:16.448 INFO:tasks.workunit.client.1.smithi165.stdout:1/47: rename d0/d3 to d0/d3/df 22 2024-09-06T14:44:16.448 INFO:tasks.workunit.client.1.smithi165.stdout:2/36: creat d9/fa x:0 0 0 2024-09-06T14:44:16.448 INFO:tasks.workunit.client.1.smithi165.stdout:5/43: write d6/f8 [1591924,37808] 0 2024-09-06T14:44:16.449 INFO:tasks.workunit.client.1.smithi165.stdout:5/44: readlink d6/lb 0 2024-09-06T14:44:16.452 INFO:tasks.workunit.client.1.smithi165.stdout:5/45: dread d6/f8 [0,4194304] 0 2024-09-06T14:44:16.454 INFO:tasks.workunit.client.1.smithi165.stdout:1/48: creat d0/f10 x:0 0 0 2024-09-06T14:44:16.454 INFO:tasks.workunit.client.1.smithi165.stdout:2/37: mknod d9/cb 0 2024-09-06T14:44:16.457 INFO:tasks.workunit.client.1.smithi165.stdout:8/50: getdents d0 0 2024-09-06T14:44:16.459 INFO:tasks.workunit.client.1.smithi165.stdout:1/49: symlink d0/d3/l11 0 2024-09-06T14:44:16.461 INFO:tasks.workunit.client.1.smithi165.stdout:2/38: dwrite f8 [0,4194304] 0 2024-09-06T14:44:16.461 INFO:tasks.workunit.client.1.smithi165.stdout:1/50: fdatasync d0/f7 0 2024-09-06T14:44:16.461 INFO:tasks.workunit.client.1.smithi165.stdout:2/39: chown d9 305098782 1 2024-09-06T14:44:16.466 INFO:tasks.workunit.client.1.smithi165.stdout:8/51: rmdir d0/d2 39 2024-09-06T14:44:16.466 INFO:tasks.workunit.client.1.smithi165.stdout:2/40: dread f8 [0,4194304] 0 2024-09-06T14:44:16.468 INFO:tasks.workunit.client.1.smithi165.stdout:1/51: creat d0/d3/f12 x:0 0 0 2024-09-06T14:44:16.471 INFO:tasks.workunit.client.1.smithi165.stdout:5/46: link c3 d6/cd 0 2024-09-06T14:44:16.473 INFO:tasks.workunit.client.1.smithi165.stdout:2/41: creat d9/fc x:0 0 0 2024-09-06T14:44:16.475 INFO:tasks.workunit.client.1.smithi165.stdout:1/52: symlink d0/d3/l13 0 2024-09-06T14:44:16.477 INFO:tasks.workunit.client.1.smithi165.stdout:1/53: dread d0/f7 [0,4194304] 0 2024-09-06T14:44:16.477 INFO:tasks.workunit.client.1.smithi165.stdout:5/47: write d6/f8 [813559,123513] 0 2024-09-06T14:44:16.478 INFO:tasks.workunit.client.1.smithi165.stdout:2/42: mknod d9/cd 0 2024-09-06T14:44:16.479 INFO:tasks.workunit.client.1.smithi165.stdout:2/43: chown f5 18439981 1 2024-09-06T14:44:16.481 INFO:tasks.workunit.client.1.smithi165.stdout:0/27: dread f3 [0,4194304] 0 2024-09-06T14:44:16.482 INFO:tasks.workunit.client.1.smithi165.stdout:5/48: mknod d6/ce 0 2024-09-06T14:44:16.482 INFO:tasks.workunit.client.1.smithi165.stdout:0/28: write f2 [85885,45062] 0 2024-09-06T14:44:16.484 INFO:tasks.workunit.client.1.smithi165.stdout:1/54: rmdir d0/d3 39 2024-09-06T14:44:16.488 INFO:tasks.workunit.client.1.smithi165.stdout:5/49: symlink d6/lf 0 2024-09-06T14:44:16.490 INFO:tasks.workunit.client.1.smithi165.stdout:0/29: unlink c6 0 2024-09-06T14:44:16.491 INFO:tasks.workunit.client.1.smithi165.stdout:1/55: chown d0/d3 1782961 1 2024-09-06T14:44:16.492 INFO:tasks.workunit.client.1.smithi165.stdout:1/56: dread - d0/d3/fe zero size 2024-09-06T14:44:16.492 INFO:tasks.workunit.client.1.smithi165.stdout:5/50: dread d6/f8 [0,4194304] 0 2024-09-06T14:44:16.495 INFO:tasks.workunit.client.1.smithi165.stdout:4/10: dread f2 [0,4194304] 0 2024-09-06T14:44:16.495 INFO:tasks.workunit.client.1.smithi165.stdout:0/30: rename f2 to fb 0 2024-09-06T14:44:16.497 INFO:tasks.workunit.client.1.smithi165.stdout:1/57: unlink d0/fa 0 2024-09-06T14:44:16.507 INFO:tasks.workunit.client.1.smithi165.stdout:0/31: creat fc x:0 0 0 2024-09-06T14:44:16.510 INFO:tasks.workunit.client.1.smithi165.stdout:5/51: chown d6/l9 25 1 2024-09-06T14:44:16.510 INFO:tasks.workunit.client.1.smithi165.stdout:5/52: stat d6/l9 0 2024-09-06T14:44:16.512 INFO:tasks.workunit.client.1.smithi165.stdout:0/32: symlink ld 0 2024-09-06T14:44:16.514 INFO:tasks.workunit.client.1.smithi165.stdout:5/53: creat d6/f10 x:0 0 0 2024-09-06T14:44:16.516 INFO:tasks.workunit.client.1.smithi165.stdout:0/33: unlink f1 0 2024-09-06T14:44:16.517 INFO:tasks.workunit.client.1.smithi165.stdout:1/58: creat d0/f14 x:0 0 0 2024-09-06T14:44:16.522 INFO:tasks.workunit.client.1.smithi165.stdout:0/34: symlink le 0 2024-09-06T14:44:16.524 INFO:tasks.workunit.client.1.smithi165.stdout:0/35: dread fb [0,4194304] 0 2024-09-06T14:44:16.525 INFO:tasks.workunit.client.1.smithi165.stdout:0/36: write fc [357988,119270] 0 2024-09-06T14:44:16.529 INFO:tasks.workunit.client.1.smithi165.stdout:9/17: write f0 [154363,125291] 0 2024-09-06T14:44:16.530 INFO:tasks.workunit.client.1.smithi165.stdout:0/37: creat ff x:0 0 0 2024-09-06T14:44:16.531 INFO:tasks.workunit.client.1.smithi165.stdout:5/54: dwrite d6/f8 [0,4194304] 0 2024-09-06T14:44:16.531 INFO:tasks.workunit.client.1.smithi165.stdout:5/55: chown c5 1497064 1 2024-09-06T14:44:16.536 INFO:tasks.workunit.client.1.smithi165.stdout:5/56: creat d6/f11 x:0 0 0 2024-09-06T14:44:16.537 INFO:tasks.workunit.client.1.smithi165.stdout:9/18: link f0 f9 0 2024-09-06T14:44:16.542 INFO:tasks.workunit.client.1.smithi165.stdout:5/57: symlink d6/l12 0 2024-09-06T14:44:16.545 INFO:tasks.workunit.client.1.smithi165.stdout:4/11: write f2 [367155,96904] 0 2024-09-06T14:44:16.546 INFO:tasks.workunit.client.1.smithi165.stdout:0/38: link f3 f10 0 2024-09-06T14:44:16.546 INFO:tasks.workunit.client.1.smithi165.stdout:4/12: truncate f2 1010336 0 2024-09-06T14:44:16.548 INFO:tasks.workunit.client.1.smithi165.stdout:4/13: write f2 [1433599,94555] 0 2024-09-06T14:44:16.550 INFO:tasks.workunit.client.1.smithi165.stdout:5/58: dwrite d6/f10 [0,4194304] 0 2024-09-06T14:44:16.550 INFO:tasks.workunit.client.1.smithi165.stdout:0/39: mkdir d11 0 2024-09-06T14:44:16.554 INFO:tasks.workunit.client.1.smithi165.stdout:1/59: getdents d0 0 2024-09-06T14:44:16.555 INFO:tasks.workunit.client.1.smithi165.stdout:1/60: fsync d0/f10 0 2024-09-06T14:44:16.555 INFO:tasks.workunit.client.1.smithi165.stdout:4/14: mknod c3 0 2024-09-06T14:44:16.555 INFO:tasks.workunit.client.1.smithi165.stdout:4/15: readlink - no filename 2024-09-06T14:44:16.556 INFO:tasks.workunit.client.1.smithi165.stdout:4/16: chown f2 5312 1 2024-09-06T14:44:16.560 INFO:tasks.workunit.client.1.smithi165.stdout:5/59: creat d6/f13 x:0 0 0 2024-09-06T14:44:16.562 INFO:tasks.workunit.client.1.smithi165.stdout:1/61: dread d0/f7 [0,4194304] 0 2024-09-06T14:44:16.567 INFO:tasks.workunit.client.1.smithi165.stdout:9/19: getdents . 0 2024-09-06T14:44:16.568 INFO:tasks.workunit.client.1.smithi165.stdout:9/20: stat f9 0 2024-09-06T14:44:16.568 INFO:tasks.workunit.client.1.smithi165.stdout:5/60: mknod d6/c14 0 2024-09-06T14:44:16.569 INFO:tasks.workunit.client.1.smithi165.stdout:1/62: symlink d0/d3/l15 0 2024-09-06T14:44:16.570 INFO:tasks.workunit.client.1.smithi165.stdout:1/63: stat d0/d3/fb 0 2024-09-06T14:44:16.570 INFO:tasks.workunit.client.1.smithi165.stdout:1/64: stat d0/d3/fe 0 2024-09-06T14:44:16.570 INFO:tasks.workunit.client.1.smithi165.stdout:0/40: rmdir d11 0 2024-09-06T14:44:16.578 INFO:tasks.workunit.client.1.smithi165.stdout:5/61: rename d6/lf to d6/l15 0 2024-09-06T14:44:16.579 INFO:tasks.workunit.client.1.smithi165.stdout:0/41: rename ld to l12 0 2024-09-06T14:44:16.580 INFO:tasks.workunit.client.1.smithi165.stdout:0/42: dread - f8 zero size 2024-09-06T14:44:16.581 INFO:tasks.workunit.client.1.smithi165.stdout:1/65: rename d0/f2 to d0/d3/f16 0 2024-09-06T14:44:16.581 INFO:tasks.workunit.client.1.smithi165.stdout:5/62: dread d6/f8 [0,4194304] 0 2024-09-06T14:44:16.582 INFO:tasks.workunit.client.1.smithi165.stdout:5/63: fdatasync d6/f8 0 2024-09-06T14:44:16.587 INFO:tasks.workunit.client.1.smithi165.stdout:5/64: creat d6/f16 x:0 0 0 2024-09-06T14:44:16.587 INFO:tasks.workunit.client.1.smithi165.stdout:5/65: read - d6/f11 zero size 2024-09-06T14:44:16.590 INFO:tasks.workunit.client.1.smithi165.stdout:4/17: truncate f2 263561 0 2024-09-06T14:44:16.592 INFO:tasks.workunit.client.1.smithi165.stdout:5/66: creat d6/f17 x:0 0 0 2024-09-06T14:44:16.594 INFO:tasks.workunit.client.1.smithi165.stdout:4/18: symlink l4 0 2024-09-06T14:44:16.596 INFO:tasks.workunit.client.1.smithi165.stdout:9/21: dwrite f0 [0,4194304] 0 2024-09-06T14:44:16.596 INFO:tasks.workunit.client.1.smithi165.stdout:9/22: fdatasync f4 0 2024-09-06T14:44:16.596 INFO:tasks.workunit.client.1.smithi165.stdout:9/23: chown f0 292551644 1 2024-09-06T14:44:16.598 INFO:tasks.workunit.client.1.smithi165.stdout:5/67: read d6/f8 [2421373,22934] 0 2024-09-06T14:44:16.602 INFO:tasks.workunit.client.1.smithi165.stdout:9/24: creat fa x:0 0 0 2024-09-06T14:44:16.604 INFO:tasks.workunit.client.1.smithi165.stdout:9/25: dread - fa zero size 2024-09-06T14:44:16.605 INFO:tasks.workunit.client.1.smithi165.stdout:5/68: rename d6/f10 to d6/f18 0 2024-09-06T14:44:16.606 INFO:tasks.workunit.client.1.smithi165.stdout:9/26: truncate f6 775997 0 2024-09-06T14:44:16.606 INFO:tasks.workunit.client.1.smithi165.stdout:9/27: rmdir - no directory 2024-09-06T14:44:16.609 INFO:tasks.workunit.client.1.smithi165.stdout:9/28: write f6 [391271,40614] 0 2024-09-06T14:44:16.611 INFO:tasks.workunit.client.1.smithi165.stdout:0/43: dwrite f10 [0,4194304] 0 2024-09-06T14:44:16.614 INFO:tasks.workunit.client.1.smithi165.stdout:9/29: unlink f6 0 2024-09-06T14:44:16.614 INFO:tasks.workunit.client.1.smithi165.stdout:1/66: dwrite d0/d3/f6 [8388608,4194304] 0 2024-09-06T14:44:16.619 INFO:tasks.workunit.client.1.smithi165.stdout:1/67: rename d0 to d0/d17 22 2024-09-06T14:44:16.625 INFO:tasks.workunit.client.1.smithi165.stdout:4/19: truncate f2 46875 0 2024-09-06T14:44:16.626 INFO:tasks.workunit.client.1.smithi165.stdout:5/69: dwrite d6/f11 [0,4194304] 0 2024-09-06T14:44:16.628 INFO:tasks.workunit.client.1.smithi165.stdout:1/68: mkdir d0/d3/d18 0 2024-09-06T14:44:16.629 INFO:tasks.workunit.client.1.smithi165.stdout:4/20: mkdir d5 0 2024-09-06T14:44:16.630 INFO:tasks.workunit.client.1.smithi165.stdout:5/70: creat d6/f19 x:0 0 0 2024-09-06T14:44:16.633 INFO:tasks.workunit.client.1.smithi165.stdout:0/44: dwrite f9 [0,4194304] 0 2024-09-06T14:44:16.633 INFO:tasks.workunit.client.1.smithi165.stdout:1/69: symlink d0/d3/l19 0 2024-09-06T14:44:16.634 INFO:tasks.workunit.client.1.smithi165.stdout:9/30: dwrite f0 [0,4194304] 0 2024-09-06T14:44:16.635 INFO:tasks.workunit.client.1.smithi165.stdout:0/45: fdatasync fc 0 2024-09-06T14:44:16.642 INFO:tasks.workunit.client.1.smithi165.stdout:0/46: link f10 f13 0 2024-09-06T14:44:16.645 INFO:tasks.workunit.client.1.smithi165.stdout:0/47: read f13 [1154778,79342] 0 2024-09-06T14:44:16.646 INFO:tasks.workunit.client.1.smithi165.stdout:1/70: dread d0/d3/fd [8388608,4194304] 0 2024-09-06T14:44:16.648 INFO:tasks.workunit.client.1.smithi165.stdout:1/71: rename d0 to d0/d3/d1a 22 2024-09-06T14:44:16.648 INFO:tasks.workunit.client.1.smithi165.stdout:9/31: dwrite f4 [0,4194304] 0 2024-09-06T14:44:16.648 INFO:tasks.workunit.client.1.smithi165.stdout:0/48: dread fb [0,4194304] 0 2024-09-06T14:44:16.649 INFO:tasks.workunit.client.1.smithi165.stdout:1/72: fsync d0/d3/f12 0 2024-09-06T14:44:16.650 INFO:tasks.workunit.client.1.smithi165.stdout:9/32: mkdir db 0 2024-09-06T14:44:16.651 INFO:tasks.workunit.client.1.smithi165.stdout:0/49: symlink l14 0 2024-09-06T14:44:16.651 INFO:tasks.workunit.client.1.smithi165.stdout:1/73: mkdir d0/d3/d1b 0 2024-09-06T14:44:16.652 INFO:tasks.workunit.client.1.smithi165.stdout:1/74: stat d0/d3/f12 0 2024-09-06T14:44:16.653 INFO:tasks.workunit.client.1.smithi165.stdout:9/33: unlink f9 0 2024-09-06T14:44:16.653 INFO:tasks.workunit.client.1.smithi165.stdout:9/34: chown f4 0 1 2024-09-06T14:44:16.654 INFO:tasks.workunit.client.1.smithi165.stdout:0/50: mkdir d15 0 2024-09-06T14:44:16.654 INFO:tasks.workunit.client.1.smithi165.stdout:0/51: read f9 [3062905,115136] 0 2024-09-06T14:44:16.656 INFO:tasks.workunit.client.1.smithi165.stdout:1/75: dread - d0/f10 zero size 2024-09-06T14:44:16.657 INFO:tasks.workunit.client.1.smithi165.stdout:1/76: write d0/f10 [14841,130540] 0 2024-09-06T14:44:16.657 INFO:tasks.workunit.client.1.smithi165.stdout:0/52: getdents d15 0 2024-09-06T14:44:16.658 INFO:tasks.workunit.client.1.smithi165.stdout:0/53: dread - f8 zero size 2024-09-06T14:44:16.659 INFO:tasks.workunit.client.1.smithi165.stdout:1/77: write d0/f10 [151486,83961] 0 2024-09-06T14:44:16.661 INFO:tasks.workunit.client.1.smithi165.stdout:9/35: dread f0 [0,4194304] 0 2024-09-06T14:44:16.661 INFO:tasks.workunit.client.1.smithi165.stdout:9/36: chown db 195733 1 2024-09-06T14:44:16.661 INFO:tasks.workunit.client.1.smithi165.stdout:0/54: dread fc [0,4194304] 0 2024-09-06T14:44:16.662 INFO:tasks.workunit.client.1.smithi165.stdout:9/37: write fa [388088,45814] 0 2024-09-06T14:44:16.664 INFO:tasks.workunit.client.1.smithi165.stdout:0/55: rename fc to d15/f16 0 2024-09-06T14:44:16.665 INFO:tasks.workunit.client.1.smithi165.stdout:9/38: creat db/fc x:0 0 0 2024-09-06T14:44:16.667 INFO:tasks.workunit.client.1.smithi165.stdout:9/39: creat db/fd x:0 0 0 2024-09-06T14:44:16.668 INFO:tasks.workunit.client.1.smithi165.stdout:9/40: truncate db/fc 630870 0 2024-09-06T14:44:16.668 INFO:tasks.workunit.client.1.smithi165.stdout:9/41: chown c7 80 1 2024-09-06T14:44:16.670 INFO:tasks.workunit.client.1.smithi165.stdout:9/42: mkdir db/de 0 2024-09-06T14:44:16.673 INFO:tasks.workunit.client.1.smithi165.stdout:9/43: creat db/ff x:0 0 0 2024-09-06T14:44:16.674 INFO:tasks.workunit.client.1.smithi165.stdout:0/56: truncate f3 275723 0 2024-09-06T14:44:16.675 INFO:tasks.workunit.client.1.smithi165.stdout:0/57: read d15/f16 [275951,66467] 0 2024-09-06T14:44:16.677 INFO:tasks.workunit.client.1.smithi165.stdout:9/44: creat db/de/f10 x:0 0 0 2024-09-06T14:44:16.678 INFO:tasks.workunit.client.1.smithi165.stdout:9/45: write db/ff [534997,29428] 0 2024-09-06T14:44:16.682 INFO:tasks.workunit.client.1.smithi165.stdout:9/46: rename c7 to db/c11 0 2024-09-06T14:44:16.684 INFO:tasks.workunit.client.1.smithi165.stdout:4/21: dwrite f2 [0,4194304] 0 2024-09-06T14:44:16.690 INFO:tasks.workunit.client.1.smithi165.stdout:0/58: truncate f13 378447 0 2024-09-06T14:44:16.694 INFO:tasks.workunit.client.1.smithi165.stdout:9/47: dwrite db/fc [0,4194304] 0 2024-09-06T14:44:16.697 INFO:tasks.workunit.client.1.smithi165.stdout:4/22: dwrite f2 [0,4194304] 0 2024-09-06T14:44:16.697 INFO:tasks.workunit.client.1.smithi165.stdout:0/59: getdents d15 0 2024-09-06T14:44:16.701 INFO:tasks.workunit.client.1.smithi165.stdout:9/48: symlink db/l12 0 2024-09-06T14:44:16.702 INFO:tasks.workunit.client.1.smithi165.stdout:0/60: write f9 [2953279,17506] 0 2024-09-06T14:44:16.702 INFO:tasks.workunit.client.1.smithi165.stdout:9/49: chown db/l12 1 1 2024-09-06T14:44:16.705 INFO:tasks.workunit.client.1.smithi165.stdout:4/23: mknod d5/c6 0 2024-09-06T14:44:16.706 INFO:tasks.workunit.client.1.smithi165.stdout:0/61: creat d15/f17 x:0 0 0 2024-09-06T14:44:16.708 INFO:tasks.workunit.client.1.smithi165.stdout:0/62: unlink l14 0 2024-09-06T14:44:16.712 INFO:tasks.workunit.client.1.smithi165.stdout:0/63: rename c4 to d15/c18 0 2024-09-06T14:44:16.713 INFO:tasks.workunit.client.1.smithi165.stdout:0/64: chown d15 47132 1 2024-09-06T14:44:16.714 INFO:tasks.workunit.client.1.smithi165.stdout:9/50: dwrite db/ff [0,4194304] 0 2024-09-06T14:44:16.716 INFO:tasks.workunit.client.1.smithi165.stdout:4/24: dwrite f2 [4194304,4194304] 0 2024-09-06T14:44:16.719 INFO:tasks.workunit.client.1.smithi165.stdout:9/51: mkdir db/de/d13 0 2024-09-06T14:44:16.720 INFO:tasks.workunit.client.1.smithi165.stdout:4/25: symlink d5/l7 0 2024-09-06T14:44:16.722 INFO:tasks.workunit.client.1.smithi165.stdout:9/52: rename db/l12 to db/l14 0 2024-09-06T14:44:16.726 INFO:tasks.workunit.client.1.smithi165.stdout:4/26: rmdir d5 39 2024-09-06T14:44:16.726 INFO:tasks.workunit.client.1.smithi165.stdout:9/53: rmdir db 39 2024-09-06T14:44:16.729 INFO:tasks.workunit.client.1.smithi165.stdout:4/27: creat d5/f8 x:0 0 0 2024-09-06T14:44:16.730 INFO:tasks.workunit.client.1.smithi165.stdout:9/54: mkdir db/de/d15 0 2024-09-06T14:44:16.730 INFO:tasks.workunit.client.1.smithi165.stdout:9/55: read db/fc [3242993,8262] 0 2024-09-06T14:44:16.730 INFO:tasks.workunit.client.1.smithi165.stdout:4/28: symlink d5/l9 0 2024-09-06T14:44:16.731 INFO:tasks.workunit.client.1.smithi165.stdout:4/29: write d5/f8 [819316,106912] 0 2024-09-06T14:44:16.732 INFO:tasks.workunit.client.1.smithi165.stdout:9/56: write db/fd [56699,111154] 0 2024-09-06T14:44:16.732 INFO:tasks.workunit.client.1.smithi165.stdout:4/30: chown d5/f8 2081 1 2024-09-06T14:44:16.734 INFO:tasks.workunit.client.1.smithi165.stdout:9/57: mkdir db/de/d16 0 2024-09-06T14:44:16.734 INFO:tasks.workunit.client.1.smithi165.stdout:9/58: chown l3 3 1 2024-09-06T14:44:16.734 INFO:tasks.workunit.client.1.smithi165.stdout:4/31: creat d5/fa x:0 0 0 2024-09-06T14:44:16.736 INFO:tasks.workunit.client.1.smithi165.stdout:9/59: mkdir db/de/d15/d17 0 2024-09-06T14:44:16.743 INFO:tasks.workunit.client.1.smithi165.stdout:0/65: chown d15/c18 10 1 2024-09-06T14:44:16.743 INFO:tasks.workunit.client.1.smithi165.stdout:9/60: dwrite db/fd [0,4194304] 0 2024-09-06T14:44:16.745 INFO:tasks.workunit.client.1.smithi165.stdout:0/66: mkdir d15/d19 0 2024-09-06T14:44:16.753 INFO:tasks.workunit.client.1.smithi165.stdout:4/32: getdents d5 0 2024-09-06T14:44:16.754 INFO:tasks.workunit.client.1.smithi165.stdout:0/67: dwrite f9 [4194304,4194304] 0 2024-09-06T14:44:16.760 INFO:tasks.workunit.client.1.smithi165.stdout:4/33: dread f2 [4194304,4194304] 0 2024-09-06T14:44:16.761 INFO:tasks.workunit.client.1.smithi165.stdout:0/68: write f3 [655187,54905] 0 2024-09-06T14:44:16.762 INFO:tasks.workunit.client.1.smithi165.stdout:4/34: getdents d5 0 2024-09-06T14:44:16.763 INFO:tasks.workunit.client.1.smithi165.stdout:0/69: read fb [177241,90319] 0 2024-09-06T14:44:16.769 INFO:tasks.workunit.client.1.smithi165.stdout:4/35: creat d5/fb x:0 0 0 2024-09-06T14:44:16.769 INFO:tasks.workunit.client.1.smithi165.stdout:0/70: symlink d15/l1a 0 2024-09-06T14:44:16.769 INFO:tasks.workunit.client.1.smithi165.stdout:4/36: chown d5/f8 11 1 2024-09-06T14:44:16.770 INFO:tasks.workunit.client.1.smithi165.stdout:4/37: fdatasync d5/fa 0 2024-09-06T14:44:16.770 INFO:tasks.workunit.client.1.smithi165.stdout:4/38: creat d5/fc x:0 0 0 2024-09-06T14:44:16.770 INFO:tasks.workunit.client.1.smithi165.stdout:0/71: creat d15/d19/f1b x:0 0 0 2024-09-06T14:44:16.770 INFO:tasks.workunit.client.1.smithi165.stdout:4/39: read - d5/fb zero size 2024-09-06T14:44:16.770 INFO:tasks.workunit.client.1.smithi165.stdout:9/61: fsync db/fd 0 2024-09-06T14:44:16.770 INFO:tasks.workunit.client.1.smithi165.stdout:4/40: mknod d5/cd 0 2024-09-06T14:44:16.772 INFO:tasks.workunit.client.1.smithi165.stdout:4/41: chown d5/cd 3356 1 2024-09-06T14:44:16.777 INFO:tasks.workunit.client.1.smithi165.stdout:0/72: dwrite f9 [4194304,4194304] 0 2024-09-06T14:44:16.778 INFO:tasks.workunit.client.1.smithi165.stdout:9/62: dwrite db/fd [0,4194304] 0 2024-09-06T14:44:16.780 INFO:tasks.workunit.client.1.smithi165.stdout:0/73: dread fb [0,4194304] 0 2024-09-06T14:44:16.781 INFO:tasks.workunit.client.1.smithi165.stdout:0/74: dread - d15/f17 zero size 2024-09-06T14:44:16.782 INFO:tasks.workunit.client.1.smithi165.stdout:0/75: chown d15/f17 52 1 2024-09-06T14:44:16.782 INFO:tasks.workunit.client.1.smithi165.stdout:0/76: stat ca 0 2024-09-06T14:44:16.782 INFO:tasks.workunit.client.1.smithi165.stdout:0/77: chown f10 8316580 1 2024-09-06T14:44:16.783 INFO:tasks.workunit.client.1.smithi165.stdout:9/63: dread f4 [0,4194304] 0 2024-09-06T14:44:16.802 INFO:tasks.workunit.client.1.smithi165.stdout:4/42: symlink d5/le 0 2024-09-06T14:44:16.809 INFO:tasks.workunit.client.1.smithi165.stdout:9/64: rename db/de/d13 to db/de/d15/d17/d18 0 2024-09-06T14:44:16.811 INFO:tasks.workunit.client.1.smithi165.stdout:4/43: rename d5/l7 to d5/lf 0 2024-09-06T14:44:16.811 INFO:tasks.workunit.client.1.smithi165.stdout:4/44: readlink l4 0 2024-09-06T14:44:16.812 INFO:tasks.workunit.client.1.smithi165.stdout:4/45: write d5/fc [551788,89965] 0 2024-09-06T14:44:16.812 INFO:tasks.workunit.client.1.smithi165.stdout:4/46: stat d5/fb 0 2024-09-06T14:44:16.816 INFO:tasks.workunit.client.1.smithi165.stdout:0/78: unlink l12 0 2024-09-06T14:44:16.816 INFO:tasks.workunit.client.1.smithi165.stdout:0/79: chown f3 12 1 2024-09-06T14:44:16.817 INFO:tasks.workunit.client.1.smithi165.stdout:0/80: write ff [450503,128371] 0 2024-09-06T14:44:16.820 INFO:tasks.workunit.client.1.smithi165.stdout:9/65: fsync f4 0 2024-09-06T14:44:16.820 INFO:tasks.workunit.client.1.smithi165.stdout:4/47: write f2 [3860416,26819] 0 2024-09-06T14:44:16.821 INFO:tasks.workunit.client.1.smithi165.stdout:4/48: read - d5/fa zero size 2024-09-06T14:44:16.823 INFO:tasks.workunit.client.1.smithi165.stdout:0/81: write d15/f16 [1122063,55638] 0 2024-09-06T14:44:16.827 INFO:tasks.workunit.client.1.smithi165.stdout:4/49: dread d5/f8 [0,4194304] 0 2024-09-06T14:44:16.828 INFO:tasks.workunit.client.1.smithi165.stdout:9/66: dwrite db/ff [0,4194304] 0 2024-09-06T14:44:16.832 INFO:tasks.workunit.client.1.smithi165.stdout:0/82: dwrite f3 [0,4194304] 0 2024-09-06T14:44:16.833 INFO:tasks.workunit.client.1.smithi165.stdout:0/83: truncate f10 5024250 0 2024-09-06T14:44:16.833 INFO:tasks.workunit.client.1.smithi165.stdout:9/67: unlink db/fc 0 2024-09-06T14:44:16.833 INFO:tasks.workunit.client.1.smithi165.stdout:0/84: stat d15/f17 0 2024-09-06T14:44:16.835 INFO:tasks.workunit.client.1.smithi165.stdout:0/85: dread fb [0,4194304] 0 2024-09-06T14:44:16.838 INFO:tasks.workunit.client.1.smithi165.stdout:9/68: creat db/de/d15/d17/f19 x:0 0 0 2024-09-06T14:44:16.840 INFO:tasks.workunit.client.1.smithi165.stdout:0/86: symlink d15/d19/l1c 0 2024-09-06T14:44:16.840 INFO:tasks.workunit.client.1.smithi165.stdout:0/87: dread - f8 zero size 2024-09-06T14:44:16.844 INFO:tasks.workunit.client.1.smithi165.stdout:0/88: chown f13 91344 1 2024-09-06T14:44:16.844 INFO:tasks.workunit.client.1.smithi165.stdout:9/69: unlink db/l14 0 2024-09-06T14:44:16.845 INFO:tasks.workunit.client.1.smithi165.stdout:9/70: chown db/de/d15 28 1 2024-09-06T14:44:16.847 INFO:tasks.workunit.client.1.smithi165.stdout:9/71: stat db/de/d15/d17/f19 0 2024-09-06T14:44:16.848 INFO:tasks.workunit.client.1.smithi165.stdout:0/89: dwrite f9 [4194304,4194304] 0 2024-09-06T14:44:16.848 INFO:tasks.workunit.client.1.smithi165.stdout:9/72: truncate db/fd 4681885 0 2024-09-06T14:44:16.848 INFO:tasks.workunit.client.1.smithi165.stdout:0/90: chown d15/l1a 495129 1 2024-09-06T14:44:16.852 INFO:tasks.workunit.client.1.smithi165.stdout:9/73: rename db/ff to db/de/d15/f1a 0 2024-09-06T14:44:16.856 INFO:tasks.workunit.client.1.smithi165.stdout:9/74: mknod db/de/d15/d17/c1b 0 2024-09-06T14:44:16.856 INFO:tasks.workunit.client.1.smithi165.stdout:0/91: dwrite d15/d19/f1b [0,4194304] 0 2024-09-06T14:44:16.857 INFO:tasks.workunit.client.1.smithi165.stdout:0/92: fsync d15/f17 0 2024-09-06T14:44:16.857 INFO:tasks.workunit.client.1.smithi165.stdout:9/75: stat db/de/d15/d17/d18 0 2024-09-06T14:44:16.860 INFO:tasks.workunit.client.1.smithi165.stdout:0/93: unlink d15/f17 0 2024-09-06T14:44:16.861 INFO:tasks.workunit.client.1.smithi165.stdout:0/94: chown f13 1031399 1 2024-09-06T14:44:16.868 INFO:tasks.workunit.client.1.smithi165.stdout:9/76: dwrite f0 [0,4194304] 0 2024-09-06T14:44:16.873 INFO:tasks.workunit.client.1.smithi165.stdout:9/77: dread db/de/d15/f1a [0,4194304] 0 2024-09-06T14:44:16.879 INFO:tasks.workunit.client.1.smithi165.stdout:9/78: creat db/f1c x:0 0 0 2024-09-06T14:44:16.879 INFO:tasks.workunit.client.1.smithi165.stdout:9/79: write db/fd [1874602,107105] 0 2024-09-06T14:44:16.885 INFO:tasks.workunit.client.1.smithi165.stdout:9/80: creat db/de/d15/d17/d18/f1d x:0 0 0 2024-09-06T14:44:16.886 INFO:tasks.workunit.client.1.smithi165.stdout:9/81: write db/de/f10 [950479,28791] 0 2024-09-06T14:44:16.889 INFO:tasks.workunit.client.1.smithi165.stdout:9/82: dread db/de/d15/f1a [0,4194304] 0 2024-09-06T14:44:16.890 INFO:tasks.workunit.client.1.smithi165.stdout:9/83: fdatasync db/f1c 0 2024-09-06T14:44:16.890 INFO:tasks.workunit.client.1.smithi165.stdout:9/84: readlink l3 0 2024-09-06T14:44:16.891 INFO:tasks.workunit.client.1.smithi165.stdout:9/85: write db/de/f10 [561935,7871] 0 2024-09-06T14:44:16.898 INFO:tasks.workunit.client.1.smithi165.stdout:9/86: link l3 db/de/l1e 0 2024-09-06T14:44:16.898 INFO:tasks.workunit.client.1.smithi165.stdout:4/50: truncate f2 3607852 0 2024-09-06T14:44:16.900 INFO:tasks.workunit.client.1.smithi165.stdout:9/87: readlink db/de/l1e 0 2024-09-06T14:44:16.904 INFO:tasks.workunit.client.1.smithi165.stdout:4/51: dwrite d5/fb [0,4194304] 0 2024-09-06T14:44:16.905 INFO:tasks.workunit.client.1.smithi165.stdout:4/52: write d5/fa [554563,75482] 0 2024-09-06T14:44:16.906 INFO:tasks.workunit.client.1.smithi165.stdout:9/88: stat db/de/l1e 0 2024-09-06T14:44:16.908 INFO:tasks.workunit.client.1.smithi165.stdout:4/53: readlink d5/lf 0 2024-09-06T14:44:16.908 INFO:tasks.workunit.client.1.smithi165.stdout:4/54: chown d5 0 1 2024-09-06T14:44:16.909 INFO:tasks.workunit.client.1.smithi165.stdout:4/55: chown d5/f8 1376126816 1 2024-09-06T14:44:16.909 INFO:tasks.workunit.client.1.smithi165.stdout:9/89: rmdir db/de/d15/d17/d18 39 2024-09-06T14:44:16.912 INFO:tasks.workunit.client.1.smithi165.stdout:4/56: rename d5/fb to d5/f10 0 2024-09-06T14:44:16.914 INFO:tasks.workunit.client.1.smithi165.stdout:0/95: getdents d15 0 2024-09-06T14:44:16.914 INFO:tasks.workunit.client.1.smithi165.stdout:0/96: chown d15/c18 45177 1 2024-09-06T14:44:16.915 INFO:tasks.workunit.client.1.smithi165.stdout:9/90: dwrite f4 [0,4194304] 0 2024-09-06T14:44:16.916 INFO:tasks.workunit.client.1.smithi165.stdout:4/57: mknod d5/c11 0 2024-09-06T14:44:16.919 INFO:tasks.workunit.client.1.smithi165.stdout:0/97: dread d15/f16 [0,4194304] 0 2024-09-06T14:44:16.919 INFO:tasks.workunit.client.1.smithi165.stdout:9/91: mknod db/de/c1f 0 2024-09-06T14:44:16.920 INFO:tasks.workunit.client.1.smithi165.stdout:0/98: chown c7 64282 1 2024-09-06T14:44:16.923 INFO:tasks.workunit.client.1.smithi165.stdout:9/92: symlink db/de/l20 0 2024-09-06T14:44:16.924 INFO:tasks.workunit.client.1.smithi165.stdout:0/99: mknod d15/d19/c1d 0 2024-09-06T14:44:16.927 INFO:tasks.workunit.client.1.smithi165.stdout:0/100: fsync fb 0 2024-09-06T14:44:16.934 INFO:tasks.workunit.client.1.smithi165.stdout:0/101: rename f13 to d15/d19/f1e 0 2024-09-06T14:44:16.939 INFO:tasks.workunit.client.1.smithi165.stdout:9/93: getdents db 0 2024-09-06T14:44:16.940 INFO:tasks.workunit.client.1.smithi165.stdout:9/94: chown db/c11 8036 1 2024-09-06T14:44:16.944 INFO:tasks.workunit.client.1.smithi165.stdout:9/95: symlink db/de/d16/l21 0 2024-09-06T14:44:16.944 INFO:tasks.workunit.client.1.smithi165.stdout:0/102: dwrite f10 [0,4194304] 0 2024-09-06T14:44:16.948 INFO:tasks.workunit.client.1.smithi165.stdout:0/103: creat d15/f1f x:0 0 0 2024-09-06T14:44:16.949 INFO:tasks.workunit.client.1.smithi165.stdout:0/104: chown d15/c18 1902441450 1 2024-09-06T14:44:16.950 INFO:tasks.workunit.client.1.smithi165.stdout:9/96: dread db/de/d15/f1a [0,4194304] 0 2024-09-06T14:44:16.953 INFO:tasks.workunit.client.1.smithi165.stdout:0/105: creat d15/d19/f20 x:0 0 0 2024-09-06T14:44:16.953 INFO:tasks.workunit.client.1.smithi165.stdout:0/106: stat ca 0 2024-09-06T14:44:16.954 INFO:tasks.workunit.client.1.smithi165.stdout:0/107: read d15/f16 [932948,129658] 0 2024-09-06T14:44:16.954 INFO:tasks.workunit.client.1.smithi165.stdout:9/97: rmdir db/de/d15 39 2024-09-06T14:44:16.956 INFO:tasks.workunit.client.1.smithi165.stdout:9/98: mkdir db/d22 0 2024-09-06T14:44:16.960 INFO:tasks.workunit.client.1.smithi165.stdout:0/108: creat d15/d19/f21 x:0 0 0 2024-09-06T14:44:16.961 INFO:tasks.workunit.client.1.smithi165.stdout:9/99: creat db/de/d15/f23 x:0 0 0 2024-09-06T14:44:16.968 INFO:tasks.workunit.client.1.smithi165.stdout:9/100: dwrite db/de/d15/f23 [0,4194304] 0 2024-09-06T14:44:16.972 INFO:tasks.workunit.client.1.smithi165.stdout:9/101: unlink db/c11 0 2024-09-06T14:44:16.980 INFO:tasks.workunit.client.1.smithi165.stdout:9/102: dwrite db/de/d15/f1a [0,4194304] 0 2024-09-06T14:44:16.982 INFO:tasks.workunit.client.1.smithi165.stdout:9/103: fsync db/de/d15/d17/f19 0 2024-09-06T14:44:16.982 INFO:tasks.workunit.client.1.smithi165.stdout:9/104: fdatasync db/de/d15/d17/f19 0 2024-09-06T14:44:16.984 INFO:tasks.workunit.client.1.smithi165.stdout:9/105: dread - db/de/d15/d17/f19 zero size 2024-09-06T14:44:16.984 INFO:tasks.workunit.client.1.smithi165.stdout:9/106: write f4 [3211181,93183] 0 2024-09-06T14:44:16.990 INFO:tasks.workunit.client.1.smithi165.stdout:9/107: getdents db/d22 0 2024-09-06T14:44:16.991 INFO:tasks.workunit.client.1.smithi165.stdout:9/108: write db/f1c [869737,114058] 0 2024-09-06T14:44:16.992 INFO:tasks.workunit.client.1.smithi165.stdout:9/109: write fa [602319,121842] 0 2024-09-06T14:44:16.996 INFO:tasks.workunit.client.1.smithi165.stdout:9/110: creat db/de/d16/f24 x:0 0 0 2024-09-06T14:44:17.005 INFO:tasks.workunit.client.1.smithi165.stdout:9/111: rename db/de/d15/f23 to db/de/d15/d17/f25 0 2024-09-06T14:44:17.006 INFO:tasks.workunit.client.1.smithi165.stdout:9/112: write db/de/d15/f1a [3115191,127198] 0 2024-09-06T14:44:17.006 INFO:tasks.workunit.client.1.smithi165.stdout:9/113: chown db/de/d16 28 1 2024-09-06T14:44:17.009 INFO:tasks.workunit.client.1.smithi165.stdout:9/114: creat db/f26 x:0 0 0 2024-09-06T14:44:17.014 INFO:tasks.workunit.client.1.smithi165.stdout:9/115: symlink db/d22/l27 0 2024-09-06T14:44:17.017 INFO:tasks.workunit.client.1.smithi165.stdout:9/116: write db/de/d15/d17/d18/f1d [1046381,41855] 0 2024-09-06T14:44:17.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:16 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi052 to 1217M 2024-09-06T14:44:17.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:16 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi052 to 1217M 2024-09-06T14:44:18.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:17 smithi052 ceph-mon[28627]: pgmap v11: 65 pgs: 65 active+clean; 190 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-09-06T14:44:18.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:17 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:18.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:17 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:18.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:17 smithi165 ceph-mon[36229]: pgmap v11: 65 pgs: 65 active+clean; 190 MiB data, 796 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-09-06T14:44:18.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:17 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:18.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:17 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:19.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:18 smithi165 ceph-mon[36229]: pgmap v12: 65 pgs: 65 active+clean; 323 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 23 MiB/s wr, 384 op/s 2024-09-06T14:44:19.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:18 smithi052 ceph-mon[28627]: pgmap v12: 65 pgs: 65 active+clean; 323 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 23 MiB/s wr, 384 op/s 2024-09-06T14:44:21.047 INFO:tasks.workunit.client.1.smithi165.stdout:7/6: sync 2024-09-06T14:44:21.049 INFO:tasks.workunit.client.1.smithi165.stdout:7/7: rename f0 to f1 0 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:9/117: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:8/52: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:0/109: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:2/44: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:5/71: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:3/43: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:4/58: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:6/13: sync 2024-09-06T14:44:21.133 INFO:tasks.workunit.client.1.smithi165.stdout:1/78: sync 2024-09-06T14:44:21.134 INFO:tasks.workunit.client.1.smithi165.stdout:5/72: readlink d6/l12 0 2024-09-06T14:44:21.134 INFO:tasks.workunit.client.1.smithi165.stdout:2/45: rename d9 to d9/de 22 2024-09-06T14:44:21.134 INFO:tasks.workunit.client.1.smithi165.stdout:0/110: readlink d15/l1a 0 2024-09-06T14:44:21.135 INFO:tasks.workunit.client.1.smithi165.stdout:6/14: mknod c2 0 2024-09-06T14:44:21.136 INFO:tasks.workunit.client.1.smithi165.stdout:8/53: readlink d0/l3 0 2024-09-06T14:44:21.140 INFO:tasks.workunit.client.1.smithi165.stdout:9/118: dread db/de/d15/d17/d18/f1d [0,4194304] 0 2024-09-06T14:44:21.142 INFO:tasks.workunit.client.1.smithi165.stdout:0/111: dwrite d15/d19/f21 [0,4194304] 0 2024-09-06T14:44:21.145 INFO:tasks.workunit.client.1.smithi165.stdout:1/79: mkdir d0/d1c 0 2024-09-06T14:44:21.149 INFO:tasks.workunit.client.1.smithi165.stdout:5/73: unlink d6/l15 0 2024-09-06T14:44:21.151 INFO:tasks.workunit.client.1.smithi165.stdout:3/44: creat d1/da/dd/fe x:0 0 0 2024-09-06T14:44:21.151 INFO:tasks.workunit.client.1.smithi165.stdout:3/45: chown d1/da/dc 1 1 2024-09-06T14:44:21.153 INFO:tasks.workunit.client.1.smithi165.stdout:2/46: link f5 d9/ff 0 2024-09-06T14:44:21.155 INFO:tasks.workunit.client.1.smithi165.stdout:3/46: dread d1/f2 [0,4194304] 0 2024-09-06T14:44:21.158 INFO:tasks.workunit.client.1.smithi165.stdout:9/119: creat db/de/d15/f28 x:0 0 0 2024-09-06T14:44:21.158 INFO:tasks.workunit.client.1.smithi165.stdout:3/47: dread d1/f2 [0,4194304] 0 2024-09-06T14:44:21.163 INFO:tasks.workunit.client.1.smithi165.stdout:6/15: truncate f1 805841 0 2024-09-06T14:44:21.164 INFO:tasks.workunit.client.1.smithi165.stdout:1/80: stat d0/d3 0 2024-09-06T14:44:21.164 INFO:tasks.workunit.client.1.smithi165.stdout:1/81: dread - d0/d3/f12 zero size 2024-09-06T14:44:21.164 INFO:tasks.workunit.client.1.smithi165.stdout:8/54: rmdir d0/d2 39 2024-09-06T14:44:21.167 INFO:tasks.workunit.client.1.smithi165.stdout:5/74: creat d6/f1a x:0 0 0 2024-09-06T14:44:21.170 INFO:tasks.workunit.client.1.smithi165.stdout:2/47: creat d9/f10 x:0 0 0 2024-09-06T14:44:21.170 INFO:tasks.workunit.client.1.smithi165.stdout:2/48: dread - d9/fc zero size 2024-09-06T14:44:21.176 INFO:tasks.workunit.client.1.smithi165.stdout:8/55: truncate d0/d2/fa 814963 0 2024-09-06T14:44:21.180 INFO:tasks.workunit.client.1.smithi165.stdout:8/56: dread d0/d2/fe [0,4194304] 0 2024-09-06T14:44:21.184 INFO:tasks.workunit.client.1.smithi165.stdout:0/112: link d15/d19/l1c d15/d19/l22 0 2024-09-06T14:44:21.187 INFO:tasks.workunit.client.1.smithi165.stdout:1/82: mkdir d0/d1c/d1d 0 2024-09-06T14:44:21.187 INFO:tasks.workunit.client.1.smithi165.stdout:2/49: dwrite d9/ff [0,4194304] 0 2024-09-06T14:44:21.188 INFO:tasks.workunit.client.1.smithi165.stdout:2/50: readlink l4 0 2024-09-06T14:44:21.192 INFO:tasks.workunit.client.1.smithi165.stdout:0/113: dwrite d15/d19/f1b [0,4194304] 0 2024-09-06T14:44:21.193 INFO:tasks.workunit.client.1.smithi165.stdout:9/120: creat db/de/d15/d17/f29 x:0 0 0 2024-09-06T14:44:21.195 INFO:tasks.workunit.client.1.smithi165.stdout:3/48: link d1/l7 d1/da/dc/lf 0 2024-09-06T14:44:21.202 INFO:tasks.workunit.client.1.smithi165.stdout:2/51: creat d9/f11 x:0 0 0 2024-09-06T14:44:21.203 INFO:tasks.workunit.client.1.smithi165.stdout:2/52: chown f8 245551 1 2024-09-06T14:44:21.203 INFO:tasks.workunit.client.1.smithi165.stdout:2/53: readlink l4 0 2024-09-06T14:44:21.203 INFO:tasks.workunit.client.1.smithi165.stdout:8/57: symlink d0/l11 0 2024-09-06T14:44:21.215 INFO:tasks.workunit.client.1.smithi165.stdout:3/49: mkdir d1/da/dc/d10 0 2024-09-06T14:44:21.216 INFO:tasks.workunit.client.1.smithi165.stdout:8/58: dwrite d0/d2/fa [0,4194304] 0 2024-09-06T14:44:21.216 INFO:tasks.workunit.client.1.smithi165.stdout:3/50: stat d1/da/dd 0 2024-09-06T14:44:21.217 INFO:tasks.workunit.client.1.smithi165.stdout:3/51: dread - d1/da/dd/fe zero size 2024-09-06T14:44:21.217 INFO:tasks.workunit.client.1.smithi165.stdout:9/121: link l8 db/de/d15/l2a 0 2024-09-06T14:44:21.218 INFO:tasks.workunit.client.1.smithi165.stdout:3/52: chown d1/da/dd/fe 136396797 1 2024-09-06T14:44:21.219 INFO:tasks.workunit.client.1.smithi165.stdout:1/83: link d0/f7 d0/d1c/d1d/f1e 0 2024-09-06T14:44:21.221 INFO:tasks.workunit.client.1.smithi165.stdout:8/59: creat d0/d2/f12 x:0 0 0 2024-09-06T14:44:21.222 INFO:tasks.workunit.client.1.smithi165.stdout:9/122: creat db/de/d15/f2b x:0 0 0 2024-09-06T14:44:21.224 INFO:tasks.workunit.client.1.smithi165.stdout:3/53: creat d1/f11 x:0 0 0 2024-09-06T14:44:21.226 INFO:tasks.workunit.client.1.smithi165.stdout:1/84: unlink d0/d3/f6 0 2024-09-06T14:44:21.229 INFO:tasks.workunit.client.1.smithi165.stdout:9/123: rmdir db 39 2024-09-06T14:44:21.230 INFO:tasks.workunit.client.1.smithi165.stdout:9/124: write f0 [2175701,85035] 0 2024-09-06T14:44:21.233 INFO:tasks.workunit.client.1.smithi165.stdout:8/60: link d0/fc d0/d2/f13 0 2024-09-06T14:44:21.234 INFO:tasks.workunit.client.1.smithi165.stdout:9/125: readlink db/d22/l27 0 2024-09-06T14:44:21.235 INFO:tasks.workunit.client.1.smithi165.stdout:1/85: creat d0/d3/d1b/f1f x:0 0 0 2024-09-06T14:44:21.236 INFO:tasks.workunit.client.1.smithi165.stdout:8/61: unlink d0/ff 0 2024-09-06T14:44:21.243 INFO:tasks.workunit.client.1.smithi165.stdout:8/62: mkdir d0/d14 0 2024-09-06T14:44:21.248 INFO:tasks.workunit.client.1.smithi165.stdout:9/126: getdents db/de/d15/d17/d18 0 2024-09-06T14:44:21.252 INFO:tasks.workunit.client.1.smithi165.stdout:8/63: dwrite d0/d2/fe [0,4194304] 0 2024-09-06T14:44:21.253 INFO:tasks.workunit.client.1.smithi165.stdout:9/127: creat db/de/f2c x:0 0 0 2024-09-06T14:44:21.253 INFO:tasks.workunit.client.1.smithi165.stdout:8/64: read d0/d2/fa [733758,114557] 0 2024-09-06T14:44:21.259 INFO:tasks.workunit.client.1.smithi165.stdout:9/128: dwrite db/fd [0,4194304] 0 2024-09-06T14:44:21.268 INFO:tasks.workunit.client.1.smithi165.stdout:9/129: dwrite db/de/d15/d17/f19 [0,4194304] 0 2024-09-06T14:44:21.270 INFO:tasks.workunit.client.1.smithi165.stdout:9/130: write db/f26 [704306,61157] 0 2024-09-06T14:44:21.271 INFO:tasks.workunit.client.1.smithi165.stdout:9/131: dread - db/de/d15/d17/f29 zero size 2024-09-06T14:44:21.273 INFO:tasks.workunit.client.1.smithi165.stdout:9/132: stat db/de/d15/d17/f25 0 2024-09-06T14:44:21.278 INFO:tasks.workunit.client.1.smithi165.stdout:9/133: mkdir db/de/d2d 0 2024-09-06T14:44:21.278 INFO:tasks.workunit.client.1.smithi165.stdout:9/134: truncate db/f26 1621613 0 2024-09-06T14:44:21.283 INFO:tasks.workunit.client.1.smithi165.stdout:9/135: chown db/de/d15/l2a 6 1 2024-09-06T14:44:21.288 INFO:tasks.workunit.client.1.smithi165.stdout:9/136: dwrite fa [0,4194304] 0 2024-09-06T14:44:21.291 INFO:tasks.workunit.client.1.smithi165.stdout:9/137: mkdir db/de/d16/d2e 0 2024-09-06T14:44:21.293 INFO:tasks.workunit.client.1.smithi165.stdout:9/138: write db/f26 [790113,76690] 0 2024-09-06T14:44:21.416 INFO:tasks.workunit.client.1.smithi165.stdout:7/8: rename f1 to f2 0 2024-09-06T14:44:21.424 INFO:tasks.workunit.client.1.smithi165.stdout:0/114: sync 2024-09-06T14:44:21.424 INFO:tasks.workunit.client.1.smithi165.stdout:4/59: sync 2024-09-06T14:44:21.431 INFO:tasks.workunit.client.1.smithi165.stdout:0/115: dwrite d15/f16 [0,4194304] 0 2024-09-06T14:44:21.434 INFO:tasks.workunit.client.1.smithi165.stdout:0/116: creat d15/f23 x:0 0 0 2024-09-06T14:44:21.436 INFO:tasks.workunit.client.1.smithi165.stdout:0/117: mknod d15/d19/c24 0 2024-09-06T14:44:21.437 INFO:tasks.workunit.client.1.smithi165.stdout:0/118: write d15/f23 [641896,9260] 0 2024-09-06T14:44:21.437 INFO:tasks.workunit.client.1.smithi165.stdout:0/119: chown d15/f23 45 1 2024-09-06T14:44:21.447 INFO:tasks.workunit.client.1.smithi165.stdout:0/120: link f3 d15/d19/f25 0 2024-09-06T14:44:21.450 INFO:tasks.workunit.client.1.smithi165.stdout:0/121: rename ca to d15/c26 0 2024-09-06T14:44:21.451 INFO:tasks.workunit.client.1.smithi165.stdout:0/122: stat d15/l1a 0 2024-09-06T14:44:21.451 INFO:tasks.workunit.client.1.smithi165.stdout:0/123: read d15/d19/f21 [2672397,9682] 0 2024-09-06T14:44:21.461 INFO:tasks.workunit.client.1.smithi165.stdout:0/124: dwrite f10 [0,4194304] 0 2024-09-06T14:44:21.461 INFO:tasks.workunit.client.1.smithi165.stdout:0/125: chown d15/d19 229086090 1 2024-09-06T14:44:21.461 INFO:tasks.workunit.client.1.smithi165.stdout:0/126: chown le 328 1 2024-09-06T14:44:21.463 INFO:tasks.workunit.client.1.smithi165.stdout:6/16: fsync f1 0 2024-09-06T14:44:21.465 INFO:tasks.workunit.client.1.smithi165.stdout:0/127: creat d15/d19/f27 x:0 0 0 2024-09-06T14:44:21.470 INFO:tasks.workunit.client.1.smithi165.stdout:6/17: creat f3 x:0 0 0 2024-09-06T14:44:21.470 INFO:tasks.workunit.client.1.smithi165.stdout:0/128: mkdir d15/d19/d28 0 2024-09-06T14:44:21.472 INFO:tasks.workunit.client.1.smithi165.stdout:0/129: mknod d15/c29 0 2024-09-06T14:44:21.476 INFO:tasks.workunit.client.1.smithi165.stdout:5/75: truncate d6/f11 875495 0 2024-09-06T14:44:21.477 INFO:tasks.workunit.client.1.smithi165.stdout:0/130: dread d15/d19/f25 [0,4194304] 0 2024-09-06T14:44:21.478 INFO:tasks.workunit.client.1.smithi165.stdout:5/76: creat d6/f1b x:0 0 0 2024-09-06T14:44:21.480 INFO:tasks.workunit.client.1.smithi165.stdout:5/77: mkdir d6/d1c 0 2024-09-06T14:44:21.482 INFO:tasks.workunit.client.1.smithi165.stdout:5/78: creat d6/f1d x:0 0 0 2024-09-06T14:44:21.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/79: link d6/f13 d6/d1c/f1e 0 2024-09-06T14:44:21.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/80: truncate d6/f17 892733 0 2024-09-06T14:44:21.488 INFO:tasks.workunit.client.1.smithi165.stdout:5/81: link d6/f1d d6/d1c/f1f 0 2024-09-06T14:44:21.488 INFO:tasks.workunit.client.1.smithi165.stdout:5/82: read - d6/f1a zero size 2024-09-06T14:44:21.500 INFO:tasks.workunit.client.1.smithi165.stdout:1/86: dwrite d0/d3/f16 [0,4194304] 0 2024-09-06T14:44:21.501 INFO:tasks.workunit.client.1.smithi165.stdout:8/65: write d0/d2/fb [713970,90083] 0 2024-09-06T14:44:21.502 INFO:tasks.workunit.client.1.smithi165.stdout:1/87: truncate d0/f14 786214 0 2024-09-06T14:44:21.504 INFO:tasks.workunit.client.1.smithi165.stdout:8/66: symlink d0/d2/l15 0 2024-09-06T14:44:21.506 INFO:tasks.workunit.client.1.smithi165.stdout:1/88: creat d0/f20 x:0 0 0 2024-09-06T14:44:21.507 INFO:tasks.workunit.client.1.smithi165.stdout:1/89: chown d0/d3 0 1 2024-09-06T14:44:21.507 INFO:tasks.workunit.client.1.smithi165.stdout:1/90: chown d0/d1c/d1d 51962 1 2024-09-06T14:44:21.508 INFO:tasks.workunit.client.1.smithi165.stdout:8/67: link d0/f6 d0/f16 0 2024-09-06T14:44:21.511 INFO:tasks.workunit.client.1.smithi165.stdout:1/91: write d0/d3/f5 [4065916,43474] 0 2024-09-06T14:44:21.512 INFO:tasks.workunit.client.1.smithi165.stdout:8/68: creat d0/f17 x:0 0 0 2024-09-06T14:44:21.513 INFO:tasks.workunit.client.1.smithi165.stdout:1/92: symlink d0/d3/l21 0 2024-09-06T14:44:21.514 INFO:tasks.workunit.client.1.smithi165.stdout:1/93: readlink d0/d3/l13 0 2024-09-06T14:44:21.514 INFO:tasks.workunit.client.1.smithi165.stdout:8/69: truncate d0/d2/fa 2325311 0 2024-09-06T14:44:21.515 INFO:tasks.workunit.client.1.smithi165.stdout:1/94: fdatasync d0/f14 0 2024-09-06T14:44:21.515 INFO:tasks.workunit.client.1.smithi165.stdout:1/95: read - d0/f20 zero size 2024-09-06T14:44:21.517 INFO:tasks.workunit.client.1.smithi165.stdout:8/70: creat d0/d2/f18 x:0 0 0 2024-09-06T14:44:21.517 INFO:tasks.workunit.client.1.smithi165.stdout:8/71: chown d0/d2/fe 0 1 2024-09-06T14:44:21.517 INFO:tasks.workunit.client.1.smithi165.stdout:8/72: readlink d0/d2/l10 0 2024-09-06T14:44:21.518 INFO:tasks.workunit.client.1.smithi165.stdout:8/73: stat d0/d2/fe 0 2024-09-06T14:44:21.520 INFO:tasks.workunit.client.1.smithi165.stdout:1/96: mkdir d0/d1c/d1d/d22 0 2024-09-06T14:44:21.521 INFO:tasks.workunit.client.1.smithi165.stdout:8/74: mkdir d0/d19 0 2024-09-06T14:44:21.522 INFO:tasks.workunit.client.1.smithi165.stdout:1/97: fdatasync d0/f10 0 2024-09-06T14:44:21.523 INFO:tasks.workunit.client.1.smithi165.stdout:1/98: write d0/d3/f5 [1657396,56321] 0 2024-09-06T14:44:21.524 INFO:tasks.workunit.client.1.smithi165.stdout:1/99: read d0/f14 [334931,38623] 0 2024-09-06T14:44:21.528 INFO:tasks.workunit.client.1.smithi165.stdout:1/100: fdatasync d0/d3/fe 0 2024-09-06T14:44:21.529 INFO:tasks.workunit.client.1.smithi165.stdout:1/101: write d0/f14 [360391,29558] 0 2024-09-06T14:44:21.530 INFO:tasks.workunit.client.1.smithi165.stdout:8/75: dwrite d0/f16 [0,4194304] 0 2024-09-06T14:44:21.531 INFO:tasks.workunit.client.1.smithi165.stdout:8/76: chown d0/d2/f7 3 1 2024-09-06T14:44:21.533 INFO:tasks.workunit.client.1.smithi165.stdout:1/102: mkdir d0/d3/d23 0 2024-09-06T14:44:21.547 INFO:tasks.workunit.client.1.smithi165.stdout:7/9: fsync f2 0 2024-09-06T14:44:21.547 INFO:tasks.workunit.client.1.smithi165.stdout:7/10: dread - f2 zero size 2024-09-06T14:44:21.548 INFO:tasks.workunit.client.1.smithi165.stdout:7/11: dread - f2 zero size 2024-09-06T14:44:21.550 INFO:tasks.workunit.client.1.smithi165.stdout:7/12: creat f3 x:0 0 0 2024-09-06T14:44:21.552 INFO:tasks.workunit.client.1.smithi165.stdout:7/13: symlink l4 0 2024-09-06T14:44:21.553 INFO:tasks.workunit.client.1.smithi165.stdout:7/14: fdatasync f3 0 2024-09-06T14:44:21.553 INFO:tasks.workunit.client.1.smithi165.stdout:7/15: chown f2 19 1 2024-09-06T14:44:21.554 INFO:tasks.workunit.client.1.smithi165.stdout:7/16: write f2 [941440,90372] 0 2024-09-06T14:44:21.556 INFO:tasks.workunit.client.1.smithi165.stdout:2/54: sync 2024-09-06T14:44:21.557 INFO:tasks.workunit.client.1.smithi165.stdout:9/139: sync 2024-09-06T14:44:21.557 INFO:tasks.workunit.client.1.smithi165.stdout:3/54: sync 2024-09-06T14:44:21.557 INFO:tasks.workunit.client.1.smithi165.stdout:7/17: creat f5 x:0 0 0 2024-09-06T14:44:21.557 INFO:tasks.workunit.client.1.smithi165.stdout:9/140: fsync f4 0 2024-09-06T14:44:21.559 INFO:tasks.workunit.client.1.smithi165.stdout:7/18: unlink f2 0 2024-09-06T14:44:21.563 INFO:tasks.workunit.client.1.smithi165.stdout:7/19: rename f5 to f6 0 2024-09-06T14:44:21.564 INFO:tasks.workunit.client.1.smithi165.stdout:9/141: mknod db/de/d2d/c2f 0 2024-09-06T14:44:21.565 INFO:tasks.workunit.client.1.smithi165.stdout:2/55: dwrite d9/f10 [0,4194304] 0 2024-09-06T14:44:21.566 INFO:tasks.workunit.client.1.smithi165.stdout:9/142: write f0 [5183151,58423] 0 2024-09-06T14:44:21.567 INFO:tasks.workunit.client.1.smithi165.stdout:7/20: write f6 [659161,40709] 0 2024-09-06T14:44:21.567 INFO:tasks.workunit.client.1.smithi165.stdout:2/56: write d9/fc [535415,82099] 0 2024-09-06T14:44:21.568 INFO:tasks.workunit.client.1.smithi165.stdout:6/18: truncate f1 59836 0 2024-09-06T14:44:21.570 INFO:tasks.workunit.client.1.smithi165.stdout:9/143: creat db/de/d16/f30 x:0 0 0 2024-09-06T14:44:21.571 INFO:tasks.workunit.client.1.smithi165.stdout:7/21: rename l4 to l7 0 2024-09-06T14:44:21.577 INFO:tasks.workunit.client.1.smithi165.stdout:9/144: creat db/de/d2d/f31 x:0 0 0 2024-09-06T14:44:21.578 INFO:tasks.workunit.client.1.smithi165.stdout:5/83: dread d6/f11 [0,4194304] 0 2024-09-06T14:44:21.581 INFO:tasks.workunit.client.1.smithi165.stdout:9/145: mknod db/de/d15/d17/d18/c32 0 2024-09-06T14:44:21.582 INFO:tasks.workunit.client.1.smithi165.stdout:9/146: write db/de/d2d/f31 [959201,11145] 0 2024-09-06T14:44:21.585 INFO:tasks.workunit.client.1.smithi165.stdout:5/84: creat d6/f20 x:0 0 0 2024-09-06T14:44:21.585 INFO:tasks.workunit.client.1.smithi165.stdout:5/85: stat d6/d1c/f1f 0 2024-09-06T14:44:21.586 INFO:tasks.workunit.client.1.smithi165.stdout:9/147: chown db/de/d15/l2a 184670 1 2024-09-06T14:44:21.586 INFO:tasks.workunit.client.1.smithi165.stdout:9/148: truncate f4 4911983 0 2024-09-06T14:44:21.587 INFO:tasks.workunit.client.1.smithi165.stdout:5/86: creat d6/f21 x:0 0 0 2024-09-06T14:44:21.591 INFO:tasks.workunit.client.1.smithi165.stdout:5/87: creat d6/d1c/f22 x:0 0 0 2024-09-06T14:44:21.592 INFO:tasks.workunit.client.1.smithi165.stdout:9/149: dwrite f4 [0,4194304] 0 2024-09-06T14:44:21.593 INFO:tasks.workunit.client.1.smithi165.stdout:5/88: creat d6/f23 x:0 0 0 2024-09-06T14:44:21.614 INFO:tasks.workunit.client.1.smithi165.stdout:8/77: getdents d0/d2 0 2024-09-06T14:44:21.614 INFO:tasks.workunit.client.1.smithi165.stdout:5/89: chown l0 62 1 2024-09-06T14:44:21.614 INFO:tasks.workunit.client.1.smithi165.stdout:8/78: write d0/f9 [3182154,49337] 0 2024-09-06T14:44:21.615 INFO:tasks.workunit.client.1.smithi165.stdout:2/57: truncate d9/fc 433016 0 2024-09-06T14:44:21.617 INFO:tasks.workunit.client.1.smithi165.stdout:2/58: write f8 [4703292,13265] 0 2024-09-06T14:44:21.618 INFO:tasks.workunit.client.1.smithi165.stdout:2/59: chown d9/f10 502 1 2024-09-06T14:44:21.618 INFO:tasks.workunit.client.1.smithi165.stdout:2/60: chown d9 5523675 1 2024-09-06T14:44:21.619 INFO:tasks.workunit.client.1.smithi165.stdout:2/61: chown d9/ff 6149 1 2024-09-06T14:44:21.621 INFO:tasks.workunit.client.1.smithi165.stdout:8/79: link d0/d2/fe d0/f1a 0 2024-09-06T14:44:21.622 INFO:tasks.workunit.client.1.smithi165.stdout:2/62: creat d9/f12 x:0 0 0 2024-09-06T14:44:21.622 INFO:tasks.workunit.client.1.smithi165.stdout:2/63: truncate d9/ff 4238537 0 2024-09-06T14:44:21.623 INFO:tasks.workunit.client.1.smithi165.stdout:2/64: fdatasync d9/fa 0 2024-09-06T14:44:21.623 INFO:tasks.workunit.client.1.smithi165.stdout:2/65: truncate d9/f12 858337 0 2024-09-06T14:44:21.627 INFO:tasks.workunit.client.1.smithi165.stdout:6/19: write f1 [569216,31048] 0 2024-09-06T14:44:21.631 INFO:tasks.workunit.client.1.smithi165.stdout:6/20: symlink l4 0 2024-09-06T14:44:21.633 INFO:tasks.workunit.client.1.smithi165.stdout:2/66: dwrite d9/f10 [0,4194304] 0 2024-09-06T14:44:21.633 INFO:tasks.workunit.client.1.smithi165.stdout:8/80: dwrite d0/f1a [0,4194304] 0 2024-09-06T14:44:21.634 INFO:tasks.workunit.client.1.smithi165.stdout:6/21: creat f5 x:0 0 0 2024-09-06T14:44:21.634 INFO:tasks.workunit.client.1.smithi165.stdout:6/22: chown c2 83 1 2024-09-06T14:44:21.637 INFO:tasks.workunit.client.1.smithi165.stdout:2/67: creat d9/f13 x:0 0 0 2024-09-06T14:44:21.638 INFO:tasks.workunit.client.1.smithi165.stdout:2/68: write f5 [290843,7841] 0 2024-09-06T14:44:21.639 INFO:tasks.workunit.client.1.smithi165.stdout:6/23: creat f6 x:0 0 0 2024-09-06T14:44:21.641 INFO:tasks.workunit.client.1.smithi165.stdout:8/81: creat d0/d14/f1b x:0 0 0 2024-09-06T14:44:21.642 INFO:tasks.workunit.client.1.smithi165.stdout:8/82: read - d0/f17 zero size 2024-09-06T14:44:21.646 INFO:tasks.workunit.client.1.smithi165.stdout:6/24: creat f7 x:0 0 0 2024-09-06T14:44:21.647 INFO:tasks.workunit.client.1.smithi165.stdout:6/25: truncate f6 343802 0 2024-09-06T14:44:21.647 INFO:tasks.workunit.client.1.smithi165.stdout:6/26: read f6 [256171,41733] 0 2024-09-06T14:44:21.653 INFO:tasks.workunit.client.1.smithi165.stdout:8/83: getdents d0 0 2024-09-06T14:44:21.656 INFO:tasks.workunit.client.1.smithi165.stdout:6/27: dwrite f6 [0,4194304] 0 2024-09-06T14:44:21.658 INFO:tasks.workunit.client.1.smithi165.stdout:2/69: getdents d9 0 2024-09-06T14:44:21.659 INFO:tasks.workunit.client.1.smithi165.stdout:6/28: creat f8 x:0 0 0 2024-09-06T14:44:21.660 INFO:tasks.workunit.client.1.smithi165.stdout:8/84: dread d0/d2/fe [0,4194304] 0 2024-09-06T14:44:21.660 INFO:tasks.workunit.client.1.smithi165.stdout:6/29: fdatasync f7 0 2024-09-06T14:44:21.661 INFO:tasks.workunit.client.1.smithi165.stdout:6/30: truncate f5 589493 0 2024-09-06T14:44:21.661 INFO:tasks.workunit.client.1.smithi165.stdout:2/70: creat d9/f14 x:0 0 0 2024-09-06T14:44:21.661 INFO:tasks.workunit.client.1.smithi165.stdout:6/31: fdatasync f3 0 2024-09-06T14:44:21.666 INFO:tasks.workunit.client.1.smithi165.stdout:6/32: dread f1 [0,4194304] 0 2024-09-06T14:44:21.667 INFO:tasks.workunit.client.1.smithi165.stdout:6/33: chown f7 5 1 2024-09-06T14:44:21.667 INFO:tasks.workunit.client.1.smithi165.stdout:6/34: rmdir - no directory 2024-09-06T14:44:21.669 INFO:tasks.workunit.client.1.smithi165.stdout:6/35: dread f5 [0,4194304] 0 2024-09-06T14:44:21.670 INFO:tasks.workunit.client.1.smithi165.stdout:2/71: dwrite d9/f13 [0,4194304] 0 2024-09-06T14:44:21.671 INFO:tasks.workunit.client.1.smithi165.stdout:2/72: readlink l7 0 2024-09-06T14:44:21.673 INFO:tasks.workunit.client.1.smithi165.stdout:2/73: symlink d9/l15 0 2024-09-06T14:44:21.676 INFO:tasks.workunit.client.1.smithi165.stdout:2/74: unlink f5 0 2024-09-06T14:44:21.678 INFO:tasks.workunit.client.1.smithi165.stdout:6/36: link c2 c9 0 2024-09-06T14:44:21.678 INFO:tasks.workunit.client.1.smithi165.stdout:8/85: dwrite d0/fd [0,4194304] 0 2024-09-06T14:44:21.681 INFO:tasks.workunit.client.1.smithi165.stdout:6/37: dread f5 [0,4194304] 0 2024-09-06T14:44:21.682 INFO:tasks.workunit.client.1.smithi165.stdout:6/38: write f3 [396377,113339] 0 2024-09-06T14:44:21.684 INFO:tasks.workunit.client.1.smithi165.stdout:8/86: rename d0/d2/f13 to d0/f1c 0 2024-09-06T14:44:21.689 INFO:tasks.workunit.client.1.smithi165.stdout:2/75: dwrite d9/f10 [0,4194304] 0 2024-09-06T14:44:21.693 INFO:tasks.workunit.client.1.smithi165.stdout:6/39: dwrite f1 [0,4194304] 0 2024-09-06T14:44:21.698 INFO:tasks.workunit.client.1.smithi165.stdout:6/40: dread f6 [0,4194304] 0 2024-09-06T14:44:21.698 INFO:tasks.workunit.client.1.smithi165.stdout:6/41: readlink l4 0 2024-09-06T14:44:21.707 INFO:tasks.workunit.client.1.smithi165.stdout:8/87: fdatasync d0/d2/f7 0 2024-09-06T14:44:21.757 INFO:tasks.workunit.client.1.smithi165.stdout:8/88: symlink d0/d19/l1d 0 2024-09-06T14:44:21.757 INFO:tasks.workunit.client.1.smithi165.stdout:6/42: dwrite f5 [0,4194304] 0 2024-09-06T14:44:21.758 INFO:tasks.workunit.client.1.smithi165.stdout:8/89: readlink d0/d19/l1d 0 2024-09-06T14:44:21.758 INFO:tasks.workunit.client.1.smithi165.stdout:6/43: dread - f8 zero size 2024-09-06T14:44:21.760 INFO:tasks.workunit.client.1.smithi165.stdout:8/90: mknod d0/d19/c1e 0 2024-09-06T14:44:21.763 INFO:tasks.workunit.client.1.smithi165.stdout:2/76: dwrite d9/ff [0,4194304] 0 2024-09-06T14:44:21.764 INFO:tasks.workunit.client.1.smithi165.stdout:8/91: creat d0/d19/f1f x:0 0 0 2024-09-06T14:44:21.765 INFO:tasks.workunit.client.1.smithi165.stdout:6/44: dread f6 [0,4194304] 0 2024-09-06T14:44:21.766 INFO:tasks.workunit.client.1.smithi165.stdout:2/77: write d9/f12 [1454702,15275] 0 2024-09-06T14:44:21.767 INFO:tasks.workunit.client.1.smithi165.stdout:6/45: write f3 [1212902,64155] 0 2024-09-06T14:44:21.767 INFO:tasks.workunit.client.1.smithi165.stdout:8/92: truncate d0/d2/fb 1789088 0 2024-09-06T14:44:21.768 INFO:tasks.workunit.client.1.smithi165.stdout:8/93: read d0/d2/f7 [3465263,109604] 0 2024-09-06T14:44:21.769 INFO:tasks.workunit.client.1.smithi165.stdout:6/46: creat fa x:0 0 0 2024-09-06T14:44:21.770 INFO:tasks.workunit.client.1.smithi165.stdout:2/78: write d9/f14 [703039,75141] 0 2024-09-06T14:44:21.771 INFO:tasks.workunit.client.1.smithi165.stdout:6/47: write fa [979407,25214] 0 2024-09-06T14:44:21.771 INFO:tasks.workunit.client.1.smithi165.stdout:8/94: symlink d0/d19/l20 0 2024-09-06T14:44:21.773 INFO:tasks.workunit.client.1.smithi165.stdout:2/79: write d9/f13 [291825,56673] 0 2024-09-06T14:44:21.782 INFO:tasks.workunit.client.1.smithi165.stdout:6/48: creat fb x:0 0 0 2024-09-06T14:44:21.782 INFO:tasks.workunit.client.1.smithi165.stdout:2/80: dwrite d9/f13 [4194304,4194304] 0 2024-09-06T14:44:21.785 INFO:tasks.workunit.client.1.smithi165.stdout:8/95: symlink d0/d2/l21 0 2024-09-06T14:44:21.785 INFO:tasks.workunit.client.1.smithi165.stdout:8/96: fsync d0/d2/fe 0 2024-09-06T14:44:21.790 INFO:tasks.workunit.client.1.smithi165.stdout:6/49: rename f1 to fc 0 2024-09-06T14:44:21.792 INFO:tasks.workunit.client.1.smithi165.stdout:2/81: mknod d9/c16 0 2024-09-06T14:44:21.798 INFO:tasks.workunit.client.1.smithi165.stdout:6/50: dwrite f8 [0,4194304] 0 2024-09-06T14:44:21.800 INFO:tasks.workunit.client.1.smithi165.stdout:6/51: write f3 [1408792,113234] 0 2024-09-06T14:44:21.800 INFO:tasks.workunit.client.1.smithi165.stdout:6/52: stat fa 0 2024-09-06T14:44:21.801 INFO:tasks.workunit.client.1.smithi165.stdout:2/82: dread d9/ff [0,4194304] 0 2024-09-06T14:44:21.803 INFO:tasks.workunit.client.1.smithi165.stdout:6/53: unlink l4 0 2024-09-06T14:44:21.807 INFO:tasks.workunit.client.1.smithi165.stdout:6/54: unlink fb 0 2024-09-06T14:44:21.812 INFO:tasks.workunit.client.1.smithi165.stdout:6/55: dwrite f8 [0,4194304] 0 2024-09-06T14:44:21.819 INFO:tasks.workunit.client.1.smithi165.stdout:6/56: dwrite f8 [0,4194304] 0 2024-09-06T14:44:21.822 INFO:tasks.workunit.client.1.smithi165.stdout:6/57: fdatasync f6 0 2024-09-06T14:44:21.822 INFO:tasks.workunit.client.1.smithi165.stdout:6/58: stat f3 0 2024-09-06T14:44:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:21 smithi165 ceph-mon[36229]: pgmap v13: 65 pgs: 65 active+clean; 323 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 21 MiB/s wr, 254 op/s 2024-09-06T14:44:21.825 INFO:tasks.workunit.client.1.smithi165.stdout:6/59: symlink ld 0 2024-09-06T14:44:21.825 INFO:tasks.workunit.client.1.smithi165.stdout:6/60: write fa [1687672,22726] 0 2024-09-06T14:44:21.827 INFO:tasks.workunit.client.1.smithi165.stdout:6/61: mknod ce 0 2024-09-06T14:44:21.859 INFO:tasks.workunit.client.1.smithi165.stdout:6/62: truncate f5 2617346 0 2024-09-06T14:44:21.861 INFO:tasks.workunit.client.1.smithi165.stdout:6/63: creat ff x:0 0 0 2024-09-06T14:44:21.866 INFO:tasks.workunit.client.1.smithi165.stdout:6/64: link ld l10 0 2024-09-06T14:44:21.875 INFO:tasks.workunit.client.1.smithi165.stdout:6/65: truncate fa 1551649 0 2024-09-06T14:44:21.881 INFO:tasks.workunit.client.1.smithi165.stdout:6/66: dwrite ff [0,4194304] 0 2024-09-06T14:44:21.881 INFO:tasks.workunit.client.1.smithi165.stdout:6/67: fdatasync f6 0 2024-09-06T14:44:21.884 INFO:tasks.workunit.client.1.smithi165.stdout:6/68: mknod c11 0 2024-09-06T14:44:21.884 INFO:tasks.workunit.client.1.smithi165.stdout:6/69: truncate f7 861273 0 2024-09-06T14:44:21.890 INFO:tasks.workunit.client.1.smithi165.stdout:6/70: dwrite ff [0,4194304] 0 2024-09-06T14:44:21.902 INFO:tasks.workunit.client.1.smithi165.stdout:6/71: write fa [2227265,86491] 0 2024-09-06T14:44:21.903 INFO:tasks.workunit.client.1.smithi165.stdout:6/72: write f6 [2140776,29997] 0 2024-09-06T14:44:21.905 INFO:tasks.workunit.client.1.smithi165.stdout:6/73: unlink ce 0 2024-09-06T14:44:21.905 INFO:tasks.workunit.client.1.smithi165.stdout:6/74: rmdir - no directory 2024-09-06T14:44:21.906 INFO:tasks.workunit.client.1.smithi165.stdout:6/75: chown c11 2343 1 2024-09-06T14:44:21.920 INFO:tasks.workunit.client.1.smithi165.stdout:6/76: dwrite f5 [0,4194304] 0 2024-09-06T14:44:21.924 INFO:tasks.workunit.client.1.smithi165.stdout:6/77: getdents . 0 2024-09-06T14:44:21.924 INFO:tasks.workunit.client.1.smithi165.stdout:6/78: write f5 [5070871,44790] 0 2024-09-06T14:44:22.005 INFO:tasks.workunit.client.1.smithi165.stdout:1/103: sync 2024-09-06T14:44:22.005 INFO:tasks.workunit.client.1.smithi165.stdout:0/131: sync 2024-09-06T14:44:22.005 INFO:tasks.workunit.client.1.smithi165.stdout:9/150: sync 2024-09-06T14:44:22.005 INFO:tasks.workunit.client.1.smithi165.stdout:7/22: sync 2024-09-06T14:44:22.005 INFO:tasks.workunit.client.1.smithi165.stdout:3/55: sync 2024-09-06T14:44:22.006 INFO:tasks.workunit.client.1.smithi165.stdout:4/60: sync 2024-09-06T14:44:22.007 INFO:tasks.workunit.client.1.smithi165.stdout:9/151: write db/de/f10 [1465254,118008] 0 2024-09-06T14:44:22.009 INFO:tasks.workunit.client.1.smithi165.stdout:3/56: symlink d1/da/dd/l12 0 2024-09-06T14:44:22.010 INFO:tasks.workunit.client.1.smithi165.stdout:0/132: rename d15/c29 to d15/d19/d28/c2a 0 2024-09-06T14:44:22.010 INFO:tasks.workunit.client.1.smithi165.stdout:7/23: dread f6 [0,4194304] 0 2024-09-06T14:44:22.011 INFO:tasks.workunit.client.1.smithi165.stdout:9/152: write db/de/d16/f30 [927426,71185] 0 2024-09-06T14:44:22.014 INFO:tasks.workunit.client.1.smithi165.stdout:7/24: creat f8 x:0 0 0 2024-09-06T14:44:22.014 INFO:tasks.workunit.client.1.smithi165.stdout:3/57: mknod d1/da/dc/c13 0 2024-09-06T14:44:22.014 INFO:tasks.workunit.client.1.smithi165.stdout:0/133: symlink d15/d19/l2b 0 2024-09-06T14:44:22.015 INFO:tasks.workunit.client.1.smithi165.stdout:9/153: mkdir db/d22/d33 0 2024-09-06T14:44:22.017 INFO:tasks.workunit.client.1.smithi165.stdout:9/154: stat db/de/d15 0 2024-09-06T14:44:22.017 INFO:tasks.workunit.client.1.smithi165.stdout:4/61: dwrite d5/fa [0,4194304] 0 2024-09-06T14:44:22.018 INFO:tasks.workunit.client.1.smithi165.stdout:7/25: symlink l9 0 2024-09-06T14:44:22.018 INFO:tasks.workunit.client.1.smithi165.stdout:4/62: truncate d5/fc 1284052 0 2024-09-06T14:44:22.018 INFO:tasks.workunit.client.1.smithi165.stdout:4/63: readlink l4 0 2024-09-06T14:44:22.019 INFO:tasks.workunit.client.1.smithi165.stdout:0/134: mkdir d15/d19/d2c 0 2024-09-06T14:44:22.020 INFO:tasks.workunit.client.1.smithi165.stdout:7/26: dread f6 [0,4194304] 0 2024-09-06T14:44:22.021 INFO:tasks.workunit.client.1.smithi165.stdout:3/58: mkdir d1/da/dd/d14 0 2024-09-06T14:44:22.023 INFO:tasks.workunit.client.1.smithi165.stdout:9/155: unlink f0 0 2024-09-06T14:44:22.025 INFO:tasks.workunit.client.1.smithi165.stdout:4/64: rename d5/lf to d5/l12 0 2024-09-06T14:44:22.028 INFO:tasks.workunit.client.1.smithi165.stdout:7/27: creat fa x:0 0 0 2024-09-06T14:44:22.028 INFO:tasks.workunit.client.1.smithi165.stdout:3/59: dwrite d1/f11 [0,4194304] 0 2024-09-06T14:44:22.034 INFO:tasks.workunit.client.1.smithi165.stdout:0/135: mknod d15/d19/d2c/c2d 0 2024-09-06T14:44:22.036 INFO:tasks.workunit.client.1.smithi165.stdout:3/60: creat d1/da/dd/f15 x:0 0 0 2024-09-06T14:44:22.041 INFO:tasks.workunit.client.1.smithi165.stdout:9/156: rename l8 to db/de/d15/d17/l34 0 2024-09-06T14:44:22.043 INFO:tasks.workunit.client.1.smithi165.stdout:3/61: symlink d1/da/dc/d10/l16 0 2024-09-06T14:44:22.043 INFO:tasks.workunit.client.1.smithi165.stdout:7/28: dwrite fa [0,4194304] 0 2024-09-06T14:44:22.048 INFO:tasks.workunit.client.1.smithi165.stdout:7/29: chown f3 54 1 2024-09-06T14:44:22.049 INFO:tasks.workunit.client.1.smithi165.stdout:3/62: dread - d1/da/dd/f15 zero size 2024-09-06T14:44:22.050 INFO:tasks.workunit.client.1.smithi165.stdout:4/65: dwrite d5/f8 [0,4194304] 0 2024-09-06T14:44:22.052 INFO:tasks.workunit.client.1.smithi165.stdout:7/30: creat fb x:0 0 0 2024-09-06T14:44:22.052 INFO:tasks.workunit.client.1.smithi165.stdout:0/136: dwrite d15/f23 [0,4194304] 0 2024-09-06T14:44:22.053 INFO:tasks.workunit.client.1.smithi165.stdout:9/157: rmdir db/d22/d33 0 2024-09-06T14:44:22.056 INFO:tasks.workunit.client.1.smithi165.stdout:3/63: fdatasync d1/f2 0 2024-09-06T14:44:22.059 INFO:tasks.workunit.client.1.smithi165.stdout:4/66: rename d5/fa to d5/f13 0 2024-09-06T14:44:22.059 INFO:tasks.workunit.client.1.smithi165.stdout:3/64: chown d1/da/dc/c13 88107 1 2024-09-06T14:44:22.061 INFO:tasks.workunit.client.1.smithi165.stdout:0/137: chown d15/d19/l22 31724594 1 2024-09-06T14:44:22.061 INFO:tasks.workunit.client.1.smithi165.stdout:9/158: unlink db/de/d15/d17/d18/c32 0 2024-09-06T14:44:22.063 INFO:tasks.workunit.client.1.smithi165.stdout:9/159: write db/fd [131210,19500] 0 2024-09-06T14:44:22.067 INFO:tasks.workunit.client.1.smithi165.stdout:9/160: dread db/de/d15/d17/f25 [0,4194304] 0 2024-09-06T14:44:22.067 INFO:tasks.workunit.client.1.smithi165.stdout:3/65: rename d1/da/dd/d14 to d1/da/dc/d10/d17 0 2024-09-06T14:44:22.068 INFO:tasks.workunit.client.1.smithi165.stdout:3/66: stat d1/da/dc 0 2024-09-06T14:44:22.071 INFO:tasks.workunit.client.1.smithi165.stdout:0/138: dread d15/d19/f21 [0,4194304] 0 2024-09-06T14:44:22.071 INFO:tasks.workunit.client.1.smithi165.stdout:9/161: symlink db/l35 0 2024-09-06T14:44:22.071 INFO:tasks.workunit.client.1.smithi165.stdout:0/139: fsync d15/f1f 0 2024-09-06T14:44:22.074 INFO:tasks.workunit.client.1.smithi165.stdout:9/162: symlink db/de/d2d/l36 0 2024-09-06T14:44:22.077 INFO:tasks.workunit.client.1.smithi165.stdout:9/163: mknod db/d22/c37 0 2024-09-06T14:44:22.079 INFO:tasks.workunit.client.1.smithi165.stdout:0/140: dwrite d15/f16 [0,4194304] 0 2024-09-06T14:44:22.083 INFO:tasks.workunit.client.1.smithi165.stdout:9/164: creat db/d22/f38 x:0 0 0 2024-09-06T14:44:22.085 INFO:tasks.workunit.client.1.smithi165.stdout:0/141: rmdir d15/d19/d2c 39 2024-09-06T14:44:22.087 INFO:tasks.workunit.client.1.smithi165.stdout:0/142: truncate d15/d19/f20 605813 0 2024-09-06T14:44:22.088 INFO:tasks.workunit.client.1.smithi165.stdout:0/143: chown fb 8296 1 2024-09-06T14:44:22.090 INFO:tasks.workunit.client.1.smithi165.stdout:9/165: dwrite db/d22/f38 [0,4194304] 0 2024-09-06T14:44:22.092 INFO:tasks.workunit.client.1.smithi165.stdout:0/144: fdatasync fb 0 2024-09-06T14:44:22.100 INFO:tasks.workunit.client.1.smithi165.stdout:9/166: dwrite db/de/d16/f24 [0,4194304] 0 2024-09-06T14:44:22.104 INFO:tasks.workunit.client.1.smithi165.stdout:9/167: symlink db/de/d15/d17/d18/l39 0 2024-09-06T14:44:22.106 INFO:tasks.workunit.client.1.smithi165.stdout:9/168: write db/de/f2c [947377,67981] 0 2024-09-06T14:44:22.113 INFO:tasks.workunit.client.1.smithi165.stdout:9/169: dwrite db/d22/f38 [0,4194304] 0 2024-09-06T14:44:22.122 INFO:tasks.workunit.client.1.smithi165.stdout:1/104: dwrite d0/d1c/d1d/f1e [0,4194304] 0 2024-09-06T14:44:22.122 INFO:tasks.workunit.client.1.smithi165.stdout:4/67: stat d5/l12 0 2024-09-06T14:44:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:21 smithi052 ceph-mon[28627]: pgmap v13: 65 pgs: 65 active+clean; 323 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 21 MiB/s wr, 254 op/s 2024-09-06T14:44:22.123 INFO:tasks.workunit.client.1.smithi165.stdout:9/170: dread f4 [0,4194304] 0 2024-09-06T14:44:22.125 INFO:tasks.workunit.client.1.smithi165.stdout:0/145: rename d15/d19/d2c/c2d to d15/c2e 0 2024-09-06T14:44:22.126 INFO:tasks.workunit.client.1.smithi165.stdout:0/146: fsync d15/f1f 0 2024-09-06T14:44:22.127 INFO:tasks.workunit.client.1.smithi165.stdout:1/105: mkdir d0/d3/d18/d24 0 2024-09-06T14:44:22.130 INFO:tasks.workunit.client.1.smithi165.stdout:1/106: fsync d0/f10 0 2024-09-06T14:44:22.131 INFO:tasks.workunit.client.1.smithi165.stdout:0/147: rename f9 to d15/f2f 0 2024-09-06T14:44:22.132 INFO:tasks.workunit.client.1.smithi165.stdout:1/107: write d0/f20 [722816,111529] 0 2024-09-06T14:44:22.134 INFO:tasks.workunit.client.1.smithi165.stdout:5/90: sync 2024-09-06T14:44:22.136 INFO:tasks.workunit.client.1.smithi165.stdout:9/171: dwrite db/de/d15/d17/f29 [0,4194304] 0 2024-09-06T14:44:22.139 INFO:tasks.workunit.client.1.smithi165.stdout:5/91: rmdir d6 39 2024-09-06T14:44:22.140 INFO:tasks.workunit.client.1.smithi165.stdout:0/148: dread d15/d19/f21 [0,4194304] 0 2024-09-06T14:44:22.142 INFO:tasks.workunit.client.1.smithi165.stdout:7/31: getdents . 0 2024-09-06T14:44:22.142 INFO:tasks.workunit.client.1.smithi165.stdout:9/172: dread db/de/d15/d17/f25 [0,4194304] 0 2024-09-06T14:44:22.143 INFO:tasks.workunit.client.1.smithi165.stdout:7/32: readlink l7 0 2024-09-06T14:44:22.145 INFO:tasks.workunit.client.1.smithi165.stdout:0/149: mknod d15/c30 0 2024-09-06T14:44:22.149 INFO:tasks.workunit.client.1.smithi165.stdout:7/33: write fb [3436,64337] 0 2024-09-06T14:44:22.150 INFO:tasks.workunit.client.1.smithi165.stdout:0/150: symlink d15/l31 0 2024-09-06T14:44:22.153 INFO:tasks.workunit.client.1.smithi165.stdout:9/173: link db/f26 db/f3a 0 2024-09-06T14:44:22.155 INFO:tasks.workunit.client.1.smithi165.stdout:9/174: write db/de/d16/f24 [2704467,31453] 0 2024-09-06T14:44:22.155 INFO:tasks.workunit.client.1.smithi165.stdout:7/34: dwrite fa [0,4194304] 0 2024-09-06T14:44:22.156 INFO:tasks.workunit.client.1.smithi165.stdout:9/175: fsync db/de/d15/d17/f29 0 2024-09-06T14:44:22.157 INFO:tasks.workunit.client.1.smithi165.stdout:0/151: creat d15/f32 x:0 0 0 2024-09-06T14:44:22.164 INFO:tasks.workunit.client.1.smithi165.stdout:7/35: link f6 fc 0 2024-09-06T14:44:22.166 INFO:tasks.workunit.client.1.smithi165.stdout:9/176: link db/de/d15/d17/f29 db/de/d16/d2e/f3b 0 2024-09-06T14:44:22.169 INFO:tasks.workunit.client.1.smithi165.stdout:7/36: dwrite fa [0,4194304] 0 2024-09-06T14:44:22.169 INFO:tasks.workunit.client.1.smithi165.stdout:9/177: creat db/de/d2d/f3c x:0 0 0 2024-09-06T14:44:22.180 INFO:tasks.workunit.client.1.smithi165.stdout:4/68: truncate d5/f13 3719101 0 2024-09-06T14:44:22.185 INFO:tasks.workunit.client.1.smithi165.stdout:8/97: sync 2024-09-06T14:44:22.185 INFO:tasks.workunit.client.1.smithi165.stdout:1/108: write d0/d3/fb [212728,118290] 0 2024-09-06T14:44:22.186 INFO:tasks.workunit.client.1.smithi165.stdout:1/109: readlink d0/d3/l13 0 2024-09-06T14:44:22.188 INFO:tasks.workunit.client.1.smithi165.stdout:0/152: rename d15/c2e to d15/d19/c33 0 2024-09-06T14:44:22.191 INFO:tasks.workunit.client.1.smithi165.stdout:5/92: write d6/d1c/f1f [795127,44102] 0 2024-09-06T14:44:22.193 INFO:tasks.workunit.client.1.smithi165.stdout:0/153: rmdir d15/d19/d28 39 2024-09-06T14:44:22.193 INFO:tasks.workunit.client.1.smithi165.stdout:0/154: dread fb [0,4194304] 0 2024-09-06T14:44:22.194 INFO:tasks.workunit.client.1.smithi165.stdout:1/110: symlink d0/d1c/d1d/d22/l25 0 2024-09-06T14:44:22.195 INFO:tasks.workunit.client.1.smithi165.stdout:5/93: creat d6/f24 x:0 0 0 2024-09-06T14:44:22.196 INFO:tasks.workunit.client.1.smithi165.stdout:5/94: chown d6/f19 3777600 1 2024-09-06T14:44:22.197 INFO:tasks.workunit.client.1.smithi165.stdout:8/98: creat d0/f22 x:0 0 0 2024-09-06T14:44:22.197 INFO:tasks.workunit.client.1.smithi165.stdout:5/95: readlink d6/lc 0 2024-09-06T14:44:22.198 INFO:tasks.workunit.client.1.smithi165.stdout:0/155: rmdir d15/d19 39 2024-09-06T14:44:22.201 INFO:tasks.workunit.client.1.smithi165.stdout:1/111: dwrite d0/f7 [0,4194304] 0 2024-09-06T14:44:22.201 INFO:tasks.workunit.client.1.smithi165.stdout:5/96: symlink d6/l25 0 2024-09-06T14:44:22.202 INFO:tasks.workunit.client.1.smithi165.stdout:5/97: write d6/f24 [847895,69577] 0 2024-09-06T14:44:22.203 INFO:tasks.workunit.client.1.smithi165.stdout:8/99: mkdir d0/d2/d23 0 2024-09-06T14:44:22.205 INFO:tasks.workunit.client.1.smithi165.stdout:5/98: write d6/f24 [1239201,41281] 0 2024-09-06T14:44:22.207 INFO:tasks.workunit.client.1.smithi165.stdout:8/100: readlink d0/l3 0 2024-09-06T14:44:22.207 INFO:tasks.workunit.client.1.smithi165.stdout:1/112: dread d0/d3/fd [8388608,4194304] 0 2024-09-06T14:44:22.209 INFO:tasks.workunit.client.1.smithi165.stdout:7/37: truncate fa 2187442 0 2024-09-06T14:44:22.210 INFO:tasks.workunit.client.1.smithi165.stdout:0/156: write d15/d19/f25 [610167,36993] 0 2024-09-06T14:44:22.211 INFO:tasks.workunit.client.1.smithi165.stdout:9/178: truncate db/de/d16/f30 26845 0 2024-09-06T14:44:22.212 INFO:tasks.workunit.client.1.smithi165.stdout:5/99: creat d6/d1c/f26 x:0 0 0 2024-09-06T14:44:22.213 INFO:tasks.workunit.client.1.smithi165.stdout:4/69: read d5/f13 [2837129,34743] 0 2024-09-06T14:44:22.213 INFO:tasks.workunit.client.1.smithi165.stdout:9/179: read db/f26 [330177,84785] 0 2024-09-06T14:44:22.216 INFO:tasks.workunit.client.1.smithi165.stdout:1/113: symlink d0/d1c/d1d/d22/l26 0 2024-09-06T14:44:22.219 INFO:tasks.workunit.client.1.smithi165.stdout:7/38: dwrite fb [0,4194304] 0 2024-09-06T14:44:22.219 INFO:tasks.workunit.client.1.smithi165.stdout:7/39: rmdir - no directory 2024-09-06T14:44:22.224 INFO:tasks.workunit.client.1.smithi165.stdout:4/70: creat d5/f14 x:0 0 0 2024-09-06T14:44:22.226 INFO:tasks.workunit.client.1.smithi165.stdout:8/101: dread d0/f6 [0,4194304] 0 2024-09-06T14:44:22.226 INFO:tasks.workunit.client.1.smithi165.stdout:4/71: chown d5/f8 495511 1 2024-09-06T14:44:22.227 INFO:tasks.workunit.client.1.smithi165.stdout:0/157: symlink d15/d19/l34 0 2024-09-06T14:44:22.228 INFO:tasks.workunit.client.1.smithi165.stdout:5/100: dwrite d6/f16 [0,4194304] 0 2024-09-06T14:44:22.232 INFO:tasks.workunit.client.1.smithi165.stdout:1/114: dwrite d0/f14 [0,4194304] 0 2024-09-06T14:44:22.232 INFO:tasks.workunit.client.1.smithi165.stdout:9/180: creat db/de/d16/d2e/f3d x:0 0 0 2024-09-06T14:44:22.233 INFO:tasks.workunit.client.1.smithi165.stdout:9/181: truncate fa 4196952 0 2024-09-06T14:44:22.236 INFO:tasks.workunit.client.1.smithi165.stdout:5/101: rmdir d6/d1c 39 2024-09-06T14:44:22.237 INFO:tasks.workunit.client.1.smithi165.stdout:5/102: stat d6/lc 0 2024-09-06T14:44:22.239 INFO:tasks.workunit.client.1.smithi165.stdout:0/158: dwrite f10 [0,4194304] 0 2024-09-06T14:44:22.240 INFO:tasks.workunit.client.1.smithi165.stdout:8/102: fdatasync d0/f1c 0 2024-09-06T14:44:22.242 INFO:tasks.workunit.client.1.smithi165.stdout:1/115: unlink d0/d3/l21 0 2024-09-06T14:44:22.246 INFO:tasks.workunit.client.1.smithi165.stdout:0/159: dread f10 [0,4194304] 0 2024-09-06T14:44:22.250 INFO:tasks.workunit.client.1.smithi165.stdout:1/116: mknod d0/d1c/c27 0 2024-09-06T14:44:22.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/40: write f6 [1436088,99682] 0 2024-09-06T14:44:22.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/41: stat f6 0 2024-09-06T14:44:22.252 INFO:tasks.workunit.client.1.smithi165.stdout:8/103: mkdir d0/d19/d24 0 2024-09-06T14:44:22.253 INFO:tasks.workunit.client.1.smithi165.stdout:8/104: truncate d0/d19/f1f 555297 0 2024-09-06T14:44:22.254 INFO:tasks.workunit.client.1.smithi165.stdout:1/117: creat d0/d3/d1b/f28 x:0 0 0 2024-09-06T14:44:22.255 INFO:tasks.workunit.client.1.smithi165.stdout:8/105: read d0/d2/fb [53531,81926] 0 2024-09-06T14:44:22.256 INFO:tasks.workunit.client.1.smithi165.stdout:7/42: dread fb [0,4194304] 0 2024-09-06T14:44:22.259 INFO:tasks.workunit.client.1.smithi165.stdout:9/182: write db/de/d15/d17/d18/f1d [100815,29991] 0 2024-09-06T14:44:22.260 INFO:tasks.workunit.client.1.smithi165.stdout:8/106: rmdir d0 39 2024-09-06T14:44:22.260 INFO:tasks.workunit.client.1.smithi165.stdout:4/72: truncate d5/fc 301362 0 2024-09-06T14:44:22.261 INFO:tasks.workunit.client.1.smithi165.stdout:7/43: symlink ld 0 2024-09-06T14:44:22.262 INFO:tasks.workunit.client.1.smithi165.stdout:1/118: mknod d0/c29 0 2024-09-06T14:44:22.262 INFO:tasks.workunit.client.1.smithi165.stdout:1/119: fsync d0/f14 0 2024-09-06T14:44:22.266 INFO:tasks.workunit.client.1.smithi165.stdout:4/73: creat d5/f15 x:0 0 0 2024-09-06T14:44:22.270 INFO:tasks.workunit.client.1.smithi165.stdout:0/160: link d15/c26 d15/d19/d28/c35 0 2024-09-06T14:44:22.271 INFO:tasks.workunit.client.1.smithi165.stdout:1/120: dwrite d0/d3/fb [0,4194304] 0 2024-09-06T14:44:22.271 INFO:tasks.workunit.client.1.smithi165.stdout:0/161: stat d15/d19/f25 0 2024-09-06T14:44:22.272 INFO:tasks.workunit.client.1.smithi165.stdout:0/162: chown d15/c30 1696069 1 2024-09-06T14:44:22.279 INFO:tasks.workunit.client.1.smithi165.stdout:4/74: dread f2 [0,4194304] 0 2024-09-06T14:44:22.279 INFO:tasks.workunit.client.1.smithi165.stdout:1/121: dwrite d0/d3/f16 [0,4194304] 0 2024-09-06T14:44:22.281 INFO:tasks.workunit.client.1.smithi165.stdout:8/107: creat d0/d14/f25 x:0 0 0 2024-09-06T14:44:22.285 INFO:tasks.workunit.client.1.smithi165.stdout:9/183: link db/de/d2d/f3c db/de/d15/d17/f3e 0 2024-09-06T14:44:22.286 INFO:tasks.workunit.client.1.smithi165.stdout:9/184: write db/de/d15/d17/f19 [3490980,107865] 0 2024-09-06T14:44:22.287 INFO:tasks.workunit.client.1.smithi165.stdout:0/163: creat d15/d19/d2c/f36 x:0 0 0 2024-09-06T14:44:22.288 INFO:tasks.workunit.client.1.smithi165.stdout:9/185: truncate db/de/d16/d2e/f3b 4667080 0 2024-09-06T14:44:22.288 INFO:tasks.workunit.client.1.smithi165.stdout:4/75: symlink d5/l16 0 2024-09-06T14:44:22.290 INFO:tasks.workunit.client.1.smithi165.stdout:1/122: unlink d0/d3/d1b/f28 0 2024-09-06T14:44:22.293 INFO:tasks.workunit.client.1.smithi165.stdout:9/186: read db/de/d15/f1a [420461,106681] 0 2024-09-06T14:44:22.294 INFO:tasks.workunit.client.1.smithi165.stdout:9/187: fdatasync db/fd 0 2024-09-06T14:44:22.296 INFO:tasks.workunit.client.1.smithi165.stdout:1/123: write d0/d3/fd [9891195,54003] 0 2024-09-06T14:44:22.297 INFO:tasks.workunit.client.1.smithi165.stdout:0/164: creat d15/f37 x:0 0 0 2024-09-06T14:44:22.297 INFO:tasks.workunit.client.1.smithi165.stdout:8/108: dwrite d0/f9 [0,4194304] 0 2024-09-06T14:44:22.299 INFO:tasks.workunit.client.1.smithi165.stdout:1/124: unlink d0/f20 0 2024-09-06T14:44:22.306 INFO:tasks.workunit.client.1.smithi165.stdout:9/188: creat db/de/f3f x:0 0 0 2024-09-06T14:44:22.307 INFO:tasks.workunit.client.1.smithi165.stdout:0/165: mkdir d15/d19/d38 0 2024-09-06T14:44:22.308 INFO:tasks.workunit.client.1.smithi165.stdout:8/109: mkdir d0/d19/d24/d26 0 2024-09-06T14:44:22.310 INFO:tasks.workunit.client.1.smithi165.stdout:9/189: mkdir db/d40 0 2024-09-06T14:44:22.314 INFO:tasks.workunit.client.1.smithi165.stdout:8/110: dread d0/fd [0,4194304] 0 2024-09-06T14:44:22.315 INFO:tasks.workunit.client.1.smithi165.stdout:9/190: unlink db/de/d15/d17/d18/f1d 0 2024-09-06T14:44:22.315 INFO:tasks.workunit.client.1.smithi165.stdout:9/191: stat db/de/f10 0 2024-09-06T14:44:22.317 INFO:tasks.workunit.client.1.smithi165.stdout:4/76: dread d5/fc [0,4194304] 0 2024-09-06T14:44:22.322 INFO:tasks.workunit.client.1.smithi165.stdout:9/192: truncate db/de/d16/f30 1011142 0 2024-09-06T14:44:22.323 INFO:tasks.workunit.client.1.smithi165.stdout:8/111: dwrite d0/fd [0,4194304] 0 2024-09-06T14:44:22.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/193: mknod db/de/d2d/c41 0 2024-09-06T14:44:22.330 INFO:tasks.workunit.client.1.smithi165.stdout:8/112: symlink d0/l27 0 2024-09-06T14:44:22.330 INFO:tasks.workunit.client.1.smithi165.stdout:8/113: fsync d0/f22 0 2024-09-06T14:44:22.330 INFO:tasks.workunit.client.1.smithi165.stdout:9/194: mknod db/de/d2d/c42 0 2024-09-06T14:44:22.333 INFO:tasks.workunit.client.1.smithi165.stdout:4/77: write d5/fc [747925,4929] 0 2024-09-06T14:44:22.337 INFO:tasks.workunit.client.1.smithi165.stdout:8/114: dread d0/f16 [0,4194304] 0 2024-09-06T14:44:22.337 INFO:tasks.workunit.client.1.smithi165.stdout:4/78: symlink d5/l17 0 2024-09-06T14:44:22.337 INFO:tasks.workunit.client.1.smithi165.stdout:8/115: fsync d0/f9 0 2024-09-06T14:44:22.338 INFO:tasks.workunit.client.1.smithi165.stdout:8/116: truncate d0/d14/f1b 87479 0 2024-09-06T14:44:22.338 INFO:tasks.workunit.client.1.smithi165.stdout:8/117: chown d0/d19/d24 3677 1 2024-09-06T14:44:22.338 INFO:tasks.workunit.client.1.smithi165.stdout:9/195: getdents db/de/d15/d17/d18 0 2024-09-06T14:44:22.338 INFO:tasks.workunit.client.1.smithi165.stdout:6/79: sync 2024-09-06T14:44:22.338 INFO:tasks.workunit.client.1.smithi165.stdout:2/83: sync 2024-09-06T14:44:22.338 INFO:tasks.workunit.client.1.smithi165.stdout:3/67: sync 2024-09-06T14:44:22.339 INFO:tasks.workunit.client.1.smithi165.stdout:9/196: stat db/de/d15 0 2024-09-06T14:44:22.339 INFO:tasks.workunit.client.1.smithi165.stdout:6/80: fsync f5 0 2024-09-06T14:44:22.339 INFO:tasks.workunit.client.1.smithi165.stdout:8/118: dread d0/d14/f1b [0,4194304] 0 2024-09-06T14:44:22.340 INFO:tasks.workunit.client.1.smithi165.stdout:8/119: chown d0/d2/l15 245440 1 2024-09-06T14:44:22.341 INFO:tasks.workunit.client.1.smithi165.stdout:6/81: read fa [376717,82598] 0 2024-09-06T14:44:22.341 INFO:tasks.workunit.client.1.smithi165.stdout:6/82: fsync f3 0 2024-09-06T14:44:22.342 INFO:tasks.workunit.client.1.smithi165.stdout:2/84: rmdir d9 39 2024-09-06T14:44:22.345 INFO:tasks.workunit.client.1.smithi165.stdout:3/68: symlink d1/da/dd/l18 0 2024-09-06T14:44:22.348 INFO:tasks.workunit.client.1.smithi165.stdout:8/120: truncate d0/f1c 5927748 0 2024-09-06T14:44:22.349 INFO:tasks.workunit.client.1.smithi165.stdout:6/83: symlink l12 0 2024-09-06T14:44:22.349 INFO:tasks.workunit.client.1.smithi165.stdout:6/84: fdatasync f5 0 2024-09-06T14:44:22.352 INFO:tasks.workunit.client.1.smithi165.stdout:3/69: truncate d1/f2 2637872 0 2024-09-06T14:44:22.355 INFO:tasks.workunit.client.1.smithi165.stdout:8/121: mkdir d0/d2/d28 0 2024-09-06T14:44:22.358 INFO:tasks.workunit.client.1.smithi165.stdout:2/85: write d9/fa [915257,114393] 0 2024-09-06T14:44:22.362 INFO:tasks.workunit.client.1.smithi165.stdout:2/86: rmdir d9 39 2024-09-06T14:44:22.365 INFO:tasks.workunit.client.1.smithi165.stdout:6/85: link l12 l13 0 2024-09-06T14:44:22.365 INFO:tasks.workunit.client.1.smithi165.stdout:8/122: creat d0/d19/d24/d26/f29 x:0 0 0 2024-09-06T14:44:22.367 INFO:tasks.workunit.client.1.smithi165.stdout:9/197: dwrite db/de/d15/d17/f29 [0,4194304] 0 2024-09-06T14:44:22.367 INFO:tasks.workunit.client.1.smithi165.stdout:6/86: mknod c14 0 2024-09-06T14:44:22.368 INFO:tasks.workunit.client.1.smithi165.stdout:9/198: truncate fa 4851776 0 2024-09-06T14:44:22.370 INFO:tasks.workunit.client.1.smithi165.stdout:2/87: creat d9/f17 x:0 0 0 2024-09-06T14:44:22.371 INFO:tasks.workunit.client.1.smithi165.stdout:9/199: creat db/de/d16/f43 x:0 0 0 2024-09-06T14:44:22.371 INFO:tasks.workunit.client.1.smithi165.stdout:9/200: chown db/de/d15/d17/c1b 1041661 1 2024-09-06T14:44:22.372 INFO:tasks.workunit.client.1.smithi165.stdout:9/201: dread - db/de/d16/f43 zero size 2024-09-06T14:44:22.374 INFO:tasks.workunit.client.1.smithi165.stdout:2/88: dread f8 [0,4194304] 0 2024-09-06T14:44:22.377 INFO:tasks.workunit.client.1.smithi165.stdout:9/202: creat db/de/d15/f44 x:0 0 0 2024-09-06T14:44:22.378 INFO:tasks.workunit.client.1.smithi165.stdout:6/87: truncate fa 2031630 0 2024-09-06T14:44:22.380 INFO:tasks.workunit.client.1.smithi165.stdout:6/88: read f3 [1125627,72497] 0 2024-09-06T14:44:22.383 INFO:tasks.workunit.client.1.smithi165.stdout:2/89: creat d9/f18 x:0 0 0 2024-09-06T14:44:22.384 INFO:tasks.workunit.client.1.smithi165.stdout:6/89: chown c2 28 1 2024-09-06T14:44:22.384 INFO:tasks.workunit.client.1.smithi165.stdout:9/203: dwrite db/de/d15/f28 [0,4194304] 0 2024-09-06T14:44:22.386 INFO:tasks.workunit.client.1.smithi165.stdout:2/90: chown d9/f10 64820 1 2024-09-06T14:44:22.387 INFO:tasks.workunit.client.1.smithi165.stdout:9/204: rmdir db/de/d15/d17/d18 39 2024-09-06T14:44:22.388 INFO:tasks.workunit.client.1.smithi165.stdout:9/205: chown db/de/d2d/l36 75674784 1 2024-09-06T14:44:22.395 INFO:tasks.workunit.client.1.smithi165.stdout:9/206: creat db/de/d15/d17/f45 x:0 0 0 2024-09-06T14:44:22.395 INFO:tasks.workunit.client.1.smithi165.stdout:2/91: dwrite d9/ff [0,4194304] 0 2024-09-06T14:44:22.395 INFO:tasks.workunit.client.1.smithi165.stdout:9/207: stat db/de/d16 0 2024-09-06T14:44:22.397 INFO:tasks.workunit.client.1.smithi165.stdout:9/208: rmdir db/de/d15 39 2024-09-06T14:44:22.400 INFO:tasks.workunit.client.1.smithi165.stdout:9/209: write f4 [2234174,18199] 0 2024-09-06T14:44:22.402 INFO:tasks.workunit.client.1.smithi165.stdout:2/92: dread d9/f12 [0,4194304] 0 2024-09-06T14:44:22.406 INFO:tasks.workunit.client.1.smithi165.stdout:2/93: link l7 d9/l19 0 2024-09-06T14:44:22.409 INFO:tasks.workunit.client.1.smithi165.stdout:9/210: dwrite db/de/d15/d17/f45 [0,4194304] 0 2024-09-06T14:44:22.409 INFO:tasks.workunit.client.1.smithi165.stdout:2/94: write d9/f14 [14639,87520] 0 2024-09-06T14:44:22.412 INFO:tasks.workunit.client.1.smithi165.stdout:2/95: readlink d9/l15 0 2024-09-06T14:44:22.412 INFO:tasks.workunit.client.1.smithi165.stdout:2/96: readlink l4 0 2024-09-06T14:44:22.412 INFO:tasks.workunit.client.1.smithi165.stdout:2/97: read d9/f12 [1367328,32890] 0 2024-09-06T14:44:22.414 INFO:tasks.workunit.client.1.smithi165.stdout:2/98: creat d9/f1a x:0 0 0 2024-09-06T14:44:22.416 INFO:tasks.workunit.client.1.smithi165.stdout:2/99: creat d9/f1b x:0 0 0 2024-09-06T14:44:22.416 INFO:tasks.workunit.client.1.smithi165.stdout:2/100: dread - d9/f1a zero size 2024-09-06T14:44:22.448 INFO:tasks.workunit.client.1.smithi165.stdout:2/101: fsync d9/f14 0 2024-09-06T14:44:22.450 INFO:tasks.workunit.client.1.smithi165.stdout:2/102: unlink c6 0 2024-09-06T14:44:22.451 INFO:tasks.workunit.client.1.smithi165.stdout:2/103: readlink l7 0 2024-09-06T14:44:22.451 INFO:tasks.workunit.client.1.smithi165.stdout:2/104: stat d9/f14 0 2024-09-06T14:44:22.452 INFO:tasks.workunit.client.1.smithi165.stdout:2/105: stat d9/l19 0 2024-09-06T14:44:22.488 INFO:tasks.workunit.client.1.smithi165.stdout:5/103: sync 2024-09-06T14:44:22.492 INFO:tasks.workunit.client.1.smithi165.stdout:5/104: read - d6/d1c/f22 zero size 2024-09-06T14:44:22.496 INFO:tasks.workunit.client.1.smithi165.stdout:5/105: creat d6/f27 x:0 0 0 2024-09-06T14:44:22.499 INFO:tasks.workunit.client.1.smithi165.stdout:5/106: mkdir d6/d1c/d28 0 2024-09-06T14:44:22.499 INFO:tasks.workunit.client.1.smithi165.stdout:6/90: read fa [751472,69676] 0 2024-09-06T14:44:22.500 INFO:tasks.workunit.client.1.smithi165.stdout:3/70: truncate d1/f2 296934 0 2024-09-06T14:44:22.501 INFO:tasks.workunit.client.1.smithi165.stdout:8/123: dwrite d0/f1c [4194304,4194304] 0 2024-09-06T14:44:22.502 INFO:tasks.workunit.client.1.smithi165.stdout:6/91: write f8 [378787,71962] 0 2024-09-06T14:44:22.503 INFO:tasks.workunit.client.1.smithi165.stdout:8/124: fdatasync d0/f22 0 2024-09-06T14:44:22.504 INFO:tasks.workunit.client.1.smithi165.stdout:3/71: fdatasync d1/da/dd/f15 0 2024-09-06T14:44:22.504 INFO:tasks.workunit.client.1.smithi165.stdout:9/211: getdents db/de/d15/d17 0 2024-09-06T14:44:22.504 INFO:tasks.workunit.client.1.smithi165.stdout:6/92: chown f3 11 1 2024-09-06T14:44:22.505 INFO:tasks.workunit.client.1.smithi165.stdout:3/72: fsync d1/da/dd/fe 0 2024-09-06T14:44:22.506 INFO:tasks.workunit.client.1.smithi165.stdout:8/125: write d0/d19/f1f [848929,72356] 0 2024-09-06T14:44:22.507 INFO:tasks.workunit.client.1.smithi165.stdout:9/212: dread - db/de/f3f zero size 2024-09-06T14:44:22.507 INFO:tasks.workunit.client.1.smithi165.stdout:3/73: chown d1/da/dd 83237 1 2024-09-06T14:44:22.509 INFO:tasks.workunit.client.1.smithi165.stdout:5/107: creat d6/d1c/d28/f29 x:0 0 0 2024-09-06T14:44:22.509 INFO:tasks.workunit.client.1.smithi165.stdout:8/126: rename d0/d19/d24/d26 to d0/d19/d24/d26/d2a 22 2024-09-06T14:44:22.511 INFO:tasks.workunit.client.1.smithi165.stdout:5/108: read - d6/d1c/f1e zero size 2024-09-06T14:44:22.512 INFO:tasks.workunit.client.1.smithi165.stdout:6/93: dread f8 [0,4194304] 0 2024-09-06T14:44:22.514 INFO:tasks.workunit.client.1.smithi165.stdout:5/109: write d6/f16 [498985,25459] 0 2024-09-06T14:44:22.516 INFO:tasks.workunit.client.1.smithi165.stdout:3/74: dwrite d1/f11 [0,4194304] 0 2024-09-06T14:44:22.518 INFO:tasks.workunit.client.1.smithi165.stdout:8/127: rename d0/d2/f18 to d0/d14/f2b 0 2024-09-06T14:44:22.519 INFO:tasks.workunit.client.1.smithi165.stdout:3/75: truncate d1/da/dd/f15 628418 0 2024-09-06T14:44:22.522 INFO:tasks.workunit.client.1.smithi165.stdout:2/106: write d9/fc [53515,127914] 0 2024-09-06T14:44:22.522 INFO:tasks.workunit.client.1.smithi165.stdout:6/94: mknod c15 0 2024-09-06T14:44:22.523 INFO:tasks.workunit.client.1.smithi165.stdout:9/213: link db/de/d15/d17/f29 db/d22/f46 0 2024-09-06T14:44:22.524 INFO:tasks.workunit.client.1.smithi165.stdout:2/107: write d9/ff [3886669,16280] 0 2024-09-06T14:44:22.524 INFO:tasks.workunit.client.1.smithi165.stdout:6/95: read fc [2752408,42577] 0 2024-09-06T14:44:22.526 INFO:tasks.workunit.client.1.smithi165.stdout:9/214: write db/fd [1493471,70078] 0 2024-09-06T14:44:22.528 INFO:tasks.workunit.client.1.smithi165.stdout:3/76: rename d1/da/dc/d10/d17 to d1/d19 0 2024-09-06T14:44:22.530 INFO:tasks.workunit.client.1.smithi165.stdout:6/96: creat f16 x:0 0 0 2024-09-06T14:44:22.534 INFO:tasks.workunit.client.1.smithi165.stdout:9/215: rename db/d22/f38 to db/de/d15/d17/f47 0 2024-09-06T14:44:22.535 INFO:tasks.workunit.client.1.smithi165.stdout:3/77: creat d1/da/dc/d10/f1a x:0 0 0 2024-09-06T14:44:22.537 INFO:tasks.workunit.client.1.smithi165.stdout:6/97: dwrite f6 [4194304,4194304] 0 2024-09-06T14:44:22.542 INFO:tasks.workunit.client.1.smithi165.stdout:2/108: creat d9/f1c x:0 0 0 2024-09-06T14:44:22.544 INFO:tasks.workunit.client.1.smithi165.stdout:5/110: write d6/f19 [962053,126777] 0 2024-09-06T14:44:22.545 INFO:tasks.workunit.client.1.smithi165.stdout:5/111: write d6/f1d [1520409,122690] 0 2024-09-06T14:44:22.547 INFO:tasks.workunit.client.1.smithi165.stdout:8/128: getdents d0 0 2024-09-06T14:44:22.547 INFO:tasks.workunit.client.1.smithi165.stdout:5/112: chown d6/l7 2 1 2024-09-06T14:44:22.547 INFO:tasks.workunit.client.1.smithi165.stdout:9/216: link db/de/f3f db/de/d15/f48 0 2024-09-06T14:44:22.549 INFO:tasks.workunit.client.1.smithi165.stdout:2/109: readlink d9/l19 0 2024-09-06T14:44:22.550 INFO:tasks.workunit.client.1.smithi165.stdout:2/110: write d9/f1a [148230,77040] 0 2024-09-06T14:44:22.553 INFO:tasks.workunit.client.1.smithi165.stdout:8/129: creat d0/d14/f2c x:0 0 0 2024-09-06T14:44:22.554 INFO:tasks.workunit.client.1.smithi165.stdout:5/113: unlink d6/f1b 0 2024-09-06T14:44:22.557 INFO:tasks.workunit.client.1.smithi165.stdout:9/217: mknod db/de/d2d/c49 0 2024-09-06T14:44:22.562 INFO:tasks.workunit.client.1.smithi165.stdout:3/78: write d1/f8 [25473,19350] 0 2024-09-06T14:44:22.563 INFO:tasks.workunit.client.1.smithi165.stdout:3/79: dread - d1/da/dd/fe zero size 2024-09-06T14:44:22.566 INFO:tasks.workunit.client.1.smithi165.stdout:9/218: unlink db/de/d15/d17/l34 0 2024-09-06T14:44:22.568 INFO:tasks.workunit.client.1.smithi165.stdout:2/111: creat d9/f1d x:0 0 0 2024-09-06T14:44:22.568 INFO:tasks.workunit.client.1.smithi165.stdout:9/219: chown db/de/d16/d2e 713790589 1 2024-09-06T14:44:22.569 INFO:tasks.workunit.client.1.smithi165.stdout:5/114: creat d6/f2a x:0 0 0 2024-09-06T14:44:22.570 INFO:tasks.workunit.client.1.smithi165.stdout:6/98: dwrite fa [0,4194304] 0 2024-09-06T14:44:22.570 INFO:tasks.workunit.client.1.smithi165.stdout:2/112: fsync d9/ff 0 2024-09-06T14:44:22.572 INFO:tasks.workunit.client.1.smithi165.stdout:2/113: read - d9/f1d zero size 2024-09-06T14:44:22.576 INFO:tasks.workunit.client.1.smithi165.stdout:7/44: sync 2024-09-06T14:44:22.578 INFO:tasks.workunit.client.1.smithi165.stdout:3/80: dwrite d1/da/dd/fe [0,4194304] 0 2024-09-06T14:44:22.578 INFO:tasks.workunit.client.1.smithi165.stdout:8/130: write d0/d2/fa [2635364,48097] 0 2024-09-06T14:44:22.579 INFO:tasks.workunit.client.1.smithi165.stdout:9/220: unlink db/de/d15/l2a 0 2024-09-06T14:44:22.580 INFO:tasks.workunit.client.1.smithi165.stdout:8/131: fsync d0/d14/f2c 0 2024-09-06T14:44:22.582 INFO:tasks.workunit.client.1.smithi165.stdout:2/114: fsync d9/f11 0 2024-09-06T14:44:22.582 INFO:tasks.workunit.client.1.smithi165.stdout:5/115: link d6/d1c/f26 d6/d1c/d28/f2b 0 2024-09-06T14:44:22.584 INFO:tasks.workunit.client.1.smithi165.stdout:3/81: chown d1/f2 437784402 1 2024-09-06T14:44:22.587 INFO:tasks.workunit.client.1.smithi165.stdout:6/99: dwrite fc [0,4194304] 0 2024-09-06T14:44:22.588 INFO:tasks.workunit.client.1.smithi165.stdout:3/82: creat d1/f1b x:0 0 0 2024-09-06T14:44:22.590 INFO:tasks.workunit.client.1.smithi165.stdout:5/116: creat d6/d1c/d28/f2c x:0 0 0 2024-09-06T14:44:22.591 INFO:tasks.workunit.client.1.smithi165.stdout:3/83: chown d1/da/dd/fe 0 1 2024-09-06T14:44:22.592 INFO:tasks.workunit.client.1.smithi165.stdout:9/221: symlink db/de/d15/d17/l4a 0 2024-09-06T14:44:22.594 INFO:tasks.workunit.client.1.smithi165.stdout:3/84: write d1/f1b [774985,45299] 0 2024-09-06T14:44:22.595 INFO:tasks.workunit.client.1.smithi165.stdout:9/222: dread - db/de/d15/f2b zero size 2024-09-06T14:44:22.595 INFO:tasks.workunit.client.1.smithi165.stdout:8/132: dwrite d0/f16 [0,4194304] 0 2024-09-06T14:44:22.598 INFO:tasks.workunit.client.1.smithi165.stdout:5/117: mkdir d6/d1c/d28/d2d 0 2024-09-06T14:44:22.598 INFO:tasks.workunit.client.1.smithi165.stdout:5/118: chown d6/d1c/d28/d2d 8198 1 2024-09-06T14:44:22.599 INFO:tasks.workunit.client.1.smithi165.stdout:5/119: chown d6/f21 278265332 1 2024-09-06T14:44:22.599 INFO:tasks.workunit.client.1.smithi165.stdout:2/115: link d9/f1d d9/f1e 0 2024-09-06T14:44:22.604 INFO:tasks.workunit.client.1.smithi165.stdout:3/85: creat d1/da/dd/f1c x:0 0 0 2024-09-06T14:44:22.607 INFO:tasks.workunit.client.1.smithi165.stdout:5/120: dwrite d6/d1c/d28/f2c [0,4194304] 0 2024-09-06T14:44:22.608 INFO:tasks.workunit.client.1.smithi165.stdout:7/45: truncate f6 753594 0 2024-09-06T14:44:22.609 INFO:tasks.workunit.client.1.smithi165.stdout:8/133: mkdir d0/d2/d2d 0 2024-09-06T14:44:22.610 INFO:tasks.workunit.client.1.smithi165.stdout:2/116: rmdir d9 39 2024-09-06T14:44:22.613 INFO:tasks.workunit.client.1.smithi165.stdout:9/223: creat db/de/d15/d17/d18/f4b x:0 0 0 2024-09-06T14:44:22.615 INFO:tasks.workunit.client.1.smithi165.stdout:5/121: creat d6/d1c/d28/f2e x:0 0 0 2024-09-06T14:44:22.616 INFO:tasks.workunit.client.1.smithi165.stdout:8/134: creat d0/d2/f2e x:0 0 0 2024-09-06T14:44:22.617 INFO:tasks.workunit.client.1.smithi165.stdout:2/117: stat d9/f1d 0 2024-09-06T14:44:22.617 INFO:tasks.workunit.client.1.smithi165.stdout:4/79: sync 2024-09-06T14:44:22.619 INFO:tasks.workunit.client.1.smithi165.stdout:6/100: getdents . 0 2024-09-06T14:44:22.619 INFO:tasks.workunit.client.1.smithi165.stdout:7/46: chown fc 56732765 1 2024-09-06T14:44:22.620 INFO:tasks.workunit.client.1.smithi165.stdout:5/122: mknod d6/d1c/c2f 0 2024-09-06T14:44:22.620 INFO:tasks.workunit.client.1.smithi165.stdout:1/125: sync 2024-09-06T14:44:22.620 INFO:tasks.workunit.client.1.smithi165.stdout:0/166: sync 2024-09-06T14:44:22.621 INFO:tasks.workunit.client.1.smithi165.stdout:5/123: chown c5 2999 1 2024-09-06T14:44:22.621 INFO:tasks.workunit.client.1.smithi165.stdout:8/135: creat d0/f2f x:0 0 0 2024-09-06T14:44:22.622 INFO:tasks.workunit.client.1.smithi165.stdout:1/126: truncate d0/d3/fe 8891 0 2024-09-06T14:44:22.623 INFO:tasks.workunit.client.1.smithi165.stdout:4/80: rename d5/l9 to d5/l18 0 2024-09-06T14:44:22.627 INFO:tasks.workunit.client.1.smithi165.stdout:0/167: symlink d15/d19/d2c/l39 0 2024-09-06T14:44:22.631 INFO:tasks.workunit.client.1.smithi165.stdout:2/118: mknod d9/c1f 0 2024-09-06T14:44:22.632 INFO:tasks.workunit.client.1.smithi165.stdout:5/124: symlink d6/d1c/d28/l30 0 2024-09-06T14:44:22.634 INFO:tasks.workunit.client.1.smithi165.stdout:0/168: dwrite d15/d19/f1b [0,4194304] 0 2024-09-06T14:44:22.636 INFO:tasks.workunit.client.1.smithi165.stdout:4/81: creat d5/f19 x:0 0 0 2024-09-06T14:44:22.639 INFO:tasks.workunit.client.1.smithi165.stdout:5/125: dread d6/f19 [0,4194304] 0 2024-09-06T14:44:22.640 INFO:tasks.workunit.client.1.smithi165.stdout:6/101: link f6 f17 0 2024-09-06T14:44:22.641 INFO:tasks.workunit.client.1.smithi165.stdout:6/102: chown f8 0 1 2024-09-06T14:44:22.641 INFO:tasks.workunit.client.1.smithi165.stdout:6/103: fdatasync f16 0 2024-09-06T14:44:22.645 INFO:tasks.workunit.client.1.smithi165.stdout:0/169: truncate d15/d19/f21 4555829 0 2024-09-06T14:44:22.650 INFO:tasks.workunit.client.1.smithi165.stdout:6/104: chown ld 1696694 1 2024-09-06T14:44:22.653 INFO:tasks.workunit.client.1.smithi165.stdout:1/127: rename d0/d3 to d0/d2a 0 2024-09-06T14:44:22.654 INFO:tasks.workunit.client.1.smithi165.stdout:8/136: stat d0/f22 0 2024-09-06T14:44:22.658 INFO:tasks.workunit.client.1.smithi165.stdout:6/105: rename c14 to c18 0 2024-09-06T14:44:22.660 INFO:tasks.workunit.client.1.smithi165.stdout:2/119: creat d9/f20 x:0 0 0 2024-09-06T14:44:22.664 INFO:tasks.workunit.client.1.smithi165.stdout:1/128: mkdir d0/d2a/d1b/d2b 0 2024-09-06T14:44:22.668 INFO:tasks.workunit.client.1.smithi165.stdout:8/137: truncate d0/d2/f2e 662095 0 2024-09-06T14:44:22.670 INFO:tasks.workunit.client.1.smithi165.stdout:1/129: dwrite d0/f10 [0,4194304] 0 2024-09-06T14:44:22.671 INFO:tasks.workunit.client.1.smithi165.stdout:1/130: write d0/d2a/f5 [6549058,52629] 0 2024-09-06T14:44:22.673 INFO:tasks.workunit.client.1.smithi165.stdout:4/82: getdents d5 0 2024-09-06T14:44:22.674 INFO:tasks.workunit.client.1.smithi165.stdout:2/120: symlink d9/l21 0 2024-09-06T14:44:22.675 INFO:tasks.workunit.client.1.smithi165.stdout:9/224: truncate db/de/d15/d17/f19 199195 0 2024-09-06T14:44:22.675 INFO:tasks.workunit.client.1.smithi165.stdout:5/126: truncate d6/f8 4115812 0 2024-09-06T14:44:22.675 INFO:tasks.workunit.client.0.smithi052.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-06T14:44:22.676 INFO:tasks.workunit.client.1.smithi165.stdout:2/121: truncate d9/f17 103933 0 2024-09-06T14:44:22.680 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-06T14:44:22.681 INFO:tasks.workunit.client.0.smithi052.stderr:+ make 2024-09-06T14:44:22.681 INFO:tasks.workunit.client.1.smithi165.stdout:0/170: truncate d15/d19/f1b 3633057 0 2024-09-06T14:44:22.682 INFO:tasks.workunit.client.1.smithi165.stdout:8/138: symlink d0/d2/d28/l30 0 2024-09-06T14:44:22.683 INFO:tasks.workunit.client.1.smithi165.stdout:6/106: rename c18 to c19 0 2024-09-06T14:44:22.683 INFO:tasks.workunit.client.1.smithi165.stdout:6/107: chown ld 50688775 1 2024-09-06T14:44:22.686 INFO:tasks.workunit.client.1.smithi165.stdout:5/127: symlink d6/l31 0 2024-09-06T14:44:22.687 INFO:tasks.workunit.client.1.smithi165.stdout:0/171: mkdir d15/d19/d28/d3a 0 2024-09-06T14:44:22.689 INFO:tasks.workunit.client.1.smithi165.stdout:6/108: dread f3 [0,4194304] 0 2024-09-06T14:44:22.689 INFO:tasks.workunit.client.1.smithi165.stdout:8/139: dread - d0/d14/f2b zero size 2024-09-06T14:44:22.689 INFO:tasks.workunit.client.1.smithi165.stdout:2/122: mknod d9/c22 0 2024-09-06T14:44:22.690 INFO:tasks.workunit.client.1.smithi165.stdout:1/131: link d0/d2a/l13 d0/d1c/d1d/d22/l2c 0 2024-09-06T14:44:22.690 INFO:tasks.workunit.client.1.smithi165.stdout:2/123: chown d9/l21 16758506 1 2024-09-06T14:44:22.691 INFO:tasks.workunit.client.1.smithi165.stdout:2/124: chown f8 459972259 1 2024-09-06T14:44:22.696 INFO:tasks.workunit.client.1.smithi165.stdout:0/172: mknod d15/d19/d28/c3b 0 2024-09-06T14:44:22.697 INFO:tasks.workunit.client.1.smithi165.stdout:0/173: chown d15/f1f 12 1 2024-09-06T14:44:22.697 INFO:tasks.workunit.client.1.smithi165.stdout:0/174: chown c7 31388548 1 2024-09-06T14:44:22.700 INFO:tasks.workunit.client.1.smithi165.stdout:4/83: truncate d5/f8 3614824 0 2024-09-06T14:44:22.700 INFO:tasks.workunit.client.1.smithi165.stdout:4/84: chown d5/c6 59 1 2024-09-06T14:44:22.701 INFO:tasks.workunit.client.1.smithi165.stdout:6/109: rename f7 to f1a 0 2024-09-06T14:44:22.701 INFO:tasks.workunit.client.1.smithi165.stdout:4/85: chown d5/f10 782555 1 2024-09-06T14:44:22.701 INFO:tasks.workunit.client.1.smithi165.stdout:8/140: dread d0/fd [0,4194304] 0 2024-09-06T14:44:22.703 INFO:tasks.workunit.client.1.smithi165.stdout:2/125: write d9/f13 [1369006,70022] 0 2024-09-06T14:44:22.706 INFO:tasks.workunit.client.1.smithi165.stdout:9/225: getdents db/de/d15/d17 0 2024-09-06T14:44:22.707 INFO:tasks.workunit.client.1.smithi165.stdout:5/128: mkdir d6/d32 0 2024-09-06T14:44:22.719 INFO:tasks.workunit.client.1.smithi165.stdout:9/226: creat db/de/d15/d17/f4c x:0 0 0 2024-09-06T14:44:22.719 INFO:tasks.workunit.client.1.smithi165.stdout:0/175: getdents d15/d19/d38 0 2024-09-06T14:44:22.722 INFO:tasks.workunit.client.1.smithi165.stdout:6/110: truncate f5 2116773 0 2024-09-06T14:44:22.723 INFO:tasks.workunit.client.1.smithi165.stdout:8/141: symlink d0/l31 0 2024-09-06T14:44:22.724 INFO:tasks.workunit.client.1.smithi165.stdout:2/126: mkdir d9/d23 0 2024-09-06T14:44:22.724 INFO:tasks.workunit.client.1.smithi165.stdout:1/132: link d0/d1c/c27 d0/d2a/d18/d24/c2d 0 2024-09-06T14:44:22.726 INFO:tasks.workunit.client.1.smithi165.stdout:5/129: link d6/f16 d6/d32/f33 0 2024-09-06T14:44:22.726 INFO:tasks.workunit.client.1.smithi165.stdout:9/227: mknod db/de/d16/d2e/c4d 0 2024-09-06T14:44:22.729 INFO:tasks.workunit.client.1.smithi165.stdout:6/111: dwrite f16 [0,4194304] 0 2024-09-06T14:44:22.731 INFO:tasks.workunit.client.1.smithi165.stdout:2/127: write d9/f12 [1312769,54406] 0 2024-09-06T14:44:22.735 INFO:tasks.workunit.client.1.smithi165.stdout:2/128: truncate d9/f11 434417 0 2024-09-06T14:44:22.735 INFO:tasks.workunit.client.1.smithi165.stdout:6/112: dread f8 [0,4194304] 0 2024-09-06T14:44:22.736 INFO:tasks.workunit.client.1.smithi165.stdout:0/176: mknod d15/d19/d38/c3c 0 2024-09-06T14:44:22.736 INFO:tasks.workunit.client.0.smithi052.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-06T14:44:22.736 INFO:tasks.workunit.client.1.smithi165.stdout:1/133: rename d0/d1c/d1d/f1e to d0/d1c/d1d/d22/f2e 0 2024-09-06T14:44:22.737 INFO:tasks.workunit.client.1.smithi165.stdout:1/134: readlink d0/d2a/l19 0 2024-09-06T14:44:22.737 INFO:tasks.workunit.client.1.smithi165.stdout:8/142: symlink d0/d19/l32 0 2024-09-06T14:44:22.738 INFO:tasks.workunit.client.1.smithi165.stdout:1/135: write d0/f10 [2739079,79966] 0 2024-09-06T14:44:22.740 INFO:tasks.workunit.client.1.smithi165.stdout:0/177: mknod d15/d19/d2c/c3d 0 2024-09-06T14:44:22.741 INFO:tasks.workunit.client.1.smithi165.stdout:0/178: dread - d15/d19/d2c/f36 zero size 2024-09-06T14:44:22.742 INFO:tasks.workunit.client.1.smithi165.stdout:2/129: symlink d9/d23/l24 0 2024-09-06T14:44:22.746 INFO:tasks.workunit.client.1.smithi165.stdout:9/228: symlink db/de/d15/d17/d18/l4e 0 2024-09-06T14:44:22.750 INFO:tasks.workunit.client.1.smithi165.stdout:9/229: mknod db/c4f 0 2024-09-06T14:44:22.752 INFO:tasks.workunit.client.1.smithi165.stdout:8/143: mkdir d0/d2/d2d/d33 0 2024-09-06T14:44:22.755 INFO:tasks.workunit.client.1.smithi165.stdout:1/136: write d0/d2a/fb [4884644,120857] 0 2024-09-06T14:44:22.756 INFO:tasks.workunit.client.1.smithi165.stdout:2/130: dwrite d9/f1c [0,4194304] 0 2024-09-06T14:44:22.756 INFO:tasks.workunit.client.1.smithi165.stdout:4/86: dread d5/f8 [0,4194304] 0 2024-09-06T14:44:22.758 INFO:tasks.workunit.client.1.smithi165.stdout:2/131: fsync d9/f20 0 2024-09-06T14:44:22.760 INFO:tasks.workunit.client.1.smithi165.stdout:4/87: chown c3 31994 1 2024-09-06T14:44:22.760 INFO:tasks.workunit.client.1.smithi165.stdout:8/144: mkdir d0/d34 0 2024-09-06T14:44:22.761 INFO:tasks.workunit.client.1.smithi165.stdout:5/130: dwrite d6/d1c/f26 [0,4194304] 0 2024-09-06T14:44:22.764 INFO:tasks.workunit.client.1.smithi165.stdout:0/179: dwrite d15/f2f [8388608,4194304] 0 2024-09-06T14:44:22.767 INFO:tasks.workunit.client.1.smithi165.stdout:4/88: creat d5/f1a x:0 0 0 2024-09-06T14:44:22.769 INFO:tasks.workunit.client.1.smithi165.stdout:2/132: mkdir d9/d25 0 2024-09-06T14:44:22.771 INFO:tasks.workunit.client.1.smithi165.stdout:8/145: creat d0/d2/d23/f35 x:0 0 0 2024-09-06T14:44:22.771 INFO:tasks.workunit.client.1.smithi165.stdout:5/131: truncate d6/d1c/f1e 761036 0 2024-09-06T14:44:22.773 INFO:tasks.workunit.client.1.smithi165.stdout:4/89: fdatasync d5/f10 0 2024-09-06T14:44:22.774 INFO:tasks.workunit.client.1.smithi165.stdout:2/133: mkdir d9/d23/d26 0 2024-09-06T14:44:22.774 INFO:tasks.workunit.client.1.smithi165.stdout:4/90: stat c3 0 2024-09-06T14:44:22.775 INFO:tasks.workunit.client.1.smithi165.stdout:9/230: dwrite db/de/d15/f28 [0,4194304] 0 2024-09-06T14:44:22.775 INFO:tasks.workunit.client.1.smithi165.stdout:1/137: dread d0/d1c/d1d/d22/f2e [0,4194304] 0 2024-09-06T14:44:22.776 INFO:tasks.workunit.client.1.smithi165.stdout:4/91: readlink d5/l17 0 2024-09-06T14:44:22.776 INFO:tasks.workunit.client.1.smithi165.stdout:0/180: getdents d15/d19/d28/d3a 0 2024-09-06T14:44:22.776 INFO:tasks.workunit.client.1.smithi165.stdout:9/231: chown f4 1968538 1 2024-09-06T14:44:22.777 INFO:tasks.workunit.client.1.smithi165.stdout:5/132: creat d6/d32/f34 x:0 0 0 2024-09-06T14:44:22.778 INFO:tasks.workunit.client.1.smithi165.stdout:0/181: read f3 [180016,38191] 0 2024-09-06T14:44:22.778 INFO:tasks.workunit.client.1.smithi165.stdout:5/133: chown d6/f1d 1718669 1 2024-09-06T14:44:22.778 INFO:tasks.workunit.client.1.smithi165.stdout:4/92: mkdir d5/d1b 0 2024-09-06T14:44:22.780 INFO:tasks.workunit.client.1.smithi165.stdout:0/182: chown d15/d19/l2b 0 1 2024-09-06T14:44:22.780 INFO:tasks.workunit.client.1.smithi165.stdout:2/134: symlink d9/d25/l27 0 2024-09-06T14:44:22.780 INFO:tasks.workunit.client.1.smithi165.stdout:9/232: creat db/de/d16/d2e/f50 x:0 0 0 2024-09-06T14:44:22.781 INFO:tasks.workunit.client.1.smithi165.stdout:5/134: write d6/f24 [2322862,97864] 0 2024-09-06T14:44:22.784 INFO:tasks.workunit.client.1.smithi165.stdout:2/135: write d9/f1b [164377,123905] 0 2024-09-06T14:44:22.784 INFO:tasks.workunit.client.1.smithi165.stdout:4/93: unlink d5/f10 0 2024-09-06T14:44:22.786 INFO:tasks.workunit.client.1.smithi165.stdout:0/183: symlink d15/d19/d28/d3a/l3e 0 2024-09-06T14:44:22.787 INFO:tasks.workunit.client.1.smithi165.stdout:9/233: getdents db/d40 0 2024-09-06T14:44:22.788 INFO:tasks.workunit.client.1.smithi165.stdout:1/138: dwrite d0/d2a/f5 [8388608,4194304] 0 2024-09-06T14:44:22.789 INFO:tasks.workunit.client.1.smithi165.stdout:8/146: rename d0/d2 to d0/d19/d36 0 2024-09-06T14:44:22.790 INFO:tasks.workunit.client.1.smithi165.stdout:5/135: rename d6/d1c to d6/d1c/d28/d2d/d35 22 2024-09-06T14:44:22.793 INFO:tasks.workunit.client.1.smithi165.stdout:2/136: creat d9/d23/f28 x:0 0 0 2024-09-06T14:44:22.795 INFO:tasks.workunit.client.1.smithi165.stdout:0/184: mkdir d15/d19/d28/d3a/d3f 0 2024-09-06T14:44:22.797 INFO:tasks.workunit.client.1.smithi165.stdout:8/147: creat d0/d19/d24/f37 x:0 0 0 2024-09-06T14:44:22.798 INFO:tasks.workunit.client.1.smithi165.stdout:5/136: creat d6/d1c/d28/f36 x:0 0 0 2024-09-06T14:44:22.799 INFO:tasks.workunit.client.1.smithi165.stdout:9/234: symlink db/de/d15/l51 0 2024-09-06T14:44:22.799 INFO:tasks.workunit.client.1.smithi165.stdout:0/185: fsync d15/f16 0 2024-09-06T14:44:22.801 INFO:tasks.workunit.client.1.smithi165.stdout:4/94: dwrite d5/fc [0,4194304] 0 2024-09-06T14:44:22.803 INFO:tasks.workunit.client.1.smithi165.stdout:8/148: read d0/f1a [2049837,34177] 0 2024-09-06T14:44:22.805 INFO:tasks.workunit.client.1.smithi165.stdout:0/186: chown d15/d19/d28/c3b 10 1 2024-09-06T14:44:22.812 INFO:tasks.workunit.client.1.smithi165.stdout:1/139: dwrite d0/d2a/d1b/f1f [0,4194304] 0 2024-09-06T14:44:22.812 INFO:tasks.workunit.client.1.smithi165.stdout:9/235: mknod db/de/d2d/c52 0 2024-09-06T14:44:22.812 INFO:tasks.workunit.client.1.smithi165.stdout:2/137: dread d9/f10 [0,4194304] 0 2024-09-06T14:44:22.812 INFO:tasks.workunit.client.1.smithi165.stdout:5/137: creat d6/f37 x:0 0 0 2024-09-06T14:44:22.813 INFO:tasks.workunit.client.1.smithi165.stdout:1/140: readlink d0/d2a/l15 0 2024-09-06T14:44:22.813 INFO:tasks.workunit.client.1.smithi165.stdout:0/187: dread - f8 zero size 2024-09-06T14:44:22.816 INFO:tasks.workunit.client.1.smithi165.stdout:2/138: mkdir d9/d23/d29 0 2024-09-06T14:44:22.817 INFO:tasks.workunit.client.1.smithi165.stdout:0/188: write d15/f1f [308315,35360] 0 2024-09-06T14:44:22.819 INFO:tasks.workunit.client.1.smithi165.stdout:8/149: rename d0/f1c to d0/d19/d36/d2d/f38 0 2024-09-06T14:44:22.820 INFO:tasks.workunit.client.1.smithi165.stdout:1/141: creat d0/d2a/f2f x:0 0 0 2024-09-06T14:44:22.821 INFO:tasks.workunit.client.1.smithi165.stdout:9/236: fsync db/de/d15/d17/f3e 0 2024-09-06T14:44:22.822 INFO:tasks.workunit.client.1.smithi165.stdout:4/95: dwrite d5/f14 [0,4194304] 0 2024-09-06T14:44:22.823 INFO:tasks.workunit.client.1.smithi165.stdout:2/139: unlink d9/f14 0 2024-09-06T14:44:22.826 INFO:tasks.workunit.client.1.smithi165.stdout:5/138: dwrite d6/f37 [0,4194304] 0 2024-09-06T14:44:22.834 INFO:tasks.workunit.client.1.smithi165.stdout:0/189: fsync d15/d19/f21 0 2024-09-06T14:44:22.834 INFO:tasks.workunit.client.1.smithi165.stdout:0/190: fdatasync d15/d19/d2c/f36 0 2024-09-06T14:44:22.838 INFO:tasks.workunit.client.1.smithi165.stdout:8/150: fsync d0/d14/f1b 0 2024-09-06T14:44:22.841 INFO:tasks.workunit.client.1.smithi165.stdout:5/139: creat d6/d1c/f38 x:0 0 0 2024-09-06T14:44:22.844 INFO:tasks.workunit.client.1.smithi165.stdout:2/140: mkdir d9/d23/d29/d2a 0 2024-09-06T14:44:22.844 INFO:tasks.workunit.client.1.smithi165.stdout:9/237: write db/f3a [65671,59082] 0 2024-09-06T14:44:22.846 INFO:tasks.workunit.client.1.smithi165.stdout:9/238: stat db/de/d2d/c49 0 2024-09-06T14:44:22.847 INFO:tasks.workunit.client.1.smithi165.stdout:5/140: creat d6/d1c/f39 x:0 0 0 2024-09-06T14:44:22.847 INFO:tasks.workunit.client.1.smithi165.stdout:9/239: readlink l5 0 2024-09-06T14:44:22.848 INFO:tasks.workunit.client.1.smithi165.stdout:0/191: symlink d15/d19/l40 0 2024-09-06T14:44:22.849 INFO:tasks.workunit.client.1.smithi165.stdout:1/142: getdents d0/d1c/d1d 0 2024-09-06T14:44:22.849 INFO:tasks.workunit.client.1.smithi165.stdout:8/151: dwrite d0/f2f [0,4194304] 0 2024-09-06T14:44:22.856 INFO:tasks.workunit.client.1.smithi165.stdout:5/141: write d6/f19 [677056,79647] 0 2024-09-06T14:44:22.856 INFO:tasks.workunit.client.1.smithi165.stdout:8/152: mknod d0/d14/c39 0 2024-09-06T14:44:22.859 INFO:tasks.workunit.client.1.smithi165.stdout:9/240: creat db/d40/f53 x:0 0 0 2024-09-06T14:44:22.861 INFO:tasks.workunit.client.1.smithi165.stdout:4/96: dwrite f2 [0,4194304] 0 2024-09-06T14:44:22.863 INFO:tasks.workunit.client.1.smithi165.stdout:2/141: dwrite d9/f13 [8388608,4194304] 0 2024-09-06T14:44:22.867 INFO:tasks.workunit.client.1.smithi165.stdout:0/192: getdents d15/d19/d28 0 2024-09-06T14:44:22.868 INFO:tasks.workunit.client.1.smithi165.stdout:5/142: rename d6/f17 to d6/d1c/f3a 0 2024-09-06T14:44:22.869 INFO:tasks.workunit.client.1.smithi165.stdout:9/241: unlink db/c4f 0 2024-09-06T14:44:22.871 INFO:tasks.workunit.client.1.smithi165.stdout:4/97: truncate d5/f1a 292992 0 2024-09-06T14:44:22.871 INFO:tasks.workunit.client.1.smithi165.stdout:0/193: fsync d15/f37 0 2024-09-06T14:44:22.872 INFO:tasks.workunit.client.1.smithi165.stdout:1/143: dwrite d0/d2a/fe [0,4194304] 0 2024-09-06T14:44:22.876 INFO:tasks.workunit.client.1.smithi165.stdout:2/142: rename d9/f20 to d9/d23/d29/f2b 0 2024-09-06T14:44:22.876 INFO:tasks.workunit.client.1.smithi165.stdout:9/242: dread - db/de/d16/d2e/f3d zero size 2024-09-06T14:44:22.877 INFO:tasks.workunit.client.1.smithi165.stdout:8/153: dwrite d0/d19/d36/fa [0,4194304] 0 2024-09-06T14:44:22.877 INFO:tasks.workunit.client.1.smithi165.stdout:0/194: creat d15/d19/d28/d3a/f41 x:0 0 0 2024-09-06T14:44:22.879 INFO:tasks.workunit.client.1.smithi165.stdout:4/98: mkdir d5/d1b/d1c 0 2024-09-06T14:44:22.881 INFO:tasks.workunit.client.1.smithi165.stdout:4/99: chown d5/f8 7359 1 2024-09-06T14:44:22.881 INFO:tasks.workunit.client.1.smithi165.stdout:8/154: write d0/d19/d24/f37 [114812,65861] 0 2024-09-06T14:44:22.881 INFO:tasks.workunit.client.1.smithi165.stdout:2/143: unlink d9/f11 0 2024-09-06T14:44:22.883 INFO:tasks.workunit.client.1.smithi165.stdout:4/100: chown d5/f15 1171176 1 2024-09-06T14:44:22.884 INFO:tasks.workunit.client.1.smithi165.stdout:5/143: dwrite d6/d1c/f22 [0,4194304] 0 2024-09-06T14:44:22.890 INFO:tasks.workunit.client.1.smithi165.stdout:4/101: dread d5/f13 [0,4194304] 0 2024-09-06T14:44:22.890 INFO:tasks.workunit.client.1.smithi165.stdout:6/113: sync 2024-09-06T14:44:22.890 INFO:tasks.workunit.client.1.smithi165.stdout:7/47: sync 2024-09-06T14:44:22.890 INFO:tasks.workunit.client.1.smithi165.stdout:3/86: sync 2024-09-06T14:44:22.891 INFO:tasks.workunit.client.1.smithi165.stdout:0/195: creat d15/d19/d28/f42 x:0 0 0 2024-09-06T14:44:22.893 INFO:tasks.workunit.client.1.smithi165.stdout:3/87: chown d1/da/dd/l18 1249264 1 2024-09-06T14:44:22.893 INFO:tasks.workunit.client.1.smithi165.stdout:4/102: stat d5/l12 0 2024-09-06T14:44:22.896 INFO:tasks.workunit.client.1.smithi165.stdout:5/144: creat d6/d1c/d28/f3b x:0 0 0 2024-09-06T14:44:22.896 INFO:tasks.workunit.client.1.smithi165.stdout:7/48: mknod ce 0 2024-09-06T14:44:22.899 INFO:tasks.workunit.client.1.smithi165.stdout:3/88: readlink d1/da/dc/lf 0 2024-09-06T14:44:22.901 INFO:tasks.workunit.client.1.smithi165.stdout:1/144: truncate d0/d2a/fe 3297182 0 2024-09-06T14:44:22.902 INFO:tasks.workunit.client.1.smithi165.stdout:8/155: mkdir d0/d19/d36/d2d/d33/d3a 0 2024-09-06T14:44:22.902 INFO:tasks.workunit.client.1.smithi165.stdout:9/243: write db/de/d15/d17/f19 [252265,92220] 0 2024-09-06T14:44:22.902 INFO:tasks.workunit.client.1.smithi165.stdout:5/145: rmdir d6 39 2024-09-06T14:44:22.905 INFO:tasks.workunit.client.1.smithi165.stdout:4/103: creat d5/d1b/d1c/f1d x:0 0 0 2024-09-06T14:44:22.905 INFO:tasks.workunit.client.1.smithi165.stdout:1/145: creat d0/d2a/d1b/f30 x:0 0 0 2024-09-06T14:44:22.905 INFO:tasks.workunit.client.1.smithi165.stdout:9/244: dread - db/de/d15/d17/f4c zero size 2024-09-06T14:44:22.906 INFO:tasks.workunit.client.1.smithi165.stdout:2/144: getdents d9/d25 0 2024-09-06T14:44:22.908 INFO:tasks.workunit.client.1.smithi165.stdout:0/196: creat d15/f43 x:0 0 0 2024-09-06T14:44:22.908 INFO:tasks.workunit.client.1.smithi165.stdout:8/156: creat d0/d19/f3b x:0 0 0 2024-09-06T14:44:22.910 INFO:tasks.workunit.client.1.smithi165.stdout:1/146: rmdir d0/d1c/d1d 39 2024-09-06T14:44:22.911 INFO:tasks.workunit.client.1.smithi165.stdout:7/49: dread f6 [0,4194304] 0 2024-09-06T14:44:22.912 INFO:tasks.workunit.client.1.smithi165.stdout:9/245: write db/de/d16/f24 [1270591,56313] 0 2024-09-06T14:44:22.912 INFO:tasks.workunit.client.1.smithi165.stdout:5/146: mkdir d6/d1c/d28/d2d/d3c 0 2024-09-06T14:44:22.913 INFO:tasks.workunit.client.1.smithi165.stdout:3/89: dwrite d1/f11 [4194304,4194304] 0 2024-09-06T14:44:22.915 INFO:tasks.workunit.client.1.smithi165.stdout:3/90: chown d1/da/dc 2108 1 2024-09-06T14:44:22.915 INFO:tasks.workunit.client.1.smithi165.stdout:0/197: chown d15/d19/l2b 68 1 2024-09-06T14:44:22.915 INFO:tasks.workunit.client.1.smithi165.stdout:8/157: dread - d0/d14/f2b zero size 2024-09-06T14:44:22.917 INFO:tasks.workunit.client.1.smithi165.stdout:7/50: creat ff x:0 0 0 2024-09-06T14:44:22.917 INFO:tasks.workunit.client.1.smithi165.stdout:8/158: dread d0/d14/f1b [0,4194304] 0 2024-09-06T14:44:22.918 INFO:tasks.workunit.client.1.smithi165.stdout:7/51: dread fc [0,4194304] 0 2024-09-06T14:44:22.920 INFO:tasks.workunit.client.1.smithi165.stdout:9/246: dread - db/de/d15/f2b zero size 2024-09-06T14:44:22.922 INFO:tasks.workunit.client.1.smithi165.stdout:3/91: mknod d1/da/dd/c1d 0 2024-09-06T14:44:22.923 INFO:tasks.workunit.client.1.smithi165.stdout:6/114: dread f5 [0,4194304] 0 2024-09-06T14:44:22.923 INFO:tasks.workunit.client.1.smithi165.stdout:4/104: truncate f2 2299114 0 2024-09-06T14:44:22.924 INFO:tasks.workunit.client.1.smithi165.stdout:1/147: mknod d0/d2a/d1b/d2b/c31 0 2024-09-06T14:44:22.924 INFO:tasks.workunit.client.1.smithi165.stdout:6/115: write fa [2211928,567] 0 2024-09-06T14:44:22.925 INFO:tasks.workunit.client.1.smithi165.stdout:3/92: dread d1/da/dd/f15 [0,4194304] 0 2024-09-06T14:44:22.925 INFO:tasks.workunit.client.1.smithi165.stdout:6/116: chown f3 132710608 1 2024-09-06T14:44:22.926 INFO:tasks.workunit.client.1.smithi165.stdout:8/159: creat d0/d19/d24/d26/f3c x:0 0 0 2024-09-06T14:44:22.927 INFO:tasks.workunit.client.1.smithi165.stdout:8/160: chown d0/d19/d36/d23 13337499 1 2024-09-06T14:44:22.927 INFO:tasks.workunit.client.1.smithi165.stdout:0/198: write d15/d19/f21 [3655609,59523] 0 2024-09-06T14:44:22.934 INFO:tasks.workunit.client.1.smithi165.stdout:6/117: symlink l1b 0 2024-09-06T14:44:22.934 INFO:tasks.workunit.client.1.smithi165.stdout:3/93: mknod d1/c1e 0 2024-09-06T14:44:22.936 INFO:tasks.workunit.client.1.smithi165.stdout:2/145: link d9/cb d9/d23/d29/c2c 0 2024-09-06T14:44:22.937 INFO:tasks.workunit.client.1.smithi165.stdout:4/105: dwrite d5/d1b/d1c/f1d [0,4194304] 0 2024-09-06T14:44:22.938 INFO:tasks.workunit.client.1.smithi165.stdout:1/148: readlink d0/d1c/d1d/d22/l2c 0 2024-09-06T14:44:22.939 INFO:tasks.workunit.client.1.smithi165.stdout:0/199: rename d15/l31 to d15/d19/d2c/l44 0 2024-09-06T14:44:22.941 INFO:tasks.workunit.client.1.smithi165.stdout:3/94: fsync d1/f2 0 2024-09-06T14:44:22.942 INFO:tasks.workunit.client.1.smithi165.stdout:8/161: dread d0/f1a [0,4194304] 0 2024-09-06T14:44:22.943 INFO:tasks.workunit.client.1.smithi165.stdout:2/146: rmdir d9/d25 39 2024-09-06T14:44:22.944 INFO:tasks.workunit.client.1.smithi165.stdout:3/95: readlink d1/lb 0 2024-09-06T14:44:22.945 INFO:tasks.workunit.client.1.smithi165.stdout:9/247: truncate db/de/d15/d17/f29 3370150 0 2024-09-06T14:44:22.947 INFO:tasks.workunit.client.1.smithi165.stdout:7/52: dwrite f6 [0,4194304] 0 2024-09-06T14:44:22.948 INFO:tasks.workunit.client.1.smithi165.stdout:1/149: creat d0/d1c/d1d/d22/f32 x:0 0 0 2024-09-06T14:44:22.949 INFO:tasks.workunit.client.1.smithi165.stdout:3/96: dread d1/f8 [0,4194304] 0 2024-09-06T14:44:22.950 INFO:tasks.workunit.client.1.smithi165.stdout:8/162: fsync d0/f6 0 2024-09-06T14:44:22.950 INFO:tasks.workunit.client.1.smithi165.stdout:3/97: chown d1/d19 48 1 2024-09-06T14:44:22.953 INFO:tasks.workunit.client.1.smithi165.stdout:7/53: unlink f6 0 2024-09-06T14:44:22.958 INFO:tasks.workunit.client.1.smithi165.stdout:2/147: dwrite d9/f12 [0,4194304] 0 2024-09-06T14:44:22.958 INFO:tasks.workunit.client.1.smithi165.stdout:7/54: write f8 [674981,57155] 0 2024-09-06T14:44:22.958 INFO:tasks.workunit.client.1.smithi165.stdout:7/55: read fb [754530,85369] 0 2024-09-06T14:44:22.958 INFO:tasks.workunit.client.1.smithi165.stdout:2/148: write d9/f12 [2337265,113797] 0 2024-09-06T14:44:22.958 INFO:tasks.workunit.client.1.smithi165.stdout:3/98: symlink d1/d19/l1f 0 2024-09-06T14:44:22.959 INFO:tasks.workunit.client.1.smithi165.stdout:7/56: dread - ff zero size 2024-09-06T14:44:22.960 INFO:tasks.workunit.client.1.smithi165.stdout:2/149: truncate d9/f1b 846098 0 2024-09-06T14:44:22.961 INFO:tasks.workunit.client.1.smithi165.stdout:8/163: creat d0/d19/d36/d28/f3d x:0 0 0 2024-09-06T14:44:22.968 INFO:tasks.workunit.client.1.smithi165.stdout:4/106: link d5/cd d5/d1b/d1c/c1e 0 2024-09-06T14:44:22.968 INFO:tasks.workunit.client.1.smithi165.stdout:2/150: dwrite d9/f1a [0,4194304] 0 2024-09-06T14:44:22.970 INFO:tasks.workunit.client.1.smithi165.stdout:2/151: dread - d9/f18 zero size 2024-09-06T14:44:22.972 INFO:tasks.workunit.client.1.smithi165.stdout:3/99: dread d1/f8 [0,4194304] 0 2024-09-06T14:44:22.973 INFO:tasks.workunit.client.1.smithi165.stdout:2/152: chown d9/l19 14472 1 2024-09-06T14:44:22.974 INFO:tasks.workunit.client.1.smithi165.stdout:3/100: readlink d1/l7 0 2024-09-06T14:44:22.975 INFO:tasks.workunit.client.1.smithi165.stdout:0/200: dwrite f8 [0,4194304] 0 2024-09-06T14:44:22.976 INFO:tasks.workunit.client.1.smithi165.stdout:3/101: readlink d1/da/dd/l18 0 2024-09-06T14:44:22.977 INFO:tasks.workunit.client.1.smithi165.stdout:0/201: chown d15/d19/d28/c2a 420 1 2024-09-06T14:44:22.978 INFO:tasks.workunit.client.1.smithi165.stdout:8/164: rename d0/d19/d36/d23 to d0/d14/d3e 0 2024-09-06T14:44:22.978 INFO:tasks.workunit.client.1.smithi165.stdout:8/165: read d0/f1a [368387,114652] 0 2024-09-06T14:44:22.982 INFO:tasks.workunit.client.1.smithi165.stdout:8/166: write d0/f6 [871740,48511] 0 2024-09-06T14:44:22.989 INFO:tasks.workunit.client.1.smithi165.stdout:3/102: truncate d1/da/dd/f15 545818 0 2024-09-06T14:44:22.991 INFO:tasks.workunit.client.1.smithi165.stdout:9/248: truncate db/fd 1244283 0 2024-09-06T14:44:22.992 INFO:tasks.workunit.client.1.smithi165.stdout:0/202: creat d15/d19/d2c/f45 x:0 0 0 2024-09-06T14:44:22.999 INFO:tasks.workunit.client.1.smithi165.stdout:8/167: mkdir d0/d19/d36/d2d/d3f 0 2024-09-06T14:44:23.005 INFO:tasks.workunit.client.1.smithi165.stdout:9/249: rmdir db/d40 39 2024-09-06T14:44:23.009 INFO:tasks.workunit.client.1.smithi165.stdout:2/153: rmdir d9/d23/d29/d2a 0 2024-09-06T14:44:23.012 INFO:tasks.workunit.client.1.smithi165.stdout:9/250: creat db/de/d15/d17/d18/f54 x:0 0 0 2024-09-06T14:44:23.014 INFO:tasks.workunit.client.1.smithi165.stdout:8/168: mknod d0/d19/d36/d2d/d3f/c40 0 2024-09-06T14:44:23.014 INFO:tasks.workunit.client.1.smithi165.stdout:9/251: chown db/de/d2d/c52 1965745 1 2024-09-06T14:44:23.015 INFO:tasks.workunit.client.1.smithi165.stdout:4/107: write f2 [1253353,117785] 0 2024-09-06T14:44:23.017 INFO:tasks.workunit.client.1.smithi165.stdout:2/154: dwrite d9/f1c [0,4194304] 0 2024-09-06T14:44:23.019 INFO:tasks.workunit.client.1.smithi165.stdout:8/169: symlink d0/d19/d36/d2d/d3f/l41 0 2024-09-06T14:44:23.022 INFO:tasks.workunit.client.1.smithi165.stdout:2/155: dread d9/f10 [0,4194304] 0 2024-09-06T14:44:23.023 INFO:tasks.workunit.client.1.smithi165.stdout:2/156: write d9/d23/f28 [968034,86745] 0 2024-09-06T14:44:23.024 INFO:tasks.workunit.client.1.smithi165.stdout:4/108: rmdir d5/d1b/d1c 39 2024-09-06T14:44:23.025 INFO:tasks.workunit.client.1.smithi165.stdout:4/109: fdatasync d5/f19 0 2024-09-06T14:44:23.025 INFO:tasks.workunit.client.1.smithi165.stdout:4/110: truncate d5/f15 313538 0 2024-09-06T14:44:23.027 INFO:tasks.workunit.client.1.smithi165.stdout:8/170: mknod d0/d19/d24/d26/c42 0 2024-09-06T14:44:23.031 INFO:tasks.workunit.client.1.smithi165.stdout:9/252: rename db/de/d16/f30 to db/de/d16/d2e/f55 0 2024-09-06T14:44:23.037 INFO:tasks.workunit.client.1.smithi165.stdout:8/171: rmdir d0/d14/d3e 39 2024-09-06T14:44:23.041 INFO:tasks.workunit.client.1.smithi165.stdout:9/253: symlink db/de/d16/l56 0 2024-09-06T14:44:23.041 INFO:tasks.workunit.client.1.smithi165.stdout:9/254: write f4 [121021,3296] 0 2024-09-06T14:44:23.042 INFO:tasks.workunit.client.1.smithi165.stdout:2/157: mkdir d9/d23/d26/d2d 0 2024-09-06T14:44:23.047 INFO:tasks.workunit.client.1.smithi165.stdout:8/172: read d0/f9 [346135,84504] 0 2024-09-06T14:44:23.051 INFO:tasks.workunit.client.1.smithi165.stdout:2/158: rmdir d9/d23/d26 39 2024-09-06T14:44:23.055 INFO:tasks.workunit.client.1.smithi165.stdout:2/159: fdatasync d9/f10 0 2024-09-06T14:44:23.055 INFO:tasks.workunit.client.1.smithi165.stdout:4/111: dwrite d5/f13 [0,4194304] 0 2024-09-06T14:44:23.056 INFO:tasks.workunit.client.1.smithi165.stdout:8/173: mkdir d0/d34/d43 0 2024-09-06T14:44:23.057 INFO:tasks.workunit.client.1.smithi165.stdout:8/174: stat d0/d19/d36 0 2024-09-06T14:44:23.059 INFO:tasks.workunit.client.1.smithi165.stdout:2/160: mknod d9/d23/d29/c2e 0 2024-09-06T14:44:23.061 INFO:tasks.workunit.client.1.smithi165.stdout:2/161: read d9/ff [1556909,86877] 0 2024-09-06T14:44:23.061 INFO:tasks.workunit.client.1.smithi165.stdout:8/175: dread d0/f2f [0,4194304] 0 2024-09-06T14:44:23.067 INFO:tasks.workunit.client.1.smithi165.stdout:9/255: getdents db/de/d16 0 2024-09-06T14:44:23.068 INFO:tasks.workunit.client.1.smithi165.stdout:4/112: symlink d5/d1b/d1c/l1f 0 2024-09-06T14:44:23.068 INFO:tasks.workunit.client.1.smithi165.stdout:4/113: fdatasync f2 0 2024-09-06T14:44:23.070 INFO:tasks.workunit.client.1.smithi165.stdout:8/176: creat d0/d19/d36/f44 x:0 0 0 2024-09-06T14:44:23.077 INFO:tasks.workunit.client.1.smithi165.stdout:4/114: mkdir d5/d1b/d1c/d20 0 2024-09-06T14:44:23.079 INFO:tasks.workunit.client.1.smithi165.stdout:8/177: creat d0/d19/d36/d28/f45 x:0 0 0 2024-09-06T14:44:23.084 INFO:tasks.workunit.client.1.smithi165.stdout:4/115: rename d5/l16 to d5/d1b/d1c/l21 0 2024-09-06T14:44:23.087 INFO:tasks.workunit.client.1.smithi165.stdout:4/116: creat d5/d1b/d1c/f22 x:0 0 0 2024-09-06T14:44:23.089 INFO:tasks.workunit.client.1.smithi165.stdout:8/178: mkdir d0/d19/d36/d2d/d33/d3a/d46 0 2024-09-06T14:44:23.097 INFO:tasks.workunit.client.1.smithi165.stdout:4/117: link d5/f15 d5/d1b/d1c/d20/f23 0 2024-09-06T14:44:23.099 INFO:tasks.workunit.client.1.smithi165.stdout:8/179: rename d0/d19/d24/d26/f3c to d0/d14/d3e/f47 0 2024-09-06T14:44:23.101 INFO:tasks.workunit.client.1.smithi165.stdout:9/256: dwrite db/de/d15/d17/f3e [0,4194304] 0 2024-09-06T14:44:23.101 INFO:tasks.workunit.client.1.smithi165.stdout:8/180: write d0/d19/d36/fa [326645,55617] 0 2024-09-06T14:44:23.107 INFO:tasks.workunit.client.1.smithi165.stdout:4/118: creat d5/d1b/d1c/d20/f24 x:0 0 0 2024-09-06T14:44:23.108 INFO:tasks.workunit.client.1.smithi165.stdout:8/181: readlink d0/l11 0 2024-09-06T14:44:23.109 INFO:tasks.workunit.client.1.smithi165.stdout:9/257: rmdir db/de 39 2024-09-06T14:44:23.113 INFO:tasks.workunit.client.1.smithi165.stdout:4/119: dwrite d5/d1b/d1c/d20/f24 [0,4194304] 0 2024-09-06T14:44:23.113 INFO:tasks.workunit.client.1.smithi165.stdout:9/258: dread - db/de/d16/d2e/f50 zero size 2024-09-06T14:44:23.114 INFO:tasks.workunit.client.1.smithi165.stdout:8/182: dread d0/d19/d36/d2d/f38 [4194304,4194304] 0 2024-09-06T14:44:23.117 INFO:tasks.workunit.client.1.smithi165.stdout:4/120: dread d5/d1b/d1c/d20/f23 [0,4194304] 0 2024-09-06T14:44:23.118 INFO:tasks.workunit.client.1.smithi165.stdout:8/183: write d0/d14/f25 [882117,24010] 0 2024-09-06T14:44:23.119 INFO:tasks.workunit.client.1.smithi165.stdout:4/121: read d5/f1a [236335,16972] 0 2024-09-06T14:44:23.126 INFO:tasks.workunit.client.1.smithi165.stdout:8/184: write d0/f17 [838094,108774] 0 2024-09-06T14:44:23.127 INFO:tasks.workunit.client.1.smithi165.stdout:4/122: mknod d5/d1b/d1c/c25 0 2024-09-06T14:44:23.129 INFO:tasks.workunit.client.1.smithi165.stdout:9/259: creat db/f57 x:0 0 0 2024-09-06T14:44:23.131 INFO:tasks.workunit.client.1.smithi165.stdout:9/260: dread - db/de/f3f zero size 2024-09-06T14:44:23.132 INFO:tasks.workunit.client.1.smithi165.stdout:9/261: fdatasync db/f3a 0 2024-09-06T14:44:23.134 INFO:tasks.workunit.client.1.smithi165.stdout:4/123: dwrite d5/d1b/d1c/f1d [0,4194304] 0 2024-09-06T14:44:23.136 INFO:tasks.workunit.client.1.smithi165.stdout:4/124: truncate d5/d1b/d1c/f1d 5061273 0 2024-09-06T14:44:23.139 INFO:tasks.workunit.client.1.smithi165.stdout:9/262: truncate db/d22/f46 2850418 0 2024-09-06T14:44:23.141 INFO:tasks.workunit.client.1.smithi165.stdout:4/125: write d5/f1a [480804,80026] 0 2024-09-06T14:44:23.143 INFO:tasks.workunit.client.1.smithi165.stdout:4/126: write d5/d1b/d1c/d20/f24 [761063,81452] 0 2024-09-06T14:44:23.143 INFO:tasks.workunit.client.1.smithi165.stdout:9/263: unlink db/de/d16/d2e/f50 0 2024-09-06T14:44:23.145 INFO:tasks.workunit.client.1.smithi165.stdout:9/264: chown db/de/d15/f2b 1 1 2024-09-06T14:44:23.149 INFO:tasks.workunit.client.1.smithi165.stdout:4/127: dwrite d5/f1a [0,4194304] 0 2024-09-06T14:44:23.150 INFO:tasks.workunit.client.1.smithi165.stdout:9/265: creat db/de/d2d/f58 x:0 0 0 2024-09-06T14:44:23.152 INFO:tasks.workunit.client.1.smithi165.stdout:4/128: mkdir d5/d1b/d1c/d20/d26 0 2024-09-06T14:44:23.153 INFO:tasks.workunit.client.1.smithi165.stdout:4/129: read - d5/d1b/d1c/f22 zero size 2024-09-06T14:44:23.154 INFO:tasks.workunit.client.1.smithi165.stdout:9/266: mkdir db/de/d15/d17/d18/d59 0 2024-09-06T14:44:23.157 INFO:tasks.workunit.client.1.smithi165.stdout:4/130: rename d5/f14 to d5/d1b/d1c/d20/f27 0 2024-09-06T14:44:23.160 INFO:tasks.workunit.client.1.smithi165.stdout:9/267: mkdir db/de/d2d/d5a 0 2024-09-06T14:44:23.165 INFO:tasks.workunit.client.1.smithi165.stdout:4/131: rename d5/f19 to d5/d1b/d1c/d20/d26/f28 0 2024-09-06T14:44:23.171 INFO:tasks.workunit.client.1.smithi165.stdout:4/132: mknod d5/d1b/d1c/c29 0 2024-09-06T14:44:23.173 INFO:tasks.workunit.client.1.smithi165.stdout:9/268: mknod db/de/d15/d17/c5b 0 2024-09-06T14:44:23.173 INFO:tasks.workunit.client.1.smithi165.stdout:9/269: chown db/de/d2d/c42 120736008 1 2024-09-06T14:44:23.174 INFO:tasks.workunit.client.1.smithi165.stdout:9/270: read - db/de/d16/d2e/f3d zero size 2024-09-06T14:44:23.174 INFO:tasks.workunit.client.1.smithi165.stdout:9/271: readlink db/de/d2d/l36 0 2024-09-06T14:44:23.175 INFO:tasks.workunit.client.1.smithi165.stdout:9/272: write db/de/d15/d17/f4c [939157,8635] 0 2024-09-06T14:44:23.175 INFO:tasks.workunit.client.1.smithi165.stdout:4/133: rename d5/f1a to d5/d1b/d1c/d20/d26/f2a 0 2024-09-06T14:44:23.180 INFO:tasks.workunit.client.1.smithi165.stdout:4/134: dread d5/fc [0,4194304] 0 2024-09-06T14:44:23.185 INFO:tasks.workunit.client.1.smithi165.stdout:4/135: creat d5/f2b x:0 0 0 2024-09-06T14:44:23.188 INFO:tasks.workunit.client.1.smithi165.stdout:4/136: chown d5/cd 96627 1 2024-09-06T14:44:23.190 INFO:tasks.workunit.client.1.smithi165.stdout:4/137: creat d5/f2c x:0 0 0 2024-09-06T14:44:23.195 INFO:tasks.workunit.client.1.smithi165.stdout:4/138: unlink d5/d1b/d1c/d20/f23 0 2024-09-06T14:44:23.199 INFO:tasks.workunit.client.1.smithi165.stdout:4/139: mknod d5/d1b/d1c/d20/d26/c2d 0 2024-09-06T14:44:23.202 INFO:tasks.workunit.client.1.smithi165.stdout:9/273: truncate db/de/d16/f24 2190541 0 2024-09-06T14:44:23.203 INFO:tasks.workunit.client.1.smithi165.stdout:9/274: chown db/de/d15/l51 114597704 1 2024-09-06T14:44:23.204 INFO:tasks.workunit.client.1.smithi165.stdout:4/140: creat d5/d1b/d1c/f2e x:0 0 0 2024-09-06T14:44:23.210 INFO:tasks.workunit.client.1.smithi165.stdout:9/275: creat db/de/d15/d17/f5c x:0 0 0 2024-09-06T14:44:23.210 INFO:tasks.workunit.client.1.smithi165.stdout:9/276: readlink db/de/d16/l21 0 2024-09-06T14:44:23.211 INFO:tasks.workunit.client.1.smithi165.stdout:9/277: write db/de/f2c [1967161,112974] 0 2024-09-06T14:44:23.214 INFO:tasks.workunit.client.1.smithi165.stdout:9/278: creat db/de/d15/d17/d18/f5d x:0 0 0 2024-09-06T14:44:23.215 INFO:tasks.workunit.client.1.smithi165.stdout:9/279: chown db/de/d2d/f58 734494124 1 2024-09-06T14:44:23.215 INFO:tasks.workunit.client.1.smithi165.stdout:9/280: chown fa 2 1 2024-09-06T14:44:23.217 INFO:tasks.workunit.client.1.smithi165.stdout:9/281: readlink l3 0 2024-09-06T14:44:23.218 INFO:tasks.workunit.client.1.smithi165.stdout:9/282: stat f4 0 2024-09-06T14:44:23.218 INFO:tasks.workunit.client.1.smithi165.stdout:9/283: truncate db/f26 1857215 0 2024-09-06T14:44:23.221 INFO:tasks.workunit.client.1.smithi165.stdout:9/284: rename db/de/d2d/f58 to db/de/d16/f5e 0 2024-09-06T14:44:23.226 INFO:tasks.workunit.client.1.smithi165.stdout:9/285: creat db/de/d2d/d5a/f5f x:0 0 0 2024-09-06T14:44:23.228 INFO:tasks.workunit.client.1.smithi165.stdout:4/141: write d5/f8 [3794051,111652] 0 2024-09-06T14:44:23.230 INFO:tasks.workunit.client.1.smithi165.stdout:9/286: symlink db/de/d15/d17/l60 0 2024-09-06T14:44:23.230 INFO:tasks.workunit.client.1.smithi165.stdout:9/287: stat db/d22/c37 0 2024-09-06T14:44:23.231 INFO:tasks.workunit.client.1.smithi165.stdout:4/142: dread f2 [0,4194304] 0 2024-09-06T14:44:23.232 INFO:tasks.workunit.client.1.smithi165.stdout:4/143: fsync d5/d1b/d1c/f1d 0 2024-09-06T14:44:23.233 INFO:tasks.workunit.client.1.smithi165.stdout:4/144: truncate d5/d1b/d1c/f2e 342537 0 2024-09-06T14:44:23.233 INFO:tasks.workunit.client.1.smithi165.stdout:4/145: truncate f2 2947857 0 2024-09-06T14:44:23.233 INFO:tasks.workunit.client.1.smithi165.stdout:9/288: mkdir db/de/d2d/d5a/d61 0 2024-09-06T14:44:23.236 INFO:tasks.workunit.client.1.smithi165.stdout:4/146: unlink d5/l17 0 2024-09-06T14:44:23.237 INFO:tasks.workunit.client.1.smithi165.stdout:4/147: truncate d5/f2b 745130 0 2024-09-06T14:44:23.238 INFO:tasks.workunit.client.1.smithi165.stdout:4/148: fsync d5/d1b/d1c/f1d 0 2024-09-06T14:44:23.239 INFO:tasks.workunit.client.1.smithi165.stdout:9/289: mknod db/de/c62 0 2024-09-06T14:44:23.242 INFO:tasks.workunit.client.1.smithi165.stdout:5/147: sync 2024-09-06T14:44:23.243 INFO:tasks.workunit.client.1.smithi165.stdout:9/290: creat db/de/d16/d2e/f63 x:0 0 0 2024-09-06T14:44:23.243 INFO:tasks.workunit.client.1.smithi165.stdout:9/291: chown db/de/d16 58119 1 2024-09-06T14:44:23.247 INFO:tasks.workunit.client.1.smithi165.stdout:5/148: unlink d6/d1c/d28/f29 0 2024-09-06T14:44:23.248 INFO:tasks.workunit.client.1.smithi165.stdout:5/149: write d6/d1c/d28/f36 [1014270,81656] 0 2024-09-06T14:44:23.255 INFO:tasks.workunit.client.1.smithi165.stdout:5/150: creat d6/d1c/f3d x:0 0 0 2024-09-06T14:44:23.257 INFO:tasks.workunit.client.1.smithi165.stdout:9/292: mkdir db/de/d15/d17/d18/d59/d64 0 2024-09-06T14:44:23.258 INFO:tasks.workunit.client.1.smithi165.stdout:5/151: mknod d6/d1c/c3e 0 2024-09-06T14:44:23.261 INFO:tasks.workunit.client.1.smithi165.stdout:5/152: creat d6/d32/f3f x:0 0 0 2024-09-06T14:44:23.266 INFO:tasks.workunit.client.1.smithi165.stdout:5/153: symlink d6/d1c/d28/d2d/d3c/l40 0 2024-09-06T14:44:23.267 INFO:tasks.workunit.client.1.smithi165.stdout:4/149: truncate d5/fc 1197852 0 2024-09-06T14:44:23.267 INFO:tasks.workunit.client.1.smithi165.stdout:9/293: link db/de/d2d/c49 db/de/d15/d17/c65 0 2024-09-06T14:44:23.268 INFO:tasks.workunit.client.1.smithi165.stdout:9/294: write db/de/d16/d2e/f3d [367558,100647] 0 2024-09-06T14:44:23.269 INFO:tasks.workunit.client.1.smithi165.stdout:5/154: mkdir d6/d32/d41 0 2024-09-06T14:44:23.273 INFO:tasks.workunit.client.1.smithi165.stdout:4/150: symlink d5/l2f 0 2024-09-06T14:44:23.273 INFO:tasks.workunit.client.1.smithi165.stdout:9/295: creat db/de/d16/f66 x:0 0 0 2024-09-06T14:44:23.274 INFO:tasks.workunit.client.1.smithi165.stdout:4/151: write d5/d1b/d1c/f22 [618522,106159] 0 2024-09-06T14:44:23.275 INFO:tasks.workunit.client.1.smithi165.stdout:4/152: write d5/f13 [2238800,126555] 0 2024-09-06T14:44:23.276 INFO:tasks.workunit.client.1.smithi165.stdout:5/155: truncate d6/d1c/f1e 1233822 0 2024-09-06T14:44:23.278 INFO:tasks.workunit.client.1.smithi165.stdout:9/296: truncate db/fd 538761 0 2024-09-06T14:44:23.279 INFO:tasks.workunit.client.1.smithi165.stdout:4/153: creat d5/f30 x:0 0 0 2024-09-06T14:44:23.282 INFO:tasks.workunit.client.1.smithi165.stdout:9/297: read - db/d40/f53 zero size 2024-09-06T14:44:23.287 INFO:tasks.workunit.client.1.smithi165.stdout:4/154: creat d5/d1b/f31 x:0 0 0 2024-09-06T14:44:23.287 INFO:tasks.workunit.client.1.smithi165.stdout:9/298: symlink db/de/d15/d17/d18/d59/d64/l67 0 2024-09-06T14:44:23.288 INFO:tasks.workunit.client.1.smithi165.stdout:9/299: dread - db/de/d16/d2e/f63 zero size 2024-09-06T14:44:23.291 INFO:tasks.workunit.client.1.smithi165.stdout:9/300: fsync db/de/d15/d17/f29 0 2024-09-06T14:44:23.293 INFO:tasks.workunit.client.1.smithi165.stdout:4/155: dwrite d5/d1b/d1c/d20/f24 [0,4194304] 0 2024-09-06T14:44:23.293 INFO:tasks.workunit.client.1.smithi165.stdout:4/156: read - d5/f30 zero size 2024-09-06T14:44:23.297 INFO:tasks.workunit.client.1.smithi165.stdout:9/301: symlink db/de/d15/d17/d18/d59/d64/l68 0 2024-09-06T14:44:23.303 INFO:tasks.workunit.client.1.smithi165.stdout:4/157: dwrite f2 [0,4194304] 0 2024-09-06T14:44:23.303 INFO:tasks.workunit.client.1.smithi165.stdout:5/156: dread d6/d1c/f1e [0,4194304] 0 2024-09-06T14:44:23.305 INFO:tasks.workunit.client.1.smithi165.stdout:9/302: dread db/de/d15/d17/f3e [0,4194304] 0 2024-09-06T14:44:23.306 INFO:tasks.workunit.client.1.smithi165.stdout:9/303: fdatasync db/de/d16/f43 0 2024-09-06T14:44:23.307 INFO:tasks.workunit.client.1.smithi165.stdout:4/158: creat d5/d1b/d1c/d20/d26/f32 x:0 0 0 2024-09-06T14:44:23.308 INFO:tasks.workunit.client.1.smithi165.stdout:5/157: creat d6/d1c/d28/f42 x:0 0 0 2024-09-06T14:44:23.311 INFO:tasks.workunit.client.1.smithi165.stdout:4/159: symlink d5/d1b/d1c/l33 0 2024-09-06T14:44:23.313 INFO:tasks.workunit.client.1.smithi165.stdout:5/158: rename d6/d32/f34 to d6/d1c/d28/f43 0 2024-09-06T14:44:23.316 INFO:tasks.workunit.client.1.smithi165.stdout:5/159: mkdir d6/d1c/d28/d2d/d3c/d44 0 2024-09-06T14:44:23.318 INFO:tasks.workunit.client.1.smithi165.stdout:4/160: rename d5/f15 to d5/d1b/d1c/f34 0 2024-09-06T14:44:23.318 INFO:tasks.workunit.client.1.smithi165.stdout:4/161: chown d5/d1b/d1c/l1f 54 1 2024-09-06T14:44:23.319 INFO:tasks.workunit.client.1.smithi165.stdout:4/162: read d5/d1b/d1c/d20/f24 [1966933,66273] 0 2024-09-06T14:44:23.321 INFO:tasks.workunit.client.1.smithi165.stdout:9/304: link db/de/d15/f1a db/de/d15/f69 0 2024-09-06T14:44:23.321 INFO:tasks.workunit.client.1.smithi165.stdout:9/305: readlink l5 0 2024-09-06T14:44:23.323 INFO:tasks.workunit.client.1.smithi165.stdout:4/163: unlink d5/f30 0 2024-09-06T14:44:23.328 INFO:tasks.workunit.client.1.smithi165.stdout:5/160: link l0 d6/d1c/d28/d2d/d3c/d44/l45 0 2024-09-06T14:44:23.328 INFO:tasks.workunit.client.0.smithi052.stderr:++ readlink -f fsstress 2024-09-06T14:44:23.329 INFO:tasks.workunit.client.1.smithi165.stdout:5/161: stat d6/d1c/f3a 0 2024-09-06T14:44:23.329 INFO:tasks.workunit.client.1.smithi165.stdout:9/306: write db/de/d15/d17/f47 [962321,58641] 0 2024-09-06T14:44:23.329 INFO:tasks.workunit.client.1.smithi165.stdout:5/162: fdatasync d6/f27 0 2024-09-06T14:44:23.330 INFO:tasks.workunit.client.0.smithi052.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-06T14:44:23.330 INFO:tasks.workunit.client.0.smithi052.stderr:+ popd 2024-09-06T14:44:23.331 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-06T14:44:23.332 INFO:tasks.workunit.client.0.smithi052.stderr:+ popd 2024-09-06T14:44:23.332 INFO:tasks.workunit.client.1.smithi165.stdout:5/163: creat d6/d1c/d28/f46 x:0 0 0 2024-09-06T14:44:23.332 INFO:tasks.workunit.client.0.smithi052.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-06T14:44:23.333 INFO:tasks.workunit.client.0.smithi052.stderr:++ mktemp -d -p . 2024-09-06T14:44:23.333 INFO:tasks.workunit.client.1.smithi165.stdout:9/307: mkdir db/de/d2d/d5a/d61/d6a 0 2024-09-06T14:44:23.336 INFO:tasks.workunit.client.0.smithi052.stderr:+ T=./tmp.NdAH0p6z0x 2024-09-06T14:44:23.336 INFO:tasks.workunit.client.0.smithi052.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.NdAH0p6z0x -l 1 -n 1000 -p 10 -v 2024-09-06T14:44:23.337 INFO:tasks.workunit.client.1.smithi165.stdout:5/164: creat d6/d1c/d28/d2d/d3c/d44/f47 x:0 0 0 2024-09-06T14:44:23.339 INFO:tasks.workunit.client.1.smithi165.stdout:5/165: write d6/f19 [912839,51650] 0 2024-09-06T14:44:23.342 INFO:tasks.workunit.client.0.smithi052.stdout:seed = 1725848762 2024-09-06T14:44:23.346 INFO:tasks.workunit.client.1.smithi165.stdout:5/166: rename d6/f8 to d6/d1c/d28/d2d/d3c/d44/f48 0 2024-09-06T14:44:23.347 INFO:tasks.workunit.client.1.smithi165.stdout:5/167: read - d6/f1a zero size 2024-09-06T14:44:23.348 INFO:tasks.workunit.client.0.smithi052.stdout:0/0: write - no filename 2024-09-06T14:44:23.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/1: dwrite - no filename 2024-09-06T14:44:23.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/2: rename - no filename 2024-09-06T14:44:23.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/3: read - no filename 2024-09-06T14:44:23.349 INFO:tasks.workunit.client.0.smithi052.stdout:0/4: dread - no filename 2024-09-06T14:44:23.349 INFO:tasks.workunit.client.1.smithi165.stdout:9/308: truncate db/de/f2c 1032237 0 2024-09-06T14:44:23.350 INFO:tasks.workunit.client.1.smithi165.stdout:5/168: mkdir d6/d1c/d28/d2d/d49 0 2024-09-06T14:44:23.351 INFO:tasks.workunit.client.0.smithi052.stdout:1/0: fdatasync - no filename 2024-09-06T14:44:23.351 INFO:tasks.workunit.client.0.smithi052.stdout:0/5: mkdir d0 0 2024-09-06T14:44:23.351 INFO:tasks.workunit.client.1.smithi165.stdout:5/169: fdatasync d6/d1c/d28/f36 0 2024-09-06T14:44:23.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/6: chown d0 23 1 2024-09-06T14:44:23.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/7: dread - no filename 2024-09-06T14:44:23.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/8: fdatasync - no filename 2024-09-06T14:44:23.353 INFO:tasks.workunit.client.1.smithi165.stdout:9/309: write db/de/d16/f5e [466775,68012] 0 2024-09-06T14:44:23.354 INFO:tasks.workunit.client.1.smithi165.stdout:4/164: dwrite d5/fc [0,4194304] 0 2024-09-06T14:44:23.354 INFO:tasks.workunit.client.0.smithi052.stdout:3/0: read - no filename 2024-09-06T14:44:23.354 INFO:tasks.workunit.client.0.smithi052.stdout:3/1: chown . 0 1 2024-09-06T14:44:23.355 INFO:tasks.workunit.client.0.smithi052.stdout:1/1: creat f0 x:0 0 0 2024-09-06T14:44:23.355 INFO:tasks.workunit.client.0.smithi052.stdout:1/2: read - f0 zero size 2024-09-06T14:44:23.357 INFO:tasks.workunit.client.0.smithi052.stdout:2/0: creat f0 x:0 0 0 2024-09-06T14:44:23.358 INFO:tasks.workunit.client.0.smithi052.stdout:2/1: rmdir - no directory 2024-09-06T14:44:23.358 INFO:tasks.workunit.client.0.smithi052.stdout:1/3: mkdir d1 0 2024-09-06T14:44:23.358 INFO:tasks.workunit.client.1.smithi165.stdout:6/118: sync 2024-09-06T14:44:23.358 INFO:tasks.workunit.client.1.smithi165.stdout:1/150: sync 2024-09-06T14:44:23.358 INFO:tasks.workunit.client.1.smithi165.stdout:7/57: sync 2024-09-06T14:44:23.359 INFO:tasks.workunit.client.0.smithi052.stdout:2/2: write f0 [719962,21942] 0 2024-09-06T14:44:23.361 INFO:tasks.workunit.client.0.smithi052.stdout:5/0: stat - no entries 2024-09-06T14:44:23.362 INFO:tasks.workunit.client.1.smithi165.stdout:4/165: write d5/d1b/d1c/d20/d26/f28 [401592,108901] 0 2024-09-06T14:44:23.363 INFO:tasks.workunit.client.1.smithi165.stdout:1/151: write d0/d2a/f5 [1258869,52974] 0 2024-09-06T14:44:23.369 INFO:tasks.workunit.client.1.smithi165.stdout:5/170: dwrite d6/d1c/d28/f36 [0,4194304] 0 2024-09-06T14:44:23.369 INFO:tasks.workunit.client.1.smithi165.stdout:9/310: dwrite db/f3a [0,4194304] 0 2024-09-06T14:44:23.370 INFO:tasks.workunit.client.0.smithi052.stdout:2/3: dwrite f0 [0,4194304] 0 2024-09-06T14:44:23.373 INFO:tasks.workunit.client.0.smithi052.stdout:1/4: mknod d1/c2 0 2024-09-06T14:44:23.374 INFO:tasks.workunit.client.1.smithi165.stdout:7/58: write fc [551874,82319] 0 2024-09-06T14:44:23.377 INFO:tasks.workunit.client.0.smithi052.stdout:7/0: chown . 23 1 2024-09-06T14:44:23.377 INFO:tasks.workunit.client.1.smithi165.stdout:1/152: rmdir d0/d2a 39 2024-09-06T14:44:23.380 INFO:tasks.workunit.client.0.smithi052.stdout:5/1: creat f0 x:0 0 0 2024-09-06T14:44:23.381 INFO:tasks.workunit.client.1.smithi165.stdout:9/311: truncate db/de/d15/d17/f5c 947200 0 2024-09-06T14:44:23.383 INFO:tasks.workunit.client.0.smithi052.stdout:5/2: write f0 [1034735,72838] 0 2024-09-06T14:44:23.383 INFO:tasks.workunit.client.1.smithi165.stdout:6/119: dwrite f8 [0,4194304] 0 2024-09-06T14:44:23.386 INFO:tasks.workunit.client.0.smithi052.stdout:1/5: rmdir d1 39 2024-09-06T14:44:23.386 INFO:tasks.workunit.client.0.smithi052.stdout:1/6: dread - f0 zero size 2024-09-06T14:44:23.387 INFO:tasks.workunit.client.1.smithi165.stdout:5/171: symlink d6/d1c/d28/d2d/l4a 0 2024-09-06T14:44:23.387 INFO:tasks.workunit.client.1.smithi165.stdout:6/120: chown c2 307620825 1 2024-09-06T14:44:23.388 INFO:tasks.workunit.client.1.smithi165.stdout:4/166: dwrite d5/d1b/d1c/d20/d26/f32 [0,4194304] 0 2024-09-06T14:44:23.389 INFO:tasks.workunit.client.0.smithi052.stdout:8/0: stat - no entries 2024-09-06T14:44:23.391 INFO:tasks.workunit.client.0.smithi052.stdout:6/0: creat f0 x:0 0 0 2024-09-06T14:44:23.394 INFO:tasks.workunit.client.0.smithi052.stdout:7/1: mknod c0 0 2024-09-06T14:44:23.394 INFO:tasks.workunit.client.0.smithi052.stdout:7/2: truncate - no filename 2024-09-06T14:44:23.394 INFO:tasks.workunit.client.0.smithi052.stdout:9/0: truncate - no filename 2024-09-06T14:44:23.394 INFO:tasks.workunit.client.0.smithi052.stdout:9/1: write - no filename 2024-09-06T14:44:23.395 INFO:tasks.workunit.client.1.smithi165.stdout:6/121: chown ld 474339387 1 2024-09-06T14:44:23.396 INFO:tasks.workunit.client.0.smithi052.stdout:6/1: mknod c1 0 2024-09-06T14:44:23.400 INFO:tasks.workunit.client.0.smithi052.stdout:1/7: dwrite f0 [0,4194304] 0 2024-09-06T14:44:23.401 INFO:tasks.workunit.client.0.smithi052.stdout:6/2: write f0 [860168,93258] 0 2024-09-06T14:44:23.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/1: symlink l0 0 2024-09-06T14:44:23.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/2: readlink l0 0 2024-09-06T14:44:23.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/3: readlink l0 0 2024-09-06T14:44:23.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/4: dread - no filename 2024-09-06T14:44:23.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/5: dwrite - no filename 2024-09-06T14:44:23.402 INFO:tasks.workunit.client.1.smithi165.stdout:5/172: mkdir d6/d1c/d28/d4b 0 2024-09-06T14:44:23.402 INFO:tasks.workunit.client.1.smithi165.stdout:6/122: dread f5 [0,4194304] 0 2024-09-06T14:44:23.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/3: rename c0 to c1 0 2024-09-06T14:44:23.405 INFO:tasks.workunit.client.1.smithi165.stdout:1/153: mknod d0/d2a/d18/c33 0 2024-09-06T14:44:23.408 INFO:tasks.workunit.client.0.smithi052.stdout:8/6: creat f1 x:0 0 0 2024-09-06T14:44:23.409 INFO:tasks.workunit.client.1.smithi165.stdout:6/123: stat l12 0 2024-09-06T14:44:23.409 INFO:tasks.workunit.client.0.smithi052.stdout:8/7: dread - f1 zero size 2024-09-06T14:44:23.409 INFO:tasks.workunit.client.1.smithi165.stdout:5/173: symlink d6/d1c/d28/d4b/l4c 0 2024-09-06T14:44:23.410 INFO:tasks.workunit.client.0.smithi052.stdout:1/8: dwrite f0 [0,4194304] 0 2024-09-06T14:44:23.410 INFO:tasks.workunit.client.0.smithi052.stdout:9/2: getdents . 0 2024-09-06T14:44:23.410 INFO:tasks.workunit.client.0.smithi052.stdout:8/8: dread - f1 zero size 2024-09-06T14:44:23.410 INFO:tasks.workunit.client.0.smithi052.stdout:1/9: readlink - no filename 2024-09-06T14:44:23.413 INFO:tasks.workunit.client.1.smithi165.stdout:5/174: readlink l0 0 2024-09-06T14:44:23.414 INFO:tasks.workunit.client.1.smithi165.stdout:1/154: dwrite d0/d2a/f2f [0,4194304] 0 2024-09-06T14:44:23.414 INFO:tasks.workunit.client.0.smithi052.stdout:1/10: dread f0 [0,4194304] 0 2024-09-06T14:44:23.416 INFO:tasks.workunit.client.0.smithi052.stdout:9/3: mknod c0 0 2024-09-06T14:44:23.416 INFO:tasks.workunit.client.0.smithi052.stdout:9/4: write - no filename 2024-09-06T14:44:23.417 INFO:tasks.workunit.client.0.smithi052.stdout:8/9: mknod c2 0 2024-09-06T14:44:23.417 INFO:tasks.workunit.client.0.smithi052.stdout:8/10: truncate f1 89670 0 2024-09-06T14:44:23.419 INFO:tasks.workunit.client.0.smithi052.stdout:8/11: dread f1 [0,4194304] 0 2024-09-06T14:44:23.419 INFO:tasks.workunit.client.1.smithi165.stdout:1/155: symlink d0/d2a/d1b/l34 0 2024-09-06T14:44:23.420 INFO:tasks.workunit.client.0.smithi052.stdout:8/12: dread f1 [0,4194304] 0 2024-09-06T14:44:23.420 INFO:tasks.workunit.client.0.smithi052.stdout:9/5: mkdir d1 0 2024-09-06T14:44:23.420 INFO:tasks.workunit.client.0.smithi052.stdout:9/6: dwrite - no filename 2024-09-06T14:44:23.420 INFO:tasks.workunit.client.1.smithi165.stdout:1/156: read - d0/d1c/d1d/d22/f32 zero size 2024-09-06T14:44:23.428 INFO:tasks.workunit.client.0.smithi052.stdout:9/7: symlink d1/l2 0 2024-09-06T14:44:23.428 INFO:tasks.workunit.client.0.smithi052.stdout:8/13: link c2 c3 0 2024-09-06T14:44:23.429 INFO:tasks.workunit.client.0.smithi052.stdout:2/4: fdatasync f0 0 2024-09-06T14:44:23.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/8: mknod d1/c3 0 2024-09-06T14:44:23.433 INFO:tasks.workunit.client.0.smithi052.stdout:9/9: mkdir d1/d4 0 2024-09-06T14:44:23.433 INFO:tasks.workunit.client.0.smithi052.stdout:9/10: dwrite - no filename 2024-09-06T14:44:23.433 INFO:tasks.workunit.client.0.smithi052.stdout:9/11: chown d1/d4 733396438 1 2024-09-06T14:44:23.434 INFO:tasks.workunit.client.0.smithi052.stdout:2/5: link f0 f1 0 2024-09-06T14:44:23.434 INFO:tasks.workunit.client.0.smithi052.stdout:2/6: chown f1 4711 1 2024-09-06T14:44:23.434 INFO:tasks.workunit.client.0.smithi052.stdout:2/7: chown f1 175 1 2024-09-06T14:44:23.435 INFO:tasks.workunit.client.0.smithi052.stdout:9/12: creat d1/d4/f5 x:0 0 0 2024-09-06T14:44:23.436 INFO:tasks.workunit.client.0.smithi052.stdout:9/13: write d1/d4/f5 [256137,8662] 0 2024-09-06T14:44:23.438 INFO:tasks.workunit.client.1.smithi165.stdout:9/312: rename db/de/f2c to db/de/d16/f6b 0 2024-09-06T14:44:23.438 INFO:tasks.workunit.client.0.smithi052.stdout:1/11: write f0 [4740309,38038] 0 2024-09-06T14:44:23.439 INFO:tasks.workunit.client.0.smithi052.stdout:2/8: link f0 f2 0 2024-09-06T14:44:23.439 INFO:tasks.workunit.client.1.smithi165.stdout:9/313: chown db/de/d2d/d5a/f5f 13788 1 2024-09-06T14:44:23.441 INFO:tasks.workunit.client.1.smithi165.stdout:6/124: dread f6 [0,4194304] 0 2024-09-06T14:44:23.443 INFO:tasks.workunit.client.1.smithi165.stdout:9/314: fdatasync db/de/d15/d17/f45 0 2024-09-06T14:44:23.444 INFO:tasks.workunit.client.1.smithi165.stdout:9/315: dread - db/f57 zero size 2024-09-06T14:44:23.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/14: dwrite d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:23.445 INFO:tasks.workunit.client.1.smithi165.stdout:4/167: truncate d5/d1b/d1c/d20/d26/f32 2232955 0 2024-09-06T14:44:23.446 INFO:tasks.workunit.client.0.smithi052.stdout:2/9: dread f2 [0,4194304] 0 2024-09-06T14:44:23.447 INFO:tasks.workunit.client.0.smithi052.stdout:1/12: symlink d1/l3 0 2024-09-06T14:44:23.447 INFO:tasks.workunit.client.0.smithi052.stdout:1/13: chown d1 3 1 2024-09-06T14:44:23.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/4: rename c1 to c2 0 2024-09-06T14:44:23.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/3: truncate f0 661298 0 2024-09-06T14:44:23.454 INFO:tasks.workunit.client.1.smithi165.stdout:4/168: dwrite d5/fc [0,4194304] 0 2024-09-06T14:44:23.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/14: dwrite f0 [0,4194304] 0 2024-09-06T14:44:23.460 INFO:tasks.workunit.client.0.smithi052.stdout:2/10: write f0 [4867403,54723] 0 2024-09-06T14:44:23.460 INFO:tasks.workunit.client.1.smithi165.stdout:1/157: getdents d0/d2a/d1b 0 2024-09-06T14:44:23.463 INFO:tasks.workunit.client.1.smithi165.stdout:5/175: truncate d6/f37 1305341 0 2024-09-06T14:44:23.464 INFO:tasks.workunit.client.1.smithi165.stdout:9/316: dread db/f1c [0,4194304] 0 2024-09-06T14:44:23.466 INFO:tasks.workunit.client.1.smithi165.stdout:9/317: truncate db/d40/f53 891430 0 2024-09-06T14:44:23.473 INFO:tasks.workunit.client.1.smithi165.stdout:5/176: symlink d6/d1c/d28/d2d/d49/l4d 0 2024-09-06T14:44:23.473 INFO:tasks.workunit.client.0.smithi052.stdout:9/15: fsync d1/d4/f5 0 2024-09-06T14:44:23.474 INFO:tasks.workunit.client.1.smithi165.stdout:3/103: sync 2024-09-06T14:44:23.475 INFO:tasks.workunit.client.1.smithi165.stdout:3/104: chown d1/da/dc 0 1 2024-09-06T14:44:23.477 INFO:tasks.workunit.client.1.smithi165.stdout:0/203: sync 2024-09-06T14:44:23.477 INFO:tasks.workunit.client.0.smithi052.stdout:9/16: mkdir d1/d4/d6 0 2024-09-06T14:44:23.479 INFO:tasks.workunit.client.1.smithi165.stdout:5/177: creat d6/d1c/d28/d2d/d49/f4e x:0 0 0 2024-09-06T14:44:23.480 INFO:tasks.workunit.client.0.smithi052.stdout:2/11: dwrite f0 [0,4194304] 0 2024-09-06T14:44:23.480 INFO:tasks.workunit.client.1.smithi165.stdout:4/169: write d5/d1b/d1c/d20/d26/f32 [2076394,14023] 0 2024-09-06T14:44:23.480 INFO:tasks.workunit.client.1.smithi165.stdout:3/105: dread d1/f1b [0,4194304] 0 2024-09-06T14:44:23.482 INFO:tasks.workunit.client.1.smithi165.stdout:5/178: stat d6/d1c/d28/d2d/d49/l4d 0 2024-09-06T14:44:23.482 INFO:tasks.workunit.client.0.smithi052.stdout:9/17: creat d1/d4/f7 x:0 0 0 2024-09-06T14:44:23.483 INFO:tasks.workunit.client.1.smithi165.stdout:4/170: write f2 [4879372,62800] 0 2024-09-06T14:44:23.483 INFO:tasks.workunit.client.1.smithi165.stdout:3/106: read - d1/da/dc/d10/f1a zero size 2024-09-06T14:44:23.484 INFO:tasks.workunit.client.0.smithi052.stdout:9/18: write d1/d4/f7 [356915,39707] 0 2024-09-06T14:44:23.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/179: write d6/f1d [364864,50820] 0 2024-09-06T14:44:23.486 INFO:tasks.workunit.client.1.smithi165.stdout:3/107: write d1/f11 [6586183,112352] 0 2024-09-06T14:44:23.486 INFO:tasks.workunit.client.0.smithi052.stdout:9/19: write d1/d4/f7 [1052160,93529] 0 2024-09-06T14:44:23.486 INFO:tasks.workunit.client.0.smithi052.stdout:9/20: chown d1 3687479 1 2024-09-06T14:44:23.486 INFO:tasks.workunit.client.0.smithi052.stdout:2/12: symlink l3 0 2024-09-06T14:44:23.487 INFO:tasks.workunit.client.1.smithi165.stdout:3/108: readlink d1/l9 0 2024-09-06T14:44:23.488 INFO:tasks.workunit.client.0.smithi052.stdout:6/4: read f0 [271442,4899] 0 2024-09-06T14:44:23.488 INFO:tasks.workunit.client.0.smithi052.stdout:7/5: rename c2 to c3 0 2024-09-06T14:44:23.493 INFO:tasks.workunit.client.0.smithi052.stdout:9/21: dread d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:23.493 INFO:tasks.workunit.client.1.smithi165.stdout:5/180: stat d6/cd 0 2024-09-06T14:44:23.494 INFO:tasks.workunit.client.1.smithi165.stdout:5/181: write d6/f24 [1523649,117127] 0 2024-09-06T14:44:23.496 INFO:tasks.workunit.client.1.smithi165.stdout:3/109: dread d1/da/dd/f15 [0,4194304] 0 2024-09-06T14:44:23.496 INFO:tasks.workunit.client.0.smithi052.stdout:2/13: dwrite f0 [0,4194304] 0 2024-09-06T14:44:23.497 INFO:tasks.workunit.client.0.smithi052.stdout:9/22: creat d1/f8 x:0 0 0 2024-09-06T14:44:23.500 INFO:tasks.workunit.client.0.smithi052.stdout:2/14: mknod c4 0 2024-09-06T14:44:23.505 INFO:tasks.workunit.client.1.smithi165.stdout:5/182: creat d6/d1c/d28/f4f x:0 0 0 2024-09-06T14:44:23.505 INFO:tasks.workunit.client.1.smithi165.stdout:5/183: stat d6/d32/f3f 0 2024-09-06T14:44:23.506 INFO:tasks.workunit.client.0.smithi052.stdout:1/15: truncate f0 3094678 0 2024-09-06T14:44:23.506 INFO:tasks.workunit.client.1.smithi165.stdout:0/204: getdents d15/d19/d28/d3a 0 2024-09-06T14:44:23.507 INFO:tasks.workunit.client.1.smithi165.stdout:0/205: write d15/f16 [3991969,122703] 0 2024-09-06T14:44:23.510 INFO:tasks.workunit.client.1.smithi165.stdout:9/318: truncate db/f3a 1623745 0 2024-09-06T14:44:23.514 INFO:tasks.workunit.client.0.smithi052.stdout:1/16: rmdir d1 39 2024-09-06T14:44:23.515 INFO:tasks.workunit.client.1.smithi165.stdout:4/171: getdents d5/d1b/d1c/d20 0 2024-09-06T14:44:23.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/6: chown c3 1608464720 1 2024-09-06T14:44:23.516 INFO:tasks.workunit.client.1.smithi165.stdout:3/110: dwrite d1/f8 [0,4194304] 0 2024-09-06T14:44:23.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/7: chown c3 40380 1 2024-09-06T14:44:23.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/8: write - no filename 2024-09-06T14:44:23.517 INFO:tasks.workunit.client.0.smithi052.stdout:7/9: dwrite - no filename 2024-09-06T14:44:23.517 INFO:tasks.workunit.client.1.smithi165.stdout:9/319: mkdir db/de/d2d/d6c 0 2024-09-06T14:44:23.519 INFO:tasks.workunit.client.1.smithi165.stdout:5/184: unlink d6/d1c/d28/d2d/d3c/d44/f48 0 2024-09-06T14:44:23.520 INFO:tasks.workunit.client.1.smithi165.stdout:5/185: write d6/f21 [383507,54743] 0 2024-09-06T14:44:23.521 INFO:tasks.workunit.client.0.smithi052.stdout:7/10: rename c3 to c4 0 2024-09-06T14:44:23.521 INFO:tasks.workunit.client.0.smithi052.stdout:7/11: truncate - no filename 2024-09-06T14:44:23.521 INFO:tasks.workunit.client.0.smithi052.stdout:7/12: fsync - no filename 2024-09-06T14:44:23.521 INFO:tasks.workunit.client.0.smithi052.stdout:7/13: dread - no filename 2024-09-06T14:44:23.521 INFO:tasks.workunit.client.1.smithi165.stdout:5/186: write d6/d1c/d28/f46 [506168,1522] 0 2024-09-06T14:44:23.525 INFO:tasks.workunit.client.0.smithi052.stdout:7/14: creat f5 x:0 0 0 2024-09-06T14:44:23.527 INFO:tasks.workunit.client.1.smithi165.stdout:9/320: unlink db/de/l1e 0 2024-09-06T14:44:23.529 INFO:tasks.workunit.client.0.smithi052.stdout:7/15: symlink l6 0 2024-09-06T14:44:23.530 INFO:tasks.workunit.client.0.smithi052.stdout:7/16: readlink l6 0 2024-09-06T14:44:23.530 INFO:tasks.workunit.client.1.smithi165.stdout:5/187: dwrite d6/d1c/d28/d2d/d3c/d44/f47 [0,4194304] 0 2024-09-06T14:44:23.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/17: read - f5 zero size 2024-09-06T14:44:23.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/18: fdatasync f5 0 2024-09-06T14:44:23.532 INFO:tasks.workunit.client.1.smithi165.stdout:3/111: unlink d1/da/dc/c13 0 2024-09-06T14:44:23.532 INFO:tasks.workunit.client.1.smithi165.stdout:5/188: chown d6 9719642 1 2024-09-06T14:44:23.532 INFO:tasks.workunit.client.0.smithi052.stdout:1/17: fsync f0 0 2024-09-06T14:44:23.533 INFO:tasks.workunit.client.1.smithi165.stdout:0/206: link d15/d19/f27 d15/d19/f46 0 2024-09-06T14:44:23.535 INFO:tasks.workunit.client.1.smithi165.stdout:3/112: write d1/f11 [6225873,66572] 0 2024-09-06T14:44:23.535 INFO:tasks.workunit.client.0.smithi052.stdout:7/19: creat f7 x:0 0 0 2024-09-06T14:44:23.536 INFO:tasks.workunit.client.0.smithi052.stdout:9/23: truncate d1/d4/f7 470033 0 2024-09-06T14:44:23.537 INFO:tasks.workunit.client.0.smithi052.stdout:1/18: dread f0 [0,4194304] 0 2024-09-06T14:44:23.538 INFO:tasks.workunit.client.1.smithi165.stdout:4/172: dwrite d5/d1b/d1c/d20/d26/f2a [0,4194304] 0 2024-09-06T14:44:23.539 INFO:tasks.workunit.client.0.smithi052.stdout:2/15: truncate f2 2264668 0 2024-09-06T14:44:23.540 INFO:tasks.workunit.client.0.smithi052.stdout:7/20: mknod c8 0 2024-09-06T14:44:23.541 INFO:tasks.workunit.client.0.smithi052.stdout:7/21: dread - f7 zero size 2024-09-06T14:44:23.541 INFO:tasks.workunit.client.0.smithi052.stdout:7/22: dread - f5 zero size 2024-09-06T14:44:23.542 INFO:tasks.workunit.client.0.smithi052.stdout:7/23: truncate f5 1002177 0 2024-09-06T14:44:23.543 INFO:tasks.workunit.client.0.smithi052.stdout:9/24: rmdir d1/d4 39 2024-09-06T14:44:23.546 INFO:tasks.workunit.client.1.smithi165.stdout:3/113: dwrite d1/da/dd/f1c [0,4194304] 0 2024-09-06T14:44:23.547 INFO:tasks.workunit.client.1.smithi165.stdout:0/207: creat d15/d19/d38/f47 x:0 0 0 2024-09-06T14:44:23.549 INFO:tasks.workunit.client.1.smithi165.stdout:9/321: unlink db/fd 0 2024-09-06T14:44:23.549 INFO:tasks.workunit.client.1.smithi165.stdout:9/322: stat db/d22/l27 0 2024-09-06T14:44:23.554 INFO:tasks.workunit.client.1.smithi165.stdout:4/173: truncate d5/d1b/d1c/d20/f24 1299588 0 2024-09-06T14:44:23.555 INFO:tasks.workunit.client.0.smithi052.stdout:1/19: truncate f0 1570842 0 2024-09-06T14:44:23.556 INFO:tasks.workunit.client.1.smithi165.stdout:4/174: write d5/f13 [2734928,15201] 0 2024-09-06T14:44:23.556 INFO:tasks.workunit.client.1.smithi165.stdout:4/175: write d5/f13 [962402,7455] 0 2024-09-06T14:44:23.557 INFO:tasks.workunit.client.1.smithi165.stdout:4/176: chown d5/l12 0 1 2024-09-06T14:44:23.560 INFO:tasks.workunit.client.0.smithi052.stdout:9/25: creat d1/d4/f9 x:0 0 0 2024-09-06T14:44:23.561 INFO:tasks.workunit.client.0.smithi052.stdout:9/26: dread - d1/f8 zero size 2024-09-06T14:44:23.561 INFO:tasks.workunit.client.1.smithi165.stdout:8/185: sync 2024-09-06T14:44:23.562 INFO:tasks.workunit.client.1.smithi165.stdout:2/162: sync 2024-09-06T14:44:23.562 INFO:tasks.workunit.client.1.smithi165.stdout:7/59: sync 2024-09-06T14:44:23.562 INFO:tasks.workunit.client.1.smithi165.stdout:3/114: creat d1/da/dd/f20 x:0 0 0 2024-09-06T14:44:23.563 INFO:tasks.workunit.client.1.smithi165.stdout:8/186: fdatasync d0/d14/f25 0 2024-09-06T14:44:23.563 INFO:tasks.workunit.client.1.smithi165.stdout:9/323: creat db/de/d2d/d5a/f6d x:0 0 0 2024-09-06T14:44:23.563 INFO:tasks.workunit.client.0.smithi052.stdout:2/16: link l3 l5 0 2024-09-06T14:44:23.563 INFO:tasks.workunit.client.0.smithi052.stdout:2/17: chown f1 796 1 2024-09-06T14:44:23.565 INFO:tasks.workunit.client.0.smithi052.stdout:2/18: mknod c6 0 2024-09-06T14:44:23.567 INFO:tasks.workunit.client.0.smithi052.stdout:9/27: creat d1/fa x:0 0 0 2024-09-06T14:44:23.569 INFO:tasks.workunit.client.1.smithi165.stdout:2/163: symlink d9/d23/d29/l2f 0 2024-09-06T14:44:23.569 INFO:tasks.workunit.client.1.smithi165.stdout:5/189: getdents d6/d32 0 2024-09-06T14:44:23.570 INFO:tasks.workunit.client.1.smithi165.stdout:2/164: truncate d9/f1e 310883 0 2024-09-06T14:44:23.572 INFO:tasks.workunit.client.1.smithi165.stdout:8/187: mknod d0/d34/c48 0 2024-09-06T14:44:23.574 INFO:tasks.workunit.client.1.smithi165.stdout:8/188: read - d0/d19/d36/f44 zero size 2024-09-06T14:44:23.574 INFO:tasks.workunit.client.0.smithi052.stdout:2/19: dwrite f1 [0,4194304] 0 2024-09-06T14:44:23.575 INFO:tasks.workunit.client.1.smithi165.stdout:8/189: chown d0/d19/d36/d2d/f38 23194 1 2024-09-06T14:44:23.576 INFO:tasks.workunit.client.1.smithi165.stdout:2/165: stat d9/d23/d29/c2c 0 2024-09-06T14:44:23.578 INFO:tasks.workunit.client.0.smithi052.stdout:2/20: dread f0 [0,4194304] 0 2024-09-06T14:44:23.578 INFO:tasks.workunit.client.1.smithi165.stdout:7/60: rename fc to f10 0 2024-09-06T14:44:23.582 INFO:tasks.workunit.client.0.smithi052.stdout:1/20: dread f0 [0,4194304] 0 2024-09-06T14:44:23.584 INFO:tasks.workunit.client.1.smithi165.stdout:8/190: stat d0/fc 0 2024-09-06T14:44:23.584 INFO:tasks.workunit.client.1.smithi165.stdout:0/208: write ff [1022739,56055] 0 2024-09-06T14:44:23.592 INFO:tasks.workunit.client.1.smithi165.stdout:0/209: dwrite ff [0,4194304] 0 2024-09-06T14:44:23.592 INFO:tasks.workunit.client.1.smithi165.stdout:4/177: truncate d5/fc 642467 0 2024-09-06T14:44:23.593 INFO:tasks.workunit.client.0.smithi052.stdout:2/21: getdents . 0 2024-09-06T14:44:23.595 INFO:tasks.workunit.client.1.smithi165.stdout:2/166: creat d9/d23/d26/f30 x:0 0 0 2024-09-06T14:44:23.595 INFO:tasks.workunit.client.0.smithi052.stdout:2/22: creat f7 x:0 0 0 2024-09-06T14:44:23.596 INFO:tasks.workunit.client.1.smithi165.stdout:7/61: symlink l11 0 2024-09-06T14:44:23.598 INFO:tasks.workunit.client.1.smithi165.stdout:4/178: mknod d5/d1b/d1c/d20/c35 0 2024-09-06T14:44:23.598 INFO:tasks.workunit.client.1.smithi165.stdout:2/167: stat d9/f18 0 2024-09-06T14:44:23.599 INFO:tasks.workunit.client.0.smithi052.stdout:1/21: write f0 [2098960,24311] 0 2024-09-06T14:44:23.600 INFO:tasks.workunit.client.0.smithi052.stdout:1/22: readlink d1/l3 0 2024-09-06T14:44:23.601 INFO:tasks.workunit.client.0.smithi052.stdout:2/23: link c4 c8 0 2024-09-06T14:44:23.601 INFO:tasks.workunit.client.0.smithi052.stdout:1/23: read f0 [526561,84840] 0 2024-09-06T14:44:23.602 INFO:tasks.workunit.client.1.smithi165.stdout:5/190: write d6/f37 [1325801,18710] 0 2024-09-06T14:44:23.605 INFO:tasks.workunit.client.1.smithi165.stdout:4/179: rmdir d5/d1b/d1c 39 2024-09-06T14:44:23.605 INFO:tasks.workunit.client.1.smithi165.stdout:7/62: write f3 [780631,64787] 0 2024-09-06T14:44:23.606 INFO:tasks.workunit.client.0.smithi052.stdout:2/24: write f2 [5161896,42330] 0 2024-09-06T14:44:23.606 INFO:tasks.workunit.client.1.smithi165.stdout:5/191: fdatasync d6/d1c/f26 0 2024-09-06T14:44:23.606 INFO:tasks.workunit.client.0.smithi052.stdout:2/25: write f1 [1286233,74409] 0 2024-09-06T14:44:23.607 INFO:tasks.workunit.client.0.smithi052.stdout:2/26: write f7 [623412,78516] 0 2024-09-06T14:44:23.609 INFO:tasks.workunit.client.0.smithi052.stdout:1/24: creat d1/f4 x:0 0 0 2024-09-06T14:44:23.609 INFO:tasks.workunit.client.1.smithi165.stdout:0/210: dwrite d15/f32 [0,4194304] 0 2024-09-06T14:44:23.611 INFO:tasks.workunit.client.1.smithi165.stdout:5/192: chown d6/d1c/d28/d2d/l4a 19768 1 2024-09-06T14:44:23.612 INFO:tasks.workunit.client.1.smithi165.stdout:8/191: getdents d0/d14 0 2024-09-06T14:44:23.613 INFO:tasks.workunit.client.1.smithi165.stdout:5/193: stat d6/l12 0 2024-09-06T14:44:23.615 INFO:tasks.workunit.client.1.smithi165.stdout:2/168: dread d9/d23/f28 [0,4194304] 0 2024-09-06T14:44:23.615 INFO:tasks.workunit.client.1.smithi165.stdout:9/324: dwrite db/de/d15/f48 [0,4194304] 0 2024-09-06T14:44:23.617 INFO:tasks.workunit.client.0.smithi052.stdout:1/25: mkdir d1/d5 0 2024-09-06T14:44:23.617 INFO:tasks.workunit.client.1.smithi165.stdout:5/194: write d6/d1c/f38 [212614,54346] 0 2024-09-06T14:44:23.618 INFO:tasks.workunit.client.1.smithi165.stdout:5/195: chown d6/lc 45626 1 2024-09-06T14:44:23.619 INFO:tasks.workunit.client.0.smithi052.stdout:1/26: dread - d1/f4 zero size 2024-09-06T14:44:23.619 INFO:tasks.workunit.client.0.smithi052.stdout:1/27: chown d1/f4 1 1 2024-09-06T14:44:23.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/27: chown c8 722 1 2024-09-06T14:44:23.619 INFO:tasks.workunit.client.0.smithi052.stdout:1/28: stat d1/d5 0 2024-09-06T14:44:23.621 INFO:tasks.workunit.client.0.smithi052.stdout:1/29: fdatasync f0 0 2024-09-06T14:44:23.624 INFO:tasks.workunit.client.1.smithi165.stdout:5/196: mknod d6/d1c/d28/d2d/d49/c50 0 2024-09-06T14:44:23.625 INFO:tasks.workunit.client.0.smithi052.stdout:1/30: getdents d1/d5 0 2024-09-06T14:44:23.627 INFO:tasks.workunit.client.1.smithi165.stdout:2/169: symlink d9/d23/l31 0 2024-09-06T14:44:23.627 INFO:tasks.workunit.client.1.smithi165.stdout:8/192: mkdir d0/d19/d36/d2d/d33/d3a/d46/d49 0 2024-09-06T14:44:23.628 INFO:tasks.workunit.client.1.smithi165.stdout:5/197: mknod d6/d1c/d28/d2d/d3c/d44/c51 0 2024-09-06T14:44:23.630 INFO:tasks.workunit.client.1.smithi165.stdout:5/198: symlink d6/l52 0 2024-09-06T14:44:23.631 INFO:tasks.workunit.client.1.smithi165.stdout:8/193: creat d0/d19/d36/d2d/d33/d3a/d46/d49/f4a x:0 0 0 2024-09-06T14:44:23.634 INFO:tasks.workunit.client.1.smithi165.stdout:5/199: write d6/d1c/f22 [3404270,91422] 0 2024-09-06T14:44:23.634 INFO:tasks.workunit.client.1.smithi165.stdout:4/180: dwrite d5/d1b/d1c/d20/f27 [0,4194304] 0 2024-09-06T14:44:23.635 INFO:tasks.workunit.client.1.smithi165.stdout:5/200: chown d6/l52 291 1 2024-09-06T14:44:23.636 INFO:tasks.workunit.client.0.smithi052.stdout:1/31: write f0 [627913,39648] 0 2024-09-06T14:44:23.641 INFO:tasks.workunit.client.1.smithi165.stdout:5/201: rename d6/f20 to d6/d1c/d28/d2d/f53 0 2024-09-06T14:44:23.642 INFO:tasks.workunit.client.1.smithi165.stdout:9/325: write db/de/d15/f1a [2421764,62886] 0 2024-09-06T14:44:23.646 INFO:tasks.workunit.client.1.smithi165.stdout:8/194: dwrite d0/d19/d36/f2e [0,4194304] 0 2024-09-06T14:44:23.646 INFO:tasks.workunit.client.0.smithi052.stdout:1/32: rmdir d1/d5 0 2024-09-06T14:44:23.649 INFO:tasks.workunit.client.0.smithi052.stdout:1/33: unlink f0 0 2024-09-06T14:44:23.649 INFO:tasks.workunit.client.1.smithi165.stdout:4/181: dwrite d5/f2c [0,4194304] 0 2024-09-06T14:44:23.651 INFO:tasks.workunit.client.0.smithi052.stdout:1/34: mknod d1/c6 0 2024-09-06T14:44:23.651 INFO:tasks.workunit.client.0.smithi052.stdout:1/35: truncate d1/f4 468063 0 2024-09-06T14:44:23.651 INFO:tasks.workunit.client.0.smithi052.stdout:1/36: stat d1/c6 0 2024-09-06T14:44:23.654 INFO:tasks.workunit.client.1.smithi165.stdout:5/202: rename l0 to d6/d1c/d28/d4b/l54 0 2024-09-06T14:44:23.654 INFO:tasks.workunit.client.0.smithi052.stdout:1/37: rename d1/c6 to d1/c7 0 2024-09-06T14:44:23.656 INFO:tasks.workunit.client.0.smithi052.stdout:1/38: creat d1/f8 x:0 0 0 2024-09-06T14:44:23.656 INFO:tasks.workunit.client.0.smithi052.stdout:1/39: chown d1/f4 11839097 1 2024-09-06T14:44:23.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/40: creat d1/f9 x:0 0 0 2024-09-06T14:44:23.660 INFO:tasks.workunit.client.1.smithi165.stdout:6/125: sync 2024-09-06T14:44:23.661 INFO:tasks.workunit.client.1.smithi165.stdout:1/158: sync 2024-09-06T14:44:23.663 INFO:tasks.workunit.client.1.smithi165.stdout:4/182: fsync d5/d1b/d1c/f34 0 2024-09-06T14:44:23.665 INFO:tasks.workunit.client.1.smithi165.stdout:9/326: link db/de/d2d/c2f db/de/c6e 0 2024-09-06T14:44:23.666 INFO:tasks.workunit.client.0.smithi052.stdout:1/41: dwrite d1/f9 [0,4194304] 0 2024-09-06T14:44:23.667 INFO:tasks.workunit.client.0.smithi052.stdout:1/42: dread d1/f4 [0,4194304] 0 2024-09-06T14:44:23.667 INFO:tasks.workunit.client.1.smithi165.stdout:5/203: dwrite d6/d1c/f22 [0,4194304] 0 2024-09-06T14:44:23.670 INFO:tasks.workunit.client.0.smithi052.stdout:1/43: fdatasync d1/f4 0 2024-09-06T14:44:23.671 INFO:tasks.workunit.client.1.smithi165.stdout:5/204: fsync d6/f1a 0 2024-09-06T14:44:23.671 INFO:tasks.workunit.client.1.smithi165.stdout:8/195: dwrite d0/d14/f2c [0,4194304] 0 2024-09-06T14:44:23.675 INFO:tasks.workunit.client.1.smithi165.stdout:8/196: write d0/d19/d36/f12 [49194,52975] 0 2024-09-06T14:44:23.677 INFO:tasks.workunit.client.1.smithi165.stdout:4/183: creat d5/d1b/f36 x:0 0 0 2024-09-06T14:44:23.678 INFO:tasks.workunit.client.1.smithi165.stdout:6/126: getdents . 0 2024-09-06T14:44:23.679 INFO:tasks.workunit.client.0.smithi052.stdout:1/44: dwrite d1/f8 [0,4194304] 0 2024-09-06T14:44:23.679 INFO:tasks.workunit.client.0.smithi052.stdout:1/45: stat d1/f8 0 2024-09-06T14:44:23.680 INFO:tasks.workunit.client.1.smithi165.stdout:5/205: mkdir d6/d1c/d28/d4b/d55 0 2024-09-06T14:44:23.683 INFO:tasks.workunit.client.1.smithi165.stdout:5/206: dread - d6/f2a zero size 2024-09-06T14:44:23.684 INFO:tasks.workunit.client.1.smithi165.stdout:1/159: dread d0/d2a/fe [0,4194304] 0 2024-09-06T14:44:23.685 INFO:tasks.workunit.client.0.smithi052.stdout:1/46: dread d1/f8 [0,4194304] 0 2024-09-06T14:44:23.687 INFO:tasks.workunit.client.1.smithi165.stdout:4/184: symlink d5/d1b/d1c/l37 0 2024-09-06T14:44:23.688 INFO:tasks.workunit.client.0.smithi052.stdout:1/47: mkdir d1/da 0 2024-09-06T14:44:23.689 INFO:tasks.workunit.client.0.smithi052.stdout:1/48: truncate d1/f9 4689443 0 2024-09-06T14:44:23.692 INFO:tasks.workunit.client.1.smithi165.stdout:9/327: dwrite db/de/d16/f66 [0,4194304] 0 2024-09-06T14:44:23.693 INFO:tasks.workunit.client.1.smithi165.stdout:6/127: dread f8 [0,4194304] 0 2024-09-06T14:44:23.693 INFO:tasks.workunit.client.0.smithi052.stdout:1/49: dread d1/f9 [0,4194304] 0 2024-09-06T14:44:23.694 INFO:tasks.workunit.client.1.smithi165.stdout:4/185: creat d5/d1b/d1c/d20/d26/f38 x:0 0 0 2024-09-06T14:44:23.695 INFO:tasks.workunit.client.0.smithi052.stdout:1/50: mkdir d1/db 0 2024-09-06T14:44:23.696 INFO:tasks.workunit.client.1.smithi165.stdout:5/207: chown l1 1528 1 2024-09-06T14:44:23.696 INFO:tasks.workunit.client.0.smithi052.stdout:1/51: dread d1/f4 [0,4194304] 0 2024-09-06T14:44:23.697 INFO:tasks.workunit.client.1.smithi165.stdout:9/328: symlink db/de/d16/d2e/l6f 0 2024-09-06T14:44:23.697 INFO:tasks.workunit.client.1.smithi165.stdout:9/329: chown db/de/d2d/f31 3 1 2024-09-06T14:44:23.699 INFO:tasks.workunit.client.1.smithi165.stdout:6/128: write f17 [7166674,14150] 0 2024-09-06T14:44:23.700 INFO:tasks.workunit.client.1.smithi165.stdout:4/186: creat d5/d1b/d1c/f39 x:0 0 0 2024-09-06T14:44:23.701 INFO:tasks.workunit.client.1.smithi165.stdout:9/330: creat db/de/d16/d2e/f70 x:0 0 0 2024-09-06T14:44:23.703 INFO:tasks.workunit.client.1.smithi165.stdout:5/208: unlink d6/l12 0 2024-09-06T14:44:23.703 INFO:tasks.workunit.client.1.smithi165.stdout:9/331: dread - db/de/d15/f2b zero size 2024-09-06T14:44:23.715 INFO:tasks.workunit.client.1.smithi165.stdout:9/332: rmdir db/de/d2d/d5a/d61/d6a 0 2024-09-06T14:44:23.717 INFO:tasks.workunit.client.1.smithi165.stdout:4/187: dwrite f2 [0,4194304] 0 2024-09-06T14:44:23.717 INFO:tasks.workunit.client.1.smithi165.stdout:5/209: dwrite d6/f1d [0,4194304] 0 2024-09-06T14:44:23.717 INFO:tasks.workunit.client.1.smithi165.stdout:8/197: truncate d0/d14/f2c 1596630 0 2024-09-06T14:44:23.719 INFO:tasks.workunit.client.0.smithi052.stdout:1/52: getdents d1 0 2024-09-06T14:44:23.721 INFO:tasks.workunit.client.0.smithi052.stdout:1/53: write d1/f8 [3514008,90413] 0 2024-09-06T14:44:23.725 INFO:tasks.workunit.client.1.smithi165.stdout:4/188: symlink d5/d1b/d1c/l3a 0 2024-09-06T14:44:23.725 INFO:tasks.workunit.client.1.smithi165.stdout:6/129: truncate f8 480228 0 2024-09-06T14:44:23.727 INFO:tasks.workunit.client.0.smithi052.stdout:1/54: dwrite d1/f8 [0,4194304] 0 2024-09-06T14:44:23.730 INFO:tasks.workunit.client.1.smithi165.stdout:4/189: dread - d5/d1b/d1c/d20/d26/f38 zero size 2024-09-06T14:44:23.732 INFO:tasks.workunit.client.1.smithi165.stdout:6/130: rename f1a to f1c 0 2024-09-06T14:44:23.737 INFO:tasks.workunit.client.1.smithi165.stdout:9/333: dwrite db/de/d15/f2b [0,4194304] 0 2024-09-06T14:44:23.738 INFO:tasks.workunit.client.1.smithi165.stdout:8/198: dwrite d0/f1a [0,4194304] 0 2024-09-06T14:44:23.739 INFO:tasks.workunit.client.1.smithi165.stdout:1/160: dread d0/d2a/fd [0,4194304] 0 2024-09-06T14:44:23.739 INFO:tasks.workunit.client.1.smithi165.stdout:6/131: rename fa to f1d 0 2024-09-06T14:44:23.740 INFO:tasks.workunit.client.0.smithi052.stdout:1/55: dwrite d1/f9 [4194304,4194304] 0 2024-09-06T14:44:23.741 INFO:tasks.workunit.client.1.smithi165.stdout:1/161: chown d0/f7 205584337 1 2024-09-06T14:44:23.742 INFO:tasks.workunit.client.0.smithi052.stdout:1/56: stat d1/db 0 2024-09-06T14:44:23.742 INFO:tasks.workunit.client.1.smithi165.stdout:9/334: readlink db/de/l20 0 2024-09-06T14:44:23.745 INFO:tasks.workunit.client.1.smithi165.stdout:8/199: readlink d0/l27 0 2024-09-06T14:44:23.745 INFO:tasks.workunit.client.1.smithi165.stdout:9/335: write db/de/d2d/d5a/f6d [314899,66977] 0 2024-09-06T14:44:23.745 INFO:tasks.workunit.client.0.smithi052.stdout:1/57: creat d1/da/fc x:0 0 0 2024-09-06T14:44:23.746 INFO:tasks.workunit.client.1.smithi165.stdout:9/336: readlink db/de/d16/l21 0 2024-09-06T14:44:23.746 INFO:tasks.workunit.client.1.smithi165.stdout:8/200: chown d0/f17 1627 1 2024-09-06T14:44:23.747 INFO:tasks.workunit.client.0.smithi052.stdout:1/58: truncate d1/da/fc 735772 0 2024-09-06T14:44:23.748 INFO:tasks.workunit.client.0.smithi052.stdout:1/59: write d1/f4 [1062551,91421] 0 2024-09-06T14:44:23.749 INFO:tasks.workunit.client.1.smithi165.stdout:9/337: readlink db/de/d15/d17/d18/l4e 0 2024-09-06T14:44:23.750 INFO:tasks.workunit.client.1.smithi165.stdout:8/201: stat d0/d19 0 2024-09-06T14:44:23.751 INFO:tasks.workunit.client.1.smithi165.stdout:6/132: creat f1e x:0 0 0 2024-09-06T14:44:23.751 INFO:tasks.workunit.client.1.smithi165.stdout:9/338: readlink db/de/d15/d17/d18/l4e 0 2024-09-06T14:44:23.752 INFO:tasks.workunit.client.1.smithi165.stdout:9/339: chown db/f1c 7350520 1 2024-09-06T14:44:23.754 INFO:tasks.workunit.client.0.smithi052.stdout:1/60: creat d1/db/fd x:0 0 0 2024-09-06T14:44:23.756 INFO:tasks.workunit.client.0.smithi052.stdout:1/61: write d1/da/fc [1246760,62605] 0 2024-09-06T14:44:23.758 INFO:tasks.workunit.client.1.smithi165.stdout:1/162: getdents d0/d2a 0 2024-09-06T14:44:23.758 INFO:tasks.workunit.client.1.smithi165.stdout:9/340: symlink db/d40/l71 0 2024-09-06T14:44:23.760 INFO:tasks.workunit.client.0.smithi052.stdout:1/62: mkdir d1/db/de 0 2024-09-06T14:44:23.760 INFO:tasks.workunit.client.0.smithi052.stdout:1/63: readlink d1/l3 0 2024-09-06T14:44:23.760 INFO:tasks.workunit.client.1.smithi165.stdout:4/190: dread d5/d1b/d1c/d20/d26/f28 [0,4194304] 0 2024-09-06T14:44:23.762 INFO:tasks.workunit.client.1.smithi165.stdout:6/133: link f1d f1f 0 2024-09-06T14:44:23.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/64: creat d1/da/ff x:0 0 0 2024-09-06T14:44:23.763 INFO:tasks.workunit.client.1.smithi165.stdout:6/134: chown l1b 6982126 1 2024-09-06T14:44:23.766 INFO:tasks.workunit.client.1.smithi165.stdout:4/191: creat d5/f3b x:0 0 0 2024-09-06T14:44:23.766 INFO:tasks.workunit.client.1.smithi165.stdout:8/202: getdents d0/d19/d36/d2d/d33 0 2024-09-06T14:44:23.768 INFO:tasks.workunit.client.1.smithi165.stdout:8/203: chown d0/d14/d3e 797570805 1 2024-09-06T14:44:23.771 INFO:tasks.workunit.client.1.smithi165.stdout:1/163: dwrite d0/d2a/d1b/f1f [0,4194304] 0 2024-09-06T14:44:23.774 INFO:tasks.workunit.client.1.smithi165.stdout:1/164: rmdir d0/d2a/d18 39 2024-09-06T14:44:23.777 INFO:tasks.workunit.client.1.smithi165.stdout:6/135: dread f6 [4194304,4194304] 0 2024-09-06T14:44:23.779 INFO:tasks.workunit.client.1.smithi165.stdout:6/136: write f3 [220139,127813] 0 2024-09-06T14:44:23.780 INFO:tasks.workunit.client.1.smithi165.stdout:9/341: truncate db/de/d15/f2b 2877575 0 2024-09-06T14:44:23.781 INFO:tasks.workunit.client.1.smithi165.stdout:8/204: dwrite d0/d19/d36/d28/f3d [0,4194304] 0 2024-09-06T14:44:23.783 INFO:tasks.workunit.client.1.smithi165.stdout:6/137: creat f20 x:0 0 0 2024-09-06T14:44:23.785 INFO:tasks.workunit.client.1.smithi165.stdout:9/342: fsync db/de/d15/d17/f5c 0 2024-09-06T14:44:23.787 INFO:tasks.workunit.client.1.smithi165.stdout:6/138: read ff [2147025,106605] 0 2024-09-06T14:44:23.788 INFO:tasks.workunit.client.1.smithi165.stdout:8/205: creat d0/d14/d3e/f4b x:0 0 0 2024-09-06T14:44:23.788 INFO:tasks.workunit.client.1.smithi165.stdout:1/165: link d0/d2a/d1b/d2b/c31 d0/d2a/d18/c35 0 2024-09-06T14:44:23.789 INFO:tasks.workunit.client.1.smithi165.stdout:9/343: chown db/de/c62 0 1 2024-09-06T14:44:23.791 INFO:tasks.workunit.client.1.smithi165.stdout:6/139: symlink l21 0 2024-09-06T14:44:23.791 INFO:tasks.workunit.client.1.smithi165.stdout:9/344: chown db/de/f3f 1336 1 2024-09-06T14:44:23.791 INFO:tasks.workunit.client.1.smithi165.stdout:4/192: dwrite d5/fc [0,4194304] 0 2024-09-06T14:44:23.795 INFO:tasks.workunit.client.1.smithi165.stdout:9/345: unlink db/de/d15/d17/f3e 0 2024-09-06T14:44:23.796 INFO:tasks.workunit.client.1.smithi165.stdout:8/206: fsync d0/d14/f1b 0 2024-09-06T14:44:23.796 INFO:tasks.workunit.client.1.smithi165.stdout:4/193: creat d5/d1b/d1c/d20/d26/f3c x:0 0 0 2024-09-06T14:44:23.797 INFO:tasks.workunit.client.1.smithi165.stdout:9/346: truncate db/f57 910275 0 2024-09-06T14:44:23.801 INFO:tasks.workunit.client.1.smithi165.stdout:4/194: dread d5/fc [0,4194304] 0 2024-09-06T14:44:23.803 INFO:tasks.workunit.client.1.smithi165.stdout:2/170: sync 2024-09-06T14:44:23.803 INFO:tasks.workunit.client.1.smithi165.stdout:3/115: sync 2024-09-06T14:44:23.803 INFO:tasks.workunit.client.1.smithi165.stdout:7/63: sync 2024-09-06T14:44:23.803 INFO:tasks.workunit.client.1.smithi165.stdout:0/211: sync 2024-09-06T14:44:23.803 INFO:tasks.workunit.client.1.smithi165.stdout:8/207: creat d0/d19/d36/d2d/d33/f4c x:0 0 0 2024-09-06T14:44:23.805 INFO:tasks.workunit.client.1.smithi165.stdout:3/116: chown d1/f2 4032 1 2024-09-06T14:44:23.805 INFO:tasks.workunit.client.1.smithi165.stdout:4/195: write d5/d1b/d1c/d20/d26/f28 [175417,11529] 0 2024-09-06T14:44:23.806 INFO:tasks.workunit.client.1.smithi165.stdout:3/117: fdatasync d1/f8 0 2024-09-06T14:44:23.806 INFO:tasks.workunit.client.1.smithi165.stdout:7/64: chown fb 1707546 1 2024-09-06T14:44:23.809 INFO:tasks.workunit.client.1.smithi165.stdout:9/347: mkdir db/de/d15/d17/d72 0 2024-09-06T14:44:23.810 INFO:tasks.workunit.client.1.smithi165.stdout:1/166: truncate d0/f7 1905064 0 2024-09-06T14:44:23.811 INFO:tasks.workunit.client.1.smithi165.stdout:4/196: chown d5/d1b/d1c/d20/d26/f28 1 1 2024-09-06T14:44:23.811 INFO:tasks.workunit.client.1.smithi165.stdout:9/348: write db/f57 [1486780,8095] 0 2024-09-06T14:44:23.814 INFO:tasks.workunit.client.1.smithi165.stdout:2/171: mkdir d9/d23/d32 0 2024-09-06T14:44:23.814 INFO:tasks.workunit.client.1.smithi165.stdout:7/65: write f8 [834040,95410] 0 2024-09-06T14:44:23.816 INFO:tasks.workunit.client.1.smithi165.stdout:9/349: fsync db/de/d16/d2e/f70 0 2024-09-06T14:44:23.817 INFO:tasks.workunit.client.1.smithi165.stdout:8/208: symlink d0/d34/d43/l4d 0 2024-09-06T14:44:23.820 INFO:tasks.workunit.client.1.smithi165.stdout:1/167: creat d0/d2a/d23/f36 x:0 0 0 2024-09-06T14:44:23.821 INFO:tasks.workunit.client.1.smithi165.stdout:4/197: mknod d5/d1b/c3d 0 2024-09-06T14:44:23.821 INFO:tasks.workunit.client.1.smithi165.stdout:6/140: dwrite f1d [0,4194304] 0 2024-09-06T14:44:23.822 INFO:tasks.workunit.client.1.smithi165.stdout:3/118: link d1/c1e d1/c21 0 2024-09-06T14:44:23.825 INFO:tasks.workunit.client.1.smithi165.stdout:1/168: write d0/f10 [272510,103560] 0 2024-09-06T14:44:23.827 INFO:tasks.workunit.client.1.smithi165.stdout:2/172: creat d9/d25/f33 x:0 0 0 2024-09-06T14:44:23.831 INFO:tasks.workunit.client.1.smithi165.stdout:8/209: creat d0/d19/d36/d2d/d3f/f4e x:0 0 0 2024-09-06T14:44:23.831 INFO:tasks.workunit.client.1.smithi165.stdout:0/212: dwrite d15/d19/f1b [0,4194304] 0 2024-09-06T14:44:23.836 INFO:tasks.workunit.client.1.smithi165.stdout:7/66: creat f12 x:0 0 0 2024-09-06T14:44:23.842 INFO:tasks.workunit.client.1.smithi165.stdout:4/198: link d5/c11 d5/d1b/c3e 0 2024-09-06T14:44:23.842 INFO:tasks.workunit.client.1.smithi165.stdout:5/210: sync 2024-09-06T14:44:23.843 INFO:tasks.workunit.client.1.smithi165.stdout:0/213: link d15/d19/d38/f47 d15/d19/d28/d3a/d3f/f48 0 2024-09-06T14:44:23.850 INFO:tasks.workunit.client.1.smithi165.stdout:6/141: dwrite ff [0,4194304] 0 2024-09-06T14:44:23.853 INFO:tasks.workunit.client.1.smithi165.stdout:2/173: dwrite d9/f1c [0,4194304] 0 2024-09-06T14:44:23.854 INFO:tasks.workunit.client.1.smithi165.stdout:9/350: dwrite db/f26 [0,4194304] 0 2024-09-06T14:44:23.855 INFO:tasks.workunit.client.1.smithi165.stdout:5/211: truncate d6/d1c/d28/f4f 766781 0 2024-09-06T14:44:23.856 INFO:tasks.workunit.client.1.smithi165.stdout:7/67: dread fb [0,4194304] 0 2024-09-06T14:44:23.856 INFO:tasks.workunit.client.1.smithi165.stdout:3/119: truncate d1/da/dd/f1c 1284960 0 2024-09-06T14:44:23.857 INFO:tasks.workunit.client.1.smithi165.stdout:8/210: rename d0/d19/l1d to d0/d19/d36/d2d/d33/d3a/d46/d49/l4f 0 2024-09-06T14:44:23.859 INFO:tasks.workunit.client.1.smithi165.stdout:6/142: rename f20 to f22 0 2024-09-06T14:44:23.860 INFO:tasks.workunit.client.1.smithi165.stdout:1/169: fsync d0/d1c/d1d/d22/f2e 0 2024-09-06T14:44:23.860 INFO:tasks.workunit.client.1.smithi165.stdout:5/212: mknod d6/d1c/c56 0 2024-09-06T14:44:23.861 INFO:tasks.workunit.client.1.smithi165.stdout:4/199: dread d5/fc [0,4194304] 0 2024-09-06T14:44:23.861 INFO:tasks.workunit.client.1.smithi165.stdout:8/211: fdatasync d0/d19/d36/fa 0 2024-09-06T14:44:23.864 INFO:tasks.workunit.client.1.smithi165.stdout:9/351: creat db/de/d2d/f73 x:0 0 0 2024-09-06T14:44:23.865 INFO:tasks.workunit.client.1.smithi165.stdout:9/352: chown db/de/d16/d2e/l6f 4 1 2024-09-06T14:44:23.868 INFO:tasks.workunit.client.1.smithi165.stdout:3/120: creat d1/d19/f22 x:0 0 0 2024-09-06T14:44:23.869 INFO:tasks.workunit.client.1.smithi165.stdout:6/143: write f1c [1123307,85783] 0 2024-09-06T14:44:23.871 INFO:tasks.workunit.client.1.smithi165.stdout:0/214: truncate f10 2556562 0 2024-09-06T14:44:23.873 INFO:tasks.workunit.client.1.smithi165.stdout:8/212: mkdir d0/d14/d50 0 2024-09-06T14:44:23.873 INFO:tasks.workunit.client.1.smithi165.stdout:0/215: read - d15/d19/d28/d3a/f41 zero size 2024-09-06T14:44:23.874 INFO:tasks.workunit.client.1.smithi165.stdout:0/216: stat d15/d19/f20 0 2024-09-06T14:44:23.875 INFO:tasks.workunit.client.1.smithi165.stdout:3/121: rename d1/d19/f22 to d1/da/dc/d10/f23 0 2024-09-06T14:44:23.875 INFO:tasks.workunit.client.1.smithi165.stdout:6/144: mknod c23 0 2024-09-06T14:44:23.877 INFO:tasks.workunit.client.1.smithi165.stdout:1/170: mknod d0/d2a/c37 0 2024-09-06T14:44:23.877 INFO:tasks.workunit.client.1.smithi165.stdout:7/68: creat f13 x:0 0 0 2024-09-06T14:44:23.878 INFO:tasks.workunit.client.1.smithi165.stdout:1/171: truncate d0/d2a/f2f 5199873 0 2024-09-06T14:44:23.878 INFO:tasks.workunit.client.1.smithi165.stdout:8/213: symlink d0/d19/d36/d2d/d33/d3a/d46/l51 0 2024-09-06T14:44:23.879 INFO:tasks.workunit.client.1.smithi165.stdout:0/217: symlink d15/d19/d38/l49 0 2024-09-06T14:44:23.880 INFO:tasks.workunit.client.1.smithi165.stdout:2/174: getdents d9/d23/d29 0 2024-09-06T14:44:23.880 INFO:tasks.workunit.client.1.smithi165.stdout:5/213: creat d6/f57 x:0 0 0 2024-09-06T14:44:23.881 INFO:tasks.workunit.client.1.smithi165.stdout:6/145: symlink l24 0 2024-09-06T14:44:23.883 INFO:tasks.workunit.client.1.smithi165.stdout:8/214: write d0/d19/d36/f12 [254419,43489] 0 2024-09-06T14:44:23.887 INFO:tasks.workunit.client.1.smithi165.stdout:1/172: creat d0/d2a/d1b/d2b/f38 x:0 0 0 2024-09-06T14:44:23.887 INFO:tasks.workunit.client.1.smithi165.stdout:6/146: creat f25 x:0 0 0 2024-09-06T14:44:23.887 INFO:tasks.workunit.client.1.smithi165.stdout:9/353: dread db/de/d16/d2e/f3b [0,4194304] 0 2024-09-06T14:44:23.888 INFO:tasks.workunit.client.1.smithi165.stdout:4/200: mknod d5/d1b/c3f 0 2024-09-06T14:44:23.889 INFO:tasks.workunit.client.1.smithi165.stdout:5/214: read d6/d1c/d28/f36 [4099344,113571] 0 2024-09-06T14:44:23.890 INFO:tasks.workunit.client.1.smithi165.stdout:8/215: write d0/d19/d24/d26/f29 [776886,2951] 0 2024-09-06T14:44:23.894 INFO:tasks.workunit.client.1.smithi165.stdout:0/218: truncate d15/d19/d38/f47 218374 0 2024-09-06T14:44:23.897 INFO:tasks.workunit.client.1.smithi165.stdout:5/215: write d6/f1d [2618127,98482] 0 2024-09-06T14:44:23.898 INFO:tasks.workunit.client.1.smithi165.stdout:4/201: symlink d5/d1b/d1c/d20/l40 0 2024-09-06T14:44:23.904 INFO:tasks.workunit.client.1.smithi165.stdout:4/202: readlink d5/d1b/d1c/l33 0 2024-09-06T14:44:23.907 INFO:tasks.workunit.client.1.smithi165.stdout:9/354: mkdir db/de/d15/d74 0 2024-09-06T14:44:23.907 INFO:tasks.workunit.client.1.smithi165.stdout:2/175: dread d9/f1c [0,4194304] 0 2024-09-06T14:44:23.908 INFO:tasks.workunit.client.1.smithi165.stdout:6/147: dwrite f16 [0,4194304] 0 2024-09-06T14:44:23.908 INFO:tasks.workunit.client.1.smithi165.stdout:8/216: creat d0/d19/d36/d2d/d33/d3a/d46/f52 x:0 0 0 2024-09-06T14:44:23.909 INFO:tasks.workunit.client.1.smithi165.stdout:6/148: rmdir - no directory 2024-09-06T14:44:23.911 INFO:tasks.workunit.client.1.smithi165.stdout:7/69: link ce c14 0 2024-09-06T14:44:23.913 INFO:tasks.workunit.client.1.smithi165.stdout:3/122: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:23.914 INFO:tasks.workunit.client.1.smithi165.stdout:5/216: rename d6/d1c/c2f to d6/d1c/d28/d2d/d3c/c58 0 2024-09-06T14:44:23.916 INFO:tasks.workunit.client.1.smithi165.stdout:4/203: mkdir d5/d1b/d1c/d41 0 2024-09-06T14:44:23.917 INFO:tasks.workunit.client.1.smithi165.stdout:1/173: dwrite d0/d2a/d1b/f30 [0,4194304] 0 2024-09-06T14:44:23.919 INFO:tasks.workunit.client.1.smithi165.stdout:6/149: mknod c26 0 2024-09-06T14:44:23.922 INFO:tasks.workunit.client.1.smithi165.stdout:9/355: creat db/de/d2d/d6c/f75 x:0 0 0 2024-09-06T14:44:23.923 INFO:tasks.workunit.client.1.smithi165.stdout:4/204: write d5/d1b/f36 [33417,109221] 0 2024-09-06T14:44:23.924 INFO:tasks.workunit.client.1.smithi165.stdout:2/176: rename d9/d23/d32 to d9/d23/d26/d2d/d34 0 2024-09-06T14:44:23.925 INFO:tasks.workunit.client.1.smithi165.stdout:5/217: symlink d6/d1c/d28/d2d/d3c/l59 0 2024-09-06T14:44:23.926 INFO:tasks.workunit.client.1.smithi165.stdout:4/205: chown d5/f2c 172 1 2024-09-06T14:44:23.929 INFO:tasks.workunit.client.1.smithi165.stdout:1/174: creat d0/d1c/d1d/d22/f39 x:0 0 0 2024-09-06T14:44:23.930 INFO:tasks.workunit.client.1.smithi165.stdout:7/70: dread f10 [0,4194304] 0 2024-09-06T14:44:23.931 INFO:tasks.workunit.client.1.smithi165.stdout:9/356: rmdir db/de/d2d 39 2024-09-06T14:44:23.932 INFO:tasks.workunit.client.1.smithi165.stdout:4/206: mknod d5/d1b/d1c/d20/d26/c42 0 2024-09-06T14:44:23.932 INFO:tasks.workunit.client.1.smithi165.stdout:8/217: write d0/d14/f2c [869511,119040] 0 2024-09-06T14:44:23.933 INFO:tasks.workunit.client.1.smithi165.stdout:7/71: dread - f13 zero size 2024-09-06T14:44:23.934 INFO:tasks.workunit.client.1.smithi165.stdout:3/123: getdents d1/da/dc/d10 0 2024-09-06T14:44:23.935 INFO:tasks.workunit.client.1.smithi165.stdout:2/177: creat d9/f35 x:0 0 0 2024-09-06T14:44:23.937 INFO:tasks.workunit.client.1.smithi165.stdout:4/207: write f2 [1629307,34757] 0 2024-09-06T14:44:23.937 INFO:tasks.workunit.client.1.smithi165.stdout:1/175: creat d0/d2a/d1b/f3a x:0 0 0 2024-09-06T14:44:23.938 INFO:tasks.workunit.client.1.smithi165.stdout:6/150: dwrite ff [0,4194304] 0 2024-09-06T14:44:23.940 INFO:tasks.workunit.client.1.smithi165.stdout:3/124: stat d1/da/dc/d10 0 2024-09-06T14:44:23.941 INFO:tasks.workunit.client.1.smithi165.stdout:2/178: unlink d9/c1f 0 2024-09-06T14:44:23.941 INFO:tasks.workunit.client.1.smithi165.stdout:7/72: write ff [195087,79565] 0 2024-09-06T14:44:23.941 INFO:tasks.workunit.client.1.smithi165.stdout:9/357: read - db/de/d2d/d5a/f5f zero size 2024-09-06T14:44:23.942 INFO:tasks.workunit.client.1.smithi165.stdout:1/176: mknod d0/d1c/d1d/c3b 0 2024-09-06T14:44:23.943 INFO:tasks.workunit.client.1.smithi165.stdout:6/151: chown c23 40 1 2024-09-06T14:44:23.943 INFO:tasks.workunit.client.1.smithi165.stdout:8/218: readlink d0/d19/d36/d2d/d33/d3a/d46/l51 0 2024-09-06T14:44:23.944 INFO:tasks.workunit.client.1.smithi165.stdout:6/152: fsync fc 0 2024-09-06T14:44:23.945 INFO:tasks.workunit.client.1.smithi165.stdout:3/125: symlink d1/da/dc/l24 0 2024-09-06T14:44:23.946 INFO:tasks.workunit.client.1.smithi165.stdout:6/153: fsync f25 0 2024-09-06T14:44:23.946 INFO:tasks.workunit.client.1.smithi165.stdout:7/73: read ff [264502,52475] 0 2024-09-06T14:44:23.948 INFO:tasks.workunit.client.1.smithi165.stdout:1/177: creat d0/d1c/d1d/f3c x:0 0 0 2024-09-06T14:44:23.949 INFO:tasks.workunit.client.1.smithi165.stdout:7/74: write f3 [431367,18222] 0 2024-09-06T14:44:23.949 INFO:tasks.workunit.client.1.smithi165.stdout:9/358: write db/de/d2d/f73 [261707,111478] 0 2024-09-06T14:44:23.950 INFO:tasks.workunit.client.1.smithi165.stdout:4/208: mknod d5/d1b/d1c/d41/c43 0 2024-09-06T14:44:23.955 INFO:tasks.workunit.client.1.smithi165.stdout:3/126: rename d1/c21 to d1/da/c25 0 2024-09-06T14:44:23.955 INFO:tasks.workunit.client.1.smithi165.stdout:0/219: dread d15/d19/f1e [0,4194304] 0 2024-09-06T14:44:23.956 INFO:tasks.workunit.client.1.smithi165.stdout:4/209: chown d5/d1b/d1c/l1f 1 1 2024-09-06T14:44:23.959 INFO:tasks.workunit.client.1.smithi165.stdout:6/154: dread f1c [0,4194304] 0 2024-09-06T14:44:23.959 INFO:tasks.workunit.client.1.smithi165.stdout:1/178: creat d0/f3d x:0 0 0 2024-09-06T14:44:23.961 INFO:tasks.workunit.client.1.smithi165.stdout:2/179: dwrite d9/d25/f33 [0,4194304] 0 2024-09-06T14:44:23.961 INFO:tasks.workunit.client.1.smithi165.stdout:7/75: creat f15 x:0 0 0 2024-09-06T14:44:23.961 INFO:tasks.workunit.client.1.smithi165.stdout:7/76: rmdir - no directory 2024-09-06T14:44:23.962 INFO:tasks.workunit.client.1.smithi165.stdout:3/127: chown d1/da/dc/d10/l16 28823 1 2024-09-06T14:44:23.964 INFO:tasks.workunit.client.1.smithi165.stdout:4/210: creat d5/d1b/d1c/d41/f44 x:0 0 0 2024-09-06T14:44:23.965 INFO:tasks.workunit.client.1.smithi165.stdout:2/180: chown d9/l21 39686 1 2024-09-06T14:44:23.965 INFO:tasks.workunit.client.1.smithi165.stdout:8/219: dread d0/f2f [0,4194304] 0 2024-09-06T14:44:23.967 INFO:tasks.workunit.client.1.smithi165.stdout:3/128: rmdir d1 39 2024-09-06T14:44:23.968 INFO:tasks.workunit.client.1.smithi165.stdout:7/77: write ff [387628,112008] 0 2024-09-06T14:44:23.969 INFO:tasks.workunit.client.1.smithi165.stdout:8/220: chown d0/f9 1713925 1 2024-09-06T14:44:23.970 INFO:tasks.workunit.client.1.smithi165.stdout:4/211: write d5/f2b [20519,99887] 0 2024-09-06T14:44:23.977 INFO:tasks.workunit.client.1.smithi165.stdout:2/181: rename l7 to d9/d23/d26/l36 0 2024-09-06T14:44:23.978 INFO:tasks.workunit.client.1.smithi165.stdout:0/220: dwrite d15/f16 [0,4194304] 0 2024-09-06T14:44:23.978 INFO:tasks.workunit.client.1.smithi165.stdout:4/212: write d5/d1b/f36 [189898,78188] 0 2024-09-06T14:44:23.980 INFO:tasks.workunit.client.1.smithi165.stdout:8/221: mkdir d0/d19/d36/d28/d53 0 2024-09-06T14:44:23.982 INFO:tasks.workunit.client.1.smithi165.stdout:1/179: dwrite d0/d2a/d23/f36 [0,4194304] 0 2024-09-06T14:44:23.985 INFO:tasks.workunit.client.1.smithi165.stdout:2/182: write d9/f18 [217222,63083] 0 2024-09-06T14:44:23.985 INFO:tasks.workunit.client.1.smithi165.stdout:3/129: rename d1/f8 to d1/da/f26 0 2024-09-06T14:44:23.988 INFO:tasks.workunit.client.1.smithi165.stdout:8/222: dread - d0/d19/d36/d28/f45 zero size 2024-09-06T14:44:23.991 INFO:tasks.workunit.client.1.smithi165.stdout:4/213: symlink d5/d1b/d1c/d20/l45 0 2024-09-06T14:44:23.992 INFO:tasks.workunit.client.1.smithi165.stdout:6/155: dread fc [0,4194304] 0 2024-09-06T14:44:23.992 INFO:tasks.workunit.client.1.smithi165.stdout:7/78: dwrite f8 [0,4194304] 0 2024-09-06T14:44:23.994 INFO:tasks.workunit.client.1.smithi165.stdout:1/180: mkdir d0/d2a/d1b/d2b/d3e 0 2024-09-06T14:44:23.995 INFO:tasks.workunit.client.1.smithi165.stdout:8/223: chown d0/d19/d36/d28/f45 1080 1 2024-09-06T14:44:23.995 INFO:tasks.workunit.client.1.smithi165.stdout:2/183: symlink d9/d23/d26/d2d/l37 0 2024-09-06T14:44:23.998 INFO:tasks.workunit.client.1.smithi165.stdout:3/130: creat d1/d19/f27 x:0 0 0 2024-09-06T14:44:24.002 INFO:tasks.workunit.client.1.smithi165.stdout:3/131: fdatasync d1/da/dc/d10/f1a 0 2024-09-06T14:44:24.002 INFO:tasks.workunit.client.1.smithi165.stdout:4/214: rename d5/f3b to d5/f46 0 2024-09-06T14:44:24.004 INFO:tasks.workunit.client.1.smithi165.stdout:0/221: dwrite d15/d19/d28/d3a/f41 [0,4194304] 0 2024-09-06T14:44:24.006 INFO:tasks.workunit.client.1.smithi165.stdout:2/184: dread d9/f18 [0,4194304] 0 2024-09-06T14:44:24.006 INFO:tasks.workunit.client.1.smithi165.stdout:1/181: mknod d0/d1c/d1d/d22/c3f 0 2024-09-06T14:44:24.007 INFO:tasks.workunit.client.1.smithi165.stdout:8/224: chown d0/d19/d36/d2d/d33/d3a/d46/f52 2 1 2024-09-06T14:44:24.012 INFO:tasks.workunit.client.1.smithi165.stdout:1/182: fdatasync d0/d2a/d1b/d2b/f38 0 2024-09-06T14:44:24.013 INFO:tasks.workunit.client.1.smithi165.stdout:4/215: write d5/d1b/d1c/d20/d26/f38 [720193,85134] 0 2024-09-06T14:44:24.015 INFO:tasks.workunit.client.1.smithi165.stdout:4/216: write d5/d1b/d1c/f1d [2571628,54993] 0 2024-09-06T14:44:24.015 INFO:tasks.workunit.client.1.smithi165.stdout:6/156: dwrite f1c [0,4194304] 0 2024-09-06T14:44:24.016 INFO:tasks.workunit.client.1.smithi165.stdout:2/185: mknod d9/d23/d26/c38 0 2024-09-06T14:44:24.017 INFO:tasks.workunit.client.1.smithi165.stdout:7/79: write f8 [4559958,59400] 0 2024-09-06T14:44:24.018 INFO:tasks.workunit.client.1.smithi165.stdout:2/186: write d9/f12 [3734932,93303] 0 2024-09-06T14:44:24.021 INFO:tasks.workunit.client.1.smithi165.stdout:8/225: fdatasync d0/f22 0 2024-09-06T14:44:24.022 INFO:tasks.workunit.client.1.smithi165.stdout:8/226: write d0/f9 [1342570,79875] 0 2024-09-06T14:44:24.024 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:23 smithi165 ceph-mon[36229]: pgmap v14: 65 pgs: 65 active+clean; 420 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 35 MiB/s wr, 368 op/s 2024-09-06T14:44:24.026 INFO:tasks.workunit.client.1.smithi165.stdout:6/157: symlink l27 0 2024-09-06T14:44:24.027 INFO:tasks.workunit.client.1.smithi165.stdout:4/217: mknod d5/d1b/d1c/d41/c47 0 2024-09-06T14:44:24.028 INFO:tasks.workunit.client.1.smithi165.stdout:0/222: write ff [4677932,70310] 0 2024-09-06T14:44:24.029 INFO:tasks.workunit.client.1.smithi165.stdout:4/218: chown d5/d1b/d1c/c1e 21878 1 2024-09-06T14:44:24.032 INFO:tasks.workunit.client.1.smithi165.stdout:0/223: dread f10 [0,4194304] 0 2024-09-06T14:44:24.032 INFO:tasks.workunit.client.1.smithi165.stdout:8/227: write d0/d14/f25 [1400871,40374] 0 2024-09-06T14:44:24.033 INFO:tasks.workunit.client.1.smithi165.stdout:8/228: readlink d0/d19/l32 0 2024-09-06T14:44:24.034 INFO:tasks.workunit.client.1.smithi165.stdout:4/219: dread d5/f2b [0,4194304] 0 2024-09-06T14:44:24.034 INFO:tasks.workunit.client.1.smithi165.stdout:0/224: read fb [97939,111124] 0 2024-09-06T14:44:24.034 INFO:tasks.workunit.client.1.smithi165.stdout:1/183: mkdir d0/d1c/d40 0 2024-09-06T14:44:24.044 INFO:tasks.workunit.client.1.smithi165.stdout:4/220: write d5/f8 [3064118,1473] 0 2024-09-06T14:44:24.047 INFO:tasks.workunit.client.1.smithi165.stdout:3/132: getdents d1 0 2024-09-06T14:44:24.047 INFO:tasks.workunit.client.1.smithi165.stdout:7/80: link f3 f16 0 2024-09-06T14:44:24.048 INFO:tasks.workunit.client.1.smithi165.stdout:2/187: creat d9/f39 x:0 0 0 2024-09-06T14:44:24.049 INFO:tasks.workunit.client.1.smithi165.stdout:0/225: fdatasync d15/d19/d38/f47 0 2024-09-06T14:44:24.050 INFO:tasks.workunit.client.1.smithi165.stdout:8/229: mknod d0/d19/d36/d2d/d33/c54 0 2024-09-06T14:44:24.052 INFO:tasks.workunit.client.1.smithi165.stdout:1/184: fdatasync d0/d2a/d1b/f30 0 2024-09-06T14:44:24.053 INFO:tasks.workunit.client.1.smithi165.stdout:8/230: write d0/d19/d36/d2d/d33/d3a/d46/f52 [121820,86739] 0 2024-09-06T14:44:24.055 INFO:tasks.workunit.client.1.smithi165.stdout:3/133: creat d1/d19/f28 x:0 0 0 2024-09-06T14:44:24.056 INFO:tasks.workunit.client.1.smithi165.stdout:7/81: write fb [3240474,122075] 0 2024-09-06T14:44:24.056 INFO:tasks.workunit.client.1.smithi165.stdout:1/185: write d0/d2a/fb [698766,18919] 0 2024-09-06T14:44:24.056 INFO:tasks.workunit.client.1.smithi165.stdout:8/231: stat d0/d19/d36/d2d/f38 0 2024-09-06T14:44:24.058 INFO:tasks.workunit.client.1.smithi165.stdout:1/186: truncate d0/f3d 166546 0 2024-09-06T14:44:24.064 INFO:tasks.workunit.client.1.smithi165.stdout:3/134: write d1/f1b [1100008,2428] 0 2024-09-06T14:44:24.065 INFO:tasks.workunit.client.1.smithi165.stdout:7/82: write f16 [243545,103816] 0 2024-09-06T14:44:24.066 INFO:tasks.workunit.client.1.smithi165.stdout:7/83: dread - f13 zero size 2024-09-06T14:44:24.067 INFO:tasks.workunit.client.1.smithi165.stdout:8/232: creat d0/d19/d36/d2d/d33/d3a/f55 x:0 0 0 2024-09-06T14:44:24.068 INFO:tasks.workunit.client.1.smithi165.stdout:8/233: write d0/f6 [2252973,8752] 0 2024-09-06T14:44:24.071 INFO:tasks.workunit.client.1.smithi165.stdout:2/188: dread f8 [0,4194304] 0 2024-09-06T14:44:24.081 INFO:tasks.workunit.client.1.smithi165.stdout:1/187: mkdir d0/d1c/d41 0 2024-09-06T14:44:24.084 INFO:tasks.workunit.client.1.smithi165.stdout:2/189: mkdir d9/d25/d3a 0 2024-09-06T14:44:24.084 INFO:tasks.workunit.client.1.smithi165.stdout:2/190: fsync d9/fa 0 2024-09-06T14:44:24.087 INFO:tasks.workunit.client.1.smithi165.stdout:8/234: write d0/d14/d3e/f47 [473702,625] 0 2024-09-06T14:44:24.092 INFO:tasks.workunit.client.1.smithi165.stdout:8/235: dread d0/d19/d24/d26/f29 [0,4194304] 0 2024-09-06T14:44:24.092 INFO:tasks.workunit.client.1.smithi165.stdout:1/188: rename d0/d1c/d1d/d22/l2c to d0/d1c/d41/l42 0 2024-09-06T14:44:24.097 INFO:tasks.workunit.client.1.smithi165.stdout:7/84: rename fb to f17 0 2024-09-06T14:44:24.097 INFO:tasks.workunit.client.1.smithi165.stdout:7/85: chown f3 66878261 1 2024-09-06T14:44:24.098 INFO:tasks.workunit.client.1.smithi165.stdout:7/86: chown f8 155 1 2024-09-06T14:44:24.098 INFO:tasks.workunit.client.1.smithi165.stdout:7/87: fsync f16 0 2024-09-06T14:44:24.101 INFO:tasks.workunit.client.1.smithi165.stdout:3/135: getdents d1/da/dd 0 2024-09-06T14:44:24.102 INFO:tasks.workunit.client.1.smithi165.stdout:3/136: chown d1/da/dd 13 1 2024-09-06T14:44:24.104 INFO:tasks.workunit.client.1.smithi165.stdout:8/236: symlink d0/d19/l56 0 2024-09-06T14:44:24.104 INFO:tasks.workunit.client.1.smithi165.stdout:7/88: dwrite f8 [0,4194304] 0 2024-09-06T14:44:24.104 INFO:tasks.workunit.client.1.smithi165.stdout:5/218: sync 2024-09-06T14:44:24.112 INFO:tasks.workunit.client.1.smithi165.stdout:8/237: dwrite d0/d19/d36/f44 [0,4194304] 0 2024-09-06T14:44:24.114 INFO:tasks.workunit.client.1.smithi165.stdout:4/221: truncate d5/f8 1003432 0 2024-09-06T14:44:24.118 INFO:tasks.workunit.client.1.smithi165.stdout:0/226: truncate d15/f16 2244614 0 2024-09-06T14:44:24.122 INFO:tasks.workunit.client.1.smithi165.stdout:7/89: unlink f10 0 2024-09-06T14:44:24.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:23 smithi052 ceph-mon[28627]: pgmap v14: 65 pgs: 65 active+clean; 420 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 35 MiB/s wr, 368 op/s 2024-09-06T14:44:24.124 INFO:tasks.workunit.client.1.smithi165.stdout:5/219: creat d6/d1c/f5a x:0 0 0 2024-09-06T14:44:24.125 INFO:tasks.workunit.client.1.smithi165.stdout:1/189: link d0/d1c/d1d/d22/f32 d0/d2a/d18/f43 0 2024-09-06T14:44:24.127 INFO:tasks.workunit.client.1.smithi165.stdout:8/238: symlink d0/d19/d24/d26/l57 0 2024-09-06T14:44:24.131 INFO:tasks.workunit.client.1.smithi165.stdout:0/227: mknod d15/d19/d28/d3a/d3f/c4a 0 2024-09-06T14:44:24.133 INFO:tasks.workunit.client.1.smithi165.stdout:5/220: symlink d6/d32/d41/l5b 0 2024-09-06T14:44:24.133 INFO:tasks.workunit.client.1.smithi165.stdout:7/90: dwrite f16 [0,4194304] 0 2024-09-06T14:44:24.134 INFO:tasks.workunit.client.1.smithi165.stdout:8/239: mknod d0/d19/d36/d2d/d33/d3a/d46/d49/c58 0 2024-09-06T14:44:24.136 INFO:tasks.workunit.client.1.smithi165.stdout:8/240: stat d0/d19/d36/d2d/d3f/f4e 0 2024-09-06T14:44:24.137 INFO:tasks.workunit.client.1.smithi165.stdout:1/190: dread d0/d2a/d1b/f1f [0,4194304] 0 2024-09-06T14:44:24.138 INFO:tasks.workunit.client.1.smithi165.stdout:4/222: dwrite d5/fc [0,4194304] 0 2024-09-06T14:44:24.139 INFO:tasks.workunit.client.1.smithi165.stdout:8/241: write d0/d19/d36/f2e [4136107,106098] 0 2024-09-06T14:44:24.139 INFO:tasks.workunit.client.1.smithi165.stdout:4/223: chown d5/d1b/d1c/d20 239838154 1 2024-09-06T14:44:24.150 INFO:tasks.workunit.client.1.smithi165.stdout:8/242: dwrite d0/d19/d36/f12 [0,4194304] 0 2024-09-06T14:44:24.152 INFO:tasks.workunit.client.1.smithi165.stdout:8/243: write d0/d19/d36/f7 [1959946,99055] 0 2024-09-06T14:44:24.153 INFO:tasks.workunit.client.1.smithi165.stdout:9/359: sync 2024-09-06T14:44:24.156 INFO:tasks.workunit.client.1.smithi165.stdout:7/91: creat f18 x:0 0 0 2024-09-06T14:44:24.158 INFO:tasks.workunit.client.1.smithi165.stdout:0/228: rename d15/d19/f1b to d15/f4b 0 2024-09-06T14:44:24.158 INFO:tasks.workunit.client.1.smithi165.stdout:9/360: truncate db/de/d15/d17/d18/f4b 132219 0 2024-09-06T14:44:24.159 INFO:tasks.workunit.client.1.smithi165.stdout:2/191: truncate f8 3750637 0 2024-09-06T14:44:24.159 INFO:tasks.workunit.client.1.smithi165.stdout:9/361: fsync db/de/d2d/f31 0 2024-09-06T14:44:24.161 INFO:tasks.workunit.client.1.smithi165.stdout:9/362: dread db/d40/f53 [0,4194304] 0 2024-09-06T14:44:24.162 INFO:tasks.workunit.client.1.smithi165.stdout:4/224: mkdir d5/d1b/d48 0 2024-09-06T14:44:24.165 INFO:tasks.workunit.client.1.smithi165.stdout:8/244: creat d0/d34/d43/f59 x:0 0 0 2024-09-06T14:44:24.172 INFO:tasks.workunit.client.1.smithi165.stdout:4/225: dwrite d5/d1b/f31 [0,4194304] 0 2024-09-06T14:44:24.177 INFO:tasks.workunit.client.1.smithi165.stdout:7/92: symlink l19 0 2024-09-06T14:44:24.179 INFO:tasks.workunit.client.1.smithi165.stdout:8/245: rmdir d0/d19/d36/d2d/d3f 39 2024-09-06T14:44:24.180 INFO:tasks.workunit.client.1.smithi165.stdout:1/191: dread d0/d2a/f16 [0,4194304] 0 2024-09-06T14:44:24.180 INFO:tasks.workunit.client.1.smithi165.stdout:3/137: dwrite d1/da/dd/f15 [0,4194304] 0 2024-09-06T14:44:24.189 INFO:tasks.workunit.client.1.smithi165.stdout:9/363: creat db/de/d15/d17/d72/f76 x:0 0 0 2024-09-06T14:44:24.194 INFO:tasks.workunit.client.1.smithi165.stdout:1/192: write d0/d2a/f16 [378548,62360] 0 2024-09-06T14:44:24.194 INFO:tasks.workunit.client.1.smithi165.stdout:8/246: dwrite d0/f17 [0,4194304] 0 2024-09-06T14:44:24.198 INFO:tasks.workunit.client.1.smithi165.stdout:3/138: creat d1/d19/f29 x:0 0 0 2024-09-06T14:44:24.200 INFO:tasks.workunit.client.1.smithi165.stdout:1/193: fsync d0/d2a/d1b/d2b/f38 0 2024-09-06T14:44:24.201 INFO:tasks.workunit.client.1.smithi165.stdout:2/192: rename d9/d25/d3a to d9/d3b 0 2024-09-06T14:44:24.205 INFO:tasks.workunit.client.1.smithi165.stdout:5/221: dwrite d6/f13 [0,4194304] 0 2024-09-06T14:44:24.207 INFO:tasks.workunit.client.1.smithi165.stdout:9/364: dwrite db/de/d2d/d5a/f6d [0,4194304] 0 2024-09-06T14:44:24.210 INFO:tasks.workunit.client.1.smithi165.stdout:9/365: fdatasync db/de/d15/d17/f4c 0 2024-09-06T14:44:24.216 INFO:tasks.workunit.client.1.smithi165.stdout:4/226: creat d5/d1b/f49 x:0 0 0 2024-09-06T14:44:24.216 INFO:tasks.workunit.client.1.smithi165.stdout:3/139: rename d1/da/dd/f20 to d1/da/f2a 0 2024-09-06T14:44:24.217 INFO:tasks.workunit.client.1.smithi165.stdout:2/193: creat d9/d23/d26/f3c x:0 0 0 2024-09-06T14:44:24.217 INFO:tasks.workunit.client.1.smithi165.stdout:5/222: dwrite d6/d1c/f3d [0,4194304] 0 2024-09-06T14:44:24.218 INFO:tasks.workunit.client.1.smithi165.stdout:0/229: write d15/d19/f25 [3232242,112227] 0 2024-09-06T14:44:24.219 INFO:tasks.workunit.client.1.smithi165.stdout:4/227: truncate d5/f46 493761 0 2024-09-06T14:44:24.220 INFO:tasks.workunit.client.1.smithi165.stdout:7/93: rename l19 to l1a 0 2024-09-06T14:44:24.223 INFO:tasks.workunit.client.1.smithi165.stdout:7/94: write f12 [350358,89224] 0 2024-09-06T14:44:24.223 INFO:tasks.workunit.client.1.smithi165.stdout:1/194: symlink d0/d1c/l44 0 2024-09-06T14:44:24.230 INFO:tasks.workunit.client.1.smithi165.stdout:5/223: unlink d6/d1c/d28/f36 0 2024-09-06T14:44:24.232 INFO:tasks.workunit.client.1.smithi165.stdout:9/366: dwrite db/de/d15/d17/d18/f5d [0,4194304] 0 2024-09-06T14:44:24.233 INFO:tasks.workunit.client.1.smithi165.stdout:9/367: chown db/de/d16/d2e/f3d 127 1 2024-09-06T14:44:24.235 INFO:tasks.workunit.client.1.smithi165.stdout:5/224: write d6/d1c/f38 [199516,12964] 0 2024-09-06T14:44:24.237 INFO:tasks.workunit.client.1.smithi165.stdout:3/140: write d1/da/f26 [3752608,3006] 0 2024-09-06T14:44:24.243 INFO:tasks.workunit.client.1.smithi165.stdout:9/368: mknod db/de/d15/d17/d72/c77 0 2024-09-06T14:44:24.244 INFO:tasks.workunit.client.1.smithi165.stdout:5/225: dread d6/f13 [0,4194304] 0 2024-09-06T14:44:24.246 INFO:tasks.workunit.client.1.smithi165.stdout:3/141: symlink d1/l2b 0 2024-09-06T14:44:24.246 INFO:tasks.workunit.client.1.smithi165.stdout:5/226: fsync d6/d1c/f1f 0 2024-09-06T14:44:24.246 INFO:tasks.workunit.client.1.smithi165.stdout:4/228: symlink d5/d1b/l4a 0 2024-09-06T14:44:24.247 INFO:tasks.workunit.client.1.smithi165.stdout:5/227: read - d6/d1c/d28/f3b zero size 2024-09-06T14:44:24.248 INFO:tasks.workunit.client.1.smithi165.stdout:9/369: creat db/de/d15/d17/d72/f78 x:0 0 0 2024-09-06T14:44:24.250 INFO:tasks.workunit.client.1.smithi165.stdout:3/142: write d1/da/dc/d10/f23 [582650,39287] 0 2024-09-06T14:44:24.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/95: creat f1b x:0 0 0 2024-09-06T14:44:24.253 INFO:tasks.workunit.client.1.smithi165.stdout:9/370: rmdir db/de/d2d/d5a 39 2024-09-06T14:44:24.255 INFO:tasks.workunit.client.1.smithi165.stdout:3/143: creat d1/da/dd/f2c x:0 0 0 2024-09-06T14:44:24.261 INFO:tasks.workunit.client.1.smithi165.stdout:2/194: write d9/d23/d29/f2b [3601,19276] 0 2024-09-06T14:44:24.262 INFO:tasks.workunit.client.1.smithi165.stdout:9/371: dread db/de/d16/d2e/f3d [0,4194304] 0 2024-09-06T14:44:24.263 INFO:tasks.workunit.client.1.smithi165.stdout:2/195: chown d9/d3b 13928293 1 2024-09-06T14:44:24.264 INFO:tasks.workunit.client.1.smithi165.stdout:5/228: dwrite d6/d1c/d28/d2d/f53 [0,4194304] 0 2024-09-06T14:44:24.266 INFO:tasks.workunit.client.1.smithi165.stdout:2/196: write d9/fc [1096208,93717] 0 2024-09-06T14:44:24.270 INFO:tasks.workunit.client.1.smithi165.stdout:2/197: write d9/f13 [9758359,562] 0 2024-09-06T14:44:24.271 INFO:tasks.workunit.client.1.smithi165.stdout:3/144: dwrite d1/da/dd/f2c [0,4194304] 0 2024-09-06T14:44:24.272 INFO:tasks.workunit.client.1.smithi165.stdout:1/195: dread d0/f14 [0,4194304] 0 2024-09-06T14:44:24.278 INFO:tasks.workunit.client.1.smithi165.stdout:5/229: symlink d6/d1c/d28/d2d/d3c/l5c 0 2024-09-06T14:44:24.279 INFO:tasks.workunit.client.1.smithi165.stdout:2/198: rmdir d9/d23/d29 39 2024-09-06T14:44:24.282 INFO:tasks.workunit.client.1.smithi165.stdout:1/196: unlink d0/d1c/d1d/d22/l25 0 2024-09-06T14:44:24.283 INFO:tasks.workunit.client.1.smithi165.stdout:9/372: dwrite db/de/d2d/f3c [0,4194304] 0 2024-09-06T14:44:24.285 INFO:tasks.workunit.client.1.smithi165.stdout:7/96: chown l1a 0 1 2024-09-06T14:44:24.290 INFO:tasks.workunit.client.1.smithi165.stdout:0/230: write d15/d19/f46 [997379,70747] 0 2024-09-06T14:44:24.291 INFO:tasks.workunit.client.1.smithi165.stdout:0/231: chown d15/d19/f1e 37 1 2024-09-06T14:44:24.295 INFO:tasks.workunit.client.1.smithi165.stdout:9/373: readlink db/de/d15/d17/l4a 0 2024-09-06T14:44:24.295 INFO:tasks.workunit.client.1.smithi165.stdout:9/374: chown db/de/d15/f28 421 1 2024-09-06T14:44:24.296 INFO:tasks.workunit.client.1.smithi165.stdout:9/375: fdatasync db/de/d15/d17/f4c 0 2024-09-06T14:44:24.298 INFO:tasks.workunit.client.1.smithi165.stdout:2/199: mknod d9/d23/d29/c3d 0 2024-09-06T14:44:24.301 INFO:tasks.workunit.client.1.smithi165.stdout:5/230: truncate d6/d1c/f26 848945 0 2024-09-06T14:44:24.302 INFO:tasks.workunit.client.1.smithi165.stdout:5/231: write d6/f57 [617536,57169] 0 2024-09-06T14:44:24.303 INFO:tasks.workunit.client.1.smithi165.stdout:1/197: mkdir d0/d45 0 2024-09-06T14:44:24.305 INFO:tasks.workunit.client.1.smithi165.stdout:0/232: creat d15/d19/d38/f4c x:0 0 0 2024-09-06T14:44:24.306 INFO:tasks.workunit.client.1.smithi165.stdout:0/233: chown d15/c18 42463001 1 2024-09-06T14:44:24.306 INFO:tasks.workunit.client.1.smithi165.stdout:9/376: stat db/de/d2d/d5a/d61 0 2024-09-06T14:44:24.309 INFO:tasks.workunit.client.1.smithi165.stdout:2/200: mknod d9/d25/c3e 0 2024-09-06T14:44:24.315 INFO:tasks.workunit.client.1.smithi165.stdout:4/229: truncate f2 438757 0 2024-09-06T14:44:24.316 INFO:tasks.workunit.client.1.smithi165.stdout:7/97: rename l11 to l1c 0 2024-09-06T14:44:24.318 INFO:tasks.workunit.client.1.smithi165.stdout:2/201: unlink d9/d25/l27 0 2024-09-06T14:44:24.320 INFO:tasks.workunit.client.1.smithi165.stdout:6/158: sync 2024-09-06T14:44:24.320 INFO:tasks.workunit.client.1.smithi165.stdout:6/159: readlink l12 0 2024-09-06T14:44:24.323 INFO:tasks.workunit.client.1.smithi165.stdout:9/377: symlink db/de/d15/d17/l79 0 2024-09-06T14:44:24.327 INFO:tasks.workunit.client.1.smithi165.stdout:5/232: link d6/l7 d6/d1c/d28/d2d/d3c/l5d 0 2024-09-06T14:44:24.329 INFO:tasks.workunit.client.1.smithi165.stdout:6/160: creat f28 x:0 0 0 2024-09-06T14:44:24.332 INFO:tasks.workunit.client.1.smithi165.stdout:4/230: link d5/fc d5/d1b/d1c/d20/d26/f4b 0 2024-09-06T14:44:24.332 INFO:tasks.workunit.client.1.smithi165.stdout:2/202: dwrite d9/d23/f28 [0,4194304] 0 2024-09-06T14:44:24.334 INFO:tasks.workunit.client.1.smithi165.stdout:5/233: creat d6/d1c/d28/d4b/f5e x:0 0 0 2024-09-06T14:44:24.336 INFO:tasks.workunit.client.1.smithi165.stdout:6/161: mkdir d29 0 2024-09-06T14:44:24.338 INFO:tasks.workunit.client.1.smithi165.stdout:0/234: rename d15/d19/d2c/l44 to d15/d19/l4d 0 2024-09-06T14:44:24.339 INFO:tasks.workunit.client.1.smithi165.stdout:4/231: dwrite d5/f2c [0,4194304] 0 2024-09-06T14:44:24.341 INFO:tasks.workunit.client.1.smithi165.stdout:4/232: write d5/f13 [1464056,9472] 0 2024-09-06T14:44:24.345 INFO:tasks.workunit.client.1.smithi165.stdout:6/162: dwrite f16 [0,4194304] 0 2024-09-06T14:44:24.346 INFO:tasks.workunit.client.1.smithi165.stdout:7/98: creat f1d x:0 0 0 2024-09-06T14:44:24.347 INFO:tasks.workunit.client.1.smithi165.stdout:7/99: chown f18 289852901 1 2024-09-06T14:44:24.348 INFO:tasks.workunit.client.1.smithi165.stdout:3/145: truncate d1/da/dd/f2c 2817968 0 2024-09-06T14:44:24.349 INFO:tasks.workunit.client.1.smithi165.stdout:2/203: mknod d9/d3b/c3f 0 2024-09-06T14:44:24.349 INFO:tasks.workunit.client.1.smithi165.stdout:5/234: mknod d6/d1c/d28/d2d/d3c/c5f 0 2024-09-06T14:44:24.350 INFO:tasks.workunit.client.1.smithi165.stdout:2/204: write d9/fa [1898808,99868] 0 2024-09-06T14:44:24.353 INFO:tasks.workunit.client.1.smithi165.stdout:0/235: unlink f10 0 2024-09-06T14:44:24.359 INFO:tasks.workunit.client.1.smithi165.stdout:7/100: stat l9 0 2024-09-06T14:44:24.359 INFO:tasks.workunit.client.1.smithi165.stdout:7/101: fsync f1b 0 2024-09-06T14:44:24.360 INFO:tasks.workunit.client.1.smithi165.stdout:5/235: mkdir d6/d1c/d28/d4b/d60 0 2024-09-06T14:44:24.361 INFO:tasks.workunit.client.1.smithi165.stdout:5/236: write d6/d1c/f5a [430793,80442] 0 2024-09-06T14:44:24.361 INFO:tasks.workunit.client.1.smithi165.stdout:3/146: rmdir d1/da/dc 39 2024-09-06T14:44:24.362 INFO:tasks.workunit.client.1.smithi165.stdout:3/147: write d1/d19/f28 [672242,55305] 0 2024-09-06T14:44:24.364 INFO:tasks.workunit.client.1.smithi165.stdout:0/236: write d15/f4b [2506353,36440] 0 2024-09-06T14:44:24.368 INFO:tasks.workunit.client.1.smithi165.stdout:4/233: creat d5/d1b/d48/f4c x:0 0 0 2024-09-06T14:44:24.369 INFO:tasks.workunit.client.1.smithi165.stdout:6/163: creat d29/f2a x:0 0 0 2024-09-06T14:44:24.371 INFO:tasks.workunit.client.1.smithi165.stdout:1/198: truncate d0/d2a/fd 5726600 0 2024-09-06T14:44:24.373 INFO:tasks.workunit.client.1.smithi165.stdout:5/237: mkdir d6/d1c/d28/d2d/d61 0 2024-09-06T14:44:24.373 INFO:tasks.workunit.client.1.smithi165.stdout:5/238: dread - d6/d1c/d28/f2e zero size 2024-09-06T14:44:24.375 INFO:tasks.workunit.client.1.smithi165.stdout:0/237: mknod d15/d19/d2c/c4e 0 2024-09-06T14:44:24.378 INFO:tasks.workunit.client.1.smithi165.stdout:6/164: mknod d29/c2b 0 2024-09-06T14:44:24.379 INFO:tasks.workunit.client.1.smithi165.stdout:6/165: dread - f1e zero size 2024-09-06T14:44:24.379 INFO:tasks.workunit.client.1.smithi165.stdout:6/166: dread - f22 zero size 2024-09-06T14:44:24.386 INFO:tasks.workunit.client.1.smithi165.stdout:0/238: mkdir d15/d19/d28/d4f 0 2024-09-06T14:44:24.388 INFO:tasks.workunit.client.1.smithi165.stdout:6/167: unlink d29/f2a 0 2024-09-06T14:44:24.389 INFO:tasks.workunit.client.1.smithi165.stdout:4/234: link d5/d1b/d1c/d20/d26/f38 d5/d1b/d48/f4d 0 2024-09-06T14:44:24.392 INFO:tasks.workunit.client.1.smithi165.stdout:3/148: read d1/da/dd/f2c [2700119,101855] 0 2024-09-06T14:44:24.393 INFO:tasks.workunit.client.1.smithi165.stdout:3/149: write d1/d19/f29 [1045300,63414] 0 2024-09-06T14:44:24.399 INFO:tasks.workunit.client.1.smithi165.stdout:6/168: symlink d29/l2c 0 2024-09-06T14:44:24.399 INFO:tasks.workunit.client.1.smithi165.stdout:3/150: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:24.404 INFO:tasks.workunit.client.1.smithi165.stdout:0/239: mkdir d15/d19/d50 0 2024-09-06T14:44:24.408 INFO:tasks.workunit.client.1.smithi165.stdout:4/235: mknod d5/d1b/c4e 0 2024-09-06T14:44:24.413 INFO:tasks.workunit.client.1.smithi165.stdout:8/247: sync 2024-09-06T14:44:24.413 INFO:tasks.workunit.client.1.smithi165.stdout:0/240: mkdir d15/d19/d28/d51 0 2024-09-06T14:44:24.413 INFO:tasks.workunit.client.1.smithi165.stdout:0/241: chown d15/f4b 149494 1 2024-09-06T14:44:24.414 INFO:tasks.workunit.client.1.smithi165.stdout:8/248: write d0/d19/f3b [32280,124267] 0 2024-09-06T14:44:24.417 INFO:tasks.workunit.client.1.smithi165.stdout:3/151: dread d1/da/f26 [0,4194304] 0 2024-09-06T14:44:24.419 INFO:tasks.workunit.client.1.smithi165.stdout:3/152: fsync d1/da/dd/f15 0 2024-09-06T14:44:24.419 INFO:tasks.workunit.client.1.smithi165.stdout:4/236: fdatasync d5/d1b/d1c/f34 0 2024-09-06T14:44:24.420 INFO:tasks.workunit.client.1.smithi165.stdout:4/237: dread - d5/d1b/d1c/d41/f44 zero size 2024-09-06T14:44:24.422 INFO:tasks.workunit.client.1.smithi165.stdout:0/242: fsync fb 0 2024-09-06T14:44:24.425 INFO:tasks.workunit.client.1.smithi165.stdout:6/169: link c11 d29/c2d 0 2024-09-06T14:44:24.426 INFO:tasks.workunit.client.1.smithi165.stdout:7/102: truncate f3 854910 0 2024-09-06T14:44:24.431 INFO:tasks.workunit.client.1.smithi165.stdout:4/238: creat d5/d1b/d1c/f4f x:0 0 0 2024-09-06T14:44:24.436 INFO:tasks.workunit.client.1.smithi165.stdout:1/199: truncate d0/d2a/d23/f36 1539074 0 2024-09-06T14:44:24.436 INFO:tasks.workunit.client.1.smithi165.stdout:1/200: fsync d0/d1c/d1d/f3c 0 2024-09-06T14:44:24.436 INFO:tasks.workunit.client.1.smithi165.stdout:8/249: symlink d0/d19/d36/d2d/d3f/l5a 0 2024-09-06T14:44:24.437 INFO:tasks.workunit.client.1.smithi165.stdout:8/250: chown d0/d19/d36/d2d/d33/f4c 1468160 1 2024-09-06T14:44:24.438 INFO:tasks.workunit.client.1.smithi165.stdout:8/251: readlink d0/d19/d36/l21 0 2024-09-06T14:44:24.439 INFO:tasks.workunit.client.1.smithi165.stdout:5/239: truncate d6/d1c/d28/f2c 857650 0 2024-09-06T14:44:24.439 INFO:tasks.workunit.client.1.smithi165.stdout:5/240: read - d6/f1a zero size 2024-09-06T14:44:24.440 INFO:tasks.workunit.client.1.smithi165.stdout:5/241: write d6/d1c/d28/d2d/d49/f4e [683675,25771] 0 2024-09-06T14:44:24.444 INFO:tasks.workunit.client.1.smithi165.stdout:0/243: mkdir d15/d19/d28/d4f/d52 0 2024-09-06T14:44:24.445 INFO:tasks.workunit.client.1.smithi165.stdout:1/201: rename d0 to d0/d46 22 2024-09-06T14:44:24.446 INFO:tasks.workunit.client.1.smithi165.stdout:1/202: chown d0/d2a/l19 8 1 2024-09-06T14:44:24.449 INFO:tasks.workunit.client.1.smithi165.stdout:8/252: unlink d0/d19/d36/d28/f45 0 2024-09-06T14:44:24.450 INFO:tasks.workunit.client.1.smithi165.stdout:8/253: write d0/d19/d36/f7 [5138520,50163] 0 2024-09-06T14:44:24.451 INFO:tasks.workunit.client.1.smithi165.stdout:8/254: read d0/f17 [982476,89496] 0 2024-09-06T14:44:24.453 INFO:tasks.workunit.client.1.smithi165.stdout:7/103: mknod c1e 0 2024-09-06T14:44:24.455 INFO:tasks.workunit.client.1.smithi165.stdout:3/153: creat d1/da/f2d x:0 0 0 2024-09-06T14:44:24.458 INFO:tasks.workunit.client.1.smithi165.stdout:4/239: link d5/d1b/d48/f4c d5/f50 0 2024-09-06T14:44:24.460 INFO:tasks.workunit.client.1.smithi165.stdout:1/203: truncate d0/d1c/d1d/d22/f2e 1807607 0 2024-09-06T14:44:24.462 INFO:tasks.workunit.client.1.smithi165.stdout:6/170: link l13 d29/l2e 0 2024-09-06T14:44:24.473 INFO:tasks.workunit.client.1.smithi165.stdout:3/154: dread - d1/da/dc/d10/f1a zero size 2024-09-06T14:44:24.475 INFO:tasks.workunit.client.1.smithi165.stdout:4/240: rmdir d5/d1b/d48 39 2024-09-06T14:44:24.483 INFO:tasks.workunit.client.1.smithi165.stdout:8/255: mkdir d0/d14/d50/d5b 0 2024-09-06T14:44:24.483 INFO:tasks.workunit.client.1.smithi165.stdout:8/256: readlink d0/d34/d43/l4d 0 2024-09-06T14:44:24.484 INFO:tasks.workunit.client.1.smithi165.stdout:8/257: chown d0/d14/d3e 206486 1 2024-09-06T14:44:24.486 INFO:tasks.workunit.client.1.smithi165.stdout:7/104: link f17 f1f 0 2024-09-06T14:44:24.489 INFO:tasks.workunit.client.1.smithi165.stdout:8/258: rename d0/d19/d36/d2d/d33/c54 to d0/d19/c5c 0 2024-09-06T14:44:24.490 INFO:tasks.workunit.client.1.smithi165.stdout:6/171: getdents d29 0 2024-09-06T14:44:24.492 INFO:tasks.workunit.client.1.smithi165.stdout:6/172: write f1f [5056010,116858] 0 2024-09-06T14:44:24.492 INFO:tasks.workunit.client.1.smithi165.stdout:8/259: symlink d0/d14/d3e/l5d 0 2024-09-06T14:44:24.492 INFO:tasks.workunit.client.1.smithi165.stdout:8/260: chown d0/l31 6 1 2024-09-06T14:44:24.492 INFO:tasks.workunit.client.1.smithi165.stdout:7/105: mkdir d20 0 2024-09-06T14:44:24.492 INFO:tasks.workunit.client.1.smithi165.stdout:8/261: dread - d0/d34/d43/f59 zero size 2024-09-06T14:44:24.493 INFO:tasks.workunit.client.1.smithi165.stdout:3/155: fsync d1/da/f2d 0 2024-09-06T14:44:24.494 INFO:tasks.workunit.client.1.smithi165.stdout:6/173: chown f8 2 1 2024-09-06T14:44:24.494 INFO:tasks.workunit.client.1.smithi165.stdout:6/174: readlink l21 0 2024-09-06T14:44:24.494 INFO:tasks.workunit.client.1.smithi165.stdout:7/106: readlink ld 0 2024-09-06T14:44:24.495 INFO:tasks.workunit.client.1.smithi165.stdout:8/262: unlink d0/d19/d24/d26/c42 0 2024-09-06T14:44:24.496 INFO:tasks.workunit.client.1.smithi165.stdout:6/175: symlink d29/l2f 0 2024-09-06T14:44:24.496 INFO:tasks.workunit.client.1.smithi165.stdout:6/176: stat f1f 0 2024-09-06T14:44:24.497 INFO:tasks.workunit.client.1.smithi165.stdout:7/107: creat d20/f21 x:0 0 0 2024-09-06T14:44:24.498 INFO:tasks.workunit.client.1.smithi165.stdout:6/177: creat d29/f30 x:0 0 0 2024-09-06T14:44:24.498 INFO:tasks.workunit.client.1.smithi165.stdout:6/178: dread - d29/f30 zero size 2024-09-06T14:44:24.499 INFO:tasks.workunit.client.1.smithi165.stdout:8/263: mkdir d0/d5e 0 2024-09-06T14:44:24.500 INFO:tasks.workunit.client.1.smithi165.stdout:7/108: rename f1b to d20/f22 0 2024-09-06T14:44:24.501 INFO:tasks.workunit.client.1.smithi165.stdout:6/179: write f17 [7330367,129775] 0 2024-09-06T14:44:24.533 INFO:tasks.workunit.client.1.smithi165.stdout:9/378: sync 2024-09-06T14:44:24.534 INFO:tasks.workunit.client.1.smithi165.stdout:8/264: creat d0/d34/d43/f5f x:0 0 0 2024-09-06T14:44:24.535 INFO:tasks.workunit.client.1.smithi165.stdout:5/242: truncate d6/d1c/f3a 712399 0 2024-09-06T14:44:24.536 INFO:tasks.workunit.client.1.smithi165.stdout:8/265: readlink d0/d19/l20 0 2024-09-06T14:44:24.536 INFO:tasks.workunit.client.1.smithi165.stdout:4/241: write d5/d1b/d1c/f34 [781789,120426] 0 2024-09-06T14:44:24.537 INFO:tasks.workunit.client.1.smithi165.stdout:5/243: chown d6/f57 4 1 2024-09-06T14:44:24.537 INFO:tasks.workunit.client.1.smithi165.stdout:8/266: fdatasync d0/d19/d24/f37 0 2024-09-06T14:44:24.538 INFO:tasks.workunit.client.1.smithi165.stdout:1/204: write d0/d2a/fd [37438,104368] 0 2024-09-06T14:44:24.538 INFO:tasks.workunit.client.1.smithi165.stdout:5/244: chown d6/d1c/d28/d4b/f5e 241558246 1 2024-09-06T14:44:24.540 INFO:tasks.workunit.client.1.smithi165.stdout:9/379: creat db/de/d2d/d6c/f7a x:0 0 0 2024-09-06T14:44:24.541 INFO:tasks.workunit.client.1.smithi165.stdout:8/267: rmdir d0/d19/d36/d2d/d33/d3a/d46 39 2024-09-06T14:44:24.542 INFO:tasks.workunit.client.1.smithi165.stdout:4/242: creat d5/d1b/d48/f51 x:0 0 0 2024-09-06T14:44:24.543 INFO:tasks.workunit.client.1.smithi165.stdout:6/180: getdents d29 0 2024-09-06T14:44:24.545 INFO:tasks.workunit.client.1.smithi165.stdout:8/268: mknod d0/d14/c60 0 2024-09-06T14:44:24.546 INFO:tasks.workunit.client.1.smithi165.stdout:9/380: creat db/f7b x:0 0 0 2024-09-06T14:44:24.547 INFO:tasks.workunit.client.1.smithi165.stdout:1/205: link d0/c29 d0/d2a/c47 0 2024-09-06T14:44:24.548 INFO:tasks.workunit.client.1.smithi165.stdout:8/269: fdatasync d0/d14/d3e/f4b 0 2024-09-06T14:44:24.548 INFO:tasks.workunit.client.1.smithi165.stdout:5/245: dread d6/f1d [0,4194304] 0 2024-09-06T14:44:24.550 INFO:tasks.workunit.client.1.smithi165.stdout:4/243: dread d5/d1b/d1c/f22 [0,4194304] 0 2024-09-06T14:44:24.551 INFO:tasks.workunit.client.1.smithi165.stdout:5/246: stat d6/ce 0 2024-09-06T14:44:24.552 INFO:tasks.workunit.client.1.smithi165.stdout:7/109: dwrite f16 [0,4194304] 0 2024-09-06T14:44:24.553 INFO:tasks.workunit.client.1.smithi165.stdout:8/270: chown d0/l3 16681723 1 2024-09-06T14:44:24.553 INFO:tasks.workunit.client.1.smithi165.stdout:6/181: dread fc [0,4194304] 0 2024-09-06T14:44:24.555 INFO:tasks.workunit.client.1.smithi165.stdout:9/381: truncate db/d40/f53 1389832 0 2024-09-06T14:44:24.555 INFO:tasks.workunit.client.1.smithi165.stdout:6/182: chown f28 370747 1 2024-09-06T14:44:24.559 INFO:tasks.workunit.client.1.smithi165.stdout:1/206: rename d0/d1c/d41/l42 to d0/d1c/d40/l48 0 2024-09-06T14:44:24.560 INFO:tasks.workunit.client.1.smithi165.stdout:1/207: readlink d0/d1c/d1d/d22/l26 0 2024-09-06T14:44:24.561 INFO:tasks.workunit.client.1.smithi165.stdout:7/110: dwrite f3 [0,4194304] 0 2024-09-06T14:44:24.562 INFO:tasks.workunit.client.1.smithi165.stdout:5/247: mknod d6/d1c/d28/d4b/d55/c62 0 2024-09-06T14:44:24.563 INFO:tasks.workunit.client.1.smithi165.stdout:7/111: write f1d [6114,98446] 0 2024-09-06T14:44:24.564 INFO:tasks.workunit.client.1.smithi165.stdout:5/248: chown d6/f18 669 1 2024-09-06T14:44:24.564 INFO:tasks.workunit.client.1.smithi165.stdout:7/112: write f12 [700913,24319] 0 2024-09-06T14:44:24.565 INFO:tasks.workunit.client.1.smithi165.stdout:4/244: getdents d5/d1b 0 2024-09-06T14:44:24.567 INFO:tasks.workunit.client.1.smithi165.stdout:9/382: creat db/de/d15/f7c x:0 0 0 2024-09-06T14:44:24.568 INFO:tasks.workunit.client.1.smithi165.stdout:9/383: stat db/de/d15/l51 0 2024-09-06T14:44:24.568 INFO:tasks.workunit.client.1.smithi165.stdout:9/384: stat f4 0 2024-09-06T14:44:24.569 INFO:tasks.workunit.client.1.smithi165.stdout:6/183: rename l12 to d29/l31 0 2024-09-06T14:44:24.570 INFO:tasks.workunit.client.1.smithi165.stdout:5/249: creat d6/d32/f63 x:0 0 0 2024-09-06T14:44:24.571 INFO:tasks.workunit.client.1.smithi165.stdout:5/250: stat d6/d1c/f38 0 2024-09-06T14:44:24.572 INFO:tasks.workunit.client.1.smithi165.stdout:7/113: dread f17 [0,4194304] 0 2024-09-06T14:44:24.573 INFO:tasks.workunit.client.1.smithi165.stdout:1/208: link d0/d2a/f12 d0/d2a/d1b/d2b/d3e/f49 0 2024-09-06T14:44:24.573 INFO:tasks.workunit.client.1.smithi165.stdout:6/184: unlink f6 0 2024-09-06T14:44:24.573 INFO:tasks.workunit.client.1.smithi165.stdout:4/245: rename d5/d1b/d48/f51 to d5/d1b/d1c/d41/f52 0 2024-09-06T14:44:24.575 INFO:tasks.workunit.client.1.smithi165.stdout:8/271: dread d0/fc [0,4194304] 0 2024-09-06T14:44:24.576 INFO:tasks.workunit.client.1.smithi165.stdout:7/114: fsync f17 0 2024-09-06T14:44:24.577 INFO:tasks.workunit.client.1.smithi165.stdout:5/251: mkdir d6/d1c/d64 0 2024-09-06T14:44:24.579 INFO:tasks.workunit.client.1.smithi165.stdout:5/252: write d6/f24 [1136842,60539] 0 2024-09-06T14:44:24.580 INFO:tasks.workunit.client.1.smithi165.stdout:9/385: rename db/de/d2d/d5a to db/de/d15/d17/d18/d7d 0 2024-09-06T14:44:24.581 INFO:tasks.workunit.client.1.smithi165.stdout:9/386: chown db/de/d15/d17/l4a 320 1 2024-09-06T14:44:24.582 INFO:tasks.workunit.client.1.smithi165.stdout:1/209: write d0/d2a/d1b/f1f [3132094,125657] 0 2024-09-06T14:44:24.583 INFO:tasks.workunit.client.1.smithi165.stdout:7/115: mknod d20/c23 0 2024-09-06T14:44:24.584 INFO:tasks.workunit.client.1.smithi165.stdout:9/387: fdatasync db/de/d2d/f3c 0 2024-09-06T14:44:24.584 INFO:tasks.workunit.client.1.smithi165.stdout:7/116: truncate f13 48675 0 2024-09-06T14:44:24.585 INFO:tasks.workunit.client.1.smithi165.stdout:7/117: write f1d [654658,121825] 0 2024-09-06T14:44:24.589 INFO:tasks.workunit.client.1.smithi165.stdout:4/246: link d5/d1b/d1c/f39 d5/d1b/d48/f53 0 2024-09-06T14:44:24.589 INFO:tasks.workunit.client.1.smithi165.stdout:6/185: dread f3 [0,4194304] 0 2024-09-06T14:44:24.590 INFO:tasks.workunit.client.1.smithi165.stdout:2/205: sync 2024-09-06T14:44:24.590 INFO:tasks.workunit.client.1.smithi165.stdout:0/244: sync 2024-09-06T14:44:24.592 INFO:tasks.workunit.client.1.smithi165.stdout:5/253: creat d6/d1c/d64/f65 x:0 0 0 2024-09-06T14:44:24.595 INFO:tasks.workunit.client.1.smithi165.stdout:4/247: truncate d5/d1b/d1c/f39 48810 0 2024-09-06T14:44:24.595 INFO:tasks.workunit.client.1.smithi165.stdout:0/245: truncate d15/d19/d28/f42 397351 0 2024-09-06T14:44:24.595 INFO:tasks.workunit.client.1.smithi165.stdout:6/186: read - f1e zero size 2024-09-06T14:44:24.597 INFO:tasks.workunit.client.1.smithi165.stdout:5/254: chown d6/d1c/f22 2 1 2024-09-06T14:44:24.597 INFO:tasks.workunit.client.1.smithi165.stdout:8/272: dread d0/d19/d36/fa [0,4194304] 0 2024-09-06T14:44:24.598 INFO:tasks.workunit.client.1.smithi165.stdout:0/246: fdatasync d15/d19/f27 0 2024-09-06T14:44:24.599 INFO:tasks.workunit.client.1.smithi165.stdout:7/118: dwrite ff [0,4194304] 0 2024-09-06T14:44:24.599 INFO:tasks.workunit.client.1.smithi165.stdout:9/388: link db/de/d15/d17/d72/c77 db/de/d15/d17/d18/d7d/c7e 0 2024-09-06T14:44:24.600 INFO:tasks.workunit.client.1.smithi165.stdout:1/210: dread d0/d1c/d1d/d22/f2e [0,4194304] 0 2024-09-06T14:44:24.600 INFO:tasks.workunit.client.1.smithi165.stdout:5/255: read d6/f24 [1938422,20873] 0 2024-09-06T14:44:24.601 INFO:tasks.workunit.client.1.smithi165.stdout:0/247: fsync d15/d19/d2c/f36 0 2024-09-06T14:44:24.601 INFO:tasks.workunit.client.1.smithi165.stdout:6/187: mkdir d29/d32 0 2024-09-06T14:44:24.602 INFO:tasks.workunit.client.1.smithi165.stdout:2/206: getdents d9/d23/d26/d2d 0 2024-09-06T14:44:24.604 INFO:tasks.workunit.client.1.smithi165.stdout:4/248: rename d5/d1b/c3d to d5/d1b/d1c/d20/d26/c54 0 2024-09-06T14:44:24.604 INFO:tasks.workunit.client.1.smithi165.stdout:7/119: rmdir d20 39 2024-09-06T14:44:24.606 INFO:tasks.workunit.client.1.smithi165.stdout:5/256: readlink d6/d1c/d28/d2d/d3c/l5d 0 2024-09-06T14:44:24.607 INFO:tasks.workunit.client.1.smithi165.stdout:5/257: fdatasync d6/f57 0 2024-09-06T14:44:24.610 INFO:tasks.workunit.client.1.smithi165.stdout:2/207: creat d9/d25/f40 x:0 0 0 2024-09-06T14:44:24.610 INFO:tasks.workunit.client.1.smithi165.stdout:5/258: write d6/f23 [249375,19568] 0 2024-09-06T14:44:24.611 INFO:tasks.workunit.client.1.smithi165.stdout:6/188: symlink d29/d32/l33 0 2024-09-06T14:44:24.611 INFO:tasks.workunit.client.1.smithi165.stdout:0/248: mkdir d15/d19/d50/d53 0 2024-09-06T14:44:24.614 INFO:tasks.workunit.client.1.smithi165.stdout:2/208: mknod d9/d23/d26/d2d/d34/c41 0 2024-09-06T14:44:24.615 INFO:tasks.workunit.client.1.smithi165.stdout:6/189: symlink d29/l34 0 2024-09-06T14:44:24.615 INFO:tasks.workunit.client.1.smithi165.stdout:4/249: dwrite d5/f13 [4194304,4194304] 0 2024-09-06T14:44:24.615 INFO:tasks.workunit.client.1.smithi165.stdout:2/209: chown d9/f1b 5311 1 2024-09-06T14:44:24.616 INFO:tasks.workunit.client.1.smithi165.stdout:2/210: read d9/d25/f33 [3268788,103398] 0 2024-09-06T14:44:24.617 INFO:tasks.workunit.client.1.smithi165.stdout:0/249: creat d15/d19/d28/d3a/d3f/f54 x:0 0 0 2024-09-06T14:44:24.618 INFO:tasks.workunit.client.1.smithi165.stdout:7/120: getdents d20 0 2024-09-06T14:44:24.618 INFO:tasks.workunit.client.1.smithi165.stdout:6/190: write ff [2655397,73990] 0 2024-09-06T14:44:24.619 INFO:tasks.workunit.client.1.smithi165.stdout:7/121: chown f16 0 1 2024-09-06T14:44:24.623 INFO:tasks.workunit.client.1.smithi165.stdout:2/211: mknod d9/d23/d26/d2d/c42 0 2024-09-06T14:44:24.623 INFO:tasks.workunit.client.1.smithi165.stdout:6/191: fdatasync f25 0 2024-09-06T14:44:24.624 INFO:tasks.workunit.client.1.smithi165.stdout:9/389: write db/de/d16/f6b [1627879,129365] 0 2024-09-06T14:44:24.625 INFO:tasks.workunit.client.1.smithi165.stdout:7/122: creat d20/f24 x:0 0 0 2024-09-06T14:44:24.629 INFO:tasks.workunit.client.1.smithi165.stdout:0/250: mkdir d15/d55 0 2024-09-06T14:44:24.629 INFO:tasks.workunit.client.1.smithi165.stdout:7/123: chown c1e 52329 1 2024-09-06T14:44:24.629 INFO:tasks.workunit.client.1.smithi165.stdout:1/211: truncate d0/d2a/f2f 4582750 0 2024-09-06T14:44:24.629 INFO:tasks.workunit.client.1.smithi165.stdout:6/192: write f25 [726003,92907] 0 2024-09-06T14:44:24.629 INFO:tasks.workunit.client.1.smithi165.stdout:9/390: rmdir db 39 2024-09-06T14:44:24.629 INFO:tasks.workunit.client.1.smithi165.stdout:1/212: stat d0/f10 0 2024-09-06T14:44:24.630 INFO:tasks.workunit.client.1.smithi165.stdout:2/212: read d9/f13 [5936046,95124] 0 2024-09-06T14:44:24.631 INFO:tasks.workunit.client.1.smithi165.stdout:4/250: write d5/d1b/d1c/d20/d26/f28 [1028473,123974] 0 2024-09-06T14:44:24.633 INFO:tasks.workunit.client.1.smithi165.stdout:1/213: stat d0/d1c/d1d/f3c 0 2024-09-06T14:44:24.634 INFO:tasks.workunit.client.1.smithi165.stdout:8/273: dwrite d0/d14/f1b [0,4194304] 0 2024-09-06T14:44:24.639 INFO:tasks.workunit.client.1.smithi165.stdout:2/213: chown d9/l19 28025782 1 2024-09-06T14:44:24.639 INFO:tasks.workunit.client.1.smithi165.stdout:1/214: dread - d0/d1c/d1d/d22/f32 zero size 2024-09-06T14:44:24.639 INFO:tasks.workunit.client.1.smithi165.stdout:4/251: mkdir d5/d1b/d1c/d55 0 2024-09-06T14:44:24.643 INFO:tasks.workunit.client.1.smithi165.stdout:2/214: write d9/f35 [584405,9680] 0 2024-09-06T14:44:24.644 INFO:tasks.workunit.client.1.smithi165.stdout:7/124: dwrite f16 [0,4194304] 0 2024-09-06T14:44:24.645 INFO:tasks.workunit.client.1.smithi165.stdout:8/274: truncate d0/d14/d3e/f4b 981137 0 2024-09-06T14:44:24.646 INFO:tasks.workunit.client.1.smithi165.stdout:6/193: dread f1c [0,4194304] 0 2024-09-06T14:44:24.647 INFO:tasks.workunit.client.1.smithi165.stdout:9/391: mkdir db/de/d15/d7f 0 2024-09-06T14:44:24.651 INFO:tasks.workunit.client.1.smithi165.stdout:6/194: rename f1f to d29/f35 0 2024-09-06T14:44:24.653 INFO:tasks.workunit.client.1.smithi165.stdout:9/392: fdatasync db/de/d15/d17/d18/f4b 0 2024-09-06T14:44:24.654 INFO:tasks.workunit.client.1.smithi165.stdout:2/215: write d9/f18 [1259598,113964] 0 2024-09-06T14:44:24.655 INFO:tasks.workunit.client.1.smithi165.stdout:6/195: chown d29/c2b 36992156 1 2024-09-06T14:44:24.656 INFO:tasks.workunit.client.1.smithi165.stdout:0/251: dread d15/f32 [0,4194304] 0 2024-09-06T14:44:24.659 INFO:tasks.workunit.client.1.smithi165.stdout:4/252: dread d5/f8 [0,4194304] 0 2024-09-06T14:44:24.660 INFO:tasks.workunit.client.1.smithi165.stdout:2/216: truncate d9/f1b 1872630 0 2024-09-06T14:44:24.661 INFO:tasks.workunit.client.1.smithi165.stdout:2/217: readlink l4 0 2024-09-06T14:44:24.662 INFO:tasks.workunit.client.1.smithi165.stdout:6/196: link f25 d29/f36 0 2024-09-06T14:44:24.663 INFO:tasks.workunit.client.1.smithi165.stdout:7/125: dwrite d20/f21 [0,4194304] 0 2024-09-06T14:44:24.665 INFO:tasks.workunit.client.1.smithi165.stdout:2/218: chown d9/d3b/c3f 106 1 2024-09-06T14:44:24.666 INFO:tasks.workunit.client.1.smithi165.stdout:9/393: dread db/de/d16/d2e/f55 [0,4194304] 0 2024-09-06T14:44:24.671 INFO:tasks.workunit.client.1.smithi165.stdout:4/253: dread - d5/d1b/d48/f4c zero size 2024-09-06T14:44:24.674 INFO:tasks.workunit.client.1.smithi165.stdout:7/126: dread f1d [0,4194304] 0 2024-09-06T14:44:24.676 INFO:tasks.workunit.client.1.smithi165.stdout:1/215: dread d0/f10 [0,4194304] 0 2024-09-06T14:44:24.677 INFO:tasks.workunit.client.1.smithi165.stdout:2/219: truncate d9/f10 2675892 0 2024-09-06T14:44:24.681 INFO:tasks.workunit.client.1.smithi165.stdout:6/197: dwrite fc [0,4194304] 0 2024-09-06T14:44:24.681 INFO:tasks.workunit.client.1.smithi165.stdout:4/254: write d5/d1b/d1c/d20/d26/f28 [1511457,123160] 0 2024-09-06T14:44:24.682 INFO:tasks.workunit.client.1.smithi165.stdout:1/216: creat d0/d2a/d1b/d2b/f4a x:0 0 0 2024-09-06T14:44:24.683 INFO:tasks.workunit.client.1.smithi165.stdout:9/394: dread db/de/d15/d17/d18/d7d/f6d [0,4194304] 0 2024-09-06T14:44:24.684 INFO:tasks.workunit.client.1.smithi165.stdout:2/220: creat d9/d23/d26/d2d/d34/f43 x:0 0 0 2024-09-06T14:44:24.684 INFO:tasks.workunit.client.1.smithi165.stdout:6/198: truncate f25 1846171 0 2024-09-06T14:44:24.685 INFO:tasks.workunit.client.1.smithi165.stdout:1/217: write d0/f14 [2056692,15244] 0 2024-09-06T14:44:24.688 INFO:tasks.workunit.client.1.smithi165.stdout:9/395: chown db/de/d15/d17/d72 151689 1 2024-09-06T14:44:24.688 INFO:tasks.workunit.client.1.smithi165.stdout:6/199: chown d29/f36 54671862 1 2024-09-06T14:44:24.688 INFO:tasks.workunit.client.1.smithi165.stdout:4/255: read d5/d1b/d1c/f1d [2054055,29160] 0 2024-09-06T14:44:24.689 INFO:tasks.workunit.client.1.smithi165.stdout:2/221: write d9/d23/f28 [1829886,85510] 0 2024-09-06T14:44:24.689 INFO:tasks.workunit.client.1.smithi165.stdout:0/252: dwrite d15/d19/f1e [0,4194304] 0 2024-09-06T14:44:24.690 INFO:tasks.workunit.client.1.smithi165.stdout:1/218: write d0/f3d [410586,78416] 0 2024-09-06T14:44:24.691 INFO:tasks.workunit.client.1.smithi165.stdout:7/127: dread f16 [0,4194304] 0 2024-09-06T14:44:24.693 INFO:tasks.workunit.client.1.smithi165.stdout:2/222: dread d9/f1e [0,4194304] 0 2024-09-06T14:44:24.694 INFO:tasks.workunit.client.1.smithi165.stdout:6/200: unlink d29/d32/l33 0 2024-09-06T14:44:24.695 INFO:tasks.workunit.client.1.smithi165.stdout:7/128: chown f18 1944197490 1 2024-09-06T14:44:24.696 INFO:tasks.workunit.client.1.smithi165.stdout:0/253: mkdir d15/d19/d28/d56 0 2024-09-06T14:44:24.698 INFO:tasks.workunit.client.1.smithi165.stdout:7/129: write ff [1014262,25207] 0 2024-09-06T14:44:24.701 INFO:tasks.workunit.client.1.smithi165.stdout:9/396: symlink db/de/d2d/l80 0 2024-09-06T14:44:24.702 INFO:tasks.workunit.client.1.smithi165.stdout:7/130: rmdir d20 39 2024-09-06T14:44:24.704 INFO:tasks.workunit.client.1.smithi165.stdout:9/397: write db/de/d15/d17/f47 [5128236,91820] 0 2024-09-06T14:44:24.707 INFO:tasks.workunit.client.1.smithi165.stdout:1/219: write d0/d1c/d1d/d22/f32 [920894,39226] 0 2024-09-06T14:44:24.708 INFO:tasks.workunit.client.1.smithi165.stdout:0/254: dwrite d15/f2f [4194304,4194304] 0 2024-09-06T14:44:24.708 INFO:tasks.workunit.client.1.smithi165.stdout:7/131: rename c1e to d20/c25 0 2024-09-06T14:44:24.711 INFO:tasks.workunit.client.1.smithi165.stdout:2/223: truncate d9/f12 2137945 0 2024-09-06T14:44:24.712 INFO:tasks.workunit.client.1.smithi165.stdout:7/132: unlink d20/f22 0 2024-09-06T14:44:24.715 INFO:tasks.workunit.client.1.smithi165.stdout:2/224: mknod d9/d23/d26/c44 0 2024-09-06T14:44:24.716 INFO:tasks.workunit.client.1.smithi165.stdout:0/255: mkdir d15/d19/d50/d53/d57 0 2024-09-06T14:44:24.718 INFO:tasks.workunit.client.1.smithi165.stdout:7/133: mkdir d20/d26 0 2024-09-06T14:44:24.720 INFO:tasks.workunit.client.1.smithi165.stdout:1/220: getdents d0/d2a 0 2024-09-06T14:44:24.721 INFO:tasks.workunit.client.1.smithi165.stdout:4/256: dwrite d5/d1b/d1c/d20/d26/f38 [0,4194304] 0 2024-09-06T14:44:24.724 INFO:tasks.workunit.client.1.smithi165.stdout:7/134: write f8 [2886626,108530] 0 2024-09-06T14:44:24.726 INFO:tasks.workunit.client.1.smithi165.stdout:9/398: dwrite db/de/d16/d2e/f63 [0,4194304] 0 2024-09-06T14:44:24.727 INFO:tasks.workunit.client.1.smithi165.stdout:1/221: write d0/f3d [1454289,34855] 0 2024-09-06T14:44:24.727 INFO:tasks.workunit.client.1.smithi165.stdout:0/256: symlink d15/d19/d28/d4f/l58 0 2024-09-06T14:44:24.728 INFO:tasks.workunit.client.1.smithi165.stdout:6/201: dread d29/f35 [0,4194304] 0 2024-09-06T14:44:24.730 INFO:tasks.workunit.client.1.smithi165.stdout:2/225: write d9/d25/f33 [5144859,76340] 0 2024-09-06T14:44:24.732 INFO:tasks.workunit.client.1.smithi165.stdout:4/257: creat d5/d1b/d1c/d55/f56 x:0 0 0 2024-09-06T14:44:24.732 INFO:tasks.workunit.client.1.smithi165.stdout:3/156: sync 2024-09-06T14:44:24.733 INFO:tasks.workunit.client.1.smithi165.stdout:0/257: dread d15/d19/d28/f42 [0,4194304] 0 2024-09-06T14:44:24.733 INFO:tasks.workunit.client.1.smithi165.stdout:6/202: unlink d29/l2c 0 2024-09-06T14:44:24.734 INFO:tasks.workunit.client.1.smithi165.stdout:9/399: write db/de/d16/d2e/f3d [1201088,18302] 0 2024-09-06T14:44:24.734 INFO:tasks.workunit.client.1.smithi165.stdout:7/135: dread f17 [0,4194304] 0 2024-09-06T14:44:24.736 INFO:tasks.workunit.client.1.smithi165.stdout:9/400: read - db/de/d15/f7c zero size 2024-09-06T14:44:24.737 INFO:tasks.workunit.client.1.smithi165.stdout:3/157: creat d1/da/dc/f2e x:0 0 0 2024-09-06T14:44:24.741 INFO:tasks.workunit.client.1.smithi165.stdout:0/258: symlink d15/d19/d2c/l59 0 2024-09-06T14:44:24.741 INFO:tasks.workunit.client.1.smithi165.stdout:2/226: fdatasync f8 0 2024-09-06T14:44:24.741 INFO:tasks.workunit.client.1.smithi165.stdout:7/136: dread f1f [0,4194304] 0 2024-09-06T14:44:24.742 INFO:tasks.workunit.client.1.smithi165.stdout:0/259: fdatasync d15/d19/d2c/f45 0 2024-09-06T14:44:24.743 INFO:tasks.workunit.client.1.smithi165.stdout:2/227: mkdir d9/d25/d45 0 2024-09-06T14:44:24.744 INFO:tasks.workunit.client.1.smithi165.stdout:9/401: truncate db/de/d15/f2b 3335149 0 2024-09-06T14:44:24.744 INFO:tasks.workunit.client.1.smithi165.stdout:0/260: fsync d15/d19/f46 0 2024-09-06T14:44:24.745 INFO:tasks.workunit.client.1.smithi165.stdout:3/158: creat d1/da/f2f x:0 0 0 2024-09-06T14:44:24.747 INFO:tasks.workunit.client.1.smithi165.stdout:2/228: rmdir d9/d23/d26/d2d/d34 39 2024-09-06T14:44:24.747 INFO:tasks.workunit.client.1.smithi165.stdout:6/203: write f25 [2050743,94347] 0 2024-09-06T14:44:24.749 INFO:tasks.workunit.client.1.smithi165.stdout:9/402: chown db/de/d15/d17/d18/d59/d64/l68 1064851441 1 2024-09-06T14:44:24.749 INFO:tasks.workunit.client.1.smithi165.stdout:3/159: creat d1/da/dc/f30 x:0 0 0 2024-09-06T14:44:24.752 INFO:tasks.workunit.client.1.smithi165.stdout:6/204: rename d29/l2f to d29/l37 0 2024-09-06T14:44:24.754 INFO:tasks.workunit.client.1.smithi165.stdout:6/205: chown d29 5599 1 2024-09-06T14:44:24.754 INFO:tasks.workunit.client.1.smithi165.stdout:7/137: dread d20/f21 [0,4194304] 0 2024-09-06T14:44:24.754 INFO:tasks.workunit.client.1.smithi165.stdout:9/403: write db/de/d2d/d6c/f75 [718935,66616] 0 2024-09-06T14:44:24.755 INFO:tasks.workunit.client.1.smithi165.stdout:3/160: unlink d1/da/dc/d10/l16 0 2024-09-06T14:44:24.758 INFO:tasks.workunit.client.1.smithi165.stdout:0/261: dwrite ff [0,4194304] 0 2024-09-06T14:44:24.763 INFO:tasks.workunit.client.1.smithi165.stdout:0/262: readlink d15/d19/d28/d3a/l3e 0 2024-09-06T14:44:24.764 INFO:tasks.workunit.client.1.smithi165.stdout:2/229: dwrite d9/f1c [0,4194304] 0 2024-09-06T14:44:24.769 INFO:tasks.workunit.client.1.smithi165.stdout:2/230: chown d9/l19 233 1 2024-09-06T14:44:24.770 INFO:tasks.workunit.client.1.smithi165.stdout:9/404: getdents db/de/d15/d17/d18/d59/d64 0 2024-09-06T14:44:24.771 INFO:tasks.workunit.client.1.smithi165.stdout:0/263: creat d15/f5a x:0 0 0 2024-09-06T14:44:24.775 INFO:tasks.workunit.client.1.smithi165.stdout:2/231: mkdir d9/d25/d46 0 2024-09-06T14:44:24.776 INFO:tasks.workunit.client.1.smithi165.stdout:3/161: dwrite d1/da/dc/d10/f1a [0,4194304] 0 2024-09-06T14:44:24.778 INFO:tasks.workunit.client.1.smithi165.stdout:7/138: dwrite f1f [0,4194304] 0 2024-09-06T14:44:24.779 INFO:tasks.workunit.client.1.smithi165.stdout:6/206: dwrite f17 [0,4194304] 0 2024-09-06T14:44:24.781 INFO:tasks.workunit.client.1.smithi165.stdout:7/139: chown ld 552 1 2024-09-06T14:44:24.783 INFO:tasks.workunit.client.1.smithi165.stdout:0/264: unlink d15/d19/f27 0 2024-09-06T14:44:24.784 INFO:tasks.workunit.client.1.smithi165.stdout:2/232: read d9/fc [25209,40882] 0 2024-09-06T14:44:24.784 INFO:tasks.workunit.client.1.smithi165.stdout:6/207: rmdir d29 39 2024-09-06T14:44:24.788 INFO:tasks.workunit.client.1.smithi165.stdout:0/265: fdatasync d15/f32 0 2024-09-06T14:44:24.789 INFO:tasks.workunit.client.1.smithi165.stdout:0/266: stat d15/d19 0 2024-09-06T14:44:24.792 INFO:tasks.workunit.client.1.smithi165.stdout:3/162: truncate d1/da/dd/f15 1085271 0 2024-09-06T14:44:24.792 INFO:tasks.workunit.client.1.smithi165.stdout:2/233: dread d9/f35 [0,4194304] 0 2024-09-06T14:44:24.793 INFO:tasks.workunit.client.1.smithi165.stdout:6/208: unlink l21 0 2024-09-06T14:44:24.794 INFO:tasks.workunit.client.1.smithi165.stdout:7/140: dwrite d20/f21 [0,4194304] 0 2024-09-06T14:44:24.798 INFO:tasks.workunit.client.1.smithi165.stdout:7/141: symlink d20/l27 0 2024-09-06T14:44:24.798 INFO:tasks.workunit.client.1.smithi165.stdout:0/267: fsync d15/f16 0 2024-09-06T14:44:24.798 INFO:tasks.workunit.client.1.smithi165.stdout:3/163: read d1/da/dd/fe [188242,115525] 0 2024-09-06T14:44:24.799 INFO:tasks.workunit.client.1.smithi165.stdout:6/209: mknod d29/d32/c38 0 2024-09-06T14:44:24.800 INFO:tasks.workunit.client.1.smithi165.stdout:7/142: fdatasync f16 0 2024-09-06T14:44:24.802 INFO:tasks.workunit.client.1.smithi165.stdout:6/210: mkdir d29/d39 0 2024-09-06T14:44:24.804 INFO:tasks.workunit.client.1.smithi165.stdout:3/164: write d1/da/dd/f2c [1813297,75910] 0 2024-09-06T14:44:24.804 INFO:tasks.workunit.client.1.smithi165.stdout:6/211: chown f22 5 1 2024-09-06T14:44:24.807 INFO:tasks.workunit.client.1.smithi165.stdout:6/212: chown l1b 62426295 1 2024-09-06T14:44:24.810 INFO:tasks.workunit.client.1.smithi165.stdout:9/405: dread db/de/d16/f66 [0,4194304] 0 2024-09-06T14:44:24.810 INFO:tasks.workunit.client.1.smithi165.stdout:7/143: dwrite f13 [0,4194304] 0 2024-09-06T14:44:24.813 INFO:tasks.workunit.client.1.smithi165.stdout:0/268: readlink d15/d19/l4d 0 2024-09-06T14:44:24.813 INFO:tasks.workunit.client.1.smithi165.stdout:9/406: stat db/de/d15/d17/d18/l39 0 2024-09-06T14:44:24.814 INFO:tasks.workunit.client.1.smithi165.stdout:6/213: write f1d [2922106,90180] 0 2024-09-06T14:44:24.816 INFO:tasks.workunit.client.1.smithi165.stdout:7/144: unlink f3 0 2024-09-06T14:44:24.819 INFO:tasks.workunit.client.1.smithi165.stdout:9/407: mkdir db/de/d2d/d6c/d81 0 2024-09-06T14:44:24.820 INFO:tasks.workunit.client.1.smithi165.stdout:9/408: readlink db/de/d16/d2e/l6f 0 2024-09-06T14:44:24.821 INFO:tasks.workunit.client.1.smithi165.stdout:9/409: read - db/de/d15/d17/d18/d7d/f5f zero size 2024-09-06T14:44:24.822 INFO:tasks.workunit.client.1.smithi165.stdout:3/165: getdents d1/d19 0 2024-09-06T14:44:24.827 INFO:tasks.workunit.client.1.smithi165.stdout:3/166: creat d1/da/dd/f31 x:0 0 0 2024-09-06T14:44:24.828 INFO:tasks.workunit.client.1.smithi165.stdout:9/410: dwrite db/de/d15/f1a [0,4194304] 0 2024-09-06T14:44:24.833 INFO:tasks.workunit.client.1.smithi165.stdout:3/167: write d1/da/dc/f30 [776505,29616] 0 2024-09-06T14:44:24.833 INFO:tasks.workunit.client.1.smithi165.stdout:0/269: getdents d15/d19/d28/d4f 0 2024-09-06T14:44:24.833 INFO:tasks.workunit.client.1.smithi165.stdout:3/168: write d1/da/dc/f30 [672597,114509] 0 2024-09-06T14:44:24.833 INFO:tasks.workunit.client.1.smithi165.stdout:6/214: truncate d29/f36 1437231 0 2024-09-06T14:44:24.834 INFO:tasks.workunit.client.1.smithi165.stdout:7/145: truncate d20/f21 820547 0 2024-09-06T14:44:24.836 INFO:tasks.workunit.client.1.smithi165.stdout:3/169: mknod d1/da/dc/d10/c32 0 2024-09-06T14:44:24.842 INFO:tasks.workunit.client.1.smithi165.stdout:9/411: dread db/de/d15/d17/f4c [0,4194304] 0 2024-09-06T14:44:24.847 INFO:tasks.workunit.client.1.smithi165.stdout:0/270: write d15/d19/d38/f47 [535863,80802] 0 2024-09-06T14:44:24.849 INFO:tasks.workunit.client.1.smithi165.stdout:7/146: dwrite f1d [0,4194304] 0 2024-09-06T14:44:24.849 INFO:tasks.workunit.client.1.smithi165.stdout:3/170: truncate d1/da/f26 3345299 0 2024-09-06T14:44:24.853 INFO:tasks.workunit.client.1.smithi165.stdout:3/171: write d1/da/f2a [340641,123086] 0 2024-09-06T14:44:24.860 INFO:tasks.workunit.client.1.smithi165.stdout:3/172: creat d1/da/dc/d10/f33 x:0 0 0 2024-09-06T14:44:24.862 INFO:tasks.workunit.client.1.smithi165.stdout:0/271: dwrite d15/d19/d38/f4c [0,4194304] 0 2024-09-06T14:44:24.863 INFO:tasks.workunit.client.1.smithi165.stdout:9/412: dwrite db/d22/f46 [0,4194304] 0 2024-09-06T14:44:24.866 INFO:tasks.workunit.client.1.smithi165.stdout:7/147: dwrite f8 [0,4194304] 0 2024-09-06T14:44:24.869 INFO:tasks.workunit.client.1.smithi165.stdout:7/148: chown f18 5774670 1 2024-09-06T14:44:24.869 INFO:tasks.workunit.client.1.smithi165.stdout:9/413: chown db/de/d15/d17/f25 27618 1 2024-09-06T14:44:24.870 INFO:tasks.workunit.client.1.smithi165.stdout:9/414: fdatasync db/de/d15/f69 0 2024-09-06T14:44:24.876 INFO:tasks.workunit.client.1.smithi165.stdout:3/173: write d1/da/f26 [2919497,82559] 0 2024-09-06T14:44:24.877 INFO:tasks.workunit.client.1.smithi165.stdout:3/174: fdatasync d1/da/f2f 0 2024-09-06T14:44:24.877 INFO:tasks.workunit.client.1.smithi165.stdout:3/175: chown d1 21307462 1 2024-09-06T14:44:24.877 INFO:tasks.workunit.client.1.smithi165.stdout:7/149: mkdir d20/d26/d28 0 2024-09-06T14:44:24.878 INFO:tasks.workunit.client.1.smithi165.stdout:3/176: read - d1/d19/f27 zero size 2024-09-06T14:44:24.880 INFO:tasks.workunit.client.1.smithi165.stdout:9/415: link db/de/d2d/f31 db/de/d15/d17/f82 0 2024-09-06T14:44:24.882 INFO:tasks.workunit.client.1.smithi165.stdout:3/177: write d1/da/dd/f31 [204296,90607] 0 2024-09-06T14:44:24.884 INFO:tasks.workunit.client.1.smithi165.stdout:3/178: chown d1/da/dc/l24 65594636 1 2024-09-06T14:44:24.885 INFO:tasks.workunit.client.1.smithi165.stdout:9/416: creat db/de/d15/d74/f83 x:0 0 0 2024-09-06T14:44:24.887 INFO:tasks.workunit.client.1.smithi165.stdout:3/179: write d1/f11 [6908979,126861] 0 2024-09-06T14:44:24.888 INFO:tasks.workunit.client.1.smithi165.stdout:7/150: dwrite d20/f24 [0,4194304] 0 2024-09-06T14:44:24.888 INFO:tasks.workunit.client.1.smithi165.stdout:3/180: readlink d1/da/dc/lf 0 2024-09-06T14:44:24.889 INFO:tasks.workunit.client.1.smithi165.stdout:9/417: read db/de/d16/d2e/f55 [994228,60099] 0 2024-09-06T14:44:24.899 INFO:tasks.workunit.client.1.smithi165.stdout:0/272: dread d15/f4b [0,4194304] 0 2024-09-06T14:44:24.899 INFO:tasks.workunit.client.1.smithi165.stdout:3/181: dwrite d1/da/f2f [0,4194304] 0 2024-09-06T14:44:24.900 INFO:tasks.workunit.client.1.smithi165.stdout:0/273: stat d15/d19/d38/l49 0 2024-09-06T14:44:24.901 INFO:tasks.workunit.client.1.smithi165.stdout:7/151: dread ff [0,4194304] 0 2024-09-06T14:44:24.901 INFO:tasks.workunit.client.1.smithi165.stdout:7/152: readlink d20/l27 0 2024-09-06T14:44:24.902 INFO:tasks.workunit.client.1.smithi165.stdout:3/182: creat d1/d19/f34 x:0 0 0 2024-09-06T14:44:24.904 INFO:tasks.workunit.client.1.smithi165.stdout:7/153: mknod d20/c29 0 2024-09-06T14:44:24.906 INFO:tasks.workunit.client.1.smithi165.stdout:7/154: truncate f18 1015581 0 2024-09-06T14:44:24.906 INFO:tasks.workunit.client.1.smithi165.stdout:3/183: rename d1/da/dd/f31 to d1/da/dc/d10/f35 0 2024-09-06T14:44:24.910 INFO:tasks.workunit.client.1.smithi165.stdout:3/184: rename d1/da/dc/d10/c32 to d1/da/dd/c36 0 2024-09-06T14:44:24.911 INFO:tasks.workunit.client.1.smithi165.stdout:7/155: dread f16 [0,4194304] 0 2024-09-06T14:44:24.911 INFO:tasks.workunit.client.1.smithi165.stdout:3/185: write d1/da/f2d [736551,1875] 0 2024-09-06T14:44:24.912 INFO:tasks.workunit.client.1.smithi165.stdout:7/156: stat d20/c25 0 2024-09-06T14:44:24.913 INFO:tasks.workunit.client.1.smithi165.stdout:3/186: creat d1/f37 x:0 0 0 2024-09-06T14:44:24.920 INFO:tasks.workunit.client.1.smithi165.stdout:0/274: dwrite fb [0,4194304] 0 2024-09-06T14:44:24.920 INFO:tasks.workunit.client.1.smithi165.stdout:3/187: link d1/l2b d1/l38 0 2024-09-06T14:44:24.921 INFO:tasks.workunit.client.1.smithi165.stdout:7/157: dread d20/f24 [0,4194304] 0 2024-09-06T14:44:24.923 INFO:tasks.workunit.client.1.smithi165.stdout:3/188: creat d1/da/dc/f39 x:0 0 0 2024-09-06T14:44:24.924 INFO:tasks.workunit.client.1.smithi165.stdout:7/158: write d20/f24 [3088804,14340] 0 2024-09-06T14:44:24.928 INFO:tasks.workunit.client.1.smithi165.stdout:9/418: dread f4 [0,4194304] 0 2024-09-06T14:44:24.932 INFO:tasks.workunit.client.1.smithi165.stdout:7/159: write f16 [2837733,53664] 0 2024-09-06T14:44:24.933 INFO:tasks.workunit.client.1.smithi165.stdout:0/275: dwrite d15/d19/f20 [0,4194304] 0 2024-09-06T14:44:24.936 INFO:tasks.workunit.client.1.smithi165.stdout:7/160: symlink d20/d26/l2a 0 2024-09-06T14:44:24.937 INFO:tasks.workunit.client.1.smithi165.stdout:0/276: symlink d15/d19/d28/d3a/d3f/l5b 0 2024-09-06T14:44:24.938 INFO:tasks.workunit.client.1.smithi165.stdout:3/189: dwrite d1/da/dd/f2c [0,4194304] 0 2024-09-06T14:44:24.939 INFO:tasks.workunit.client.1.smithi165.stdout:9/419: dread db/de/d2d/f31 [0,4194304] 0 2024-09-06T14:44:24.941 INFO:tasks.workunit.client.1.smithi165.stdout:9/420: chown db/de 1910941420 1 2024-09-06T14:44:24.943 INFO:tasks.workunit.client.1.smithi165.stdout:0/277: chown d15/d19/c24 0 1 2024-09-06T14:44:24.943 INFO:tasks.workunit.client.1.smithi165.stdout:3/190: creat d1/da/dc/f3a x:0 0 0 2024-09-06T14:44:24.945 INFO:tasks.workunit.client.1.smithi165.stdout:9/421: write db/de/d15/f7c [779780,116348] 0 2024-09-06T14:44:24.948 INFO:tasks.workunit.client.1.smithi165.stdout:7/161: dwrite f8 [0,4194304] 0 2024-09-06T14:44:24.953 INFO:tasks.workunit.client.1.smithi165.stdout:7/162: getdents d20/d26/d28 0 2024-09-06T14:44:24.953 INFO:tasks.workunit.client.1.smithi165.stdout:0/278: getdents d15/d19/d50/d53 0 2024-09-06T14:44:24.954 INFO:tasks.workunit.client.1.smithi165.stdout:7/163: rmdir d20/d26 39 2024-09-06T14:44:24.956 INFO:tasks.workunit.client.1.smithi165.stdout:0/279: symlink d15/d55/l5c 0 2024-09-06T14:44:24.957 INFO:tasks.workunit.client.1.smithi165.stdout:3/191: dwrite d1/da/dc/d10/f1a [0,4194304] 0 2024-09-06T14:44:24.957 INFO:tasks.workunit.client.1.smithi165.stdout:9/422: dread db/de/d16/f6b [0,4194304] 0 2024-09-06T14:44:24.959 INFO:tasks.workunit.client.1.smithi165.stdout:7/164: truncate f15 167997 0 2024-09-06T14:44:24.959 INFO:tasks.workunit.client.1.smithi165.stdout:3/192: readlink d1/l38 0 2024-09-06T14:44:24.959 INFO:tasks.workunit.client.1.smithi165.stdout:9/423: write db/f3a [3134363,17427] 0 2024-09-06T14:44:24.961 INFO:tasks.workunit.client.1.smithi165.stdout:3/193: write d1/da/f2f [1842849,67219] 0 2024-09-06T14:44:24.962 INFO:tasks.workunit.client.1.smithi165.stdout:5/259: sync 2024-09-06T14:44:24.962 INFO:tasks.workunit.client.1.smithi165.stdout:8/275: sync 2024-09-06T14:44:24.965 INFO:tasks.workunit.client.1.smithi165.stdout:3/194: mkdir d1/da/dc/d3b 0 2024-09-06T14:44:24.966 INFO:tasks.workunit.client.1.smithi165.stdout:5/260: stat d6/d1c/d28/d4b/l54 0 2024-09-06T14:44:24.969 INFO:tasks.workunit.client.1.smithi165.stdout:9/424: rename db/f3a to db/de/d15/d17/d18/f84 0 2024-09-06T14:44:24.971 INFO:tasks.workunit.client.1.smithi165.stdout:9/425: stat db/de/d16/d2e/c4d 0 2024-09-06T14:44:24.972 INFO:tasks.workunit.client.1.smithi165.stdout:5/261: symlink d6/d1c/d28/d4b/l66 0 2024-09-06T14:44:24.973 INFO:tasks.workunit.client.1.smithi165.stdout:7/165: getdents d20/d26 0 2024-09-06T14:44:24.975 INFO:tasks.workunit.client.1.smithi165.stdout:5/262: write d6/d1c/d64/f65 [773820,35742] 0 2024-09-06T14:44:24.976 INFO:tasks.workunit.client.1.smithi165.stdout:5/263: readlink l1 0 2024-09-06T14:44:24.978 INFO:tasks.workunit.client.1.smithi165.stdout:3/195: dwrite d1/da/f2d [0,4194304] 0 2024-09-06T14:44:24.979 INFO:tasks.workunit.client.1.smithi165.stdout:9/426: dread db/de/d16/f6b [0,4194304] 0 2024-09-06T14:44:24.980 INFO:tasks.workunit.client.1.smithi165.stdout:5/264: chown d6/d1c/d28/f2e 58204 1 2024-09-06T14:44:24.985 INFO:tasks.workunit.client.1.smithi165.stdout:8/276: dread d0/d19/d36/d28/f3d [0,4194304] 0 2024-09-06T14:44:24.985 INFO:tasks.workunit.client.1.smithi165.stdout:3/196: symlink d1/da/dc/d3b/l3c 0 2024-09-06T14:44:24.986 INFO:tasks.workunit.client.1.smithi165.stdout:7/166: dwrite f12 [0,4194304] 0 2024-09-06T14:44:24.987 INFO:tasks.workunit.client.1.smithi165.stdout:0/280: dread d15/d19/d28/d3a/f41 [0,4194304] 0 2024-09-06T14:44:24.991 INFO:tasks.workunit.client.1.smithi165.stdout:8/277: write d0/f16 [4489631,88987] 0 2024-09-06T14:44:24.992 INFO:tasks.workunit.client.1.smithi165.stdout:8/278: write d0/d19/d36/d2d/d3f/f4e [183164,82755] 0 2024-09-06T14:44:24.993 INFO:tasks.workunit.client.1.smithi165.stdout:5/265: dread d6/d1c/d28/f2c [0,4194304] 0 2024-09-06T14:44:24.994 INFO:tasks.workunit.client.1.smithi165.stdout:9/427: truncate db/de/d15/f69 3291163 0 2024-09-06T14:44:24.995 INFO:tasks.workunit.client.1.smithi165.stdout:3/197: mknod d1/d19/c3d 0 2024-09-06T14:44:24.996 INFO:tasks.workunit.client.1.smithi165.stdout:3/198: fdatasync d1/da/dd/f2c 0 2024-09-06T14:44:24.996 INFO:tasks.workunit.client.1.smithi165.stdout:0/281: mkdir d15/d19/d28/d3a/d5d 0 2024-09-06T14:44:24.997 INFO:tasks.workunit.client.1.smithi165.stdout:0/282: write d15/f1f [1085796,127792] 0 2024-09-06T14:44:24.999 INFO:tasks.workunit.client.1.smithi165.stdout:8/279: symlink d0/d34/l61 0 2024-09-06T14:44:24.999 INFO:tasks.workunit.client.1.smithi165.stdout:8/280: chown d0/l27 31 1 2024-09-06T14:44:25.001 INFO:tasks.workunit.client.1.smithi165.stdout:7/167: unlink l1c 0 2024-09-06T14:44:25.001 INFO:tasks.workunit.client.1.smithi165.stdout:9/428: rmdir db/de/d16/d2e 39 2024-09-06T14:44:25.003 INFO:tasks.workunit.client.1.smithi165.stdout:5/266: write d6/d1c/d28/f43 [196505,59650] 0 2024-09-06T14:44:25.003 INFO:tasks.workunit.client.1.smithi165.stdout:9/429: write db/de/d15/d17/d72/f76 [923713,28170] 0 2024-09-06T14:44:25.004 INFO:tasks.workunit.client.1.smithi165.stdout:3/199: chown d1/da/dd/f15 1734416 1 2024-09-06T14:44:25.005 INFO:tasks.workunit.client.1.smithi165.stdout:1/222: sync 2024-09-06T14:44:25.005 INFO:tasks.workunit.client.1.smithi165.stdout:6/215: sync 2024-09-06T14:44:25.005 INFO:tasks.workunit.client.1.smithi165.stdout:4/258: sync 2024-09-06T14:44:25.006 INFO:tasks.workunit.client.1.smithi165.stdout:2/234: sync 2024-09-06T14:44:25.007 INFO:tasks.workunit.client.1.smithi165.stdout:0/283: rename d15/f32 to d15/d19/d38/f5e 0 2024-09-06T14:44:25.009 INFO:tasks.workunit.client.1.smithi165.stdout:0/284: write ff [5383720,66941] 0 2024-09-06T14:44:25.009 INFO:tasks.workunit.client.1.smithi165.stdout:7/168: dwrite f18 [0,4194304] 0 2024-09-06T14:44:25.011 INFO:tasks.workunit.client.1.smithi165.stdout:1/223: write d0/d2a/d1b/d2b/f4a [964128,99401] 0 2024-09-06T14:44:25.015 INFO:tasks.workunit.client.1.smithi165.stdout:3/200: creat d1/d19/f3e x:0 0 0 2024-09-06T14:44:25.015 INFO:tasks.workunit.client.1.smithi165.stdout:9/430: write db/de/d16/f66 [2366099,114093] 0 2024-09-06T14:44:25.018 INFO:tasks.workunit.client.1.smithi165.stdout:1/224: write d0/d2a/d1b/f3a [266672,67133] 0 2024-09-06T14:44:25.019 INFO:tasks.workunit.client.1.smithi165.stdout:5/267: dread d6/d1c/f3a [0,4194304] 0 2024-09-06T14:44:25.020 INFO:tasks.workunit.client.1.smithi165.stdout:8/281: symlink d0/d19/d36/d2d/d33/d3a/l62 0 2024-09-06T14:44:25.021 INFO:tasks.workunit.client.1.smithi165.stdout:0/285: write d15/d19/f20 [2684719,93511] 0 2024-09-06T14:44:25.094 INFO:tasks.workunit.client.1.smithi165.stdout:6/216: truncate f25 317657 0 2024-09-06T14:44:25.094 INFO:tasks.workunit.client.1.smithi165.stdout:1/225: write d0/d2a/d18/f43 [384636,21381] 0 2024-09-06T14:44:25.094 INFO:tasks.workunit.client.1.smithi165.stdout:0/286: chown f3 9995362 1 2024-09-06T14:44:25.094 INFO:tasks.workunit.client.1.smithi165.stdout:2/235: dwrite d9/f1c [4194304,4194304] 0 2024-09-06T14:44:25.095 INFO:tasks.workunit.client.1.smithi165.stdout:2/236: chown d9 126336608 1 2024-09-06T14:44:25.103 INFO:tasks.workunit.client.1.smithi165.stdout:7/169: creat d20/f2b x:0 0 0 2024-09-06T14:44:25.104 INFO:tasks.workunit.client.1.smithi165.stdout:5/268: dwrite d6/d1c/f5a [0,4194304] 0 2024-09-06T14:44:25.107 INFO:tasks.workunit.client.1.smithi165.stdout:1/226: dread d0/d2a/fd [4194304,4194304] 0 2024-09-06T14:44:25.110 INFO:tasks.workunit.client.1.smithi165.stdout:8/282: mknod d0/d14/d50/d5b/c63 0 2024-09-06T14:44:25.117 INFO:tasks.workunit.client.1.smithi165.stdout:3/201: link d1/lb d1/da/dc/d10/l3f 0 2024-09-06T14:44:25.122 INFO:tasks.workunit.client.1.smithi165.stdout:5/269: symlink d6/d1c/d28/d4b/d55/l67 0 2024-09-06T14:44:25.124 INFO:tasks.workunit.client.1.smithi165.stdout:2/237: rename d9/f10 to d9/d23/d26/f47 0 2024-09-06T14:44:25.124 INFO:tasks.workunit.client.1.smithi165.stdout:2/238: stat d9/f13 0 2024-09-06T14:44:25.127 INFO:tasks.workunit.client.1.smithi165.stdout:8/283: mkdir d0/d19/d36/d28/d64 0 2024-09-06T14:44:25.129 INFO:tasks.workunit.client.1.smithi165.stdout:2/239: dwrite d9/f39 [0,4194304] 0 2024-09-06T14:44:25.131 INFO:tasks.workunit.client.1.smithi165.stdout:7/170: mknod d20/d26/d28/c2c 0 2024-09-06T14:44:25.134 INFO:tasks.workunit.client.1.smithi165.stdout:5/270: creat d6/d1c/f68 x:0 0 0 2024-09-06T14:44:25.136 INFO:tasks.workunit.client.1.smithi165.stdout:1/227: mkdir d0/d2a/d18/d24/d4b 0 2024-09-06T14:44:25.136 INFO:tasks.workunit.client.1.smithi165.stdout:1/228: readlink d0/d2a/d1b/l34 0 2024-09-06T14:44:25.140 INFO:tasks.workunit.client.1.smithi165.stdout:6/217: link c26 d29/d32/c3a 0 2024-09-06T14:44:25.142 INFO:tasks.workunit.client.1.smithi165.stdout:3/202: mknod d1/da/c40 0 2024-09-06T14:44:25.144 INFO:tasks.workunit.client.1.smithi165.stdout:5/271: mknod d6/d1c/d28/d2d/c69 0 2024-09-06T14:44:25.146 INFO:tasks.workunit.client.1.smithi165.stdout:1/229: creat d0/d1c/d1d/d22/f4c x:0 0 0 2024-09-06T14:44:25.147 INFO:tasks.workunit.client.1.smithi165.stdout:1/230: write d0/d1c/d1d/d22/f32 [528981,116604] 0 2024-09-06T14:44:25.147 INFO:tasks.workunit.client.1.smithi165.stdout:8/284: mkdir d0/d5e/d65 0 2024-09-06T14:44:25.149 INFO:tasks.workunit.client.1.smithi165.stdout:6/218: mknod d29/d32/c3b 0 2024-09-06T14:44:25.149 INFO:tasks.workunit.client.1.smithi165.stdout:1/231: read d0/d2a/f16 [2199131,54282] 0 2024-09-06T14:44:25.150 INFO:tasks.workunit.client.1.smithi165.stdout:2/240: dread d9/f13 [4194304,4194304] 0 2024-09-06T14:44:25.150 INFO:tasks.workunit.client.1.smithi165.stdout:3/203: rmdir d1/da/dc/d10 39 2024-09-06T14:44:25.151 INFO:tasks.workunit.client.1.smithi165.stdout:1/232: write d0/f14 [4927243,44902] 0 2024-09-06T14:44:25.154 INFO:tasks.workunit.client.1.smithi165.stdout:5/272: rmdir d6/d32/d41 39 2024-09-06T14:44:25.155 INFO:tasks.workunit.client.1.smithi165.stdout:6/219: dwrite ff [0,4194304] 0 2024-09-06T14:44:25.168 INFO:tasks.workunit.client.1.smithi165.stdout:3/204: mkdir d1/d41 0 2024-09-06T14:44:25.170 INFO:tasks.workunit.client.1.smithi165.stdout:2/241: dwrite d9/f13 [4194304,4194304] 0 2024-09-06T14:44:25.173 INFO:tasks.workunit.client.1.smithi165.stdout:3/205: dread d1/da/dc/f30 [0,4194304] 0 2024-09-06T14:44:25.174 INFO:tasks.workunit.client.1.smithi165.stdout:5/273: creat d6/d1c/d28/d4b/d55/f6a x:0 0 0 2024-09-06T14:44:25.174 INFO:tasks.workunit.client.1.smithi165.stdout:2/242: read d9/ff [1149054,15498] 0 2024-09-06T14:44:25.184 INFO:tasks.workunit.client.1.smithi165.stdout:1/233: truncate d0/d2a/d23/f36 887034 0 2024-09-06T14:44:25.185 INFO:tasks.workunit.client.1.smithi165.stdout:1/234: chown d0/d2a/c37 29644 1 2024-09-06T14:44:25.187 INFO:tasks.workunit.client.1.smithi165.stdout:3/206: creat d1/da/dc/d3b/f42 x:0 0 0 2024-09-06T14:44:25.189 INFO:tasks.workunit.client.1.smithi165.stdout:4/259: truncate d5/d1b/d1c/d20/d26/f2a 3662733 0 2024-09-06T14:44:25.193 INFO:tasks.workunit.client.1.smithi165.stdout:5/274: rename d6/f57 to d6/d1c/d28/f6b 0 2024-09-06T14:44:25.193 INFO:tasks.workunit.client.1.smithi165.stdout:5/275: chown d6/f19 0 1 2024-09-06T14:44:25.197 INFO:tasks.workunit.client.1.smithi165.stdout:1/235: fsync d0/d2a/f5 0 2024-09-06T14:44:25.201 INFO:tasks.workunit.client.1.smithi165.stdout:4/260: creat d5/d1b/d1c/f57 x:0 0 0 2024-09-06T14:44:25.208 INFO:tasks.workunit.client.1.smithi165.stdout:3/207: mkdir d1/da/d43 0 2024-09-06T14:44:25.209 INFO:tasks.workunit.client.1.smithi165.stdout:3/208: write d1/da/dc/f39 [149317,17836] 0 2024-09-06T14:44:25.216 INFO:tasks.workunit.client.1.smithi165.stdout:3/209: mknod d1/da/dc/d3b/c44 0 2024-09-06T14:44:25.219 INFO:tasks.workunit.client.1.smithi165.stdout:4/261: rename f2 to d5/f58 0 2024-09-06T14:44:25.221 INFO:tasks.workunit.client.1.smithi165.stdout:2/243: fsync d9/d23/d26/f47 0 2024-09-06T14:44:25.223 INFO:tasks.workunit.client.1.smithi165.stdout:3/210: rename d1/da/c40 to d1/d41/c45 0 2024-09-06T14:44:25.224 INFO:tasks.workunit.client.1.smithi165.stdout:4/262: rmdir d5/d1b/d1c/d20/d26 39 2024-09-06T14:44:25.228 INFO:tasks.workunit.client.1.smithi165.stdout:2/244: dread f8 [0,4194304] 0 2024-09-06T14:44:25.229 INFO:tasks.workunit.client.1.smithi165.stdout:3/211: mknod d1/da/d43/c46 0 2024-09-06T14:44:25.229 INFO:tasks.workunit.client.1.smithi165.stdout:3/212: stat d1/da/dc/f30 0 2024-09-06T14:44:25.233 INFO:tasks.workunit.client.1.smithi165.stdout:3/213: mknod d1/da/dd/c47 0 2024-09-06T14:44:25.234 INFO:tasks.workunit.client.1.smithi165.stdout:7/171: write d20/f21 [381125,87727] 0 2024-09-06T14:44:25.238 INFO:tasks.workunit.client.1.smithi165.stdout:8/285: write d0/f17 [160251,103851] 0 2024-09-06T14:44:25.240 INFO:tasks.workunit.client.1.smithi165.stdout:8/286: rename d0/d19 to d0/d19/d36/d28/d53/d66 22 2024-09-06T14:44:25.241 INFO:tasks.workunit.client.1.smithi165.stdout:7/172: dread ff [0,4194304] 0 2024-09-06T14:44:25.244 INFO:tasks.workunit.client.1.smithi165.stdout:3/214: dwrite d1/da/dd/fe [0,4194304] 0 2024-09-06T14:44:25.245 INFO:tasks.workunit.client.1.smithi165.stdout:8/287: chown d0/d19/l32 1649801399 1 2024-09-06T14:44:25.246 INFO:tasks.workunit.client.1.smithi165.stdout:7/173: creat d20/d26/f2d x:0 0 0 2024-09-06T14:44:25.247 INFO:tasks.workunit.client.1.smithi165.stdout:7/174: dread - d20/d26/f2d zero size 2024-09-06T14:44:25.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/175: rmdir d20 39 2024-09-06T14:44:25.254 INFO:tasks.workunit.client.1.smithi165.stdout:8/288: link d0/d19/d36/d2d/d3f/l5a d0/d19/d36/d28/l67 0 2024-09-06T14:44:25.257 INFO:tasks.workunit.client.1.smithi165.stdout:3/215: dread d1/f11 [4194304,4194304] 0 2024-09-06T14:44:25.257 INFO:tasks.workunit.client.1.smithi165.stdout:8/289: dread - d0/d19/d36/d2d/d33/d3a/d46/d49/f4a zero size 2024-09-06T14:44:25.260 INFO:tasks.workunit.client.1.smithi165.stdout:8/290: dread - d0/d14/f2b zero size 2024-09-06T14:44:25.260 INFO:tasks.workunit.client.1.smithi165.stdout:3/216: rename d1/d19/l1f to d1/da/dc/d3b/l48 0 2024-09-06T14:44:25.261 INFO:tasks.workunit.client.1.smithi165.stdout:7/176: link l9 d20/d26/d28/l2e 0 2024-09-06T14:44:25.263 INFO:tasks.workunit.client.1.smithi165.stdout:7/177: chown l9 193 1 2024-09-06T14:44:25.265 INFO:tasks.workunit.client.1.smithi165.stdout:3/217: unlink d1/da/dc/d10/f23 0 2024-09-06T14:44:25.269 INFO:tasks.workunit.client.1.smithi165.stdout:3/218: write d1/f11 [2921963,78188] 0 2024-09-06T14:44:25.271 INFO:tasks.workunit.client.1.smithi165.stdout:8/291: dread d0/d19/d36/d2d/f38 [4194304,4194304] 0 2024-09-06T14:44:25.273 INFO:tasks.workunit.client.1.smithi165.stdout:4/263: getdents d5 0 2024-09-06T14:44:25.274 INFO:tasks.workunit.client.1.smithi165.stdout:3/219: creat d1/d19/f49 x:0 0 0 2024-09-06T14:44:25.274 INFO:tasks.workunit.client.1.smithi165.stdout:1/236: dread d0/d2a/d23/f36 [0,4194304] 0 2024-09-06T14:44:25.275 INFO:tasks.workunit.client.1.smithi165.stdout:8/292: mkdir d0/d34/d43/d68 0 2024-09-06T14:44:25.276 INFO:tasks.workunit.client.1.smithi165.stdout:6/220: dwrite d29/f36 [0,4194304] 0 2024-09-06T14:44:25.276 INFO:tasks.workunit.client.1.smithi165.stdout:3/220: mkdir d1/d4a 0 2024-09-06T14:44:25.281 INFO:tasks.workunit.client.1.smithi165.stdout:4/264: rmdir d5/d1b/d48 39 2024-09-06T14:44:25.281 INFO:tasks.workunit.client.1.smithi165.stdout:9/431: sync 2024-09-06T14:44:25.282 INFO:tasks.workunit.client.1.smithi165.stdout:2/245: truncate d9/d23/d26/f47 2214238 0 2024-09-06T14:44:25.282 INFO:tasks.workunit.client.1.smithi165.stdout:3/221: chown d1/da/f2f 149321 1 2024-09-06T14:44:25.283 INFO:tasks.workunit.client.1.smithi165.stdout:6/221: mknod d29/d32/c3c 0 2024-09-06T14:44:25.283 INFO:tasks.workunit.client.1.smithi165.stdout:1/237: unlink d0/d1c/d40/l48 0 2024-09-06T14:44:25.286 INFO:tasks.workunit.client.1.smithi165.stdout:8/293: mkdir d0/d34/d43/d68/d69 0 2024-09-06T14:44:25.288 INFO:tasks.workunit.client.1.smithi165.stdout:6/222: symlink d29/l3d 0 2024-09-06T14:44:25.288 INFO:tasks.workunit.client.1.smithi165.stdout:2/246: dwrite d9/d23/f28 [0,4194304] 0 2024-09-06T14:44:25.288 INFO:tasks.workunit.client.1.smithi165.stdout:3/222: mkdir d1/da/dd/d4b 0 2024-09-06T14:44:25.290 INFO:tasks.workunit.client.1.smithi165.stdout:3/223: chown d1/da/dc/d3b 73 1 2024-09-06T14:44:25.293 INFO:tasks.workunit.client.1.smithi165.stdout:8/294: creat d0/d19/d36/d28/f6a x:0 0 0 2024-09-06T14:44:25.293 INFO:tasks.workunit.client.1.smithi165.stdout:4/265: symlink d5/d1b/d1c/d41/l59 0 2024-09-06T14:44:25.295 INFO:tasks.workunit.client.1.smithi165.stdout:6/223: dread d29/f35 [4194304,4194304] 0 2024-09-06T14:44:25.295 INFO:tasks.workunit.client.1.smithi165.stdout:6/224: fdatasync f1e 0 2024-09-06T14:44:25.296 INFO:tasks.workunit.client.1.smithi165.stdout:3/224: symlink d1/d41/l4c 0 2024-09-06T14:44:25.297 INFO:tasks.workunit.client.1.smithi165.stdout:3/225: dread - d1/d19/f49 zero size 2024-09-06T14:44:25.298 INFO:tasks.workunit.client.1.smithi165.stdout:2/247: dwrite d9/f39 [0,4194304] 0 2024-09-06T14:44:25.298 INFO:tasks.workunit.client.1.smithi165.stdout:8/295: mkdir d0/d34/d6b 0 2024-09-06T14:44:25.301 INFO:tasks.workunit.client.1.smithi165.stdout:4/266: creat d5/f5a x:0 0 0 2024-09-06T14:44:25.304 INFO:tasks.workunit.client.1.smithi165.stdout:6/225: mknod d29/d32/c3e 0 2024-09-06T14:44:25.305 INFO:tasks.workunit.client.1.smithi165.stdout:7/178: truncate f17 3532408 0 2024-09-06T14:44:25.306 INFO:tasks.workunit.client.1.smithi165.stdout:7/179: chown f8 12463 1 2024-09-06T14:44:25.307 INFO:tasks.workunit.client.1.smithi165.stdout:2/248: unlink d9/f39 0 2024-09-06T14:44:25.309 INFO:tasks.workunit.client.1.smithi165.stdout:8/296: rmdir d0/d19/d36/d2d/d3f 39 2024-09-06T14:44:25.312 INFO:tasks.workunit.client.1.smithi165.stdout:4/267: truncate d5/f2b 387623 0 2024-09-06T14:44:25.313 INFO:tasks.workunit.client.1.smithi165.stdout:3/226: dwrite d1/da/dc/d10/f33 [0,4194304] 0 2024-09-06T14:44:25.322 INFO:tasks.workunit.client.1.smithi165.stdout:3/227: mkdir d1/d19/d4d 0 2024-09-06T14:44:25.324 INFO:tasks.workunit.client.1.smithi165.stdout:4/268: fdatasync d5/d1b/d1c/f1d 0 2024-09-06T14:44:25.326 INFO:tasks.workunit.client.1.smithi165.stdout:6/226: dwrite d29/f36 [4194304,4194304] 0 2024-09-06T14:44:25.328 INFO:tasks.workunit.client.1.smithi165.stdout:9/432: dwrite db/d40/f53 [0,4194304] 0 2024-09-06T14:44:25.330 INFO:tasks.workunit.client.1.smithi165.stdout:2/249: dread d9/fa [0,4194304] 0 2024-09-06T14:44:25.331 INFO:tasks.workunit.client.1.smithi165.stdout:7/180: dread f13 [0,4194304] 0 2024-09-06T14:44:25.331 INFO:tasks.workunit.client.1.smithi165.stdout:9/433: readlink db/de/d15/d17/d18/d59/d64/l68 0 2024-09-06T14:44:25.334 INFO:tasks.workunit.client.1.smithi165.stdout:7/181: write d20/d26/f2d [720225,39237] 0 2024-09-06T14:44:25.336 INFO:tasks.workunit.client.1.smithi165.stdout:7/182: chown f8 37124057 1 2024-09-06T14:44:25.336 INFO:tasks.workunit.client.1.smithi165.stdout:2/250: mkdir d9/d23/d29/d48 0 2024-09-06T14:44:25.337 INFO:tasks.workunit.client.1.smithi165.stdout:8/297: rename d0/d19/d24/d26/l57 to d0/d19/d36/d2d/l6c 0 2024-09-06T14:44:25.339 INFO:tasks.workunit.client.1.smithi165.stdout:2/251: write d9/d23/d26/f30 [1025654,22394] 0 2024-09-06T14:44:25.339 INFO:tasks.workunit.client.1.smithi165.stdout:3/228: link d1/l9 d1/da/dc/l4e 0 2024-09-06T14:44:25.341 INFO:tasks.workunit.client.1.smithi165.stdout:7/183: mknod d20/d26/d28/c2f 0 2024-09-06T14:44:25.342 INFO:tasks.workunit.client.1.smithi165.stdout:6/227: rename ff to d29/f3f 0 2024-09-06T14:44:25.343 INFO:tasks.workunit.client.1.smithi165.stdout:9/434: truncate db/de/d15/d17/f4c 727879 0 2024-09-06T14:44:25.344 INFO:tasks.workunit.client.1.smithi165.stdout:7/184: mkdir d20/d26/d28/d30 0 2024-09-06T14:44:25.345 INFO:tasks.workunit.client.1.smithi165.stdout:2/252: symlink d9/d23/l49 0 2024-09-06T14:44:25.347 INFO:tasks.workunit.client.1.smithi165.stdout:9/435: mknod db/de/d15/d17/c85 0 2024-09-06T14:44:25.347 INFO:tasks.workunit.client.1.smithi165.stdout:2/253: readlink d9/d23/l49 0 2024-09-06T14:44:25.348 INFO:tasks.workunit.client.1.smithi165.stdout:2/254: dread - d9/d25/f40 zero size 2024-09-06T14:44:25.350 INFO:tasks.workunit.client.1.smithi165.stdout:9/436: rmdir db/de/d16/d2e 39 2024-09-06T14:44:25.351 INFO:tasks.workunit.client.1.smithi165.stdout:2/255: mknod d9/c4a 0 2024-09-06T14:44:25.353 INFO:tasks.workunit.client.1.smithi165.stdout:3/229: dwrite d1/da/dc/d10/f35 [0,4194304] 0 2024-09-06T14:44:25.353 INFO:tasks.workunit.client.1.smithi165.stdout:2/256: dread - d9/d25/f40 zero size 2024-09-06T14:44:25.356 INFO:tasks.workunit.client.1.smithi165.stdout:8/298: dread d0/d19/d36/d2d/f38 [0,4194304] 0 2024-09-06T14:44:25.358 INFO:tasks.workunit.client.1.smithi165.stdout:5/276: sync 2024-09-06T14:44:25.358 INFO:tasks.workunit.client.1.smithi165.stdout:0/287: sync 2024-09-06T14:44:25.361 INFO:tasks.workunit.client.1.smithi165.stdout:8/299: rmdir d0/d19/d24 39 2024-09-06T14:44:25.363 INFO:tasks.workunit.client.1.smithi165.stdout:3/230: dread d1/da/dd/f2c [0,4194304] 0 2024-09-06T14:44:25.364 INFO:tasks.workunit.client.1.smithi165.stdout:4/269: dwrite d5/fc [0,4194304] 0 2024-09-06T14:44:25.365 INFO:tasks.workunit.client.1.smithi165.stdout:5/277: symlink d6/l6c 0 2024-09-06T14:44:25.366 INFO:tasks.workunit.client.1.smithi165.stdout:3/231: chown d1/d41/c45 0 1 2024-09-06T14:44:25.366 INFO:tasks.workunit.client.1.smithi165.stdout:5/278: fdatasync d6/d1c/d28/d2d/d49/f4e 0 2024-09-06T14:44:25.367 INFO:tasks.workunit.client.1.smithi165.stdout:5/279: fdatasync d6/d1c/f5a 0 2024-09-06T14:44:25.368 INFO:tasks.workunit.client.1.smithi165.stdout:6/228: getdents d29 0 2024-09-06T14:44:25.374 INFO:tasks.workunit.client.1.smithi165.stdout:6/229: chown c2 14819043 1 2024-09-06T14:44:25.374 INFO:tasks.workunit.client.1.smithi165.stdout:7/185: write f12 [4283022,25075] 0 2024-09-06T14:44:25.377 INFO:tasks.workunit.client.1.smithi165.stdout:9/437: truncate db/de/d16/f66 4046346 0 2024-09-06T14:44:25.379 INFO:tasks.workunit.client.1.smithi165.stdout:9/438: fdatasync fa 0 2024-09-06T14:44:25.379 INFO:tasks.workunit.client.1.smithi165.stdout:5/280: dwrite d6/d32/f3f [0,4194304] 0 2024-09-06T14:44:25.383 INFO:tasks.workunit.client.1.smithi165.stdout:6/230: mknod d29/d39/c40 0 2024-09-06T14:44:25.392 INFO:tasks.workunit.client.1.smithi165.stdout:2/257: dwrite d9/f1d [0,4194304] 0 2024-09-06T14:44:25.393 INFO:tasks.workunit.client.1.smithi165.stdout:9/439: mkdir db/de/d15/d17/d86 0 2024-09-06T14:44:25.395 INFO:tasks.workunit.client.1.smithi165.stdout:8/300: dread d0/d19/d36/fa [0,4194304] 0 2024-09-06T14:44:25.395 INFO:tasks.workunit.client.1.smithi165.stdout:4/270: dwrite d5/f8 [0,4194304] 0 2024-09-06T14:44:25.398 INFO:tasks.workunit.client.1.smithi165.stdout:5/281: getdents d6/d1c/d28 0 2024-09-06T14:44:25.402 INFO:tasks.workunit.client.1.smithi165.stdout:6/231: dread f25 [0,4194304] 0 2024-09-06T14:44:25.402 INFO:tasks.workunit.client.1.smithi165.stdout:9/440: creat db/de/d2d/d6c/f87 x:0 0 0 2024-09-06T14:44:25.405 INFO:tasks.workunit.client.1.smithi165.stdout:7/186: dwrite fa [0,4194304] 0 2024-09-06T14:44:25.406 INFO:tasks.workunit.client.1.smithi165.stdout:2/258: dread d9/f18 [0,4194304] 0 2024-09-06T14:44:25.407 INFO:tasks.workunit.client.1.smithi165.stdout:6/232: write d29/f30 [235520,68314] 0 2024-09-06T14:44:25.409 INFO:tasks.workunit.client.1.smithi165.stdout:9/441: fsync db/de/d15/d17/f19 0 2024-09-06T14:44:25.410 INFO:tasks.workunit.client.1.smithi165.stdout:2/259: write d9/f17 [249060,64754] 0 2024-09-06T14:44:25.413 INFO:tasks.workunit.client.1.smithi165.stdout:2/260: read - d9/d23/d26/f3c zero size 2024-09-06T14:44:25.414 INFO:tasks.workunit.client.1.smithi165.stdout:4/271: read d5/d1b/d1c/d20/d26/f2a [903547,73797] 0 2024-09-06T14:44:25.415 INFO:tasks.workunit.client.1.smithi165.stdout:9/442: creat db/d40/f88 x:0 0 0 2024-09-06T14:44:25.417 INFO:tasks.workunit.client.1.smithi165.stdout:7/187: getdents d20/d26/d28 0 2024-09-06T14:44:25.418 INFO:tasks.workunit.client.1.smithi165.stdout:4/272: stat d5/d1b/d48/f4d 0 2024-09-06T14:44:25.418 INFO:tasks.workunit.client.1.smithi165.stdout:2/261: symlink d9/d25/d46/l4b 0 2024-09-06T14:44:25.420 INFO:tasks.workunit.client.1.smithi165.stdout:9/443: dread fa [4194304,4194304] 0 2024-09-06T14:44:25.421 INFO:tasks.workunit.client.1.smithi165.stdout:4/273: creat d5/d1b/f5b x:0 0 0 2024-09-06T14:44:25.422 INFO:tasks.workunit.client.1.smithi165.stdout:6/233: dwrite f28 [0,4194304] 0 2024-09-06T14:44:25.423 INFO:tasks.workunit.client.1.smithi165.stdout:8/301: dread d0/f9 [0,4194304] 0 2024-09-06T14:44:25.423 INFO:tasks.workunit.client.1.smithi165.stdout:6/234: write fc [2264620,111767] 0 2024-09-06T14:44:25.423 INFO:tasks.workunit.client.1.smithi165.stdout:8/302: readlink d0/d19/d36/l10 0 2024-09-06T14:44:25.467 INFO:tasks.workunit.client.1.smithi165.stdout:2/262: mknod d9/d25/d45/c4c 0 2024-09-06T14:44:25.467 INFO:tasks.workunit.client.1.smithi165.stdout:2/263: readlink l4 0 2024-09-06T14:44:25.468 INFO:tasks.workunit.client.1.smithi165.stdout:8/303: chown d0/d19/d36/f2e 225 1 2024-09-06T14:44:25.468 INFO:tasks.workunit.client.1.smithi165.stdout:5/282: truncate d6/d1c/d28/d2d/f53 3842902 0 2024-09-06T14:44:25.468 INFO:tasks.workunit.client.1.smithi165.stdout:6/235: read f1c [2323694,25291] 0 2024-09-06T14:44:25.469 INFO:tasks.workunit.client.1.smithi165.stdout:4/274: mknod d5/d1b/d1c/c5c 0 2024-09-06T14:44:25.470 INFO:tasks.workunit.client.1.smithi165.stdout:5/283: truncate d6/d1c/f68 106206 0 2024-09-06T14:44:25.471 INFO:tasks.workunit.client.1.smithi165.stdout:6/236: creat d29/f41 x:0 0 0 2024-09-06T14:44:25.471 INFO:tasks.workunit.client.1.smithi165.stdout:5/284: read d6/f23 [82663,33124] 0 2024-09-06T14:44:25.472 INFO:tasks.workunit.client.1.smithi165.stdout:5/285: write d6/d1c/d28/f42 [612738,10799] 0 2024-09-06T14:44:25.473 INFO:tasks.workunit.client.1.smithi165.stdout:5/286: fdatasync d6/d1c/d28/f3b 0 2024-09-06T14:44:25.473 INFO:tasks.workunit.client.1.smithi165.stdout:2/264: rename d9/fa to d9/d23/d29/d48/f4d 0 2024-09-06T14:44:25.474 INFO:tasks.workunit.client.1.smithi165.stdout:8/304: truncate d0/fd 4175665 0 2024-09-06T14:44:25.475 INFO:tasks.workunit.client.1.smithi165.stdout:4/275: mknod d5/d1b/d1c/d20/d26/c5d 0 2024-09-06T14:44:25.477 INFO:tasks.workunit.client.1.smithi165.stdout:6/237: mknod d29/d32/c42 0 2024-09-06T14:44:25.479 INFO:tasks.workunit.client.1.smithi165.stdout:9/444: link db/de/d16/d2e/f70 db/de/d15/d17/f89 0 2024-09-06T14:44:25.480 INFO:tasks.workunit.client.1.smithi165.stdout:2/265: write d9/d23/d29/d48/f4d [453194,48312] 0 2024-09-06T14:44:25.481 INFO:tasks.workunit.client.1.smithi165.stdout:4/276: symlink d5/d1b/d1c/d55/l5e 0 2024-09-06T14:44:25.481 INFO:tasks.workunit.client.1.smithi165.stdout:4/277: stat l4 0 2024-09-06T14:44:25.482 INFO:tasks.workunit.client.1.smithi165.stdout:5/287: mknod d6/d32/c6d 0 2024-09-06T14:44:25.485 INFO:tasks.workunit.client.1.smithi165.stdout:9/445: unlink db/de/d15/d17/l4a 0 2024-09-06T14:44:25.486 INFO:tasks.workunit.client.1.smithi165.stdout:2/266: symlink d9/d25/l4e 0 2024-09-06T14:44:25.487 INFO:tasks.workunit.client.1.smithi165.stdout:4/278: truncate d5/d1b/d1c/d20/d26/f2a 3198733 0 2024-09-06T14:44:25.487 INFO:tasks.workunit.client.1.smithi165.stdout:6/238: dwrite d29/f3f [0,4194304] 0 2024-09-06T14:44:25.491 INFO:tasks.workunit.client.1.smithi165.stdout:4/279: creat d5/d1b/d48/f5f x:0 0 0 2024-09-06T14:44:25.492 INFO:tasks.workunit.client.1.smithi165.stdout:6/239: mknod d29/c43 0 2024-09-06T14:44:25.492 INFO:tasks.workunit.client.1.smithi165.stdout:8/305: link d0/l3 d0/l6d 0 2024-09-06T14:44:25.492 INFO:tasks.workunit.client.1.smithi165.stdout:4/280: write d5/d1b/d1c/f2e [792449,105189] 0 2024-09-06T14:44:25.493 INFO:tasks.workunit.client.1.smithi165.stdout:9/446: mknod db/de/d15/d7f/c8a 0 2024-09-06T14:44:25.495 INFO:tasks.workunit.client.1.smithi165.stdout:5/288: dwrite d6/f18 [0,4194304] 0 2024-09-06T14:44:25.502 INFO:tasks.workunit.client.1.smithi165.stdout:8/306: unlink d0/d19/d36/d2d/d33/d3a/d46/d49/l4f 0 2024-09-06T14:44:25.503 INFO:tasks.workunit.client.1.smithi165.stdout:9/447: truncate db/de/d16/d2e/f55 874868 0 2024-09-06T14:44:25.504 INFO:tasks.workunit.client.1.smithi165.stdout:5/289: dread d6/d1c/d64/f65 [0,4194304] 0 2024-09-06T14:44:25.505 INFO:tasks.workunit.client.1.smithi165.stdout:4/281: dread d5/d1b/f36 [0,4194304] 0 2024-09-06T14:44:25.506 INFO:tasks.workunit.client.1.smithi165.stdout:9/448: creat db/de/d15/d7f/f8b x:0 0 0 2024-09-06T14:44:25.507 INFO:tasks.workunit.client.1.smithi165.stdout:6/240: dwrite d29/f35 [4194304,4194304] 0 2024-09-06T14:44:25.509 INFO:tasks.workunit.client.1.smithi165.stdout:9/449: stat db/de/d15/d17/d18/l4e 0 2024-09-06T14:44:25.510 INFO:tasks.workunit.client.1.smithi165.stdout:5/290: write d6/d1c/d28/d2d/d3c/d44/f47 [4036614,84134] 0 2024-09-06T14:44:25.511 INFO:tasks.workunit.client.1.smithi165.stdout:6/241: creat d29/d39/f44 x:0 0 0 2024-09-06T14:44:25.512 INFO:tasks.workunit.client.1.smithi165.stdout:5/291: chown d6/d1c/d28/d2d/d49 108586 1 2024-09-06T14:44:25.513 INFO:tasks.workunit.client.1.smithi165.stdout:4/282: rename d5/d1b/d1c/d41/f52 to d5/d1b/d1c/f60 0 2024-09-06T14:44:25.513 INFO:tasks.workunit.client.1.smithi165.stdout:4/283: chown d5/d1b/d1c/d55/l5e 538348 1 2024-09-06T14:44:25.519 INFO:tasks.workunit.client.1.smithi165.stdout:6/242: dread f8 [0,4194304] 0 2024-09-06T14:44:25.521 INFO:tasks.workunit.client.1.smithi165.stdout:2/267: truncate d9/f35 492051 0 2024-09-06T14:44:25.523 INFO:tasks.workunit.client.1.smithi165.stdout:6/243: rename d29/l3d to d29/d39/l45 0 2024-09-06T14:44:25.525 INFO:tasks.workunit.client.1.smithi165.stdout:2/268: rmdir d9/d23/d26 39 2024-09-06T14:44:25.525 INFO:tasks.workunit.client.1.smithi165.stdout:5/292: dwrite d6/f24 [0,4194304] 0 2024-09-06T14:44:25.527 INFO:tasks.workunit.client.1.smithi165.stdout:5/293: write d6/d1c/d28/d2d/d3c/d44/f47 [3770359,84898] 0 2024-09-06T14:44:25.529 INFO:tasks.workunit.client.1.smithi165.stdout:6/244: dread f25 [0,4194304] 0 2024-09-06T14:44:25.529 INFO:tasks.workunit.client.1.smithi165.stdout:5/294: dread - d6/f1a zero size 2024-09-06T14:44:25.532 INFO:tasks.workunit.client.1.smithi165.stdout:6/245: mknod d29/d32/c46 0 2024-09-06T14:44:25.535 INFO:tasks.workunit.client.1.smithi165.stdout:8/307: dwrite d0/d19/d36/fb [0,4194304] 0 2024-09-06T14:44:25.538 INFO:tasks.workunit.client.1.smithi165.stdout:9/450: write db/de/d16/d2e/f70 [1010153,30358] 0 2024-09-06T14:44:25.540 INFO:tasks.workunit.client.1.smithi165.stdout:8/308: mknod d0/d19/d36/d28/c6e 0 2024-09-06T14:44:25.541 INFO:tasks.workunit.client.1.smithi165.stdout:2/269: dread d9/f12 [0,4194304] 0 2024-09-06T14:44:25.542 INFO:tasks.workunit.client.1.smithi165.stdout:4/284: truncate d5/d1b/f31 646608 0 2024-09-06T14:44:25.543 INFO:tasks.workunit.client.1.smithi165.stdout:9/451: creat db/de/d15/d17/d86/f8c x:0 0 0 2024-09-06T14:44:25.543 INFO:tasks.workunit.client.1.smithi165.stdout:4/285: read d5/d1b/d1c/f34 [116647,28160] 0 2024-09-06T14:44:25.545 INFO:tasks.workunit.client.1.smithi165.stdout:4/286: write d5/f13 [7538,42752] 0 2024-09-06T14:44:25.547 INFO:tasks.workunit.client.1.smithi165.stdout:8/309: creat d0/d19/d24/d26/f6f x:0 0 0 2024-09-06T14:44:25.549 INFO:tasks.workunit.client.1.smithi165.stdout:2/270: mkdir d9/d4f 0 2024-09-06T14:44:25.550 INFO:tasks.workunit.client.1.smithi165.stdout:9/452: symlink db/de/d16/d2e/l8d 0 2024-09-06T14:44:25.550 INFO:tasks.workunit.client.1.smithi165.stdout:2/271: write d9/f1e [2860002,78184] 0 2024-09-06T14:44:25.553 INFO:tasks.workunit.client.1.smithi165.stdout:4/287: mkdir d5/d1b/d61 0 2024-09-06T14:44:25.554 INFO:tasks.workunit.client.1.smithi165.stdout:9/453: mkdir db/de/d15/d17/d18/d7d/d8e 0 2024-09-06T14:44:25.555 INFO:tasks.workunit.client.1.smithi165.stdout:4/288: chown d5/d1b/f36 37620069 1 2024-09-06T14:44:25.556 INFO:tasks.workunit.client.1.smithi165.stdout:2/272: rmdir d9 39 2024-09-06T14:44:25.557 INFO:tasks.workunit.client.1.smithi165.stdout:9/454: chown db/de/d15/d17/d18/d7d 31897891 1 2024-09-06T14:44:25.558 INFO:tasks.workunit.client.1.smithi165.stdout:4/289: fdatasync d5/f8 0 2024-09-06T14:44:25.559 INFO:tasks.workunit.client.1.smithi165.stdout:8/310: dwrite d0/d14/d3e/f4b [0,4194304] 0 2024-09-06T14:44:25.560 INFO:tasks.workunit.client.1.smithi165.stdout:9/455: stat db/de/d15/d17/d18 0 2024-09-06T14:44:25.561 INFO:tasks.workunit.client.1.smithi165.stdout:5/295: write d6/d1c/d28/d2d/f53 [580532,106521] 0 2024-09-06T14:44:25.563 INFO:tasks.workunit.client.1.smithi165.stdout:4/290: creat d5/d1b/d48/f62 x:0 0 0 2024-09-06T14:44:25.565 INFO:tasks.workunit.client.1.smithi165.stdout:1/238: sync 2024-09-06T14:44:25.566 INFO:tasks.workunit.client.1.smithi165.stdout:8/311: write d0/d19/d36/d28/f3d [3090214,43219] 0 2024-09-06T14:44:25.567 INFO:tasks.workunit.client.1.smithi165.stdout:1/239: readlink d0/d2a/l19 0 2024-09-06T14:44:25.567 INFO:tasks.workunit.client.1.smithi165.stdout:5/296: rename d6/d1c/d28/f4f to d6/d1c/d64/f6e 0 2024-09-06T14:44:25.570 INFO:tasks.workunit.client.1.smithi165.stdout:5/297: chown d6/c14 78 1 2024-09-06T14:44:25.570 INFO:tasks.workunit.client.1.smithi165.stdout:8/312: mkdir d0/d34/d43/d70 0 2024-09-06T14:44:25.571 INFO:tasks.workunit.client.1.smithi165.stdout:1/240: fsync d0/d2a/f12 0 2024-09-06T14:44:25.572 INFO:tasks.workunit.client.1.smithi165.stdout:9/456: dwrite db/de/d2d/d6c/f87 [0,4194304] 0 2024-09-06T14:44:25.572 INFO:tasks.workunit.client.1.smithi165.stdout:4/291: rename d5/d1b/d1c/f2e to d5/d1b/f63 0 2024-09-06T14:44:25.573 INFO:tasks.workunit.client.1.smithi165.stdout:1/241: fdatasync d0/d2a/d18/f43 0 2024-09-06T14:44:25.573 INFO:tasks.workunit.client.1.smithi165.stdout:5/298: chown d6/d1c/d28/d2d/d3c/c5f 0 1 2024-09-06T14:44:25.575 INFO:tasks.workunit.client.1.smithi165.stdout:4/292: rmdir d5/d1b/d1c/d41 39 2024-09-06T14:44:25.577 INFO:tasks.workunit.client.1.smithi165.stdout:1/242: creat d0/d1c/d40/f4d x:0 0 0 2024-09-06T14:44:25.577 INFO:tasks.workunit.client.1.smithi165.stdout:9/457: getdents db/de/d15/d17/d18/d59/d64 0 2024-09-06T14:44:25.582 INFO:tasks.workunit.client.1.smithi165.stdout:9/458: symlink db/de/d15/d7f/l8f 0 2024-09-06T14:44:25.584 INFO:tasks.workunit.client.1.smithi165.stdout:8/313: dwrite d0/d19/f1f [0,4194304] 0 2024-09-06T14:44:25.587 INFO:tasks.workunit.client.1.smithi165.stdout:5/299: dwrite d6/f18 [0,4194304] 0 2024-09-06T14:44:25.587 INFO:tasks.workunit.client.1.smithi165.stdout:1/243: rename d0/d1c/c27 to d0/d2a/d18/c4e 0 2024-09-06T14:44:25.589 INFO:tasks.workunit.client.1.smithi165.stdout:4/293: dwrite d5/f8 [0,4194304] 0 2024-09-06T14:44:25.593 INFO:tasks.workunit.client.1.smithi165.stdout:9/459: write db/de/d15/d17/f25 [2669214,21215] 0 2024-09-06T14:44:25.599 INFO:tasks.workunit.client.1.smithi165.stdout:4/294: chown d5/d1b/c3f 117 1 2024-09-06T14:44:25.601 INFO:tasks.workunit.client.1.smithi165.stdout:5/300: rename d6/d1c/f5a to d6/d1c/d28/d4b/d55/f6f 0 2024-09-06T14:44:25.603 INFO:tasks.workunit.client.1.smithi165.stdout:9/460: write db/de/d15/d17/d86/f8c [1019348,1879] 0 2024-09-06T14:44:25.605 INFO:tasks.workunit.client.1.smithi165.stdout:4/295: creat d5/d1b/d48/f64 x:0 0 0 2024-09-06T14:44:25.605 INFO:tasks.workunit.client.1.smithi165.stdout:8/314: dwrite d0/d19/f1f [0,4194304] 0 2024-09-06T14:44:25.609 INFO:tasks.workunit.client.1.smithi165.stdout:4/296: chown d5/cd 29504 1 2024-09-06T14:44:25.609 INFO:tasks.workunit.client.1.smithi165.stdout:1/244: dwrite d0/d2a/d1b/d2b/f4a [0,4194304] 0 2024-09-06T14:44:25.610 INFO:tasks.workunit.client.1.smithi165.stdout:8/315: symlink d0/d19/d36/l71 0 2024-09-06T14:44:25.614 INFO:tasks.workunit.client.1.smithi165.stdout:9/461: mknod db/de/d15/d17/d18/d7d/d8e/c90 0 2024-09-06T14:44:25.614 INFO:tasks.workunit.client.1.smithi165.stdout:5/301: dwrite d6/f27 [0,4194304] 0 2024-09-06T14:44:25.615 INFO:tasks.workunit.client.1.smithi165.stdout:4/297: symlink d5/d1b/d1c/d20/d26/l65 0 2024-09-06T14:44:25.617 INFO:tasks.workunit.client.1.smithi165.stdout:9/462: write db/de/d15/f28 [2545445,98101] 0 2024-09-06T14:44:25.619 INFO:tasks.workunit.client.1.smithi165.stdout:9/463: readlink db/de/d15/d17/d18/d59/d64/l67 0 2024-09-06T14:44:25.621 INFO:tasks.workunit.client.1.smithi165.stdout:4/298: mkdir d5/d1b/d66 0 2024-09-06T14:44:25.621 INFO:tasks.workunit.client.1.smithi165.stdout:5/302: creat d6/d1c/d28/d4b/d60/f70 x:0 0 0 2024-09-06T14:44:25.622 INFO:tasks.workunit.client.1.smithi165.stdout:5/303: readlink d6/lc 0 2024-09-06T14:44:25.622 INFO:tasks.workunit.client.1.smithi165.stdout:5/304: fsync d6/d1c/d28/f2e 0 2024-09-06T14:44:25.626 INFO:tasks.workunit.client.1.smithi165.stdout:4/299: mknod d5/d1b/d48/c67 0 2024-09-06T14:44:25.626 INFO:tasks.workunit.client.1.smithi165.stdout:4/300: chown d5/d1b/d48 26 1 2024-09-06T14:44:25.627 INFO:tasks.workunit.client.1.smithi165.stdout:9/464: mkdir db/de/d15/d91 0 2024-09-06T14:44:25.627 INFO:tasks.workunit.client.1.smithi165.stdout:4/301: dread - d5/d1b/d1c/f57 zero size 2024-09-06T14:44:25.630 INFO:tasks.workunit.client.1.smithi165.stdout:4/302: write d5/d1b/f5b [879165,13469] 0 2024-09-06T14:44:25.630 INFO:tasks.workunit.client.1.smithi165.stdout:1/245: truncate d0/f3d 182629 0 2024-09-06T14:44:25.630 INFO:tasks.workunit.client.1.smithi165.stdout:9/465: rmdir db/de/d15/d17/d18 39 2024-09-06T14:44:25.632 INFO:tasks.workunit.client.1.smithi165.stdout:4/303: creat d5/d1b/d1c/d55/f68 x:0 0 0 2024-09-06T14:44:25.633 INFO:tasks.workunit.client.1.smithi165.stdout:4/304: write d5/d1b/d1c/d20/d26/f3c [87387,88086] 0 2024-09-06T14:44:25.633 INFO:tasks.workunit.client.1.smithi165.stdout:9/466: creat db/de/d15/d17/d18/d7d/f92 x:0 0 0 2024-09-06T14:44:25.635 INFO:tasks.workunit.client.1.smithi165.stdout:4/305: write d5/f8 [2215504,68368] 0 2024-09-06T14:44:25.635 INFO:tasks.workunit.client.1.smithi165.stdout:1/246: getdents d0/d2a/d18 0 2024-09-06T14:44:25.637 INFO:tasks.workunit.client.1.smithi165.stdout:1/247: mknod d0/d1c/d1d/c4f 0 2024-09-06T14:44:25.639 INFO:tasks.workunit.client.1.smithi165.stdout:4/306: link d5/d1b/d1c/f4f d5/d1b/d48/f69 0 2024-09-06T14:44:25.640 INFO:tasks.workunit.client.1.smithi165.stdout:1/248: dread d0/d2a/d1b/f3a [0,4194304] 0 2024-09-06T14:44:25.641 INFO:tasks.workunit.client.1.smithi165.stdout:9/467: link db/de/d15/d17/d18/d59/d64/l67 db/de/d15/d17/d18/d59/d64/l93 0 2024-09-06T14:44:25.644 INFO:tasks.workunit.client.1.smithi165.stdout:1/249: rename d0/d2a/f5 to d0/d2a/d1b/d2b/f50 0 2024-09-06T14:44:25.646 INFO:tasks.workunit.client.1.smithi165.stdout:1/250: rmdir d0/d2a 39 2024-09-06T14:44:25.650 INFO:tasks.workunit.client.1.smithi165.stdout:1/251: dread d0/d2a/d23/f36 [0,4194304] 0 2024-09-06T14:44:25.652 INFO:tasks.workunit.client.1.smithi165.stdout:4/307: dread d5/d1b/d1c/d20/d26/f38 [0,4194304] 0 2024-09-06T14:44:25.656 INFO:tasks.workunit.client.1.smithi165.stdout:4/308: creat d5/d1b/d48/f6a x:0 0 0 2024-09-06T14:44:25.656 INFO:tasks.workunit.client.1.smithi165.stdout:1/252: link d0/d2a/f12 d0/d2a/d18/d24/d4b/f51 0 2024-09-06T14:44:25.656 INFO:tasks.workunit.client.1.smithi165.stdout:9/468: dread db/de/f3f [0,4194304] 0 2024-09-06T14:44:25.656 INFO:tasks.workunit.client.1.smithi165.stdout:9/469: write db/de/d15/d17/f47 [5449130,72968] 0 2024-09-06T14:44:25.657 INFO:tasks.workunit.client.1.smithi165.stdout:1/253: symlink d0/d2a/d1b/d2b/d3e/l52 0 2024-09-06T14:44:25.657 INFO:tasks.workunit.client.1.smithi165.stdout:1/254: dread - d0/d1c/d1d/f3c zero size 2024-09-06T14:44:25.658 INFO:tasks.workunit.client.1.smithi165.stdout:9/470: mknod db/de/d15/d74/c94 0 2024-09-06T14:44:25.659 INFO:tasks.workunit.client.1.smithi165.stdout:9/471: chown db/d22/l27 306912615 1 2024-09-06T14:44:25.659 INFO:tasks.workunit.client.1.smithi165.stdout:4/309: link d5/d1b/d1c/d41/f44 d5/d1b/d1c/f6b 0 2024-09-06T14:44:25.660 INFO:tasks.workunit.client.1.smithi165.stdout:9/472: write db/de/d2d/f31 [591826,29197] 0 2024-09-06T14:44:25.661 INFO:tasks.workunit.client.1.smithi165.stdout:1/255: fdatasync d0/d2a/d1b/d2b/d3e/f49 0 2024-09-06T14:44:25.663 INFO:tasks.workunit.client.1.smithi165.stdout:9/473: creat db/d22/f95 x:0 0 0 2024-09-06T14:44:25.664 INFO:tasks.workunit.client.1.smithi165.stdout:4/310: creat d5/d1b/d1c/f6c x:0 0 0 2024-09-06T14:44:25.664 INFO:tasks.workunit.client.1.smithi165.stdout:9/474: truncate db/de/d16/f5e 765737 0 2024-09-06T14:44:25.665 INFO:tasks.workunit.client.1.smithi165.stdout:1/256: rename d0/d2a/d23/f36 to d0/d2a/f53 0 2024-09-06T14:44:25.667 INFO:tasks.workunit.client.1.smithi165.stdout:9/475: mkdir db/de/d2d/d6c/d96 0 2024-09-06T14:44:25.675 INFO:tasks.workunit.client.1.smithi165.stdout:4/311: write d5/d1b/d1c/d20/f24 [1186721,55113] 0 2024-09-06T14:44:25.675 INFO:tasks.workunit.client.1.smithi165.stdout:9/476: write db/de/d16/f24 [911463,34696] 0 2024-09-06T14:44:25.675 INFO:tasks.workunit.client.1.smithi165.stdout:1/257: dread d0/d2a/d1b/d2b/f50 [0,4194304] 0 2024-09-06T14:44:25.679 INFO:tasks.workunit.client.1.smithi165.stdout:4/312: symlink d5/d1b/d1c/l6d 0 2024-09-06T14:44:25.679 INFO:tasks.workunit.client.1.smithi165.stdout:1/258: write d0/f3d [1212522,100560] 0 2024-09-06T14:44:25.681 INFO:tasks.workunit.client.1.smithi165.stdout:4/313: mkdir d5/d1b/d66/d6e 0 2024-09-06T14:44:25.682 INFO:tasks.workunit.client.1.smithi165.stdout:1/259: getdents d0/d2a/d18 0 2024-09-06T14:44:25.682 INFO:tasks.workunit.client.1.smithi165.stdout:4/314: write d5/d1b/d48/f62 [887743,28748] 0 2024-09-06T14:44:25.683 INFO:tasks.workunit.client.1.smithi165.stdout:4/315: chown d5/f50 883056 1 2024-09-06T14:44:25.683 INFO:tasks.workunit.client.1.smithi165.stdout:1/260: mknod d0/d2a/d1b/d2b/c54 0 2024-09-06T14:44:25.684 INFO:tasks.workunit.client.1.smithi165.stdout:4/316: truncate d5/d1b/f36 1119258 0 2024-09-06T14:44:25.685 INFO:tasks.workunit.client.1.smithi165.stdout:1/261: creat d0/d2a/d1b/f55 x:0 0 0 2024-09-06T14:44:25.685 INFO:tasks.workunit.client.1.smithi165.stdout:4/317: truncate d5/d1b/d1c/f34 1830929 0 2024-09-06T14:44:25.686 INFO:tasks.workunit.client.1.smithi165.stdout:1/262: mkdir d0/d2a/d23/d56 0 2024-09-06T14:44:25.687 INFO:tasks.workunit.client.1.smithi165.stdout:4/318: write d5/d1b/d1c/f57 [944253,4744] 0 2024-09-06T14:44:25.689 INFO:tasks.workunit.client.1.smithi165.stdout:1/263: unlink d0/d2a/f2f 0 2024-09-06T14:44:25.689 INFO:tasks.workunit.client.1.smithi165.stdout:1/264: fdatasync d0/f14 0 2024-09-06T14:44:25.692 INFO:tasks.workunit.client.1.smithi165.stdout:1/265: unlink d0/d2a/d1b/f55 0 2024-09-06T14:44:25.692 INFO:tasks.workunit.client.1.smithi165.stdout:4/319: dwrite d5/f2c [0,4194304] 0 2024-09-06T14:44:25.698 INFO:tasks.workunit.client.1.smithi165.stdout:4/320: creat d5/d1b/d1c/f6f x:0 0 0 2024-09-06T14:44:25.700 INFO:tasks.workunit.client.1.smithi165.stdout:4/321: dread - d5/d1b/f49 zero size 2024-09-06T14:44:25.701 INFO:tasks.workunit.client.1.smithi165.stdout:1/266: dwrite d0/d1c/d1d/d22/f4c [0,4194304] 0 2024-09-06T14:44:25.704 INFO:tasks.workunit.client.1.smithi165.stdout:1/267: mkdir d0/d1c/d1d/d57 0 2024-09-06T14:44:25.709 INFO:tasks.workunit.client.1.smithi165.stdout:4/322: dwrite d5/f13 [4194304,4194304] 0 2024-09-06T14:44:25.710 INFO:tasks.workunit.client.1.smithi165.stdout:7/188: sync 2024-09-06T14:44:25.710 INFO:tasks.workunit.client.1.smithi165.stdout:0/288: sync 2024-09-06T14:44:25.710 INFO:tasks.workunit.client.1.smithi165.stdout:3/232: sync 2024-09-06T14:44:25.712 INFO:tasks.workunit.client.1.smithi165.stdout:3/233: write d1/f1b [1586318,125948] 0 2024-09-06T14:44:25.715 INFO:tasks.workunit.client.1.smithi165.stdout:3/234: fdatasync d1/da/dc/d3b/f42 0 2024-09-06T14:44:25.716 INFO:tasks.workunit.client.1.smithi165.stdout:7/189: creat d20/d26/d28/d30/f31 x:0 0 0 2024-09-06T14:44:25.716 INFO:tasks.workunit.client.1.smithi165.stdout:0/289: read - d15/d19/d2c/f36 zero size 2024-09-06T14:44:25.717 INFO:tasks.workunit.client.1.smithi165.stdout:1/268: dwrite d0/d1c/d1d/d22/f32 [0,4194304] 0 2024-09-06T14:44:25.719 INFO:tasks.workunit.client.1.smithi165.stdout:7/190: write d20/f21 [1861150,83549] 0 2024-09-06T14:44:25.721 INFO:tasks.workunit.client.1.smithi165.stdout:1/269: fdatasync d0/d2a/d18/d24/d4b/f51 0 2024-09-06T14:44:25.722 INFO:tasks.workunit.client.1.smithi165.stdout:1/270: chown d0/d2a/d1b/f30 0 1 2024-09-06T14:44:25.723 INFO:tasks.workunit.client.1.smithi165.stdout:1/271: chown d0/d2a/l19 531311 1 2024-09-06T14:44:25.726 INFO:tasks.workunit.client.1.smithi165.stdout:7/191: rename d20/c29 to d20/d26/d28/c32 0 2024-09-06T14:44:25.728 INFO:tasks.workunit.client.1.smithi165.stdout:1/272: link d0/d2a/d1b/d2b/f4a d0/d2a/d1b/f58 0 2024-09-06T14:44:25.728 INFO:tasks.workunit.client.1.smithi165.stdout:0/290: truncate fb 1663012 0 2024-09-06T14:44:25.729 INFO:tasks.workunit.client.1.smithi165.stdout:7/192: mkdir d20/d33 0 2024-09-06T14:44:25.730 INFO:tasks.workunit.client.1.smithi165.stdout:1/273: chown d0/d2a/d1b/d2b/c31 6954 1 2024-09-06T14:44:25.730 INFO:tasks.workunit.client.1.smithi165.stdout:3/235: truncate d1/da/f2a 34205 0 2024-09-06T14:44:25.731 INFO:tasks.workunit.client.1.smithi165.stdout:0/291: rmdir d15/d55 39 2024-09-06T14:44:25.732 INFO:tasks.workunit.client.1.smithi165.stdout:7/193: creat d20/d26/f34 x:0 0 0 2024-09-06T14:44:25.732 INFO:tasks.workunit.client.1.smithi165.stdout:7/194: fsync fa 0 2024-09-06T14:44:25.733 INFO:tasks.workunit.client.1.smithi165.stdout:7/195: chown d20/d26 169273855 1 2024-09-06T14:44:25.733 INFO:tasks.workunit.client.1.smithi165.stdout:7/196: dread - d20/d26/d28/d30/f31 zero size 2024-09-06T14:44:25.734 INFO:tasks.workunit.client.1.smithi165.stdout:1/274: rename d0/f3d to d0/f59 0 2024-09-06T14:44:25.735 INFO:tasks.workunit.client.1.smithi165.stdout:1/275: fdatasync d0/d2a/d1b/d2b/f38 0 2024-09-06T14:44:25.736 INFO:tasks.workunit.client.1.smithi165.stdout:0/292: rename d15/d19/d28/d4f/l58 to d15/d19/l5f 0 2024-09-06T14:44:25.737 INFO:tasks.workunit.client.1.smithi165.stdout:7/197: symlink d20/l35 0 2024-09-06T14:44:25.739 INFO:tasks.workunit.client.1.smithi165.stdout:1/276: write d0/d2a/fe [1980798,115637] 0 2024-09-06T14:44:25.740 INFO:tasks.workunit.client.1.smithi165.stdout:7/198: readlink l1a 0 2024-09-06T14:44:25.740 INFO:tasks.workunit.client.1.smithi165.stdout:1/277: rmdir d0/d2a/d1b 39 2024-09-06T14:44:25.740 INFO:tasks.workunit.client.1.smithi165.stdout:3/236: dread d1/da/dd/f15 [0,4194304] 0 2024-09-06T14:44:25.741 INFO:tasks.workunit.client.1.smithi165.stdout:0/293: rename d15/d19/d28/d56 to d15/d19/d28/d51/d60 0 2024-09-06T14:44:25.741 INFO:tasks.workunit.client.1.smithi165.stdout:7/199: creat d20/d26/d28/d30/f36 x:0 0 0 2024-09-06T14:44:25.743 INFO:tasks.workunit.client.1.smithi165.stdout:3/237: chown d1/l9 7618652 1 2024-09-06T14:44:25.743 INFO:tasks.workunit.client.1.smithi165.stdout:7/200: readlink ld 0 2024-09-06T14:44:25.744 INFO:tasks.workunit.client.1.smithi165.stdout:1/278: mknod d0/d2a/d1b/d2b/d3e/c5a 0 2024-09-06T14:44:25.744 INFO:tasks.workunit.client.1.smithi165.stdout:7/201: fdatasync d20/f24 0 2024-09-06T14:44:25.744 INFO:tasks.workunit.client.1.smithi165.stdout:3/238: readlink d1/da/dc/d10/l3f 0 2024-09-06T14:44:25.745 INFO:tasks.workunit.client.1.smithi165.stdout:1/279: readlink d0/l9 0 2024-09-06T14:44:25.748 INFO:tasks.workunit.client.1.smithi165.stdout:1/280: creat d0/d2a/d23/d56/f5b x:0 0 0 2024-09-06T14:44:25.748 INFO:tasks.workunit.client.1.smithi165.stdout:7/202: dread f8 [4194304,4194304] 0 2024-09-06T14:44:25.749 INFO:tasks.workunit.client.1.smithi165.stdout:1/281: stat d0/d2a/c37 0 2024-09-06T14:44:25.750 INFO:tasks.workunit.client.1.smithi165.stdout:7/203: unlink d20/l27 0 2024-09-06T14:44:25.750 INFO:tasks.workunit.client.1.smithi165.stdout:1/282: chown d0/d1c/d1d/d22/f32 1001 1 2024-09-06T14:44:25.751 INFO:tasks.workunit.client.1.smithi165.stdout:3/239: dwrite d1/da/f2d [0,4194304] 0 2024-09-06T14:44:25.752 INFO:tasks.workunit.client.1.smithi165.stdout:1/283: chown d0/d2a/d1b/f58 15400242 1 2024-09-06T14:44:25.753 INFO:tasks.workunit.client.1.smithi165.stdout:3/240: fdatasync d1/da/dc/f3a 0 2024-09-06T14:44:25.754 INFO:tasks.workunit.client.1.smithi165.stdout:7/204: mknod d20/d26/d28/c37 0 2024-09-06T14:44:25.757 INFO:tasks.workunit.client.1.smithi165.stdout:3/241: rename d1/da/dd/l18 to d1/l4f 0 2024-09-06T14:44:25.761 INFO:tasks.workunit.client.1.smithi165.stdout:3/242: unlink d1/d41/l4c 0 2024-09-06T14:44:25.764 INFO:tasks.workunit.client.1.smithi165.stdout:7/205: rename d20/d26/d28/l2e to d20/l38 0 2024-09-06T14:44:25.765 INFO:tasks.workunit.client.1.smithi165.stdout:3/243: dread d1/da/dd/f2c [0,4194304] 0 2024-09-06T14:44:25.767 INFO:tasks.workunit.client.1.smithi165.stdout:3/244: creat d1/d4a/f50 x:0 0 0 2024-09-06T14:44:25.768 INFO:tasks.workunit.client.1.smithi165.stdout:3/245: write d1/da/f26 [724570,116712] 0 2024-09-06T14:44:25.769 INFO:tasks.workunit.client.1.smithi165.stdout:3/246: truncate d1/da/dc/d3b/f42 424467 0 2024-09-06T14:44:25.772 INFO:tasks.workunit.client.1.smithi165.stdout:3/247: rename d1/c1e to d1/da/c51 0 2024-09-06T14:44:25.773 INFO:tasks.workunit.client.1.smithi165.stdout:3/248: write d1/d19/f27 [974409,48644] 0 2024-09-06T14:44:25.775 INFO:tasks.workunit.client.1.smithi165.stdout:3/249: symlink d1/da/d43/l52 0 2024-09-06T14:44:25.776 INFO:tasks.workunit.client.1.smithi165.stdout:3/250: rmdir d1 39 2024-09-06T14:44:25.779 INFO:tasks.workunit.client.1.smithi165.stdout:3/251: write d1/d4a/f50 [3336,35522] 0 2024-09-06T14:44:25.780 INFO:tasks.workunit.client.1.smithi165.stdout:3/252: chown d1/d19/f28 320664436 1 2024-09-06T14:44:25.780 INFO:tasks.workunit.client.1.smithi165.stdout:3/253: read - d1/d19/f49 zero size 2024-09-06T14:44:25.788 INFO:tasks.workunit.client.1.smithi165.stdout:3/254: chown d1/da/f2a 16225125 1 2024-09-06T14:44:25.789 INFO:tasks.workunit.client.1.smithi165.stdout:3/255: write d1/da/dc/d3b/f42 [214975,43679] 0 2024-09-06T14:44:25.791 INFO:tasks.workunit.client.1.smithi165.stdout:3/256: symlink d1/da/dd/d4b/l53 0 2024-09-06T14:44:25.791 INFO:tasks.workunit.client.1.smithi165.stdout:3/257: fsync d1/d19/f34 0 2024-09-06T14:44:25.793 INFO:tasks.workunit.client.1.smithi165.stdout:3/258: getdents d1/d41 0 2024-09-06T14:44:25.794 INFO:tasks.workunit.client.1.smithi165.stdout:3/259: symlink d1/d19/l54 0 2024-09-06T14:44:25.795 INFO:tasks.workunit.client.1.smithi165.stdout:3/260: rmdir d1/da/dd/d4b 39 2024-09-06T14:44:25.800 INFO:tasks.workunit.client.1.smithi165.stdout:3/261: dwrite d1/da/dd/fe [0,4194304] 0 2024-09-06T14:44:25.803 INFO:tasks.workunit.client.1.smithi165.stdout:3/262: truncate d1/da/dc/f30 964953 0 2024-09-06T14:44:25.803 INFO:tasks.workunit.client.1.smithi165.stdout:3/263: fsync d1/da/dd/f2c 0 2024-09-06T14:44:25.806 INFO:tasks.workunit.client.1.smithi165.stdout:3/264: dread d1/da/dc/f39 [0,4194304] 0 2024-09-06T14:44:25.812 INFO:tasks.workunit.client.1.smithi165.stdout:3/265: dwrite d1/da/f2f [0,4194304] 0 2024-09-06T14:44:25.813 INFO:tasks.workunit.client.1.smithi165.stdout:3/266: fsync d1/da/dc/f3a 0 2024-09-06T14:44:25.815 INFO:tasks.workunit.client.1.smithi165.stdout:3/267: creat d1/d4a/f55 x:0 0 0 2024-09-06T14:44:25.823 INFO:tasks.workunit.client.1.smithi165.stdout:3/268: dwrite d1/da/dc/f3a [0,4194304] 0 2024-09-06T14:44:25.824 INFO:tasks.workunit.client.1.smithi165.stdout:3/269: write d1/f1b [1222159,70473] 0 2024-09-06T14:44:25.827 INFO:tasks.workunit.client.1.smithi165.stdout:3/270: creat d1/d41/f56 x:0 0 0 2024-09-06T14:44:25.833 INFO:tasks.workunit.client.1.smithi165.stdout:3/271: dwrite d1/da/dd/f2c [0,4194304] 0 2024-09-06T14:44:25.834 INFO:tasks.workunit.client.1.smithi165.stdout:3/272: chown d1/da/d43/c46 0 1 2024-09-06T14:44:25.837 INFO:tasks.workunit.client.1.smithi165.stdout:3/273: creat d1/da/dd/f57 x:0 0 0 2024-09-06T14:44:25.850 INFO:tasks.workunit.client.1.smithi165.stdout:3/274: dread d1/f1b [0,4194304] 0 2024-09-06T14:44:25.852 INFO:tasks.workunit.client.1.smithi165.stdout:3/275: unlink d1/da/d43/l52 0 2024-09-06T14:44:25.853 INFO:tasks.workunit.client.1.smithi165.stdout:3/276: truncate d1/da/dd/f1c 1994361 0 2024-09-06T14:44:25.854 INFO:tasks.workunit.client.1.smithi165.stdout:3/277: write d1/f1b [1560357,65542] 0 2024-09-06T14:44:25.858 INFO:tasks.workunit.client.1.smithi165.stdout:6/246: sync 2024-09-06T14:44:25.860 INFO:tasks.workunit.client.1.smithi165.stdout:6/247: creat d29/f47 x:0 0 0 2024-09-06T14:44:25.860 INFO:tasks.workunit.client.1.smithi165.stdout:6/248: creat d29/f48 x:0 0 0 2024-09-06T14:44:25.861 INFO:tasks.workunit.client.1.smithi165.stdout:6/249: write d29/f47 [106751,61037] 0 2024-09-06T14:44:25.862 INFO:tasks.workunit.client.1.smithi165.stdout:3/278: truncate d1/da/dc/d10/f33 3037604 0 2024-09-06T14:44:25.863 INFO:tasks.workunit.client.1.smithi165.stdout:6/250: creat d29/f49 x:0 0 0 2024-09-06T14:44:25.863 INFO:tasks.workunit.client.1.smithi165.stdout:3/279: write d1/d19/f27 [448563,72152] 0 2024-09-06T14:44:25.866 INFO:tasks.workunit.client.1.smithi165.stdout:3/280: link d1/da/dc/d3b/c44 d1/c58 0 2024-09-06T14:44:25.868 INFO:tasks.workunit.client.1.smithi165.stdout:3/281: creat d1/d19/f59 x:0 0 0 2024-09-06T14:44:25.869 INFO:tasks.workunit.client.1.smithi165.stdout:6/251: dwrite d29/f3f [4194304,4194304] 0 2024-09-06T14:44:25.871 INFO:tasks.workunit.client.1.smithi165.stdout:6/252: mknod d29/d39/c4a 0 2024-09-06T14:44:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:25 smithi052 ceph-mon[28627]: pgmap v15: 65 pgs: 65 active+clean; 420 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 34 MiB/s wr, 250 op/s 2024-09-06T14:44:25.873 INFO:tasks.workunit.client.1.smithi165.stdout:3/282: link d1/l9 d1/d19/l5a 0 2024-09-06T14:44:25.875 INFO:tasks.workunit.client.1.smithi165.stdout:3/283: write d1/d4a/f55 [808793,79899] 0 2024-09-06T14:44:25.882 INFO:tasks.workunit.client.1.smithi165.stdout:6/253: dread f1d [0,4194304] 0 2024-09-06T14:44:25.882 INFO:tasks.workunit.client.1.smithi165.stdout:3/284: truncate d1/f2 2445971 0 2024-09-06T14:44:25.884 INFO:tasks.workunit.client.1.smithi165.stdout:6/254: rename f8 to d29/f4b 0 2024-09-06T14:44:25.885 INFO:tasks.workunit.client.1.smithi165.stdout:3/285: creat d1/f5b x:0 0 0 2024-09-06T14:44:25.885 INFO:tasks.workunit.client.1.smithi165.stdout:6/255: readlink ld 0 2024-09-06T14:44:25.886 INFO:tasks.workunit.client.1.smithi165.stdout:6/256: symlink d29/d39/l4c 0 2024-09-06T14:44:25.887 INFO:tasks.workunit.client.1.smithi165.stdout:3/286: creat d1/da/dc/f5c x:0 0 0 2024-09-06T14:44:25.888 INFO:tasks.workunit.client.1.smithi165.stdout:6/257: write f16 [473643,10609] 0 2024-09-06T14:44:25.890 INFO:tasks.workunit.client.1.smithi165.stdout:3/287: mkdir d1/da/dc/d5d 0 2024-09-06T14:44:25.890 INFO:tasks.workunit.client.1.smithi165.stdout:3/288: stat d1/lb 0 2024-09-06T14:44:25.891 INFO:tasks.workunit.client.1.smithi165.stdout:3/289: write d1/d4a/f55 [521980,106447] 0 2024-09-06T14:44:25.891 INFO:tasks.workunit.client.1.smithi165.stdout:3/290: readlink d1/l7 0 2024-09-06T14:44:25.895 INFO:tasks.workunit.client.1.smithi165.stdout:3/291: creat d1/da/dc/f5e x:0 0 0 2024-09-06T14:44:25.898 INFO:tasks.workunit.client.1.smithi165.stdout:3/292: rename d1/da/f2d to d1/da/dd/d4b/f5f 0 2024-09-06T14:44:25.899 INFO:tasks.workunit.client.1.smithi165.stdout:6/258: truncate d29/f36 1936408 0 2024-09-06T14:44:25.900 INFO:tasks.workunit.client.1.smithi165.stdout:3/293: symlink d1/d4a/l60 0 2024-09-06T14:44:25.901 INFO:tasks.workunit.client.1.smithi165.stdout:6/259: mknod d29/d39/c4d 0 2024-09-06T14:44:25.902 INFO:tasks.workunit.client.1.smithi165.stdout:6/260: symlink d29/d39/l4e 0 2024-09-06T14:44:25.904 INFO:tasks.workunit.client.1.smithi165.stdout:3/294: rename d1/da/dc/d3b/f42 to d1/da/dd/f61 0 2024-09-06T14:44:25.905 INFO:tasks.workunit.client.1.smithi165.stdout:3/295: chown d1/d41/c45 19699888 1 2024-09-06T14:44:25.906 INFO:tasks.workunit.client.1.smithi165.stdout:3/296: write d1/da/dc/f2e [49205,57208] 0 2024-09-06T14:44:25.909 INFO:tasks.workunit.client.1.smithi165.stdout:6/261: dwrite d29/d39/f44 [0,4194304] 0 2024-09-06T14:44:25.909 INFO:tasks.workunit.client.1.smithi165.stdout:3/297: chown d1/da/dd/f1c 9290 1 2024-09-06T14:44:25.914 INFO:tasks.workunit.client.1.smithi165.stdout:3/298: fdatasync d1/da/dc/f39 0 2024-09-06T14:44:25.914 INFO:tasks.workunit.client.1.smithi165.stdout:3/299: fsync d1/d4a/f50 0 2024-09-06T14:44:25.921 INFO:tasks.workunit.client.1.smithi165.stdout:6/262: truncate f17 3173491 0 2024-09-06T14:44:25.931 INFO:tasks.workunit.client.1.smithi165.stdout:6/263: dwrite d29/f4b [0,4194304] 0 2024-09-06T14:44:25.933 INFO:tasks.workunit.client.1.smithi165.stdout:6/264: symlink d29/d39/l4f 0 2024-09-06T14:44:25.947 INFO:tasks.workunit.client.1.smithi165.stdout:2/273: sync 2024-09-06T14:44:25.948 INFO:tasks.workunit.client.1.smithi165.stdout:6/265: rename fc to d29/d32/f50 0 2024-09-06T14:44:25.949 INFO:tasks.workunit.client.1.smithi165.stdout:6/266: read - d29/f48 zero size 2024-09-06T14:44:25.951 INFO:tasks.workunit.client.1.smithi165.stdout:2/274: dread d9/f12 [0,4194304] 0 2024-09-06T14:44:25.952 INFO:tasks.workunit.client.1.smithi165.stdout:2/275: chown d9/d23/l31 1709 1 2024-09-06T14:44:25.955 INFO:tasks.workunit.client.1.smithi165.stdout:2/276: symlink d9/d23/l50 0 2024-09-06T14:44:25.955 INFO:tasks.workunit.client.1.smithi165.stdout:6/267: dwrite d29/f47 [0,4194304] 0 2024-09-06T14:44:25.957 INFO:tasks.workunit.client.1.smithi165.stdout:2/277: chown d9/d23/d29/c3d 1451961 1 2024-09-06T14:44:25.957 INFO:tasks.workunit.client.1.smithi165.stdout:6/268: mkdir d29/d32/d51 0 2024-09-06T14:44:25.966 INFO:tasks.workunit.client.1.smithi165.stdout:2/278: truncate d9/f17 32696 0 2024-09-06T14:44:25.966 INFO:tasks.workunit.client.1.smithi165.stdout:6/269: write f17 [3434786,41632] 0 2024-09-06T14:44:25.974 INFO:tasks.workunit.client.1.smithi165.stdout:6/270: dwrite f28 [0,4194304] 0 2024-09-06T14:44:25.979 INFO:tasks.workunit.client.1.smithi165.stdout:2/279: dwrite d9/f35 [0,4194304] 0 2024-09-06T14:44:25.980 INFO:tasks.workunit.client.1.smithi165.stdout:2/280: chown d9 36235373 1 2024-09-06T14:44:25.984 INFO:tasks.workunit.client.1.smithi165.stdout:6/271: dwrite f17 [0,4194304] 0 2024-09-06T14:44:25.987 INFO:tasks.workunit.client.1.smithi165.stdout:2/281: link d9/d23/d26/f3c d9/d25/d45/f51 0 2024-09-06T14:44:25.989 INFO:tasks.workunit.client.1.smithi165.stdout:6/272: rename l27 to d29/l52 0 2024-09-06T14:44:25.990 INFO:tasks.workunit.client.1.smithi165.stdout:2/282: write d9/fc [896179,109524] 0 2024-09-06T14:44:25.991 INFO:tasks.workunit.client.1.smithi165.stdout:6/273: write f1d [3785270,48154] 0 2024-09-06T14:44:25.991 INFO:tasks.workunit.client.1.smithi165.stdout:2/283: fdatasync d9/d25/f40 0 2024-09-06T14:44:25.993 INFO:tasks.workunit.client.1.smithi165.stdout:6/274: rename d29/d39/l4c to d29/d32/l53 0 2024-09-06T14:44:25.994 INFO:tasks.workunit.client.1.smithi165.stdout:2/284: mkdir d9/d23/d52 0 2024-09-06T14:44:25.996 INFO:tasks.workunit.client.1.smithi165.stdout:6/275: rmdir d29/d32/d51 0 2024-09-06T14:44:25.998 INFO:tasks.workunit.client.1.smithi165.stdout:6/276: write f1c [3641396,30573] 0 2024-09-06T14:44:25.999 INFO:tasks.workunit.client.1.smithi165.stdout:6/277: chown f22 2571 1 2024-09-06T14:44:26.000 INFO:tasks.workunit.client.1.smithi165.stdout:6/278: fsync d29/f49 0 2024-09-06T14:44:26.001 INFO:tasks.workunit.client.1.smithi165.stdout:2/285: dwrite d9/d23/d26/f30 [0,4194304] 0 2024-09-06T14:44:26.001 INFO:tasks.workunit.client.1.smithi165.stdout:6/279: chown ld 14747 1 2024-09-06T14:44:26.003 INFO:tasks.workunit.client.1.smithi165.stdout:2/286: truncate d9/d23/d29/f2b 1027165 0 2024-09-06T14:44:26.004 INFO:tasks.workunit.client.1.smithi165.stdout:2/287: dread - d9/d23/d26/f3c zero size 2024-09-06T14:44:26.008 INFO:tasks.workunit.client.1.smithi165.stdout:6/280: dwrite f1d [0,4194304] 0 2024-09-06T14:44:26.013 INFO:tasks.workunit.client.1.smithi165.stdout:6/281: fsync f22 0 2024-09-06T14:44:26.014 INFO:tasks.workunit.client.1.smithi165.stdout:6/282: chown d29/d39/l4f 2 1 2024-09-06T14:44:26.016 INFO:tasks.workunit.client.1.smithi165.stdout:2/288: mknod d9/d23/d26/d2d/d34/c53 0 2024-09-06T14:44:26.022 INFO:tasks.workunit.client.1.smithi165.stdout:2/289: dwrite d9/d25/f33 [0,4194304] 0 2024-09-06T14:44:26.034 INFO:tasks.workunit.client.1.smithi165.stdout:6/283: truncate d29/d32/f50 2267068 0 2024-09-06T14:44:26.036 INFO:tasks.workunit.client.1.smithi165.stdout:6/284: stat d29/c2d 0 2024-09-06T14:44:26.036 INFO:tasks.workunit.client.1.smithi165.stdout:6/285: write d29/f41 [155793,55495] 0 2024-09-06T14:44:26.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:25 smithi165 ceph-mon[36229]: pgmap v15: 65 pgs: 65 active+clean; 420 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 34 MiB/s wr, 250 op/s 2024-09-06T14:44:26.075 INFO:tasks.workunit.client.1.smithi165.stdout:8/316: sync 2024-09-06T14:44:26.075 INFO:tasks.workunit.client.1.smithi165.stdout:5/305: sync 2024-09-06T14:44:26.079 INFO:tasks.workunit.client.1.smithi165.stdout:6/286: write d29/d39/f44 [2659580,126518] 0 2024-09-06T14:44:26.080 INFO:tasks.workunit.client.1.smithi165.stdout:8/317: write d0/d19/d24/f37 [86866,77753] 0 2024-09-06T14:44:26.081 INFO:tasks.workunit.client.1.smithi165.stdout:5/306: symlink d6/d1c/d28/l71 0 2024-09-06T14:44:26.082 INFO:tasks.workunit.client.1.smithi165.stdout:6/287: rmdir d29 39 2024-09-06T14:44:26.083 INFO:tasks.workunit.client.1.smithi165.stdout:5/307: write d6/d1c/d28/f2e [229526,36356] 0 2024-09-06T14:44:26.110 INFO:tasks.workunit.client.1.smithi165.stdout:2/290: dwrite d9/f12 [0,4194304] 0 2024-09-06T14:44:26.112 INFO:tasks.workunit.client.1.smithi165.stdout:6/288: stat d29/f36 0 2024-09-06T14:44:26.113 INFO:tasks.workunit.client.1.smithi165.stdout:6/289: fdatasync f17 0 2024-09-06T14:44:26.118 INFO:tasks.workunit.client.1.smithi165.stdout:2/291: dwrite d9/f1e [0,4194304] 0 2024-09-06T14:44:26.119 INFO:tasks.workunit.client.1.smithi165.stdout:8/318: getdents d0/d14 0 2024-09-06T14:44:26.128 INFO:tasks.workunit.client.1.smithi165.stdout:8/319: dread d0/d19/d36/d2d/d3f/f4e [0,4194304] 0 2024-09-06T14:44:26.130 INFO:tasks.workunit.client.1.smithi165.stdout:2/292: creat d9/d23/d26/d2d/f54 x:0 0 0 2024-09-06T14:44:26.136 INFO:tasks.workunit.client.1.smithi165.stdout:2/293: symlink d9/d23/d26/d2d/l55 0 2024-09-06T14:44:26.142 INFO:tasks.workunit.client.1.smithi165.stdout:2/294: rename d9/d23/d26/c38 to d9/c56 0 2024-09-06T14:44:26.149 INFO:tasks.workunit.client.1.smithi165.stdout:8/320: dread d0/f2f [0,4194304] 0 2024-09-06T14:44:26.152 INFO:tasks.workunit.client.1.smithi165.stdout:8/321: dread d0/d19/d36/d2d/d33/d3a/d46/f52 [0,4194304] 0 2024-09-06T14:44:26.156 INFO:tasks.workunit.client.1.smithi165.stdout:2/295: dread f8 [0,4194304] 0 2024-09-06T14:44:26.156 INFO:tasks.workunit.client.1.smithi165.stdout:8/322: rmdir d0/d19/d36/d2d 39 2024-09-06T14:44:26.158 INFO:tasks.workunit.client.1.smithi165.stdout:4/323: sync 2024-09-06T14:44:26.158 INFO:tasks.workunit.client.1.smithi165.stdout:9/477: sync 2024-09-06T14:44:26.158 INFO:tasks.workunit.client.1.smithi165.stdout:2/296: creat d9/d25/f57 x:0 0 0 2024-09-06T14:44:26.162 INFO:tasks.workunit.client.1.smithi165.stdout:9/478: mkdir db/d22/d97 0 2024-09-06T14:44:26.170 INFO:tasks.workunit.client.1.smithi165.stdout:8/323: dread d0/d14/f1b [0,4194304] 0 2024-09-06T14:44:26.170 INFO:tasks.workunit.client.1.smithi165.stdout:4/324: link d5/d1b/d1c/d41/l59 d5/d1b/d66/l70 0 2024-09-06T14:44:26.172 INFO:tasks.workunit.client.1.smithi165.stdout:4/325: creat d5/d1b/d1c/d55/f71 x:0 0 0 2024-09-06T14:44:26.189 INFO:tasks.workunit.client.1.smithi165.stdout:9/479: dread db/de/d15/f28 [0,4194304] 0 2024-09-06T14:44:26.190 INFO:tasks.workunit.client.1.smithi165.stdout:9/480: write db/de/d15/d17/d18/d7d/f92 [231962,75147] 0 2024-09-06T14:44:26.193 INFO:tasks.workunit.client.1.smithi165.stdout:9/481: mknod db/de/d15/d17/d18/d59/d64/c98 0 2024-09-06T14:44:26.193 INFO:tasks.workunit.client.1.smithi165.stdout:9/482: chown db/de/d15/d17/d18 31 1 2024-09-06T14:44:26.206 INFO:tasks.workunit.client.1.smithi165.stdout:5/308: write d6/d1c/d28/f2c [1293412,6602] 0 2024-09-06T14:44:26.207 INFO:tasks.workunit.client.1.smithi165.stdout:5/309: chown d6/d1c/d28/d2d/f53 16 1 2024-09-06T14:44:26.207 INFO:tasks.workunit.client.1.smithi165.stdout:5/310: chown c3 14155 1 2024-09-06T14:44:26.241 INFO:tasks.workunit.client.1.smithi165.stdout:0/294: sync 2024-09-06T14:44:26.242 INFO:tasks.workunit.client.1.smithi165.stdout:7/206: sync 2024-09-06T14:44:26.242 INFO:tasks.workunit.client.1.smithi165.stdout:1/284: sync 2024-09-06T14:44:26.242 INFO:tasks.workunit.client.1.smithi165.stdout:3/300: sync 2024-09-06T14:44:26.242 INFO:tasks.workunit.client.1.smithi165.stdout:5/311: mknod d6/d1c/d28/d4b/c72 0 2024-09-06T14:44:26.243 INFO:tasks.workunit.client.1.smithi165.stdout:1/285: dread - d0/d2a/f12 zero size 2024-09-06T14:44:26.244 INFO:tasks.workunit.client.1.smithi165.stdout:9/483: rename db/d22 to db/de/d15/d17/d18/d59/d64/d99 0 2024-09-06T14:44:26.245 INFO:tasks.workunit.client.1.smithi165.stdout:5/312: fsync d6/d1c/d28/d2d/d3c/d44/f47 0 2024-09-06T14:44:26.246 INFO:tasks.workunit.client.1.smithi165.stdout:7/207: creat d20/d26/d28/d30/f39 x:0 0 0 2024-09-06T14:44:26.247 INFO:tasks.workunit.client.1.smithi165.stdout:7/208: stat f18 0 2024-09-06T14:44:26.248 INFO:tasks.workunit.client.1.smithi165.stdout:3/301: rename d1/l38 to d1/da/dc/d3b/l62 0 2024-09-06T14:44:26.249 INFO:tasks.workunit.client.1.smithi165.stdout:1/286: mknod d0/d2a/d23/c5c 0 2024-09-06T14:44:26.249 INFO:tasks.workunit.client.1.smithi165.stdout:3/302: chown d1/da/dc 2465768 1 2024-09-06T14:44:26.249 INFO:tasks.workunit.client.1.smithi165.stdout:6/290: dwrite f5 [0,4194304] 0 2024-09-06T14:44:26.255 INFO:tasks.workunit.client.1.smithi165.stdout:6/291: creat d29/d39/f54 x:0 0 0 2024-09-06T14:44:26.255 INFO:tasks.workunit.client.1.smithi165.stdout:9/484: dwrite db/de/d2d/f31 [0,4194304] 0 2024-09-06T14:44:26.256 INFO:tasks.workunit.client.1.smithi165.stdout:3/303: symlink d1/da/l63 0 2024-09-06T14:44:26.257 INFO:tasks.workunit.client.1.smithi165.stdout:8/324: truncate d0/d19/d36/f7 3590667 0 2024-09-06T14:44:26.265 INFO:tasks.workunit.client.1.smithi165.stdout:5/313: link d6/d1c/d28/d2d/d49/l4d d6/d32/d41/l73 0 2024-09-06T14:44:26.265 INFO:tasks.workunit.client.1.smithi165.stdout:3/304: dwrite d1/d19/f49 [0,4194304] 0 2024-09-06T14:44:26.268 INFO:tasks.workunit.client.1.smithi165.stdout:7/209: link d20/d26/d28/c32 d20/d26/d28/c3a 0 2024-09-06T14:44:26.269 INFO:tasks.workunit.client.1.smithi165.stdout:5/314: rmdir d6/d32/d41 39 2024-09-06T14:44:26.271 INFO:tasks.workunit.client.1.smithi165.stdout:6/292: link d29/d39/l4f d29/d32/l55 0 2024-09-06T14:44:26.272 INFO:tasks.workunit.client.1.smithi165.stdout:3/305: dread d1/da/dd/f61 [0,4194304] 0 2024-09-06T14:44:26.272 INFO:tasks.workunit.client.1.smithi165.stdout:9/485: dwrite db/de/d15/d17/d18/f84 [0,4194304] 0 2024-09-06T14:44:26.274 INFO:tasks.workunit.client.1.smithi165.stdout:7/210: mkdir d20/d3b 0 2024-09-06T14:44:26.274 INFO:tasks.workunit.client.1.smithi165.stdout:6/293: write d29/f41 [349801,100499] 0 2024-09-06T14:44:26.275 INFO:tasks.workunit.client.1.smithi165.stdout:5/315: fsync d6/d1c/d28/f6b 0 2024-09-06T14:44:26.275 INFO:tasks.workunit.client.1.smithi165.stdout:8/325: getdents d0/d19/d24 0 2024-09-06T14:44:26.276 INFO:tasks.workunit.client.1.smithi165.stdout:6/294: dread - d29/d39/f54 zero size 2024-09-06T14:44:26.276 INFO:tasks.workunit.client.1.smithi165.stdout:3/306: rmdir d1/da/dd 39 2024-09-06T14:44:26.277 INFO:tasks.workunit.client.1.smithi165.stdout:5/316: stat d6/d1c/d28/d2d/d3c/d44/c51 0 2024-09-06T14:44:26.278 INFO:tasks.workunit.client.1.smithi165.stdout:3/307: rename d1/da to d1/da/d43/d64 22 2024-09-06T14:44:26.279 INFO:tasks.workunit.client.1.smithi165.stdout:7/211: symlink d20/d26/d28/d30/l3c 0 2024-09-06T14:44:26.288 INFO:tasks.workunit.client.1.smithi165.stdout:6/295: dread d29/f4b [0,4194304] 0 2024-09-06T14:44:26.288 INFO:tasks.workunit.client.1.smithi165.stdout:5/317: creat d6/d1c/f74 x:0 0 0 2024-09-06T14:44:26.288 INFO:tasks.workunit.client.1.smithi165.stdout:3/308: symlink d1/d4a/l65 0 2024-09-06T14:44:26.288 INFO:tasks.workunit.client.1.smithi165.stdout:7/212: symlink d20/d26/l3d 0 2024-09-06T14:44:26.288 INFO:tasks.workunit.client.1.smithi165.stdout:3/309: write d1/d19/f59 [37790,90083] 0 2024-09-06T14:44:26.290 INFO:tasks.workunit.client.1.smithi165.stdout:3/310: write d1/da/dc/f5c [820917,118087] 0 2024-09-06T14:44:26.290 INFO:tasks.workunit.client.1.smithi165.stdout:6/296: creat d29/d32/f56 x:0 0 0 2024-09-06T14:44:26.291 INFO:tasks.workunit.client.1.smithi165.stdout:3/311: readlink d1/da/dc/d3b/l3c 0 2024-09-06T14:44:26.294 INFO:tasks.workunit.client.1.smithi165.stdout:3/312: mkdir d1/d66 0 2024-09-06T14:44:26.295 INFO:tasks.workunit.client.1.smithi165.stdout:8/326: creat d0/d19/d36/d2d/f72 x:0 0 0 2024-09-06T14:44:26.296 INFO:tasks.workunit.client.1.smithi165.stdout:3/313: rename d1/da/dc to d1/da/dc/d3b/d67 22 2024-09-06T14:44:26.298 INFO:tasks.workunit.client.1.smithi165.stdout:6/297: dwrite f1e [0,4194304] 0 2024-09-06T14:44:26.301 INFO:tasks.workunit.client.1.smithi165.stdout:7/213: dread d20/f21 [0,4194304] 0 2024-09-06T14:44:26.301 INFO:tasks.workunit.client.1.smithi165.stdout:8/327: mkdir d0/d19/d73 0 2024-09-06T14:44:26.302 INFO:tasks.workunit.client.1.smithi165.stdout:3/314: symlink d1/da/dc/l68 0 2024-09-06T14:44:26.303 INFO:tasks.workunit.client.1.smithi165.stdout:8/328: fdatasync d0/d19/d36/d2d/d33/d3a/f55 0 2024-09-06T14:44:26.304 INFO:tasks.workunit.client.1.smithi165.stdout:3/315: rename d1/f5b to d1/f69 0 2024-09-06T14:44:26.306 INFO:tasks.workunit.client.1.smithi165.stdout:6/298: rename d29/d32/l55 to d29/l57 0 2024-09-06T14:44:26.309 INFO:tasks.workunit.client.1.smithi165.stdout:8/329: mknod d0/d19/c74 0 2024-09-06T14:44:26.310 INFO:tasks.workunit.client.1.smithi165.stdout:7/214: dwrite d20/f24 [0,4194304] 0 2024-09-06T14:44:26.316 INFO:tasks.workunit.client.1.smithi165.stdout:3/316: dwrite d1/da/dc/f5e [0,4194304] 0 2024-09-06T14:44:26.317 INFO:tasks.workunit.client.1.smithi165.stdout:6/299: dread f1e [0,4194304] 0 2024-09-06T14:44:26.321 INFO:tasks.workunit.client.1.smithi165.stdout:6/300: dread d29/f35 [0,4194304] 0 2024-09-06T14:44:26.326 INFO:tasks.workunit.client.1.smithi165.stdout:7/215: link d20/d26/l2a d20/d26/d28/d30/l3e 0 2024-09-06T14:44:26.329 INFO:tasks.workunit.client.1.smithi165.stdout:7/216: rename fa to d20/d3b/f3f 0 2024-09-06T14:44:26.331 INFO:tasks.workunit.client.1.smithi165.stdout:7/217: mkdir d20/d40 0 2024-09-06T14:44:26.333 INFO:tasks.workunit.client.1.smithi165.stdout:7/218: fsync f17 0 2024-09-06T14:44:26.335 INFO:tasks.workunit.client.1.smithi165.stdout:7/219: symlink d20/d3b/l41 0 2024-09-06T14:44:26.336 INFO:tasks.workunit.client.1.smithi165.stdout:7/220: write f12 [4217143,65768] 0 2024-09-06T14:44:26.341 INFO:tasks.workunit.client.1.smithi165.stdout:9/486: write db/de/d16/d2e/f55 [16130,77304] 0 2024-09-06T14:44:26.341 INFO:tasks.workunit.client.1.smithi165.stdout:1/287: dwrite d0/d2a/f12 [0,4194304] 0 2024-09-06T14:44:26.344 INFO:tasks.workunit.client.1.smithi165.stdout:9/487: mkdir db/d40/d9a 0 2024-09-06T14:44:26.344 INFO:tasks.workunit.client.1.smithi165.stdout:5/318: truncate d6/d1c/d28/d2d/f53 1415631 0 2024-09-06T14:44:26.346 INFO:tasks.workunit.client.1.smithi165.stdout:1/288: mknod d0/d2a/c5d 0 2024-09-06T14:44:26.347 INFO:tasks.workunit.client.1.smithi165.stdout:5/319: dread d6/d1c/d28/f43 [0,4194304] 0 2024-09-06T14:44:26.348 INFO:tasks.workunit.client.1.smithi165.stdout:9/488: rename db/de/d2d to db/de/d15/d7f/d9b 0 2024-09-06T14:44:26.349 INFO:tasks.workunit.client.1.smithi165.stdout:9/489: chown db/de/d15/d7f/d9b/c52 3750 1 2024-09-06T14:44:26.355 INFO:tasks.workunit.client.1.smithi165.stdout:7/221: dread ff [0,4194304] 0 2024-09-06T14:44:26.356 INFO:tasks.workunit.client.1.smithi165.stdout:8/330: truncate d0/d19/d36/f12 220009 0 2024-09-06T14:44:26.356 INFO:tasks.workunit.client.1.smithi165.stdout:3/317: write d1/da/dd/f15 [411374,74313] 0 2024-09-06T14:44:26.357 INFO:tasks.workunit.client.1.smithi165.stdout:7/222: write d20/f2b [436327,16795] 0 2024-09-06T14:44:26.357 INFO:tasks.workunit.client.1.smithi165.stdout:9/490: link db/d40/l71 db/de/d15/d17/d18/d59/d64/d99/l9c 0 2024-09-06T14:44:26.360 INFO:tasks.workunit.client.1.smithi165.stdout:5/320: getdents d6/d1c/d28 0 2024-09-06T14:44:26.360 INFO:tasks.workunit.client.1.smithi165.stdout:8/331: write d0/d14/f2b [684436,3226] 0 2024-09-06T14:44:26.362 INFO:tasks.workunit.client.1.smithi165.stdout:9/491: fdatasync db/de/d15/d17/d18/d7d/f6d 0 2024-09-06T14:44:26.362 INFO:tasks.workunit.client.1.smithi165.stdout:5/321: fdatasync d6/d1c/d64/f65 0 2024-09-06T14:44:26.363 INFO:tasks.workunit.client.1.smithi165.stdout:7/223: mknod d20/c42 0 2024-09-06T14:44:26.364 INFO:tasks.workunit.client.1.smithi165.stdout:5/322: chown d6/d1c/d28/d2d/d3c 30235051 1 2024-09-06T14:44:26.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/224: symlink d20/d33/l43 0 2024-09-06T14:44:26.371 INFO:tasks.workunit.client.1.smithi165.stdout:8/332: getdents d0/d19/d36/d2d/d3f 0 2024-09-06T14:44:26.372 INFO:tasks.workunit.client.1.smithi165.stdout:9/492: dwrite db/de/f10 [0,4194304] 0 2024-09-06T14:44:26.376 INFO:tasks.workunit.client.1.smithi165.stdout:3/318: dread d1/da/dc/d10/f33 [0,4194304] 0 2024-09-06T14:44:26.378 INFO:tasks.workunit.client.1.smithi165.stdout:9/493: readlink db/de/d16/d2e/l8d 0 2024-09-06T14:44:26.379 INFO:tasks.workunit.client.1.smithi165.stdout:7/225: rename d20/d26/d28/c2f to d20/d26/d28/d30/c44 0 2024-09-06T14:44:26.382 INFO:tasks.workunit.client.1.smithi165.stdout:5/323: dwrite d6/d1c/d64/f6e [0,4194304] 0 2024-09-06T14:44:26.382 INFO:tasks.workunit.client.1.smithi165.stdout:8/333: creat d0/d19/d36/d2d/f75 x:0 0 0 2024-09-06T14:44:26.383 INFO:tasks.workunit.client.1.smithi165.stdout:1/289: dwrite d0/d2a/d1b/f58 [0,4194304] 0 2024-09-06T14:44:26.384 INFO:tasks.workunit.client.1.smithi165.stdout:9/494: mknod db/de/d15/d17/d18/d59/d64/d99/c9d 0 2024-09-06T14:44:26.385 INFO:tasks.workunit.client.1.smithi165.stdout:8/334: write d0/d19/d36/fa [4704782,113131] 0 2024-09-06T14:44:26.387 INFO:tasks.workunit.client.1.smithi165.stdout:5/324: write d6/d1c/d28/d4b/f5e [111972,21598] 0 2024-09-06T14:44:26.388 INFO:tasks.workunit.client.1.smithi165.stdout:9/495: fsync db/de/d15/d7f/d9b/f3c 0 2024-09-06T14:44:26.389 INFO:tasks.workunit.client.1.smithi165.stdout:7/226: rename d20/d26/d28/d30/l3e to d20/d3b/l45 0 2024-09-06T14:44:26.391 INFO:tasks.workunit.client.1.smithi165.stdout:8/335: creat d0/d19/d24/d26/f76 x:0 0 0 2024-09-06T14:44:26.393 INFO:tasks.workunit.client.1.smithi165.stdout:8/336: read d0/d14/f2b [130745,69906] 0 2024-09-06T14:44:26.394 INFO:tasks.workunit.client.1.smithi165.stdout:8/337: chown d0/d19/d36/d2d/d3f 1327703 1 2024-09-06T14:44:26.396 INFO:tasks.workunit.client.1.smithi165.stdout:7/227: symlink d20/d3b/l46 0 2024-09-06T14:44:26.397 INFO:tasks.workunit.client.1.smithi165.stdout:7/228: fsync f15 0 2024-09-06T14:44:26.400 INFO:tasks.workunit.client.1.smithi165.stdout:3/319: truncate d1/da/dd/fe 3901415 0 2024-09-06T14:44:26.401 INFO:tasks.workunit.client.1.smithi165.stdout:7/229: mknod d20/d3b/c47 0 2024-09-06T14:44:26.402 INFO:tasks.workunit.client.1.smithi165.stdout:3/320: symlink d1/da/d43/l6a 0 2024-09-06T14:44:26.403 INFO:tasks.workunit.client.1.smithi165.stdout:9/496: dwrite db/de/d15/f28 [0,4194304] 0 2024-09-06T14:44:26.403 INFO:tasks.workunit.client.1.smithi165.stdout:7/230: stat d20/d26/l3d 0 2024-09-06T14:44:26.408 INFO:tasks.workunit.client.1.smithi165.stdout:9/497: write db/de/d15/d17/d18/d7d/f5f [162888,17622] 0 2024-09-06T14:44:26.409 INFO:tasks.workunit.client.1.smithi165.stdout:3/321: fsync d1/da/dd/d4b/f5f 0 2024-09-06T14:44:26.412 INFO:tasks.workunit.client.1.smithi165.stdout:3/322: chown d1/da/dc/d5d 5 1 2024-09-06T14:44:26.412 INFO:tasks.workunit.client.1.smithi165.stdout:8/338: dwrite d0/fc [8388608,4194304] 0 2024-09-06T14:44:26.412 INFO:tasks.workunit.client.1.smithi165.stdout:1/290: truncate d0/d2a/d1b/d2b/d3e/f49 516057 0 2024-09-06T14:44:26.412 INFO:tasks.workunit.client.1.smithi165.stdout:5/325: dread d6/d1c/f3d [0,4194304] 0 2024-09-06T14:44:26.414 INFO:tasks.workunit.client.1.smithi165.stdout:3/323: read d1/da/dc/f3a [2594412,42820] 0 2024-09-06T14:44:26.414 INFO:tasks.workunit.client.1.smithi165.stdout:9/498: mkdir db/de/d15/d17/d72/d9e 0 2024-09-06T14:44:26.415 INFO:tasks.workunit.client.1.smithi165.stdout:3/324: write d1/d19/f49 [122674,100744] 0 2024-09-06T14:44:26.417 INFO:tasks.workunit.client.1.smithi165.stdout:8/339: rmdir d0/d19/d36/d2d 39 2024-09-06T14:44:26.418 INFO:tasks.workunit.client.1.smithi165.stdout:3/325: fdatasync d1/da/dd/f57 0 2024-09-06T14:44:26.422 INFO:tasks.workunit.client.1.smithi165.stdout:9/499: mknod db/de/d15/d17/d18/d59/d64/d99/d97/c9f 0 2024-09-06T14:44:26.424 INFO:tasks.workunit.client.1.smithi165.stdout:3/326: rename d1/l2b to d1/da/dc/d10/l6b 0 2024-09-06T14:44:26.426 INFO:tasks.workunit.client.1.smithi165.stdout:3/327: readlink d1/da/d43/l6a 0 2024-09-06T14:44:26.427 INFO:tasks.workunit.client.1.smithi165.stdout:5/326: dwrite d6/d1c/f3d [0,4194304] 0 2024-09-06T14:44:26.427 INFO:tasks.workunit.client.1.smithi165.stdout:9/500: chown db/de/d15/d17/d18/d7d/d8e 17299 1 2024-09-06T14:44:26.430 INFO:tasks.workunit.client.1.smithi165.stdout:7/231: dread f8 [0,4194304] 0 2024-09-06T14:44:26.433 INFO:tasks.workunit.client.1.smithi165.stdout:5/327: symlink d6/d1c/d28/d2d/d3c/l75 0 2024-09-06T14:44:26.437 INFO:tasks.workunit.client.1.smithi165.stdout:4/326: sync 2024-09-06T14:44:26.437 INFO:tasks.workunit.client.1.smithi165.stdout:0/295: sync 2024-09-06T14:44:26.437 INFO:tasks.workunit.client.1.smithi165.stdout:2/297: sync 2024-09-06T14:44:26.439 INFO:tasks.workunit.client.1.smithi165.stdout:9/501: unlink db/de/d15/d17/d72/c77 0 2024-09-06T14:44:26.440 INFO:tasks.workunit.client.1.smithi165.stdout:7/232: rename f16 to d20/f48 0 2024-09-06T14:44:26.440 INFO:tasks.workunit.client.1.smithi165.stdout:0/296: write d15/f37 [661836,75207] 0 2024-09-06T14:44:26.443 INFO:tasks.workunit.client.1.smithi165.stdout:1/291: dwrite d0/d2a/f53 [0,4194304] 0 2024-09-06T14:44:26.445 INFO:tasks.workunit.client.1.smithi165.stdout:2/298: rename d9/ff to d9/d23/d29/f58 0 2024-09-06T14:44:26.448 INFO:tasks.workunit.client.1.smithi165.stdout:7/233: mknod d20/c49 0 2024-09-06T14:44:26.451 INFO:tasks.workunit.client.1.smithi165.stdout:1/292: creat d0/d1c/d41/f5e x:0 0 0 2024-09-06T14:44:26.451 INFO:tasks.workunit.client.1.smithi165.stdout:4/327: rename d5/d1b/d1c/l3a to d5/d1b/d1c/d20/d26/l72 0 2024-09-06T14:44:26.452 INFO:tasks.workunit.client.1.smithi165.stdout:0/297: mknod d15/d19/c61 0 2024-09-06T14:44:26.456 INFO:tasks.workunit.client.1.smithi165.stdout:7/234: fsync d20/d3b/f3f 0 2024-09-06T14:44:26.456 INFO:tasks.workunit.client.1.smithi165.stdout:5/328: dread d6/d32/f33 [0,4194304] 0 2024-09-06T14:44:26.456 INFO:tasks.workunit.client.1.smithi165.stdout:9/502: dwrite db/de/d15/d17/f5c [0,4194304] 0 2024-09-06T14:44:26.459 INFO:tasks.workunit.client.1.smithi165.stdout:6/301: sync 2024-09-06T14:44:26.460 INFO:tasks.workunit.client.1.smithi165.stdout:2/299: symlink d9/d23/l59 0 2024-09-06T14:44:26.460 INFO:tasks.workunit.client.1.smithi165.stdout:6/302: readlink d29/l37 0 2024-09-06T14:44:26.460 INFO:tasks.workunit.client.1.smithi165.stdout:9/503: chown db/de/d16/d2e 2 1 2024-09-06T14:44:26.461 INFO:tasks.workunit.client.1.smithi165.stdout:7/235: rename d20/d26 to d20/d26/d28/d4a 22 2024-09-06T14:44:26.462 INFO:tasks.workunit.client.1.smithi165.stdout:0/298: rmdir d15/d19/d28/d3a 39 2024-09-06T14:44:26.462 INFO:tasks.workunit.client.1.smithi165.stdout:8/340: dread d0/fd [0,4194304] 0 2024-09-06T14:44:26.464 INFO:tasks.workunit.client.1.smithi165.stdout:4/328: mknod d5/d1b/c73 0 2024-09-06T14:44:26.467 INFO:tasks.workunit.client.1.smithi165.stdout:2/300: dread - d9/d25/f40 zero size 2024-09-06T14:44:26.467 INFO:tasks.workunit.client.1.smithi165.stdout:3/328: dwrite d1/da/dc/f30 [0,4194304] 0 2024-09-06T14:44:26.472 INFO:tasks.workunit.client.1.smithi165.stdout:1/293: mkdir d0/d2a/d18/d24/d4b/d5f 0 2024-09-06T14:44:26.473 INFO:tasks.workunit.client.1.smithi165.stdout:2/301: write d9/f13 [10561400,80365] 0 2024-09-06T14:44:26.474 INFO:tasks.workunit.client.1.smithi165.stdout:6/303: fdatasync f3 0 2024-09-06T14:44:26.474 INFO:tasks.workunit.client.1.smithi165.stdout:5/329: dread d6/d1c/d28/f2c [0,4194304] 0 2024-09-06T14:44:26.476 INFO:tasks.workunit.client.1.smithi165.stdout:7/236: rename d20/d26/l2a to d20/d3b/l4b 0 2024-09-06T14:44:26.476 INFO:tasks.workunit.client.1.smithi165.stdout:0/299: mknod d15/d19/d28/c62 0 2024-09-06T14:44:26.477 INFO:tasks.workunit.client.1.smithi165.stdout:3/329: mknod d1/da/c6c 0 2024-09-06T14:44:26.477 INFO:tasks.workunit.client.1.smithi165.stdout:8/341: mkdir d0/d19/d36/d28/d53/d77 0 2024-09-06T14:44:26.478 INFO:tasks.workunit.client.1.smithi165.stdout:5/330: write d6/f18 [2924461,2015] 0 2024-09-06T14:44:26.478 INFO:tasks.workunit.client.1.smithi165.stdout:6/304: mknod d29/c58 0 2024-09-06T14:44:26.479 INFO:tasks.workunit.client.1.smithi165.stdout:2/302: chown d9/d25/d46/l4b 2014602304 1 2024-09-06T14:44:26.479 INFO:tasks.workunit.client.1.smithi165.stdout:3/330: fsync d1/d19/f49 0 2024-09-06T14:44:26.480 INFO:tasks.workunit.client.1.smithi165.stdout:6/305: readlink d29/l37 0 2024-09-06T14:44:26.481 INFO:tasks.workunit.client.1.smithi165.stdout:7/237: creat d20/d26/d28/f4c x:0 0 0 2024-09-06T14:44:26.481 INFO:tasks.workunit.client.1.smithi165.stdout:2/303: chown d9/d23/d52 3970191 1 2024-09-06T14:44:26.481 INFO:tasks.workunit.client.1.smithi165.stdout:9/504: creat db/de/d15/d17/d18/d7d/d61/fa0 x:0 0 0 2024-09-06T14:44:26.482 INFO:tasks.workunit.client.1.smithi165.stdout:8/342: write d0/d19/d24/f37 [979891,7770] 0 2024-09-06T14:44:26.483 INFO:tasks.workunit.client.1.smithi165.stdout:1/294: creat d0/d2a/d18/d24/d4b/d5f/f60 x:0 0 0 2024-09-06T14:44:26.484 INFO:tasks.workunit.client.1.smithi165.stdout:5/331: creat d6/d1c/f76 x:0 0 0 2024-09-06T14:44:26.486 INFO:tasks.workunit.client.1.smithi165.stdout:7/238: truncate d20/d26/d28/d30/f39 856560 0 2024-09-06T14:44:26.486 INFO:tasks.workunit.client.1.smithi165.stdout:2/304: rmdir d9/d23/d26 39 2024-09-06T14:44:26.487 INFO:tasks.workunit.client.1.smithi165.stdout:9/505: readlink db/de/d15/d17/d18/d59/d64/l67 0 2024-09-06T14:44:26.487 INFO:tasks.workunit.client.1.smithi165.stdout:2/305: chown d9/f1c 86838 1 2024-09-06T14:44:26.487 INFO:tasks.workunit.client.1.smithi165.stdout:5/332: truncate d6/d32/f63 869910 0 2024-09-06T14:44:26.488 INFO:tasks.workunit.client.1.smithi165.stdout:0/300: creat d15/d19/d28/d4f/d52/f63 x:0 0 0 2024-09-06T14:44:26.488 INFO:tasks.workunit.client.1.smithi165.stdout:8/343: creat d0/d19/d36/d28/f78 x:0 0 0 2024-09-06T14:44:26.490 INFO:tasks.workunit.client.1.smithi165.stdout:6/306: rename d29/l57 to d29/l59 0 2024-09-06T14:44:26.491 INFO:tasks.workunit.client.1.smithi165.stdout:0/301: truncate d15/d19/d28/d4f/d52/f63 98257 0 2024-09-06T14:44:26.491 INFO:tasks.workunit.client.1.smithi165.stdout:1/295: creat d0/d2a/d18/d24/d4b/d5f/f61 x:0 0 0 2024-09-06T14:44:26.492 INFO:tasks.workunit.client.1.smithi165.stdout:9/506: unlink db/de/d15/d74/f83 0 2024-09-06T14:44:26.493 INFO:tasks.workunit.client.1.smithi165.stdout:6/307: write d29/f49 [252480,12843] 0 2024-09-06T14:44:26.494 INFO:tasks.workunit.client.1.smithi165.stdout:8/344: creat d0/d34/f79 x:0 0 0 2024-09-06T14:44:26.494 INFO:tasks.workunit.client.1.smithi165.stdout:7/239: mkdir d20/d4d 0 2024-09-06T14:44:26.495 INFO:tasks.workunit.client.1.smithi165.stdout:5/333: chown d6/d32/d41/l5b 1541 1 2024-09-06T14:44:26.495 INFO:tasks.workunit.client.1.smithi165.stdout:2/306: mkdir d9/d5a 0 2024-09-06T14:44:26.496 INFO:tasks.workunit.client.1.smithi165.stdout:1/296: fdatasync d0/f59 0 2024-09-06T14:44:26.496 INFO:tasks.workunit.client.1.smithi165.stdout:0/302: mknod d15/d19/d28/d51/c64 0 2024-09-06T14:44:26.498 INFO:tasks.workunit.client.1.smithi165.stdout:8/345: chown d0/d19/d36/fb 3084705 1 2024-09-06T14:44:26.500 INFO:tasks.workunit.client.1.smithi165.stdout:7/240: read f18 [3867724,51389] 0 2024-09-06T14:44:26.500 INFO:tasks.workunit.client.1.smithi165.stdout:9/507: chown db/de/d15/d7f/d9b/d6c/f87 9511398 1 2024-09-06T14:44:26.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/329: dwrite d5/d1b/d48/f53 [0,4194304] 0 2024-09-06T14:44:26.503 INFO:tasks.workunit.client.1.smithi165.stdout:2/307: chown d9/d23/d26/c44 57 1 2024-09-06T14:44:26.504 INFO:tasks.workunit.client.1.smithi165.stdout:8/346: rmdir d0/d34 39 2024-09-06T14:44:26.507 INFO:tasks.workunit.client.1.smithi165.stdout:8/347: write d0/d19/d36/f44 [3108942,41857] 0 2024-09-06T14:44:26.507 INFO:tasks.workunit.client.1.smithi165.stdout:9/508: symlink db/de/d15/d17/d18/d59/d64/la1 0 2024-09-06T14:44:26.509 INFO:tasks.workunit.client.1.smithi165.stdout:1/297: dread d0/d2a/d1b/f58 [0,4194304] 0 2024-09-06T14:44:26.510 INFO:tasks.workunit.client.1.smithi165.stdout:2/308: creat d9/d23/d26/f5b x:0 0 0 2024-09-06T14:44:26.510 INFO:tasks.workunit.client.1.smithi165.stdout:0/303: dwrite d15/f37 [0,4194304] 0 2024-09-06T14:44:26.511 INFO:tasks.workunit.client.1.smithi165.stdout:5/334: rename d6/d1c/d28/d4b/c72 to d6/c77 0 2024-09-06T14:44:26.514 INFO:tasks.workunit.client.1.smithi165.stdout:4/330: creat d5/d1b/f74 x:0 0 0 2024-09-06T14:44:26.518 INFO:tasks.workunit.client.1.smithi165.stdout:2/309: dread d9/f1d [0,4194304] 0 2024-09-06T14:44:26.519 INFO:tasks.workunit.client.1.smithi165.stdout:7/241: rename f13 to d20/d26/d28/f4e 0 2024-09-06T14:44:26.520 INFO:tasks.workunit.client.1.smithi165.stdout:1/298: symlink d0/d2a/d23/l62 0 2024-09-06T14:44:26.523 INFO:tasks.workunit.client.1.smithi165.stdout:5/335: creat d6/d1c/d28/d4b/d60/f78 x:0 0 0 2024-09-06T14:44:26.525 INFO:tasks.workunit.client.1.smithi165.stdout:2/310: dwrite d9/d23/d26/d2d/d34/f43 [0,4194304] 0 2024-09-06T14:44:26.525 INFO:tasks.workunit.client.1.smithi165.stdout:9/509: symlink db/de/d15/d17/d72/d9e/la2 0 2024-09-06T14:44:26.528 INFO:tasks.workunit.client.1.smithi165.stdout:2/311: write d9/f1b [310591,33511] 0 2024-09-06T14:44:26.534 INFO:tasks.workunit.client.1.smithi165.stdout:1/299: dwrite d0/f59 [0,4194304] 0 2024-09-06T14:44:26.534 INFO:tasks.workunit.client.1.smithi165.stdout:9/510: mkdir db/de/d15/d17/d72/da3 0 2024-09-06T14:44:26.535 INFO:tasks.workunit.client.1.smithi165.stdout:8/348: link d0/l27 d0/d19/d36/d2d/d33/d3a/d46/d49/l7a 0 2024-09-06T14:44:26.537 INFO:tasks.workunit.client.1.smithi165.stdout:4/331: rename d5/d1b/d66/d6e to d5/d1b/d1c/d20/d75 0 2024-09-06T14:44:26.538 INFO:tasks.workunit.client.1.smithi165.stdout:7/242: rename d20/c42 to d20/c4f 0 2024-09-06T14:44:26.542 INFO:tasks.workunit.client.1.smithi165.stdout:1/300: creat d0/d2a/d18/d24/d4b/d5f/f63 x:0 0 0 2024-09-06T14:44:26.542 INFO:tasks.workunit.client.1.smithi165.stdout:6/308: dwrite d29/d32/f50 [0,4194304] 0 2024-09-06T14:44:26.544 INFO:tasks.workunit.client.1.smithi165.stdout:9/511: dread db/de/d15/d17/d18/d7d/f92 [0,4194304] 0 2024-09-06T14:44:26.544 INFO:tasks.workunit.client.1.smithi165.stdout:0/304: rename d15/d19/c1d to d15/d19/d50/c65 0 2024-09-06T14:44:26.549 INFO:tasks.workunit.client.1.smithi165.stdout:4/332: rename d5/d1b/d1c/d55/l5e to d5/d1b/d1c/d20/d26/l76 0 2024-09-06T14:44:26.551 INFO:tasks.workunit.client.1.smithi165.stdout:7/243: dwrite d20/d26/d28/d30/f31 [0,4194304] 0 2024-09-06T14:44:26.552 INFO:tasks.workunit.client.1.smithi165.stdout:4/333: chown d5/d1b/d1c/d20/f24 1926717 1 2024-09-06T14:44:26.553 INFO:tasks.workunit.client.1.smithi165.stdout:8/349: rmdir d0/d19/d36/d28/d53/d77 0 2024-09-06T14:44:26.558 INFO:tasks.workunit.client.1.smithi165.stdout:2/312: truncate d9/f1e 3438917 0 2024-09-06T14:44:26.559 INFO:tasks.workunit.client.1.smithi165.stdout:0/305: dread d15/d19/d28/d3a/f41 [0,4194304] 0 2024-09-06T14:44:26.560 INFO:tasks.workunit.client.1.smithi165.stdout:7/244: symlink d20/l50 0 2024-09-06T14:44:26.562 INFO:tasks.workunit.client.1.smithi165.stdout:7/245: read ff [4177277,83350] 0 2024-09-06T14:44:26.562 INFO:tasks.workunit.client.1.smithi165.stdout:9/512: link db/de/d15/d17/c5b db/d40/d9a/ca4 0 2024-09-06T14:44:26.564 INFO:tasks.workunit.client.1.smithi165.stdout:6/309: dread f1c [0,4194304] 0 2024-09-06T14:44:26.565 INFO:tasks.workunit.client.1.smithi165.stdout:8/350: creat d0/d19/f7b x:0 0 0 2024-09-06T14:44:26.566 INFO:tasks.workunit.client.1.smithi165.stdout:0/306: read fb [536137,98016] 0 2024-09-06T14:44:26.569 INFO:tasks.workunit.client.1.smithi165.stdout:7/246: creat d20/d40/f51 x:0 0 0 2024-09-06T14:44:26.569 INFO:tasks.workunit.client.1.smithi165.stdout:1/301: dread d0/d2a/d1b/f30 [0,4194304] 0 2024-09-06T14:44:26.571 INFO:tasks.workunit.client.1.smithi165.stdout:7/247: readlink d20/d3b/l46 0 2024-09-06T14:44:26.572 INFO:tasks.workunit.client.1.smithi165.stdout:2/313: getdents d9/d25/d45 0 2024-09-06T14:44:26.572 INFO:tasks.workunit.client.1.smithi165.stdout:6/310: dread d29/f47 [0,4194304] 0 2024-09-06T14:44:26.573 INFO:tasks.workunit.client.1.smithi165.stdout:8/351: creat d0/d34/d43/f7c x:0 0 0 2024-09-06T14:44:26.573 INFO:tasks.workunit.client.1.smithi165.stdout:6/311: chown ld 31811837 1 2024-09-06T14:44:26.575 INFO:tasks.workunit.client.1.smithi165.stdout:1/302: creat d0/d2a/d18/d24/d4b/f64 x:0 0 0 2024-09-06T14:44:26.578 INFO:tasks.workunit.client.1.smithi165.stdout:8/352: symlink d0/d14/l7d 0 2024-09-06T14:44:26.579 INFO:tasks.workunit.client.1.smithi165.stdout:9/513: truncate db/d40/f53 2631945 0 2024-09-06T14:44:26.579 INFO:tasks.workunit.client.1.smithi165.stdout:6/312: mknod d29/c5a 0 2024-09-06T14:44:26.579 INFO:tasks.workunit.client.1.smithi165.stdout:4/334: dread d5/d1b/d1c/d20/d26/f38 [0,4194304] 0 2024-09-06T14:44:26.580 INFO:tasks.workunit.client.1.smithi165.stdout:2/314: dread d9/d23/d26/f30 [0,4194304] 0 2024-09-06T14:44:26.581 INFO:tasks.workunit.client.1.smithi165.stdout:9/514: write fa [5108211,80669] 0 2024-09-06T14:44:26.581 INFO:tasks.workunit.client.1.smithi165.stdout:7/248: link f18 d20/d33/f52 0 2024-09-06T14:44:26.581 INFO:tasks.workunit.client.1.smithi165.stdout:0/307: dwrite d15/d19/d38/f5e [0,4194304] 0 2024-09-06T14:44:26.582 INFO:tasks.workunit.client.1.smithi165.stdout:4/335: chown d5/d1b/f36 13589 1 2024-09-06T14:44:26.583 INFO:tasks.workunit.client.1.smithi165.stdout:7/249: chown d20/f2b 143430 1 2024-09-06T14:44:26.584 INFO:tasks.workunit.client.1.smithi165.stdout:1/303: symlink d0/d1c/d1d/l65 0 2024-09-06T14:44:26.585 INFO:tasks.workunit.client.1.smithi165.stdout:6/313: mkdir d29/d39/d5b 0 2024-09-06T14:44:26.586 INFO:tasks.workunit.client.1.smithi165.stdout:4/336: read d5/d1b/d1c/d20/d26/f28 [183654,116057] 0 2024-09-06T14:44:26.587 INFO:tasks.workunit.client.1.smithi165.stdout:0/308: stat d15/d19/c24 0 2024-09-06T14:44:26.588 INFO:tasks.workunit.client.1.smithi165.stdout:7/250: mkdir d20/d33/d53 0 2024-09-06T14:44:26.588 INFO:tasks.workunit.client.1.smithi165.stdout:2/315: dread d9/f1b [0,4194304] 0 2024-09-06T14:44:26.589 INFO:tasks.workunit.client.1.smithi165.stdout:1/304: unlink d0/d1c/d1d/d22/l26 0 2024-09-06T14:44:26.594 INFO:tasks.workunit.client.1.smithi165.stdout:9/515: symlink db/de/d15/d17/d18/d7d/la5 0 2024-09-06T14:44:26.597 INFO:tasks.workunit.client.1.smithi165.stdout:1/305: creat d0/d2a/d23/f66 x:0 0 0 2024-09-06T14:44:26.599 INFO:tasks.workunit.client.1.smithi165.stdout:8/353: write d0/f1a [1430206,113528] 0 2024-09-06T14:44:26.601 INFO:tasks.workunit.client.1.smithi165.stdout:6/314: write f1d [46088,123099] 0 2024-09-06T14:44:26.603 INFO:tasks.workunit.client.1.smithi165.stdout:9/516: dread db/de/d15/d17/f89 [0,4194304] 0 2024-09-06T14:44:26.605 INFO:tasks.workunit.client.1.smithi165.stdout:6/315: creat d29/f5c x:0 0 0 2024-09-06T14:44:26.607 INFO:tasks.workunit.client.1.smithi165.stdout:2/316: dwrite d9/d23/d26/f30 [0,4194304] 0 2024-09-06T14:44:26.607 INFO:tasks.workunit.client.1.smithi165.stdout:8/354: creat d0/d19/d36/d2d/d33/d3a/d46/f7e x:0 0 0 2024-09-06T14:44:26.607 INFO:tasks.workunit.client.1.smithi165.stdout:9/517: fdatasync db/de/d16/f6b 0 2024-09-06T14:44:26.609 INFO:tasks.workunit.client.1.smithi165.stdout:4/337: dread d5/fc [0,4194304] 0 2024-09-06T14:44:26.610 INFO:tasks.workunit.client.1.smithi165.stdout:2/317: chown d9/d23/l50 210 1 2024-09-06T14:44:26.610 INFO:tasks.workunit.client.1.smithi165.stdout:9/518: chown db/de/d15/d17/d72 1 1 2024-09-06T14:44:26.613 INFO:tasks.workunit.client.1.smithi165.stdout:7/251: dwrite d20/d33/f52 [0,4194304] 0 2024-09-06T14:44:26.616 INFO:tasks.workunit.client.1.smithi165.stdout:2/318: mknod d9/d23/d29/d48/c5c 0 2024-09-06T14:44:26.619 INFO:tasks.workunit.client.1.smithi165.stdout:4/338: mkdir d5/d1b/d61/d77 0 2024-09-06T14:44:26.621 INFO:tasks.workunit.client.1.smithi165.stdout:6/316: getdents d29 0 2024-09-06T14:44:26.621 INFO:tasks.workunit.client.1.smithi165.stdout:8/355: dwrite d0/d19/d36/d2d/f38 [4194304,4194304] 0 2024-09-06T14:44:26.624 INFO:tasks.workunit.client.1.smithi165.stdout:7/252: mkdir d20/d4d/d54 0 2024-09-06T14:44:26.625 INFO:tasks.workunit.client.1.smithi165.stdout:9/519: dwrite db/de/d15/d17/d18/f5d [0,4194304] 0 2024-09-06T14:44:26.625 INFO:tasks.workunit.client.1.smithi165.stdout:2/319: mknod d9/d25/d46/c5d 0 2024-09-06T14:44:26.626 INFO:tasks.workunit.client.1.smithi165.stdout:4/339: unlink d5/d1b/d1c/c5c 0 2024-09-06T14:44:26.628 INFO:tasks.workunit.client.1.smithi165.stdout:8/356: rmdir d0/d19 39 2024-09-06T14:44:26.630 INFO:tasks.workunit.client.1.smithi165.stdout:9/520: chown db/de/d15/d17/c5b 69 1 2024-09-06T14:44:26.631 INFO:tasks.workunit.client.1.smithi165.stdout:7/253: creat d20/d33/d53/f55 x:0 0 0 2024-09-06T14:44:26.633 INFO:tasks.workunit.client.1.smithi165.stdout:7/254: write d20/d26/f2d [908296,1183] 0 2024-09-06T14:44:26.634 INFO:tasks.workunit.client.1.smithi165.stdout:2/320: link d9/f1a d9/d4f/f5e 0 2024-09-06T14:44:26.635 INFO:tasks.workunit.client.1.smithi165.stdout:6/317: dwrite f1e [0,4194304] 0 2024-09-06T14:44:26.637 INFO:tasks.workunit.client.1.smithi165.stdout:4/340: mkdir d5/d1b/d1c/d78 0 2024-09-06T14:44:26.638 INFO:tasks.workunit.client.1.smithi165.stdout:7/255: symlink d20/d3b/l56 0 2024-09-06T14:44:26.642 INFO:tasks.workunit.client.1.smithi165.stdout:4/341: fsync d5/d1b/d48/f62 0 2024-09-06T14:44:26.643 INFO:tasks.workunit.client.1.smithi165.stdout:7/256: creat d20/d33/d53/f57 x:0 0 0 2024-09-06T14:44:26.643 INFO:tasks.workunit.client.1.smithi165.stdout:8/357: rename d0/d19/d73 to d0/d19/d7f 0 2024-09-06T14:44:26.643 INFO:tasks.workunit.client.1.smithi165.stdout:9/521: dwrite db/de/d15/d17/f47 [4194304,4194304] 0 2024-09-06T14:44:26.644 INFO:tasks.workunit.client.1.smithi165.stdout:6/318: rename d29/d32/l53 to d29/l5d 0 2024-09-06T14:44:26.649 INFO:tasks.workunit.client.1.smithi165.stdout:4/342: mknod d5/d1b/d61/c79 0 2024-09-06T14:44:26.650 INFO:tasks.workunit.client.1.smithi165.stdout:4/343: stat d5/le 0 2024-09-06T14:44:26.652 INFO:tasks.workunit.client.1.smithi165.stdout:6/319: creat d29/d32/f5e x:0 0 0 2024-09-06T14:44:26.652 INFO:tasks.workunit.client.1.smithi165.stdout:6/320: chown f28 7100953 1 2024-09-06T14:44:26.653 INFO:tasks.workunit.client.1.smithi165.stdout:9/522: write db/de/d15/d17/f89 [1641615,109473] 0 2024-09-06T14:44:26.653 INFO:tasks.workunit.client.1.smithi165.stdout:8/358: mknod d0/d34/d6b/c80 0 2024-09-06T14:44:26.654 INFO:tasks.workunit.client.1.smithi165.stdout:7/257: truncate f1f 958391 0 2024-09-06T14:44:26.655 INFO:tasks.workunit.client.1.smithi165.stdout:4/344: truncate d5/f50 10534 0 2024-09-06T14:44:26.655 INFO:tasks.workunit.client.1.smithi165.stdout:8/359: dread - d0/d19/d36/d2d/d33/d3a/f55 zero size 2024-09-06T14:44:26.656 INFO:tasks.workunit.client.1.smithi165.stdout:2/321: write d9/d25/d45/f51 [620602,3990] 0 2024-09-06T14:44:26.656 INFO:tasks.workunit.client.1.smithi165.stdout:6/321: mknod d29/d39/d5b/c5f 0 2024-09-06T14:44:26.659 INFO:tasks.workunit.client.1.smithi165.stdout:6/322: chown d29/f41 2 1 2024-09-06T14:44:26.662 INFO:tasks.workunit.client.1.smithi165.stdout:6/323: chown c11 2116 1 2024-09-06T14:44:26.663 INFO:tasks.workunit.client.1.smithi165.stdout:4/345: dread d5/d1b/d1c/f57 [0,4194304] 0 2024-09-06T14:44:26.663 INFO:tasks.workunit.client.1.smithi165.stdout:6/324: dread - d29/d32/f5e zero size 2024-09-06T14:44:26.665 INFO:tasks.workunit.client.1.smithi165.stdout:2/322: rename d9/d25/c3e to d9/d23/d26/d2d/c5f 0 2024-09-06T14:44:26.665 INFO:tasks.workunit.client.1.smithi165.stdout:7/258: dwrite d20/d26/d28/d30/f36 [0,4194304] 0 2024-09-06T14:44:26.666 INFO:tasks.workunit.client.1.smithi165.stdout:7/259: write f12 [5293214,105010] 0 2024-09-06T14:44:26.667 INFO:tasks.workunit.client.1.smithi165.stdout:4/346: creat d5/d1b/d61/f7a x:0 0 0 2024-09-06T14:44:26.668 INFO:tasks.workunit.client.1.smithi165.stdout:7/260: write d20/d26/f2d [1290446,49133] 0 2024-09-06T14:44:26.669 INFO:tasks.workunit.client.1.smithi165.stdout:6/325: unlink c23 0 2024-09-06T14:44:26.671 INFO:tasks.workunit.client.1.smithi165.stdout:7/261: fsync d20/d33/d53/f57 0 2024-09-06T14:44:26.676 INFO:tasks.workunit.client.1.smithi165.stdout:2/323: dwrite d9/d25/d45/f51 [0,4194304] 0 2024-09-06T14:44:26.676 INFO:tasks.workunit.client.1.smithi165.stdout:6/326: unlink d29/d32/c3b 0 2024-09-06T14:44:26.676 INFO:tasks.workunit.client.1.smithi165.stdout:4/347: creat d5/d1b/d1c/d78/f7b x:0 0 0 2024-09-06T14:44:26.680 INFO:tasks.workunit.client.1.smithi165.stdout:2/324: dread d9/f17 [0,4194304] 0 2024-09-06T14:44:26.682 INFO:tasks.workunit.client.1.smithi165.stdout:2/325: chown d9/d25/f33 958 1 2024-09-06T14:44:26.682 INFO:tasks.workunit.client.1.smithi165.stdout:8/360: dwrite d0/d14/f2b [0,4194304] 0 2024-09-06T14:44:26.682 INFO:tasks.workunit.client.1.smithi165.stdout:6/327: rename c9 to d29/d39/c60 0 2024-09-06T14:44:26.684 INFO:tasks.workunit.client.1.smithi165.stdout:8/361: stat d0/d19/d24/d26/f6f 0 2024-09-06T14:44:26.684 INFO:tasks.workunit.client.1.smithi165.stdout:6/328: write d29/f30 [14467,81366] 0 2024-09-06T14:44:26.685 INFO:tasks.workunit.client.1.smithi165.stdout:4/348: mkdir d5/d1b/d61/d77/d7c 0 2024-09-06T14:44:26.730 INFO:tasks.workunit.client.1.smithi165.stdout:8/362: read d0/f6 [1614440,71360] 0 2024-09-06T14:44:26.730 INFO:tasks.workunit.client.1.smithi165.stdout:7/262: truncate d20/d26/f2d 709424 0 2024-09-06T14:44:26.731 INFO:tasks.workunit.client.1.smithi165.stdout:6/329: creat d29/d32/f61 x:0 0 0 2024-09-06T14:44:26.731 INFO:tasks.workunit.client.1.smithi165.stdout:4/349: mkdir d5/d1b/d1c/d55/d7d 0 2024-09-06T14:44:26.734 INFO:tasks.workunit.client.1.smithi165.stdout:7/263: unlink d20/d3b/l56 0 2024-09-06T14:44:26.737 INFO:tasks.workunit.client.1.smithi165.stdout:7/264: fdatasync d20/d26/d28/d30/f31 0 2024-09-06T14:44:26.739 INFO:tasks.workunit.client.1.smithi165.stdout:4/350: truncate d5/f2b 878837 0 2024-09-06T14:44:26.741 INFO:tasks.workunit.client.1.smithi165.stdout:7/265: write f1d [4113166,57593] 0 2024-09-06T14:44:26.742 INFO:tasks.workunit.client.1.smithi165.stdout:4/351: read - d5/f5a zero size 2024-09-06T14:44:26.742 INFO:tasks.workunit.client.1.smithi165.stdout:6/330: dwrite d29/f49 [0,4194304] 0 2024-09-06T14:44:26.742 INFO:tasks.workunit.client.1.smithi165.stdout:8/363: dwrite d0/d19/d36/f2e [0,4194304] 0 2024-09-06T14:44:26.745 INFO:tasks.workunit.client.1.smithi165.stdout:2/326: dread d9/d23/f28 [0,4194304] 0 2024-09-06T14:44:26.745 INFO:tasks.workunit.client.1.smithi165.stdout:4/352: readlink d5/d1b/d1c/l37 0 2024-09-06T14:44:26.747 INFO:tasks.workunit.client.1.smithi165.stdout:7/266: creat d20/d26/d28/f58 x:0 0 0 2024-09-06T14:44:26.748 INFO:tasks.workunit.client.1.smithi165.stdout:7/267: readlink l1a 0 2024-09-06T14:44:26.748 INFO:tasks.workunit.client.1.smithi165.stdout:6/331: mkdir d29/d39/d5b/d62 0 2024-09-06T14:44:26.749 INFO:tasks.workunit.client.1.smithi165.stdout:8/364: mknod d0/d19/d24/c81 0 2024-09-06T14:44:26.750 INFO:tasks.workunit.client.1.smithi165.stdout:7/268: write d20/d26/f34 [1040889,86652] 0 2024-09-06T14:44:26.753 INFO:tasks.workunit.client.1.smithi165.stdout:6/332: truncate f25 654539 0 2024-09-06T14:44:26.753 INFO:tasks.workunit.client.1.smithi165.stdout:6/333: chown d29 1791 1 2024-09-06T14:44:26.754 INFO:tasks.workunit.client.1.smithi165.stdout:2/327: dread d9/d23/d26/d2d/d34/f43 [0,4194304] 0 2024-09-06T14:44:26.754 INFO:tasks.workunit.client.1.smithi165.stdout:8/365: creat d0/d19/d7f/f82 x:0 0 0 2024-09-06T14:44:26.756 INFO:tasks.workunit.client.1.smithi165.stdout:4/353: rename d5/d1b/d66/l70 to d5/d1b/d1c/d55/d7d/l7e 0 2024-09-06T14:44:26.758 INFO:tasks.workunit.client.1.smithi165.stdout:8/366: mknod d0/d34/d43/d68/c83 0 2024-09-06T14:44:26.760 INFO:tasks.workunit.client.1.smithi165.stdout:7/269: link d20/l50 d20/d3b/l59 0 2024-09-06T14:44:26.761 INFO:tasks.workunit.client.1.smithi165.stdout:2/328: rmdir d9/d5a 0 2024-09-06T14:44:26.763 INFO:tasks.workunit.client.1.smithi165.stdout:8/367: truncate d0/d19/d36/d2d/d33/f4c 1041892 0 2024-09-06T14:44:26.763 INFO:tasks.workunit.client.1.smithi165.stdout:6/334: getdents d29/d39/d5b 0 2024-09-06T14:44:26.765 INFO:tasks.workunit.client.1.smithi165.stdout:7/270: mknod d20/d40/c5a 0 2024-09-06T14:44:26.767 INFO:tasks.workunit.client.1.smithi165.stdout:4/354: dwrite d5/d1b/f49 [0,4194304] 0 2024-09-06T14:44:26.767 INFO:tasks.workunit.client.1.smithi165.stdout:7/271: write f12 [1950685,58110] 0 2024-09-06T14:44:26.767 INFO:tasks.workunit.client.1.smithi165.stdout:2/329: rename d9/d3b/c3f to d9/d23/d29/c60 0 2024-09-06T14:44:26.768 INFO:tasks.workunit.client.1.smithi165.stdout:8/368: mkdir d0/d19/d36/d2d/d33/d84 0 2024-09-06T14:44:26.769 INFO:tasks.workunit.client.1.smithi165.stdout:7/272: write d20/d33/f52 [1016579,101152] 0 2024-09-06T14:44:26.770 INFO:tasks.workunit.client.1.smithi165.stdout:7/273: readlink d20/l35 0 2024-09-06T14:44:26.770 INFO:tasks.workunit.client.1.smithi165.stdout:6/335: mknod d29/d39/d5b/c63 0 2024-09-06T14:44:26.771 INFO:tasks.workunit.client.1.smithi165.stdout:7/274: chown d20/d33/d53/f55 75 1 2024-09-06T14:44:26.772 INFO:tasks.workunit.client.1.smithi165.stdout:2/330: creat d9/d25/f61 x:0 0 0 2024-09-06T14:44:26.774 INFO:tasks.workunit.client.1.smithi165.stdout:4/355: rename d5/d1b/d48/f69 to d5/d1b/d66/f7f 0 2024-09-06T14:44:26.791 INFO:tasks.workunit.client.1.smithi165.stdout:7/275: symlink d20/d26/d28/l5b 0 2024-09-06T14:44:26.791 INFO:tasks.workunit.client.1.smithi165.stdout:7/276: fdatasync d20/d33/d53/f55 0 2024-09-06T14:44:26.792 INFO:tasks.workunit.client.1.smithi165.stdout:2/331: creat d9/d23/d29/d48/f62 x:0 0 0 2024-09-06T14:44:26.793 INFO:tasks.workunit.client.1.smithi165.stdout:7/277: chown d20/d26/d28/d30/f31 0 1 2024-09-06T14:44:26.794 INFO:tasks.workunit.client.1.smithi165.stdout:7/278: truncate d20/d26/f34 1646172 0 2024-09-06T14:44:26.795 INFO:tasks.workunit.client.1.smithi165.stdout:8/369: symlink d0/d19/d36/d28/d64/l85 0 2024-09-06T14:44:26.799 INFO:tasks.workunit.client.1.smithi165.stdout:2/332: unlink d9/d23/l59 0 2024-09-06T14:44:26.800 INFO:tasks.workunit.client.1.smithi165.stdout:4/356: link d5/d1b/f36 d5/d1b/d1c/d41/f80 0 2024-09-06T14:44:26.803 INFO:tasks.workunit.client.1.smithi165.stdout:8/370: dwrite d0/d19/d36/d28/f3d [0,4194304] 0 2024-09-06T14:44:26.805 INFO:tasks.workunit.client.1.smithi165.stdout:8/371: fdatasync d0/d19/d7f/f82 0 2024-09-06T14:44:26.805 INFO:tasks.workunit.client.1.smithi165.stdout:4/357: rmdir d5/d1b/d61 39 2024-09-06T14:44:26.806 INFO:tasks.workunit.client.1.smithi165.stdout:8/372: stat d0/d19/d24/f37 0 2024-09-06T14:44:26.807 INFO:tasks.workunit.client.1.smithi165.stdout:3/331: sync 2024-09-06T14:44:26.807 INFO:tasks.workunit.client.1.smithi165.stdout:4/358: write d5/d1b/d1c/d55/f68 [1028728,68795] 0 2024-09-06T14:44:26.809 INFO:tasks.workunit.client.1.smithi165.stdout:3/332: write d1/da/dd/f2c [3253426,19661] 0 2024-09-06T14:44:26.814 INFO:tasks.workunit.client.1.smithi165.stdout:4/359: unlink d5/d1b/f63 0 2024-09-06T14:44:26.816 INFO:tasks.workunit.client.1.smithi165.stdout:8/373: link d0/d19/d24/d26/f6f d0/d19/f86 0 2024-09-06T14:44:26.817 INFO:tasks.workunit.client.1.smithi165.stdout:3/333: symlink d1/da/dc/d5d/l6d 0 2024-09-06T14:44:26.819 INFO:tasks.workunit.client.1.smithi165.stdout:8/374: symlink d0/d19/d36/d28/d53/l87 0 2024-09-06T14:44:26.820 INFO:tasks.workunit.client.1.smithi165.stdout:4/360: write d5/d1b/d1c/d20/d26/f38 [2291595,51283] 0 2024-09-06T14:44:26.823 INFO:tasks.workunit.client.1.smithi165.stdout:3/334: rmdir d1/d66 0 2024-09-06T14:44:26.825 INFO:tasks.workunit.client.1.smithi165.stdout:4/361: readlink d5/d1b/d1c/d55/d7d/l7e 0 2024-09-06T14:44:26.826 INFO:tasks.workunit.client.1.smithi165.stdout:3/335: creat d1/da/dd/d4b/f6e x:0 0 0 2024-09-06T14:44:26.828 INFO:tasks.workunit.client.1.smithi165.stdout:3/336: dread - d1/f37 zero size 2024-09-06T14:44:26.828 INFO:tasks.workunit.client.1.smithi165.stdout:4/362: symlink d5/d1b/d1c/d78/l81 0 2024-09-06T14:44:26.830 INFO:tasks.workunit.client.1.smithi165.stdout:4/363: creat d5/d1b/d61/f82 x:0 0 0 2024-09-06T14:44:26.835 INFO:tasks.workunit.client.1.smithi165.stdout:6/336: truncate f16 1199799 0 2024-09-06T14:44:26.835 INFO:tasks.workunit.client.1.smithi165.stdout:3/337: dwrite d1/d19/f29 [0,4194304] 0 2024-09-06T14:44:26.836 INFO:tasks.workunit.client.1.smithi165.stdout:6/337: stat d29/d32/c3c 0 2024-09-06T14:44:26.838 INFO:tasks.workunit.client.1.smithi165.stdout:3/338: symlink d1/l6f 0 2024-09-06T14:44:26.850 INFO:tasks.workunit.client.1.smithi165.stdout:6/338: dwrite f22 [0,4194304] 0 2024-09-06T14:44:26.852 INFO:tasks.workunit.client.1.smithi165.stdout:7/279: dwrite f1f [0,4194304] 0 2024-09-06T14:44:26.853 INFO:tasks.workunit.client.1.smithi165.stdout:2/333: dwrite d9/f1a [0,4194304] 0 2024-09-06T14:44:26.860 INFO:tasks.workunit.client.1.smithi165.stdout:6/339: creat d29/d39/f64 x:0 0 0 2024-09-06T14:44:26.863 INFO:tasks.workunit.client.1.smithi165.stdout:2/334: creat d9/d25/d45/f63 x:0 0 0 2024-09-06T14:44:26.863 INFO:tasks.workunit.client.1.smithi165.stdout:6/340: read d29/f35 [6774467,28408] 0 2024-09-06T14:44:26.864 INFO:tasks.workunit.client.1.smithi165.stdout:8/375: dwrite d0/d19/d36/d2d/d3f/f4e [0,4194304] 0 2024-09-06T14:44:26.864 INFO:tasks.workunit.client.1.smithi165.stdout:7/280: write d20/f48 [4754615,76660] 0 2024-09-06T14:44:26.865 INFO:tasks.workunit.client.1.smithi165.stdout:3/339: mknod d1/da/c70 0 2024-09-06T14:44:26.869 INFO:tasks.workunit.client.1.smithi165.stdout:2/335: mknod d9/c64 0 2024-09-06T14:44:26.870 INFO:tasks.workunit.client.1.smithi165.stdout:8/376: stat d0/d19/d36/d2d/d33/d3a/d46/d49 0 2024-09-06T14:44:26.872 INFO:tasks.workunit.client.1.smithi165.stdout:8/377: chown d0/d19/d36/d2d/d3f/f4e 25478 1 2024-09-06T14:44:26.872 INFO:tasks.workunit.client.1.smithi165.stdout:7/281: link f12 d20/d40/f5c 0 2024-09-06T14:44:26.874 INFO:tasks.workunit.client.1.smithi165.stdout:8/378: write d0/d19/d36/d28/f6a [524360,32511] 0 2024-09-06T14:44:26.876 INFO:tasks.workunit.client.1.smithi165.stdout:3/340: dread d1/da/dd/f61 [0,4194304] 0 2024-09-06T14:44:26.881 INFO:tasks.workunit.client.1.smithi165.stdout:8/379: creat d0/d34/d43/d70/f88 x:0 0 0 2024-09-06T14:44:26.881 INFO:tasks.workunit.client.1.smithi165.stdout:6/341: dread f3 [0,4194304] 0 2024-09-06T14:44:26.881 INFO:tasks.workunit.client.1.smithi165.stdout:3/341: chown d1/da/dc/d10/l6b 7780174 1 2024-09-06T14:44:26.882 INFO:tasks.workunit.client.1.smithi165.stdout:7/282: dwrite d20/f2b [0,4194304] 0 2024-09-06T14:44:26.885 INFO:tasks.workunit.client.1.smithi165.stdout:3/342: mkdir d1/da/dc/d3b/d71 0 2024-09-06T14:44:26.888 INFO:tasks.workunit.client.1.smithi165.stdout:7/283: dread d20/d33/f52 [0,4194304] 0 2024-09-06T14:44:26.889 INFO:tasks.workunit.client.1.smithi165.stdout:8/380: link d0/d34/d43/l4d d0/d34/l89 0 2024-09-06T14:44:26.894 INFO:tasks.workunit.client.1.smithi165.stdout:8/381: mknod d0/d19/d36/d2d/d33/d84/c8a 0 2024-09-06T14:44:26.898 INFO:tasks.workunit.client.1.smithi165.stdout:7/284: dread d20/d26/f2d [0,4194304] 0 2024-09-06T14:44:26.900 INFO:tasks.workunit.client.1.smithi165.stdout:8/382: creat d0/d19/d36/d2d/d3f/f8b x:0 0 0 2024-09-06T14:44:26.904 INFO:tasks.workunit.client.1.smithi165.stdout:2/336: dwrite d9/f17 [0,4194304] 0 2024-09-06T14:44:26.904 INFO:tasks.workunit.client.1.smithi165.stdout:8/383: stat d0/d19/d24/d26/f6f 0 2024-09-06T14:44:26.905 INFO:tasks.workunit.client.1.smithi165.stdout:7/285: rename d20/d40/f5c to d20/d26/d28/f5d 0 2024-09-06T14:44:26.907 INFO:tasks.workunit.client.1.smithi165.stdout:6/342: dwrite d29/f36 [0,4194304] 0 2024-09-06T14:44:26.907 INFO:tasks.workunit.client.1.smithi165.stdout:3/343: dwrite d1/da/dd/fe [0,4194304] 0 2024-09-06T14:44:26.909 INFO:tasks.workunit.client.1.smithi165.stdout:2/337: write d9/d25/f61 [957468,124578] 0 2024-09-06T14:44:26.911 INFO:tasks.workunit.client.1.smithi165.stdout:8/384: read d0/d19/d36/d2d/d3f/f4e [3695417,123643] 0 2024-09-06T14:44:26.911 INFO:tasks.workunit.client.1.smithi165.stdout:6/343: unlink d29/d39/d5b/c5f 0 2024-09-06T14:44:26.913 INFO:tasks.workunit.client.1.smithi165.stdout:7/286: rename d20/c23 to d20/d3b/c5e 0 2024-09-06T14:44:26.913 INFO:tasks.workunit.client.1.smithi165.stdout:6/344: dread - d29/d39/f64 zero size 2024-09-06T14:44:26.913 INFO:tasks.workunit.client.1.smithi165.stdout:8/385: mkdir d0/d14/d50/d8c 0 2024-09-06T14:44:26.918 INFO:tasks.workunit.client.1.smithi165.stdout:3/344: rename d1/da/dc/d5d/l6d to d1/da/dc/d3b/d71/l72 0 2024-09-06T14:44:26.919 INFO:tasks.workunit.client.1.smithi165.stdout:8/386: chown d0/d14/d3e/l5d 7775931 1 2024-09-06T14:44:26.921 INFO:tasks.workunit.client.1.smithi165.stdout:8/387: write d0/d19/d36/d2d/d33/f4c [281205,21930] 0 2024-09-06T14:44:26.921 INFO:tasks.workunit.client.1.smithi165.stdout:3/345: readlink d1/da/dc/d3b/l48 0 2024-09-06T14:44:26.922 INFO:tasks.workunit.client.1.smithi165.stdout:6/345: creat d29/d39/d5b/d62/f65 x:0 0 0 2024-09-06T14:44:26.922 INFO:tasks.workunit.client.1.smithi165.stdout:8/388: write d0/d19/d36/d28/f6a [785688,20168] 0 2024-09-06T14:44:26.924 INFO:tasks.workunit.client.1.smithi165.stdout:2/338: getdents d9/d4f 0 2024-09-06T14:44:26.925 INFO:tasks.workunit.client.1.smithi165.stdout:3/346: symlink d1/l73 0 2024-09-06T14:44:26.926 INFO:tasks.workunit.client.1.smithi165.stdout:6/346: unlink d29/d39/f44 0 2024-09-06T14:44:26.927 INFO:tasks.workunit.client.1.smithi165.stdout:2/339: rename d9/d25/d45/c4c to d9/d23/d26/c65 0 2024-09-06T14:44:26.928 INFO:tasks.workunit.client.1.smithi165.stdout:3/347: creat d1/da/dd/d4b/f74 x:0 0 0 2024-09-06T14:44:26.928 INFO:tasks.workunit.client.1.smithi165.stdout:6/347: write d29/d39/f64 [395289,74708] 0 2024-09-06T14:44:26.933 INFO:tasks.workunit.client.1.smithi165.stdout:8/389: dwrite d0/d19/f7b [0,4194304] 0 2024-09-06T14:44:26.939 INFO:tasks.workunit.client.1.smithi165.stdout:3/348: dwrite d1/da/f2f [0,4194304] 0 2024-09-06T14:44:26.940 INFO:tasks.workunit.client.1.smithi165.stdout:7/287: truncate d20/d26/d28/d30/f36 1133362 0 2024-09-06T14:44:26.942 INFO:tasks.workunit.client.1.smithi165.stdout:7/288: fdatasync d20/f2b 0 2024-09-06T14:44:26.943 INFO:tasks.workunit.client.1.smithi165.stdout:5/336: sync 2024-09-06T14:44:26.943 INFO:tasks.workunit.client.1.smithi165.stdout:9/523: sync 2024-09-06T14:44:26.943 INFO:tasks.workunit.client.1.smithi165.stdout:0/309: sync 2024-09-06T14:44:26.944 INFO:tasks.workunit.client.1.smithi165.stdout:1/306: sync 2024-09-06T14:44:26.947 INFO:tasks.workunit.client.1.smithi165.stdout:7/289: mknod d20/d40/c5f 0 2024-09-06T14:44:26.948 INFO:tasks.workunit.client.1.smithi165.stdout:0/310: dread - d15/f43 zero size 2024-09-06T14:44:26.950 INFO:tasks.workunit.client.1.smithi165.stdout:8/390: dwrite d0/d19/d36/d2d/d33/d3a/f55 [0,4194304] 0 2024-09-06T14:44:26.952 INFO:tasks.workunit.client.1.smithi165.stdout:7/290: stat d20/l38 0 2024-09-06T14:44:26.954 INFO:tasks.workunit.client.1.smithi165.stdout:1/307: truncate d0/d1c/d40/f4d 1001658 0 2024-09-06T14:44:26.959 INFO:tasks.workunit.client.1.smithi165.stdout:3/349: dwrite d1/d19/f27 [0,4194304] 0 2024-09-06T14:44:26.961 INFO:tasks.workunit.client.1.smithi165.stdout:1/308: write d0/d2a/d18/f43 [748753,53083] 0 2024-09-06T14:44:26.962 INFO:tasks.workunit.client.1.smithi165.stdout:5/337: rename d6/d1c/d28/f3b to d6/d1c/d28/d2d/d61/f79 0 2024-09-06T14:44:26.964 INFO:tasks.workunit.client.1.smithi165.stdout:7/291: truncate f17 4772000 0 2024-09-06T14:44:26.964 INFO:tasks.workunit.client.1.smithi165.stdout:3/350: truncate d1/f69 893618 0 2024-09-06T14:44:26.965 INFO:tasks.workunit.client.1.smithi165.stdout:6/348: dwrite d29/f35 [4194304,4194304] 0 2024-09-06T14:44:26.968 INFO:tasks.workunit.client.1.smithi165.stdout:1/309: creat d0/d2a/d18/f67 x:0 0 0 2024-09-06T14:44:26.968 INFO:tasks.workunit.client.1.smithi165.stdout:0/311: dread d15/f37 [0,4194304] 0 2024-09-06T14:44:26.968 INFO:tasks.workunit.client.1.smithi165.stdout:3/351: rmdir d1/d41 39 2024-09-06T14:44:26.969 INFO:tasks.workunit.client.1.smithi165.stdout:8/391: write d0/fd [535493,14367] 0 2024-09-06T14:44:26.971 INFO:tasks.workunit.client.1.smithi165.stdout:0/312: chown d15/f37 0 1 2024-09-06T14:44:26.971 INFO:tasks.workunit.client.1.smithi165.stdout:9/524: truncate db/de/d15/f48 3925922 0 2024-09-06T14:44:26.972 INFO:tasks.workunit.client.1.smithi165.stdout:5/338: symlink d6/d1c/d28/d4b/l7a 0 2024-09-06T14:44:26.974 INFO:tasks.workunit.client.1.smithi165.stdout:3/352: truncate d1/da/dc/f2e 763101 0 2024-09-06T14:44:26.974 INFO:tasks.workunit.client.1.smithi165.stdout:0/313: write f8 [2403109,20909] 0 2024-09-06T14:44:26.975 INFO:tasks.workunit.client.1.smithi165.stdout:6/349: link d29/f36 d29/f66 0 2024-09-06T14:44:26.976 INFO:tasks.workunit.client.1.smithi165.stdout:1/310: mkdir d0/d2a/d1b/d68 0 2024-09-06T14:44:26.977 INFO:tasks.workunit.client.1.smithi165.stdout:8/392: symlink d0/d14/d3e/l8d 0 2024-09-06T14:44:26.977 INFO:tasks.workunit.client.1.smithi165.stdout:6/350: fsync f22 0 2024-09-06T14:44:26.978 INFO:tasks.workunit.client.1.smithi165.stdout:5/339: dread d6/d1c/d28/f43 [0,4194304] 0 2024-09-06T14:44:26.982 INFO:tasks.workunit.client.1.smithi165.stdout:9/525: creat db/de/d15/d17/d18/d59/d64/d99/d97/fa6 x:0 0 0 2024-09-06T14:44:26.984 INFO:tasks.workunit.client.1.smithi165.stdout:7/292: dwrite d20/d26/d28/d30/f39 [0,4194304] 0 2024-09-06T14:44:26.985 INFO:tasks.workunit.client.1.smithi165.stdout:0/314: mkdir d15/d19/d66 0 2024-09-06T14:44:26.985 INFO:tasks.workunit.client.1.smithi165.stdout:7/293: fdatasync f15 0 2024-09-06T14:44:26.988 INFO:tasks.workunit.client.1.smithi165.stdout:1/311: dread d0/d2a/fb [4194304,4194304] 0 2024-09-06T14:44:26.992 INFO:tasks.workunit.client.1.smithi165.stdout:0/315: chown d15/d19/d2c/f45 1163836962 1 2024-09-06T14:44:26.993 INFO:tasks.workunit.client.1.smithi165.stdout:7/294: mknod d20/d33/c60 0 2024-09-06T14:44:26.994 INFO:tasks.workunit.client.1.smithi165.stdout:6/351: dwrite d29/f47 [0,4194304] 0 2024-09-06T14:44:26.996 INFO:tasks.workunit.client.1.smithi165.stdout:9/526: fsync db/de/d15/f69 0 2024-09-06T14:44:26.998 INFO:tasks.workunit.client.1.smithi165.stdout:1/312: write d0/d2a/d1b/d2b/f4a [5148020,55299] 0 2024-09-06T14:44:26.999 INFO:tasks.workunit.client.1.smithi165.stdout:7/295: creat d20/d26/f61 x:0 0 0 2024-09-06T14:44:27.000 INFO:tasks.workunit.client.1.smithi165.stdout:9/527: write db/de/d16/d2e/f3b [4482677,129829] 0 2024-09-06T14:44:27.002 INFO:tasks.workunit.client.1.smithi165.stdout:6/352: mkdir d29/d39/d5b/d62/d67 0 2024-09-06T14:44:27.004 INFO:tasks.workunit.client.1.smithi165.stdout:3/353: truncate d1/d4a/f55 674199 0 2024-09-06T14:44:27.007 INFO:tasks.workunit.client.1.smithi165.stdout:5/340: truncate d6/d1c/d28/f2e 93085 0 2024-09-06T14:44:27.008 INFO:tasks.workunit.client.1.smithi165.stdout:8/393: getdents d0/d19/d36/d2d/d33/d84 0 2024-09-06T14:44:27.008 INFO:tasks.workunit.client.1.smithi165.stdout:1/313: mkdir d0/d2a/d1b/d2b/d3e/d69 0 2024-09-06T14:44:27.012 INFO:tasks.workunit.client.1.smithi165.stdout:0/316: creat d15/d19/d28/f67 x:0 0 0 2024-09-06T14:44:27.012 INFO:tasks.workunit.client.1.smithi165.stdout:7/296: dwrite d20/d3b/f3f [0,4194304] 0 2024-09-06T14:44:27.012 INFO:tasks.workunit.client.1.smithi165.stdout:9/528: dwrite db/de/d15/d17/f45 [4194304,4194304] 0 2024-09-06T14:44:27.014 INFO:tasks.workunit.client.1.smithi165.stdout:3/354: mknod d1/da/c75 0 2024-09-06T14:44:27.016 INFO:tasks.workunit.client.1.smithi165.stdout:3/355: chown d1/da/f26 11796 1 2024-09-06T14:44:27.017 INFO:tasks.workunit.client.1.smithi165.stdout:1/314: mkdir d0/d2a/d1b/d6a 0 2024-09-06T14:44:27.021 INFO:tasks.workunit.client.1.smithi165.stdout:9/529: mkdir db/de/d16/d2e/da7 0 2024-09-06T14:44:27.028 INFO:tasks.workunit.client.1.smithi165.stdout:6/353: getdents d29/d39 0 2024-09-06T14:44:27.028 INFO:tasks.workunit.client.1.smithi165.stdout:0/317: dwrite d15/d19/d38/f4c [0,4194304] 0 2024-09-06T14:44:27.032 INFO:tasks.workunit.client.1.smithi165.stdout:0/318: write d15/f5a [364960,71537] 0 2024-09-06T14:44:27.033 INFO:tasks.workunit.client.1.smithi165.stdout:7/297: dwrite d20/f21 [0,4194304] 0 2024-09-06T14:44:27.033 INFO:tasks.workunit.client.1.smithi165.stdout:5/341: link d6/lb d6/d1c/d28/d2d/d61/l7b 0 2024-09-06T14:44:27.035 INFO:tasks.workunit.client.1.smithi165.stdout:1/315: dwrite d0/d2a/d1b/f30 [0,4194304] 0 2024-09-06T14:44:27.035 INFO:tasks.workunit.client.1.smithi165.stdout:9/530: fdatasync db/de/d15/d17/d18/d7d/f5f 0 2024-09-06T14:44:27.036 INFO:tasks.workunit.client.1.smithi165.stdout:6/354: unlink d29/f30 0 2024-09-06T14:44:27.046 INFO:tasks.workunit.client.1.smithi165.stdout:7/298: mknod d20/d33/d53/c62 0 2024-09-06T14:44:27.046 INFO:tasks.workunit.client.1.smithi165.stdout:8/394: truncate d0/d14/d3e/f4b 927877 0 2024-09-06T14:44:27.047 INFO:tasks.workunit.client.1.smithi165.stdout:5/342: mkdir d6/d1c/d7c 0 2024-09-06T14:44:27.049 INFO:tasks.workunit.client.1.smithi165.stdout:1/316: rmdir d0/d1c/d1d 39 2024-09-06T14:44:27.049 INFO:tasks.workunit.client.1.smithi165.stdout:8/395: chown d0/f22 184 1 2024-09-06T14:44:27.049 INFO:tasks.workunit.client.1.smithi165.stdout:3/356: link d1/da/dc/l4e d1/da/dc/d5d/l76 0 2024-09-06T14:44:27.050 INFO:tasks.workunit.client.1.smithi165.stdout:6/355: dwrite d29/d32/f50 [0,4194304] 0 2024-09-06T14:44:27.050 INFO:tasks.workunit.client.1.smithi165.stdout:0/319: mknod d15/d19/d66/c68 0 2024-09-06T14:44:27.051 INFO:tasks.workunit.client.1.smithi165.stdout:1/317: readlink d0/d2a/l11 0 2024-09-06T14:44:27.052 INFO:tasks.workunit.client.1.smithi165.stdout:7/299: readlink d20/d3b/l4b 0 2024-09-06T14:44:27.054 INFO:tasks.workunit.client.1.smithi165.stdout:9/531: dwrite db/de/d15/d7f/d9b/f3c [0,4194304] 0 2024-09-06T14:44:27.054 INFO:tasks.workunit.client.1.smithi165.stdout:5/343: write d6/d1c/f1e [2096210,72999] 0 2024-09-06T14:44:27.056 INFO:tasks.workunit.client.1.smithi165.stdout:6/356: mkdir d29/d39/d5b/d68 0 2024-09-06T14:44:27.056 INFO:tasks.workunit.client.1.smithi165.stdout:0/320: mkdir d15/d19/d50/d53/d69 0 2024-09-06T14:44:27.059 INFO:tasks.workunit.client.1.smithi165.stdout:6/357: fsync d29/f4b 0 2024-09-06T14:44:27.061 INFO:tasks.workunit.client.1.smithi165.stdout:0/321: write f8 [4940261,103341] 0 2024-09-06T14:44:27.062 INFO:tasks.workunit.client.1.smithi165.stdout:1/318: rename d0/d2a/d23/d56/f5b to d0/d2a/d1b/d2b/d3e/d69/f6b 0 2024-09-06T14:44:27.063 INFO:tasks.workunit.client.1.smithi165.stdout:6/358: fdatasync d29/f3f 0 2024-09-06T14:44:27.065 INFO:tasks.workunit.client.1.smithi165.stdout:5/344: mknod d6/d1c/d28/d2d/d49/c7d 0 2024-09-06T14:44:27.065 INFO:tasks.workunit.client.1.smithi165.stdout:3/357: dread d1/da/dd/fe [0,4194304] 0 2024-09-06T14:44:27.068 INFO:tasks.workunit.client.1.smithi165.stdout:7/300: dwrite d20/d3b/f3f [0,4194304] 0 2024-09-06T14:44:27.070 INFO:tasks.workunit.client.1.smithi165.stdout:3/358: write d1/f11 [1218015,46073] 0 2024-09-06T14:44:27.071 INFO:tasks.workunit.client.1.smithi165.stdout:9/532: mknod db/de/d15/d91/ca8 0 2024-09-06T14:44:27.074 INFO:tasks.workunit.client.1.smithi165.stdout:0/322: rename d15/f43 to d15/d19/d28/d4f/d52/f6a 0 2024-09-06T14:44:27.081 INFO:tasks.workunit.client.1.smithi165.stdout:6/359: dwrite d29/d32/f56 [0,4194304] 0 2024-09-06T14:44:27.081 INFO:tasks.workunit.client.1.smithi165.stdout:1/319: dwrite d0/d2a/d18/d24/d4b/d5f/f61 [0,4194304] 0 2024-09-06T14:44:27.083 INFO:tasks.workunit.client.1.smithi165.stdout:9/533: chown db/de/d15/d17/d18/d59/d64/d99/c37 24 1 2024-09-06T14:44:27.086 INFO:tasks.workunit.client.1.smithi165.stdout:1/320: fsync d0/d2a/d18/d24/d4b/d5f/f60 0 2024-09-06T14:44:27.087 INFO:tasks.workunit.client.1.smithi165.stdout:5/345: creat d6/d1c/d28/d2d/f7e x:0 0 0 2024-09-06T14:44:27.090 INFO:tasks.workunit.client.1.smithi165.stdout:8/396: link d0/d34/l89 d0/d19/d36/d2d/d33/d3a/d46/l8e 0 2024-09-06T14:44:27.092 INFO:tasks.workunit.client.1.smithi165.stdout:7/301: dwrite d20/d40/f51 [0,4194304] 0 2024-09-06T14:44:27.097 INFO:tasks.workunit.client.1.smithi165.stdout:0/323: symlink d15/d19/l6b 0 2024-09-06T14:44:27.100 INFO:tasks.workunit.client.1.smithi165.stdout:6/360: dwrite f17 [0,4194304] 0 2024-09-06T14:44:27.101 INFO:tasks.workunit.client.1.smithi165.stdout:7/302: rmdir d20/d33/d53 39 2024-09-06T14:44:27.106 INFO:tasks.workunit.client.1.smithi165.stdout:6/361: dread d29/f66 [0,4194304] 0 2024-09-06T14:44:27.106 INFO:tasks.workunit.client.1.smithi165.stdout:3/359: rename d1/da/dc/d3b/l62 to d1/da/dc/l77 0 2024-09-06T14:44:27.110 INFO:tasks.workunit.client.1.smithi165.stdout:0/324: symlink d15/d19/d2c/l6c 0 2024-09-06T14:44:27.114 INFO:tasks.workunit.client.1.smithi165.stdout:0/325: dread d15/d19/d28/d3a/f41 [0,4194304] 0 2024-09-06T14:44:27.117 INFO:tasks.workunit.client.1.smithi165.stdout:3/360: creat d1/d4a/f78 x:0 0 0 2024-09-06T14:44:27.117 INFO:tasks.workunit.client.1.smithi165.stdout:3/361: dread - d1/da/dd/d4b/f74 zero size 2024-09-06T14:44:27.121 INFO:tasks.workunit.client.1.smithi165.stdout:7/303: symlink d20/d33/l63 0 2024-09-06T14:44:27.123 INFO:tasks.workunit.client.1.smithi165.stdout:0/326: chown d15/c26 10027 1 2024-09-06T14:44:27.124 INFO:tasks.workunit.client.1.smithi165.stdout:0/327: fsync f3 0 2024-09-06T14:44:27.125 INFO:tasks.workunit.client.1.smithi165.stdout:6/362: rename l13 to d29/l69 0 2024-09-06T14:44:27.132 INFO:tasks.workunit.client.1.smithi165.stdout:9/534: write db/f1c [938467,27665] 0 2024-09-06T14:44:27.132 INFO:tasks.workunit.client.1.smithi165.stdout:6/363: mkdir d29/d6a 0 2024-09-06T14:44:27.134 INFO:tasks.workunit.client.1.smithi165.stdout:3/362: rename d1/f1b to d1/d41/f79 0 2024-09-06T14:44:27.136 INFO:tasks.workunit.client.1.smithi165.stdout:5/346: truncate d6/f16 3140928 0 2024-09-06T14:44:27.137 INFO:tasks.workunit.client.1.smithi165.stdout:7/304: truncate d20/d26/d28/d30/f31 3050689 0 2024-09-06T14:44:27.137 INFO:tasks.workunit.client.1.smithi165.stdout:0/328: dwrite d15/f37 [4194304,4194304] 0 2024-09-06T14:44:27.144 INFO:tasks.workunit.client.1.smithi165.stdout:3/363: unlink d1/d19/l54 0 2024-09-06T14:44:27.145 INFO:tasks.workunit.client.1.smithi165.stdout:3/364: truncate d1/d19/f59 351500 0 2024-09-06T14:44:27.146 INFO:tasks.workunit.client.1.smithi165.stdout:6/364: truncate d29/f36 4202954 0 2024-09-06T14:44:27.149 INFO:tasks.workunit.client.1.smithi165.stdout:5/347: chown d6/d1c/d28/d2d/d49/l4d 417292749 1 2024-09-06T14:44:27.150 INFO:tasks.workunit.client.1.smithi165.stdout:5/348: fsync d6/f1a 0 2024-09-06T14:44:27.150 INFO:tasks.workunit.client.1.smithi165.stdout:8/397: truncate d0/d19/d36/fa 1299973 0 2024-09-06T14:44:27.152 INFO:tasks.workunit.client.1.smithi165.stdout:0/329: mknod d15/d19/d50/d53/c6d 0 2024-09-06T14:44:27.152 INFO:tasks.workunit.client.1.smithi165.stdout:5/349: write d6/d1c/f68 [695626,130549] 0 2024-09-06T14:44:27.153 INFO:tasks.workunit.client.1.smithi165.stdout:3/365: dwrite d1/da/dc/f2e [0,4194304] 0 2024-09-06T14:44:27.153 INFO:tasks.workunit.client.1.smithi165.stdout:9/535: mknod db/de/ca9 0 2024-09-06T14:44:27.155 INFO:tasks.workunit.client.1.smithi165.stdout:5/350: readlink d6/d1c/d28/d2d/d3c/l5d 0 2024-09-06T14:44:27.158 INFO:tasks.workunit.client.1.smithi165.stdout:7/305: symlink d20/d4d/d54/l64 0 2024-09-06T14:44:27.162 INFO:tasks.workunit.client.1.smithi165.stdout:3/366: dwrite d1/d19/f59 [0,4194304] 0 2024-09-06T14:44:27.162 INFO:tasks.workunit.client.1.smithi165.stdout:3/367: chown d1/da/f2a 36 1 2024-09-06T14:44:27.165 INFO:tasks.workunit.client.1.smithi165.stdout:8/398: rename d0/d19/d36/d2d/d33/d84/c8a to d0/d19/d36/d28/d64/c8f 0 2024-09-06T14:44:27.167 INFO:tasks.workunit.client.1.smithi165.stdout:5/351: unlink l1 0 2024-09-06T14:44:27.170 INFO:tasks.workunit.client.1.smithi165.stdout:9/536: truncate db/de/d15/f69 439211 0 2024-09-06T14:44:27.171 INFO:tasks.workunit.client.1.smithi165.stdout:3/368: dwrite d1/da/dd/d4b/f5f [4194304,4194304] 0 2024-09-06T14:44:27.171 INFO:tasks.workunit.client.1.smithi165.stdout:2/340: sync 2024-09-06T14:44:27.171 INFO:tasks.workunit.client.1.smithi165.stdout:4/364: sync 2024-09-06T14:44:27.173 INFO:tasks.workunit.client.1.smithi165.stdout:6/365: symlink d29/d39/d5b/d62/d67/l6b 0 2024-09-06T14:44:27.176 INFO:tasks.workunit.client.1.smithi165.stdout:0/330: dread fb [0,4194304] 0 2024-09-06T14:44:27.181 INFO:tasks.workunit.client.1.smithi165.stdout:5/352: creat d6/d1c/d28/d2d/d3c/d44/f7f x:0 0 0 2024-09-06T14:44:27.185 INFO:tasks.workunit.client.1.smithi165.stdout:3/369: creat d1/da/dc/d3b/d71/f7a x:0 0 0 2024-09-06T14:44:27.186 INFO:tasks.workunit.client.1.smithi165.stdout:3/370: dread - d1/d4a/f78 zero size 2024-09-06T14:44:27.187 INFO:tasks.workunit.client.1.smithi165.stdout:3/371: write d1/d41/f56 [926959,66023] 0 2024-09-06T14:44:27.190 INFO:tasks.workunit.client.1.smithi165.stdout:6/366: unlink d29/c2d 0 2024-09-06T14:44:27.198 INFO:tasks.workunit.client.1.smithi165.stdout:5/353: creat d6/d1c/d28/d2d/d3c/f80 x:0 0 0 2024-09-06T14:44:27.199 INFO:tasks.workunit.client.1.smithi165.stdout:5/354: write d6/f1a [805586,22814] 0 2024-09-06T14:44:27.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/537: mknod db/de/d16/caa 0 2024-09-06T14:44:27.202 INFO:tasks.workunit.client.1.smithi165.stdout:9/538: write db/de/d16/f24 [825726,109793] 0 2024-09-06T14:44:27.202 INFO:tasks.workunit.client.1.smithi165.stdout:4/365: getdents d5/d1b/d1c/d20/d75 0 2024-09-06T14:44:27.203 INFO:tasks.workunit.client.1.smithi165.stdout:9/539: write db/de/d16/f5e [1374155,122718] 0 2024-09-06T14:44:27.207 INFO:tasks.workunit.client.1.smithi165.stdout:8/399: write d0/d19/d24/d26/f6f [140165,29466] 0 2024-09-06T14:44:27.211 INFO:tasks.workunit.client.1.smithi165.stdout:0/331: mkdir d15/d6e 0 2024-09-06T14:44:27.213 INFO:tasks.workunit.client.1.smithi165.stdout:5/355: rename d6/d32/d41 to d6/d1c/d28/d2d/d3c/d81 0 2024-09-06T14:44:27.218 INFO:tasks.workunit.client.1.smithi165.stdout:9/540: creat db/de/d15/d17/d18/d7d/d61/fab x:0 0 0 2024-09-06T14:44:27.220 INFO:tasks.workunit.client.1.smithi165.stdout:7/306: truncate d20/d26/d28/f4e 708781 0 2024-09-06T14:44:27.223 INFO:tasks.workunit.client.1.smithi165.stdout:0/332: unlink d15/d19/d2c/c3d 0 2024-09-06T14:44:27.225 INFO:tasks.workunit.client.1.smithi165.stdout:5/356: mkdir d6/d1c/d28/d2d/d3c/d44/d82 0 2024-09-06T14:44:27.229 INFO:tasks.workunit.client.1.smithi165.stdout:3/372: creat d1/da/f7b x:0 0 0 2024-09-06T14:44:27.230 INFO:tasks.workunit.client.1.smithi165.stdout:2/341: truncate d9/d25/f61 536962 0 2024-09-06T14:44:27.231 INFO:tasks.workunit.client.1.smithi165.stdout:3/373: write d1/da/dc/d10/f1a [428114,31219] 0 2024-09-06T14:44:27.231 INFO:tasks.workunit.client.1.smithi165.stdout:5/357: dwrite d6/d1c/f76 [0,4194304] 0 2024-09-06T14:44:27.233 INFO:tasks.workunit.client.1.smithi165.stdout:3/374: dread - d1/da/dd/f57 zero size 2024-09-06T14:44:27.239 INFO:tasks.workunit.client.1.smithi165.stdout:7/307: dwrite d20/d33/d53/f55 [0,4194304] 0 2024-09-06T14:44:27.247 INFO:tasks.workunit.client.1.smithi165.stdout:6/367: write f25 [4796894,38601] 0 2024-09-06T14:44:27.248 INFO:tasks.workunit.client.1.smithi165.stdout:6/368: fsync d29/f41 0 2024-09-06T14:44:27.250 INFO:tasks.workunit.client.1.smithi165.stdout:3/375: rmdir d1/da/dc/d10 39 2024-09-06T14:44:27.252 INFO:tasks.workunit.client.1.smithi165.stdout:5/358: creat d6/d1c/d28/d2d/d3c/d44/f83 x:0 0 0 2024-09-06T14:44:27.253 INFO:tasks.workunit.client.1.smithi165.stdout:0/333: rmdir d15/d55 39 2024-09-06T14:44:27.253 INFO:tasks.workunit.client.1.smithi165.stdout:0/334: chown d15/d19/d28/d3a 1345 1 2024-09-06T14:44:27.255 INFO:tasks.workunit.client.1.smithi165.stdout:4/366: getdents d5 0 2024-09-06T14:44:27.258 INFO:tasks.workunit.client.1.smithi165.stdout:7/308: dread f12 [0,4194304] 0 2024-09-06T14:44:27.261 INFO:tasks.workunit.client.1.smithi165.stdout:2/342: getdents d9/d4f 0 2024-09-06T14:44:27.263 INFO:tasks.workunit.client.1.smithi165.stdout:2/343: write d9/f1c [7247263,50810] 0 2024-09-06T14:44:27.264 INFO:tasks.workunit.client.1.smithi165.stdout:7/309: dwrite d20/d26/f34 [0,4194304] 0 2024-09-06T14:44:27.264 INFO:tasks.workunit.client.1.smithi165.stdout:2/344: fdatasync d9/d25/f40 0 2024-09-06T14:44:27.266 INFO:tasks.workunit.client.1.smithi165.stdout:7/310: fsync d20/d26/f61 0 2024-09-06T14:44:27.266 INFO:tasks.workunit.client.1.smithi165.stdout:2/345: chown d9/d23/l31 165019673 1 2024-09-06T14:44:27.267 INFO:tasks.workunit.client.1.smithi165.stdout:7/311: read d20/d40/f51 [1493490,113137] 0 2024-09-06T14:44:27.267 INFO:tasks.workunit.client.1.smithi165.stdout:2/346: chown d9/d23/d26/d2d/d34 9 1 2024-09-06T14:44:27.269 INFO:tasks.workunit.client.1.smithi165.stdout:9/541: truncate db/de/d15/d17/d18/d59/d64/d99/f46 136960 0 2024-09-06T14:44:27.277 INFO:tasks.workunit.client.1.smithi165.stdout:6/369: mkdir d29/d6a/d6c 0 2024-09-06T14:44:27.277 INFO:tasks.workunit.client.1.smithi165.stdout:6/370: fsync d29/d39/f64 0 2024-09-06T14:44:27.283 INFO:tasks.workunit.client.1.smithi165.stdout:6/371: dwrite d29/f36 [0,4194304] 0 2024-09-06T14:44:27.284 INFO:tasks.workunit.client.1.smithi165.stdout:2/347: symlink d9/d23/d26/l66 0 2024-09-06T14:44:27.289 INFO:tasks.workunit.client.1.smithi165.stdout:4/367: fdatasync d5/f50 0 2024-09-06T14:44:27.290 INFO:tasks.workunit.client.1.smithi165.stdout:2/348: write d9/d23/d26/f30 [1990257,73184] 0 2024-09-06T14:44:27.293 INFO:tasks.workunit.client.1.smithi165.stdout:9/542: creat db/de/d15/d17/d86/fac x:0 0 0 2024-09-06T14:44:27.294 INFO:tasks.workunit.client.1.smithi165.stdout:2/349: stat d9/d23/d29/c2c 0 2024-09-06T14:44:27.294 INFO:tasks.workunit.client.1.smithi165.stdout:4/368: stat d5/d1b/d1c/d55/d7d/l7e 0 2024-09-06T14:44:27.295 INFO:tasks.workunit.client.1.smithi165.stdout:7/312: dwrite f18 [0,4194304] 0 2024-09-06T14:44:27.295 INFO:tasks.workunit.client.1.smithi165.stdout:9/543: fdatasync db/de/d15/d7f/d9b/d6c/f75 0 2024-09-06T14:44:27.296 INFO:tasks.workunit.client.1.smithi165.stdout:7/313: chown f8 9 1 2024-09-06T14:44:27.299 INFO:tasks.workunit.client.1.smithi165.stdout:7/314: stat d20/d26/d28/d30/l3c 0 2024-09-06T14:44:27.300 INFO:tasks.workunit.client.1.smithi165.stdout:5/359: creat d6/d32/f84 x:0 0 0 2024-09-06T14:44:27.302 INFO:tasks.workunit.client.1.smithi165.stdout:6/372: rmdir d29/d39 39 2024-09-06T14:44:27.304 INFO:tasks.workunit.client.1.smithi165.stdout:2/350: dwrite d9/f13 [0,4194304] 0 2024-09-06T14:44:27.306 INFO:tasks.workunit.client.1.smithi165.stdout:3/376: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:27.309 INFO:tasks.workunit.client.1.smithi165.stdout:2/351: dread d9/f1a [0,4194304] 0 2024-09-06T14:44:27.311 INFO:tasks.workunit.client.1.smithi165.stdout:2/352: write d9/d23/d29/f2b [1999871,19342] 0 2024-09-06T14:44:27.313 INFO:tasks.workunit.client.1.smithi165.stdout:2/353: fsync d9/fc 0 2024-09-06T14:44:27.314 INFO:tasks.workunit.client.1.smithi165.stdout:6/373: symlink d29/d6a/l6d 0 2024-09-06T14:44:27.317 INFO:tasks.workunit.client.1.smithi165.stdout:2/354: write d9/d25/d45/f63 [986237,45459] 0 2024-09-06T14:44:27.317 INFO:tasks.workunit.client.1.smithi165.stdout:4/369: dwrite d5/f50 [0,4194304] 0 2024-09-06T14:44:27.320 INFO:tasks.workunit.client.1.smithi165.stdout:4/370: dread - d5/d1b/d1c/f60 zero size 2024-09-06T14:44:27.323 INFO:tasks.workunit.client.1.smithi165.stdout:7/315: dwrite d20/d26/d28/f5d [0,4194304] 0 2024-09-06T14:44:27.325 INFO:tasks.workunit.client.1.smithi165.stdout:7/316: chown d20/d26/d28/d30/f39 247876817 1 2024-09-06T14:44:27.327 INFO:tasks.workunit.client.1.smithi165.stdout:6/374: chown d29/d39/c40 15453303 1 2024-09-06T14:44:27.329 INFO:tasks.workunit.client.1.smithi165.stdout:5/360: dread d6/d1c/d28/d2d/f53 [0,4194304] 0 2024-09-06T14:44:27.332 INFO:tasks.workunit.client.1.smithi165.stdout:3/377: mkdir d1/d7c 0 2024-09-06T14:44:27.334 INFO:tasks.workunit.client.1.smithi165.stdout:6/375: dread d29/d32/f56 [0,4194304] 0 2024-09-06T14:44:27.335 INFO:tasks.workunit.client.1.smithi165.stdout:9/544: rename db/de/d15/d17/d18/d59/d64/d99 to db/de/d15/d17/dad 0 2024-09-06T14:44:27.336 INFO:tasks.workunit.client.1.smithi165.stdout:9/545: write db/de/f10 [1867681,79485] 0 2024-09-06T14:44:27.338 INFO:tasks.workunit.client.1.smithi165.stdout:9/546: write db/de/d15/d17/f25 [525274,6392] 0 2024-09-06T14:44:27.341 INFO:tasks.workunit.client.1.smithi165.stdout:2/355: mkdir d9/d23/d26/d2d/d67 0 2024-09-06T14:44:27.342 INFO:tasks.workunit.client.1.smithi165.stdout:5/361: mknod d6/d1c/d28/d2d/d3c/c85 0 2024-09-06T14:44:27.344 INFO:tasks.workunit.client.1.smithi165.stdout:3/378: creat d1/d4a/f7d x:0 0 0 2024-09-06T14:44:27.345 INFO:tasks.workunit.client.1.smithi165.stdout:9/547: dread db/de/d16/f5e [0,4194304] 0 2024-09-06T14:44:27.346 INFO:tasks.workunit.client.1.smithi165.stdout:6/376: chown d29/l59 470487 1 2024-09-06T14:44:27.347 INFO:tasks.workunit.client.1.smithi165.stdout:6/377: write f3 [1521417,64014] 0 2024-09-06T14:44:27.349 INFO:tasks.workunit.client.1.smithi165.stdout:4/371: rename d5/d1b/d48 to d5/d1b/d1c/d20/d75/d83 0 2024-09-06T14:44:27.351 INFO:tasks.workunit.client.1.smithi165.stdout:4/372: write d5/d1b/d1c/d55/f68 [470708,13658] 0 2024-09-06T14:44:27.351 INFO:tasks.workunit.client.1.smithi165.stdout:3/379: dwrite d1/da/dd/f2c [0,4194304] 0 2024-09-06T14:44:27.352 INFO:tasks.workunit.client.1.smithi165.stdout:4/373: write d5/d1b/f5b [1499605,19268] 0 2024-09-06T14:44:27.354 INFO:tasks.workunit.client.1.smithi165.stdout:4/374: read - d5/d1b/d1c/f60 zero size 2024-09-06T14:44:27.355 INFO:tasks.workunit.client.1.smithi165.stdout:4/375: chown d5/d1b/d1c/d20/d75/d83 154474370 1 2024-09-06T14:44:27.356 INFO:tasks.workunit.client.1.smithi165.stdout:4/376: write d5/d1b/d1c/d20/d75/d83/f5f [679851,14693] 0 2024-09-06T14:44:27.362 INFO:tasks.workunit.client.1.smithi165.stdout:9/548: rmdir db/de/d16/d2e 39 2024-09-06T14:44:27.370 INFO:tasks.workunit.client.1.smithi165.stdout:7/317: rename d20/d26 to d20/d65 0 2024-09-06T14:44:27.372 INFO:tasks.workunit.client.1.smithi165.stdout:4/377: creat d5/d1b/d1c/d20/d26/f84 x:0 0 0 2024-09-06T14:44:27.375 INFO:tasks.workunit.client.1.smithi165.stdout:1/321: sync 2024-09-06T14:44:27.377 INFO:tasks.workunit.client.1.smithi165.stdout:5/362: mknod d6/c86 0 2024-09-06T14:44:27.379 INFO:tasks.workunit.client.1.smithi165.stdout:5/363: read d6/d1c/d64/f65 [154536,123342] 0 2024-09-06T14:44:27.382 INFO:tasks.workunit.client.1.smithi165.stdout:3/380: mkdir d1/d7c/d7e 0 2024-09-06T14:44:27.383 INFO:tasks.workunit.client.1.smithi165.stdout:3/381: chown d1/da/dd/d4b/l53 290857 1 2024-09-06T14:44:27.385 INFO:tasks.workunit.client.1.smithi165.stdout:7/318: mkdir d20/d33/d53/d66 0 2024-09-06T14:44:27.387 INFO:tasks.workunit.client.1.smithi165.stdout:4/378: creat d5/d1b/d66/f85 x:0 0 0 2024-09-06T14:44:27.390 INFO:tasks.workunit.client.1.smithi165.stdout:9/549: dread db/de/d15/f2b [0,4194304] 0 2024-09-06T14:44:27.391 INFO:tasks.workunit.client.1.smithi165.stdout:5/364: creat d6/d1c/d28/d4b/d55/f87 x:0 0 0 2024-09-06T14:44:27.392 INFO:tasks.workunit.client.1.smithi165.stdout:7/319: dwrite d20/d65/d28/f58 [0,4194304] 0 2024-09-06T14:44:27.392 INFO:tasks.workunit.client.1.smithi165.stdout:5/365: readlink d6/l52 0 2024-09-06T14:44:27.393 INFO:tasks.workunit.client.1.smithi165.stdout:2/356: rename d9/d23/d29/f58 to d9/f68 0 2024-09-06T14:44:27.394 INFO:tasks.workunit.client.1.smithi165.stdout:3/382: stat d1/d4a/f55 0 2024-09-06T14:44:27.396 INFO:tasks.workunit.client.1.smithi165.stdout:5/366: truncate d6/d1c/d28/d4b/d60/f78 502617 0 2024-09-06T14:44:27.397 INFO:tasks.workunit.client.1.smithi165.stdout:1/322: unlink d0/d2a/d18/c4e 0 2024-09-06T14:44:27.397 INFO:tasks.workunit.client.1.smithi165.stdout:3/383: write d1/da/dc/d3b/d71/f7a [248566,23464] 0 2024-09-06T14:44:27.451 INFO:tasks.workunit.client.1.smithi165.stdout:5/367: mkdir d6/d1c/d28/d88 0 2024-09-06T14:44:27.452 INFO:tasks.workunit.client.1.smithi165.stdout:7/320: dwrite f12 [0,4194304] 0 2024-09-06T14:44:27.452 INFO:tasks.workunit.client.1.smithi165.stdout:2/357: dwrite d9/fc [0,4194304] 0 2024-09-06T14:44:27.455 INFO:tasks.workunit.client.1.smithi165.stdout:9/550: dread db/de/d15/f69 [0,4194304] 0 2024-09-06T14:44:27.455 INFO:tasks.workunit.client.1.smithi165.stdout:1/323: rename d0/d2a/d1b/f58 to d0/d2a/d1b/d2b/d3e/d69/f6c 0 2024-09-06T14:44:27.455 INFO:tasks.workunit.client.1.smithi165.stdout:5/368: rename d6 to d6/d1c/d28/d4b/d89 22 2024-09-06T14:44:27.457 INFO:tasks.workunit.client.1.smithi165.stdout:7/321: creat d20/d33/d53/f67 x:0 0 0 2024-09-06T14:44:27.459 INFO:tasks.workunit.client.1.smithi165.stdout:2/358: mkdir d9/d25/d45/d69 0 2024-09-06T14:44:27.461 INFO:tasks.workunit.client.1.smithi165.stdout:1/324: read - d0/d1c/d1d/d22/f39 zero size 2024-09-06T14:44:27.462 INFO:tasks.workunit.client.1.smithi165.stdout:1/325: stat d0/d1c/d1d/d22 0 2024-09-06T14:44:27.462 INFO:tasks.workunit.client.1.smithi165.stdout:5/369: mkdir d6/d1c/d28/d4b/d55/d8a 0 2024-09-06T14:44:27.464 INFO:tasks.workunit.client.1.smithi165.stdout:7/322: stat d20/d65/d28/d30/f31 0 2024-09-06T14:44:27.464 INFO:tasks.workunit.client.1.smithi165.stdout:1/326: write d0/d2a/d1b/f1f [105194,46552] 0 2024-09-06T14:44:27.466 INFO:tasks.workunit.client.1.smithi165.stdout:2/359: rename d9/d23/d26/d2d/f54 to d9/d23/d26/f6a 0 2024-09-06T14:44:27.469 INFO:tasks.workunit.client.1.smithi165.stdout:5/370: symlink d6/d1c/d28/d2d/d61/l8b 0 2024-09-06T14:44:27.474 INFO:tasks.workunit.client.1.smithi165.stdout:2/360: symlink d9/d25/d45/l6b 0 2024-09-06T14:44:27.475 INFO:tasks.workunit.client.1.smithi165.stdout:3/384: dread d1/da/dc/f30 [0,4194304] 0 2024-09-06T14:44:27.477 INFO:tasks.workunit.client.1.smithi165.stdout:9/551: link db/de/d15/d7f/d9b/d6c/f75 db/de/d15/d17/d18/d7d/fae 0 2024-09-06T14:44:27.480 INFO:tasks.workunit.client.1.smithi165.stdout:3/385: rmdir d1/d7c 39 2024-09-06T14:44:27.481 INFO:tasks.workunit.client.1.smithi165.stdout:5/371: truncate d6/d1c/f26 520851 0 2024-09-06T14:44:27.482 INFO:tasks.workunit.client.1.smithi165.stdout:7/323: dread f1d [0,4194304] 0 2024-09-06T14:44:27.483 INFO:tasks.workunit.client.1.smithi165.stdout:9/552: mkdir db/de/d15/d7f/d9b/d6c/daf 0 2024-09-06T14:44:27.486 INFO:tasks.workunit.client.1.smithi165.stdout:5/372: write d6/d1c/d28/d2d/d61/f79 [497606,105490] 0 2024-09-06T14:44:27.486 INFO:tasks.workunit.client.1.smithi165.stdout:9/553: creat db/de/d15/d74/fb0 x:0 0 0 2024-09-06T14:44:27.489 INFO:tasks.workunit.client.1.smithi165.stdout:5/373: write d6/d1c/f39 [287538,9304] 0 2024-09-06T14:44:27.489 INFO:tasks.workunit.client.1.smithi165.stdout:9/554: chown db/de/d16/l56 5 1 2024-09-06T14:44:27.489 INFO:tasks.workunit.client.1.smithi165.stdout:0/335: sync 2024-09-06T14:44:27.489 INFO:tasks.workunit.client.1.smithi165.stdout:8/400: sync 2024-09-06T14:44:27.492 INFO:tasks.workunit.client.1.smithi165.stdout:7/324: dwrite d20/d33/d53/f57 [0,4194304] 0 2024-09-06T14:44:27.494 INFO:tasks.workunit.client.1.smithi165.stdout:2/361: dread d9/d25/d45/f51 [0,4194304] 0 2024-09-06T14:44:27.495 INFO:tasks.workunit.client.1.smithi165.stdout:0/336: creat d15/d19/d28/d3a/d3f/f6f x:0 0 0 2024-09-06T14:44:27.496 INFO:tasks.workunit.client.1.smithi165.stdout:8/401: readlink d0/d19/d36/d2d/d33/d3a/d46/l8e 0 2024-09-06T14:44:27.496 INFO:tasks.workunit.client.1.smithi165.stdout:9/555: creat db/de/fb1 x:0 0 0 2024-09-06T14:44:27.498 INFO:tasks.workunit.client.1.smithi165.stdout:5/374: rename d6/d1c/d28/d4b/d60/f70 to d6/d1c/d28/d4b/d55/f8c 0 2024-09-06T14:44:27.499 INFO:tasks.workunit.client.1.smithi165.stdout:7/325: dread d20/d3b/f3f [0,4194304] 0 2024-09-06T14:44:27.500 INFO:tasks.workunit.client.1.smithi165.stdout:7/326: stat d20/d33/d53/c62 0 2024-09-06T14:44:27.502 INFO:tasks.workunit.client.1.smithi165.stdout:2/362: creat d9/d23/d26/d2d/d34/f6c x:0 0 0 2024-09-06T14:44:27.502 INFO:tasks.workunit.client.1.smithi165.stdout:1/327: write d0/d2a/f12 [1036149,23464] 0 2024-09-06T14:44:27.504 INFO:tasks.workunit.client.1.smithi165.stdout:8/402: creat d0/d19/d36/d28/f90 x:0 0 0 2024-09-06T14:44:27.506 INFO:tasks.workunit.client.1.smithi165.stdout:7/327: unlink d20/d3b/l45 0 2024-09-06T14:44:27.507 INFO:tasks.workunit.client.1.smithi165.stdout:3/386: truncate d1/da/dc/d10/f35 4109282 0 2024-09-06T14:44:27.508 INFO:tasks.workunit.client.1.smithi165.stdout:0/337: symlink d15/d19/d28/d3a/d5d/l70 0 2024-09-06T14:44:27.509 INFO:tasks.workunit.client.1.smithi165.stdout:9/556: symlink db/de/d15/d17/d18/d7d/d8e/lb2 0 2024-09-06T14:44:27.510 INFO:tasks.workunit.client.1.smithi165.stdout:2/363: dwrite d9/f17 [4194304,4194304] 0 2024-09-06T14:44:27.510 INFO:tasks.workunit.client.1.smithi165.stdout:0/338: write d15/f1f [1046970,111635] 0 2024-09-06T14:44:27.510 INFO:tasks.workunit.client.1.smithi165.stdout:7/328: truncate d20/d33/d53/f67 166466 0 2024-09-06T14:44:27.511 INFO:tasks.workunit.client.1.smithi165.stdout:5/375: link d6/d1c/d28/f6b d6/d1c/d28/d4b/d55/d8a/f8d 0 2024-09-06T14:44:27.512 INFO:tasks.workunit.client.1.smithi165.stdout:7/329: chown d20/d65/d28/d30/f39 6096467 1 2024-09-06T14:44:27.513 INFO:tasks.workunit.client.1.smithi165.stdout:5/376: chown d6/d1c/d28/d4b/d55/c62 859 1 2024-09-06T14:44:27.513 INFO:tasks.workunit.client.1.smithi165.stdout:3/387: unlink d1/da/dd/d4b/l53 0 2024-09-06T14:44:27.518 INFO:tasks.workunit.client.1.smithi165.stdout:8/403: symlink d0/d14/l91 0 2024-09-06T14:44:27.520 INFO:tasks.workunit.client.1.smithi165.stdout:5/377: dread d6/d1c/d28/d2d/f53 [0,4194304] 0 2024-09-06T14:44:27.522 INFO:tasks.workunit.client.1.smithi165.stdout:0/339: dwrite d15/f37 [4194304,4194304] 0 2024-09-06T14:44:27.522 INFO:tasks.workunit.client.1.smithi165.stdout:2/364: unlink d9/c56 0 2024-09-06T14:44:27.523 INFO:tasks.workunit.client.1.smithi165.stdout:7/330: dread d20/d65/d28/f58 [0,4194304] 0 2024-09-06T14:44:27.526 INFO:tasks.workunit.client.1.smithi165.stdout:5/378: dread d6/d1c/f39 [0,4194304] 0 2024-09-06T14:44:27.526 INFO:tasks.workunit.client.1.smithi165.stdout:1/328: getdents d0/d2a/d1b/d2b 0 2024-09-06T14:44:27.527 INFO:tasks.workunit.client.1.smithi165.stdout:3/388: mknod d1/da/c7f 0 2024-09-06T14:44:27.533 INFO:tasks.workunit.client.1.smithi165.stdout:7/331: write f8 [368579,18283] 0 2024-09-06T14:44:27.533 INFO:tasks.workunit.client.1.smithi165.stdout:9/557: link db/de/d15/d17/d18/d7d/fae db/de/d15/d17/d18/fb3 0 2024-09-06T14:44:27.534 INFO:tasks.workunit.client.1.smithi165.stdout:7/332: read d20/d3b/f3f [1062256,50477] 0 2024-09-06T14:44:27.535 INFO:tasks.workunit.client.1.smithi165.stdout:5/379: mkdir d6/d1c/d28/d2d/d3c/d81/d8e 0 2024-09-06T14:44:27.536 INFO:tasks.workunit.client.1.smithi165.stdout:3/389: mknod d1/da/d43/c80 0 2024-09-06T14:44:27.536 INFO:tasks.workunit.client.1.smithi165.stdout:5/380: write d6/d1c/f74 [297566,7116] 0 2024-09-06T14:44:27.537 INFO:tasks.workunit.client.1.smithi165.stdout:5/381: stat d6/d1c/d28/d2d/l4a 0 2024-09-06T14:44:27.539 INFO:tasks.workunit.client.1.smithi165.stdout:1/329: write d0/d2a/d18/d24/d4b/f51 [312596,1211] 0 2024-09-06T14:44:27.541 INFO:tasks.workunit.client.1.smithi165.stdout:7/333: rmdir d20/d4d 39 2024-09-06T14:44:27.541 INFO:tasks.workunit.client.1.smithi165.stdout:6/378: sync 2024-09-06T14:44:27.543 INFO:tasks.workunit.client.1.smithi165.stdout:0/340: creat d15/d19/d28/f71 x:0 0 0 2024-09-06T14:44:27.544 INFO:tasks.workunit.client.1.smithi165.stdout:5/382: creat d6/d1c/f8f x:0 0 0 2024-09-06T14:44:27.546 INFO:tasks.workunit.client.1.smithi165.stdout:3/390: symlink d1/da/dd/l81 0 2024-09-06T14:44:27.548 INFO:tasks.workunit.client.1.smithi165.stdout:8/404: truncate d0/d19/d36/fe 2880589 0 2024-09-06T14:44:27.549 INFO:tasks.workunit.client.1.smithi165.stdout:5/383: mkdir d6/d1c/d28/d2d/d3c/d44/d90 0 2024-09-06T14:44:27.549 INFO:tasks.workunit.client.1.smithi165.stdout:6/379: creat d29/d6a/d6c/f6e x:0 0 0 2024-09-06T14:44:27.550 INFO:tasks.workunit.client.1.smithi165.stdout:1/330: dwrite d0/d2a/d18/f43 [0,4194304] 0 2024-09-06T14:44:27.552 INFO:tasks.workunit.client.1.smithi165.stdout:2/365: dread d9/d25/f33 [0,4194304] 0 2024-09-06T14:44:27.552 INFO:tasks.workunit.client.1.smithi165.stdout:8/405: symlink d0/d19/l92 0 2024-09-06T14:44:27.556 INFO:tasks.workunit.client.1.smithi165.stdout:1/331: write d0/d2a/d1b/d2b/f38 [769029,122153] 0 2024-09-06T14:44:27.556 INFO:tasks.workunit.client.1.smithi165.stdout:9/558: dread db/de/d15/d17/f25 [0,4194304] 0 2024-09-06T14:44:27.557 INFO:tasks.workunit.client.1.smithi165.stdout:6/380: creat d29/d39/d5b/d68/f6f x:0 0 0 2024-09-06T14:44:27.558 INFO:tasks.workunit.client.1.smithi165.stdout:0/341: dwrite d15/d19/d38/f4c [0,4194304] 0 2024-09-06T14:44:27.560 INFO:tasks.workunit.client.1.smithi165.stdout:9/559: chown db/de/d15/l51 300188 1 2024-09-06T14:44:27.561 INFO:tasks.workunit.client.1.smithi165.stdout:7/334: truncate d20/d33/d53/f57 2841779 0 2024-09-06T14:44:27.561 INFO:tasks.workunit.client.1.smithi165.stdout:0/342: rename d15/d19 to d15/d19/d66/d72 22 2024-09-06T14:44:27.563 INFO:tasks.workunit.client.1.smithi165.stdout:5/384: write d6/d1c/f39 [1336193,85467] 0 2024-09-06T14:44:27.566 INFO:tasks.workunit.client.1.smithi165.stdout:1/332: truncate d0/f7 765975 0 2024-09-06T14:44:27.567 INFO:tasks.workunit.client.1.smithi165.stdout:0/343: rmdir d15/d19/d50 39 2024-09-06T14:44:27.569 INFO:tasks.workunit.client.1.smithi165.stdout:6/381: link d29/d39/f54 d29/d6a/f70 0 2024-09-06T14:44:27.570 INFO:tasks.workunit.client.1.smithi165.stdout:5/385: symlink d6/l91 0 2024-09-06T14:44:27.570 INFO:tasks.workunit.client.1.smithi165.stdout:1/333: write d0/d1c/d41/f5e [288219,35787] 0 2024-09-06T14:44:27.571 INFO:tasks.workunit.client.1.smithi165.stdout:7/335: fsync d20/d65/d28/f4e 0 2024-09-06T14:44:27.571 INFO:tasks.workunit.client.1.smithi165.stdout:8/406: dread d0/d14/f25 [0,4194304] 0 2024-09-06T14:44:27.575 INFO:tasks.workunit.client.1.smithi165.stdout:5/386: rename d6/d1c/d28 to d6/d1c/d28/d4b/d92 22 2024-09-06T14:44:27.575 INFO:tasks.workunit.client.1.smithi165.stdout:9/560: dwrite db/f26 [0,4194304] 0 2024-09-06T14:44:27.576 INFO:tasks.workunit.client.1.smithi165.stdout:7/336: symlink d20/d40/l68 0 2024-09-06T14:44:27.577 INFO:tasks.workunit.client.1.smithi165.stdout:6/382: dread d29/f41 [0,4194304] 0 2024-09-06T14:44:27.578 INFO:tasks.workunit.client.1.smithi165.stdout:2/366: dread d9/f68 [0,4194304] 0 2024-09-06T14:44:27.579 INFO:tasks.workunit.client.1.smithi165.stdout:8/407: mkdir d0/d19/d36/d2d/d3f/d93 0 2024-09-06T14:44:27.579 INFO:tasks.workunit.client.1.smithi165.stdout:9/561: dread - db/d40/f88 zero size 2024-09-06T14:44:27.582 INFO:tasks.workunit.client.1.smithi165.stdout:7/337: unlink f18 0 2024-09-06T14:44:27.582 INFO:tasks.workunit.client.1.smithi165.stdout:9/562: truncate db/de/fb1 21251 0 2024-09-06T14:44:27.583 INFO:tasks.workunit.client.1.smithi165.stdout:0/344: symlink d15/d19/d50/d53/d57/l73 0 2024-09-06T14:44:27.585 INFO:tasks.workunit.client.1.smithi165.stdout:0/345: read fb [302701,50218] 0 2024-09-06T14:44:27.587 INFO:tasks.workunit.client.1.smithi165.stdout:6/383: dwrite d29/f49 [0,4194304] 0 2024-09-06T14:44:27.588 INFO:tasks.workunit.client.1.smithi165.stdout:6/384: stat d29/d32/f50 0 2024-09-06T14:44:27.588 INFO:tasks.workunit.client.1.smithi165.stdout:8/408: dwrite d0/fd [0,4194304] 0 2024-09-06T14:44:27.590 INFO:tasks.workunit.client.1.smithi165.stdout:6/385: truncate d29/f48 782120 0 2024-09-06T14:44:27.590 INFO:tasks.workunit.client.1.smithi165.stdout:8/409: chown d0/d34/d43/d68/c83 1690094 1 2024-09-06T14:44:27.590 INFO:tasks.workunit.client.1.smithi165.stdout:7/338: mkdir d20/d3b/d69 0 2024-09-06T14:44:27.591 INFO:tasks.workunit.client.1.smithi165.stdout:2/367: symlink d9/d23/d52/l6d 0 2024-09-06T14:44:27.593 INFO:tasks.workunit.client.1.smithi165.stdout:7/339: write d20/f48 [5405536,127762] 0 2024-09-06T14:44:27.593 INFO:tasks.workunit.client.1.smithi165.stdout:8/410: read d0/d19/d36/f2e [1790353,60462] 0 2024-09-06T14:44:27.595 INFO:tasks.workunit.client.1.smithi165.stdout:8/411: write d0/d19/d36/d28/f78 [462655,56612] 0 2024-09-06T14:44:27.596 INFO:tasks.workunit.client.1.smithi165.stdout:9/563: creat db/de/d15/d17/d18/fb4 x:0 0 0 2024-09-06T14:44:27.596 INFO:tasks.workunit.client.1.smithi165.stdout:0/346: creat d15/d19/d28/d51/d60/f74 x:0 0 0 2024-09-06T14:44:27.600 INFO:tasks.workunit.client.1.smithi165.stdout:7/340: dread d20/d33/d53/f55 [0,4194304] 0 2024-09-06T14:44:27.600 INFO:tasks.workunit.client.1.smithi165.stdout:6/386: mkdir d29/d6a/d71 0 2024-09-06T14:44:27.601 INFO:tasks.workunit.client.1.smithi165.stdout:6/387: stat d29/d32/c3e 0 2024-09-06T14:44:27.602 INFO:tasks.workunit.client.1.smithi165.stdout:2/368: fdatasync d9/d23/d26/f3c 0 2024-09-06T14:44:27.603 INFO:tasks.workunit.client.1.smithi165.stdout:0/347: dwrite d15/d19/d38/f4c [0,4194304] 0 2024-09-06T14:44:27.605 INFO:tasks.workunit.client.1.smithi165.stdout:5/387: truncate d6/d1c/d28/f2c 249705 0 2024-09-06T14:44:27.609 INFO:tasks.workunit.client.1.smithi165.stdout:8/412: rename d0/d34/d43 to d0/d34/d6b/d94 0 2024-09-06T14:44:27.612 INFO:tasks.workunit.client.1.smithi165.stdout:6/388: unlink d29/l52 0 2024-09-06T14:44:27.612 INFO:tasks.workunit.client.1.smithi165.stdout:6/389: fdatasync d29/f36 0 2024-09-06T14:44:27.619 INFO:tasks.workunit.client.1.smithi165.stdout:9/564: rename db/de/d15/d17/dad/l27 to db/de/d15/d17/dad/d97/lb5 0 2024-09-06T14:44:27.621 INFO:tasks.workunit.client.1.smithi165.stdout:7/341: dread d20/d65/d28/d30/f36 [0,4194304] 0 2024-09-06T14:44:27.621 INFO:tasks.workunit.client.1.smithi165.stdout:0/348: dread d15/d19/d38/f5e [0,4194304] 0 2024-09-06T14:44:27.623 INFO:tasks.workunit.client.1.smithi165.stdout:6/390: creat d29/d6a/d6c/f72 x:0 0 0 2024-09-06T14:44:27.624 INFO:tasks.workunit.client.1.smithi165.stdout:1/334: dread d0/f7 [0,4194304] 0 2024-09-06T14:44:27.624 INFO:tasks.workunit.client.1.smithi165.stdout:2/369: fdatasync d9/d23/d26/f47 0 2024-09-06T14:44:27.625 INFO:tasks.workunit.client.1.smithi165.stdout:1/335: dread - d0/d2a/d18/f67 zero size 2024-09-06T14:44:27.627 INFO:tasks.workunit.client.1.smithi165.stdout:5/388: getdents d6/d1c/d28/d2d/d3c/d44/d82 0 2024-09-06T14:44:27.629 INFO:tasks.workunit.client.1.smithi165.stdout:9/565: creat db/de/d15/d17/d86/fb6 x:0 0 0 2024-09-06T14:44:27.629 INFO:tasks.workunit.client.1.smithi165.stdout:0/349: fsync d15/d19/d28/f42 0 2024-09-06T14:44:27.630 INFO:tasks.workunit.client.1.smithi165.stdout:0/350: read - d15/d19/d28/d3a/d3f/f54 zero size 2024-09-06T14:44:27.631 INFO:tasks.workunit.client.1.smithi165.stdout:0/351: read - d15/d19/d2c/f36 zero size 2024-09-06T14:44:27.631 INFO:tasks.workunit.client.1.smithi165.stdout:9/566: read db/de/d15/d17/f47 [983916,69232] 0 2024-09-06T14:44:27.631 INFO:tasks.workunit.client.1.smithi165.stdout:6/391: creat d29/d39/d5b/d68/f73 x:0 0 0 2024-09-06T14:44:27.632 INFO:tasks.workunit.client.1.smithi165.stdout:6/392: fsync d29/d32/f61 0 2024-09-06T14:44:27.633 INFO:tasks.workunit.client.1.smithi165.stdout:0/352: chown d15/d19/d2c/l6c 14857 1 2024-09-06T14:44:27.634 INFO:tasks.workunit.client.1.smithi165.stdout:5/389: symlink d6/d1c/d28/l93 0 2024-09-06T14:44:27.635 INFO:tasks.workunit.client.1.smithi165.stdout:8/413: creat d0/d19/f95 x:0 0 0 2024-09-06T14:44:27.637 INFO:tasks.workunit.client.1.smithi165.stdout:8/414: chown d0/d19 15118148 1 2024-09-06T14:44:27.639 INFO:tasks.workunit.client.1.smithi165.stdout:1/336: truncate d0/f14 691014 0 2024-09-06T14:44:27.639 INFO:tasks.workunit.client.1.smithi165.stdout:6/393: chown d29/l2e 385 1 2024-09-06T14:44:27.641 INFO:tasks.workunit.client.1.smithi165.stdout:5/390: rename d6/lc to d6/d1c/l94 0 2024-09-06T14:44:27.643 INFO:tasks.workunit.client.1.smithi165.stdout:9/567: dwrite db/de/d15/d17/d86/fac [0,4194304] 0 2024-09-06T14:44:27.643 INFO:tasks.workunit.client.1.smithi165.stdout:1/337: symlink d0/d2a/d18/l6d 0 2024-09-06T14:44:27.644 INFO:tasks.workunit.client.1.smithi165.stdout:8/415: symlink d0/d14/l96 0 2024-09-06T14:44:27.645 INFO:tasks.workunit.client.1.smithi165.stdout:0/353: dwrite f8 [4194304,4194304] 0 2024-09-06T14:44:27.646 INFO:tasks.workunit.client.1.smithi165.stdout:2/370: dread d9/f1d [0,4194304] 0 2024-09-06T14:44:27.648 INFO:tasks.workunit.client.1.smithi165.stdout:5/391: write d6/d1c/d28/d2d/d61/f79 [1388749,126394] 0 2024-09-06T14:44:27.651 INFO:tasks.workunit.client.1.smithi165.stdout:1/338: truncate d0/d1c/d1d/d22/f4c 4222249 0 2024-09-06T14:44:27.656 INFO:tasks.workunit.client.1.smithi165.stdout:6/394: getdents d29 0 2024-09-06T14:44:27.656 INFO:tasks.workunit.client.1.smithi165.stdout:2/371: rename d9/d23/d26/l66 to d9/d23/d26/d2d/d67/l6e 0 2024-09-06T14:44:27.657 INFO:tasks.workunit.client.1.smithi165.stdout:5/392: mknod d6/d1c/d28/d2d/d3c/d44/d82/c95 0 2024-09-06T14:44:27.658 INFO:tasks.workunit.client.1.smithi165.stdout:0/354: dwrite f3 [0,4194304] 0 2024-09-06T14:44:27.658 INFO:tasks.workunit.client.1.smithi165.stdout:1/339: creat d0/d45/f6e x:0 0 0 2024-09-06T14:44:27.659 INFO:tasks.workunit.client.1.smithi165.stdout:9/568: write db/de/d15/d17/dad/f46 [1009732,118011] 0 2024-09-06T14:44:27.661 INFO:tasks.workunit.client.1.smithi165.stdout:6/395: truncate d29/d39/d5b/d62/f65 215339 0 2024-09-06T14:44:27.662 INFO:tasks.workunit.client.1.smithi165.stdout:5/393: symlink d6/d1c/d28/d4b/l96 0 2024-09-06T14:44:27.662 INFO:tasks.workunit.client.1.smithi165.stdout:1/340: readlink d0/d2a/d1b/d2b/d3e/l52 0 2024-09-06T14:44:27.663 INFO:tasks.workunit.client.1.smithi165.stdout:6/396: stat d29/d6a/d6c/f72 0 2024-09-06T14:44:27.664 INFO:tasks.workunit.client.1.smithi165.stdout:9/569: creat db/de/d15/d91/fb7 x:0 0 0 2024-09-06T14:44:27.664 INFO:tasks.workunit.client.1.smithi165.stdout:1/341: chown d0/d2a/c8 8708074 1 2024-09-06T14:44:27.666 INFO:tasks.workunit.client.1.smithi165.stdout:5/394: creat d6/d1c/d7c/f97 x:0 0 0 2024-09-06T14:44:27.667 INFO:tasks.workunit.client.1.smithi165.stdout:2/372: dread d9/f18 [0,4194304] 0 2024-09-06T14:44:27.667 INFO:tasks.workunit.client.1.smithi165.stdout:1/342: readlink d0/d2a/l13 0 2024-09-06T14:44:27.667 INFO:tasks.workunit.client.1.smithi165.stdout:9/570: chown db/de/d15/d17/d18/d7d/d8e/lb2 477172142 1 2024-09-06T14:44:27.667 INFO:tasks.workunit.client.1.smithi165.stdout:2/373: chown d9 95 1 2024-09-06T14:44:27.668 INFO:tasks.workunit.client.1.smithi165.stdout:1/343: chown d0/d2a 82344 1 2024-09-06T14:44:27.669 INFO:tasks.workunit.client.1.smithi165.stdout:5/395: mkdir d6/d98 0 2024-09-06T14:44:27.669 INFO:tasks.workunit.client.1.smithi165.stdout:2/374: dread - d9/d25/f40 zero size 2024-09-06T14:44:27.670 INFO:tasks.workunit.client.1.smithi165.stdout:9/571: chown db/de/d16/l56 2902242 1 2024-09-06T14:44:27.671 INFO:tasks.workunit.client.1.smithi165.stdout:1/344: creat d0/d2a/d23/f6f x:0 0 0 2024-09-06T14:44:27.673 INFO:tasks.workunit.client.1.smithi165.stdout:6/397: dwrite f3 [0,4194304] 0 2024-09-06T14:44:27.673 INFO:tasks.workunit.client.1.smithi165.stdout:2/375: write d9/f18 [270401,49368] 0 2024-09-06T14:44:27.675 INFO:tasks.workunit.client.1.smithi165.stdout:6/398: chown d29/d32/c3c 50 1 2024-09-06T14:44:27.675 INFO:tasks.workunit.client.1.smithi165.stdout:6/399: fsync d29/f36 0 2024-09-06T14:44:27.675 INFO:tasks.workunit.client.1.smithi165.stdout:5/396: dread d6/f1a [0,4194304] 0 2024-09-06T14:44:27.680 INFO:tasks.workunit.client.1.smithi165.stdout:5/397: chown d6/d1c/d28/d4b/l96 1979 1 2024-09-06T14:44:27.680 INFO:tasks.workunit.client.1.smithi165.stdout:2/376: getdents d9/d25 0 2024-09-06T14:44:27.682 INFO:tasks.workunit.client.1.smithi165.stdout:5/398: truncate d6/d1c/f38 575358 0 2024-09-06T14:44:27.682 INFO:tasks.workunit.client.1.smithi165.stdout:2/377: chown d9/d23/d26/f6a 61098320 1 2024-09-06T14:44:27.683 INFO:tasks.workunit.client.1.smithi165.stdout:6/400: getdents d29 0 2024-09-06T14:44:27.684 INFO:tasks.workunit.client.1.smithi165.stdout:2/378: symlink d9/d23/d26/d2d/d34/l6f 0 2024-09-06T14:44:27.684 INFO:tasks.workunit.client.1.smithi165.stdout:6/401: chown d29/f41 0 1 2024-09-06T14:44:27.685 INFO:tasks.workunit.client.1.smithi165.stdout:2/379: mknod d9/d25/d45/c70 0 2024-09-06T14:44:27.689 INFO:tasks.workunit.client.1.smithi165.stdout:2/380: getdents d9 0 2024-09-06T14:44:27.690 INFO:tasks.workunit.client.1.smithi165.stdout:9/572: dread db/de/d16/f66 [0,4194304] 0 2024-09-06T14:44:27.691 INFO:tasks.workunit.client.1.smithi165.stdout:5/399: write d6/d1c/d28/f2c [135049,100646] 0 2024-09-06T14:44:27.691 INFO:tasks.workunit.client.1.smithi165.stdout:2/381: mkdir d9/d23/d71 0 2024-09-06T14:44:27.692 INFO:tasks.workunit.client.1.smithi165.stdout:5/400: dread - d6/f2a zero size 2024-09-06T14:44:27.692 INFO:tasks.workunit.client.1.smithi165.stdout:9/573: symlink db/de/d15/d17/dad/d97/lb8 0 2024-09-06T14:44:27.696 INFO:tasks.workunit.client.1.smithi165.stdout:5/401: mknod d6/d1c/d28/d88/c99 0 2024-09-06T14:44:27.696 INFO:tasks.workunit.client.1.smithi165.stdout:2/382: creat d9/d23/d71/f72 x:0 0 0 2024-09-06T14:44:27.696 INFO:tasks.workunit.client.1.smithi165.stdout:1/345: dread d0/d2a/fb [0,4194304] 0 2024-09-06T14:44:27.697 INFO:tasks.workunit.client.1.smithi165.stdout:2/383: write d9/d23/d71/f72 [380957,74256] 0 2024-09-06T14:44:27.698 INFO:tasks.workunit.client.1.smithi165.stdout:1/346: chown d0/d2a/d18/d24/d4b/d5f/f60 8773863 1 2024-09-06T14:44:27.699 INFO:tasks.workunit.client.1.smithi165.stdout:9/574: dread db/de/d15/d17/d18/f84 [0,4194304] 0 2024-09-06T14:44:27.702 INFO:tasks.workunit.client.1.smithi165.stdout:1/347: rename d0/d2a/d18/d24/d4b/f64 to d0/d2a/d1b/d2b/f70 0 2024-09-06T14:44:27.706 INFO:tasks.workunit.client.1.smithi165.stdout:1/348: link d0/d2a/d18/d24/d4b/d5f/f61 d0/d2a/d23/d56/f71 0 2024-09-06T14:44:27.708 INFO:tasks.workunit.client.1.smithi165.stdout:1/349: read d0/d1c/d1d/d22/f2e [699223,122815] 0 2024-09-06T14:44:27.709 INFO:tasks.workunit.client.1.smithi165.stdout:9/575: dwrite db/de/d16/d2e/f3b [0,4194304] 0 2024-09-06T14:44:27.711 INFO:tasks.workunit.client.1.smithi165.stdout:5/402: dread d6/d1c/f22 [0,4194304] 0 2024-09-06T14:44:27.711 INFO:tasks.workunit.client.1.smithi165.stdout:1/350: symlink d0/d2a/l72 0 2024-09-06T14:44:27.712 INFO:tasks.workunit.client.1.smithi165.stdout:5/403: chown d6/d32/c6d 2 1 2024-09-06T14:44:27.714 INFO:tasks.workunit.client.1.smithi165.stdout:1/351: creat d0/d2a/d1b/f73 x:0 0 0 2024-09-06T14:44:27.715 INFO:tasks.workunit.client.1.smithi165.stdout:5/404: dread d6/d1c/d28/f2c [0,4194304] 0 2024-09-06T14:44:27.715 INFO:tasks.workunit.client.1.smithi165.stdout:1/352: write d0/d2a/d1b/f73 [417597,28969] 0 2024-09-06T14:44:27.715 INFO:tasks.workunit.client.1.smithi165.stdout:5/405: readlink d6/l6c 0 2024-09-06T14:44:27.716 INFO:tasks.workunit.client.1.smithi165.stdout:9/576: link db/de/ca9 db/de/d15/d17/cb9 0 2024-09-06T14:44:27.720 INFO:tasks.workunit.client.1.smithi165.stdout:1/353: symlink d0/d2a/d18/d24/l74 0 2024-09-06T14:44:27.725 INFO:tasks.workunit.client.1.smithi165.stdout:5/406: dwrite d6/d1c/d28/d4b/d55/f87 [0,4194304] 0 2024-09-06T14:44:27.726 INFO:tasks.workunit.client.1.smithi165.stdout:9/577: dwrite db/de/d15/d17/d18/d7d/d61/fa0 [0,4194304] 0 2024-09-06T14:44:27.729 INFO:tasks.workunit.client.1.smithi165.stdout:5/407: symlink d6/l9a 0 2024-09-06T14:44:27.729 INFO:tasks.workunit.client.1.smithi165.stdout:1/354: dwrite d0/d2a/fe [0,4194304] 0 2024-09-06T14:44:27.730 INFO:tasks.workunit.client.1.smithi165.stdout:9/578: dread db/de/fb1 [0,4194304] 0 2024-09-06T14:44:27.731 INFO:tasks.workunit.client.1.smithi165.stdout:9/579: readlink db/de/d16/l21 0 2024-09-06T14:44:27.733 INFO:tasks.workunit.client.1.smithi165.stdout:1/355: write d0/d2a/fd [4362013,50556] 0 2024-09-06T14:44:27.741 INFO:tasks.workunit.client.1.smithi165.stdout:1/356: mkdir d0/d2a/d1b/d68/d75 0 2024-09-06T14:44:27.742 INFO:tasks.workunit.client.1.smithi165.stdout:5/408: link d6/d1c/d28/d2d/d3c/d81/l5b d6/d1c/d28/d4b/d55/d8a/l9b 0 2024-09-06T14:44:27.742 INFO:tasks.workunit.client.1.smithi165.stdout:1/357: write d0/d2a/d18/d24/d4b/d5f/f60 [123109,15795] 0 2024-09-06T14:44:27.748 INFO:tasks.workunit.client.1.smithi165.stdout:5/409: dwrite d6/d1c/f1e [0,4194304] 0 2024-09-06T14:44:27.752 INFO:tasks.workunit.client.1.smithi165.stdout:5/410: creat d6/d1c/f9c x:0 0 0 2024-09-06T14:44:27.756 INFO:tasks.workunit.client.1.smithi165.stdout:5/411: dread d6/d1c/d28/f6b [0,4194304] 0 2024-09-06T14:44:27.758 INFO:tasks.workunit.client.1.smithi165.stdout:1/358: truncate d0/d2a/fb 3129719 0 2024-09-06T14:44:27.758 INFO:tasks.workunit.client.1.smithi165.stdout:5/412: write d6/f13 [104956,756] 0 2024-09-06T14:44:27.761 INFO:tasks.workunit.client.1.smithi165.stdout:9/580: dwrite db/de/d15/d17/f4c [0,4194304] 0 2024-09-06T14:44:27.763 INFO:tasks.workunit.client.1.smithi165.stdout:1/359: dread d0/d2a/d1b/f3a [0,4194304] 0 2024-09-06T14:44:27.765 INFO:tasks.workunit.client.1.smithi165.stdout:9/581: symlink db/de/d15/d17/dad/lba 0 2024-09-06T14:44:27.765 INFO:tasks.workunit.client.1.smithi165.stdout:5/413: link d6/d1c/d28/d4b/l7a d6/d1c/d28/l9d 0 2024-09-06T14:44:27.766 INFO:tasks.workunit.client.1.smithi165.stdout:5/414: truncate d6/f2a 642955 0 2024-09-06T14:44:27.767 INFO:tasks.workunit.client.1.smithi165.stdout:1/360: symlink d0/d1c/d1d/d22/l76 0 2024-09-06T14:44:27.768 INFO:tasks.workunit.client.1.smithi165.stdout:9/582: creat db/de/d15/d17/dad/fbb x:0 0 0 2024-09-06T14:44:27.769 INFO:tasks.workunit.client.1.smithi165.stdout:5/415: creat d6/d1c/d28/d2d/d3c/f9e x:0 0 0 2024-09-06T14:44:27.771 INFO:tasks.workunit.client.1.smithi165.stdout:1/361: rename d0/l9 to d0/d1c/d1d/d22/l77 0 2024-09-06T14:44:27.771 INFO:tasks.workunit.client.1.smithi165.stdout:9/583: mkdir db/de/d15/d7f/dbc 0 2024-09-06T14:44:27.774 INFO:tasks.workunit.client.1.smithi165.stdout:1/362: rename d0/d2a/d1b/d2b/c31 to d0/d2a/d1b/c78 0 2024-09-06T14:44:27.774 INFO:tasks.workunit.client.1.smithi165.stdout:5/416: link d6/d1c/d28/f6b d6/d1c/d28/d2d/d3c/d81/d8e/f9f 0 2024-09-06T14:44:27.775 INFO:tasks.workunit.client.1.smithi165.stdout:1/363: chown d0/d2a/d1b/d2b/c54 6629 1 2024-09-06T14:44:27.775 INFO:tasks.workunit.client.1.smithi165.stdout:5/417: rmdir d6/d1c/d28/d2d 39 2024-09-06T14:44:27.777 INFO:tasks.workunit.client.1.smithi165.stdout:5/418: creat d6/d1c/d28/d4b/d55/d8a/fa0 x:0 0 0 2024-09-06T14:44:27.781 INFO:tasks.workunit.client.1.smithi165.stdout:1/364: dwrite d0/d2a/fd [0,4194304] 0 2024-09-06T14:44:27.782 INFO:tasks.workunit.client.1.smithi165.stdout:5/419: mknod d6/d1c/d28/d2d/d3c/d44/d82/ca1 0 2024-09-06T14:44:27.783 INFO:tasks.workunit.client.1.smithi165.stdout:1/365: symlink d0/d2a/d23/d56/l79 0 2024-09-06T14:44:27.784 INFO:tasks.workunit.client.1.smithi165.stdout:5/420: fdatasync d6/d1c/d28/f43 0 2024-09-06T14:44:27.785 INFO:tasks.workunit.client.1.smithi165.stdout:1/366: write d0/d1c/d40/f4d [1122382,110995] 0 2024-09-06T14:44:27.785 INFO:tasks.workunit.client.1.smithi165.stdout:5/421: write d6/d1c/f76 [1336838,24346] 0 2024-09-06T14:44:27.790 INFO:tasks.workunit.client.1.smithi165.stdout:5/422: symlink d6/d1c/d28/d2d/d3c/d44/d82/la2 0 2024-09-06T14:44:27.793 INFO:tasks.workunit.client.1.smithi165.stdout:5/423: fdatasync d6/d32/f33 0 2024-09-06T14:44:27.806 INFO:tasks.workunit.client.1.smithi165.stdout:1/367: dread d0/f59 [0,4194304] 0 2024-09-06T14:44:27.817 INFO:tasks.workunit.client.1.smithi165.stdout:4/379: sync 2024-09-06T14:44:27.819 INFO:tasks.workunit.client.1.smithi165.stdout:4/380: creat d5/f86 x:0 0 0 2024-09-06T14:44:27.821 INFO:tasks.workunit.client.1.smithi165.stdout:4/381: creat d5/d1b/d1c/d20/d75/d83/f87 x:0 0 0 2024-09-06T14:44:27.822 INFO:tasks.workunit.client.1.smithi165.stdout:4/382: truncate d5/d1b/d1c/d20/f24 1593769 0 2024-09-06T14:44:27.823 INFO:tasks.workunit.client.1.smithi165.stdout:4/383: creat d5/d1b/d1c/d20/d26/f88 x:0 0 0 2024-09-06T14:44:27.824 INFO:tasks.workunit.client.1.smithi165.stdout:4/384: mknod d5/d1b/d61/d77/c89 0 2024-09-06T14:44:27.830 INFO:tasks.workunit.client.1.smithi165.stdout:4/385: truncate d5/d1b/d1c/d20/f27 747350 0 2024-09-06T14:44:27.888 INFO:tasks.workunit.client.1.smithi165.stdout:4/386: truncate d5/d1b/d1c/d20/d26/f4b 4054352 0 2024-09-06T14:44:27.895 INFO:tasks.workunit.client.1.smithi165.stdout:4/387: dwrite d5/d1b/d1c/f6b [0,4194304] 0 2024-09-06T14:44:27.924 INFO:tasks.workunit.client.1.smithi165.stdout:4/388: write d5/d1b/d1c/f34 [2437226,53335] 0 2024-09-06T14:44:27.924 INFO:tasks.workunit.client.1.smithi165.stdout:4/389: fdatasync d5/f2c 0 2024-09-06T14:44:27.925 INFO:tasks.workunit.client.1.smithi165.stdout:4/390: fdatasync d5/d1b/d1c/d55/f56 0 2024-09-06T14:44:27.926 INFO:tasks.workunit.client.1.smithi165.stdout:4/391: fdatasync d5/d1b/d66/f7f 0 2024-09-06T14:44:27.928 INFO:tasks.workunit.client.1.smithi165.stdout:4/392: chown d5/fc 2214 1 2024-09-06T14:44:28.060 INFO:tasks.workunit.client.1.smithi165.stdout:7/342: sync 2024-09-06T14:44:28.060 INFO:tasks.workunit.client.1.smithi165.stdout:3/391: sync 2024-09-06T14:44:28.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:27 smithi165 ceph-mon[36229]: pgmap v16: 65 pgs: 65 active+clean; 420 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 34 MiB/s wr, 250 op/s 2024-09-06T14:44:28.094 INFO:tasks.workunit.client.1.smithi165.stdout:3/392: truncate d1/da/dd/d4b/f5f 5701186 0 2024-09-06T14:44:28.095 INFO:tasks.workunit.client.1.smithi165.stdout:3/393: truncate d1/d19/f3e 516707 0 2024-09-06T14:44:28.100 INFO:tasks.workunit.client.1.smithi165.stdout:3/394: dwrite d1/da/dc/d10/f1a [0,4194304] 0 2024-09-06T14:44:28.103 INFO:tasks.workunit.client.1.smithi165.stdout:3/395: creat d1/da/dc/d3b/f82 x:0 0 0 2024-09-06T14:44:28.104 INFO:tasks.workunit.client.1.smithi165.stdout:3/396: fdatasync d1/d19/f34 0 2024-09-06T14:44:28.108 INFO:tasks.workunit.client.1.smithi165.stdout:3/397: mkdir d1/da/dc/d3b/d83 0 2024-09-06T14:44:28.108 INFO:tasks.workunit.client.1.smithi165.stdout:3/398: write d1/d19/f3e [195958,53264] 0 2024-09-06T14:44:28.108 INFO:tasks.workunit.client.1.smithi165.stdout:3/399: stat d1/da/dc 0 2024-09-06T14:44:28.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:27 smithi052 ceph-mon[28627]: pgmap v16: 65 pgs: 65 active+clean; 420 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 34 MiB/s wr, 250 op/s 2024-09-06T14:44:28.128 INFO:tasks.workunit.client.1.smithi165.stdout:8/416: sync 2024-09-06T14:44:28.130 INFO:tasks.workunit.client.1.smithi165.stdout:8/417: mknod d0/d19/d36/d2d/d3f/c97 0 2024-09-06T14:44:28.131 INFO:tasks.workunit.client.1.smithi165.stdout:3/400: truncate d1/f2 2243247 0 2024-09-06T14:44:28.132 INFO:tasks.workunit.client.1.smithi165.stdout:8/418: write d0/d19/d24/d26/f6f [850905,128072] 0 2024-09-06T14:44:28.134 INFO:tasks.workunit.client.1.smithi165.stdout:8/419: mknod d0/d14/d50/d8c/c98 0 2024-09-06T14:44:28.137 INFO:tasks.workunit.client.1.smithi165.stdout:8/420: creat d0/d5e/d65/f99 x:0 0 0 2024-09-06T14:44:28.138 INFO:tasks.workunit.client.1.smithi165.stdout:8/421: dread - d0/d34/d6b/d94/d70/f88 zero size 2024-09-06T14:44:28.142 INFO:tasks.workunit.client.1.smithi165.stdout:3/401: dwrite d1/da/dd/f1c [0,4194304] 0 2024-09-06T14:44:28.143 INFO:tasks.workunit.client.1.smithi165.stdout:3/402: chown d1/da/dc/f3a 32 1 2024-09-06T14:44:28.145 INFO:tasks.workunit.client.1.smithi165.stdout:3/403: truncate d1/da/f2a 560343 0 2024-09-06T14:44:28.146 INFO:tasks.workunit.client.1.smithi165.stdout:3/404: read - d1/d4a/f7d zero size 2024-09-06T14:44:28.147 INFO:tasks.workunit.client.1.smithi165.stdout:3/405: chown d1/da/c70 7133 1 2024-09-06T14:44:28.148 INFO:tasks.workunit.client.1.smithi165.stdout:3/406: fsync d1/da/dd/f15 0 2024-09-06T14:44:28.154 INFO:tasks.workunit.client.1.smithi165.stdout:3/407: dwrite d1/da/dc/f39 [0,4194304] 0 2024-09-06T14:44:28.157 INFO:tasks.workunit.client.1.smithi165.stdout:3/408: creat d1/f84 x:0 0 0 2024-09-06T14:44:28.157 INFO:tasks.workunit.client.1.smithi165.stdout:8/422: dread d0/d19/d36/f2e [0,4194304] 0 2024-09-06T14:44:28.158 INFO:tasks.workunit.client.1.smithi165.stdout:8/423: write d0/d19/d24/f37 [1676976,72958] 0 2024-09-06T14:44:28.160 INFO:tasks.workunit.client.1.smithi165.stdout:8/424: write d0/d19/d36/f44 [2025425,109209] 0 2024-09-06T14:44:28.162 INFO:tasks.workunit.client.1.smithi165.stdout:0/355: sync 2024-09-06T14:44:28.163 INFO:tasks.workunit.client.1.smithi165.stdout:6/402: sync 2024-09-06T14:44:28.163 INFO:tasks.workunit.client.1.smithi165.stdout:5/424: sync 2024-09-06T14:44:28.163 INFO:tasks.workunit.client.1.smithi165.stdout:4/393: sync 2024-09-06T14:44:28.163 INFO:tasks.workunit.client.1.smithi165.stdout:7/343: sync 2024-09-06T14:44:28.163 INFO:tasks.workunit.client.1.smithi165.stdout:9/584: sync 2024-09-06T14:44:28.163 INFO:tasks.workunit.client.1.smithi165.stdout:1/368: sync 2024-09-06T14:44:28.163 INFO:tasks.workunit.client.1.smithi165.stdout:2/384: sync 2024-09-06T14:44:28.165 INFO:tasks.workunit.client.1.smithi165.stdout:8/425: rename d0/d19/d36/f44 to d0/d19/d7f/f9a 0 2024-09-06T14:44:28.168 INFO:tasks.workunit.client.1.smithi165.stdout:2/385: read d9/d23/d26/f3c [2916105,113796] 0 2024-09-06T14:44:28.168 INFO:tasks.workunit.client.1.smithi165.stdout:3/409: dwrite d1/da/dd/f2c [4194304,4194304] 0 2024-09-06T14:44:28.168 INFO:tasks.workunit.client.1.smithi165.stdout:6/403: write d29/d6a/d6c/f6e [214913,130462] 0 2024-09-06T14:44:28.169 INFO:tasks.workunit.client.1.smithi165.stdout:8/426: write d0/d19/f3b [1081513,29997] 0 2024-09-06T14:44:28.173 INFO:tasks.workunit.client.1.smithi165.stdout:7/344: mkdir d20/d33/d6a 0 2024-09-06T14:44:28.173 INFO:tasks.workunit.client.1.smithi165.stdout:6/404: fsync d29/d32/f5e 0 2024-09-06T14:44:28.174 INFO:tasks.workunit.client.1.smithi165.stdout:2/386: chown d9/d23/d71/f72 49278 1 2024-09-06T14:44:28.176 INFO:tasks.workunit.client.1.smithi165.stdout:3/410: symlink d1/da/l85 0 2024-09-06T14:44:28.178 INFO:tasks.workunit.client.1.smithi165.stdout:5/425: rename d6/d1c/d28/d4b/l66 to d6/d1c/d28/d2d/d3c/d44/la3 0 2024-09-06T14:44:28.179 INFO:tasks.workunit.client.1.smithi165.stdout:6/405: mknod d29/c74 0 2024-09-06T14:44:28.179 INFO:tasks.workunit.client.1.smithi165.stdout:1/369: dread d0/d2a/d18/f43 [0,4194304] 0 2024-09-06T14:44:28.180 INFO:tasks.workunit.client.1.smithi165.stdout:9/585: link db/de/d15/d17/c85 db/de/d15/d17/d86/cbd 0 2024-09-06T14:44:28.180 INFO:tasks.workunit.client.1.smithi165.stdout:2/387: chown d9/d23/d26/d2d/d34/c53 800565953 1 2024-09-06T14:44:28.181 INFO:tasks.workunit.client.1.smithi165.stdout:7/345: mknod d20/d3b/d69/c6b 0 2024-09-06T14:44:28.184 INFO:tasks.workunit.client.1.smithi165.stdout:5/426: chown d6/c77 314910172 1 2024-09-06T14:44:28.185 INFO:tasks.workunit.client.1.smithi165.stdout:0/356: dwrite fb [0,4194304] 0 2024-09-06T14:44:28.185 INFO:tasks.workunit.client.1.smithi165.stdout:6/406: creat d29/d6a/f75 x:0 0 0 2024-09-06T14:44:28.186 INFO:tasks.workunit.client.1.smithi165.stdout:6/407: stat f1c 0 2024-09-06T14:44:28.187 INFO:tasks.workunit.client.1.smithi165.stdout:8/427: rename d0/d19/d36/fa to d0/d19/d36/d2d/d3f/f9b 0 2024-09-06T14:44:28.190 INFO:tasks.workunit.client.1.smithi165.stdout:4/394: dread d5/d1b/d1c/d20/d75/d83/f53 [0,4194304] 0 2024-09-06T14:44:28.190 INFO:tasks.workunit.client.1.smithi165.stdout:3/411: mkdir d1/da/dc/d3b/d83/d86 0 2024-09-06T14:44:28.191 INFO:tasks.workunit.client.1.smithi165.stdout:9/586: fsync db/de/fb1 0 2024-09-06T14:44:28.193 INFO:tasks.workunit.client.1.smithi165.stdout:9/587: chown db/de/d15/d17/d72 11108 1 2024-09-06T14:44:28.247 INFO:tasks.workunit.client.1.smithi165.stdout:6/408: mknod d29/d39/d5b/d62/d67/c76 0 2024-09-06T14:44:28.249 INFO:tasks.workunit.client.1.smithi165.stdout:6/409: fsync f3 0 2024-09-06T14:44:28.249 INFO:tasks.workunit.client.1.smithi165.stdout:4/395: fsync d5/d1b/d1c/f60 0 2024-09-06T14:44:28.250 INFO:tasks.workunit.client.1.smithi165.stdout:1/370: write d0/d2a/d18/d24/d4b/d5f/f61 [2739960,93601] 0 2024-09-06T14:44:28.251 INFO:tasks.workunit.client.1.smithi165.stdout:8/428: fdatasync d0/d19/d36/fe 0 2024-09-06T14:44:28.252 INFO:tasks.workunit.client.1.smithi165.stdout:6/410: stat d29/d32/c3e 0 2024-09-06T14:44:28.254 INFO:tasks.workunit.client.1.smithi165.stdout:1/371: chown d0/d1c/d41 1 1 2024-09-06T14:44:28.254 INFO:tasks.workunit.client.1.smithi165.stdout:5/427: getdents d6/d1c/d28/d2d/d3c/d81 0 2024-09-06T14:44:28.255 INFO:tasks.workunit.client.1.smithi165.stdout:3/412: dwrite d1/f84 [0,4194304] 0 2024-09-06T14:44:28.256 INFO:tasks.workunit.client.1.smithi165.stdout:1/372: chown d0/d1c 171722 1 2024-09-06T14:44:28.256 INFO:tasks.workunit.client.1.smithi165.stdout:8/429: mknod d0/d5e/c9c 0 2024-09-06T14:44:28.258 INFO:tasks.workunit.client.1.smithi165.stdout:5/428: chown d6/l31 94504 1 2024-09-06T14:44:28.258 INFO:tasks.workunit.client.1.smithi165.stdout:2/388: dwrite d9/f1d [0,4194304] 0 2024-09-06T14:44:28.259 INFO:tasks.workunit.client.1.smithi165.stdout:5/429: chown d6/l9a 240 1 2024-09-06T14:44:28.260 INFO:tasks.workunit.client.1.smithi165.stdout:8/430: dread - d0/d19/d7f/f82 zero size 2024-09-06T14:44:28.261 INFO:tasks.workunit.client.1.smithi165.stdout:6/411: getdents d29/d32 0 2024-09-06T14:44:28.262 INFO:tasks.workunit.client.1.smithi165.stdout:3/413: creat d1/d19/d4d/f87 x:0 0 0 2024-09-06T14:44:28.263 INFO:tasks.workunit.client.1.smithi165.stdout:7/346: dwrite d20/d33/d53/f67 [0,4194304] 0 2024-09-06T14:44:28.265 INFO:tasks.workunit.client.1.smithi165.stdout:1/373: dread d0/d1c/d1d/d22/f2e [0,4194304] 0 2024-09-06T14:44:28.266 INFO:tasks.workunit.client.1.smithi165.stdout:8/431: write d0/d19/d36/fb [112755,32564] 0 2024-09-06T14:44:28.267 INFO:tasks.workunit.client.1.smithi165.stdout:2/389: write d9/d23/d26/f6a [530763,43773] 0 2024-09-06T14:44:28.274 INFO:tasks.workunit.client.1.smithi165.stdout:5/430: rename d6/f1d to d6/d1c/d28/d4b/d60/fa4 0 2024-09-06T14:44:28.276 INFO:tasks.workunit.client.1.smithi165.stdout:8/432: creat d0/d19/d7f/f9d x:0 0 0 2024-09-06T14:44:28.278 INFO:tasks.workunit.client.1.smithi165.stdout:7/347: rename d20/f24 to d20/d65/f6c 0 2024-09-06T14:44:28.278 INFO:tasks.workunit.client.1.smithi165.stdout:2/390: dread d9/d23/d26/f6a [0,4194304] 0 2024-09-06T14:44:28.279 INFO:tasks.workunit.client.1.smithi165.stdout:5/431: chown d6/d1c/d64/f6e 61 1 2024-09-06T14:44:28.279 INFO:tasks.workunit.client.1.smithi165.stdout:6/412: dwrite f1e [0,4194304] 0 2024-09-06T14:44:28.281 INFO:tasks.workunit.client.1.smithi165.stdout:1/374: dwrite d0/d1c/d1d/f3c [0,4194304] 0 2024-09-06T14:44:28.281 INFO:tasks.workunit.client.1.smithi165.stdout:5/432: chown d6/f16 0 1 2024-09-06T14:44:28.282 INFO:tasks.workunit.client.1.smithi165.stdout:2/391: write d9/d23/d29/d48/f4d [336750,49066] 0 2024-09-06T14:44:28.282 INFO:tasks.workunit.client.1.smithi165.stdout:8/433: mkdir d0/d9e 0 2024-09-06T14:44:28.283 INFO:tasks.workunit.client.1.smithi165.stdout:3/414: getdents d1/d7c 0 2024-09-06T14:44:28.285 INFO:tasks.workunit.client.1.smithi165.stdout:5/433: write d6/d1c/f76 [4158658,66336] 0 2024-09-06T14:44:28.286 INFO:tasks.workunit.client.1.smithi165.stdout:8/434: read - d0/d19/d7f/f82 zero size 2024-09-06T14:44:28.288 INFO:tasks.workunit.client.1.smithi165.stdout:6/413: unlink d29/f3f 0 2024-09-06T14:44:28.289 INFO:tasks.workunit.client.1.smithi165.stdout:1/375: creat d0/d1c/d40/f7a x:0 0 0 2024-09-06T14:44:28.290 INFO:tasks.workunit.client.1.smithi165.stdout:2/392: fdatasync d9/f1a 0 2024-09-06T14:44:28.298 INFO:tasks.workunit.client.1.smithi165.stdout:2/393: write d9/d25/f40 [605355,11764] 0 2024-09-06T14:44:28.300 INFO:tasks.workunit.client.1.smithi165.stdout:8/435: rename d0/d34/f79 to d0/d5e/d65/f9f 0 2024-09-06T14:44:28.302 INFO:tasks.workunit.client.1.smithi165.stdout:7/348: dwrite d20/d3b/f3f [0,4194304] 0 2024-09-06T14:44:28.302 INFO:tasks.workunit.client.1.smithi165.stdout:6/414: truncate f1d 4210970 0 2024-09-06T14:44:28.303 INFO:tasks.workunit.client.1.smithi165.stdout:8/436: chown d0/d19/d36/d2d/d33/d3a/d46 30 1 2024-09-06T14:44:28.304 INFO:tasks.workunit.client.1.smithi165.stdout:3/415: rename d1/da/dc/f3a to d1/da/dc/f88 0 2024-09-06T14:44:28.307 INFO:tasks.workunit.client.1.smithi165.stdout:1/376: rename d0/d2a/fe to d0/d2a/d1b/d2b/d3e/f7b 0 2024-09-06T14:44:28.307 INFO:tasks.workunit.client.1.smithi165.stdout:2/394: mknod d9/d25/d45/d69/c73 0 2024-09-06T14:44:28.308 INFO:tasks.workunit.client.1.smithi165.stdout:6/415: mknod d29/d39/c77 0 2024-09-06T14:44:28.308 INFO:tasks.workunit.client.1.smithi165.stdout:3/416: chown d1/l7 52499415 1 2024-09-06T14:44:28.309 INFO:tasks.workunit.client.1.smithi165.stdout:2/395: chown d9/d23/d71/f72 0 1 2024-09-06T14:44:28.312 INFO:tasks.workunit.client.1.smithi165.stdout:6/416: chown d29/d32/c3a 699257 1 2024-09-06T14:44:28.313 INFO:tasks.workunit.client.1.smithi165.stdout:1/377: mkdir d0/d2a/d18/d24/d4b/d5f/d7c 0 2024-09-06T14:44:28.315 INFO:tasks.workunit.client.1.smithi165.stdout:5/434: truncate d6/d1c/d28/d4b/d55/f87 589155 0 2024-09-06T14:44:28.319 INFO:tasks.workunit.client.1.smithi165.stdout:7/349: dread d20/d65/d28/f4e [0,4194304] 0 2024-09-06T14:44:28.319 INFO:tasks.workunit.client.1.smithi165.stdout:5/435: stat d6/d1c/d28/l9d 0 2024-09-06T14:44:28.320 INFO:tasks.workunit.client.1.smithi165.stdout:6/417: dwrite d29/d39/d5b/d68/f6f [0,4194304] 0 2024-09-06T14:44:28.323 INFO:tasks.workunit.client.1.smithi165.stdout:5/436: write d6/d1c/f9c [526065,26062] 0 2024-09-06T14:44:28.323 INFO:tasks.workunit.client.1.smithi165.stdout:1/378: rename d0/c29 to d0/d2a/d1b/d68/c7d 0 2024-09-06T14:44:28.325 INFO:tasks.workunit.client.1.smithi165.stdout:2/396: write d9/d23/d26/f47 [3062999,77201] 0 2024-09-06T14:44:28.325 INFO:tasks.workunit.client.1.smithi165.stdout:3/417: getdents d1/da/d43 0 2024-09-06T14:44:28.327 INFO:tasks.workunit.client.1.smithi165.stdout:7/350: creat d20/d3b/f6d x:0 0 0 2024-09-06T14:44:28.327 INFO:tasks.workunit.client.1.smithi165.stdout:8/437: dwrite d0/d19/d36/f12 [0,4194304] 0 2024-09-06T14:44:28.327 INFO:tasks.workunit.client.1.smithi165.stdout:3/418: stat d1/da/d43 0 2024-09-06T14:44:28.329 INFO:tasks.workunit.client.1.smithi165.stdout:7/351: chown d20/d65/d28/f5d 3355 1 2024-09-06T14:44:28.330 INFO:tasks.workunit.client.1.smithi165.stdout:6/418: creat d29/d39/d5b/f78 x:0 0 0 2024-09-06T14:44:28.333 INFO:tasks.workunit.client.1.smithi165.stdout:3/419: fsync d1/da/dc/f30 0 2024-09-06T14:44:28.333 INFO:tasks.workunit.client.1.smithi165.stdout:1/379: write d0/d2a/d1b/d2b/f4a [611124,13660] 0 2024-09-06T14:44:28.334 INFO:tasks.workunit.client.1.smithi165.stdout:2/397: rename d9/d23/d26/d2d/l37 to d9/d23/d52/l74 0 2024-09-06T14:44:28.334 INFO:tasks.workunit.client.1.smithi165.stdout:8/438: fdatasync d0/d19/d36/d2d/d3f/f4e 0 2024-09-06T14:44:28.336 INFO:tasks.workunit.client.1.smithi165.stdout:6/419: symlink d29/d39/d5b/d62/d67/l79 0 2024-09-06T14:44:28.338 INFO:tasks.workunit.client.1.smithi165.stdout:1/380: mkdir d0/d2a/d23/d7e 0 2024-09-06T14:44:28.340 INFO:tasks.workunit.client.1.smithi165.stdout:5/437: write d6/d1c/d28/d4b/d55/d8a/f8d [1448187,66882] 0 2024-09-06T14:44:28.341 INFO:tasks.workunit.client.1.smithi165.stdout:2/398: rename d9/d23/d26/d2d to d9/d25/d45/d75 0 2024-09-06T14:44:28.343 INFO:tasks.workunit.client.1.smithi165.stdout:6/420: mkdir d29/d32/d7a 0 2024-09-06T14:44:28.344 INFO:tasks.workunit.client.1.smithi165.stdout:1/381: symlink d0/d1c/d1d/d22/l7f 0 2024-09-06T14:44:28.344 INFO:tasks.workunit.client.1.smithi165.stdout:5/438: mkdir d6/d1c/d28/d4b/d55/d8a/da5 0 2024-09-06T14:44:28.345 INFO:tasks.workunit.client.1.smithi165.stdout:7/352: rename d20/d3b/l41 to d20/d4d/l6e 0 2024-09-06T14:44:28.348 INFO:tasks.workunit.client.1.smithi165.stdout:1/382: creat d0/d2a/d23/f80 x:0 0 0 2024-09-06T14:44:28.349 INFO:tasks.workunit.client.1.smithi165.stdout:6/421: read f16 [280813,49391] 0 2024-09-06T14:44:28.352 INFO:tasks.workunit.client.1.smithi165.stdout:7/353: creat d20/f6f x:0 0 0 2024-09-06T14:44:28.354 INFO:tasks.workunit.client.1.smithi165.stdout:8/439: dread d0/f1a [0,4194304] 0 2024-09-06T14:44:28.354 INFO:tasks.workunit.client.1.smithi165.stdout:2/399: dread d9/d23/d29/f2b [0,4194304] 0 2024-09-06T14:44:28.354 INFO:tasks.workunit.client.1.smithi165.stdout:3/420: dwrite d1/d4a/f55 [0,4194304] 0 2024-09-06T14:44:28.358 INFO:tasks.workunit.client.1.smithi165.stdout:6/422: rename l10 to d29/d6a/d6c/l7b 0 2024-09-06T14:44:28.358 INFO:tasks.workunit.client.1.smithi165.stdout:8/440: chown d0/d34/d6b/d94/d68/d69 10480306 1 2024-09-06T14:44:28.359 INFO:tasks.workunit.client.1.smithi165.stdout:3/421: mkdir d1/da/dc/d5d/d89 0 2024-09-06T14:44:28.359 INFO:tasks.workunit.client.1.smithi165.stdout:5/439: dwrite d6/d1c/f38 [0,4194304] 0 2024-09-06T14:44:28.361 INFO:tasks.workunit.client.1.smithi165.stdout:3/422: readlink d1/da/dd/l12 0 2024-09-06T14:44:28.361 INFO:tasks.workunit.client.1.smithi165.stdout:7/354: getdents d20/d33 0 2024-09-06T14:44:28.369 INFO:tasks.workunit.client.1.smithi165.stdout:2/400: rename d9/d23/d26 to d9/d25/d45/d75/d67/d76 0 2024-09-06T14:44:28.375 INFO:tasks.workunit.client.1.smithi165.stdout:1/383: dwrite d0/d1c/d1d/d22/f39 [0,4194304] 0 2024-09-06T14:44:28.376 INFO:tasks.workunit.client.1.smithi165.stdout:1/384: chown d0/d1c/d1d 1840937 1 2024-09-06T14:44:28.376 INFO:tasks.workunit.client.1.smithi165.stdout:1/385: readlink d0/d1c/d1d/d22/l76 0 2024-09-06T14:44:28.376 INFO:tasks.workunit.client.1.smithi165.stdout:5/440: creat d6/d98/fa6 x:0 0 0 2024-09-06T14:44:28.376 INFO:tasks.workunit.client.1.smithi165.stdout:3/423: mknod d1/da/dc/d3b/d83/c8a 0 2024-09-06T14:44:28.380 INFO:tasks.workunit.client.1.smithi165.stdout:2/401: dread d9/f1d [0,4194304] 0 2024-09-06T14:44:28.381 INFO:tasks.workunit.client.1.smithi165.stdout:6/423: truncate d29/d6a/d6c/f6e 71609 0 2024-09-06T14:44:28.382 INFO:tasks.workunit.client.1.smithi165.stdout:6/424: stat f22 0 2024-09-06T14:44:28.383 INFO:tasks.workunit.client.1.smithi165.stdout:3/424: rename d1/d4a/f78 to d1/da/dd/d4b/f8b 0 2024-09-06T14:44:28.390 INFO:tasks.workunit.client.1.smithi165.stdout:5/441: dwrite d6/d1c/f8f [0,4194304] 0 2024-09-06T14:44:28.391 INFO:tasks.workunit.client.1.smithi165.stdout:7/355: dwrite d20/d65/d28/f5d [0,4194304] 0 2024-09-06T14:44:28.393 INFO:tasks.workunit.client.1.smithi165.stdout:6/425: creat d29/d39/d5b/d68/f7c x:0 0 0 2024-09-06T14:44:28.395 INFO:tasks.workunit.client.1.smithi165.stdout:1/386: dwrite d0/d2a/f12 [0,4194304] 0 2024-09-06T14:44:28.398 INFO:tasks.workunit.client.1.smithi165.stdout:5/442: stat d6/d1c/d28/d2d/d61/l8b 0 2024-09-06T14:44:28.401 INFO:tasks.workunit.client.1.smithi165.stdout:3/425: mkdir d1/da/dd/d8c 0 2024-09-06T14:44:28.401 INFO:tasks.workunit.client.1.smithi165.stdout:6/426: unlink d29/d32/f5e 0 2024-09-06T14:44:28.402 INFO:tasks.workunit.client.1.smithi165.stdout:1/387: write d0/d2a/d1b/f30 [1114138,127512] 0 2024-09-06T14:44:28.405 INFO:tasks.workunit.client.1.smithi165.stdout:2/402: dwrite d9/d25/d45/d75/d67/d76/f6a [0,4194304] 0 2024-09-06T14:44:28.407 INFO:tasks.workunit.client.1.smithi165.stdout:1/388: chown d0/d2a/d1b/d2b/c54 10099 1 2024-09-06T14:44:28.407 INFO:tasks.workunit.client.1.smithi165.stdout:7/356: rename f1d to d20/f70 0 2024-09-06T14:44:28.412 INFO:tasks.workunit.client.1.smithi165.stdout:1/389: write d0/d2a/d18/d24/d4b/f51 [4549892,25918] 0 2024-09-06T14:44:28.413 INFO:tasks.workunit.client.1.smithi165.stdout:7/357: write d20/d65/d28/f58 [3383987,7582] 0 2024-09-06T14:44:28.414 INFO:tasks.workunit.client.1.smithi165.stdout:7/358: fdatasync f1f 0 2024-09-06T14:44:28.414 INFO:tasks.workunit.client.1.smithi165.stdout:5/443: dread d6/d1c/f8f [0,4194304] 0 2024-09-06T14:44:28.415 INFO:tasks.workunit.client.1.smithi165.stdout:6/427: dwrite d29/f66 [0,4194304] 0 2024-09-06T14:44:28.416 INFO:tasks.workunit.client.1.smithi165.stdout:1/390: chown d0/d2a/l15 13 1 2024-09-06T14:44:28.416 INFO:tasks.workunit.client.1.smithi165.stdout:7/359: read d20/d65/d28/f5d [751247,66820] 0 2024-09-06T14:44:28.419 INFO:tasks.workunit.client.1.smithi165.stdout:7/360: symlink d20/d33/l71 0 2024-09-06T14:44:28.420 INFO:tasks.workunit.client.1.smithi165.stdout:6/428: read f17 [879152,90543] 0 2024-09-06T14:44:28.421 INFO:tasks.workunit.client.1.smithi165.stdout:6/429: fdatasync d29/d39/d5b/f78 0 2024-09-06T14:44:28.423 INFO:tasks.workunit.client.1.smithi165.stdout:2/403: write d9/f1a [5057050,35854] 0 2024-09-06T14:44:28.424 INFO:tasks.workunit.client.1.smithi165.stdout:6/430: creat d29/d6a/f7d x:0 0 0 2024-09-06T14:44:28.425 INFO:tasks.workunit.client.1.smithi165.stdout:6/431: read f3 [33929,99033] 0 2024-09-06T14:44:28.426 INFO:tasks.workunit.client.1.smithi165.stdout:5/444: write d6/f23 [214953,5090] 0 2024-09-06T14:44:28.428 INFO:tasks.workunit.client.1.smithi165.stdout:3/426: dread d1/f2 [0,4194304] 0 2024-09-06T14:44:28.428 INFO:tasks.workunit.client.1.smithi165.stdout:2/404: rename d9/d23/d71/f72 to d9/d25/d45/d75/d67/d76/f77 0 2024-09-06T14:44:28.429 INFO:tasks.workunit.client.1.smithi165.stdout:1/391: truncate d0/d2a/d1b/d2b/f50 1154658 0 2024-09-06T14:44:28.430 INFO:tasks.workunit.client.1.smithi165.stdout:0/357: sync 2024-09-06T14:44:28.431 INFO:tasks.workunit.client.1.smithi165.stdout:6/432: creat d29/d39/d5b/d62/f7e x:0 0 0 2024-09-06T14:44:28.431 INFO:tasks.workunit.client.1.smithi165.stdout:5/445: rmdir d6/d1c/d28/d2d/d49 39 2024-09-06T14:44:28.432 INFO:tasks.workunit.client.1.smithi165.stdout:1/392: write d0/d2a/d1b/f30 [805018,108239] 0 2024-09-06T14:44:28.432 INFO:tasks.workunit.client.1.smithi165.stdout:2/405: mkdir d9/d3b/d78 0 2024-09-06T14:44:28.432 INFO:tasks.workunit.client.1.smithi165.stdout:3/427: symlink d1/da/dc/d5d/l8d 0 2024-09-06T14:44:28.434 INFO:tasks.workunit.client.1.smithi165.stdout:6/433: write d29/f5c [132090,117139] 0 2024-09-06T14:44:28.435 INFO:tasks.workunit.client.1.smithi165.stdout:5/446: mkdir d6/d1c/d28/d4b/da7 0 2024-09-06T14:44:28.435 INFO:tasks.workunit.client.1.smithi165.stdout:1/393: fdatasync d0/d2a/d1b/d2b/f4a 0 2024-09-06T14:44:28.437 INFO:tasks.workunit.client.1.smithi165.stdout:2/406: write d9/d23/d29/d48/f4d [658073,95836] 0 2024-09-06T14:44:28.438 INFO:tasks.workunit.client.1.smithi165.stdout:3/428: creat d1/da/f8e x:0 0 0 2024-09-06T14:44:28.438 INFO:tasks.workunit.client.1.smithi165.stdout:5/447: truncate d6/d32/f84 476821 0 2024-09-06T14:44:28.440 INFO:tasks.workunit.client.1.smithi165.stdout:6/434: symlink d29/d6a/d71/l7f 0 2024-09-06T14:44:28.440 INFO:tasks.workunit.client.1.smithi165.stdout:6/435: readlink d29/d39/l45 0 2024-09-06T14:44:28.441 INFO:tasks.workunit.client.1.smithi165.stdout:6/436: readlink d29/l37 0 2024-09-06T14:44:28.442 INFO:tasks.workunit.client.1.smithi165.stdout:1/394: rename d0/d2a/l13 to d0/d2a/d18/l81 0 2024-09-06T14:44:28.443 INFO:tasks.workunit.client.1.smithi165.stdout:7/361: dread f1f [0,4194304] 0 2024-09-06T14:44:28.443 INFO:tasks.workunit.client.1.smithi165.stdout:6/437: rmdir d29/d32 39 2024-09-06T14:44:28.444 INFO:tasks.workunit.client.1.smithi165.stdout:5/448: dread d6/d1c/f1e [0,4194304] 0 2024-09-06T14:44:28.444 INFO:tasks.workunit.client.1.smithi165.stdout:6/438: write d29/f66 [820839,73704] 0 2024-09-06T14:44:28.445 INFO:tasks.workunit.client.1.smithi165.stdout:2/407: creat d9/d3b/d78/f79 x:0 0 0 2024-09-06T14:44:28.445 INFO:tasks.workunit.client.1.smithi165.stdout:6/439: chown d29 3 1 2024-09-06T14:44:28.446 INFO:tasks.workunit.client.1.smithi165.stdout:7/362: fsync f12 0 2024-09-06T14:44:28.448 INFO:tasks.workunit.client.1.smithi165.stdout:5/449: dread d6/f21 [0,4194304] 0 2024-09-06T14:44:28.452 INFO:tasks.workunit.client.1.smithi165.stdout:6/440: stat d29/d32/d7a 0 2024-09-06T14:44:28.452 INFO:tasks.workunit.client.1.smithi165.stdout:6/441: read - d29/d39/d5b/f78 zero size 2024-09-06T14:44:28.453 INFO:tasks.workunit.client.1.smithi165.stdout:2/408: symlink d9/d25/d45/d69/l7a 0 2024-09-06T14:44:28.460 INFO:tasks.workunit.client.1.smithi165.stdout:5/450: creat d6/d1c/d28/d2d/d3c/fa8 x:0 0 0 2024-09-06T14:44:28.461 INFO:tasks.workunit.client.1.smithi165.stdout:5/451: write d6/d1c/d7c/f97 [891237,83590] 0 2024-09-06T14:44:28.463 INFO:tasks.workunit.client.1.smithi165.stdout:6/442: rename d29/d6a/d6c/f72 to d29/d39/d5b/d62/f80 0 2024-09-06T14:44:28.464 INFO:tasks.workunit.client.1.smithi165.stdout:2/409: mkdir d9/d25/d7b 0 2024-09-06T14:44:28.465 INFO:tasks.workunit.client.1.smithi165.stdout:7/363: link d20/d3b/f3f d20/d3b/f72 0 2024-09-06T14:44:28.468 INFO:tasks.workunit.client.1.smithi165.stdout:6/443: mknod d29/d39/d5b/c81 0 2024-09-06T14:44:28.472 INFO:tasks.workunit.client.1.smithi165.stdout:5/452: unlink d6/d1c/d28/d4b/d55/f87 0 2024-09-06T14:44:28.473 INFO:tasks.workunit.client.1.smithi165.stdout:6/444: symlink d29/d39/d5b/d62/d67/l82 0 2024-09-06T14:44:28.475 INFO:tasks.workunit.client.1.smithi165.stdout:2/410: link d9/f12 d9/d25/d46/f7c 0 2024-09-06T14:44:28.478 INFO:tasks.workunit.client.1.smithi165.stdout:5/453: dwrite d6/d1c/d28/f46 [0,4194304] 0 2024-09-06T14:44:28.478 INFO:tasks.workunit.client.1.smithi165.stdout:6/445: mkdir d29/d6a/d83 0 2024-09-06T14:44:28.483 INFO:tasks.workunit.client.1.smithi165.stdout:2/411: symlink d9/d25/d45/d75/d67/d76/l7d 0 2024-09-06T14:44:28.485 INFO:tasks.workunit.client.1.smithi165.stdout:7/364: symlink d20/d33/d53/d66/l73 0 2024-09-06T14:44:28.485 INFO:tasks.workunit.client.1.smithi165.stdout:6/446: dread d29/f5c [0,4194304] 0 2024-09-06T14:44:28.487 INFO:tasks.workunit.client.1.smithi165.stdout:2/412: mkdir d9/d25/d46/d7e 0 2024-09-06T14:44:28.488 INFO:tasks.workunit.client.1.smithi165.stdout:6/447: dread - d29/d32/f61 zero size 2024-09-06T14:44:28.489 INFO:tasks.workunit.client.1.smithi165.stdout:1/395: dwrite d0/d2a/fb [0,4194304] 0 2024-09-06T14:44:28.490 INFO:tasks.workunit.client.1.smithi165.stdout:7/365: creat d20/d3b/f74 x:0 0 0 2024-09-06T14:44:28.490 INFO:tasks.workunit.client.1.smithi165.stdout:2/413: chown d9/l19 1103362 1 2024-09-06T14:44:28.492 INFO:tasks.workunit.client.1.smithi165.stdout:6/448: symlink d29/d39/d5b/d62/d67/l84 0 2024-09-06T14:44:28.493 INFO:tasks.workunit.client.1.smithi165.stdout:5/454: dwrite d6/d1c/d28/f6b [0,4194304] 0 2024-09-06T14:44:28.493 INFO:tasks.workunit.client.1.smithi165.stdout:2/414: stat d9/d25/d45/d75/d34/c53 0 2024-09-06T14:44:28.494 INFO:tasks.workunit.client.1.smithi165.stdout:1/396: fdatasync d0/d2a/d1b/f73 0 2024-09-06T14:44:28.496 INFO:tasks.workunit.client.1.smithi165.stdout:6/449: creat d29/d32/f85 x:0 0 0 2024-09-06T14:44:28.498 INFO:tasks.workunit.client.1.smithi165.stdout:1/397: fsync d0/d2a/d1b/f30 0 2024-09-06T14:44:28.498 INFO:tasks.workunit.client.1.smithi165.stdout:5/455: fdatasync d6/d32/f33 0 2024-09-06T14:44:28.499 INFO:tasks.workunit.client.1.smithi165.stdout:2/415: creat d9/d23/d52/f7f x:0 0 0 2024-09-06T14:44:28.500 INFO:tasks.workunit.client.1.smithi165.stdout:5/456: write d6/d1c/f9c [741155,48835] 0 2024-09-06T14:44:28.500 INFO:tasks.workunit.client.1.smithi165.stdout:1/398: read d0/d2a/d1b/d2b/f38 [626211,56789] 0 2024-09-06T14:44:28.505 INFO:tasks.workunit.client.1.smithi165.stdout:1/399: link d0/d1c/d1d/d22/f32 d0/d1c/d1d/d57/f82 0 2024-09-06T14:44:28.511 INFO:tasks.workunit.client.1.smithi165.stdout:2/416: dread d9/d25/d45/d75/d67/d76/f47 [0,4194304] 0 2024-09-06T14:44:28.512 INFO:tasks.workunit.client.1.smithi165.stdout:1/400: dwrite d0/d2a/d1b/d2b/d3e/d69/f6c [0,4194304] 0 2024-09-06T14:44:28.513 INFO:tasks.workunit.client.1.smithi165.stdout:2/417: truncate d9/d25/d45/d75/d34/f6c 864575 0 2024-09-06T14:44:28.515 INFO:tasks.workunit.client.1.smithi165.stdout:1/401: mkdir d0/d2a/d1b/d6a/d83 0 2024-09-06T14:44:28.520 INFO:tasks.workunit.client.1.smithi165.stdout:1/402: write d0/d2a/d18/d24/d4b/d5f/f60 [910993,48141] 0 2024-09-06T14:44:28.520 INFO:tasks.workunit.client.1.smithi165.stdout:1/403: stat d0/d1c/d1d/c3b 0 2024-09-06T14:44:28.520 INFO:tasks.workunit.client.1.smithi165.stdout:2/418: dwrite d9/f35 [0,4194304] 0 2024-09-06T14:44:28.523 INFO:tasks.workunit.client.1.smithi165.stdout:1/404: symlink d0/d2a/d18/d24/l84 0 2024-09-06T14:44:28.525 INFO:tasks.workunit.client.1.smithi165.stdout:2/419: rename d9/d23/l49 to d9/d25/d7b/l80 0 2024-09-06T14:44:28.527 INFO:tasks.workunit.client.1.smithi165.stdout:2/420: mknod d9/d25/d46/c81 0 2024-09-06T14:44:28.528 INFO:tasks.workunit.client.1.smithi165.stdout:1/405: getdents d0 0 2024-09-06T14:44:28.529 INFO:tasks.workunit.client.1.smithi165.stdout:1/406: fsync d0/d2a/d1b/d2b/d3e/f49 0 2024-09-06T14:44:28.533 INFO:tasks.workunit.client.1.smithi165.stdout:1/407: dread d0/d2a/f12 [0,4194304] 0 2024-09-06T14:44:28.569 INFO:tasks.workunit.client.1.smithi165.stdout:9/588: sync 2024-09-06T14:44:28.570 INFO:tasks.workunit.client.1.smithi165.stdout:4/396: sync 2024-09-06T14:44:28.574 INFO:tasks.workunit.client.1.smithi165.stdout:4/397: dwrite d5/d1b/d1c/d41/f44 [0,4194304] 0 2024-09-06T14:44:28.637 INFO:tasks.workunit.client.1.smithi165.stdout:8/441: sync 2024-09-06T14:44:28.637 INFO:tasks.workunit.client.1.smithi165.stdout:0/358: sync 2024-09-06T14:44:28.720 INFO:tasks.workunit.client.1.smithi165.stdout:3/429: sync 2024-09-06T14:44:28.752 INFO:tasks.workunit.client.1.smithi165.stdout:6/450: dread d29/f41 [0,4194304] 0 2024-09-06T14:44:28.753 INFO:tasks.workunit.client.1.smithi165.stdout:2/421: creat d9/d25/d45/d69/f82 x:0 0 0 2024-09-06T14:44:28.756 INFO:tasks.workunit.client.1.smithi165.stdout:4/398: unlink d5/d1b/d1c/d41/f80 0 2024-09-06T14:44:28.772 INFO:tasks.workunit.client.1.smithi165.stdout:0/359: symlink d15/d19/d50/d53/d57/l75 0 2024-09-06T14:44:28.772 INFO:tasks.workunit.client.1.smithi165.stdout:7/366: dread d20/d40/f51 [0,4194304] 0 2024-09-06T14:44:28.772 INFO:tasks.workunit.client.1.smithi165.stdout:8/442: rmdir d0/d19/d36/d2d/d33/d3a/d46/d49 39 2024-09-06T14:44:28.773 INFO:tasks.workunit.client.1.smithi165.stdout:0/360: truncate d15/f5a 1052046 0 2024-09-06T14:44:28.774 INFO:tasks.workunit.client.1.smithi165.stdout:6/451: mkdir d29/d39/d86 0 2024-09-06T14:44:28.775 INFO:tasks.workunit.client.1.smithi165.stdout:2/422: mknod d9/d25/d46/c83 0 2024-09-06T14:44:28.775 INFO:tasks.workunit.client.1.smithi165.stdout:6/452: write d29/d39/d5b/d68/f73 [696078,13168] 0 2024-09-06T14:44:28.778 INFO:tasks.workunit.client.1.smithi165.stdout:1/408: link d0/d2a/d1b/f3a d0/d2a/d1b/d2b/d3e/d69/f85 0 2024-09-06T14:44:28.778 INFO:tasks.workunit.client.1.smithi165.stdout:1/409: readlink d0/d1c/d1d/d22/l7f 0 2024-09-06T14:44:28.781 INFO:tasks.workunit.client.1.smithi165.stdout:4/399: creat d5/f8a x:0 0 0 2024-09-06T14:44:28.781 INFO:tasks.workunit.client.1.smithi165.stdout:8/443: rmdir d0/d19/d36 39 2024-09-06T14:44:28.783 INFO:tasks.workunit.client.1.smithi165.stdout:7/367: mknod d20/d65/d28/d30/c75 0 2024-09-06T14:44:28.784 INFO:tasks.workunit.client.1.smithi165.stdout:0/361: symlink d15/d19/d50/l76 0 2024-09-06T14:44:28.785 INFO:tasks.workunit.client.1.smithi165.stdout:2/423: creat d9/f84 x:0 0 0 2024-09-06T14:44:28.786 INFO:tasks.workunit.client.1.smithi165.stdout:1/410: dwrite d0/d2a/d18/d24/d4b/d5f/f60 [0,4194304] 0 2024-09-06T14:44:28.786 INFO:tasks.workunit.client.1.smithi165.stdout:6/453: mkdir d29/d6a/d6c/d87 0 2024-09-06T14:44:28.787 INFO:tasks.workunit.client.1.smithi165.stdout:1/411: fdatasync d0/d2a/d18/d24/d4b/f51 0 2024-09-06T14:44:28.788 INFO:tasks.workunit.client.1.smithi165.stdout:9/589: rename fa to db/de/d15/fbe 0 2024-09-06T14:44:28.788 INFO:tasks.workunit.client.1.smithi165.stdout:1/412: chown d0/d1c/d41/f5e 9 1 2024-09-06T14:44:28.794 INFO:tasks.workunit.client.1.smithi165.stdout:3/430: rename d1/da/dc/d10/f33 to d1/da/dc/d3b/d83/f8f 0 2024-09-06T14:44:28.794 INFO:tasks.workunit.client.1.smithi165.stdout:9/590: write db/de/d15/d17/dad/d97/fa6 [348420,57469] 0 2024-09-06T14:44:28.795 INFO:tasks.workunit.client.1.smithi165.stdout:0/362: symlink d15/d55/l77 0 2024-09-06T14:44:28.796 INFO:tasks.workunit.client.1.smithi165.stdout:3/431: stat d1/da/dc/f5c 0 2024-09-06T14:44:28.797 INFO:tasks.workunit.client.1.smithi165.stdout:3/432: chown d1/da 6734166 1 2024-09-06T14:44:28.797 INFO:tasks.workunit.client.1.smithi165.stdout:1/413: truncate d0/d1c/d1d/d22/f2e 1532468 0 2024-09-06T14:44:28.798 INFO:tasks.workunit.client.1.smithi165.stdout:9/591: dread - db/de/d15/d17/d86/fb6 zero size 2024-09-06T14:44:28.798 INFO:tasks.workunit.client.1.smithi165.stdout:6/454: dwrite d29/d39/d5b/d68/f7c [0,4194304] 0 2024-09-06T14:44:28.801 INFO:tasks.workunit.client.1.smithi165.stdout:4/400: rename d5/d1b/c4e to d5/d1b/d1c/d20/d75/c8b 0 2024-09-06T14:44:28.802 INFO:tasks.workunit.client.1.smithi165.stdout:3/433: creat d1/d19/f90 x:0 0 0 2024-09-06T14:44:28.802 INFO:tasks.workunit.client.1.smithi165.stdout:4/401: chown d5/le 493 1 2024-09-06T14:44:28.803 INFO:tasks.workunit.client.1.smithi165.stdout:3/434: fsync d1/da/dc/d3b/f82 0 2024-09-06T14:44:28.809 INFO:tasks.workunit.client.1.smithi165.stdout:3/435: creat d1/d19/f91 x:0 0 0 2024-09-06T14:44:28.810 INFO:tasks.workunit.client.1.smithi165.stdout:7/368: dread d20/d33/d53/f57 [0,4194304] 0 2024-09-06T14:44:28.810 INFO:tasks.workunit.client.1.smithi165.stdout:3/436: write d1/d19/f90 [95130,78349] 0 2024-09-06T14:44:28.810 INFO:tasks.workunit.client.1.smithi165.stdout:0/363: rename d15/d19/f20 to d15/d19/d50/d53/d57/f78 0 2024-09-06T14:44:28.812 INFO:tasks.workunit.client.1.smithi165.stdout:4/402: mkdir d5/d1b/d1c/d8c 0 2024-09-06T14:44:28.818 INFO:tasks.workunit.client.1.smithi165.stdout:3/437: dwrite d1/da/f7b [0,4194304] 0 2024-09-06T14:44:28.819 INFO:tasks.workunit.client.1.smithi165.stdout:6/455: rename d29/f4b to d29/d39/d5b/d68/f88 0 2024-09-06T14:44:28.820 INFO:tasks.workunit.client.1.smithi165.stdout:1/414: getdents d0/d1c/d41 0 2024-09-06T14:44:28.821 INFO:tasks.workunit.client.1.smithi165.stdout:1/415: chown d0/d1c/d1d/d22/c3f 6 1 2024-09-06T14:44:28.822 INFO:tasks.workunit.client.1.smithi165.stdout:0/364: fsync d15/d19/d38/f5e 0 2024-09-06T14:44:28.823 INFO:tasks.workunit.client.1.smithi165.stdout:5/457: truncate d6/d32/f33 2635451 0 2024-09-06T14:44:28.827 INFO:tasks.workunit.client.1.smithi165.stdout:7/369: mkdir d20/d76 0 2024-09-06T14:44:28.828 INFO:tasks.workunit.client.1.smithi165.stdout:3/438: mkdir d1/d19/d92 0 2024-09-06T14:44:28.830 INFO:tasks.workunit.client.1.smithi165.stdout:5/458: dwrite d6/f2a [0,4194304] 0 2024-09-06T14:44:28.831 INFO:tasks.workunit.client.1.smithi165.stdout:1/416: creat d0/d2a/d1b/d68/f86 x:0 0 0 2024-09-06T14:44:28.832 INFO:tasks.workunit.client.1.smithi165.stdout:9/592: link db/de/d15/d17/cb9 db/de/d15/d7f/d9b/cbf 0 2024-09-06T14:44:28.833 INFO:tasks.workunit.client.1.smithi165.stdout:5/459: dread d6/f21 [0,4194304] 0 2024-09-06T14:44:28.833 INFO:tasks.workunit.client.1.smithi165.stdout:1/417: fsync d0/d2a/d18/f67 0 2024-09-06T14:44:28.833 INFO:tasks.workunit.client.1.smithi165.stdout:4/403: creat d5/d1b/d1c/d8c/f8d x:0 0 0 2024-09-06T14:44:28.836 INFO:tasks.workunit.client.1.smithi165.stdout:1/418: write d0/d2a/d23/f66 [832656,41467] 0 2024-09-06T14:44:28.837 INFO:tasks.workunit.client.1.smithi165.stdout:7/370: symlink d20/d33/d53/l77 0 2024-09-06T14:44:28.839 INFO:tasks.workunit.client.1.smithi165.stdout:6/456: mkdir d29/d6a/d83/d89 0 2024-09-06T14:44:28.841 INFO:tasks.workunit.client.1.smithi165.stdout:9/593: dread db/de/d16/d2e/f3b [0,4194304] 0 2024-09-06T14:44:28.841 INFO:tasks.workunit.client.1.smithi165.stdout:0/365: mkdir d15/d19/d28/d79 0 2024-09-06T14:44:28.843 INFO:tasks.workunit.client.1.smithi165.stdout:4/404: symlink d5/d1b/d66/l8e 0 2024-09-06T14:44:28.844 INFO:tasks.workunit.client.1.smithi165.stdout:9/594: write db/de/d15/d17/d18/f5d [1229388,124792] 0 2024-09-06T14:44:28.846 INFO:tasks.workunit.client.1.smithi165.stdout:3/439: dwrite d1/da/dd/f61 [0,4194304] 0 2024-09-06T14:44:28.847 INFO:tasks.workunit.client.1.smithi165.stdout:9/595: write db/de/d15/d17/d86/f8c [1007400,68593] 0 2024-09-06T14:44:28.847 INFO:tasks.workunit.client.1.smithi165.stdout:5/460: rename d6/d1c/d28/f2c to d6/d1c/d28/d4b/d55/fa9 0 2024-09-06T14:44:28.849 INFO:tasks.workunit.client.1.smithi165.stdout:5/461: fsync d6/d1c/f76 0 2024-09-06T14:44:28.849 INFO:tasks.workunit.client.1.smithi165.stdout:9/596: chown db/de/d15/d7f/d9b/d6c/d96 31320 1 2024-09-06T14:44:28.850 INFO:tasks.workunit.client.1.smithi165.stdout:6/457: creat d29/d6a/f8a x:0 0 0 2024-09-06T14:44:28.850 INFO:tasks.workunit.client.1.smithi165.stdout:5/462: write d6/d1c/f76 [2371616,104912] 0 2024-09-06T14:44:28.852 INFO:tasks.workunit.client.1.smithi165.stdout:7/371: read d20/d33/d53/f55 [2739589,127413] 0 2024-09-06T14:44:28.855 INFO:tasks.workunit.client.1.smithi165.stdout:0/366: fdatasync d15/d19/d50/d53/d57/f78 0 2024-09-06T14:44:28.858 INFO:tasks.workunit.client.1.smithi165.stdout:4/405: creat d5/d1b/d1c/d55/f8f x:0 0 0 2024-09-06T14:44:28.861 INFO:tasks.workunit.client.1.smithi165.stdout:1/419: read d0/d1c/d1d/d22/f2e [1363745,104644] 0 2024-09-06T14:44:28.863 INFO:tasks.workunit.client.1.smithi165.stdout:1/420: stat d0/d1c/d1d/d22/c3f 0 2024-09-06T14:44:28.865 INFO:tasks.workunit.client.1.smithi165.stdout:0/367: dwrite d15/d19/d28/d3a/d3f/f6f [0,4194304] 0 2024-09-06T14:44:28.865 INFO:tasks.workunit.client.1.smithi165.stdout:2/424: readlink d9/d23/d52/l6d 0 2024-09-06T14:44:28.865 INFO:tasks.workunit.client.1.smithi165.stdout:1/421: readlink d0/d2a/l15 0 2024-09-06T14:44:28.865 INFO:tasks.workunit.client.1.smithi165.stdout:7/372: stat d20/d33/l43 0 2024-09-06T14:44:28.866 INFO:tasks.workunit.client.1.smithi165.stdout:1/422: chown d0/f59 1 1 2024-09-06T14:44:28.866 INFO:tasks.workunit.client.1.smithi165.stdout:1/423: fsync d0/d2a/f53 0 2024-09-06T14:44:28.868 INFO:tasks.workunit.client.1.smithi165.stdout:3/440: symlink d1/d7c/d7e/l93 0 2024-09-06T14:44:28.869 INFO:tasks.workunit.client.1.smithi165.stdout:4/406: creat d5/f90 x:0 0 0 2024-09-06T14:44:28.869 INFO:tasks.workunit.client.1.smithi165.stdout:3/441: fdatasync d1/f37 0 2024-09-06T14:44:28.870 INFO:tasks.workunit.client.1.smithi165.stdout:9/597: dread db/de/d15/d7f/d9b/d6c/f75 [0,4194304] 0 2024-09-06T14:44:28.871 INFO:tasks.workunit.client.1.smithi165.stdout:4/407: read - d5/d1b/d1c/d55/f8f zero size 2024-09-06T14:44:28.874 INFO:tasks.workunit.client.1.smithi165.stdout:2/425: fsync d9/d4f/f5e 0 2024-09-06T14:44:28.879 INFO:tasks.workunit.client.1.smithi165.stdout:1/424: creat d0/d2a/d1b/d68/f87 x:0 0 0 2024-09-06T14:44:28.880 INFO:tasks.workunit.client.1.smithi165.stdout:9/598: fdatasync db/f26 0 2024-09-06T14:44:28.880 INFO:tasks.workunit.client.1.smithi165.stdout:5/463: link d6/ce d6/d1c/d28/d4b/d60/caa 0 2024-09-06T14:44:28.882 INFO:tasks.workunit.client.1.smithi165.stdout:5/464: dread - d6/d1c/d28/d2d/d3c/f80 zero size 2024-09-06T14:44:28.883 INFO:tasks.workunit.client.1.smithi165.stdout:3/442: symlink d1/da/dc/l94 0 2024-09-06T14:44:28.885 INFO:tasks.workunit.client.1.smithi165.stdout:1/425: rename d0/d2a/d23/f6f to d0/d2a/d1b/d68/f88 0 2024-09-06T14:44:28.886 INFO:tasks.workunit.client.1.smithi165.stdout:2/426: symlink d9/d3b/l85 0 2024-09-06T14:44:28.887 INFO:tasks.workunit.client.1.smithi165.stdout:3/443: truncate d1/d19/f3e 730011 0 2024-09-06T14:44:28.888 INFO:tasks.workunit.client.1.smithi165.stdout:0/368: creat d15/d19/d28/f7a x:0 0 0 2024-09-06T14:44:28.889 INFO:tasks.workunit.client.1.smithi165.stdout:9/599: dwrite db/de/d16/d2e/f63 [0,4194304] 0 2024-09-06T14:44:28.891 INFO:tasks.workunit.client.1.smithi165.stdout:1/426: mknod d0/d2a/d23/d56/c89 0 2024-09-06T14:44:28.891 INFO:tasks.workunit.client.1.smithi165.stdout:6/458: write d29/d32/f56 [4338900,5061] 0 2024-09-06T14:44:28.894 INFO:tasks.workunit.client.1.smithi165.stdout:3/444: creat d1/da/dc/d5d/f95 x:0 0 0 2024-09-06T14:44:28.894 INFO:tasks.workunit.client.1.smithi165.stdout:7/373: dread d20/d33/f52 [0,4194304] 0 2024-09-06T14:44:28.896 INFO:tasks.workunit.client.1.smithi165.stdout:3/445: write d1/da/dc/d3b/d71/f7a [783616,56117] 0 2024-09-06T14:44:28.897 INFO:tasks.workunit.client.1.smithi165.stdout:0/369: unlink d15/f16 0 2024-09-06T14:44:28.898 INFO:tasks.workunit.client.1.smithi165.stdout:3/446: dread - d1/d4a/f7d zero size 2024-09-06T14:44:28.899 INFO:tasks.workunit.client.1.smithi165.stdout:9/600: mknod db/de/d15/d17/d86/cc0 0 2024-09-06T14:44:28.901 INFO:tasks.workunit.client.1.smithi165.stdout:3/447: write d1/da/dd/f61 [1296271,87402] 0 2024-09-06T14:44:28.902 INFO:tasks.workunit.client.1.smithi165.stdout:2/427: creat d9/d25/d7b/f86 x:0 0 0 2024-09-06T14:44:28.903 INFO:tasks.workunit.client.1.smithi165.stdout:3/448: readlink d1/l6f 0 2024-09-06T14:44:28.903 INFO:tasks.workunit.client.1.smithi165.stdout:6/459: creat d29/d39/d5b/d62/f8b x:0 0 0 2024-09-06T14:44:28.905 INFO:tasks.workunit.client.1.smithi165.stdout:1/427: rename d0/d2a/d1b/d2b/d3e/c5a to d0/d2a/d18/d24/d4b/d5f/d7c/c8a 0 2024-09-06T14:44:28.906 INFO:tasks.workunit.client.1.smithi165.stdout:7/374: dwrite d20/d65/d28/f58 [0,4194304] 0 2024-09-06T14:44:28.907 INFO:tasks.workunit.client.1.smithi165.stdout:2/428: write d9/d25/d45/d75/d34/f6c [1841945,113129] 0 2024-09-06T14:44:28.907 INFO:tasks.workunit.client.1.smithi165.stdout:3/449: write d1/d19/d4d/f87 [450385,1543] 0 2024-09-06T14:44:28.909 INFO:tasks.workunit.client.1.smithi165.stdout:0/370: creat d15/d19/d28/d4f/f7b x:0 0 0 2024-09-06T14:44:28.910 INFO:tasks.workunit.client.1.smithi165.stdout:0/371: chown d15/d19/d28/d4f/f7b 6951471 1 2024-09-06T14:44:28.915 INFO:tasks.workunit.client.1.smithi165.stdout:7/375: dwrite d20/f21 [0,4194304] 0 2024-09-06T14:44:28.916 INFO:tasks.workunit.client.1.smithi165.stdout:5/465: write d6/d1c/d28/d4b/d55/fa9 [1182867,100784] 0 2024-09-06T14:44:28.917 INFO:tasks.workunit.client.1.smithi165.stdout:5/466: fsync d6/d1c/f74 0 2024-09-06T14:44:28.917 INFO:tasks.workunit.client.1.smithi165.stdout:2/429: creat d9/d23/d71/f87 x:0 0 0 2024-09-06T14:44:28.920 INFO:tasks.workunit.client.1.smithi165.stdout:6/460: rename d29/d39/d5b/d62/f7e to d29/d6a/d83/f8c 0 2024-09-06T14:44:28.921 INFO:tasks.workunit.client.1.smithi165.stdout:0/372: mkdir d15/d19/d50/d53/d7c 0 2024-09-06T14:44:28.924 INFO:tasks.workunit.client.1.smithi165.stdout:1/428: symlink d0/d2a/l8b 0 2024-09-06T14:44:28.929 INFO:tasks.workunit.client.1.smithi165.stdout:1/429: fsync d0/d1c/d41/f5e 0 2024-09-06T14:44:28.932 INFO:tasks.workunit.client.1.smithi165.stdout:3/450: rename d1/f84 to d1/da/d43/f96 0 2024-09-06T14:44:28.933 INFO:tasks.workunit.client.1.smithi165.stdout:0/373: creat d15/d19/d50/d53/d57/f7d x:0 0 0 2024-09-06T14:44:28.933 INFO:tasks.workunit.client.1.smithi165.stdout:9/601: truncate db/de/d15/d17/f82 483438 0 2024-09-06T14:44:28.934 INFO:tasks.workunit.client.1.smithi165.stdout:0/374: write d15/f2f [2086931,4596] 0 2024-09-06T14:44:28.935 INFO:tasks.workunit.client.1.smithi165.stdout:1/430: truncate d0/f7 1799829 0 2024-09-06T14:44:28.935 INFO:tasks.workunit.client.1.smithi165.stdout:7/376: dread d20/d65/f34 [0,4194304] 0 2024-09-06T14:44:28.936 INFO:tasks.workunit.client.1.smithi165.stdout:2/430: mkdir d9/d88 0 2024-09-06T14:44:28.936 INFO:tasks.workunit.client.1.smithi165.stdout:6/461: write f16 [128465,33821] 0 2024-09-06T14:44:28.937 INFO:tasks.workunit.client.1.smithi165.stdout:1/431: write d0/d2a/d23/f80 [376956,115389] 0 2024-09-06T14:44:28.938 INFO:tasks.workunit.client.1.smithi165.stdout:6/462: write f25 [3588075,20671] 0 2024-09-06T14:44:28.938 INFO:tasks.workunit.client.1.smithi165.stdout:3/451: creat d1/d41/f97 x:0 0 0 2024-09-06T14:44:28.942 INFO:tasks.workunit.client.1.smithi165.stdout:0/375: creat d15/d19/d50/d53/f7e x:0 0 0 2024-09-06T14:44:28.945 INFO:tasks.workunit.client.1.smithi165.stdout:2/431: read d9/d25/d45/f51 [3520162,127033] 0 2024-09-06T14:44:28.948 INFO:tasks.workunit.client.1.smithi165.stdout:5/467: truncate d6/d1c/f22 2605007 0 2024-09-06T14:44:28.950 INFO:tasks.workunit.client.1.smithi165.stdout:8/444: sync 2024-09-06T14:44:28.950 INFO:tasks.workunit.client.1.smithi165.stdout:5/468: write d6/d1c/d64/f6e [4742713,3252] 0 2024-09-06T14:44:28.950 INFO:tasks.workunit.client.1.smithi165.stdout:0/376: creat d15/d19/d50/f7f x:0 0 0 2024-09-06T14:44:28.951 INFO:tasks.workunit.client.1.smithi165.stdout:8/445: chown d0/d19/d7f 420529 1 2024-09-06T14:44:28.953 INFO:tasks.workunit.client.1.smithi165.stdout:0/377: stat d15/d19/d28/f42 0 2024-09-06T14:44:28.953 INFO:tasks.workunit.client.1.smithi165.stdout:9/602: write db/de/fb1 [728174,56208] 0 2024-09-06T14:44:28.954 INFO:tasks.workunit.client.1.smithi165.stdout:7/377: write d20/d65/f2d [1121862,35935] 0 2024-09-06T14:44:28.955 INFO:tasks.workunit.client.1.smithi165.stdout:2/432: read d9/f13 [12530671,101226] 0 2024-09-06T14:44:28.956 INFO:tasks.workunit.client.1.smithi165.stdout:0/378: write fb [3335234,85018] 0 2024-09-06T14:44:28.959 INFO:tasks.workunit.client.1.smithi165.stdout:6/463: dread d29/f47 [0,4194304] 0 2024-09-06T14:44:28.959 INFO:tasks.workunit.client.1.smithi165.stdout:8/446: creat d0/d34/d6b/fa0 x:0 0 0 2024-09-06T14:44:28.959 INFO:tasks.workunit.client.1.smithi165.stdout:3/452: dwrite d1/d19/f27 [0,4194304] 0 2024-09-06T14:44:28.993 INFO:tasks.workunit.client.1.smithi165.stdout:7/378: rmdir d20/d33/d53/d66 39 2024-09-06T14:44:28.993 INFO:tasks.workunit.client.1.smithi165.stdout:1/432: getdents d0/d1c 0 2024-09-06T14:44:28.994 INFO:tasks.workunit.client.1.smithi165.stdout:0/379: symlink d15/d55/l80 0 2024-09-06T14:44:28.994 INFO:tasks.workunit.client.1.smithi165.stdout:3/453: mkdir d1/d7c/d98 0 2024-09-06T14:44:29.000 INFO:tasks.workunit.client.1.smithi165.stdout:7/379: dread f12 [0,4194304] 0 2024-09-06T14:44:29.001 INFO:tasks.workunit.client.1.smithi165.stdout:5/469: dread d6/f24 [0,4194304] 0 2024-09-06T14:44:29.001 INFO:tasks.workunit.client.1.smithi165.stdout:9/603: rename db/de/d15/d7f/d9b/l80 to db/de/d15/d7f/d9b/lc1 0 2024-09-06T14:44:29.001 INFO:tasks.workunit.client.1.smithi165.stdout:3/454: mknod d1/d7c/d98/c99 0 2024-09-06T14:44:29.003 INFO:tasks.workunit.client.1.smithi165.stdout:8/447: link d0/d19/d7f/f9a d0/d19/d36/d28/d53/fa1 0 2024-09-06T14:44:29.004 INFO:tasks.workunit.client.1.smithi165.stdout:1/433: link d0/d2a/d18/d24/d4b/f51 d0/d1c/d41/f8c 0 2024-09-06T14:44:29.004 INFO:tasks.workunit.client.1.smithi165.stdout:0/380: dwrite d15/d19/d50/d53/d57/f78 [0,4194304] 0 2024-09-06T14:44:29.006 INFO:tasks.workunit.client.1.smithi165.stdout:6/464: truncate d29/d39/d5b/d68/f6f 1111010 0 2024-09-06T14:44:29.007 INFO:tasks.workunit.client.1.smithi165.stdout:3/455: symlink d1/da/dc/d10/l9a 0 2024-09-06T14:44:29.010 INFO:tasks.workunit.client.1.smithi165.stdout:7/380: rmdir d20/d33/d53/d66 39 2024-09-06T14:44:29.013 INFO:tasks.workunit.client.1.smithi165.stdout:1/434: unlink d0/d2a/d1b/f73 0 2024-09-06T14:44:29.013 INFO:tasks.workunit.client.1.smithi165.stdout:1/435: chown d0/d1c/d1d 1 1 2024-09-06T14:44:29.014 INFO:tasks.workunit.client.1.smithi165.stdout:0/381: creat d15/d19/d28/d4f/f81 x:0 0 0 2024-09-06T14:44:29.017 INFO:tasks.workunit.client.1.smithi165.stdout:6/465: creat d29/d6a/f8d x:0 0 0 2024-09-06T14:44:29.018 INFO:tasks.workunit.client.1.smithi165.stdout:5/470: getdents d6/d1c/d28/d2d/d3c/d44/d90 0 2024-09-06T14:44:29.019 INFO:tasks.workunit.client.1.smithi165.stdout:3/456: write d1/da/dd/d4b/f8b [171969,27363] 0 2024-09-06T14:44:29.019 INFO:tasks.workunit.client.1.smithi165.stdout:8/448: fdatasync d0/d14/d3e/f4b 0 2024-09-06T14:44:29.021 INFO:tasks.workunit.client.1.smithi165.stdout:7/381: mkdir d20/d65/d28/d30/d78 0 2024-09-06T14:44:29.022 INFO:tasks.workunit.client.1.smithi165.stdout:6/466: write d29/f49 [2747801,49910] 0 2024-09-06T14:44:29.023 INFO:tasks.workunit.client.1.smithi165.stdout:1/436: rename d0/d2a/d1b/f30 to d0/d2a/d23/d56/f8d 0 2024-09-06T14:44:29.028 INFO:tasks.workunit.client.1.smithi165.stdout:5/471: chown d6/d1c/d28/d2d/d3c/d44/f7f 26940318 1 2024-09-06T14:44:29.028 INFO:tasks.workunit.client.1.smithi165.stdout:9/604: dwrite db/de/d16/f5e [0,4194304] 0 2024-09-06T14:44:29.029 INFO:tasks.workunit.client.1.smithi165.stdout:1/437: chown d0/d1c/d40/f4d 520 1 2024-09-06T14:44:29.029 INFO:tasks.workunit.client.1.smithi165.stdout:8/449: rmdir d0/d34/d6b/d94/d70 39 2024-09-06T14:44:29.030 INFO:tasks.workunit.client.1.smithi165.stdout:0/382: dwrite d15/f37 [4194304,4194304] 0 2024-09-06T14:44:29.031 INFO:tasks.workunit.client.1.smithi165.stdout:6/467: truncate d29/d6a/f8d 646193 0 2024-09-06T14:44:29.032 INFO:tasks.workunit.client.1.smithi165.stdout:3/457: rename d1/da/d43/c46 to d1/d41/c9b 0 2024-09-06T14:44:29.034 INFO:tasks.workunit.client.1.smithi165.stdout:7/382: mknod d20/d33/d6a/c79 0 2024-09-06T14:44:29.035 INFO:tasks.workunit.client.1.smithi165.stdout:6/468: chown d29/d39/d5b/d62/d67/l79 960991 1 2024-09-06T14:44:29.036 INFO:tasks.workunit.client.1.smithi165.stdout:9/605: mknod db/de/d15/d17/d72/cc2 0 2024-09-06T14:44:29.037 INFO:tasks.workunit.client.1.smithi165.stdout:7/383: truncate d20/f2b 4288787 0 2024-09-06T14:44:29.041 INFO:tasks.workunit.client.1.smithi165.stdout:0/383: dwrite f3 [4194304,4194304] 0 2024-09-06T14:44:29.043 INFO:tasks.workunit.client.1.smithi165.stdout:8/450: symlink d0/d19/d36/d2d/d33/d3a/d46/la2 0 2024-09-06T14:44:29.047 INFO:tasks.workunit.client.1.smithi165.stdout:6/469: creat d29/d39/d5b/d62/d67/f8e x:0 0 0 2024-09-06T14:44:29.047 INFO:tasks.workunit.client.1.smithi165.stdout:4/408: sync 2024-09-06T14:44:29.049 INFO:tasks.workunit.client.1.smithi165.stdout:4/409: dread - d5/d1b/f74 zero size 2024-09-06T14:44:29.049 INFO:tasks.workunit.client.1.smithi165.stdout:7/384: mknod d20/d40/c7a 0 2024-09-06T14:44:29.052 INFO:tasks.workunit.client.1.smithi165.stdout:0/384: creat d15/d55/f82 x:0 0 0 2024-09-06T14:44:29.057 INFO:tasks.workunit.client.1.smithi165.stdout:6/470: rmdir d29/d6a/d83 39 2024-09-06T14:44:29.057 INFO:tasks.workunit.client.1.smithi165.stdout:5/472: getdents d6/d1c/d28/d2d/d3c/d44 0 2024-09-06T14:44:29.060 INFO:tasks.workunit.client.1.smithi165.stdout:9/606: mkdir db/de/d15/d17/dc3 0 2024-09-06T14:44:29.060 INFO:tasks.workunit.client.1.smithi165.stdout:8/451: dwrite d0/d5e/d65/f9f [0,4194304] 0 2024-09-06T14:44:29.062 INFO:tasks.workunit.client.1.smithi165.stdout:9/607: stat db/de/d15/d17/d18/d59/d64/l68 0 2024-09-06T14:44:29.065 INFO:tasks.workunit.client.1.smithi165.stdout:1/438: dread d0/d1c/d1d/d22/f32 [0,4194304] 0 2024-09-06T14:44:29.065 INFO:tasks.workunit.client.1.smithi165.stdout:4/410: rename d5/d1b/d1c/d20/f24 to d5/d1b/d1c/d78/f91 0 2024-09-06T14:44:29.066 INFO:tasks.workunit.client.1.smithi165.stdout:0/385: creat d15/d19/d28/d3a/d3f/f83 x:0 0 0 2024-09-06T14:44:29.066 INFO:tasks.workunit.client.1.smithi165.stdout:4/411: dread - d5/d1b/d1c/d20/d26/f88 zero size 2024-09-06T14:44:29.067 INFO:tasks.workunit.client.1.smithi165.stdout:6/471: unlink d29/c58 0 2024-09-06T14:44:29.070 INFO:tasks.workunit.client.1.smithi165.stdout:3/458: getdents d1/da/dc/d3b/d83 0 2024-09-06T14:44:29.071 INFO:tasks.workunit.client.1.smithi165.stdout:7/385: symlink d20/d65/d28/d30/d78/l7b 0 2024-09-06T14:44:29.074 INFO:tasks.workunit.client.1.smithi165.stdout:0/386: creat d15/d55/f84 x:0 0 0 2024-09-06T14:44:29.075 INFO:tasks.workunit.client.1.smithi165.stdout:4/412: creat d5/d1b/d1c/d78/f92 x:0 0 0 2024-09-06T14:44:29.076 INFO:tasks.workunit.client.1.smithi165.stdout:5/473: fdatasync d6/d32/f33 0 2024-09-06T14:44:29.078 INFO:tasks.workunit.client.1.smithi165.stdout:4/413: chown d5/d1b/d1c/d20/d75/d83/f4d 6989426 1 2024-09-06T14:44:29.078 INFO:tasks.workunit.client.1.smithi165.stdout:7/386: symlink d20/d33/d6a/l7c 0 2024-09-06T14:44:29.079 INFO:tasks.workunit.client.1.smithi165.stdout:9/608: symlink db/de/d15/lc4 0 2024-09-06T14:44:29.081 INFO:tasks.workunit.client.1.smithi165.stdout:3/459: unlink d1/da/dc/d5d/l76 0 2024-09-06T14:44:29.082 INFO:tasks.workunit.client.1.smithi165.stdout:4/414: truncate d5/d1b/d1c/f6c 650523 0 2024-09-06T14:44:29.082 INFO:tasks.workunit.client.1.smithi165.stdout:0/387: dwrite d15/d55/f82 [0,4194304] 0 2024-09-06T14:44:29.083 INFO:tasks.workunit.client.1.smithi165.stdout:3/460: write d1/d19/f49 [4881088,74432] 0 2024-09-06T14:44:29.084 INFO:tasks.workunit.client.1.smithi165.stdout:4/415: stat d5/d1b/d1c/d20/d26/f32 0 2024-09-06T14:44:29.085 INFO:tasks.workunit.client.1.smithi165.stdout:1/439: rename d0/f59 to d0/d2a/f8e 0 2024-09-06T14:44:29.088 INFO:tasks.workunit.client.1.smithi165.stdout:5/474: mkdir d6/d1c/d28/d4b/da7/dab 0 2024-09-06T14:44:29.089 INFO:tasks.workunit.client.1.smithi165.stdout:1/440: read d0/d1c/d40/f4d [429928,98212] 0 2024-09-06T14:44:29.090 INFO:tasks.workunit.client.1.smithi165.stdout:3/461: write d1/da/dd/fe [3570940,37962] 0 2024-09-06T14:44:29.090 INFO:tasks.workunit.client.1.smithi165.stdout:4/416: rmdir d5/d1b/d61 39 2024-09-06T14:44:29.091 INFO:tasks.workunit.client.1.smithi165.stdout:8/452: write d0/d19/d36/f2e [137496,22742] 0 2024-09-06T14:44:29.093 INFO:tasks.workunit.client.1.smithi165.stdout:8/453: write d0/d19/f7b [495629,85023] 0 2024-09-06T14:44:29.098 INFO:tasks.workunit.client.1.smithi165.stdout:9/609: creat db/de/d15/fc5 x:0 0 0 2024-09-06T14:44:29.099 INFO:tasks.workunit.client.1.smithi165.stdout:3/462: stat d1/da/dc/d3b/c44 0 2024-09-06T14:44:29.101 INFO:tasks.workunit.client.1.smithi165.stdout:7/387: dread d20/d33/d53/f55 [0,4194304] 0 2024-09-06T14:44:29.104 INFO:tasks.workunit.client.1.smithi165.stdout:3/463: write d1/d4a/f7d [154235,66678] 0 2024-09-06T14:44:29.105 INFO:tasks.workunit.client.1.smithi165.stdout:8/454: symlink d0/d19/la3 0 2024-09-06T14:44:29.107 INFO:tasks.workunit.client.1.smithi165.stdout:4/417: dwrite d5/d1b/d1c/d20/d75/d83/f64 [0,4194304] 0 2024-09-06T14:44:29.108 INFO:tasks.workunit.client.1.smithi165.stdout:1/441: dwrite d0/d2a/f8e [0,4194304] 0 2024-09-06T14:44:29.111 INFO:tasks.workunit.client.1.smithi165.stdout:0/388: dread ff [0,4194304] 0 2024-09-06T14:44:29.112 INFO:tasks.workunit.client.1.smithi165.stdout:4/418: chown d5/d1b/c73 8730 1 2024-09-06T14:44:29.113 INFO:tasks.workunit.client.1.smithi165.stdout:7/388: rename d20/d65/d28/d30/d78/l7b to d20/d33/d6a/l7d 0 2024-09-06T14:44:29.114 INFO:tasks.workunit.client.0.smithi052.stdout:0/9: sync 2024-09-06T14:44:29.114 INFO:tasks.workunit.client.0.smithi052.stdout:0/10: write - no filename 2024-09-06T14:44:29.114 INFO:tasks.workunit.client.0.smithi052.stdout:0/11: truncate - no filename 2024-09-06T14:44:29.115 INFO:tasks.workunit.client.0.smithi052.stdout:0/12: rename d0 to d0/d1 22 2024-09-06T14:44:29.116 INFO:tasks.workunit.client.0.smithi052.stdout:0/13: stat d0 0 2024-09-06T14:44:29.116 INFO:tasks.workunit.client.0.smithi052.stdout:0/14: fdatasync - no filename 2024-09-06T14:44:29.118 INFO:tasks.workunit.client.1.smithi165.stdout:9/610: dwrite db/de/d15/d17/f25 [0,4194304] 0 2024-09-06T14:44:29.119 INFO:tasks.workunit.client.1.smithi165.stdout:3/464: dread d1/da/f2a [0,4194304] 0 2024-09-06T14:44:29.121 INFO:tasks.workunit.client.1.smithi165.stdout:7/389: unlink d20/d65/d28/d30/f36 0 2024-09-06T14:44:29.121 INFO:tasks.workunit.client.1.smithi165.stdout:1/442: chown d0/d2a/d18/d24/d4b/d5f/d7c/c8a 13 1 2024-09-06T14:44:29.122 INFO:tasks.workunit.client.0.smithi052.stdout:0/15: mkdir d0/d2 0 2024-09-06T14:44:29.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/16: mknod d0/d2/c3 0 2024-09-06T14:44:29.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/17: dread - no filename 2024-09-06T14:44:29.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/18: stat d0 0 2024-09-06T14:44:29.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/19: read - no filename 2024-09-06T14:44:29.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/20: dread - no filename 2024-09-06T14:44:29.126 INFO:tasks.workunit.client.1.smithi165.stdout:8/455: dwrite d0/d14/f2c [0,4194304] 0 2024-09-06T14:44:29.127 INFO:tasks.workunit.client.0.smithi052.stdout:0/21: rmdir d0/d2 39 2024-09-06T14:44:29.130 INFO:tasks.workunit.client.1.smithi165.stdout:7/390: write d20/d65/f6c [191502,4891] 0 2024-09-06T14:44:29.132 INFO:tasks.workunit.client.1.smithi165.stdout:3/465: truncate d1/da/dd/d4b/f74 174533 0 2024-09-06T14:44:29.132 INFO:tasks.workunit.client.1.smithi165.stdout:0/389: dwrite d15/d19/d38/f5e [0,4194304] 0 2024-09-06T14:44:29.133 INFO:tasks.workunit.client.1.smithi165.stdout:9/611: truncate db/de/d15/d17/d86/fb6 284394 0 2024-09-06T14:44:29.133 INFO:tasks.workunit.client.1.smithi165.stdout:1/443: mknod d0/d2a/d18/d24/d4b/d5f/c8f 0 2024-09-06T14:44:29.137 INFO:tasks.workunit.client.1.smithi165.stdout:4/419: truncate d5/d1b/d1c/d20/d26/f2a 1752661 0 2024-09-06T14:44:29.141 INFO:tasks.workunit.client.1.smithi165.stdout:1/444: mknod d0/d1c/d40/c90 0 2024-09-06T14:44:29.141 INFO:tasks.workunit.client.1.smithi165.stdout:7/391: dwrite f17 [4194304,4194304] 0 2024-09-06T14:44:29.142 INFO:tasks.workunit.client.0.smithi052.stdout:0/22: creat d0/d2/f4 x:0 0 0 2024-09-06T14:44:29.143 INFO:tasks.workunit.client.0.smithi052.stdout:0/23: rename d0 to d0/d2/d5 22 2024-09-06T14:44:29.144 INFO:tasks.workunit.client.1.smithi165.stdout:9/612: mknod db/de/d15/d17/d18/cc6 0 2024-09-06T14:44:29.144 INFO:tasks.workunit.client.1.smithi165.stdout:0/390: creat d15/d6e/f85 x:0 0 0 2024-09-06T14:44:29.148 INFO:tasks.workunit.client.1.smithi165.stdout:3/466: mknod d1/da/dc/d5d/d89/c9c 0 2024-09-06T14:44:29.148 INFO:tasks.workunit.client.1.smithi165.stdout:0/391: chown d15/d55 1 1 2024-09-06T14:44:29.150 INFO:tasks.workunit.client.1.smithi165.stdout:8/456: getdents d0/d19/d36 0 2024-09-06T14:44:29.151 INFO:tasks.workunit.client.0.smithi052.stdout:0/24: dwrite d0/d2/f4 [0,4194304] 0 2024-09-06T14:44:29.152 INFO:tasks.workunit.client.1.smithi165.stdout:0/392: readlink d15/d19/d50/d53/d57/l75 0 2024-09-06T14:44:29.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/445: link d0/d2a/d1b/d2b/f4a d0/d45/f91 0 2024-09-06T14:44:29.154 INFO:tasks.workunit.client.1.smithi165.stdout:8/457: write d0/d19/d36/fb [1394263,90663] 0 2024-09-06T14:44:29.155 INFO:tasks.workunit.client.0.smithi052.stdout:0/25: write d0/d2/f4 [3769658,14800] 0 2024-09-06T14:44:29.158 INFO:tasks.workunit.client.0.smithi052.stdout:0/26: read d0/d2/f4 [3205988,68081] 0 2024-09-06T14:44:29.158 INFO:tasks.workunit.client.1.smithi165.stdout:4/420: dwrite d5/d1b/d1c/d78/f91 [0,4194304] 0 2024-09-06T14:44:29.167 INFO:tasks.workunit.client.1.smithi165.stdout:2/433: sync 2024-09-06T14:44:29.170 INFO:tasks.workunit.client.1.smithi165.stdout:9/613: getdents db/de/d15/d91 0 2024-09-06T14:44:29.171 INFO:tasks.workunit.client.1.smithi165.stdout:3/467: truncate d1/da/f7b 3722136 0 2024-09-06T14:44:29.173 INFO:tasks.workunit.client.1.smithi165.stdout:4/421: mkdir d5/d1b/d61/d77/d93 0 2024-09-06T14:44:29.174 INFO:tasks.workunit.client.1.smithi165.stdout:8/458: write d0/d14/d3e/f4b [1289025,11226] 0 2024-09-06T14:44:29.174 INFO:tasks.workunit.client.1.smithi165.stdout:0/393: rmdir d15/d19/d50/d53/d69 0 2024-09-06T14:44:29.175 INFO:tasks.workunit.client.1.smithi165.stdout:1/446: write d0/d2a/d1b/d2b/d3e/d69/f85 [613060,52983] 0 2024-09-06T14:44:29.176 INFO:tasks.workunit.client.1.smithi165.stdout:9/614: rename db/de/d15/d17/dad/c9d to db/de/d15/d17/d18/d59/cc7 0 2024-09-06T14:44:29.177 INFO:tasks.workunit.client.1.smithi165.stdout:7/392: dread d20/d33/d53/f67 [0,4194304] 0 2024-09-06T14:44:29.177 INFO:tasks.workunit.client.1.smithi165.stdout:3/468: link d1/d7c/d98/c99 d1/d19/d92/c9d 0 2024-09-06T14:44:29.178 INFO:tasks.workunit.client.0.smithi052.stdout:0/27: fdatasync d0/d2/f4 0 2024-09-06T14:44:29.179 INFO:tasks.workunit.client.0.smithi052.stdout:0/28: write d0/d2/f4 [2641878,5942] 0 2024-09-06T14:44:29.180 INFO:tasks.workunit.client.0.smithi052.stdout:0/29: write d0/d2/f4 [256012,68199] 0 2024-09-06T14:44:29.181 INFO:tasks.workunit.client.1.smithi165.stdout:4/422: read d5/d1b/d1c/d20/d75/d83/f4c [4118030,46257] 0 2024-09-06T14:44:29.183 INFO:tasks.workunit.client.1.smithi165.stdout:8/459: rename d0/d19/d7f/f9d to d0/d9e/fa4 0 2024-09-06T14:44:29.188 INFO:tasks.workunit.client.1.smithi165.stdout:0/394: dwrite fb [0,4194304] 0 2024-09-06T14:44:29.191 INFO:tasks.workunit.client.0.smithi052.stdout:0/30: dwrite d0/d2/f4 [4194304,4194304] 0 2024-09-06T14:44:29.192 INFO:tasks.workunit.client.1.smithi165.stdout:1/447: dwrite d0/d1c/d41/f5e [0,4194304] 0 2024-09-06T14:44:29.194 INFO:tasks.workunit.client.1.smithi165.stdout:0/395: truncate d15/d19/d50/d53/d57/f78 4355273 0 2024-09-06T14:44:29.194 INFO:tasks.workunit.client.1.smithi165.stdout:3/469: dwrite d1/da/dd/f61 [0,4194304] 0 2024-09-06T14:44:29.197 INFO:tasks.workunit.client.0.smithi052.stdout:0/31: dread d0/d2/f4 [0,4194304] 0 2024-09-06T14:44:29.198 INFO:tasks.workunit.client.1.smithi165.stdout:0/396: truncate d15/d55/f84 467933 0 2024-09-06T14:44:29.199 INFO:tasks.workunit.client.1.smithi165.stdout:1/448: truncate d0/d2a/d18/d24/d4b/d5f/f63 1015184 0 2024-09-06T14:44:29.199 INFO:tasks.workunit.client.1.smithi165.stdout:1/449: readlink d0/d2a/d18/l6d 0 2024-09-06T14:44:29.200 INFO:tasks.workunit.client.1.smithi165.stdout:2/434: dread d9/d25/d45/d75/d34/f43 [0,4194304] 0 2024-09-06T14:44:29.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/615: read db/de/d15/d7f/d9b/f31 [435048,113932] 0 2024-09-06T14:44:29.202 INFO:tasks.workunit.client.1.smithi165.stdout:4/423: mknod d5/d1b/c94 0 2024-09-06T14:44:29.203 INFO:tasks.workunit.client.1.smithi165.stdout:8/460: creat d0/d19/d36/d2d/d3f/d93/fa5 x:0 0 0 2024-09-06T14:44:29.205 INFO:tasks.workunit.client.1.smithi165.stdout:8/461: chown d0/d19/d36/d28/d53 5 1 2024-09-06T14:44:29.208 INFO:tasks.workunit.client.1.smithi165.stdout:7/393: truncate ff 2982443 0 2024-09-06T14:44:29.209 INFO:tasks.workunit.client.0.smithi052.stdout:0/32: dwrite d0/d2/f4 [0,4194304] 0 2024-09-06T14:44:29.209 INFO:tasks.workunit.client.1.smithi165.stdout:9/616: write f4 [3726075,2767] 0 2024-09-06T14:44:29.211 INFO:tasks.workunit.client.0.smithi052.stdout:0/33: write d0/d2/f4 [7347569,127403] 0 2024-09-06T14:44:29.212 INFO:tasks.workunit.client.1.smithi165.stdout:1/450: dwrite d0/d2a/d18/f67 [0,4194304] 0 2024-09-06T14:44:29.214 INFO:tasks.workunit.client.1.smithi165.stdout:4/424: creat d5/d1b/d1c/d20/d26/f95 x:0 0 0 2024-09-06T14:44:29.222 INFO:tasks.workunit.client.1.smithi165.stdout:3/470: link d1/f11 d1/d7c/f9e 0 2024-09-06T14:44:29.225 INFO:tasks.workunit.client.0.smithi052.stdout:0/34: unlink d0/d2/f4 0 2024-09-06T14:44:29.226 INFO:tasks.workunit.client.0.smithi052.stdout:0/35: rename d0 to d0/d2/d6 22 2024-09-06T14:44:29.226 INFO:tasks.workunit.client.0.smithi052.stdout:0/36: dread - no filename 2024-09-06T14:44:29.226 INFO:tasks.workunit.client.0.smithi052.stdout:0/37: dwrite - no filename 2024-09-06T14:44:29.226 INFO:tasks.workunit.client.0.smithi052.stdout:0/38: write - no filename 2024-09-06T14:44:29.231 INFO:tasks.workunit.client.1.smithi165.stdout:7/394: rename d20/f48 to d20/d3b/f7e 0 2024-09-06T14:44:29.231 INFO:tasks.workunit.client.1.smithi165.stdout:2/435: write d9/d25/f61 [790343,58753] 0 2024-09-06T14:44:29.237 INFO:tasks.workunit.client.1.smithi165.stdout:4/425: dread d5/d1b/d1c/d20/d26/f4b [0,4194304] 0 2024-09-06T14:44:29.238 INFO:tasks.workunit.client.0.smithi052.stdout:0/39: link d0/d2/c3 d0/c7 0 2024-09-06T14:44:29.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/40: readlink - no filename 2024-09-06T14:44:29.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/41: dread - no filename 2024-09-06T14:44:29.242 INFO:tasks.workunit.client.1.smithi165.stdout:0/397: getdents d15/d19/d28/d51 0 2024-09-06T14:44:29.244 INFO:tasks.workunit.client.1.smithi165.stdout:4/426: creat d5/d1b/d1c/d20/d26/f96 x:0 0 0 2024-09-06T14:44:29.246 INFO:tasks.workunit.client.1.smithi165.stdout:9/617: link db/de/d15/d7f/d9b/d6c/f7a db/de/fc8 0 2024-09-06T14:44:29.247 INFO:tasks.workunit.client.1.smithi165.stdout:8/462: getdents d0/d19/d24 0 2024-09-06T14:44:29.248 INFO:tasks.workunit.client.1.smithi165.stdout:3/471: creat d1/da/f9f x:0 0 0 2024-09-06T14:44:29.249 INFO:tasks.workunit.client.1.smithi165.stdout:0/398: read d15/d19/f25 [7521844,96244] 0 2024-09-06T14:44:29.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/395: creat d20/d33/d53/f7f x:0 0 0 2024-09-06T14:44:29.252 INFO:tasks.workunit.client.1.smithi165.stdout:4/427: fdatasync d5/d1b/d1c/f39 0 2024-09-06T14:44:29.253 INFO:tasks.workunit.client.1.smithi165.stdout:3/472: write d1/d19/f34 [223625,5739] 0 2024-09-06T14:44:29.253 INFO:tasks.workunit.client.1.smithi165.stdout:1/451: dread d0/d2a/f16 [0,4194304] 0 2024-09-06T14:44:29.255 INFO:tasks.workunit.client.1.smithi165.stdout:0/399: write d15/d55/f84 [382816,84406] 0 2024-09-06T14:44:29.256 INFO:tasks.workunit.client.1.smithi165.stdout:2/436: dread d9/f1a [0,4194304] 0 2024-09-06T14:44:29.257 INFO:tasks.workunit.client.1.smithi165.stdout:7/396: mkdir d20/d65/d28/d80 0 2024-09-06T14:44:29.258 INFO:tasks.workunit.client.1.smithi165.stdout:6/472: sync 2024-09-06T14:44:29.258 INFO:tasks.workunit.client.1.smithi165.stdout:5/475: sync 2024-09-06T14:44:29.259 INFO:tasks.workunit.client.1.smithi165.stdout:8/463: link d0/d34/d6b/d94/f5f d0/d19/d36/d2d/d3f/d93/fa6 0 2024-09-06T14:44:29.260 INFO:tasks.workunit.client.1.smithi165.stdout:4/428: truncate d5/d1b/d61/f82 458907 0 2024-09-06T14:44:29.262 INFO:tasks.workunit.client.1.smithi165.stdout:9/618: dwrite db/de/d15/d17/d86/fac [4194304,4194304] 0 2024-09-06T14:44:29.264 INFO:tasks.workunit.client.1.smithi165.stdout:1/452: write d0/d2a/d1b/d2b/d3e/f7b [1624370,71630] 0 2024-09-06T14:44:29.265 INFO:tasks.workunit.client.1.smithi165.stdout:7/397: mkdir d20/d65/d28/d80/d81 0 2024-09-06T14:44:29.265 INFO:tasks.workunit.client.1.smithi165.stdout:4/429: fsync d5/d1b/d1c/d20/d75/d83/f6a 0 2024-09-06T14:44:29.267 INFO:tasks.workunit.client.1.smithi165.stdout:2/437: link d9/f1e d9/d25/d45/f89 0 2024-09-06T14:44:29.269 INFO:tasks.workunit.client.1.smithi165.stdout:4/430: dread - d5/d1b/d1c/d8c/f8d zero size 2024-09-06T14:44:29.270 INFO:tasks.workunit.client.1.smithi165.stdout:3/473: rename d1/da/dc/d5d/f95 to d1/da/dd/fa0 0 2024-09-06T14:44:29.271 INFO:tasks.workunit.client.1.smithi165.stdout:9/619: unlink db/de/d15/d7f/d9b/c52 0 2024-09-06T14:44:29.271 INFO:tasks.workunit.client.1.smithi165.stdout:5/476: dwrite d6/f23 [0,4194304] 0 2024-09-06T14:44:29.272 INFO:tasks.workunit.client.1.smithi165.stdout:7/398: mkdir d20/d65/d82 0 2024-09-06T14:44:29.274 INFO:tasks.workunit.client.1.smithi165.stdout:0/400: getdents d15/d19/d28 0 2024-09-06T14:44:29.275 INFO:tasks.workunit.client.1.smithi165.stdout:3/474: mkdir d1/d41/da1 0 2024-09-06T14:44:29.275 INFO:tasks.workunit.client.1.smithi165.stdout:4/431: mkdir d5/d1b/d61/d97 0 2024-09-06T14:44:29.276 INFO:tasks.workunit.client.1.smithi165.stdout:2/438: mknod d9/d88/c8a 0 2024-09-06T14:44:29.276 INFO:tasks.workunit.client.1.smithi165.stdout:9/620: unlink db/de/d15/f7c 0 2024-09-06T14:44:29.276 INFO:tasks.workunit.client.1.smithi165.stdout:5/477: write d6/d1c/d28/d2d/d3c/d44/f7f [158643,80313] 0 2024-09-06T14:44:29.279 INFO:tasks.workunit.client.1.smithi165.stdout:0/401: rmdir d15/d19/d2c 39 2024-09-06T14:44:29.279 INFO:tasks.workunit.client.1.smithi165.stdout:7/399: creat d20/d65/d28/d30/f83 x:0 0 0 2024-09-06T14:44:29.280 INFO:tasks.workunit.client.1.smithi165.stdout:8/464: link d0/f6 d0/d19/d36/d2d/d33/d3a/d46/fa7 0 2024-09-06T14:44:29.281 INFO:tasks.workunit.client.1.smithi165.stdout:9/621: dread - db/de/d15/d17/d18/d7d/d61/fab zero size 2024-09-06T14:44:29.281 INFO:tasks.workunit.client.1.smithi165.stdout:5/478: fsync d6/d1c/d28/d4b/d55/f6a 0 2024-09-06T14:44:29.282 INFO:tasks.workunit.client.1.smithi165.stdout:4/432: creat d5/d1b/d1c/d20/d26/f98 x:0 0 0 2024-09-06T14:44:29.282 INFO:tasks.workunit.client.1.smithi165.stdout:1/453: getdents d0/d2a/d1b/d2b/d3e/d69 0 2024-09-06T14:44:29.283 INFO:tasks.workunit.client.1.smithi165.stdout:7/400: rmdir d20/d4d 39 2024-09-06T14:44:29.283 INFO:tasks.workunit.client.1.smithi165.stdout:3/475: symlink d1/d19/d92/la2 0 2024-09-06T14:44:29.284 INFO:tasks.workunit.client.1.smithi165.stdout:2/439: rename d9/c4a to d9/d25/d45/d75/d67/c8b 0 2024-09-06T14:44:29.284 INFO:tasks.workunit.client.1.smithi165.stdout:1/454: write d0/d2a/fb [1340951,26803] 0 2024-09-06T14:44:29.285 INFO:tasks.workunit.client.1.smithi165.stdout:9/622: stat db/de/d15/d17/d18/d7d/f92 0 2024-09-06T14:44:29.285 INFO:tasks.workunit.client.1.smithi165.stdout:0/402: creat d15/d19/d28/d3a/f86 x:0 0 0 2024-09-06T14:44:29.287 INFO:tasks.workunit.client.1.smithi165.stdout:7/401: readlink d20/d3b/l59 0 2024-09-06T14:44:29.287 INFO:tasks.workunit.client.1.smithi165.stdout:0/403: stat d15/d19/d28/f7a 0 2024-09-06T14:44:29.288 INFO:tasks.workunit.client.1.smithi165.stdout:4/433: creat d5/d1b/d1c/d41/f99 x:0 0 0 2024-09-06T14:44:29.289 INFO:tasks.workunit.client.1.smithi165.stdout:1/455: chown d0/d2a/d18/c33 16 1 2024-09-06T14:44:29.289 INFO:tasks.workunit.client.1.smithi165.stdout:0/404: stat d15/f23 0 2024-09-06T14:44:29.289 INFO:tasks.workunit.client.1.smithi165.stdout:3/476: write d1/da/dd/f15 [2067308,17761] 0 2024-09-06T14:44:29.290 INFO:tasks.workunit.client.1.smithi165.stdout:5/479: creat d6/fac x:0 0 0 2024-09-06T14:44:29.291 INFO:tasks.workunit.client.1.smithi165.stdout:7/402: chown ff 1 1 2024-09-06T14:44:29.292 INFO:tasks.workunit.client.1.smithi165.stdout:4/434: unlink d5/d1b/d1c/l6d 0 2024-09-06T14:44:29.293 INFO:tasks.workunit.client.1.smithi165.stdout:3/477: readlink d1/da/d43/l6a 0 2024-09-06T14:44:29.294 INFO:tasks.workunit.client.1.smithi165.stdout:9/623: dread db/de/d15/d17/dad/d97/fa6 [0,4194304] 0 2024-09-06T14:44:29.294 INFO:tasks.workunit.client.1.smithi165.stdout:1/456: write d0/d45/f6e [898031,29712] 0 2024-09-06T14:44:29.294 INFO:tasks.workunit.client.1.smithi165.stdout:7/403: write d20/f2b [2311028,70936] 0 2024-09-06T14:44:29.295 INFO:tasks.workunit.client.1.smithi165.stdout:2/440: rename d9/d25/d7b to d9/d23/d29/d48/d8c 0 2024-09-06T14:44:29.301 INFO:tasks.workunit.client.1.smithi165.stdout:5/480: symlink d6/d1c/d7c/lad 0 2024-09-06T14:44:29.302 INFO:tasks.workunit.client.1.smithi165.stdout:7/404: dread - d20/f6f zero size 2024-09-06T14:44:29.303 INFO:tasks.workunit.client.1.smithi165.stdout:3/478: symlink d1/da/dc/la3 0 2024-09-06T14:44:29.303 INFO:tasks.workunit.client.1.smithi165.stdout:9/624: stat db/de/d15/d7f/d9b/d6c/f75 0 2024-09-06T14:44:29.304 INFO:tasks.workunit.client.1.smithi165.stdout:4/435: creat d5/d1b/d1c/d8c/f9a x:0 0 0 2024-09-06T14:44:29.304 INFO:tasks.workunit.client.1.smithi165.stdout:2/441: mknod d9/d3b/c8d 0 2024-09-06T14:44:29.305 INFO:tasks.workunit.client.1.smithi165.stdout:5/481: write d6/d1c/f39 [1257194,109116] 0 2024-09-06T14:44:29.305 INFO:tasks.workunit.client.1.smithi165.stdout:7/405: dread - d20/d65/f61 zero size 2024-09-06T14:44:29.310 INFO:tasks.workunit.client.1.smithi165.stdout:2/442: write d9/d3b/d78/f79 [241592,94720] 0 2024-09-06T14:44:29.311 INFO:tasks.workunit.client.1.smithi165.stdout:0/405: dwrite d15/d19/d28/f67 [0,4194304] 0 2024-09-06T14:44:29.314 INFO:tasks.workunit.client.1.smithi165.stdout:3/479: truncate d1/da/dd/d4b/f5f 3911993 0 2024-09-06T14:44:29.315 INFO:tasks.workunit.client.1.smithi165.stdout:9/625: rename db/de/f3f to db/de/d15/fc9 0 2024-09-06T14:44:29.316 INFO:tasks.workunit.client.1.smithi165.stdout:5/482: dread d6/d1c/d28/f42 [0,4194304] 0 2024-09-06T14:44:29.317 INFO:tasks.workunit.client.1.smithi165.stdout:3/480: fsync d1/da/dc/f5c 0 2024-09-06T14:44:29.317 INFO:tasks.workunit.client.1.smithi165.stdout:9/626: readlink db/de/d15/lc4 0 2024-09-06T14:44:29.317 INFO:tasks.workunit.client.1.smithi165.stdout:1/457: dwrite d0/d2a/f53 [0,4194304] 0 2024-09-06T14:44:29.319 INFO:tasks.workunit.client.1.smithi165.stdout:4/436: rename d5/d1b/d1c/d78/f7b to d5/d1b/d1c/f9b 0 2024-09-06T14:44:29.319 INFO:tasks.workunit.client.1.smithi165.stdout:5/483: write d6/d1c/f3d [1962280,6411] 0 2024-09-06T14:44:29.321 INFO:tasks.workunit.client.1.smithi165.stdout:3/481: creat d1/d7c/d7e/fa4 x:0 0 0 2024-09-06T14:44:29.321 INFO:tasks.workunit.client.1.smithi165.stdout:4/437: readlink d5/l2f 0 2024-09-06T14:44:29.322 INFO:tasks.workunit.client.1.smithi165.stdout:2/443: rename d9/d23/d29/c2c to d9/d88/c8e 0 2024-09-06T14:44:29.324 INFO:tasks.workunit.client.1.smithi165.stdout:4/438: rmdir d5/d1b/d1c/d55 39 2024-09-06T14:44:29.325 INFO:tasks.workunit.client.1.smithi165.stdout:2/444: readlink d9/l19 0 2024-09-06T14:44:29.326 INFO:tasks.workunit.client.1.smithi165.stdout:1/458: link d0/d2a/d1b/f3a d0/d2a/d18/d24/d4b/d5f/d7c/f92 0 2024-09-06T14:44:29.327 INFO:tasks.workunit.client.1.smithi165.stdout:5/484: link d6/d1c/d28/d4b/d55/f6a d6/d1c/d28/d4b/fae 0 2024-09-06T14:44:29.328 INFO:tasks.workunit.client.1.smithi165.stdout:5/485: truncate d6/d1c/f68 1069279 0 2024-09-06T14:44:29.329 INFO:tasks.workunit.client.1.smithi165.stdout:4/439: link d5/d1b/c73 d5/d1b/d61/d97/c9c 0 2024-09-06T14:44:29.330 INFO:tasks.workunit.client.1.smithi165.stdout:5/486: mknod d6/d1c/d28/d4b/d55/d8a/caf 0 2024-09-06T14:44:29.330 INFO:tasks.workunit.client.1.smithi165.stdout:4/440: fdatasync d5/d1b/d1c/d20/d75/d83/f64 0 2024-09-06T14:44:29.331 INFO:tasks.workunit.client.1.smithi165.stdout:4/441: chown d5/f46 1674778953 1 2024-09-06T14:44:29.332 INFO:tasks.workunit.client.1.smithi165.stdout:5/487: mknod d6/d1c/d28/d4b/d55/cb0 0 2024-09-06T14:44:29.333 INFO:tasks.workunit.client.1.smithi165.stdout:4/442: creat d5/d1b/d61/f9d x:0 0 0 2024-09-06T14:44:29.335 INFO:tasks.workunit.client.1.smithi165.stdout:4/443: mkdir d5/d1b/d1c/d41/d9e 0 2024-09-06T14:44:29.336 INFO:tasks.workunit.client.1.smithi165.stdout:4/444: chown d5/f8a 5 1 2024-09-06T14:44:29.336 INFO:tasks.workunit.client.1.smithi165.stdout:4/445: stat c3 0 2024-09-06T14:44:29.337 INFO:tasks.workunit.client.1.smithi165.stdout:5/488: link d6/d1c/d28/d4b/l96 d6/lb1 0 2024-09-06T14:44:29.338 INFO:tasks.workunit.client.1.smithi165.stdout:4/446: mkdir d5/d1b/d1c/d20/d75/d83/d9f 0 2024-09-06T14:44:29.340 INFO:tasks.workunit.client.1.smithi165.stdout:5/489: write d6/d1c/f68 [716700,1364] 0 2024-09-06T14:44:29.340 INFO:tasks.workunit.client.1.smithi165.stdout:5/490: symlink d6/d32/lb2 0 2024-09-06T14:44:29.343 INFO:tasks.workunit.client.1.smithi165.stdout:5/491: unlink d6/d1c/d28/d2d/c69 0 2024-09-06T14:44:29.345 INFO:tasks.workunit.client.1.smithi165.stdout:4/447: dwrite d5/f90 [0,4194304] 0 2024-09-06T14:44:29.346 INFO:tasks.workunit.client.1.smithi165.stdout:4/448: dread - d5/d1b/d1c/d20/d26/f98 zero size 2024-09-06T14:44:29.346 INFO:tasks.workunit.client.1.smithi165.stdout:5/492: truncate d6/d1c/f26 638712 0 2024-09-06T14:44:29.347 INFO:tasks.workunit.client.1.smithi165.stdout:5/493: fsync d6/d1c/f9c 0 2024-09-06T14:44:29.351 INFO:tasks.workunit.client.1.smithi165.stdout:5/494: truncate d6/d1c/d28/d2d/d3c/fa8 878435 0 2024-09-06T14:44:29.352 INFO:tasks.workunit.client.1.smithi165.stdout:5/495: fsync d6/d32/f84 0 2024-09-06T14:44:29.353 INFO:tasks.workunit.client.1.smithi165.stdout:4/449: dwrite d5/f8a [0,4194304] 0 2024-09-06T14:44:29.353 INFO:tasks.workunit.client.1.smithi165.stdout:5/496: fsync d6/d1c/d28/d4b/d55/d8a/fa0 0 2024-09-06T14:44:29.354 INFO:tasks.workunit.client.1.smithi165.stdout:2/445: dread d9/f1c [4194304,4194304] 0 2024-09-06T14:44:29.354 INFO:tasks.workunit.client.1.smithi165.stdout:4/450: chown d5/d1b/d1c/d20/d26/f88 19504521 1 2024-09-06T14:44:29.355 INFO:tasks.workunit.client.1.smithi165.stdout:2/446: truncate d9/f1e 4390028 0 2024-09-06T14:44:29.357 INFO:tasks.workunit.client.1.smithi165.stdout:4/451: creat d5/d1b/d1c/fa0 x:0 0 0 2024-09-06T14:44:29.360 INFO:tasks.workunit.client.1.smithi165.stdout:4/452: dread - d5/d1b/d1c/d55/f56 zero size 2024-09-06T14:44:29.360 INFO:tasks.workunit.client.1.smithi165.stdout:5/497: dwrite d6/d1c/d28/f6b [0,4194304] 0 2024-09-06T14:44:29.363 INFO:tasks.workunit.client.1.smithi165.stdout:5/498: read d6/d1c/d28/d4b/d55/fa9 [56034,11248] 0 2024-09-06T14:44:29.363 INFO:tasks.workunit.client.1.smithi165.stdout:4/453: truncate d5/d1b/d1c/d20/d75/d83/f4c 4279095 0 2024-09-06T14:44:29.366 INFO:tasks.workunit.client.1.smithi165.stdout:4/454: creat d5/d1b/d61/d77/d93/fa1 x:0 0 0 2024-09-06T14:44:29.368 INFO:tasks.workunit.client.1.smithi165.stdout:5/499: link d6/f13 d6/d1c/d28/d2d/d3c/d44/d90/fb3 0 2024-09-06T14:44:29.370 INFO:tasks.workunit.client.1.smithi165.stdout:5/500: creat d6/d1c/d28/d4b/d55/fb4 x:0 0 0 2024-09-06T14:44:29.371 INFO:tasks.workunit.client.1.smithi165.stdout:5/501: chown d6/f27 0 1 2024-09-06T14:44:29.497 INFO:tasks.workunit.client.1.smithi165.stdout:7/406: getdents d20/d65/d28/d80 0 2024-09-06T14:44:29.512 INFO:tasks.workunit.client.1.smithi165.stdout:6/473: dread d29/d39/d5b/d68/f6f [0,4194304] 0 2024-09-06T14:44:29.513 INFO:tasks.workunit.client.1.smithi165.stdout:6/474: rmdir d29/d39/d5b/d62/d67 39 2024-09-06T14:44:29.514 INFO:tasks.workunit.client.1.smithi165.stdout:8/465: write d0/d19/d7f/f9a [946716,114162] 0 2024-09-06T14:44:29.517 INFO:tasks.workunit.client.1.smithi165.stdout:6/475: creat d29/d6a/f8f x:0 0 0 2024-09-06T14:44:29.518 INFO:tasks.workunit.client.1.smithi165.stdout:6/476: chown d29/d39/f54 26 1 2024-09-06T14:44:29.519 INFO:tasks.workunit.client.1.smithi165.stdout:8/466: getdents d0/d9e 0 2024-09-06T14:44:29.520 INFO:tasks.workunit.client.1.smithi165.stdout:6/477: mknod d29/d6a/d71/c90 0 2024-09-06T14:44:29.522 INFO:tasks.workunit.client.1.smithi165.stdout:6/478: creat d29/d39/d5b/d68/f91 x:0 0 0 2024-09-06T14:44:29.525 INFO:tasks.workunit.client.1.smithi165.stdout:6/479: unlink d29/d39/d5b/d68/f88 0 2024-09-06T14:44:29.532 INFO:tasks.workunit.client.1.smithi165.stdout:6/480: dwrite f17 [4194304,4194304] 0 2024-09-06T14:44:29.535 INFO:tasks.workunit.client.1.smithi165.stdout:8/467: dread d0/d19/d36/d2d/d3f/f4e [0,4194304] 0 2024-09-06T14:44:29.537 INFO:tasks.workunit.client.1.smithi165.stdout:6/481: fdatasync d29/d39/f54 0 2024-09-06T14:44:29.537 INFO:tasks.workunit.client.1.smithi165.stdout:6/482: readlink d29/l59 0 2024-09-06T14:44:29.540 INFO:tasks.workunit.client.1.smithi165.stdout:8/468: mkdir d0/d19/d36/d2d/d33/da8 0 2024-09-06T14:44:29.540 INFO:tasks.workunit.client.1.smithi165.stdout:1/459: write d0/d2a/d18/d24/d4b/f51 [3078307,34929] 0 2024-09-06T14:44:29.544 INFO:tasks.workunit.client.1.smithi165.stdout:6/483: creat d29/d39/d5b/f92 x:0 0 0 2024-09-06T14:44:29.544 INFO:tasks.workunit.client.1.smithi165.stdout:6/484: chown d29/d32/c3a 380202 1 2024-09-06T14:44:29.544 INFO:tasks.workunit.client.1.smithi165.stdout:0/406: sync 2024-09-06T14:44:29.545 INFO:tasks.workunit.client.1.smithi165.stdout:8/469: symlink d0/d19/d36/d2d/d3f/la9 0 2024-09-06T14:44:29.547 INFO:tasks.workunit.client.1.smithi165.stdout:1/460: rename d0/d2a/d1b to d0/d2a/d18/d24/d4b/d93 0 2024-09-06T14:44:29.548 INFO:tasks.workunit.client.1.smithi165.stdout:0/407: symlink d15/d19/d28/d4f/d52/l87 0 2024-09-06T14:44:29.548 INFO:tasks.workunit.client.1.smithi165.stdout:0/408: chown fb 96 1 2024-09-06T14:44:29.553 INFO:tasks.workunit.client.1.smithi165.stdout:4/455: getdents d5/d1b/d1c/d20/d75/d83 0 2024-09-06T14:44:29.554 INFO:tasks.workunit.client.1.smithi165.stdout:0/409: rmdir d15/d19/d28/d4f 39 2024-09-06T14:44:29.556 INFO:tasks.workunit.client.1.smithi165.stdout:1/461: dwrite d0/d1c/d1d/d57/f82 [0,4194304] 0 2024-09-06T14:44:29.556 INFO:tasks.workunit.client.1.smithi165.stdout:6/485: rename d29/d6a/d6c to d29/d93 0 2024-09-06T14:44:29.558 INFO:tasks.workunit.client.1.smithi165.stdout:4/456: mknod d5/d1b/d61/ca2 0 2024-09-06T14:44:29.559 INFO:tasks.workunit.client.1.smithi165.stdout:6/486: truncate d29/d39/d5b/d62/f8b 576528 0 2024-09-06T14:44:29.559 INFO:tasks.workunit.client.1.smithi165.stdout:0/410: symlink d15/d55/l88 0 2024-09-06T14:44:29.560 INFO:tasks.workunit.client.1.smithi165.stdout:4/457: unlink d5/f13 0 2024-09-06T14:44:29.561 INFO:tasks.workunit.client.1.smithi165.stdout:4/458: chown d5/c6 75 1 2024-09-06T14:44:29.562 INFO:tasks.workunit.client.1.smithi165.stdout:4/459: stat d5/d1b/d61/d97 0 2024-09-06T14:44:29.562 INFO:tasks.workunit.client.1.smithi165.stdout:5/502: dread d6/d1c/d28/f2b [0,4194304] 0 2024-09-06T14:44:29.565 INFO:tasks.workunit.client.1.smithi165.stdout:5/503: read d6/d1c/f38 [445679,19257] 0 2024-09-06T14:44:29.568 INFO:tasks.workunit.client.1.smithi165.stdout:4/460: creat d5/d1b/d1c/d8c/fa3 x:0 0 0 2024-09-06T14:44:29.570 INFO:tasks.workunit.client.1.smithi165.stdout:4/461: chown d5/d1b/d1c/d55/f68 0 1 2024-09-06T14:44:29.570 INFO:tasks.workunit.client.1.smithi165.stdout:2/447: dwrite d9/f13 [4194304,4194304] 0 2024-09-06T14:44:29.572 INFO:tasks.workunit.client.1.smithi165.stdout:6/487: mkdir d29/d39/d5b/d62/d94 0 2024-09-06T14:44:29.575 INFO:tasks.workunit.client.1.smithi165.stdout:7/407: write d20/d65/d28/d30/f31 [1506863,77243] 0 2024-09-06T14:44:29.580 INFO:tasks.workunit.client.1.smithi165.stdout:5/504: creat d6/fb5 x:0 0 0 2024-09-06T14:44:29.581 INFO:tasks.workunit.client.1.smithi165.stdout:5/505: fdatasync d6/d1c/f39 0 2024-09-06T14:44:29.583 INFO:tasks.workunit.client.1.smithi165.stdout:9/627: write db/de/d15/fc9 [782216,107924] 0 2024-09-06T14:44:29.585 INFO:tasks.workunit.client.1.smithi165.stdout:9/628: write db/de/d15/d17/d72/f76 [1412351,1608] 0 2024-09-06T14:44:29.586 INFO:tasks.workunit.client.1.smithi165.stdout:6/488: creat d29/d6a/d83/f95 x:0 0 0 2024-09-06T14:44:29.588 INFO:tasks.workunit.client.1.smithi165.stdout:4/462: link d5/d1b/d66/f85 d5/d1b/d1c/fa4 0 2024-09-06T14:44:29.588 INFO:tasks.workunit.client.1.smithi165.stdout:2/448: dread d9/d25/d45/d75/d67/d76/f6a [0,4194304] 0 2024-09-06T14:44:29.589 INFO:tasks.workunit.client.1.smithi165.stdout:4/463: dread - d5/d1b/d1c/fa4 zero size 2024-09-06T14:44:29.590 INFO:tasks.workunit.client.1.smithi165.stdout:5/506: mknod d6/d1c/d28/d4b/d55/d8a/cb6 0 2024-09-06T14:44:29.590 INFO:tasks.workunit.client.1.smithi165.stdout:4/464: stat d5/d1b/d61/f82 0 2024-09-06T14:44:29.591 INFO:tasks.workunit.client.1.smithi165.stdout:5/507: write d6/d1c/d28/d2d/d3c/fa8 [1783789,12286] 0 2024-09-06T14:44:29.592 INFO:tasks.workunit.client.1.smithi165.stdout:8/470: truncate d0/d19/d36/d2d/f38 12570415 0 2024-09-06T14:44:29.592 INFO:tasks.workunit.client.1.smithi165.stdout:0/411: getdents d15/d19/d28/d51 0 2024-09-06T14:44:29.593 INFO:tasks.workunit.client.1.smithi165.stdout:5/508: read d6/f2a [402773,124633] 0 2024-09-06T14:44:29.594 INFO:tasks.workunit.client.1.smithi165.stdout:5/509: read - d6/d1c/d28/d4b/fae zero size 2024-09-06T14:44:29.594 INFO:tasks.workunit.client.1.smithi165.stdout:9/629: rename db/de/d15/d17/f5c to db/de/d15/d74/fca 0 2024-09-06T14:44:29.597 INFO:tasks.workunit.client.1.smithi165.stdout:1/462: write d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f6c [5263882,16140] 0 2024-09-06T14:44:29.602 INFO:tasks.workunit.client.1.smithi165.stdout:8/471: mkdir d0/d14/d3e/daa 0 2024-09-06T14:44:29.603 INFO:tasks.workunit.client.1.smithi165.stdout:0/412: fdatasync d15/d19/d2c/f36 0 2024-09-06T14:44:29.603 INFO:tasks.workunit.client.1.smithi165.stdout:8/472: chown d0/d14/d3e/f35 1789460 1 2024-09-06T14:44:29.604 INFO:tasks.workunit.client.1.smithi165.stdout:0/413: write d15/d19/d38/f5e [4833388,90138] 0 2024-09-06T14:44:29.607 INFO:tasks.workunit.client.1.smithi165.stdout:5/510: creat d6/d1c/d28/d4b/d60/fb7 x:0 0 0 2024-09-06T14:44:29.607 INFO:tasks.workunit.client.1.smithi165.stdout:5/511: readlink d6/l25 0 2024-09-06T14:44:29.608 INFO:tasks.workunit.client.1.smithi165.stdout:6/489: mknod d29/d6a/c96 0 2024-09-06T14:44:29.610 INFO:tasks.workunit.client.1.smithi165.stdout:9/630: mknod db/de/d15/d17/d18/d7d/d61/ccb 0 2024-09-06T14:44:29.615 INFO:tasks.workunit.client.1.smithi165.stdout:9/631: write db/de/d15/d74/fb0 [48768,111092] 0 2024-09-06T14:44:29.617 INFO:tasks.workunit.client.1.smithi165.stdout:8/473: creat d0/d19/d24/fab x:0 0 0 2024-09-06T14:44:29.618 INFO:tasks.workunit.client.1.smithi165.stdout:5/512: dwrite d6/fb5 [0,4194304] 0 2024-09-06T14:44:29.618 INFO:tasks.workunit.client.1.smithi165.stdout:2/449: link d9/d23/d29/c2e d9/d25/c8f 0 2024-09-06T14:44:29.618 INFO:tasks.workunit.client.1.smithi165.stdout:6/490: dwrite d29/d6a/d83/f95 [0,4194304] 0 2024-09-06T14:44:29.619 INFO:tasks.workunit.client.1.smithi165.stdout:1/463: symlink d0/d2a/d23/d7e/l94 0 2024-09-06T14:44:29.619 INFO:tasks.workunit.client.1.smithi165.stdout:8/474: dread - d0/d34/d6b/d94/f5f zero size 2024-09-06T14:44:29.621 INFO:tasks.workunit.client.1.smithi165.stdout:6/491: truncate f16 1390813 0 2024-09-06T14:44:29.622 INFO:tasks.workunit.client.1.smithi165.stdout:7/408: getdents d20/d33/d53/d66 0 2024-09-06T14:44:29.622 INFO:tasks.workunit.client.1.smithi165.stdout:1/464: chown d0/d2a/d18/d24/d4b/d93/d2b/d3e/l52 31 1 2024-09-06T14:44:29.622 INFO:tasks.workunit.client.1.smithi165.stdout:0/414: dread d15/d19/d38/f4c [0,4194304] 0 2024-09-06T14:44:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: Adjusting osd_memory_target on smithi165 to 2240M 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-06T14:44:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: pgmap v17: 65 pgs: 65 active+clean; 973 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 MiB/s rd, 130 MiB/s wr, 431 op/s 2024-09-06T14:44:29.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:29 smithi052 ceph-mon[28627]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:44:29.625 INFO:tasks.workunit.client.1.smithi165.stdout:0/415: readlink d15/d19/d50/l76 0 2024-09-06T14:44:29.625 INFO:tasks.workunit.client.1.smithi165.stdout:1/465: write d0/d2a/d23/d56/f71 [355240,8495] 0 2024-09-06T14:44:29.625 INFO:tasks.workunit.client.1.smithi165.stdout:9/632: creat db/de/d15/d7f/fcc x:0 0 0 2024-09-06T14:44:29.630 INFO:tasks.workunit.client.1.smithi165.stdout:4/465: getdents d5/d1b/d1c/d55 0 2024-09-06T14:44:29.633 INFO:tasks.workunit.client.1.smithi165.stdout:1/466: dwrite d0/d2a/d18/d24/d4b/d93/d68/f86 [0,4194304] 0 2024-09-06T14:44:29.635 INFO:tasks.workunit.client.1.smithi165.stdout:8/475: write d0/d9e/fa4 [995263,56809] 0 2024-09-06T14:44:29.635 INFO:tasks.workunit.client.1.smithi165.stdout:1/467: readlink d0/d2a/l8b 0 2024-09-06T14:44:29.635 INFO:tasks.workunit.client.1.smithi165.stdout:7/409: creat d20/d65/d28/d30/d78/f84 x:0 0 0 2024-09-06T14:44:29.636 INFO:tasks.workunit.client.1.smithi165.stdout:3/482: sync 2024-09-06T14:44:29.637 INFO:tasks.workunit.client.1.smithi165.stdout:1/468: readlink d0/d2a/d23/d56/l79 0 2024-09-06T14:44:29.637 INFO:tasks.workunit.client.1.smithi165.stdout:8/476: chown d0/d14/d50/d8c 254513 1 2024-09-06T14:44:29.638 INFO:tasks.workunit.client.1.smithi165.stdout:0/416: creat d15/d19/d28/d51/f89 x:0 0 0 2024-09-06T14:44:29.638 INFO:tasks.workunit.client.1.smithi165.stdout:1/469: readlink d0/d2a/d18/l6d 0 2024-09-06T14:44:29.639 INFO:tasks.workunit.client.1.smithi165.stdout:1/470: fdatasync d0/d1c/d41/f5e 0 2024-09-06T14:44:29.642 INFO:tasks.workunit.client.1.smithi165.stdout:0/417: dread fb [0,4194304] 0 2024-09-06T14:44:29.642 INFO:tasks.workunit.client.1.smithi165.stdout:2/450: mkdir d9/d25/d46/d7e/d90 0 2024-09-06T14:44:29.644 INFO:tasks.workunit.client.1.smithi165.stdout:4/466: unlink d5/d1b/d1c/d20/d75/d83/f53 0 2024-09-06T14:44:29.646 INFO:tasks.workunit.client.1.smithi165.stdout:4/467: dread - d5/d1b/d1c/d8c/fa3 zero size 2024-09-06T14:44:29.647 INFO:tasks.workunit.client.1.smithi165.stdout:4/468: dread - d5/d1b/d61/f7a zero size 2024-09-06T14:44:29.650 INFO:tasks.workunit.client.1.smithi165.stdout:1/471: mkdir d0/d2a/d18/d24/d4b/d95 0 2024-09-06T14:44:29.651 INFO:tasks.workunit.client.1.smithi165.stdout:5/513: rename d6/f21 to d6/d1c/d28/fb8 0 2024-09-06T14:44:29.651 INFO:tasks.workunit.client.1.smithi165.stdout:1/472: write d0/d2a/f8e [23247,102299] 0 2024-09-06T14:44:29.653 INFO:tasks.workunit.client.1.smithi165.stdout:8/477: dwrite d0/d34/d6b/d94/d70/f88 [0,4194304] 0 2024-09-06T14:44:29.654 INFO:tasks.workunit.client.1.smithi165.stdout:9/633: truncate db/de/d15/f48 3098430 0 2024-09-06T14:44:29.657 INFO:tasks.workunit.client.1.smithi165.stdout:4/469: mknod d5/d1b/d1c/d20/d75/d83/ca5 0 2024-09-06T14:44:29.658 INFO:tasks.workunit.client.1.smithi165.stdout:4/470: stat d5/d1b/d1c/d20/d26/l65 0 2024-09-06T14:44:29.659 INFO:tasks.workunit.client.1.smithi165.stdout:0/418: write d15/d19/f25 [8136934,101073] 0 2024-09-06T14:44:29.662 INFO:tasks.workunit.client.1.smithi165.stdout:0/419: read d15/f2f [10304542,96708] 0 2024-09-06T14:44:29.664 INFO:tasks.workunit.client.1.smithi165.stdout:4/471: unlink d5/d1b/d61/f7a 0 2024-09-06T14:44:29.664 INFO:tasks.workunit.client.1.smithi165.stdout:6/492: dread d29/f35 [0,4194304] 0 2024-09-06T14:44:29.664 INFO:tasks.workunit.client.1.smithi165.stdout:1/473: dwrite d0/d2a/d18/d24/d4b/d93/d68/f86 [0,4194304] 0 2024-09-06T14:44:29.665 INFO:tasks.workunit.client.1.smithi165.stdout:5/514: symlink d6/d1c/d28/d2d/d3c/d44/d90/lb9 0 2024-09-06T14:44:29.667 INFO:tasks.workunit.client.1.smithi165.stdout:3/483: getdents d1/d4a 0 2024-09-06T14:44:29.667 INFO:tasks.workunit.client.1.smithi165.stdout:2/451: rename d9/f1d to d9/d4f/f91 0 2024-09-06T14:44:29.668 INFO:tasks.workunit.client.1.smithi165.stdout:4/472: write d5/d1b/f74 [1009829,126621] 0 2024-09-06T14:44:29.668 INFO:tasks.workunit.client.1.smithi165.stdout:7/410: getdents d20/d65/d28/d30/d78 0 2024-09-06T14:44:29.669 INFO:tasks.workunit.client.1.smithi165.stdout:4/473: chown d5/c6 3029 1 2024-09-06T14:44:29.670 INFO:tasks.workunit.client.1.smithi165.stdout:8/478: creat d0/d14/fac x:0 0 0 2024-09-06T14:44:29.674 INFO:tasks.workunit.client.1.smithi165.stdout:6/493: chown d29/d93/f6e 72 1 2024-09-06T14:44:29.675 INFO:tasks.workunit.client.1.smithi165.stdout:5/515: creat d6/d1c/d28/d2d/d61/fba x:0 0 0 2024-09-06T14:44:29.678 INFO:tasks.workunit.client.1.smithi165.stdout:5/516: write d6/d1c/d64/f65 [975234,109968] 0 2024-09-06T14:44:29.681 INFO:tasks.workunit.client.1.smithi165.stdout:9/634: truncate db/de/d15/d17/f25 3063460 0 2024-09-06T14:44:29.682 INFO:tasks.workunit.client.1.smithi165.stdout:0/420: write d15/d19/d28/d3a/f41 [4576503,64058] 0 2024-09-06T14:44:29.683 INFO:tasks.workunit.client.1.smithi165.stdout:1/474: creat d0/d2a/d18/d24/d4b/d95/f96 x:0 0 0 2024-09-06T14:44:29.685 INFO:tasks.workunit.client.1.smithi165.stdout:4/474: mknod d5/d1b/d1c/d20/ca6 0 2024-09-06T14:44:29.685 INFO:tasks.workunit.client.1.smithi165.stdout:0/421: dread - d15/d19/d28/d3a/f86 zero size 2024-09-06T14:44:29.685 INFO:tasks.workunit.client.1.smithi165.stdout:5/517: dwrite d6/d1c/f3d [0,4194304] 0 2024-09-06T14:44:29.687 INFO:tasks.workunit.client.1.smithi165.stdout:0/422: chown d15/d19/d28/d3a/l3e 821468022 1 2024-09-06T14:44:29.687 INFO:tasks.workunit.client.1.smithi165.stdout:8/479: unlink d0/d19/d36/d2d/d3f/f9b 0 2024-09-06T14:44:29.687 INFO:tasks.workunit.client.1.smithi165.stdout:6/494: symlink d29/d39/d86/l97 0 2024-09-06T14:44:29.688 INFO:tasks.workunit.client.1.smithi165.stdout:7/411: write d20/d3b/f72 [4155293,50050] 0 2024-09-06T14:44:29.688 INFO:tasks.workunit.client.1.smithi165.stdout:9/635: fdatasync db/de/d15/d7f/d9b/d6c/f75 0 2024-09-06T14:44:29.691 INFO:tasks.workunit.client.1.smithi165.stdout:7/412: read f15 [97404,63490] 0 2024-09-06T14:44:29.693 INFO:tasks.workunit.client.1.smithi165.stdout:4/475: creat d5/d1b/d1c/d55/fa7 x:0 0 0 2024-09-06T14:44:29.693 INFO:tasks.workunit.client.1.smithi165.stdout:1/475: dread d0/d2a/d23/f66 [0,4194304] 0 2024-09-06T14:44:29.694 INFO:tasks.workunit.client.1.smithi165.stdout:8/480: chown d0/d19/d36/d28/f90 3 1 2024-09-06T14:44:29.698 INFO:tasks.workunit.client.1.smithi165.stdout:7/413: rmdir d20/d65/d28 39 2024-09-06T14:44:29.699 INFO:tasks.workunit.client.1.smithi165.stdout:8/481: creat d0/d14/d3e/fad x:0 0 0 2024-09-06T14:44:29.699 INFO:tasks.workunit.client.1.smithi165.stdout:1/476: mkdir d0/d2a/d18/d24/d4b/d93/d97 0 2024-09-06T14:44:29.700 INFO:tasks.workunit.client.1.smithi165.stdout:9/636: symlink db/de/d15/lcd 0 2024-09-06T14:44:29.701 INFO:tasks.workunit.client.1.smithi165.stdout:6/495: dwrite d29/f66 [0,4194304] 0 2024-09-06T14:44:29.701 INFO:tasks.workunit.client.1.smithi165.stdout:5/518: rename d6/d1c/d28/d2d/d61/l8b to d6/d1c/d28/d2d/lbb 0 2024-09-06T14:44:29.702 INFO:tasks.workunit.client.1.smithi165.stdout:6/496: chown f25 0 1 2024-09-06T14:44:29.704 INFO:tasks.workunit.client.1.smithi165.stdout:0/423: getdents d15/d19/d50/d53 0 2024-09-06T14:44:29.704 INFO:tasks.workunit.client.1.smithi165.stdout:5/519: fsync d6/f13 0 2024-09-06T14:44:29.704 INFO:tasks.workunit.client.1.smithi165.stdout:1/477: mkdir d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98 0 2024-09-06T14:44:29.706 INFO:tasks.workunit.client.1.smithi165.stdout:6/497: write d29/d39/d5b/d68/f7c [2195372,95107] 0 2024-09-06T14:44:29.707 INFO:tasks.workunit.client.1.smithi165.stdout:4/476: dread d5/d1b/d1c/d20/d75/d83/f5f [0,4194304] 0 2024-09-06T14:44:29.709 INFO:tasks.workunit.client.1.smithi165.stdout:8/482: creat d0/d14/fae x:0 0 0 2024-09-06T14:44:29.712 INFO:tasks.workunit.client.1.smithi165.stdout:0/424: mkdir d15/d19/d28/d3a/d8a 0 2024-09-06T14:44:29.713 INFO:tasks.workunit.client.1.smithi165.stdout:4/477: rename d5/f90 to d5/d1b/d1c/d55/d7d/fa8 0 2024-09-06T14:44:29.715 INFO:tasks.workunit.client.1.smithi165.stdout:7/414: dwrite d20/d65/d28/f58 [0,4194304] 0 2024-09-06T14:44:29.718 INFO:tasks.workunit.client.1.smithi165.stdout:6/498: dwrite d29/d32/f85 [0,4194304] 0 2024-09-06T14:44:29.719 INFO:tasks.workunit.client.1.smithi165.stdout:1/478: rename d0/d1c/d1d/d57/f82 to d0/d2a/d18/d24/d4b/d93/d68/d75/f99 0 2024-09-06T14:44:29.719 INFO:tasks.workunit.client.1.smithi165.stdout:5/520: link d6/l6c d6/d1c/d28/d4b/da7/lbc 0 2024-09-06T14:44:29.721 INFO:tasks.workunit.client.1.smithi165.stdout:6/499: dread d29/d6a/f8d [0,4194304] 0 2024-09-06T14:44:29.722 INFO:tasks.workunit.client.1.smithi165.stdout:1/479: dread - d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f6b zero size 2024-09-06T14:44:29.724 INFO:tasks.workunit.client.1.smithi165.stdout:1/480: stat d0/d2a/d18/d24/d4b/d93/f1f 0 2024-09-06T14:44:29.725 INFO:tasks.workunit.client.1.smithi165.stdout:1/481: chown d0/d2a/d18/d24/d4b/d93 8961519 1 2024-09-06T14:44:29.726 INFO:tasks.workunit.client.1.smithi165.stdout:1/482: write d0/d2a/f53 [4136755,123394] 0 2024-09-06T14:44:29.728 INFO:tasks.workunit.client.1.smithi165.stdout:1/483: fsync d0/d2a/d18/d24/d4b/d95/f96 0 2024-09-06T14:44:29.730 INFO:tasks.workunit.client.1.smithi165.stdout:4/478: write d5/d1b/d1c/f4f [403987,24967] 0 2024-09-06T14:44:29.731 INFO:tasks.workunit.client.1.smithi165.stdout:5/521: mkdir d6/d1c/d28/d4b/d60/dbd 0 2024-09-06T14:44:29.732 INFO:tasks.workunit.client.1.smithi165.stdout:6/500: chown c11 14618 1 2024-09-06T14:44:29.732 INFO:tasks.workunit.client.1.smithi165.stdout:7/415: rmdir d20/d4d 39 2024-09-06T14:44:29.734 INFO:tasks.workunit.client.1.smithi165.stdout:6/501: truncate d29/d6a/f8a 340148 0 2024-09-06T14:44:29.735 INFO:tasks.workunit.client.1.smithi165.stdout:5/522: rmdir d6/d1c/d28/d4b 39 2024-09-06T14:44:29.735 INFO:tasks.workunit.client.1.smithi165.stdout:6/502: readlink d29/l2e 0 2024-09-06T14:44:29.735 INFO:tasks.workunit.client.1.smithi165.stdout:1/484: mknod d0/d2a/c9a 0 2024-09-06T14:44:29.737 INFO:tasks.workunit.client.1.smithi165.stdout:6/503: truncate f16 1488188 0 2024-09-06T14:44:29.737 INFO:tasks.workunit.client.1.smithi165.stdout:0/425: rename d15/d19/d28/d3a/l3e to d15/l8b 0 2024-09-06T14:44:29.739 INFO:tasks.workunit.client.1.smithi165.stdout:8/483: dread d0/d19/d36/d2d/f38 [0,4194304] 0 2024-09-06T14:44:29.740 INFO:tasks.workunit.client.1.smithi165.stdout:1/485: symlink d0/d1c/d1d/d57/l9b 0 2024-09-06T14:44:29.740 INFO:tasks.workunit.client.1.smithi165.stdout:6/504: rename d29 to d29/d6a/d83/d98 22 2024-09-06T14:44:29.742 INFO:tasks.workunit.client.1.smithi165.stdout:5/523: chown d6/d1c/d28/d4b/d55/fb4 9436004 1 2024-09-06T14:44:29.746 INFO:tasks.workunit.client.1.smithi165.stdout:8/484: mkdir d0/d19/d36/d2d/d3f/daf 0 2024-09-06T14:44:29.746 INFO:tasks.workunit.client.1.smithi165.stdout:6/505: read f17 [4114825,44110] 0 2024-09-06T14:44:29.746 INFO:tasks.workunit.client.1.smithi165.stdout:7/416: dread f1f [0,4194304] 0 2024-09-06T14:44:29.747 INFO:tasks.workunit.client.1.smithi165.stdout:4/479: dwrite d5/d1b/d1c/f22 [0,4194304] 0 2024-09-06T14:44:29.747 INFO:tasks.workunit.client.1.smithi165.stdout:5/524: truncate d6/d1c/d64/f6e 5555490 0 2024-09-06T14:44:29.751 INFO:tasks.workunit.client.1.smithi165.stdout:1/486: write d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f85 [539807,78382] 0 2024-09-06T14:44:29.752 INFO:tasks.workunit.client.1.smithi165.stdout:7/417: creat d20/d3b/d69/f85 x:0 0 0 2024-09-06T14:44:29.752 INFO:tasks.workunit.client.1.smithi165.stdout:6/506: mknod d29/c99 0 2024-09-06T14:44:29.754 INFO:tasks.workunit.client.1.smithi165.stdout:5/525: creat d6/d1c/d28/d4b/d55/fbe x:0 0 0 2024-09-06T14:44:29.754 INFO:tasks.workunit.client.1.smithi165.stdout:0/426: dwrite d15/d19/d28/f67 [0,4194304] 0 2024-09-06T14:44:29.756 INFO:tasks.workunit.client.1.smithi165.stdout:7/418: dread - d20/d33/d53/f7f zero size 2024-09-06T14:44:29.756 INFO:tasks.workunit.client.1.smithi165.stdout:0/427: fsync f3 0 2024-09-06T14:44:29.758 INFO:tasks.workunit.client.1.smithi165.stdout:5/526: truncate d6/d1c/d64/f6e 6512519 0 2024-09-06T14:44:29.759 INFO:tasks.workunit.client.1.smithi165.stdout:4/480: dwrite d5/d1b/d61/f9d [0,4194304] 0 2024-09-06T14:44:29.762 INFO:tasks.workunit.client.1.smithi165.stdout:8/485: truncate d0/d19/d36/d28/f78 78992 0 2024-09-06T14:44:29.765 INFO:tasks.workunit.client.1.smithi165.stdout:4/481: mkdir d5/d1b/d1c/d78/da9 0 2024-09-06T14:44:29.765 INFO:tasks.workunit.client.1.smithi165.stdout:8/486: fsync d0/f22 0 2024-09-06T14:44:29.766 INFO:tasks.workunit.client.1.smithi165.stdout:0/428: getdents d15/d19/d28/d3a/d8a 0 2024-09-06T14:44:29.767 INFO:tasks.workunit.client.1.smithi165.stdout:0/429: write d15/d19/d28/d3a/f41 [3833254,66974] 0 2024-09-06T14:44:29.768 INFO:tasks.workunit.client.1.smithi165.stdout:8/487: read d0/d19/d36/d2d/d33/f4c [629448,71735] 0 2024-09-06T14:44:29.769 INFO:tasks.workunit.client.1.smithi165.stdout:0/430: readlink d15/d19/d2c/l39 0 2024-09-06T14:44:29.769 INFO:tasks.workunit.client.1.smithi165.stdout:6/507: truncate f16 674588 0 2024-09-06T14:44:29.772 INFO:tasks.workunit.client.1.smithi165.stdout:4/482: mkdir d5/d1b/d61/d77/d7c/daa 0 2024-09-06T14:44:29.775 INFO:tasks.workunit.client.1.smithi165.stdout:8/488: dwrite d0/d19/f7b [0,4194304] 0 2024-09-06T14:44:29.775 INFO:tasks.workunit.client.1.smithi165.stdout:5/527: dread d6/f37 [0,4194304] 0 2024-09-06T14:44:29.777 INFO:tasks.workunit.client.1.smithi165.stdout:5/528: write d6/d1c/d64/f65 [409780,16102] 0 2024-09-06T14:44:29.777 INFO:tasks.workunit.client.1.smithi165.stdout:4/483: creat d5/d1b/d1c/d55/d7d/fab x:0 0 0 2024-09-06T14:44:29.780 INFO:tasks.workunit.client.1.smithi165.stdout:6/508: rename d29/d32/c3a to d29/d39/d5b/d62/d67/c9a 0 2024-09-06T14:44:29.781 INFO:tasks.workunit.client.1.smithi165.stdout:5/529: dread d6/f37 [0,4194304] 0 2024-09-06T14:44:29.781 INFO:tasks.workunit.client.1.smithi165.stdout:6/509: stat d29/d39/d5b/d62 0 2024-09-06T14:44:29.787 INFO:tasks.workunit.client.1.smithi165.stdout:6/510: unlink d29/d39/d5b/d62/f8b 0 2024-09-06T14:44:29.789 INFO:tasks.workunit.client.1.smithi165.stdout:5/530: dwrite d6/f27 [0,4194304] 0 2024-09-06T14:44:29.789 INFO:tasks.workunit.client.1.smithi165.stdout:0/431: getdents d15/d19/d28/d4f/d52 0 2024-09-06T14:44:29.790 INFO:tasks.workunit.client.1.smithi165.stdout:0/432: fdatasync d15/d19/d2c/f36 0 2024-09-06T14:44:29.793 INFO:tasks.workunit.client.1.smithi165.stdout:6/511: fsync d29/f35 0 2024-09-06T14:44:29.793 INFO:tasks.workunit.client.1.smithi165.stdout:8/489: dread d0/fc [8388608,4194304] 0 2024-09-06T14:44:29.796 INFO:tasks.workunit.client.1.smithi165.stdout:4/484: getdents d5/d1b 0 2024-09-06T14:44:29.799 INFO:tasks.workunit.client.1.smithi165.stdout:5/531: rename d6/d1c/d7c/f97 to d6/d1c/d28/d4b/fbf 0 2024-09-06T14:44:29.800 INFO:tasks.workunit.client.1.smithi165.stdout:0/433: dread - d15/d19/d28/f7a zero size 2024-09-06T14:44:29.802 INFO:tasks.workunit.client.1.smithi165.stdout:6/512: fsync f1d 0 2024-09-06T14:44:29.806 INFO:tasks.workunit.client.1.smithi165.stdout:0/434: symlink d15/d19/d66/l8c 0 2024-09-06T14:44:29.807 INFO:tasks.workunit.client.1.smithi165.stdout:0/435: stat d15/d6e/f85 0 2024-09-06T14:44:29.808 INFO:tasks.workunit.client.1.smithi165.stdout:6/513: readlink d29/d93/l7b 0 2024-09-06T14:44:29.808 INFO:tasks.workunit.client.1.smithi165.stdout:0/436: stat d15/d19/d28/d51 0 2024-09-06T14:44:29.808 INFO:tasks.workunit.client.1.smithi165.stdout:8/490: readlink d0/d19/d36/d2d/d33/d3a/d46/d49/l7a 0 2024-09-06T14:44:29.809 INFO:tasks.workunit.client.1.smithi165.stdout:4/485: mknod d5/d1b/d61/d77/d7c/daa/cac 0 2024-09-06T14:44:29.809 INFO:tasks.workunit.client.1.smithi165.stdout:5/532: mkdir d6/d1c/d28/d2d/dc0 0 2024-09-06T14:44:29.809 INFO:tasks.workunit.client.1.smithi165.stdout:6/514: write d29/d39/d5b/d68/f91 [101767,105091] 0 2024-09-06T14:44:29.810 INFO:tasks.workunit.client.1.smithi165.stdout:0/437: mkdir d15/d19/d50/d53/d8d 0 2024-09-06T14:44:29.810 INFO:tasks.workunit.client.1.smithi165.stdout:4/486: write d5/d1b/d1c/f34 [1590658,126834] 0 2024-09-06T14:44:29.813 INFO:tasks.workunit.client.1.smithi165.stdout:5/533: mkdir d6/dc1 0 2024-09-06T14:44:29.814 INFO:tasks.workunit.client.1.smithi165.stdout:8/491: creat d0/d19/d36/d2d/d33/d3a/fb0 x:0 0 0 2024-09-06T14:44:29.814 INFO:tasks.workunit.client.1.smithi165.stdout:8/492: dread - d0/d14/fac zero size 2024-09-06T14:44:29.815 INFO:tasks.workunit.client.1.smithi165.stdout:6/515: creat d29/d39/d5b/f9b x:0 0 0 2024-09-06T14:44:29.816 INFO:tasks.workunit.client.1.smithi165.stdout:8/493: write d0/d19/d36/d2d/d3f/f4e [5049754,74978] 0 2024-09-06T14:44:29.816 INFO:tasks.workunit.client.1.smithi165.stdout:4/487: creat d5/d1b/d1c/d8c/fad x:0 0 0 2024-09-06T14:44:29.817 INFO:tasks.workunit.client.1.smithi165.stdout:4/488: chown d5/d1b/d1c/fa4 1303186 1 2024-09-06T14:44:29.818 INFO:tasks.workunit.client.1.smithi165.stdout:5/534: mknod d6/d1c/d28/d2d/d3c/d44/d82/cc2 0 2024-09-06T14:44:29.819 INFO:tasks.workunit.client.1.smithi165.stdout:0/438: fsync d15/d19/d28/f42 0 2024-09-06T14:44:29.821 INFO:tasks.workunit.client.1.smithi165.stdout:6/516: creat d29/d39/d5b/d62/d67/f9c x:0 0 0 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: Adjusting osd_memory_target on smithi165 to 2240M 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:44:29.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:44:29.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:44:29.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-06T14:44:29.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: pgmap v17: 65 pgs: 65 active+clean; 973 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 23 MiB/s rd, 130 MiB/s wr, 431 op/s 2024-09-06T14:44:29.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:29 smithi165 ceph-mon[36229]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:44:29.825 INFO:tasks.workunit.client.1.smithi165.stdout:4/489: rmdir d5/d1b/d1c/d20/d75/d83 39 2024-09-06T14:44:29.825 INFO:tasks.workunit.client.1.smithi165.stdout:6/517: write d29/d39/d5b/d62/d67/f9c [578598,43077] 0 2024-09-06T14:44:29.826 INFO:tasks.workunit.client.1.smithi165.stdout:0/439: dread d15/d19/d28/f67 [0,4194304] 0 2024-09-06T14:44:29.827 INFO:tasks.workunit.client.1.smithi165.stdout:5/535: dwrite d6/d1c/d28/d4b/d60/fb7 [0,4194304] 0 2024-09-06T14:44:29.827 INFO:tasks.workunit.client.1.smithi165.stdout:5/536: chown d6/c86 2289329 1 2024-09-06T14:44:29.828 INFO:tasks.workunit.client.1.smithi165.stdout:6/518: chown c15 689446 1 2024-09-06T14:44:29.831 INFO:tasks.workunit.client.1.smithi165.stdout:0/440: unlink d15/d19/d28/d51/f89 0 2024-09-06T14:44:29.834 INFO:tasks.workunit.client.1.smithi165.stdout:5/537: symlink d6/dc1/lc3 0 2024-09-06T14:44:29.835 INFO:tasks.workunit.client.1.smithi165.stdout:0/441: write d15/d19/d38/f47 [1217383,90499] 0 2024-09-06T14:44:29.837 INFO:tasks.workunit.client.1.smithi165.stdout:6/519: mknod d29/d32/d7a/c9d 0 2024-09-06T14:44:29.837 INFO:tasks.workunit.client.1.smithi165.stdout:4/490: dwrite d5/d1b/d1c/f22 [0,4194304] 0 2024-09-06T14:44:29.838 INFO:tasks.workunit.client.1.smithi165.stdout:8/494: dwrite d0/f1a [0,4194304] 0 2024-09-06T14:44:29.838 INFO:tasks.workunit.client.1.smithi165.stdout:5/538: stat d6/d1c/d28/d4b/d60/f78 0 2024-09-06T14:44:29.838 INFO:tasks.workunit.client.1.smithi165.stdout:0/442: chown d15/c18 9976854 1 2024-09-06T14:44:29.838 INFO:tasks.workunit.client.1.smithi165.stdout:6/520: chown d29/d93/f6e 58971692 1 2024-09-06T14:44:29.839 INFO:tasks.workunit.client.1.smithi165.stdout:8/495: stat d0/f9 0 2024-09-06T14:44:29.842 INFO:tasks.workunit.client.1.smithi165.stdout:0/443: mknod d15/d19/d28/d4f/c8e 0 2024-09-06T14:44:29.844 INFO:tasks.workunit.client.1.smithi165.stdout:5/539: truncate d6/d1c/d28/d2d/f53 1981073 0 2024-09-06T14:44:29.845 INFO:tasks.workunit.client.1.smithi165.stdout:5/540: stat d6/d1c/d28/fb8 0 2024-09-06T14:44:29.846 INFO:tasks.workunit.client.1.smithi165.stdout:8/496: rename d0/d14/d50 to d0/d19/d24/db1 0 2024-09-06T14:44:29.847 INFO:tasks.workunit.client.1.smithi165.stdout:8/497: stat d0/d19/d36/fe 0 2024-09-06T14:44:29.847 INFO:tasks.workunit.client.1.smithi165.stdout:5/541: read d6/d1c/d28/d4b/f5e [37444,70731] 0 2024-09-06T14:44:29.847 INFO:tasks.workunit.client.1.smithi165.stdout:8/498: fsync d0/d9e/fa4 0 2024-09-06T14:44:29.850 INFO:tasks.workunit.client.1.smithi165.stdout:0/444: symlink d15/d19/d28/l8f 0 2024-09-06T14:44:29.852 INFO:tasks.workunit.client.1.smithi165.stdout:0/445: chown d15/d19/d28/d4f/f7b 16 1 2024-09-06T14:44:29.852 INFO:tasks.workunit.client.1.smithi165.stdout:5/542: stat d6/d1c/d28/d2d/d61/l7b 0 2024-09-06T14:44:29.854 INFO:tasks.workunit.client.1.smithi165.stdout:8/499: link d0/f1a d0/d5e/d65/fb2 0 2024-09-06T14:44:29.857 INFO:tasks.workunit.client.1.smithi165.stdout:8/500: chown d0/d14/d3e/daa 25 1 2024-09-06T14:44:29.858 INFO:tasks.workunit.client.1.smithi165.stdout:4/491: dwrite d5/d1b/d66/f85 [0,4194304] 0 2024-09-06T14:44:29.859 INFO:tasks.workunit.client.1.smithi165.stdout:6/521: dwrite d29/d39/f54 [0,4194304] 0 2024-09-06T14:44:29.867 INFO:tasks.workunit.client.1.smithi165.stdout:6/522: mknod d29/d32/d7a/c9e 0 2024-09-06T14:44:29.870 INFO:tasks.workunit.client.1.smithi165.stdout:4/492: mkdir d5/d1b/d1c/d20/d75/d83/dae 0 2024-09-06T14:44:29.871 INFO:tasks.workunit.client.1.smithi165.stdout:0/446: truncate d15/d19/d28/d3a/d3f/f6f 94386 0 2024-09-06T14:44:29.872 INFO:tasks.workunit.client.1.smithi165.stdout:6/523: mkdir d29/d39/d5b/d62/d9f 0 2024-09-06T14:44:29.872 INFO:tasks.workunit.client.1.smithi165.stdout:5/543: dwrite d6/f2a [0,4194304] 0 2024-09-06T14:44:29.874 INFO:tasks.workunit.client.1.smithi165.stdout:4/493: mknod d5/d1b/d1c/d20/d75/caf 0 2024-09-06T14:44:29.874 INFO:tasks.workunit.client.1.smithi165.stdout:0/447: mknod d15/d19/d50/d53/c90 0 2024-09-06T14:44:29.875 INFO:tasks.workunit.client.1.smithi165.stdout:5/544: mknod d6/d1c/d28/d4b/d55/d8a/cc4 0 2024-09-06T14:44:29.876 INFO:tasks.workunit.client.1.smithi165.stdout:4/494: chown d5/d1b/d1c/d20/d75/caf 0 1 2024-09-06T14:44:29.878 INFO:tasks.workunit.client.1.smithi165.stdout:6/524: read d29/d32/f56 [1534579,115870] 0 2024-09-06T14:44:29.880 INFO:tasks.workunit.client.1.smithi165.stdout:6/525: dread - d29/d32/f61 zero size 2024-09-06T14:44:29.880 INFO:tasks.workunit.client.1.smithi165.stdout:0/448: link d15/d19/d28/d51/d60/f74 d15/d19/d50/d53/f91 0 2024-09-06T14:44:29.882 INFO:tasks.workunit.client.1.smithi165.stdout:4/495: dread d5/d1b/d1c/f22 [0,4194304] 0 2024-09-06T14:44:29.883 INFO:tasks.workunit.client.1.smithi165.stdout:0/449: unlink d15/d19/d66/l8c 0 2024-09-06T14:44:29.885 INFO:tasks.workunit.client.1.smithi165.stdout:4/496: mkdir d5/d1b/d1c/db0 0 2024-09-06T14:44:29.886 INFO:tasks.workunit.client.1.smithi165.stdout:4/497: write d5/d1b/d1c/fa4 [1332575,62782] 0 2024-09-06T14:44:29.887 INFO:tasks.workunit.client.1.smithi165.stdout:0/450: write d15/d19/d50/d53/f91 [86621,10281] 0 2024-09-06T14:44:29.888 INFO:tasks.workunit.client.1.smithi165.stdout:4/498: chown d5/d1b/d1c/f4f 36487391 1 2024-09-06T14:44:29.893 INFO:tasks.workunit.client.1.smithi165.stdout:0/451: link d15/d19/d28/d3a/d3f/c4a d15/d19/c92 0 2024-09-06T14:44:29.896 INFO:tasks.workunit.client.1.smithi165.stdout:4/499: dwrite d5/d1b/d1c/f6f [0,4194304] 0 2024-09-06T14:44:29.898 INFO:tasks.workunit.client.1.smithi165.stdout:4/500: truncate d5/d1b/f5b 1890846 0 2024-09-06T14:44:29.898 INFO:tasks.workunit.client.1.smithi165.stdout:6/526: dread d29/d32/f50 [0,4194304] 0 2024-09-06T14:44:29.900 INFO:tasks.workunit.client.1.smithi165.stdout:0/452: rename d15/d19/d28/d3a/d8a to d15/d19/d28/d79/d93 0 2024-09-06T14:44:29.901 INFO:tasks.workunit.client.1.smithi165.stdout:4/501: creat d5/d1b/d1c/d20/d75/d83/fb1 x:0 0 0 2024-09-06T14:44:29.901 INFO:tasks.workunit.client.1.smithi165.stdout:4/502: fsync d5/d1b/d1c/d8c/f8d 0 2024-09-06T14:44:29.904 INFO:tasks.workunit.client.1.smithi165.stdout:0/453: write d15/d19/d28/d4f/d52/f6a [708058,12936] 0 2024-09-06T14:44:29.906 INFO:tasks.workunit.client.1.smithi165.stdout:6/527: creat d29/d39/d5b/d62/d94/fa0 x:0 0 0 2024-09-06T14:44:29.908 INFO:tasks.workunit.client.1.smithi165.stdout:4/503: unlink d5/d1b/d1c/d20/d75/d83/f6a 0 2024-09-06T14:44:29.909 INFO:tasks.workunit.client.1.smithi165.stdout:0/454: creat d15/d19/d28/d3a/f94 x:0 0 0 2024-09-06T14:44:29.909 INFO:tasks.workunit.client.1.smithi165.stdout:0/455: dread - d15/d19/d2c/f36 zero size 2024-09-06T14:44:29.910 INFO:tasks.workunit.client.1.smithi165.stdout:4/504: truncate d5/d1b/f31 128855 0 2024-09-06T14:44:29.964 INFO:tasks.workunit.client.1.smithi165.stdout:3/484: sync 2024-09-06T14:44:29.982 INFO:tasks.workunit.client.1.smithi165.stdout:0/456: creat d15/d19/d66/f95 x:0 0 0 2024-09-06T14:44:29.984 INFO:tasks.workunit.client.1.smithi165.stdout:4/505: rmdir d5/d1b/d61/d77/d7c/daa 39 2024-09-06T14:44:29.985 INFO:tasks.workunit.client.1.smithi165.stdout:3/485: creat d1/d19/d4d/fa5 x:0 0 0 2024-09-06T14:44:29.985 INFO:tasks.workunit.client.1.smithi165.stdout:0/457: write d15/d19/d38/f4c [4223472,61721] 0 2024-09-06T14:44:29.986 INFO:tasks.workunit.client.1.smithi165.stdout:3/486: chown d1/da/dc/d3b/d71 453947102 1 2024-09-06T14:44:29.986 INFO:tasks.workunit.client.1.smithi165.stdout:6/528: dwrite d29/d39/d5b/d62/f80 [0,4194304] 0 2024-09-06T14:44:29.987 INFO:tasks.workunit.client.1.smithi165.stdout:0/458: chown d15/d55/f82 0 1 2024-09-06T14:44:29.989 INFO:tasks.workunit.client.1.smithi165.stdout:6/529: unlink d29/d39/l4e 0 2024-09-06T14:44:29.991 INFO:tasks.workunit.client.1.smithi165.stdout:3/487: creat d1/da/d43/fa6 x:0 0 0 2024-09-06T14:44:29.992 INFO:tasks.workunit.client.1.smithi165.stdout:3/488: chown d1/da/dc/l24 48 1 2024-09-06T14:44:29.992 INFO:tasks.workunit.client.1.smithi165.stdout:0/459: rmdir d15/d19/d50 39 2024-09-06T14:44:29.994 INFO:tasks.workunit.client.1.smithi165.stdout:6/530: symlink d29/d32/la1 0 2024-09-06T14:44:29.997 INFO:tasks.workunit.client.1.smithi165.stdout:4/506: read d5/d1b/d1c/f39 [3512935,116077] 0 2024-09-06T14:44:29.998 INFO:tasks.workunit.client.1.smithi165.stdout:0/460: creat d15/d19/d28/d3a/f96 x:0 0 0 2024-09-06T14:44:29.998 INFO:tasks.workunit.client.1.smithi165.stdout:0/461: chown d15/d19/d38 15 1 2024-09-06T14:44:29.999 INFO:tasks.workunit.client.1.smithi165.stdout:3/489: creat d1/d41/da1/fa7 x:0 0 0 2024-09-06T14:44:29.999 INFO:tasks.workunit.client.1.smithi165.stdout:6/531: fsync d29/f47 0 2024-09-06T14:44:30.000 INFO:tasks.workunit.client.1.smithi165.stdout:6/532: chown d29/l31 20619814 1 2024-09-06T14:44:30.001 INFO:tasks.workunit.client.1.smithi165.stdout:6/533: read - d29/d6a/f7d zero size 2024-09-06T14:44:30.003 INFO:tasks.workunit.client.1.smithi165.stdout:4/507: symlink d5/d1b/d1c/d20/d75/lb2 0 2024-09-06T14:44:30.008 INFO:tasks.workunit.client.1.smithi165.stdout:0/462: dwrite d15/d19/d50/d53/d57/f7d [0,4194304] 0 2024-09-06T14:44:30.013 INFO:tasks.workunit.client.1.smithi165.stdout:3/490: getdents d1/da 0 2024-09-06T14:44:30.017 INFO:tasks.workunit.client.1.smithi165.stdout:6/534: dread d29/d39/d5b/d68/f7c [0,4194304] 0 2024-09-06T14:44:30.018 INFO:tasks.workunit.client.1.smithi165.stdout:6/535: fdatasync d29/d32/f61 0 2024-09-06T14:44:30.018 INFO:tasks.workunit.client.1.smithi165.stdout:3/491: write d1/f11 [7137509,65227] 0 2024-09-06T14:44:30.019 INFO:tasks.workunit.client.1.smithi165.stdout:0/463: dwrite d15/f2f [0,4194304] 0 2024-09-06T14:44:30.020 INFO:tasks.workunit.client.1.smithi165.stdout:6/536: truncate d29/d6a/d83/f8c 137661 0 2024-09-06T14:44:30.022 INFO:tasks.workunit.client.1.smithi165.stdout:0/464: symlink d15/d19/d28/d79/l97 0 2024-09-06T14:44:30.023 INFO:tasks.workunit.client.1.smithi165.stdout:4/508: write d5/d1b/f31 [589936,82510] 0 2024-09-06T14:44:30.026 INFO:tasks.workunit.client.1.smithi165.stdout:4/509: write d5/d1b/d66/f85 [3381619,56194] 0 2024-09-06T14:44:30.030 INFO:tasks.workunit.client.1.smithi165.stdout:4/510: fsync d5/d1b/d1c/d20/d75/d83/f64 0 2024-09-06T14:44:30.031 INFO:tasks.workunit.client.1.smithi165.stdout:3/492: dwrite d1/d19/f91 [0,4194304] 0 2024-09-06T14:44:30.032 INFO:tasks.workunit.client.1.smithi165.stdout:3/493: fsync d1/d7c/d7e/fa4 0 2024-09-06T14:44:30.035 INFO:tasks.workunit.client.1.smithi165.stdout:0/465: truncate d15/d19/d28/d4f/d52/f6a 381063 0 2024-09-06T14:44:30.035 INFO:tasks.workunit.client.1.smithi165.stdout:0/466: fsync f3 0 2024-09-06T14:44:30.036 INFO:tasks.workunit.client.1.smithi165.stdout:4/511: truncate d5/f50 1289311 0 2024-09-06T14:44:30.039 INFO:tasks.workunit.client.1.smithi165.stdout:4/512: mknod d5/d1b/d1c/d20/d75/d83/cb3 0 2024-09-06T14:44:30.041 INFO:tasks.workunit.client.1.smithi165.stdout:6/537: dread f22 [0,4194304] 0 2024-09-06T14:44:30.042 INFO:tasks.workunit.client.1.smithi165.stdout:6/538: chown d29/d39/d5b/c81 7402092 1 2024-09-06T14:44:30.042 INFO:tasks.workunit.client.1.smithi165.stdout:3/494: dread d1/da/dc/d3b/d83/f8f [0,4194304] 0 2024-09-06T14:44:30.044 INFO:tasks.workunit.client.1.smithi165.stdout:3/495: write d1/d19/f28 [304984,53644] 0 2024-09-06T14:44:30.045 INFO:tasks.workunit.client.1.smithi165.stdout:4/513: link d5/d1b/d1c/d20/d26/f95 d5/d1b/d1c/d41/fb4 0 2024-09-06T14:44:30.046 INFO:tasks.workunit.client.1.smithi165.stdout:0/467: write d15/d19/d28/d4f/d52/f6a [281028,123715] 0 2024-09-06T14:44:30.046 INFO:tasks.workunit.client.1.smithi165.stdout:6/539: rename d29/d32/d7a/c9e to d29/d39/ca2 0 2024-09-06T14:44:30.063 INFO:tasks.workunit.client.1.smithi165.stdout:3/496: stat d1/l4f 0 2024-09-06T14:44:30.065 INFO:tasks.workunit.client.1.smithi165.stdout:4/514: unlink d5/d1b/d1c/d55/d7d/fab 0 2024-09-06T14:44:30.070 INFO:tasks.workunit.client.1.smithi165.stdout:4/515: dwrite d5/f5a [0,4194304] 0 2024-09-06T14:44:30.076 INFO:tasks.workunit.client.1.smithi165.stdout:4/516: dwrite d5/d1b/d1c/d55/f68 [0,4194304] 0 2024-09-06T14:44:30.082 INFO:tasks.workunit.client.1.smithi165.stdout:0/468: symlink d15/d19/d28/d3a/d3f/l98 0 2024-09-06T14:44:30.089 INFO:tasks.workunit.client.1.smithi165.stdout:0/469: symlink d15/d19/d38/l99 0 2024-09-06T14:44:30.090 INFO:tasks.workunit.client.1.smithi165.stdout:6/540: creat d29/d39/d5b/d62/fa3 x:0 0 0 2024-09-06T14:44:30.092 INFO:tasks.workunit.client.1.smithi165.stdout:0/470: rename d15/d19/d28/d79 to d15/d19/d50/d53/d7c/d9a 0 2024-09-06T14:44:30.094 INFO:tasks.workunit.client.1.smithi165.stdout:0/471: write d15/f37 [7517481,81971] 0 2024-09-06T14:44:30.095 INFO:tasks.workunit.client.1.smithi165.stdout:6/541: symlink d29/d6a/la4 0 2024-09-06T14:44:30.096 INFO:tasks.workunit.client.1.smithi165.stdout:6/542: chown f1d 9876 1 2024-09-06T14:44:30.098 INFO:tasks.workunit.client.1.smithi165.stdout:6/543: symlink d29/d6a/d83/la5 0 2024-09-06T14:44:30.099 INFO:tasks.workunit.client.1.smithi165.stdout:0/472: fdatasync d15/d19/d28/d3a/d3f/f6f 0 2024-09-06T14:44:30.101 INFO:tasks.workunit.client.1.smithi165.stdout:3/497: dwrite d1/f2 [0,4194304] 0 2024-09-06T14:44:30.102 INFO:tasks.workunit.client.1.smithi165.stdout:6/544: creat d29/fa6 x:0 0 0 2024-09-06T14:44:30.103 INFO:tasks.workunit.client.1.smithi165.stdout:6/545: stat d29/l37 0 2024-09-06T14:44:30.103 INFO:tasks.workunit.client.1.smithi165.stdout:4/517: dread d5/d1b/d1c/d20/d75/d83/f4c [0,4194304] 0 2024-09-06T14:44:30.103 INFO:tasks.workunit.client.1.smithi165.stdout:0/473: rename d15/d19/d38/f47 to d15/d19/d28/d4f/f9b 0 2024-09-06T14:44:30.104 INFO:tasks.workunit.client.1.smithi165.stdout:4/518: write d5/d1b/d1c/d8c/f8d [811204,107196] 0 2024-09-06T14:44:30.105 INFO:tasks.workunit.client.1.smithi165.stdout:4/519: write d5/f86 [885893,50133] 0 2024-09-06T14:44:30.105 INFO:tasks.workunit.client.1.smithi165.stdout:4/520: stat d5/f2c 0 2024-09-06T14:44:30.106 INFO:tasks.workunit.client.1.smithi165.stdout:3/498: unlink d1/d41/da1/fa7 0 2024-09-06T14:44:30.109 INFO:tasks.workunit.client.1.smithi165.stdout:6/546: symlink d29/d39/d5b/d62/d67/la7 0 2024-09-06T14:44:30.111 INFO:tasks.workunit.client.1.smithi165.stdout:2/452: sync 2024-09-06T14:44:30.111 INFO:tasks.workunit.client.1.smithi165.stdout:9/637: sync 2024-09-06T14:44:30.111 INFO:tasks.workunit.client.1.smithi165.stdout:0/474: symlink d15/d19/d28/d3a/l9c 0 2024-09-06T14:44:30.113 INFO:tasks.workunit.client.1.smithi165.stdout:2/453: read d9/d25/d45/d75/d67/d76/f6a [3929719,11669] 0 2024-09-06T14:44:30.114 INFO:tasks.workunit.client.1.smithi165.stdout:6/547: rename d29/l31 to d29/d39/d5b/d68/la8 0 2024-09-06T14:44:30.115 INFO:tasks.workunit.client.1.smithi165.stdout:4/521: mknod d5/d1b/d61/d77/d7c/cb5 0 2024-09-06T14:44:30.116 INFO:tasks.workunit.client.1.smithi165.stdout:9/638: truncate db/de/d15/d7f/d9b/d6c/f75 30414 0 2024-09-06T14:44:30.119 INFO:tasks.workunit.client.1.smithi165.stdout:3/499: getdents d1/da/dd/d4b 0 2024-09-06T14:44:30.120 INFO:tasks.workunit.client.1.smithi165.stdout:3/500: rename d1/da/dc/d3b/d71 to d1/da/dc/d3b/d71/da8 22 2024-09-06T14:44:30.121 INFO:tasks.workunit.client.1.smithi165.stdout:4/522: mkdir d5/d1b/d1c/d78/da9/db6 0 2024-09-06T14:44:30.121 INFO:tasks.workunit.client.1.smithi165.stdout:3/501: chown d1/d7c/f9e 0 1 2024-09-06T14:44:30.121 INFO:tasks.workunit.client.1.smithi165.stdout:4/523: fsync d5/d1b/d1c/d55/f56 0 2024-09-06T14:44:30.126 INFO:tasks.workunit.client.1.smithi165.stdout:4/524: symlink d5/d1b/d61/d77/d7c/daa/lb7 0 2024-09-06T14:44:30.127 INFO:tasks.workunit.client.1.smithi165.stdout:2/454: write d9/f1e [1654612,124555] 0 2024-09-06T14:44:30.128 INFO:tasks.workunit.client.1.smithi165.stdout:0/475: dread d15/d19/d28/d3a/f41 [0,4194304] 0 2024-09-06T14:44:30.129 INFO:tasks.workunit.client.1.smithi165.stdout:3/502: link d1/da/dc/d3b/d83/c8a d1/da/dc/d3b/d71/ca9 0 2024-09-06T14:44:30.129 INFO:tasks.workunit.client.1.smithi165.stdout:6/548: write d29/f5c [613980,2577] 0 2024-09-06T14:44:30.131 INFO:tasks.workunit.client.1.smithi165.stdout:0/476: chown d15/d19/d2c/l39 359610 1 2024-09-06T14:44:30.131 INFO:tasks.workunit.client.1.smithi165.stdout:3/503: fdatasync d1/da/dd/d4b/f6e 0 2024-09-06T14:44:30.133 INFO:tasks.workunit.client.1.smithi165.stdout:3/504: write d1/d19/f29 [448157,103371] 0 2024-09-06T14:44:30.134 INFO:tasks.workunit.client.1.smithi165.stdout:2/455: link d9/d25/f57 d9/d25/d45/d75/d67/f92 0 2024-09-06T14:44:30.134 INFO:tasks.workunit.client.1.smithi165.stdout:2/456: chown d9/d88 262581 1 2024-09-06T14:44:30.136 INFO:tasks.workunit.client.1.smithi165.stdout:0/477: symlink d15/d19/d50/d53/d7c/d9a/l9d 0 2024-09-06T14:44:30.137 INFO:tasks.workunit.client.1.smithi165.stdout:2/457: symlink d9/d3b/d78/l93 0 2024-09-06T14:44:30.138 INFO:tasks.workunit.client.1.smithi165.stdout:6/549: getdents d29/d32 0 2024-09-06T14:44:30.139 INFO:tasks.workunit.client.1.smithi165.stdout:2/458: chown d9/d25/d45/d75/d67/d76/l36 448891252 1 2024-09-06T14:44:30.139 INFO:tasks.workunit.client.1.smithi165.stdout:3/505: dread d1/da/dc/f5c [0,4194304] 0 2024-09-06T14:44:30.141 INFO:tasks.workunit.client.1.smithi165.stdout:6/550: mknod d29/d39/d86/ca9 0 2024-09-06T14:44:30.143 INFO:tasks.workunit.client.1.smithi165.stdout:3/506: creat d1/da/dc/d10/faa x:0 0 0 2024-09-06T14:44:30.144 INFO:tasks.workunit.client.1.smithi165.stdout:0/478: dwrite d15/d19/d28/d3a/f86 [0,4194304] 0 2024-09-06T14:44:30.144 INFO:tasks.workunit.client.1.smithi165.stdout:6/551: readlink d29/l69 0 2024-09-06T14:44:30.146 INFO:tasks.workunit.client.1.smithi165.stdout:6/552: read - d29/d6a/f75 zero size 2024-09-06T14:44:30.153 INFO:tasks.workunit.client.1.smithi165.stdout:0/479: dread d15/d19/d28/d4f/f9b [0,4194304] 0 2024-09-06T14:44:30.158 INFO:tasks.workunit.client.1.smithi165.stdout:3/507: dwrite d1/da/f8e [0,4194304] 0 2024-09-06T14:44:30.159 INFO:tasks.workunit.client.1.smithi165.stdout:6/553: dwrite d29/d32/f61 [0,4194304] 0 2024-09-06T14:44:30.159 INFO:tasks.workunit.client.1.smithi165.stdout:2/459: dread d9/d25/d45/f51 [0,4194304] 0 2024-09-06T14:44:30.159 INFO:tasks.workunit.client.1.smithi165.stdout:6/554: write d29/f49 [3820653,121018] 0 2024-09-06T14:44:30.161 INFO:tasks.workunit.client.1.smithi165.stdout:2/460: fsync d9/d23/d29/f2b 0 2024-09-06T14:44:30.163 INFO:tasks.workunit.client.1.smithi165.stdout:6/555: mknod d29/d39/d5b/d62/d9f/caa 0 2024-09-06T14:44:30.164 INFO:tasks.workunit.client.1.smithi165.stdout:3/508: dwrite d1/d4a/f7d [0,4194304] 0 2024-09-06T14:44:30.174 INFO:tasks.workunit.client.1.smithi165.stdout:6/556: dwrite f1d [0,4194304] 0 2024-09-06T14:44:30.174 INFO:tasks.workunit.client.1.smithi165.stdout:3/509: dwrite d1/da/dc/f30 [4194304,4194304] 0 2024-09-06T14:44:30.177 INFO:tasks.workunit.client.1.smithi165.stdout:3/510: mknod d1/da/dc/d5d/cab 0 2024-09-06T14:44:30.181 INFO:tasks.workunit.client.1.smithi165.stdout:3/511: creat d1/da/dc/d5d/d89/fac x:0 0 0 2024-09-06T14:44:30.183 INFO:tasks.workunit.client.1.smithi165.stdout:6/557: dread d29/f41 [0,4194304] 0 2024-09-06T14:44:30.188 INFO:tasks.workunit.client.1.smithi165.stdout:3/512: link d1/d7c/d7e/fa4 d1/d7c/fad 0 2024-09-06T14:44:30.188 INFO:tasks.workunit.client.1.smithi165.stdout:6/558: mknod d29/d39/d5b/d62/cab 0 2024-09-06T14:44:30.189 INFO:tasks.workunit.client.1.smithi165.stdout:6/559: truncate d29/d39/d5b/d68/f73 1576550 0 2024-09-06T14:44:30.190 INFO:tasks.workunit.client.1.smithi165.stdout:6/560: chown d29/d6a/d71/c90 139350 1 2024-09-06T14:44:30.196 INFO:tasks.workunit.client.1.smithi165.stdout:6/561: write f16 [1125263,89533] 0 2024-09-06T14:44:30.198 INFO:tasks.workunit.client.1.smithi165.stdout:6/562: link d29/c74 d29/cac 0 2024-09-06T14:44:30.228 INFO:tasks.workunit.client.1.smithi165.stdout:7/419: sync 2024-09-06T14:44:30.228 INFO:tasks.workunit.client.1.smithi165.stdout:1/487: sync 2024-09-06T14:44:30.228 INFO:tasks.workunit.client.1.smithi165.stdout:8/501: sync 2024-09-06T14:44:30.228 INFO:tasks.workunit.client.1.smithi165.stdout:5/545: sync 2024-09-06T14:44:30.229 INFO:tasks.workunit.client.1.smithi165.stdout:1/488: chown d0/d2a/d18/d24/d4b/d93/d68/d75/f99 532 1 2024-09-06T14:44:30.230 INFO:tasks.workunit.client.1.smithi165.stdout:7/420: creat d20/d3b/f86 x:0 0 0 2024-09-06T14:44:30.231 INFO:tasks.workunit.client.1.smithi165.stdout:8/502: mkdir d0/d19/d36/d2d/d33/d3a/d46/db3 0 2024-09-06T14:44:30.231 INFO:tasks.workunit.client.1.smithi165.stdout:7/421: read d20/d33/f52 [2719433,4735] 0 2024-09-06T14:44:30.232 INFO:tasks.workunit.client.1.smithi165.stdout:7/422: write d20/d33/d53/f7f [839693,54348] 0 2024-09-06T14:44:30.233 INFO:tasks.workunit.client.1.smithi165.stdout:8/503: mkdir d0/d14/d3e/db4 0 2024-09-06T14:44:30.235 INFO:tasks.workunit.client.1.smithi165.stdout:7/423: creat d20/d40/f87 x:0 0 0 2024-09-06T14:44:30.236 INFO:tasks.workunit.client.1.smithi165.stdout:7/424: chown d20/d3b/f72 23 1 2024-09-06T14:44:30.240 INFO:tasks.workunit.client.1.smithi165.stdout:7/425: rename d20/d65/d28 to d20/d3b/d69/d88 0 2024-09-06T14:44:30.241 INFO:tasks.workunit.client.1.smithi165.stdout:8/504: rmdir d0/d34/d6b/d94/d68/d69 0 2024-09-06T14:44:30.241 INFO:tasks.workunit.client.1.smithi165.stdout:5/546: dread d6/d1c/f1e [0,4194304] 0 2024-09-06T14:44:30.242 INFO:tasks.workunit.client.1.smithi165.stdout:1/489: dwrite d0/d2a/f16 [4194304,4194304] 0 2024-09-06T14:44:30.243 INFO:tasks.workunit.client.1.smithi165.stdout:8/505: chown d0/d19/d36/d2d/d3f/c40 3 1 2024-09-06T14:44:30.243 INFO:tasks.workunit.client.1.smithi165.stdout:5/547: fsync d6/d1c/d28/d2d/d61/f79 0 2024-09-06T14:44:30.243 INFO:tasks.workunit.client.1.smithi165.stdout:7/426: symlink d20/d40/l89 0 2024-09-06T14:44:30.246 INFO:tasks.workunit.client.1.smithi165.stdout:5/548: dread - d6/d1c/d28/d2d/d3c/d44/f83 zero size 2024-09-06T14:44:30.249 INFO:tasks.workunit.client.1.smithi165.stdout:7/427: rmdir d20/d76 0 2024-09-06T14:44:30.250 INFO:tasks.workunit.client.1.smithi165.stdout:5/549: mknod d6/d32/cc5 0 2024-09-06T14:44:30.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/428: dread - d20/d3b/d69/f85 zero size 2024-09-06T14:44:30.251 INFO:tasks.workunit.client.1.smithi165.stdout:1/490: getdents d0/d2a/d18/d24/d4b/d93/d68/d75 0 2024-09-06T14:44:30.252 INFO:tasks.workunit.client.1.smithi165.stdout:8/506: dwrite d0/d19/d36/d2d/d33/d3a/d46/f7e [0,4194304] 0 2024-09-06T14:44:30.253 INFO:tasks.workunit.client.1.smithi165.stdout:7/429: fdatasync d20/d65/f6c 0 2024-09-06T14:44:30.253 INFO:tasks.workunit.client.1.smithi165.stdout:1/491: rename d0/d1c/d1d to d0/d1c/d1d/d9c 22 2024-09-06T14:44:30.255 INFO:tasks.workunit.client.1.smithi165.stdout:5/550: chown d6/d1c/d28/d2d/f53 137 1 2024-09-06T14:44:30.256 INFO:tasks.workunit.client.1.smithi165.stdout:5/551: stat d6/d1c/d28/d2d/d3c/l40 0 2024-09-06T14:44:30.257 INFO:tasks.workunit.client.1.smithi165.stdout:1/492: dread d0/d2a/d23/f66 [0,4194304] 0 2024-09-06T14:44:30.260 INFO:tasks.workunit.client.1.smithi165.stdout:1/493: write d0/d2a/d18/d24/d4b/d93/d68/f86 [2393112,58671] 0 2024-09-06T14:44:30.260 INFO:tasks.workunit.client.1.smithi165.stdout:7/430: creat d20/d33/f8a x:0 0 0 2024-09-06T14:44:30.261 INFO:tasks.workunit.client.1.smithi165.stdout:1/494: truncate d0/d1c/d41/f5e 5052686 0 2024-09-06T14:44:30.262 INFO:tasks.workunit.client.1.smithi165.stdout:8/507: write d0/d19/d36/d2d/d3f/d93/fa6 [323320,56103] 0 2024-09-06T14:44:30.262 INFO:tasks.workunit.client.1.smithi165.stdout:5/552: symlink d6/d1c/d28/d2d/dc0/lc6 0 2024-09-06T14:44:30.262 INFO:tasks.workunit.client.1.smithi165.stdout:7/431: dread - d20/d3b/d69/d88/d30/f83 zero size 2024-09-06T14:44:30.263 INFO:tasks.workunit.client.1.smithi165.stdout:8/508: stat d0/d34/d6b/d94 0 2024-09-06T14:44:30.263 INFO:tasks.workunit.client.1.smithi165.stdout:7/432: dread - d20/d33/f8a zero size 2024-09-06T14:44:30.265 INFO:tasks.workunit.client.1.smithi165.stdout:8/509: unlink d0/d34/l61 0 2024-09-06T14:44:30.265 INFO:tasks.workunit.client.1.smithi165.stdout:8/510: chown d0/d19/d24 45274 1 2024-09-06T14:44:30.266 INFO:tasks.workunit.client.1.smithi165.stdout:1/495: write d0/d2a/d18/d24/d4b/d93/d68/d75/f99 [306974,60548] 0 2024-09-06T14:44:30.267 INFO:tasks.workunit.client.1.smithi165.stdout:7/433: creat d20/d3b/f8b x:0 0 0 2024-09-06T14:44:30.268 INFO:tasks.workunit.client.1.smithi165.stdout:7/434: dread - d20/d3b/f86 zero size 2024-09-06T14:44:30.268 INFO:tasks.workunit.client.1.smithi165.stdout:5/553: mkdir d6/d1c/d28/d4b/d55/d8a/da5/dc7 0 2024-09-06T14:44:30.270 INFO:tasks.workunit.client.1.smithi165.stdout:8/511: mknod d0/d19/d24/db1/d8c/cb5 0 2024-09-06T14:44:30.272 INFO:tasks.workunit.client.1.smithi165.stdout:1/496: creat d0/d2a/f9d x:0 0 0 2024-09-06T14:44:30.273 INFO:tasks.workunit.client.1.smithi165.stdout:5/554: creat d6/d1c/d28/d2d/fc8 x:0 0 0 2024-09-06T14:44:30.274 INFO:tasks.workunit.client.1.smithi165.stdout:8/512: creat d0/d19/d36/d2d/d33/d3a/d46/db3/fb6 x:0 0 0 2024-09-06T14:44:30.275 INFO:tasks.workunit.client.1.smithi165.stdout:7/435: dwrite d20/d3b/f72 [0,4194304] 0 2024-09-06T14:44:30.276 INFO:tasks.workunit.client.1.smithi165.stdout:8/513: write d0/f17 [1059771,98905] 0 2024-09-06T14:44:30.277 INFO:tasks.workunit.client.1.smithi165.stdout:8/514: chown d0/f9 103388 1 2024-09-06T14:44:30.277 INFO:tasks.workunit.client.1.smithi165.stdout:7/436: write d20/d65/f61 [546369,102329] 0 2024-09-06T14:44:30.279 INFO:tasks.workunit.client.1.smithi165.stdout:5/555: creat d6/d1c/d28/d2d/d61/fc9 x:0 0 0 2024-09-06T14:44:30.281 INFO:tasks.workunit.client.1.smithi165.stdout:7/437: mkdir d20/d3b/d8c 0 2024-09-06T14:44:30.282 INFO:tasks.workunit.client.1.smithi165.stdout:5/556: stat d6/d1c/d28/d2d/d3c/d44/d90/fb3 0 2024-09-06T14:44:30.284 INFO:tasks.workunit.client.1.smithi165.stdout:8/515: unlink d0/d19/d36/d2d/d3f/f4e 0 2024-09-06T14:44:30.284 INFO:tasks.workunit.client.1.smithi165.stdout:5/557: fsync d6/d1c/d28/f46 0 2024-09-06T14:44:30.289 INFO:tasks.workunit.client.1.smithi165.stdout:1/497: dread d0/d2a/f16 [0,4194304] 0 2024-09-06T14:44:30.289 INFO:tasks.workunit.client.1.smithi165.stdout:5/558: creat d6/d1c/d28/d4b/d55/fca x:0 0 0 2024-09-06T14:44:30.291 INFO:tasks.workunit.client.1.smithi165.stdout:7/438: dwrite d20/d3b/f72 [0,4194304] 0 2024-09-06T14:44:30.292 INFO:tasks.workunit.client.1.smithi165.stdout:1/498: write d0/d1c/d40/f7a [166105,19257] 0 2024-09-06T14:44:30.293 INFO:tasks.workunit.client.1.smithi165.stdout:7/439: fdatasync d20/d3b/f86 0 2024-09-06T14:44:30.297 INFO:tasks.workunit.client.1.smithi165.stdout:5/559: dread d6/f1a [0,4194304] 0 2024-09-06T14:44:30.297 INFO:tasks.workunit.client.1.smithi165.stdout:7/440: dread - d20/d3b/d69/d88/d30/d78/f84 zero size 2024-09-06T14:44:30.298 INFO:tasks.workunit.client.1.smithi165.stdout:1/499: symlink d0/d2a/d18/d24/d4b/d5f/l9e 0 2024-09-06T14:44:30.300 INFO:tasks.workunit.client.1.smithi165.stdout:8/516: dwrite d0/d19/d36/d2d/d33/d3a/d46/d49/f4a [0,4194304] 0 2024-09-06T14:44:30.308 INFO:tasks.workunit.client.1.smithi165.stdout:5/560: mknod d6/d1c/d28/d2d/d3c/d44/d90/ccb 0 2024-09-06T14:44:30.308 INFO:tasks.workunit.client.1.smithi165.stdout:1/500: creat d0/d1c/d41/f9f x:0 0 0 2024-09-06T14:44:30.309 INFO:tasks.workunit.client.1.smithi165.stdout:8/517: mkdir d0/d34/d6b/d94/d70/db7 0 2024-09-06T14:44:30.310 INFO:tasks.workunit.client.1.smithi165.stdout:1/501: mkdir d0/d2a/d18/da0 0 2024-09-06T14:44:30.311 INFO:tasks.workunit.client.1.smithi165.stdout:8/518: mkdir d0/d34/d6b/d94/d70/db8 0 2024-09-06T14:44:30.313 INFO:tasks.workunit.client.1.smithi165.stdout:5/561: rename d6/d1c/d28/d2d/d3c/d81/l5b to d6/d1c/d28/d4b/da7/dab/lcc 0 2024-09-06T14:44:30.315 INFO:tasks.workunit.client.1.smithi165.stdout:5/562: fsync d6/d1c/d28/f43 0 2024-09-06T14:44:30.318 INFO:tasks.workunit.client.1.smithi165.stdout:8/519: dwrite d0/d19/f1f [0,4194304] 0 2024-09-06T14:44:30.322 INFO:tasks.workunit.client.1.smithi165.stdout:8/520: rename d0/d14/l96 to d0/d34/lb9 0 2024-09-06T14:44:30.324 INFO:tasks.workunit.client.1.smithi165.stdout:5/563: dwrite d6/d1c/d28/d2d/d3c/f9e [0,4194304] 0 2024-09-06T14:44:30.326 INFO:tasks.workunit.client.1.smithi165.stdout:8/521: mkdir d0/d5e/dba 0 2024-09-06T14:44:30.326 INFO:tasks.workunit.client.1.smithi165.stdout:5/564: chown d6/d1c/d28/d4b/d55/d8a/cc4 15229532 1 2024-09-06T14:44:30.330 INFO:tasks.workunit.client.1.smithi165.stdout:8/522: rename d0/d5e/d65/fb2 to d0/d19/d24/fbb 0 2024-09-06T14:44:30.331 INFO:tasks.workunit.client.1.smithi165.stdout:8/523: readlink d0/d19/l20 0 2024-09-06T14:44:30.331 INFO:tasks.workunit.client.1.smithi165.stdout:5/565: mknod d6/d1c/d28/d4b/d60/ccd 0 2024-09-06T14:44:30.332 INFO:tasks.workunit.client.1.smithi165.stdout:8/524: chown d0/d19/c74 179 1 2024-09-06T14:44:30.332 INFO:tasks.workunit.client.1.smithi165.stdout:1/502: dread d0/d2a/f8e [0,4194304] 0 2024-09-06T14:44:30.334 INFO:tasks.workunit.client.1.smithi165.stdout:1/503: readlink d0/d2a/l15 0 2024-09-06T14:44:30.334 INFO:tasks.workunit.client.1.smithi165.stdout:8/525: stat d0/d19/d36/d2d/d3f/d93 0 2024-09-06T14:44:30.335 INFO:tasks.workunit.client.1.smithi165.stdout:5/566: rename d6/d1c/d28/d4b/l4c to d6/d1c/d28/d4b/da7/lce 0 2024-09-06T14:44:30.337 INFO:tasks.workunit.client.1.smithi165.stdout:5/567: creat d6/dc1/fcf x:0 0 0 2024-09-06T14:44:30.338 INFO:tasks.workunit.client.1.smithi165.stdout:1/504: link d0/d2a/d18/d24/d4b/d5f/f63 d0/d1c/d1d/fa1 0 2024-09-06T14:44:30.339 INFO:tasks.workunit.client.1.smithi165.stdout:1/505: dread - d0/d2a/d18/d24/d4b/d95/f96 zero size 2024-09-06T14:44:30.339 INFO:tasks.workunit.client.1.smithi165.stdout:8/526: link d0/d19/d36/d2d/d3f/d93/fa5 d0/d14/fbc 0 2024-09-06T14:44:30.339 INFO:tasks.workunit.client.1.smithi165.stdout:5/568: write d6/f1a [1343304,90082] 0 2024-09-06T14:44:30.341 INFO:tasks.workunit.client.1.smithi165.stdout:1/506: mknod d0/d1c/d1d/d57/ca2 0 2024-09-06T14:44:30.342 INFO:tasks.workunit.client.1.smithi165.stdout:1/507: fdatasync d0/d2a/d18/d24/d4b/d93/f1f 0 2024-09-06T14:44:30.342 INFO:tasks.workunit.client.1.smithi165.stdout:8/527: rename d0/d34/l89 to d0/d9e/lbd 0 2024-09-06T14:44:30.343 INFO:tasks.workunit.client.1.smithi165.stdout:5/569: creat d6/d1c/d28/d2d/d3c/fd0 x:0 0 0 2024-09-06T14:44:30.343 INFO:tasks.workunit.client.1.smithi165.stdout:5/570: fsync d6/f2a 0 2024-09-06T14:44:30.344 INFO:tasks.workunit.client.1.smithi165.stdout:8/528: write d0/d19/d36/d2d/d33/d3a/d46/d49/f4a [2697019,100340] 0 2024-09-06T14:44:30.346 INFO:tasks.workunit.client.1.smithi165.stdout:5/571: symlink d6/d98/ld1 0 2024-09-06T14:44:30.346 INFO:tasks.workunit.client.1.smithi165.stdout:1/508: getdents d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98 0 2024-09-06T14:44:30.349 INFO:tasks.workunit.client.1.smithi165.stdout:1/509: write d0/d2a/d18/d24/d4b/d93/f3a [282427,16387] 0 2024-09-06T14:44:30.351 INFO:tasks.workunit.client.1.smithi165.stdout:8/529: dwrite d0/d19/d36/f12 [0,4194304] 0 2024-09-06T14:44:30.352 INFO:tasks.workunit.client.1.smithi165.stdout:5/572: dread d6/f2a [0,4194304] 0 2024-09-06T14:44:30.354 INFO:tasks.workunit.client.1.smithi165.stdout:8/530: write d0/d19/d36/d2d/d33/d3a/fb0 [760085,8497] 0 2024-09-06T14:44:30.355 INFO:tasks.workunit.client.1.smithi165.stdout:9/639: sync 2024-09-06T14:44:30.355 INFO:tasks.workunit.client.1.smithi165.stdout:5/573: creat d6/d1c/d7c/fd2 x:0 0 0 2024-09-06T14:44:30.355 INFO:tasks.workunit.client.1.smithi165.stdout:8/531: dread - d0/d19/d36/d2d/d3f/d93/fa5 zero size 2024-09-06T14:44:30.361 INFO:tasks.workunit.client.1.smithi165.stdout:9/640: fsync db/de/d16/f66 0 2024-09-06T14:44:30.361 INFO:tasks.workunit.client.1.smithi165.stdout:9/641: fdatasync db/de/d15/d17/dad/f95 0 2024-09-06T14:44:30.364 INFO:tasks.workunit.client.1.smithi165.stdout:9/642: creat db/de/d15/d17/d72/fce x:0 0 0 2024-09-06T14:44:30.364 INFO:tasks.workunit.client.1.smithi165.stdout:1/510: write d0/d1c/d1d/fa1 [189874,102372] 0 2024-09-06T14:44:30.365 INFO:tasks.workunit.client.1.smithi165.stdout:9/643: stat db/de/c62 0 2024-09-06T14:44:30.365 INFO:tasks.workunit.client.1.smithi165.stdout:1/511: chown d0/d2a/d23/d7e 2078105217 1 2024-09-06T14:44:30.366 INFO:tasks.workunit.client.1.smithi165.stdout:5/574: rename d6/d1c/d28/d2d/d3c/f9e to d6/d1c/d28/d2d/fd3 0 2024-09-06T14:44:30.367 INFO:tasks.workunit.client.1.smithi165.stdout:8/532: write d0/d14/fbc [697968,96725] 0 2024-09-06T14:44:30.370 INFO:tasks.workunit.client.1.smithi165.stdout:9/644: chown db/de/d15/d17/d18/d7d/c7e 22 1 2024-09-06T14:44:30.371 INFO:tasks.workunit.client.1.smithi165.stdout:9/645: chown db/de/d15/d17/f29 231 1 2024-09-06T14:44:30.373 INFO:tasks.workunit.client.1.smithi165.stdout:5/575: dwrite d6/d1c/f68 [0,4194304] 0 2024-09-06T14:44:30.378 INFO:tasks.workunit.client.1.smithi165.stdout:9/646: mkdir db/dcf 0 2024-09-06T14:44:30.379 INFO:tasks.workunit.client.1.smithi165.stdout:8/533: truncate d0/d19/d36/f7 367796 0 2024-09-06T14:44:30.379 INFO:tasks.workunit.client.1.smithi165.stdout:1/512: write d0/d2a/fd [367560,33157] 0 2024-09-06T14:44:30.382 INFO:tasks.workunit.client.1.smithi165.stdout:8/534: mkdir d0/d34/d6b/dbe 0 2024-09-06T14:44:30.383 INFO:tasks.workunit.client.1.smithi165.stdout:9/647: symlink db/de/d15/d17/d18/d7d/ld0 0 2024-09-06T14:44:30.384 INFO:tasks.workunit.client.1.smithi165.stdout:5/576: dwrite d6/f19 [0,4194304] 0 2024-09-06T14:44:30.387 INFO:tasks.workunit.client.1.smithi165.stdout:8/535: rmdir d0 39 2024-09-06T14:44:30.387 INFO:tasks.workunit.client.1.smithi165.stdout:9/648: creat db/de/d15/d17/d18/d59/d64/fd1 x:0 0 0 2024-09-06T14:44:30.388 INFO:tasks.workunit.client.1.smithi165.stdout:5/577: truncate d6/d1c/f38 3424012 0 2024-09-06T14:44:30.391 INFO:tasks.workunit.client.1.smithi165.stdout:5/578: write d6/d1c/d28/d2d/d3c/f80 [954090,26256] 0 2024-09-06T14:44:30.393 INFO:tasks.workunit.client.1.smithi165.stdout:1/513: dwrite d0/f14 [0,4194304] 0 2024-09-06T14:44:30.398 INFO:tasks.workunit.client.1.smithi165.stdout:5/579: rmdir d6/d1c/d28/d4b/d55/d8a/da5 39 2024-09-06T14:44:30.399 INFO:tasks.workunit.client.1.smithi165.stdout:1/514: creat d0/d2a/d18/d24/d4b/d93/d68/fa3 x:0 0 0 2024-09-06T14:44:30.399 INFO:tasks.workunit.client.1.smithi165.stdout:9/649: link db/de/d16/d2e/l6f db/de/d15/d91/ld2 0 2024-09-06T14:44:30.400 INFO:tasks.workunit.client.1.smithi165.stdout:5/580: symlink d6/d1c/d28/d2d/d3c/ld4 0 2024-09-06T14:44:30.405 INFO:tasks.workunit.client.1.smithi165.stdout:9/650: dwrite db/f26 [0,4194304] 0 2024-09-06T14:44:30.405 INFO:tasks.workunit.client.1.smithi165.stdout:1/515: link d0/d2a/d18/d24/d4b/d93/f1f d0/fa4 0 2024-09-06T14:44:30.407 INFO:tasks.workunit.client.1.smithi165.stdout:5/581: creat d6/d1c/d28/d2d/d3c/d44/fd5 x:0 0 0 2024-09-06T14:44:30.407 INFO:tasks.workunit.client.1.smithi165.stdout:1/516: readlink d0/d2a/d18/l81 0 2024-09-06T14:44:30.408 INFO:tasks.workunit.client.1.smithi165.stdout:1/517: write d0/d1c/d41/f8c [2103974,40228] 0 2024-09-06T14:44:30.409 INFO:tasks.workunit.client.1.smithi165.stdout:9/651: fdatasync db/de/d16/d2e/f3d 0 2024-09-06T14:44:30.410 INFO:tasks.workunit.client.1.smithi165.stdout:9/652: chown db/de/d15/d17/dad/fbb 51 1 2024-09-06T14:44:30.410 INFO:tasks.workunit.client.1.smithi165.stdout:1/518: dread - d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f6b zero size 2024-09-06T14:44:30.414 INFO:tasks.workunit.client.1.smithi165.stdout:8/536: truncate d0/d19/f3b 475714 0 2024-09-06T14:44:30.417 INFO:tasks.workunit.client.1.smithi165.stdout:1/519: symlink d0/d1c/d1d/d22/la5 0 2024-09-06T14:44:30.419 INFO:tasks.workunit.client.1.smithi165.stdout:9/653: creat db/de/d15/d17/d72/da3/fd3 x:0 0 0 2024-09-06T14:44:30.420 INFO:tasks.workunit.client.1.smithi165.stdout:9/654: readlink db/de/d15/d17/dad/d97/lb8 0 2024-09-06T14:44:30.423 INFO:tasks.workunit.client.1.smithi165.stdout:9/655: rename db/de/d16/d2e/c4d to db/de/d15/d17/d18/d7d/d61/cd4 0 2024-09-06T14:44:30.425 INFO:tasks.workunit.client.1.smithi165.stdout:9/656: creat db/de/d15/d74/fd5 x:0 0 0 2024-09-06T14:44:30.427 INFO:tasks.workunit.client.1.smithi165.stdout:5/582: dwrite d6/f13 [0,4194304] 0 2024-09-06T14:44:30.429 INFO:tasks.workunit.client.1.smithi165.stdout:9/657: creat db/de/d15/d17/d72/d9e/fd6 x:0 0 0 2024-09-06T14:44:30.431 INFO:tasks.workunit.client.1.smithi165.stdout:5/583: mkdir d6/d1c/d28/d4b/d55/d8a/da5/dd6 0 2024-09-06T14:44:30.431 INFO:tasks.workunit.client.1.smithi165.stdout:9/658: fdatasync db/de/d15/f2b 0 2024-09-06T14:44:30.433 INFO:tasks.workunit.client.1.smithi165.stdout:5/584: dread d6/d32/f63 [0,4194304] 0 2024-09-06T14:44:30.434 INFO:tasks.workunit.client.1.smithi165.stdout:5/585: write d6/f13 [2228822,36508] 0 2024-09-06T14:44:30.436 INFO:tasks.workunit.client.1.smithi165.stdout:5/586: chown d6/d1c/d28/d2d/d3c/l40 114 1 2024-09-06T14:44:30.437 INFO:tasks.workunit.client.1.smithi165.stdout:5/587: dread - d6/d1c/d28/d2d/d3c/d44/f83 zero size 2024-09-06T14:44:30.524 INFO:tasks.workunit.client.1.smithi165.stdout:5/588: mkdir d6/d98/dd7 0 2024-09-06T14:44:30.524 INFO:tasks.workunit.client.1.smithi165.stdout:5/589: fdatasync d6/f19 0 2024-09-06T14:44:30.529 INFO:tasks.workunit.client.1.smithi165.stdout:5/590: link d6/d1c/d28/d4b/d60/caa d6/d1c/d28/d2d/d3c/cd8 0 2024-09-06T14:44:30.530 INFO:tasks.workunit.client.1.smithi165.stdout:4/525: sync 2024-09-06T14:44:30.530 INFO:tasks.workunit.client.1.smithi165.stdout:0/480: sync 2024-09-06T14:44:30.533 INFO:tasks.workunit.client.1.smithi165.stdout:4/526: write d5/d1b/d1c/d20/d26/f3c [1053783,71901] 0 2024-09-06T14:44:30.537 INFO:tasks.workunit.client.1.smithi165.stdout:4/527: read d5/d1b/f49 [2130953,129388] 0 2024-09-06T14:44:30.540 INFO:tasks.workunit.client.1.smithi165.stdout:9/659: dwrite db/de/d15/d17/d18/f4b [0,4194304] 0 2024-09-06T14:44:30.543 INFO:tasks.workunit.client.1.smithi165.stdout:0/481: dwrite d15/d19/d28/d3a/d3f/f48 [0,4194304] 0 2024-09-06T14:44:30.543 INFO:tasks.workunit.client.1.smithi165.stdout:0/482: stat d15/c30 0 2024-09-06T14:44:30.545 INFO:tasks.workunit.client.1.smithi165.stdout:4/528: getdents d5/d1b/d61/d97 0 2024-09-06T14:44:30.552 INFO:tasks.workunit.client.1.smithi165.stdout:9/660: dread db/de/d15/d17/d72/f76 [0,4194304] 0 2024-09-06T14:44:30.553 INFO:tasks.workunit.client.1.smithi165.stdout:0/483: truncate d15/d19/d28/d3a/f41 1847256 0 2024-09-06T14:44:30.555 INFO:tasks.workunit.client.1.smithi165.stdout:4/529: dwrite d5/d1b/d1c/d8c/f8d [0,4194304] 0 2024-09-06T14:44:30.555 INFO:tasks.workunit.client.1.smithi165.stdout:0/484: readlink d15/d19/d28/l8f 0 2024-09-06T14:44:30.555 INFO:tasks.workunit.client.1.smithi165.stdout:5/591: dread d6/d1c/d28/f6b [0,4194304] 0 2024-09-06T14:44:30.556 INFO:tasks.workunit.client.1.smithi165.stdout:9/661: rmdir db/de/d16 39 2024-09-06T14:44:30.559 INFO:tasks.workunit.client.1.smithi165.stdout:5/592: fdatasync d6/d1c/d28/d2d/d49/f4e 0 2024-09-06T14:44:30.560 INFO:tasks.workunit.client.1.smithi165.stdout:0/485: mkdir d15/d19/d28/d9e 0 2024-09-06T14:44:30.565 INFO:tasks.workunit.client.1.smithi165.stdout:4/530: dwrite d5/d1b/d1c/d55/f8f [0,4194304] 0 2024-09-06T14:44:30.565 INFO:tasks.workunit.client.1.smithi165.stdout:4/531: readlink l4 0 2024-09-06T14:44:30.566 INFO:tasks.workunit.client.1.smithi165.stdout:5/593: mkdir d6/d98/dd7/dd9 0 2024-09-06T14:44:30.567 INFO:tasks.workunit.client.1.smithi165.stdout:9/662: dread db/de/d15/d17/f19 [0,4194304] 0 2024-09-06T14:44:30.568 INFO:tasks.workunit.client.1.smithi165.stdout:0/486: creat d15/d19/d28/d3a/f9f x:0 0 0 2024-09-06T14:44:30.569 INFO:tasks.workunit.client.1.smithi165.stdout:4/532: mkdir d5/db8 0 2024-09-06T14:44:30.573 INFO:tasks.workunit.client.1.smithi165.stdout:4/533: dread d5/d1b/d1c/d8c/f8d [0,4194304] 0 2024-09-06T14:44:30.573 INFO:tasks.workunit.client.1.smithi165.stdout:5/594: mkdir d6/d1c/d28/d4b/d55/d8a/dda 0 2024-09-06T14:44:30.575 INFO:tasks.workunit.client.1.smithi165.stdout:4/534: chown d5/d1b/d1c/d20/d26/f95 1593 1 2024-09-06T14:44:30.576 INFO:tasks.workunit.client.1.smithi165.stdout:5/595: dread - d6/d1c/d28/d4b/d55/fca zero size 2024-09-06T14:44:30.576 INFO:tasks.workunit.client.1.smithi165.stdout:9/663: creat db/dcf/fd7 x:0 0 0 2024-09-06T14:44:30.577 INFO:tasks.workunit.client.1.smithi165.stdout:4/535: chown d5/d1b/d1c/d55 171305 1 2024-09-06T14:44:30.580 INFO:tasks.workunit.client.1.smithi165.stdout:0/487: dwrite ff [0,4194304] 0 2024-09-06T14:44:30.582 INFO:tasks.workunit.client.1.smithi165.stdout:4/536: unlink d5/d1b/d1c/d20/l45 0 2024-09-06T14:44:30.584 INFO:tasks.workunit.client.1.smithi165.stdout:5/596: dread d6/d1c/d28/f6b [0,4194304] 0 2024-09-06T14:44:30.587 INFO:tasks.workunit.client.1.smithi165.stdout:4/537: mknod d5/d1b/d61/d77/cb9 0 2024-09-06T14:44:30.588 INFO:tasks.workunit.client.1.smithi165.stdout:4/538: fdatasync d5/d1b/d1c/d41/f44 0 2024-09-06T14:44:30.592 INFO:tasks.workunit.client.1.smithi165.stdout:0/488: write d15/d19/d28/d3a/d3f/f6f [526149,89720] 0 2024-09-06T14:44:30.592 INFO:tasks.workunit.client.1.smithi165.stdout:9/664: truncate db/de/d16/d2e/f63 1421484 0 2024-09-06T14:44:30.593 INFO:tasks.workunit.client.1.smithi165.stdout:9/665: dread - db/de/d15/fc5 zero size 2024-09-06T14:44:30.595 INFO:tasks.workunit.client.1.smithi165.stdout:5/597: write d6/d1c/d28/f43 [672565,123293] 0 2024-09-06T14:44:30.596 INFO:tasks.workunit.client.1.smithi165.stdout:9/666: fdatasync db/de/d15/d17/f47 0 2024-09-06T14:44:30.597 INFO:tasks.workunit.client.1.smithi165.stdout:5/598: chown d6/d1c/d28/d2d/d49/c7d 122 1 2024-09-06T14:44:30.599 INFO:tasks.workunit.client.1.smithi165.stdout:9/667: truncate db/de/d15/d17/d18/d7d/d61/fab 806741 0 2024-09-06T14:44:30.603 INFO:tasks.workunit.client.1.smithi165.stdout:9/668: creat db/dcf/fd8 x:0 0 0 2024-09-06T14:44:30.604 INFO:tasks.workunit.client.1.smithi165.stdout:4/539: dwrite d5/d1b/d1c/d20/f27 [0,4194304] 0 2024-09-06T14:44:30.604 INFO:tasks.workunit.client.1.smithi165.stdout:2/461: sync 2024-09-06T14:44:30.604 INFO:tasks.workunit.client.1.smithi165.stdout:0/489: getdents d15/d19/d50/d53/d57 0 2024-09-06T14:44:30.607 INFO:tasks.workunit.client.1.smithi165.stdout:9/669: creat db/de/d15/d17/d18/d59/d64/fd9 x:0 0 0 2024-09-06T14:44:30.610 INFO:tasks.workunit.client.1.smithi165.stdout:5/599: getdents d6/d1c/d28 0 2024-09-06T14:44:30.612 INFO:tasks.workunit.client.1.smithi165.stdout:0/490: dwrite d15/d19/d28/d3a/f96 [0,4194304] 0 2024-09-06T14:44:30.618 INFO:tasks.workunit.client.1.smithi165.stdout:9/670: unlink db/de/d15/d7f/d9b/f73 0 2024-09-06T14:44:30.619 INFO:tasks.workunit.client.1.smithi165.stdout:5/600: rmdir d6/d1c/d28 39 2024-09-06T14:44:30.623 INFO:tasks.workunit.client.1.smithi165.stdout:2/462: truncate d9/f13 5763355 0 2024-09-06T14:44:30.624 INFO:tasks.workunit.client.1.smithi165.stdout:5/601: dread - d6/d1c/d28/d4b/d55/f6a zero size 2024-09-06T14:44:30.625 INFO:tasks.workunit.client.1.smithi165.stdout:0/491: rename d15/d19/d28/d3a/f41 to d15/d19/d38/fa0 0 2024-09-06T14:44:30.625 INFO:tasks.workunit.client.1.smithi165.stdout:2/463: stat d9/d23/l24 0 2024-09-06T14:44:30.626 INFO:tasks.workunit.client.1.smithi165.stdout:5/602: mkdir d6/dc1/ddb 0 2024-09-06T14:44:30.628 INFO:tasks.workunit.client.1.smithi165.stdout:9/671: dwrite db/de/d16/f6b [0,4194304] 0 2024-09-06T14:44:30.629 INFO:tasks.workunit.client.1.smithi165.stdout:0/492: write d15/d19/d50/d53/f91 [217795,83908] 0 2024-09-06T14:44:30.629 INFO:tasks.workunit.client.1.smithi165.stdout:2/464: symlink d9/d23/d29/l94 0 2024-09-06T14:44:30.631 INFO:tasks.workunit.client.1.smithi165.stdout:9/672: chown db/de/d15/d17/l79 583652687 1 2024-09-06T14:44:30.631 INFO:tasks.workunit.client.1.smithi165.stdout:2/465: chown d9/d23/d29/l2f 6529623 1 2024-09-06T14:44:30.631 INFO:tasks.workunit.client.1.smithi165.stdout:5/603: mkdir d6/d1c/d28/d2d/d61/ddc 0 2024-09-06T14:44:30.636 INFO:tasks.workunit.client.1.smithi165.stdout:2/466: read d9/d23/d29/f2b [1480655,63020] 0 2024-09-06T14:44:30.637 INFO:tasks.workunit.client.1.smithi165.stdout:9/673: mkdir db/de/d15/d7f/dda 0 2024-09-06T14:44:30.637 INFO:tasks.workunit.client.1.smithi165.stdout:0/493: dread d15/d19/d28/f67 [0,4194304] 0 2024-09-06T14:44:30.639 INFO:tasks.workunit.client.1.smithi165.stdout:2/467: mkdir d9/d25/d45/d69/d95 0 2024-09-06T14:44:30.642 INFO:tasks.workunit.client.1.smithi165.stdout:2/468: symlink d9/d25/l96 0 2024-09-06T14:44:30.645 INFO:tasks.workunit.client.1.smithi165.stdout:2/469: chown d9/d3b/d78/f79 168288253 1 2024-09-06T14:44:30.645 INFO:tasks.workunit.client.1.smithi165.stdout:0/494: link d15/d19/l4d d15/d19/d50/d53/d7c/d9a/la1 0 2024-09-06T14:44:30.646 INFO:tasks.workunit.client.1.smithi165.stdout:9/674: dwrite db/de/d16/d2e/f70 [0,4194304] 0 2024-09-06T14:44:30.648 INFO:tasks.workunit.client.1.smithi165.stdout:2/470: creat d9/d25/d45/d75/d34/f97 x:0 0 0 2024-09-06T14:44:30.651 INFO:tasks.workunit.client.1.smithi165.stdout:5/604: dread d6/d1c/f76 [0,4194304] 0 2024-09-06T14:44:30.653 INFO:tasks.workunit.client.1.smithi165.stdout:9/675: creat db/de/fdb x:0 0 0 2024-09-06T14:44:30.653 INFO:tasks.workunit.client.1.smithi165.stdout:2/471: symlink d9/d25/d45/d75/d67/d76/l98 0 2024-09-06T14:44:30.654 INFO:tasks.workunit.client.1.smithi165.stdout:0/495: link d15/d19/f46 d15/d19/d38/fa2 0 2024-09-06T14:44:30.654 INFO:tasks.workunit.client.1.smithi165.stdout:9/676: dread - db/de/d15/d17/d18/d59/d64/fd9 zero size 2024-09-06T14:44:30.654 INFO:tasks.workunit.client.1.smithi165.stdout:2/472: chown d9/d25/d45/d69/d95 115 1 2024-09-06T14:44:30.656 INFO:tasks.workunit.client.1.smithi165.stdout:5/605: creat d6/d1c/d28/d2d/d61/ddc/fdd x:0 0 0 2024-09-06T14:44:30.657 INFO:tasks.workunit.client.1.smithi165.stdout:2/473: chown d9/d88/c8e 252 1 2024-09-06T14:44:30.659 INFO:tasks.workunit.client.1.smithi165.stdout:5/606: mkdir d6/d1c/d28/d2d/d61/dde 0 2024-09-06T14:44:30.659 INFO:tasks.workunit.client.1.smithi165.stdout:5/607: dread - d6/fac zero size 2024-09-06T14:44:30.660 INFO:tasks.workunit.client.1.smithi165.stdout:2/474: rmdir d9/d25/d46 39 2024-09-06T14:44:30.662 INFO:tasks.workunit.client.1.smithi165.stdout:9/677: creat db/de/d15/fdc x:0 0 0 2024-09-06T14:44:30.662 INFO:tasks.workunit.client.1.smithi165.stdout:9/678: chown db/de/d15/d17/dad/f95 89476 1 2024-09-06T14:44:30.663 INFO:tasks.workunit.client.1.smithi165.stdout:9/679: chown db/de/d15/d17/dad 1690782 1 2024-09-06T14:44:30.663 INFO:tasks.workunit.client.1.smithi165.stdout:0/496: getdents d15/d19/d2c 0 2024-09-06T14:44:30.664 INFO:tasks.workunit.client.1.smithi165.stdout:0/497: chown d15/d19/d28/l8f 0 1 2024-09-06T14:44:30.665 INFO:tasks.workunit.client.1.smithi165.stdout:0/498: write d15/d19/d28/f7a [367861,23566] 0 2024-09-06T14:44:30.665 INFO:tasks.workunit.client.1.smithi165.stdout:5/608: rename d6/d1c/d7c to d6/d1c/d28/d2d/d3c/d44/d90/ddf 0 2024-09-06T14:44:30.671 INFO:tasks.workunit.client.1.smithi165.stdout:0/499: mkdir d15/d19/d28/d9e/da3 0 2024-09-06T14:44:30.671 INFO:tasks.workunit.client.1.smithi165.stdout:5/609: dwrite d6/d1c/d28/f43 [0,4194304] 0 2024-09-06T14:44:30.676 INFO:tasks.workunit.client.1.smithi165.stdout:0/500: dread d15/d19/d28/d3a/f96 [0,4194304] 0 2024-09-06T14:44:30.676 INFO:tasks.workunit.client.1.smithi165.stdout:0/501: chown d15/f2f 156714 1 2024-09-06T14:44:30.677 INFO:tasks.workunit.client.1.smithi165.stdout:5/610: mkdir d6/dc1/ddb/de0 0 2024-09-06T14:44:30.679 INFO:tasks.workunit.client.1.smithi165.stdout:0/502: mknod d15/d19/d2c/ca4 0 2024-09-06T14:44:30.682 INFO:tasks.workunit.client.1.smithi165.stdout:0/503: rmdir d15/d19/d50/d53/d7c/d9a/d93 0 2024-09-06T14:44:30.683 INFO:tasks.workunit.client.1.smithi165.stdout:0/504: write ff [2541437,28500] 0 2024-09-06T14:44:30.691 INFO:tasks.workunit.client.1.smithi165.stdout:2/475: dwrite d9/f12 [0,4194304] 0 2024-09-06T14:44:30.691 INFO:tasks.workunit.client.1.smithi165.stdout:9/680: dwrite db/de/d15/d17/f25 [0,4194304] 0 2024-09-06T14:44:30.693 INFO:tasks.workunit.client.1.smithi165.stdout:0/505: dwrite d15/d19/d50/d53/f91 [0,4194304] 0 2024-09-06T14:44:30.700 INFO:tasks.workunit.client.1.smithi165.stdout:0/506: fsync d15/d19/f46 0 2024-09-06T14:44:30.702 INFO:tasks.workunit.client.1.smithi165.stdout:2/476: creat d9/d23/f99 x:0 0 0 2024-09-06T14:44:30.703 INFO:tasks.workunit.client.1.smithi165.stdout:0/507: creat d15/d6e/fa5 x:0 0 0 2024-09-06T14:44:30.706 INFO:tasks.workunit.client.1.smithi165.stdout:0/508: chown d15/d19/l40 1774 1 2024-09-06T14:44:30.708 INFO:tasks.workunit.client.1.smithi165.stdout:9/681: dread db/de/d15/f48 [0,4194304] 0 2024-09-06T14:44:30.708 INFO:tasks.workunit.client.1.smithi165.stdout:0/509: symlink d15/d19/d66/la6 0 2024-09-06T14:44:30.710 INFO:tasks.workunit.client.1.smithi165.stdout:9/682: mkdir db/de/d15/d17/d86/ddd 0 2024-09-06T14:44:30.710 INFO:tasks.workunit.client.1.smithi165.stdout:0/510: mkdir d15/d19/d28/d4f/da7 0 2024-09-06T14:44:30.711 INFO:tasks.workunit.client.1.smithi165.stdout:9/683: chown db/de/d15/d7f/l8f 872821 1 2024-09-06T14:44:30.724 INFO:tasks.workunit.client.1.smithi165.stdout:2/477: write d9/f13 [4457270,72809] 0 2024-09-06T14:44:30.725 INFO:tasks.workunit.client.1.smithi165.stdout:0/511: dread d15/f37 [4194304,4194304] 0 2024-09-06T14:44:30.727 INFO:tasks.workunit.client.1.smithi165.stdout:2/478: creat d9/d25/d45/d75/d67/f9a x:0 0 0 2024-09-06T14:44:30.727 INFO:tasks.workunit.client.1.smithi165.stdout:9/684: dread db/de/d15/d74/fca [0,4194304] 0 2024-09-06T14:44:30.728 INFO:tasks.workunit.client.1.smithi165.stdout:0/512: dread d15/d19/d28/d4f/d52/f63 [0,4194304] 0 2024-09-06T14:44:30.731 INFO:tasks.workunit.client.1.smithi165.stdout:0/513: symlink d15/d19/d28/d51/la8 0 2024-09-06T14:44:30.734 INFO:tasks.workunit.client.1.smithi165.stdout:0/514: creat d15/d19/d28/fa9 x:0 0 0 2024-09-06T14:44:30.737 INFO:tasks.workunit.client.1.smithi165.stdout:0/515: creat d15/d6e/faa x:0 0 0 2024-09-06T14:44:30.738 INFO:tasks.workunit.client.1.smithi165.stdout:1/520: sync 2024-09-06T14:44:30.738 INFO:tasks.workunit.client.1.smithi165.stdout:3/513: sync 2024-09-06T14:44:30.738 INFO:tasks.workunit.client.1.smithi165.stdout:6/563: sync 2024-09-06T14:44:30.738 INFO:tasks.workunit.client.1.smithi165.stdout:7/441: sync 2024-09-06T14:44:30.738 INFO:tasks.workunit.client.1.smithi165.stdout:8/537: sync 2024-09-06T14:44:30.739 INFO:tasks.workunit.client.1.smithi165.stdout:2/479: dread d9/d25/d45/d75/d67/d76/f47 [0,4194304] 0 2024-09-06T14:44:30.740 INFO:tasks.workunit.client.1.smithi165.stdout:7/442: chown f1f 198931 1 2024-09-06T14:44:30.740 INFO:tasks.workunit.client.1.smithi165.stdout:0/516: symlink d15/d19/d28/d51/lab 0 2024-09-06T14:44:30.741 INFO:tasks.workunit.client.1.smithi165.stdout:9/685: dwrite db/de/d16/d2e/f63 [0,4194304] 0 2024-09-06T14:44:30.742 INFO:tasks.workunit.client.1.smithi165.stdout:3/514: dread d1/f69 [0,4194304] 0 2024-09-06T14:44:30.743 INFO:tasks.workunit.client.1.smithi165.stdout:6/564: mkdir d29/d32/dad 0 2024-09-06T14:44:30.744 INFO:tasks.workunit.client.1.smithi165.stdout:2/480: fdatasync d9/d23/f28 0 2024-09-06T14:44:30.745 INFO:tasks.workunit.client.1.smithi165.stdout:2/481: truncate d9/d25/f57 767752 0 2024-09-06T14:44:30.747 INFO:tasks.workunit.client.1.smithi165.stdout:7/443: creat d20/d3b/d69/d88/d80/f8d x:0 0 0 2024-09-06T14:44:30.749 INFO:tasks.workunit.client.1.smithi165.stdout:0/517: rename d15/d19/d50/d53/c6d to d15/d19/d28/d4f/cac 0 2024-09-06T14:44:30.749 INFO:tasks.workunit.client.1.smithi165.stdout:6/565: mknod d29/d39/d5b/d62/d94/cae 0 2024-09-06T14:44:30.751 INFO:tasks.workunit.client.1.smithi165.stdout:6/566: write d29/d39/d5b/d62/fa3 [19714,18294] 0 2024-09-06T14:44:30.752 INFO:tasks.workunit.client.1.smithi165.stdout:0/518: dread d15/d19/d28/d4f/d52/f6a [0,4194304] 0 2024-09-06T14:44:30.754 INFO:tasks.workunit.client.1.smithi165.stdout:3/515: mkdir d1/da/dd/d8c/dae 0 2024-09-06T14:44:30.755 INFO:tasks.workunit.client.1.smithi165.stdout:3/516: fdatasync d1/d19/f29 0 2024-09-06T14:44:30.755 INFO:tasks.workunit.client.1.smithi165.stdout:3/517: readlink d1/da/dc/l94 0 2024-09-06T14:44:30.756 INFO:tasks.workunit.client.1.smithi165.stdout:0/519: fdatasync d15/d19/d28/d3a/f96 0 2024-09-06T14:44:30.756 INFO:tasks.workunit.client.1.smithi165.stdout:3/518: dread - d1/d41/f97 zero size 2024-09-06T14:44:30.757 INFO:tasks.workunit.client.1.smithi165.stdout:8/538: getdents d0/d34/d6b/d94 0 2024-09-06T14:44:30.762 INFO:tasks.workunit.client.1.smithi165.stdout:3/519: creat d1/d7c/d98/faf x:0 0 0 2024-09-06T14:44:30.763 INFO:tasks.workunit.client.1.smithi165.stdout:1/521: truncate d0/d1c/d1d/f3c 3830966 0 2024-09-06T14:44:30.764 INFO:tasks.workunit.client.1.smithi165.stdout:8/539: creat d0/d9e/fbf x:0 0 0 2024-09-06T14:44:30.768 INFO:tasks.workunit.client.1.smithi165.stdout:0/520: symlink d15/d19/d28/d9e/da3/lad 0 2024-09-06T14:44:30.768 INFO:tasks.workunit.client.1.smithi165.stdout:3/520: symlink d1/d41/da1/lb0 0 2024-09-06T14:44:30.768 INFO:tasks.workunit.client.1.smithi165.stdout:2/482: truncate d9/d25/d45/d75/d34/f6c 476585 0 2024-09-06T14:44:30.770 INFO:tasks.workunit.client.1.smithi165.stdout:2/483: fdatasync d9/d4f/f91 0 2024-09-06T14:44:30.770 INFO:tasks.workunit.client.1.smithi165.stdout:1/522: creat d0/d2a/d18/d24/d4b/d93/d6a/d83/fa6 x:0 0 0 2024-09-06T14:44:30.770 INFO:tasks.workunit.client.1.smithi165.stdout:3/521: chown d1/d19/f90 113478 1 2024-09-06T14:44:30.771 INFO:tasks.workunit.client.1.smithi165.stdout:0/521: mkdir d15/d19/d50/d53/d7c/dae 0 2024-09-06T14:44:30.772 INFO:tasks.workunit.client.1.smithi165.stdout:7/444: dwrite d20/d3b/d69/d88/f4e [0,4194304] 0 2024-09-06T14:44:30.772 INFO:tasks.workunit.client.1.smithi165.stdout:6/567: truncate d29/d39/d5b/d68/f73 1254948 0 2024-09-06T14:44:30.773 INFO:tasks.workunit.client.1.smithi165.stdout:3/522: chown d1/l73 5 1 2024-09-06T14:44:30.774 INFO:tasks.workunit.client.1.smithi165.stdout:0/522: readlink d15/d19/d2c/l6c 0 2024-09-06T14:44:30.776 INFO:tasks.workunit.client.1.smithi165.stdout:8/540: dwrite d0/d19/f95 [0,4194304] 0 2024-09-06T14:44:30.777 INFO:tasks.workunit.client.1.smithi165.stdout:1/523: creat d0/d1c/fa7 x:0 0 0 2024-09-06T14:44:30.777 INFO:tasks.workunit.client.1.smithi165.stdout:7/445: chown d20/d3b/d69/d88/d30/d78 22028 1 2024-09-06T14:44:30.778 INFO:tasks.workunit.client.1.smithi165.stdout:2/484: mknod d9/d25/d45/d69/c9b 0 2024-09-06T14:44:30.779 INFO:tasks.workunit.client.1.smithi165.stdout:8/541: stat d0/d19/d24/d26 0 2024-09-06T14:44:30.779 INFO:tasks.workunit.client.1.smithi165.stdout:0/523: write d15/d6e/f85 [284941,25553] 0 2024-09-06T14:44:30.782 INFO:tasks.workunit.client.1.smithi165.stdout:3/523: write d1/da/dd/d4b/f74 [437911,63361] 0 2024-09-06T14:44:30.783 INFO:tasks.workunit.client.1.smithi165.stdout:7/446: write d20/d3b/d69/d88/d30/f83 [583393,57003] 0 2024-09-06T14:44:30.783 INFO:tasks.workunit.client.1.smithi165.stdout:2/485: write d9/d25/d45/f51 [1668489,69216] 0 2024-09-06T14:44:30.784 INFO:tasks.workunit.client.1.smithi165.stdout:3/524: chown d1/da/dc/f39 167104120 1 2024-09-06T14:44:30.785 INFO:tasks.workunit.client.1.smithi165.stdout:7/447: dread - d20/d3b/d69/d88/d80/f8d zero size 2024-09-06T14:44:30.789 INFO:tasks.workunit.client.1.smithi165.stdout:0/524: rename d15/d19/d28/d4f/f81 to d15/d6e/faf 0 2024-09-06T14:44:30.790 INFO:tasks.workunit.client.1.smithi165.stdout:8/542: creat d0/d34/d6b/d94/d70/fc0 x:0 0 0 2024-09-06T14:44:30.791 INFO:tasks.workunit.client.1.smithi165.stdout:1/524: mknod d0/d2a/d18/d24/d4b/d93/d6a/ca8 0 2024-09-06T14:44:30.791 INFO:tasks.workunit.client.1.smithi165.stdout:6/568: getdents d29/d93 0 2024-09-06T14:44:30.791 INFO:tasks.workunit.client.1.smithi165.stdout:3/525: rmdir d1/da/dd/d8c 39 2024-09-06T14:44:30.793 INFO:tasks.workunit.client.1.smithi165.stdout:3/526: fsync d1/da/dd/f15 0 2024-09-06T14:44:30.793 INFO:tasks.workunit.client.1.smithi165.stdout:1/525: read d0/d2a/d18/f67 [3452191,101399] 0 2024-09-06T14:44:30.843 INFO:tasks.workunit.client.1.smithi165.stdout:0/525: rename d15/d19/d28/f7a to d15/d19/d28/d4f/da7/fb0 0 2024-09-06T14:44:30.844 INFO:tasks.workunit.client.1.smithi165.stdout:8/543: symlink d0/d19/d36/d2d/d3f/d93/lc1 0 2024-09-06T14:44:30.844 INFO:tasks.workunit.client.1.smithi165.stdout:2/486: write d9/d25/d45/d75/d67/f92 [820217,58325] 0 2024-09-06T14:44:30.845 INFO:tasks.workunit.client.1.smithi165.stdout:1/526: write d0/d2a/d18/d24/d4b/d95/f96 [756113,69917] 0 2024-09-06T14:44:30.847 INFO:tasks.workunit.client.1.smithi165.stdout:8/544: creat d0/d19/d36/d28/fc2 x:0 0 0 2024-09-06T14:44:30.847 INFO:tasks.workunit.client.1.smithi165.stdout:2/487: chown d9/d25/d45/d75/d67/d76 1982324793 1 2024-09-06T14:44:30.848 INFO:tasks.workunit.client.1.smithi165.stdout:0/526: creat d15/d19/d28/d9e/da3/fb1 x:0 0 0 2024-09-06T14:44:30.850 INFO:tasks.workunit.client.1.smithi165.stdout:1/527: mknod d0/d2a/d18/d24/d4b/d93/ca9 0 2024-09-06T14:44:30.850 INFO:tasks.workunit.client.1.smithi165.stdout:2/488: stat d9/d25/d45/d75/d67/d76/f6a 0 2024-09-06T14:44:30.850 INFO:tasks.workunit.client.1.smithi165.stdout:8/545: chown d0/d19/d36/d2d/d3f/d93/lc1 593 1 2024-09-06T14:44:30.851 INFO:tasks.workunit.client.1.smithi165.stdout:0/527: creat d15/d19/d50/d53/fb2 x:0 0 0 2024-09-06T14:44:30.852 INFO:tasks.workunit.client.1.smithi165.stdout:6/569: dwrite d29/d32/f56 [0,4194304] 0 2024-09-06T14:44:30.853 INFO:tasks.workunit.client.1.smithi165.stdout:2/489: write d9/d25/d45/f89 [2723816,54868] 0 2024-09-06T14:44:30.859 INFO:tasks.workunit.client.1.smithi165.stdout:3/527: dread d1/da/f7b [0,4194304] 0 2024-09-06T14:44:30.859 INFO:tasks.workunit.client.1.smithi165.stdout:8/546: dread d0/d19/f3b [0,4194304] 0 2024-09-06T14:44:30.861 INFO:tasks.workunit.client.1.smithi165.stdout:8/547: fdatasync d0/d19/d36/d2d/d33/d3a/d46/d49/f4a 0 2024-09-06T14:44:30.862 INFO:tasks.workunit.client.1.smithi165.stdout:6/570: rmdir d29/d32/dad 0 2024-09-06T14:44:30.863 INFO:tasks.workunit.client.1.smithi165.stdout:6/571: chown d29/d39/f54 47670 1 2024-09-06T14:44:30.864 INFO:tasks.workunit.client.1.smithi165.stdout:6/572: chown d29/d39/d5b/d62/d67 126959258 1 2024-09-06T14:44:30.868 INFO:tasks.workunit.client.1.smithi165.stdout:0/528: getdents d15/d19/d50/d53 0 2024-09-06T14:44:30.869 INFO:tasks.workunit.client.1.smithi165.stdout:6/573: symlink d29/d39/d5b/d62/d94/laf 0 2024-09-06T14:44:30.871 INFO:tasks.workunit.client.1.smithi165.stdout:2/490: link d9/d25/d45/d75/d34/c53 d9/d23/d52/c9c 0 2024-09-06T14:44:30.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:44:30.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:44:30.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:44:30.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:44:30.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:44:30.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:30 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:44:30.875 INFO:tasks.workunit.client.1.smithi165.stdout:0/529: symlink d15/d19/d28/lb3 0 2024-09-06T14:44:30.875 INFO:tasks.workunit.client.1.smithi165.stdout:6/574: chown d29/d39/ca2 42306 1 2024-09-06T14:44:30.875 INFO:tasks.workunit.client.1.smithi165.stdout:3/528: dread d1/da/f26 [0,4194304] 0 2024-09-06T14:44:30.875 INFO:tasks.workunit.client.1.smithi165.stdout:1/528: dwrite d0/d1c/d40/f4d [0,4194304] 0 2024-09-06T14:44:30.875 INFO:tasks.workunit.client.1.smithi165.stdout:2/491: creat d9/d25/d45/d75/d34/f9d x:0 0 0 2024-09-06T14:44:30.876 INFO:tasks.workunit.client.1.smithi165.stdout:2/492: readlink d9/d23/l31 0 2024-09-06T14:44:30.878 INFO:tasks.workunit.client.1.smithi165.stdout:6/575: unlink d29/d32/c42 0 2024-09-06T14:44:30.880 INFO:tasks.workunit.client.1.smithi165.stdout:3/529: creat d1/da/dc/d3b/fb1 x:0 0 0 2024-09-06T14:44:30.882 INFO:tasks.workunit.client.1.smithi165.stdout:1/529: creat d0/d2a/d18/d24/d4b/d93/d97/faa x:0 0 0 2024-09-06T14:44:30.884 INFO:tasks.workunit.client.1.smithi165.stdout:0/530: getdents d15/d19/d50/d53 0 2024-09-06T14:44:30.884 INFO:tasks.workunit.client.1.smithi165.stdout:3/530: write d1/da/dc/f2e [2202337,84275] 0 2024-09-06T14:44:30.886 INFO:tasks.workunit.client.1.smithi165.stdout:8/548: dwrite d0/d19/d36/fe [0,4194304] 0 2024-09-06T14:44:30.886 INFO:tasks.workunit.client.1.smithi165.stdout:6/576: getdents d29/d6a/d71 0 2024-09-06T14:44:30.887 INFO:tasks.workunit.client.1.smithi165.stdout:2/493: dread d9/d25/d45/d75/d67/d76/f47 [0,4194304] 0 2024-09-06T14:44:30.887 INFO:tasks.workunit.client.1.smithi165.stdout:0/531: mknod d15/d55/cb4 0 2024-09-06T14:44:30.888 INFO:tasks.workunit.client.1.smithi165.stdout:3/531: dread - d1/da/dc/d3b/fb1 zero size 2024-09-06T14:44:30.888 INFO:tasks.workunit.client.1.smithi165.stdout:6/577: chown d29/d93/d87 929775 1 2024-09-06T14:44:30.890 INFO:tasks.workunit.client.1.smithi165.stdout:2/494: write d9/d25/d45/f51 [2714650,111574] 0 2024-09-06T14:44:30.890 INFO:tasks.workunit.client.1.smithi165.stdout:8/549: creat d0/d19/d36/d28/fc3 x:0 0 0 2024-09-06T14:44:30.891 INFO:tasks.workunit.client.1.smithi165.stdout:4/540: sync 2024-09-06T14:44:30.891 INFO:tasks.workunit.client.1.smithi165.stdout:5/611: sync 2024-09-06T14:44:30.891 INFO:tasks.workunit.client.1.smithi165.stdout:9/686: sync 2024-09-06T14:44:30.892 INFO:tasks.workunit.client.1.smithi165.stdout:3/532: mknod d1/d41/da1/cb2 0 2024-09-06T14:44:30.892 INFO:tasks.workunit.client.1.smithi165.stdout:6/578: write d29/d39/d5b/f92 [740940,116160] 0 2024-09-06T14:44:30.896 INFO:tasks.workunit.client.1.smithi165.stdout:5/612: readlink d6/d1c/d28/d2d/d3c/d44/d90/lb9 0 2024-09-06T14:44:30.896 INFO:tasks.workunit.client.1.smithi165.stdout:3/533: rmdir d1/da 39 2024-09-06T14:44:30.897 INFO:tasks.workunit.client.1.smithi165.stdout:2/495: symlink d9/d25/l9e 0 2024-09-06T14:44:30.898 INFO:tasks.workunit.client.1.smithi165.stdout:6/579: creat d29/d93/fb0 x:0 0 0 2024-09-06T14:44:30.898 INFO:tasks.workunit.client.1.smithi165.stdout:8/550: dread d0/d19/d36/d28/f78 [0,4194304] 0 2024-09-06T14:44:30.902 INFO:tasks.workunit.client.1.smithi165.stdout:6/580: read d29/d39/d5b/d62/d67/f9c [48746,109565] 0 2024-09-06T14:44:30.904 INFO:tasks.workunit.client.1.smithi165.stdout:3/534: truncate d1/da/dc/d3b/fb1 911306 0 2024-09-06T14:44:30.904 INFO:tasks.workunit.client.1.smithi165.stdout:8/551: symlink d0/d19/d36/d2d/d33/d3a/lc4 0 2024-09-06T14:44:30.905 INFO:tasks.workunit.client.1.smithi165.stdout:4/541: dwrite d5/d1b/f49 [4194304,4194304] 0 2024-09-06T14:44:30.957 INFO:tasks.workunit.client.1.smithi165.stdout:6/581: write d29/d32/f56 [3185315,65016] 0 2024-09-06T14:44:30.958 INFO:tasks.workunit.client.1.smithi165.stdout:8/552: dread - d0/d34/d6b/fa0 zero size 2024-09-06T14:44:30.960 INFO:tasks.workunit.client.1.smithi165.stdout:3/535: symlink d1/da/dc/d10/lb3 0 2024-09-06T14:44:30.960 INFO:tasks.workunit.client.1.smithi165.stdout:4/542: write d5/d1b/d1c/d55/f8f [2272467,61840] 0 2024-09-06T14:44:30.960 INFO:tasks.workunit.client.1.smithi165.stdout:6/582: write f1d [2712066,49068] 0 2024-09-06T14:44:30.960 INFO:tasks.workunit.client.1.smithi165.stdout:5/613: dwrite d6/d1c/f8f [4194304,4194304] 0 2024-09-06T14:44:30.992 INFO:tasks.workunit.client.1.smithi165.stdout:4/543: stat d5/d1b/d1c/d41/f99 0 2024-09-06T14:44:30.994 INFO:tasks.workunit.client.1.smithi165.stdout:5/614: truncate d6/d1c/d28/d4b/d60/f78 502638 0 2024-09-06T14:44:30.995 INFO:tasks.workunit.client.1.smithi165.stdout:9/687: dread db/de/d15/d17/d18/d7d/d61/fa0 [0,4194304] 0 2024-09-06T14:44:30.997 INFO:tasks.workunit.client.1.smithi165.stdout:8/553: dread d0/d19/d24/f37 [0,4194304] 0 2024-09-06T14:44:30.999 INFO:tasks.workunit.client.1.smithi165.stdout:4/544: rename d5/d1b/d61/c79 to d5/d1b/d1c/d20/d26/cba 0 2024-09-06T14:44:31.000 INFO:tasks.workunit.client.1.smithi165.stdout:8/554: dread - d0/d9e/fbf zero size 2024-09-06T14:44:31.000 INFO:tasks.workunit.client.1.smithi165.stdout:3/536: dwrite d1/da/f2a [0,4194304] 0 2024-09-06T14:44:31.003 INFO:tasks.workunit.client.1.smithi165.stdout:4/545: dread - d5/d1b/d1c/f9b zero size 2024-09-06T14:44:31.004 INFO:tasks.workunit.client.1.smithi165.stdout:3/537: chown d1/da/dd/d4b/f6e 15 1 2024-09-06T14:44:31.008 INFO:tasks.workunit.client.1.smithi165.stdout:5/615: dwrite d6/d1c/d28/d2d/d3c/f80 [0,4194304] 0 2024-09-06T14:44:31.010 INFO:tasks.workunit.client.1.smithi165.stdout:6/583: dread d29/d39/d5b/d62/f80 [0,4194304] 0 2024-09-06T14:44:31.010 INFO:tasks.workunit.client.1.smithi165.stdout:3/538: mkdir d1/d4a/db4 0 2024-09-06T14:44:31.011 INFO:tasks.workunit.client.1.smithi165.stdout:9/688: dread db/de/d16/f24 [0,4194304] 0 2024-09-06T14:44:31.015 INFO:tasks.workunit.client.1.smithi165.stdout:8/555: dwrite d0/d19/d7f/f82 [0,4194304] 0 2024-09-06T14:44:31.015 INFO:tasks.workunit.client.1.smithi165.stdout:9/689: write db/d40/f88 [662729,1933] 0 2024-09-06T14:44:31.017 INFO:tasks.workunit.client.1.smithi165.stdout:3/539: creat d1/d19/fb5 x:0 0 0 2024-09-06T14:44:31.018 INFO:tasks.workunit.client.1.smithi165.stdout:8/556: write d0/d19/f1f [3465677,101472] 0 2024-09-06T14:44:31.019 INFO:tasks.workunit.client.1.smithi165.stdout:3/540: write d1/f37 [498331,71457] 0 2024-09-06T14:44:31.020 INFO:tasks.workunit.client.1.smithi165.stdout:9/690: read - db/de/fc8 zero size 2024-09-06T14:44:31.034 INFO:tasks.workunit.client.1.smithi165.stdout:1/530: sync 2024-09-06T14:44:31.034 INFO:tasks.workunit.client.1.smithi165.stdout:7/448: sync 2024-09-06T14:44:31.034 INFO:tasks.workunit.client.1.smithi165.stdout:1/531: chown d0/d2a/f12 2 1 2024-09-06T14:44:31.036 INFO:tasks.workunit.client.1.smithi165.stdout:4/546: dread d5/f2c [0,4194304] 0 2024-09-06T14:44:31.037 INFO:tasks.workunit.client.1.smithi165.stdout:4/547: chown d5/d1b/d66/f85 1205989246 1 2024-09-06T14:44:31.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:44:31.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:44:31.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:44:31.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:44:31.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:44:31.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:30 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:44:31.075 INFO:tasks.workunit.client.1.smithi165.stdout:9/691: chown db/de/c6e 4866 1 2024-09-06T14:44:31.075 INFO:tasks.workunit.client.1.smithi165.stdout:3/541: creat d1/da/dc/d3b/d83/fb6 x:0 0 0 2024-09-06T14:44:31.075 INFO:tasks.workunit.client.1.smithi165.stdout:6/584: getdents d29/d6a/d83 0 2024-09-06T14:44:31.076 INFO:tasks.workunit.client.1.smithi165.stdout:6/585: write d29/d32/f56 [4307479,78354] 0 2024-09-06T14:44:31.081 INFO:tasks.workunit.client.1.smithi165.stdout:9/692: dwrite db/de/d15/d7f/d9b/d6c/f87 [4194304,4194304] 0 2024-09-06T14:44:31.095 INFO:tasks.workunit.client.1.smithi165.stdout:8/557: read d0/d14/f1b [3892551,18372] 0 2024-09-06T14:44:31.096 INFO:tasks.workunit.client.1.smithi165.stdout:8/558: dread - d0/d19/d36/d28/f90 zero size 2024-09-06T14:44:31.096 INFO:tasks.workunit.client.1.smithi165.stdout:5/616: rename d6/d1c/d28/d4b/d60 to d6/d1c/d28/d4b/d55/d8a/de1 0 2024-09-06T14:44:31.097 INFO:tasks.workunit.client.1.smithi165.stdout:8/559: chown d0/d9e 54933 1 2024-09-06T14:44:31.097 INFO:tasks.workunit.client.1.smithi165.stdout:1/532: creat d0/d1c/d1d/d22/fab x:0 0 0 2024-09-06T14:44:31.099 INFO:tasks.workunit.client.1.smithi165.stdout:6/586: chown c2 743 1 2024-09-06T14:44:31.100 INFO:tasks.workunit.client.1.smithi165.stdout:6/587: fdatasync d29/f47 0 2024-09-06T14:44:31.103 INFO:tasks.workunit.client.1.smithi165.stdout:5/617: dwrite d6/d1c/f68 [0,4194304] 0 2024-09-06T14:44:31.103 INFO:tasks.workunit.client.1.smithi165.stdout:8/560: creat d0/d19/d24/db1/fc5 x:0 0 0 2024-09-06T14:44:31.104 INFO:tasks.workunit.client.1.smithi165.stdout:8/561: chown d0/d19/d36/d28/d64/l85 6051985 1 2024-09-06T14:44:31.105 INFO:tasks.workunit.client.1.smithi165.stdout:8/562: chown d0/d9e/fbf 72906 1 2024-09-06T14:44:31.105 INFO:tasks.workunit.client.1.smithi165.stdout:1/533: creat d0/d2a/d18/d24/d4b/d93/d6a/fac x:0 0 0 2024-09-06T14:44:31.107 INFO:tasks.workunit.client.1.smithi165.stdout:6/588: creat d29/d39/d5b/d62/d94/fb1 x:0 0 0 2024-09-06T14:44:31.108 INFO:tasks.workunit.client.1.smithi165.stdout:3/542: link d1/f37 d1/da/dd/fb7 0 2024-09-06T14:44:31.109 INFO:tasks.workunit.client.1.smithi165.stdout:6/589: write f1d [5157829,52458] 0 2024-09-06T14:44:31.111 INFO:tasks.workunit.client.1.smithi165.stdout:1/534: creat d0/d2a/d18/d24/d4b/d93/d2b/fad x:0 0 0 2024-09-06T14:44:31.113 INFO:tasks.workunit.client.1.smithi165.stdout:6/590: dread d29/d39/d5b/d62/f65 [0,4194304] 0 2024-09-06T14:44:31.114 INFO:tasks.workunit.client.1.smithi165.stdout:9/693: truncate db/de/d16/f5e 1718507 0 2024-09-06T14:44:31.115 INFO:tasks.workunit.client.1.smithi165.stdout:5/618: dwrite d6/d1c/d28/d4b/d55/d8a/fa0 [0,4194304] 0 2024-09-06T14:44:31.116 INFO:tasks.workunit.client.1.smithi165.stdout:8/563: dwrite d0/f9 [0,4194304] 0 2024-09-06T14:44:31.119 INFO:tasks.workunit.client.1.smithi165.stdout:5/619: dread - d6/d1c/d28/d4b/d55/fbe zero size 2024-09-06T14:44:31.121 INFO:tasks.workunit.client.1.smithi165.stdout:5/620: readlink d6/d1c/d28/d2d/d3c/l40 0 2024-09-06T14:44:31.124 INFO:tasks.workunit.client.1.smithi165.stdout:1/535: dwrite d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f6b [0,4194304] 0 2024-09-06T14:44:31.125 INFO:tasks.workunit.client.1.smithi165.stdout:5/621: creat d6/dc1/fe2 x:0 0 0 2024-09-06T14:44:31.126 INFO:tasks.workunit.client.1.smithi165.stdout:1/536: dread - d0/d2a/d18/d24/d4b/d93/d2b/fad zero size 2024-09-06T14:44:31.127 INFO:tasks.workunit.client.1.smithi165.stdout:1/537: chown d0/d2a/d18/d24/d4b/d93/d68/d75 0 1 2024-09-06T14:44:31.131 INFO:tasks.workunit.client.1.smithi165.stdout:8/564: write d0/d14/d3e/f35 [946837,95820] 0 2024-09-06T14:44:31.132 INFO:tasks.workunit.client.1.smithi165.stdout:1/538: fdatasync d0/d2a/d18/d24/d4b/d93/f1f 0 2024-09-06T14:44:31.133 INFO:tasks.workunit.client.1.smithi165.stdout:5/622: mkdir d6/d1c/d28/d4b/d55/d8a/dda/de3 0 2024-09-06T14:44:31.134 INFO:tasks.workunit.client.1.smithi165.stdout:1/539: truncate d0/d2a/d18/d24/d4b/d93/d2b/f4a 6191872 0 2024-09-06T14:44:31.135 INFO:tasks.workunit.client.1.smithi165.stdout:6/591: truncate d29/d32/f50 3889390 0 2024-09-06T14:44:31.137 INFO:tasks.workunit.client.1.smithi165.stdout:8/565: mkdir d0/d19/dc6 0 2024-09-06T14:44:31.139 INFO:tasks.workunit.client.1.smithi165.stdout:1/540: write d0/d2a/d18/d24/d4b/d93/d2b/f70 [213326,75020] 0 2024-09-06T14:44:31.141 INFO:tasks.workunit.client.1.smithi165.stdout:5/623: creat d6/d1c/d28/d4b/d55/d8a/fe4 x:0 0 0 2024-09-06T14:44:31.142 INFO:tasks.workunit.client.1.smithi165.stdout:8/566: rmdir d0/d19/d36/d2d/d3f/d93 39 2024-09-06T14:44:31.144 INFO:tasks.workunit.client.1.smithi165.stdout:1/541: rename d0/d2a/d23/d7e to d0/d2a/d18/d24/d4b/d93/d68/dae 0 2024-09-06T14:44:31.145 INFO:tasks.workunit.client.1.smithi165.stdout:5/624: creat d6/d1c/d28/d4b/da7/dab/fe5 x:0 0 0 2024-09-06T14:44:31.147 INFO:tasks.workunit.client.1.smithi165.stdout:8/567: creat d0/d5e/d65/fc7 x:0 0 0 2024-09-06T14:44:31.148 INFO:tasks.workunit.client.1.smithi165.stdout:5/625: truncate d6/d1c/d28/d2d/d3c/d44/f7f 504898 0 2024-09-06T14:44:31.148 INFO:tasks.workunit.client.1.smithi165.stdout:2/496: sync 2024-09-06T14:44:31.148 INFO:tasks.workunit.client.1.smithi165.stdout:0/532: sync 2024-09-06T14:44:31.148 INFO:tasks.workunit.client.1.smithi165.stdout:1/542: mknod d0/d2a/d18/da0/caf 0 2024-09-06T14:44:31.150 INFO:tasks.workunit.client.1.smithi165.stdout:8/568: truncate d0/d19/d36/d2d/f75 485698 0 2024-09-06T14:44:31.150 INFO:tasks.workunit.client.1.smithi165.stdout:2/497: chown d9/d23/f99 167535244 1 2024-09-06T14:44:31.150 INFO:tasks.workunit.client.1.smithi165.stdout:6/592: dread d29/d32/f61 [0,4194304] 0 2024-09-06T14:44:31.151 INFO:tasks.workunit.client.1.smithi165.stdout:1/543: write d0/d2a/d18/d24/d4b/d5f/f63 [280319,74286] 0 2024-09-06T14:44:31.151 INFO:tasks.workunit.client.1.smithi165.stdout:0/533: creat d15/d19/d2c/fb5 x:0 0 0 2024-09-06T14:44:31.151 INFO:tasks.workunit.client.1.smithi165.stdout:5/626: mknod d6/d1c/d28/d4b/da7/ce6 0 2024-09-06T14:44:31.152 INFO:tasks.workunit.client.1.smithi165.stdout:8/569: chown d0/d14/d3e/l8d 803617259 1 2024-09-06T14:44:31.153 INFO:tasks.workunit.client.1.smithi165.stdout:2/498: mknod d9/c9f 0 2024-09-06T14:44:31.154 INFO:tasks.workunit.client.1.smithi165.stdout:0/534: unlink d15/d19/d28/d4f/d52/f6a 0 2024-09-06T14:44:31.154 INFO:tasks.workunit.client.1.smithi165.stdout:6/593: getdents d29/d6a/d83 0 2024-09-06T14:44:31.155 INFO:tasks.workunit.client.1.smithi165.stdout:5/627: creat d6/d1c/d28/d2d/d61/ddc/fe7 x:0 0 0 2024-09-06T14:44:31.155 INFO:tasks.workunit.client.1.smithi165.stdout:6/594: chown d29/d39/d5b/d68/f91 1548326 1 2024-09-06T14:44:31.155 INFO:tasks.workunit.client.1.smithi165.stdout:1/544: creat d0/d2a/d18/d24/d4b/d93/d2b/fb0 x:0 0 0 2024-09-06T14:44:31.156 INFO:tasks.workunit.client.1.smithi165.stdout:2/499: creat d9/d88/fa0 x:0 0 0 2024-09-06T14:44:31.157 INFO:tasks.workunit.client.1.smithi165.stdout:8/570: rename d0/d19/d24/f37 to d0/d9e/fc8 0 2024-09-06T14:44:31.158 INFO:tasks.workunit.client.1.smithi165.stdout:0/535: symlink d15/d19/d38/lb6 0 2024-09-06T14:44:31.158 INFO:tasks.workunit.client.1.smithi165.stdout:5/628: truncate d6/d1c/d28/d2d/d3c/d44/d90/ddf/fd2 809165 0 2024-09-06T14:44:31.158 INFO:tasks.workunit.client.1.smithi165.stdout:6/595: rmdir d29/d39 39 2024-09-06T14:44:31.159 INFO:tasks.workunit.client.1.smithi165.stdout:8/571: fsync d0/d19/d36/d2d/f75 0 2024-09-06T14:44:31.159 INFO:tasks.workunit.client.1.smithi165.stdout:1/545: mknod d0/d2a/d18/d24/d4b/d93/d6a/cb1 0 2024-09-06T14:44:31.159 INFO:tasks.workunit.client.1.smithi165.stdout:0/536: chown d15/d19/d50/d53/fb2 350 1 2024-09-06T14:44:31.161 INFO:tasks.workunit.client.1.smithi165.stdout:6/596: write d29/d39/d5b/d62/d67/f8e [659170,105470] 0 2024-09-06T14:44:31.162 INFO:tasks.workunit.client.1.smithi165.stdout:5/629: mkdir d6/d1c/d28/d2d/d3c/d44/d82/de8 0 2024-09-06T14:44:31.162 INFO:tasks.workunit.client.1.smithi165.stdout:1/546: write d0/d2a/d18/d24/d4b/d93/d97/faa [4214,60523] 0 2024-09-06T14:44:31.164 INFO:tasks.workunit.client.1.smithi165.stdout:6/597: mknod d29/d39/d5b/d62/d9f/cb2 0 2024-09-06T14:44:31.166 INFO:tasks.workunit.client.1.smithi165.stdout:5/630: mkdir d6/d1c/d28/d2d/d49/de9 0 2024-09-06T14:44:31.168 INFO:tasks.workunit.client.1.smithi165.stdout:0/537: dwrite d15/d19/d28/d9e/da3/fb1 [0,4194304] 0 2024-09-06T14:44:31.175 INFO:tasks.workunit.client.1.smithi165.stdout:1/547: dwrite d0/d2a/d18/d24/d4b/d93/d2b/f4a [0,4194304] 0 2024-09-06T14:44:31.175 INFO:tasks.workunit.client.1.smithi165.stdout:0/538: chown d15/d19/l34 1458335 1 2024-09-06T14:44:31.180 INFO:tasks.workunit.client.1.smithi165.stdout:1/548: chown d0/d2a/d18/d24/d4b/d95 46 1 2024-09-06T14:44:31.182 INFO:tasks.workunit.client.1.smithi165.stdout:0/539: write d15/d19/d28/d3a/d3f/f6f [291529,31885] 0 2024-09-06T14:44:31.183 INFO:tasks.workunit.client.1.smithi165.stdout:5/631: dwrite d6/d1c/d28/d4b/d55/d8a/fe4 [0,4194304] 0 2024-09-06T14:44:31.185 INFO:tasks.workunit.client.1.smithi165.stdout:0/540: stat le 0 2024-09-06T14:44:31.186 INFO:tasks.workunit.client.1.smithi165.stdout:8/572: dwrite d0/f2f [0,4194304] 0 2024-09-06T14:44:31.187 INFO:tasks.workunit.client.1.smithi165.stdout:1/549: creat d0/d1c/d1d/fb2 x:0 0 0 2024-09-06T14:44:31.194 INFO:tasks.workunit.client.1.smithi165.stdout:8/573: write d0/d19/d24/d26/f76 [849020,108233] 0 2024-09-06T14:44:31.195 INFO:tasks.workunit.client.1.smithi165.stdout:0/541: creat d15/d19/d28/d3a/d5d/fb7 x:0 0 0 2024-09-06T14:44:31.195 INFO:tasks.workunit.client.1.smithi165.stdout:6/598: dwrite d29/d93/f6e [0,4194304] 0 2024-09-06T14:44:31.198 INFO:tasks.workunit.client.1.smithi165.stdout:5/632: rename d6/dc1/ddb to d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea 0 2024-09-06T14:44:31.201 INFO:tasks.workunit.client.1.smithi165.stdout:1/550: getdents d0/d2a/d23 0 2024-09-06T14:44:31.203 INFO:tasks.workunit.client.1.smithi165.stdout:6/599: truncate d29/f47 1007938 0 2024-09-06T14:44:31.205 INFO:tasks.workunit.client.1.smithi165.stdout:5/633: readlink d6/d1c/d28/d4b/da7/dab/lcc 0 2024-09-06T14:44:31.208 INFO:tasks.workunit.client.1.smithi165.stdout:0/542: dwrite d15/d19/d28/d3a/f9f [0,4194304] 0 2024-09-06T14:44:31.209 INFO:tasks.workunit.client.1.smithi165.stdout:8/574: dwrite d0/d14/fac [0,4194304] 0 2024-09-06T14:44:31.215 INFO:tasks.workunit.client.1.smithi165.stdout:7/449: sync 2024-09-06T14:44:31.216 INFO:tasks.workunit.client.1.smithi165.stdout:0/543: write d15/d19/d28/f71 [432004,98737] 0 2024-09-06T14:44:31.227 INFO:tasks.workunit.client.1.smithi165.stdout:7/450: dwrite d20/d3b/d69/d88/d80/f8d [0,4194304] 0 2024-09-06T14:44:31.227 INFO:tasks.workunit.client.1.smithi165.stdout:0/544: dwrite d15/d19/d28/d3a/f86 [0,4194304] 0 2024-09-06T14:44:31.229 INFO:tasks.workunit.client.1.smithi165.stdout:0/545: dread - d15/d19/d50/d53/f7e zero size 2024-09-06T14:44:31.232 INFO:tasks.workunit.client.1.smithi165.stdout:0/546: unlink d15/d19/d28/d3a/d3f/f54 0 2024-09-06T14:44:31.233 INFO:tasks.workunit.client.1.smithi165.stdout:0/547: truncate d15/d19/d28/f71 1048584 0 2024-09-06T14:44:31.237 INFO:tasks.workunit.client.1.smithi165.stdout:1/551: truncate d0/d2a/d18/d24/d4b/d93/d2b/f4a 1004370 0 2024-09-06T14:44:31.238 INFO:tasks.workunit.client.1.smithi165.stdout:1/552: chown d0/d2a/d18/d24 2950916 1 2024-09-06T14:44:31.238 INFO:tasks.workunit.client.1.smithi165.stdout:6/600: dread f5 [0,4194304] 0 2024-09-06T14:44:31.240 INFO:tasks.workunit.client.1.smithi165.stdout:6/601: mkdir d29/d39/d5b/d68/db3 0 2024-09-06T14:44:31.240 INFO:tasks.workunit.client.1.smithi165.stdout:1/553: mknod d0/d2a/d18/d24/cb3 0 2024-09-06T14:44:31.241 INFO:tasks.workunit.client.1.smithi165.stdout:6/602: fsync d29/d39/d5b/d62/f65 0 2024-09-06T14:44:31.243 INFO:tasks.workunit.client.1.smithi165.stdout:1/554: creat d0/d2a/d18/d24/d4b/d93/d2b/fb4 x:0 0 0 2024-09-06T14:44:31.244 INFO:tasks.workunit.client.1.smithi165.stdout:8/575: truncate d0/d19/d36/d28/d53/fa1 2234505 0 2024-09-06T14:44:31.244 INFO:tasks.workunit.client.1.smithi165.stdout:1/555: write d0/d2a/d18/d24/d4b/d93/d68/fa3 [429937,127372] 0 2024-09-06T14:44:31.245 INFO:tasks.workunit.client.1.smithi165.stdout:6/603: creat d29/d39/d5b/d62/d67/fb4 x:0 0 0 2024-09-06T14:44:31.245 INFO:tasks.workunit.client.1.smithi165.stdout:1/556: readlink d0/d2a/l15 0 2024-09-06T14:44:31.255 INFO:tasks.workunit.client.1.smithi165.stdout:1/557: dwrite d0/d1c/d41/f9f [0,4194304] 0 2024-09-06T14:44:31.261 INFO:tasks.workunit.client.1.smithi165.stdout:8/576: dread d0/d5e/d65/f9f [0,4194304] 0 2024-09-06T14:44:31.262 INFO:tasks.workunit.client.1.smithi165.stdout:1/558: dwrite d0/d2a/d18/d24/d4b/f51 [0,4194304] 0 2024-09-06T14:44:31.264 INFO:tasks.workunit.client.1.smithi165.stdout:1/559: chown d0/d2a/d18/da0 30771 1 2024-09-06T14:44:31.270 INFO:tasks.workunit.client.1.smithi165.stdout:8/577: dwrite d0/d19/d36/d2d/d3f/d93/fa6 [0,4194304] 0 2024-09-06T14:44:31.272 INFO:tasks.workunit.client.1.smithi165.stdout:1/560: dwrite d0/d2a/d18/d24/d4b/d5f/f61 [0,4194304] 0 2024-09-06T14:44:31.285 INFO:tasks.workunit.client.1.smithi165.stdout:1/561: dwrite d0/d1c/d1d/d22/f4c [0,4194304] 0 2024-09-06T14:44:31.285 INFO:tasks.workunit.client.1.smithi165.stdout:8/578: fdatasync d0/d19/d36/d28/d53/fa1 0 2024-09-06T14:44:31.285 INFO:tasks.workunit.client.1.smithi165.stdout:8/579: read - d0/d19/d36/d2d/f72 zero size 2024-09-06T14:44:31.287 INFO:tasks.workunit.client.1.smithi165.stdout:8/580: chown d0/d14/c39 81453 1 2024-09-06T14:44:31.295 INFO:tasks.workunit.client.1.smithi165.stdout:8/581: dwrite d0/d19/d36/d2d/d33/d3a/d46/f7e [4194304,4194304] 0 2024-09-06T14:44:31.302 INFO:tasks.workunit.client.1.smithi165.stdout:8/582: mkdir d0/d19/d36/d2d/dc9 0 2024-09-06T14:44:31.312 INFO:tasks.workunit.client.1.smithi165.stdout:3/543: sync 2024-09-06T14:44:31.312 INFO:tasks.workunit.client.1.smithi165.stdout:4/548: sync 2024-09-06T14:44:31.314 INFO:tasks.workunit.client.1.smithi165.stdout:4/549: write d5/d1b/d1c/f6b [1042317,82148] 0 2024-09-06T14:44:31.314 INFO:tasks.workunit.client.1.smithi165.stdout:8/583: dwrite d0/d19/d36/d2d/f72 [0,4194304] 0 2024-09-06T14:44:31.319 INFO:tasks.workunit.client.1.smithi165.stdout:4/550: truncate d5/d1b/d1c/d41/f99 280590 0 2024-09-06T14:44:31.321 INFO:tasks.workunit.client.1.smithi165.stdout:4/551: read - d5/d1b/d1c/d8c/fad zero size 2024-09-06T14:44:31.323 INFO:tasks.workunit.client.1.smithi165.stdout:3/544: creat d1/da/dd/fb8 x:0 0 0 2024-09-06T14:44:31.327 INFO:tasks.workunit.client.1.smithi165.stdout:3/545: chown d1/da/dc/d5d 415 1 2024-09-06T14:44:31.329 INFO:tasks.workunit.client.1.smithi165.stdout:8/584: dwrite d0/d5e/d65/f99 [0,4194304] 0 2024-09-06T14:44:31.329 INFO:tasks.workunit.client.1.smithi165.stdout:2/500: dread d9/d25/d45/d75/d67/d76/f6a [0,4194304] 0 2024-09-06T14:44:31.330 INFO:tasks.workunit.client.1.smithi165.stdout:8/585: stat d0/d34/c48 0 2024-09-06T14:44:31.330 INFO:tasks.workunit.client.1.smithi165.stdout:3/546: write d1/da/dc/d10/faa [934125,90546] 0 2024-09-06T14:44:31.334 INFO:tasks.workunit.client.1.smithi165.stdout:3/547: truncate d1/da/f26 4294716 0 2024-09-06T14:44:31.335 INFO:tasks.workunit.client.1.smithi165.stdout:2/501: mknod d9/d25/d46/d7e/ca1 0 2024-09-06T14:44:31.336 INFO:tasks.workunit.client.1.smithi165.stdout:2/502: chown d9/d25/d45/d75/d67/f92 399 1 2024-09-06T14:44:31.384 INFO:tasks.workunit.client.1.smithi165.stdout:3/548: rmdir d1/da/dc/d5d/d89 39 2024-09-06T14:44:31.385 INFO:tasks.workunit.client.1.smithi165.stdout:2/503: rmdir d9/d25/d46/d7e 39 2024-09-06T14:44:31.389 INFO:tasks.workunit.client.1.smithi165.stdout:2/504: stat d9/d3b/l85 0 2024-09-06T14:44:31.389 INFO:tasks.workunit.client.1.smithi165.stdout:3/549: mknod d1/da/dd/d4b/cb9 0 2024-09-06T14:44:31.389 INFO:tasks.workunit.client.1.smithi165.stdout:7/451: sync 2024-09-06T14:44:31.389 INFO:tasks.workunit.client.1.smithi165.stdout:7/452: fdatasync d20/d3b/f86 0 2024-09-06T14:44:31.389 INFO:tasks.workunit.client.1.smithi165.stdout:9/694: dread db/de/d15/d17/f45 [4194304,4194304] 0 2024-09-06T14:44:31.390 INFO:tasks.workunit.client.1.smithi165.stdout:7/453: write d20/d3b/f86 [803147,33636] 0 2024-09-06T14:44:31.394 INFO:tasks.workunit.client.1.smithi165.stdout:5/634: dread d6/d1c/d28/d4b/d55/f6f [0,4194304] 0 2024-09-06T14:44:31.394 INFO:tasks.workunit.client.1.smithi165.stdout:4/552: dread d5/d1b/d1c/d20/f27 [0,4194304] 0 2024-09-06T14:44:31.396 INFO:tasks.workunit.client.1.smithi165.stdout:2/505: truncate d9/d25/f40 26783 0 2024-09-06T14:44:31.397 INFO:tasks.workunit.client.1.smithi165.stdout:7/454: write d20/d33/f52 [1505467,113802] 0 2024-09-06T14:44:31.399 INFO:tasks.workunit.client.1.smithi165.stdout:5/635: stat d6/d1c/d28/d2d/d49/l4d 0 2024-09-06T14:44:31.399 INFO:tasks.workunit.client.1.smithi165.stdout:7/455: readlink ld 0 2024-09-06T14:44:31.400 INFO:tasks.workunit.client.1.smithi165.stdout:3/550: dwrite d1/da/f8e [0,4194304] 0 2024-09-06T14:44:31.400 INFO:tasks.workunit.client.1.smithi165.stdout:4/553: mknod d5/d1b/d61/cbb 0 2024-09-06T14:44:31.403 INFO:tasks.workunit.client.1.smithi165.stdout:5/636: write d6/f27 [2552716,21102] 0 2024-09-06T14:44:31.404 INFO:tasks.workunit.client.1.smithi165.stdout:4/554: write d5/d1b/d66/f7f [594577,41998] 0 2024-09-06T14:44:31.407 INFO:tasks.workunit.client.1.smithi165.stdout:8/586: dread d0/d34/d6b/d94/d70/f88 [0,4194304] 0 2024-09-06T14:44:31.407 INFO:tasks.workunit.client.1.smithi165.stdout:9/695: dwrite db/de/d15/d17/dad/fbb [0,4194304] 0 2024-09-06T14:44:31.408 INFO:tasks.workunit.client.1.smithi165.stdout:1/562: sync 2024-09-06T14:44:31.408 INFO:tasks.workunit.client.1.smithi165.stdout:6/604: sync 2024-09-06T14:44:31.408 INFO:tasks.workunit.client.1.smithi165.stdout:0/548: sync 2024-09-06T14:44:31.410 INFO:tasks.workunit.client.1.smithi165.stdout:2/506: getdents d9/d3b 0 2024-09-06T14:44:31.411 INFO:tasks.workunit.client.1.smithi165.stdout:3/551: dread d1/da/dd/d4b/f74 [0,4194304] 0 2024-09-06T14:44:31.411 INFO:tasks.workunit.client.1.smithi165.stdout:5/637: creat d6/d1c/d28/d4b/feb x:0 0 0 2024-09-06T14:44:31.414 INFO:tasks.workunit.client.1.smithi165.stdout:6/605: creat d29/d32/fb5 x:0 0 0 2024-09-06T14:44:31.415 INFO:tasks.workunit.client.1.smithi165.stdout:1/563: symlink d0/d2a/d18/d24/d4b/d93/d68/lb5 0 2024-09-06T14:44:31.416 INFO:tasks.workunit.client.1.smithi165.stdout:7/456: link d20/d3b/d69/d88/l5b d20/d65/l8e 0 2024-09-06T14:44:31.417 INFO:tasks.workunit.client.1.smithi165.stdout:2/507: creat d9/d25/d45/d75/d67/d76/fa2 x:0 0 0 2024-09-06T14:44:31.418 INFO:tasks.workunit.client.1.smithi165.stdout:3/552: creat d1/da/dc/d3b/d83/fba x:0 0 0 2024-09-06T14:44:31.418 INFO:tasks.workunit.client.1.smithi165.stdout:8/587: rmdir d0/d14/d3e/daa 0 2024-09-06T14:44:31.420 INFO:tasks.workunit.client.1.smithi165.stdout:0/549: rename d15/d19/d38/l99 to d15/d19/d50/d53/d7c/dae/lb8 0 2024-09-06T14:44:31.421 INFO:tasks.workunit.client.1.smithi165.stdout:1/564: fsync d0/d2a/f16 0 2024-09-06T14:44:31.422 INFO:tasks.workunit.client.1.smithi165.stdout:3/553: symlink d1/d19/d92/lbb 0 2024-09-06T14:44:31.422 INFO:tasks.workunit.client.1.smithi165.stdout:9/696: truncate db/de/d15/d17/d18/d7d/fae 823348 0 2024-09-06T14:44:31.423 INFO:tasks.workunit.client.1.smithi165.stdout:2/508: write d9/d25/d45/d75/d34/f43 [1126226,69630] 0 2024-09-06T14:44:31.423 INFO:tasks.workunit.client.1.smithi165.stdout:8/588: write d0/d34/d6b/d94/f7c [178700,34686] 0 2024-09-06T14:44:31.426 INFO:tasks.workunit.client.1.smithi165.stdout:8/589: fsync d0/f1a 0 2024-09-06T14:44:31.428 INFO:tasks.workunit.client.1.smithi165.stdout:1/565: mknod d0/d2a/d18/d24/d4b/d93/d2b/cb6 0 2024-09-06T14:44:31.428 INFO:tasks.workunit.client.1.smithi165.stdout:2/509: chown d9/d88/fa0 222122 1 2024-09-06T14:44:31.429 INFO:tasks.workunit.client.1.smithi165.stdout:5/638: dread d6/d1c/f68 [0,4194304] 0 2024-09-06T14:44:31.430 INFO:tasks.workunit.client.1.smithi165.stdout:6/606: dwrite d29/d39/d5b/d62/fa3 [0,4194304] 0 2024-09-06T14:44:31.431 INFO:tasks.workunit.client.1.smithi165.stdout:3/554: getdents d1/da/dd/d4b 0 2024-09-06T14:44:31.433 INFO:tasks.workunit.client.1.smithi165.stdout:5/639: read d6/f11 [561748,24138] 0 2024-09-06T14:44:31.434 INFO:tasks.workunit.client.1.smithi165.stdout:8/590: creat d0/d19/dc6/fca x:0 0 0 2024-09-06T14:44:31.435 INFO:tasks.workunit.client.1.smithi165.stdout:8/591: write d0/d19/d24/fbb [3918913,92591] 0 2024-09-06T14:44:31.438 INFO:tasks.workunit.client.1.smithi165.stdout:6/607: creat d29/d32/d7a/fb6 x:0 0 0 2024-09-06T14:44:31.440 INFO:tasks.workunit.client.1.smithi165.stdout:9/697: rename db/de/d15/d17/d86/cbd to db/de/d15/d17/d18/cde 0 2024-09-06T14:44:31.442 INFO:tasks.workunit.client.1.smithi165.stdout:5/640: chown d6/d1c/d28/d4b/da7/lce 0 1 2024-09-06T14:44:31.443 INFO:tasks.workunit.client.1.smithi165.stdout:9/698: truncate db/de/d15/d17/dad/d97/fa6 1287970 0 2024-09-06T14:44:31.443 INFO:tasks.workunit.client.1.smithi165.stdout:5/641: fsync d6/d98/fa6 0 2024-09-06T14:44:31.443 INFO:tasks.workunit.client.1.smithi165.stdout:4/555: truncate d5/d1b/d1c/d55/f68 3397813 0 2024-09-06T14:44:31.445 INFO:tasks.workunit.client.1.smithi165.stdout:2/510: creat d9/d25/fa3 x:0 0 0 2024-09-06T14:44:31.446 INFO:tasks.workunit.client.1.smithi165.stdout:9/699: readlink l3 0 2024-09-06T14:44:31.447 INFO:tasks.workunit.client.1.smithi165.stdout:4/556: symlink d5/d1b/d61/d77/d7c/daa/lbc 0 2024-09-06T14:44:31.450 INFO:tasks.workunit.client.1.smithi165.stdout:1/566: getdents d0/d2a/d18 0 2024-09-06T14:44:31.450 INFO:tasks.workunit.client.1.smithi165.stdout:2/511: mkdir d9/d25/d45/d69/da4 0 2024-09-06T14:44:31.451 INFO:tasks.workunit.client.1.smithi165.stdout:9/700: write db/de/d15/d7f/fcc [732166,37443] 0 2024-09-06T14:44:31.452 INFO:tasks.workunit.client.1.smithi165.stdout:0/550: dread d15/d19/d28/f67 [0,4194304] 0 2024-09-06T14:44:31.453 INFO:tasks.workunit.client.1.smithi165.stdout:5/642: dwrite d6/d1c/d28/d4b/d55/fca [0,4194304] 0 2024-09-06T14:44:31.456 INFO:tasks.workunit.client.1.smithi165.stdout:2/512: mkdir d9/d25/d45/d75/da5 0 2024-09-06T14:44:31.457 INFO:tasks.workunit.client.1.smithi165.stdout:0/551: mkdir d15/db9 0 2024-09-06T14:44:31.459 INFO:tasks.workunit.client.1.smithi165.stdout:9/701: unlink db/de/d15/d17/d18/l39 0 2024-09-06T14:44:31.461 INFO:tasks.workunit.client.1.smithi165.stdout:1/567: creat d0/d2a/d18/d24/d4b/d93/d2b/d3e/fb7 x:0 0 0 2024-09-06T14:44:31.461 INFO:tasks.workunit.client.1.smithi165.stdout:8/592: truncate d0/d34/d6b/d94/f5f 1123616 0 2024-09-06T14:44:31.461 INFO:tasks.workunit.client.1.smithi165.stdout:4/557: dwrite d5/d1b/d1c/d20/d26/f88 [0,4194304] 0 2024-09-06T14:44:31.463 INFO:tasks.workunit.client.1.smithi165.stdout:0/552: mknod d15/d6e/cba 0 2024-09-06T14:44:31.467 INFO:tasks.workunit.client.1.smithi165.stdout:5/643: rename d6/d1c/d28/d2d/lbb to d6/d1c/d28/d2d/d3c/d81/lec 0 2024-09-06T14:44:31.468 INFO:tasks.workunit.client.1.smithi165.stdout:0/553: mkdir d15/d19/d50/d53/d7c/dbb 0 2024-09-06T14:44:31.474 INFO:tasks.workunit.client.1.smithi165.stdout:2/513: rename d9/d25/d45/d75/d67/c8b to d9/d23/d29/d48/ca6 0 2024-09-06T14:44:31.475 INFO:tasks.workunit.client.1.smithi165.stdout:4/558: dwrite d5/d1b/d1c/d55/f8f [0,4194304] 0 2024-09-06T14:44:31.478 INFO:tasks.workunit.client.1.smithi165.stdout:8/593: dwrite d0/d34/d6b/d94/d70/f88 [0,4194304] 0 2024-09-06T14:44:31.480 INFO:tasks.workunit.client.1.smithi165.stdout:9/702: rename db/de/d15/d17/dad/d97 to db/de/d15/d7f/dbc/ddf 0 2024-09-06T14:44:31.481 INFO:tasks.workunit.client.1.smithi165.stdout:4/559: write d5/d1b/d1c/d8c/fa3 [368977,50640] 0 2024-09-06T14:44:31.482 INFO:tasks.workunit.client.1.smithi165.stdout:5/644: read d6/d1c/f38 [104246,27785] 0 2024-09-06T14:44:31.483 INFO:tasks.workunit.client.1.smithi165.stdout:2/514: creat d9/d23/d29/fa7 x:0 0 0 2024-09-06T14:44:31.483 INFO:tasks.workunit.client.1.smithi165.stdout:1/568: truncate d0/d2a/d23/d56/f71 2430075 0 2024-09-06T14:44:31.485 INFO:tasks.workunit.client.1.smithi165.stdout:0/554: dwrite d15/d19/d66/f95 [0,4194304] 0 2024-09-06T14:44:31.486 INFO:tasks.workunit.client.1.smithi165.stdout:4/560: write d5/f86 [868298,117833] 0 2024-09-06T14:44:31.487 INFO:tasks.workunit.client.1.smithi165.stdout:5/645: rmdir d6/dc1 39 2024-09-06T14:44:31.489 INFO:tasks.workunit.client.1.smithi165.stdout:2/515: readlink d9/d25/d45/d75/d67/d76/l7d 0 2024-09-06T14:44:31.491 INFO:tasks.workunit.client.1.smithi165.stdout:5/646: readlink d6/lb 0 2024-09-06T14:44:31.495 INFO:tasks.workunit.client.1.smithi165.stdout:4/561: stat d5/d1b/d1c/d20/d75/d83/dae 0 2024-09-06T14:44:31.496 INFO:tasks.workunit.client.1.smithi165.stdout:1/569: mkdir d0/d2a/d18/d24/d4b/d5f/db8 0 2024-09-06T14:44:31.497 INFO:tasks.workunit.client.1.smithi165.stdout:8/594: dwrite d0/d19/dc6/fca [0,4194304] 0 2024-09-06T14:44:31.498 INFO:tasks.workunit.client.1.smithi165.stdout:9/703: link db/de/d15/fbe db/de/d15/d7f/fe0 0 2024-09-06T14:44:31.498 INFO:tasks.workunit.client.1.smithi165.stdout:2/516: unlink d9/d25/d45/d69/f82 0 2024-09-06T14:44:31.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/562: read d5/f8a [2779666,69806] 0 2024-09-06T14:44:31.502 INFO:tasks.workunit.client.1.smithi165.stdout:5/647: symlink d6/d1c/d28/d4b/d55/d8a/dda/led 0 2024-09-06T14:44:31.504 INFO:tasks.workunit.client.1.smithi165.stdout:1/570: write d0/d2a/d18/d24/d4b/d93/d2b/fad [468531,87535] 0 2024-09-06T14:44:31.505 INFO:tasks.workunit.client.1.smithi165.stdout:9/704: symlink db/de/d15/d17/d18/d59/le1 0 2024-09-06T14:44:31.506 INFO:tasks.workunit.client.1.smithi165.stdout:1/571: readlink d0/d2a/d18/d24/l84 0 2024-09-06T14:44:31.507 INFO:tasks.workunit.client.1.smithi165.stdout:8/595: mknod d0/d19/d36/d2d/d33/d3a/d46/db3/ccb 0 2024-09-06T14:44:31.508 INFO:tasks.workunit.client.1.smithi165.stdout:2/517: rename d9/d25/d45/d75/d34/f97 to d9/d25/d45/d69/da4/fa8 0 2024-09-06T14:44:31.510 INFO:tasks.workunit.client.1.smithi165.stdout:8/596: dread d0/d19/d36/d28/f78 [0,4194304] 0 2024-09-06T14:44:31.513 INFO:tasks.workunit.client.1.smithi165.stdout:5/648: dwrite d6/d1c/f3d [0,4194304] 0 2024-09-06T14:44:31.513 INFO:tasks.workunit.client.1.smithi165.stdout:2/518: creat d9/d23/d52/fa9 x:0 0 0 2024-09-06T14:44:31.518 INFO:tasks.workunit.client.1.smithi165.stdout:5/649: unlink d6/d1c/d28/d2d/d3c/d44/fd5 0 2024-09-06T14:44:31.520 INFO:tasks.workunit.client.1.smithi165.stdout:9/705: dwrite db/de/d15/d7f/fe0 [0,4194304] 0 2024-09-06T14:44:31.522 INFO:tasks.workunit.client.1.smithi165.stdout:5/650: stat d6/d1c/d28/d2d/d3c/l5d 0 2024-09-06T14:44:31.523 INFO:tasks.workunit.client.1.smithi165.stdout:9/706: dread - db/de/d15/d17/dad/f95 zero size 2024-09-06T14:44:31.524 INFO:tasks.workunit.client.1.smithi165.stdout:8/597: fdatasync d0/d19/dc6/fca 0 2024-09-06T14:44:31.526 INFO:tasks.workunit.client.1.smithi165.stdout:5/651: chown d6/dc1/fe2 22803 1 2024-09-06T14:44:31.526 INFO:tasks.workunit.client.1.smithi165.stdout:9/707: fsync db/de/d15/d17/d18/d59/d64/fd1 0 2024-09-06T14:44:31.528 INFO:tasks.workunit.client.1.smithi165.stdout:8/598: symlink d0/d5e/d65/lcc 0 2024-09-06T14:44:31.530 INFO:tasks.workunit.client.1.smithi165.stdout:8/599: fsync d0/f1a 0 2024-09-06T14:44:31.530 INFO:tasks.workunit.client.1.smithi165.stdout:4/563: truncate d5/d1b/d1c/d20/d75/d83/f4d 2775238 0 2024-09-06T14:44:31.531 INFO:tasks.workunit.client.1.smithi165.stdout:0/555: dread d15/d19/d28/d3a/d3f/f48 [0,4194304] 0 2024-09-06T14:44:31.533 INFO:tasks.workunit.client.1.smithi165.stdout:0/556: fdatasync f3 0 2024-09-06T14:44:31.534 INFO:tasks.workunit.client.1.smithi165.stdout:8/600: chown d0/d19/d36/d28/fc2 3 1 2024-09-06T14:44:31.536 INFO:tasks.workunit.client.1.smithi165.stdout:7/457: sync 2024-09-06T14:44:31.536 INFO:tasks.workunit.client.1.smithi165.stdout:4/564: write d5/d1b/d61/f9d [379354,126806] 0 2024-09-06T14:44:31.539 INFO:tasks.workunit.client.1.smithi165.stdout:5/652: dwrite d6/d1c/d28/d2d/d61/ddc/fdd [0,4194304] 0 2024-09-06T14:44:31.539 INFO:tasks.workunit.client.1.smithi165.stdout:8/601: mkdir d0/d19/d36/d2d/d33/d3a/d46/dcd 0 2024-09-06T14:44:31.540 INFO:tasks.workunit.client.1.smithi165.stdout:4/565: write d5/f8a [1552456,16562] 0 2024-09-06T14:44:31.545 INFO:tasks.workunit.client.1.smithi165.stdout:4/566: chown d5/d1b/l4a 365829 1 2024-09-06T14:44:31.546 INFO:tasks.workunit.client.1.smithi165.stdout:5/653: mknod d6/d1c/d28/d2d/d61/cee 0 2024-09-06T14:44:31.549 INFO:tasks.workunit.client.1.smithi165.stdout:8/602: dread d0/d19/d36/d2d/d33/d3a/fb0 [0,4194304] 0 2024-09-06T14:44:31.551 INFO:tasks.workunit.client.1.smithi165.stdout:7/458: link d20/d3b/d69/d88/l5b d20/d3b/d69/l8f 0 2024-09-06T14:44:31.553 INFO:tasks.workunit.client.1.smithi165.stdout:4/567: mkdir d5/d1b/d61/d77/dbd 0 2024-09-06T14:44:31.554 INFO:tasks.workunit.client.1.smithi165.stdout:8/603: stat d0/d19/c5c 0 2024-09-06T14:44:31.555 INFO:tasks.workunit.client.1.smithi165.stdout:4/568: rmdir d5/d1b/d1c/d55 39 2024-09-06T14:44:31.556 INFO:tasks.workunit.client.1.smithi165.stdout:8/604: read d0/d19/d36/f7 [2527342,11070] 0 2024-09-06T14:44:31.556 INFO:tasks.workunit.client.1.smithi165.stdout:5/654: dwrite d6/d1c/d28/d4b/d55/fca [0,4194304] 0 2024-09-06T14:44:31.560 INFO:tasks.workunit.client.1.smithi165.stdout:1/572: dread d0/f10 [0,4194304] 0 2024-09-06T14:44:31.562 INFO:tasks.workunit.client.1.smithi165.stdout:8/605: fsync d0/d34/d6b/d94/d70/fc0 0 2024-09-06T14:44:31.566 INFO:tasks.workunit.client.1.smithi165.stdout:1/573: mknod d0/d2a/d18/d24/d4b/d93/d68/cb9 0 2024-09-06T14:44:31.567 INFO:tasks.workunit.client.1.smithi165.stdout:0/557: dwrite d15/d19/f46 [0,4194304] 0 2024-09-06T14:44:31.569 INFO:tasks.workunit.client.1.smithi165.stdout:5/655: getdents d6/d1c/d28 0 2024-09-06T14:44:31.570 INFO:tasks.workunit.client.1.smithi165.stdout:1/574: creat d0/fba x:0 0 0 2024-09-06T14:44:31.571 INFO:tasks.workunit.client.1.smithi165.stdout:0/558: readlink d15/d19/l22 0 2024-09-06T14:44:31.571 INFO:tasks.workunit.client.1.smithi165.stdout:4/569: link d5/d1b/d1c/d20/d75/d83/ca5 d5/d1b/d1c/d20/cbe 0 2024-09-06T14:44:31.572 INFO:tasks.workunit.client.1.smithi165.stdout:8/606: symlink d0/d19/d36/d2d/d3f/daf/lce 0 2024-09-06T14:44:31.572 INFO:tasks.workunit.client.1.smithi165.stdout:4/570: chown d5/d1b/d1c/c29 5 1 2024-09-06T14:44:31.573 INFO:tasks.workunit.client.1.smithi165.stdout:4/571: stat d5/d1b/d1c/d41/f44 0 2024-09-06T14:44:31.575 INFO:tasks.workunit.client.1.smithi165.stdout:1/575: creat d0/d2a/d18/d24/d4b/d93/d68/dae/fbb x:0 0 0 2024-09-06T14:44:31.575 INFO:tasks.workunit.client.1.smithi165.stdout:5/656: read d6/d1c/f22 [317308,10827] 0 2024-09-06T14:44:31.576 INFO:tasks.workunit.client.1.smithi165.stdout:7/459: dread d20/d33/d53/f67 [0,4194304] 0 2024-09-06T14:44:31.576 INFO:tasks.workunit.client.1.smithi165.stdout:4/572: symlink d5/d1b/d66/lbf 0 2024-09-06T14:44:31.578 INFO:tasks.workunit.client.1.smithi165.stdout:7/460: fsync d20/f2b 0 2024-09-06T14:44:31.581 INFO:tasks.workunit.client.1.smithi165.stdout:7/461: mkdir d20/d33/d6a/d90 0 2024-09-06T14:44:31.582 INFO:tasks.workunit.client.1.smithi165.stdout:0/559: dwrite d15/d19/d38/f4c [4194304,4194304] 0 2024-09-06T14:44:31.584 INFO:tasks.workunit.client.1.smithi165.stdout:1/576: rename d0/d2a/d18/d24/d4b/d93/d2b/f70 to d0/d2a/d18/fbc 0 2024-09-06T14:44:31.588 INFO:tasks.workunit.client.1.smithi165.stdout:0/560: symlink d15/d19/d28/d9e/da3/lbc 0 2024-09-06T14:44:31.588 INFO:tasks.workunit.client.1.smithi165.stdout:0/561: chown d15/d6e 39634 1 2024-09-06T14:44:31.589 INFO:tasks.workunit.client.1.smithi165.stdout:0/562: chown d15/d19/d28/d51/d60/f74 7697 1 2024-09-06T14:44:31.591 INFO:tasks.workunit.client.1.smithi165.stdout:5/657: write d6/d1c/d28/d2d/d3c/d44/f47 [342808,31456] 0 2024-09-06T14:44:31.594 INFO:tasks.workunit.client.1.smithi165.stdout:0/563: getdents d15/d19/d50/d53/d8d 0 2024-09-06T14:44:31.595 INFO:tasks.workunit.client.1.smithi165.stdout:7/462: link l7 d20/d33/d6a/l91 0 2024-09-06T14:44:31.598 INFO:tasks.workunit.client.1.smithi165.stdout:4/573: truncate d5/d1b/d1c/fa4 1908255 0 2024-09-06T14:44:31.599 INFO:tasks.workunit.client.1.smithi165.stdout:5/658: dwrite d6/f13 [0,4194304] 0 2024-09-06T14:44:31.599 INFO:tasks.workunit.client.1.smithi165.stdout:1/577: truncate d0/d1c/d41/f5e 2838988 0 2024-09-06T14:44:31.604 INFO:tasks.workunit.client.1.smithi165.stdout:4/574: mknod d5/d1b/d1c/d20/d26/cc0 0 2024-09-06T14:44:31.604 INFO:tasks.workunit.client.1.smithi165.stdout:1/578: chown d0/f7 212559 1 2024-09-06T14:44:31.606 INFO:tasks.workunit.client.1.smithi165.stdout:0/564: dwrite d15/d19/f46 [0,4194304] 0 2024-09-06T14:44:31.607 INFO:tasks.workunit.client.1.smithi165.stdout:7/463: dwrite d20/d65/f61 [0,4194304] 0 2024-09-06T14:44:31.608 INFO:tasks.workunit.client.1.smithi165.stdout:7/464: truncate d20/d33/f8a 813449 0 2024-09-06T14:44:31.609 INFO:tasks.workunit.client.1.smithi165.stdout:5/659: rename d6/d1c/d28/d2d/d3c/l59 to d6/d1c/d28/d2d/d61/dde/lef 0 2024-09-06T14:44:31.610 INFO:tasks.workunit.client.1.smithi165.stdout:1/579: write d0/d2a/d18/d24/d4b/d93/d2b/f38 [730232,19903] 0 2024-09-06T14:44:31.610 INFO:tasks.workunit.client.1.smithi165.stdout:5/660: truncate d6/f19 4509905 0 2024-09-06T14:44:31.612 INFO:tasks.workunit.client.1.smithi165.stdout:1/580: fdatasync d0/d1c/d1d/d22/f39 0 2024-09-06T14:44:31.612 INFO:tasks.workunit.client.1.smithi165.stdout:0/565: creat d15/d19/d50/d53/d57/fbd x:0 0 0 2024-09-06T14:44:31.613 INFO:tasks.workunit.client.1.smithi165.stdout:0/566: read d15/d19/d38/fa2 [2837912,37441] 0 2024-09-06T14:44:31.614 INFO:tasks.workunit.client.1.smithi165.stdout:7/465: mknod d20/d3b/d69/d88/d30/d78/c92 0 2024-09-06T14:44:31.614 INFO:tasks.workunit.client.1.smithi165.stdout:7/466: stat d20/d33/d6a 0 2024-09-06T14:44:31.615 INFO:tasks.workunit.client.1.smithi165.stdout:7/467: chown d20 1890971 1 2024-09-06T14:44:31.617 INFO:tasks.workunit.client.1.smithi165.stdout:4/575: truncate d5/d1b/d1c/d20/d75/d83/f62 371834 0 2024-09-06T14:44:31.619 INFO:tasks.workunit.client.1.smithi165.stdout:7/468: mknod d20/d3b/c93 0 2024-09-06T14:44:31.621 INFO:tasks.workunit.client.1.smithi165.stdout:0/567: truncate d15/d19/f25 4705630 0 2024-09-06T14:44:31.621 INFO:tasks.workunit.client.1.smithi165.stdout:5/661: dread d6/d1c/d28/d4b/d55/fa9 [0,4194304] 0 2024-09-06T14:44:31.625 INFO:tasks.workunit.client.1.smithi165.stdout:4/576: dread d5/d1b/d1c/f4f [0,4194304] 0 2024-09-06T14:44:31.627 INFO:tasks.workunit.client.1.smithi165.stdout:4/577: write d5/f2c [2472548,70820] 0 2024-09-06T14:44:31.628 INFO:tasks.workunit.client.1.smithi165.stdout:7/469: link f1f d20/d3b/d69/d88/f94 0 2024-09-06T14:44:31.633 INFO:tasks.workunit.client.1.smithi165.stdout:5/662: link d6/d1c/d28/d4b/d55/d8a/fe4 d6/d1c/d28/d2d/d3c/d44/d82/ff0 0 2024-09-06T14:44:31.636 INFO:tasks.workunit.client.1.smithi165.stdout:4/578: mknod d5/d1b/d1c/cc1 0 2024-09-06T14:44:31.637 INFO:tasks.workunit.client.1.smithi165.stdout:5/663: mknod d6/d1c/d28/d4b/d55/cf1 0 2024-09-06T14:44:31.638 INFO:tasks.workunit.client.1.smithi165.stdout:7/470: creat d20/d3b/d69/d88/d80/d81/f95 x:0 0 0 2024-09-06T14:44:31.641 INFO:tasks.workunit.client.1.smithi165.stdout:7/471: dread - d20/d3b/d69/d88/d80/d81/f95 zero size 2024-09-06T14:44:31.641 INFO:tasks.workunit.client.1.smithi165.stdout:1/581: dread d0/d1c/d1d/d22/f39 [0,4194304] 0 2024-09-06T14:44:31.644 INFO:tasks.workunit.client.1.smithi165.stdout:5/664: dwrite d6/d1c/f74 [0,4194304] 0 2024-09-06T14:44:31.645 INFO:tasks.workunit.client.1.smithi165.stdout:4/579: link d5/f50 d5/d1b/d61/d77/d93/fc2 0 2024-09-06T14:44:31.646 INFO:tasks.workunit.client.1.smithi165.stdout:5/665: read - d6/d1c/d28/d2d/d61/fba zero size 2024-09-06T14:44:31.646 INFO:tasks.workunit.client.1.smithi165.stdout:0/568: write d15/d19/d38/fa0 [1273816,41872] 0 2024-09-06T14:44:31.648 INFO:tasks.workunit.client.1.smithi165.stdout:5/666: write d6/d1c/f39 [119670,54934] 0 2024-09-06T14:44:31.650 INFO:tasks.workunit.client.1.smithi165.stdout:7/472: symlink d20/d3b/d69/d88/d80/d81/l96 0 2024-09-06T14:44:31.651 INFO:tasks.workunit.client.1.smithi165.stdout:7/473: read - d20/d3b/d69/d88/d80/d81/f95 zero size 2024-09-06T14:44:31.651 INFO:tasks.workunit.client.1.smithi165.stdout:4/580: rename d5/d1b/d1c/d20/d75/lb2 to d5/db8/lc3 0 2024-09-06T14:44:31.652 INFO:tasks.workunit.client.1.smithi165.stdout:7/474: chown d20/d65/l3d 71 1 2024-09-06T14:44:31.653 INFO:tasks.workunit.client.1.smithi165.stdout:5/667: unlink d6/d1c/d28/d2d/d3c/ld4 0 2024-09-06T14:44:31.658 INFO:tasks.workunit.client.1.smithi165.stdout:7/475: dwrite d20/d3b/f3f [0,4194304] 0 2024-09-06T14:44:31.659 INFO:tasks.workunit.client.1.smithi165.stdout:7/476: write d20/d3b/f6d [379144,119884] 0 2024-09-06T14:44:31.659 INFO:tasks.workunit.client.1.smithi165.stdout:5/668: creat d6/d1c/d28/ff2 x:0 0 0 2024-09-06T14:44:31.660 INFO:tasks.workunit.client.1.smithi165.stdout:4/581: creat d5/d1b/d1c/d55/fc4 x:0 0 0 2024-09-06T14:44:31.661 INFO:tasks.workunit.client.1.smithi165.stdout:4/582: stat d5/d1b/f74 0 2024-09-06T14:44:31.662 INFO:tasks.workunit.client.1.smithi165.stdout:4/583: chown d5/l12 851 1 2024-09-06T14:44:31.662 INFO:tasks.workunit.client.1.smithi165.stdout:7/477: mkdir d20/d65/d82/d97 0 2024-09-06T14:44:31.663 INFO:tasks.workunit.client.1.smithi165.stdout:7/478: write f15 [1103609,13226] 0 2024-09-06T14:44:31.664 INFO:tasks.workunit.client.1.smithi165.stdout:4/584: truncate d5/d1b/d1c/f4f 740030 0 2024-09-06T14:44:31.666 INFO:tasks.workunit.client.1.smithi165.stdout:0/569: write d15/d19/f25 [1842114,45253] 0 2024-09-06T14:44:31.667 INFO:tasks.workunit.client.1.smithi165.stdout:4/585: mknod d5/d1b/d1c/d20/d26/cc5 0 2024-09-06T14:44:31.668 INFO:tasks.workunit.client.1.smithi165.stdout:7/479: creat d20/d65/d82/d97/f98 x:0 0 0 2024-09-06T14:44:31.671 INFO:tasks.workunit.client.1.smithi165.stdout:4/586: symlink d5/d1b/d1c/db0/lc6 0 2024-09-06T14:44:31.672 INFO:tasks.workunit.client.1.smithi165.stdout:4/587: fdatasync d5/d1b/d1c/f6c 0 2024-09-06T14:44:31.673 INFO:tasks.workunit.client.1.smithi165.stdout:4/588: dread - d5/d1b/d1c/d20/d26/f95 zero size 2024-09-06T14:44:31.675 INFO:tasks.workunit.client.1.smithi165.stdout:4/589: chown d5/d1b/d1c/d78/f92 50594 1 2024-09-06T14:44:31.675 INFO:tasks.workunit.client.1.smithi165.stdout:5/669: dread d6/d1c/f38 [0,4194304] 0 2024-09-06T14:44:31.675 INFO:tasks.workunit.client.1.smithi165.stdout:4/590: chown d5/d1b/d1c/f60 1 1 2024-09-06T14:44:31.676 INFO:tasks.workunit.client.1.smithi165.stdout:5/670: rename d6 to d6/d1c/d28/d2d/df3 22 2024-09-06T14:44:31.677 INFO:tasks.workunit.client.1.smithi165.stdout:5/671: stat d6/d1c/d28/d4b/d55/d8a/dda 0 2024-09-06T14:44:31.677 INFO:tasks.workunit.client.1.smithi165.stdout:4/591: creat d5/d1b/d1c/db0/fc7 x:0 0 0 2024-09-06T14:44:31.679 INFO:tasks.workunit.client.1.smithi165.stdout:4/592: mknod d5/d1b/cc8 0 2024-09-06T14:44:31.679 INFO:tasks.workunit.client.1.smithi165.stdout:0/570: truncate d15/d6e/f85 87904 0 2024-09-06T14:44:31.680 INFO:tasks.workunit.client.1.smithi165.stdout:7/480: truncate d20/d3b/d69/d88/d80/f8d 2651741 0 2024-09-06T14:44:31.681 INFO:tasks.workunit.client.1.smithi165.stdout:7/481: fdatasync d20/d65/f61 0 2024-09-06T14:44:31.682 INFO:tasks.workunit.client.1.smithi165.stdout:4/593: unlink d5/d1b/d1c/f9b 0 2024-09-06T14:44:31.683 INFO:tasks.workunit.client.1.smithi165.stdout:0/571: write d15/d19/d28/d4f/da7/fb0 [356710,109958] 0 2024-09-06T14:44:31.684 INFO:tasks.workunit.client.1.smithi165.stdout:5/672: dwrite d6/d1c/d28/d2d/f7e [0,4194304] 0 2024-09-06T14:44:31.685 INFO:tasks.workunit.client.1.smithi165.stdout:0/572: readlink d15/d19/d28/d9e/da3/lad 0 2024-09-06T14:44:31.686 INFO:tasks.workunit.client.1.smithi165.stdout:7/482: unlink d20/d40/f51 0 2024-09-06T14:44:31.689 INFO:tasks.workunit.client.1.smithi165.stdout:5/673: creat d6/dc1/ff4 x:0 0 0 2024-09-06T14:44:31.694 INFO:tasks.workunit.client.1.smithi165.stdout:5/674: readlink d6/d1c/d28/d2d/d3c/d44/l45 0 2024-09-06T14:44:31.696 INFO:tasks.workunit.client.1.smithi165.stdout:7/483: unlink d20/d33/l63 0 2024-09-06T14:44:31.697 INFO:tasks.workunit.client.1.smithi165.stdout:0/573: creat d15/fbe x:0 0 0 2024-09-06T14:44:31.699 INFO:tasks.workunit.client.1.smithi165.stdout:4/594: truncate d5/d1b/d61/f9d 707819 0 2024-09-06T14:44:31.701 INFO:tasks.workunit.client.1.smithi165.stdout:7/484: mknod d20/d3b/d69/d88/d30/c99 0 2024-09-06T14:44:31.703 INFO:tasks.workunit.client.1.smithi165.stdout:5/675: creat d6/d1c/d28/d4b/d55/d8a/dda/de3/ff5 x:0 0 0 2024-09-06T14:44:31.703 INFO:tasks.workunit.client.1.smithi165.stdout:0/574: dwrite f8 [0,4194304] 0 2024-09-06T14:44:31.704 INFO:tasks.workunit.client.1.smithi165.stdout:0/575: write d15/d19/d50/d53/f7e [164870,76267] 0 2024-09-06T14:44:31.705 INFO:tasks.workunit.client.1.smithi165.stdout:4/595: mkdir d5/d1b/d61/d97/dc9 0 2024-09-06T14:44:31.705 INFO:tasks.workunit.client.1.smithi165.stdout:5/676: write d6/d1c/d28/d4b/d55/fca [4645432,64665] 0 2024-09-06T14:44:31.707 INFO:tasks.workunit.client.1.smithi165.stdout:7/485: mkdir d20/d33/d6a/d9a 0 2024-09-06T14:44:31.709 INFO:tasks.workunit.client.1.smithi165.stdout:0/576: mkdir d15/d19/d50/d53/dbf 0 2024-09-06T14:44:31.710 INFO:tasks.workunit.client.1.smithi165.stdout:4/596: mknod d5/d1b/d1c/d78/da9/cca 0 2024-09-06T14:44:31.712 INFO:tasks.workunit.client.1.smithi165.stdout:0/577: rmdir d15/d55 39 2024-09-06T14:44:31.715 INFO:tasks.workunit.client.1.smithi165.stdout:5/677: rename d6/d1c/d28/d2d/d3c/d44/d82 to d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6 0 2024-09-06T14:44:31.718 INFO:tasks.workunit.client.1.smithi165.stdout:4/597: symlink d5/d1b/d61/d77/d7c/daa/lcb 0 2024-09-06T14:44:31.718 INFO:tasks.workunit.client.1.smithi165.stdout:7/486: link d20/d3b/c47 d20/d40/c9b 0 2024-09-06T14:44:31.721 INFO:tasks.workunit.client.1.smithi165.stdout:4/598: symlink d5/d1b/d61/d77/dbd/lcc 0 2024-09-06T14:44:31.722 INFO:tasks.workunit.client.1.smithi165.stdout:7/487: creat d20/d4d/d54/f9c x:0 0 0 2024-09-06T14:44:31.725 INFO:tasks.workunit.client.1.smithi165.stdout:3/555: sync 2024-09-06T14:44:31.726 INFO:tasks.workunit.client.1.smithi165.stdout:7/488: rename d20/d3b/d69/d88/f5d to d20/d4d/d54/f9d 0 2024-09-06T14:44:31.727 INFO:tasks.workunit.client.1.smithi165.stdout:4/599: dwrite d5/d1b/d1c/f22 [0,4194304] 0 2024-09-06T14:44:31.727 INFO:tasks.workunit.client.1.smithi165.stdout:3/556: fdatasync d1/da/dd/d4b/f5f 0 2024-09-06T14:44:31.732 INFO:tasks.workunit.client.1.smithi165.stdout:7/489: dread d20/d33/d53/f67 [0,4194304] 0 2024-09-06T14:44:31.733 INFO:tasks.workunit.client.1.smithi165.stdout:3/557: mkdir d1/da/dc/d5d/dbc 0 2024-09-06T14:44:31.735 INFO:tasks.workunit.client.1.smithi165.stdout:3/558: fdatasync d1/da/dc/f5c 0 2024-09-06T14:44:31.737 INFO:tasks.workunit.client.1.smithi165.stdout:4/600: dwrite d5/d1b/d1c/d78/f92 [0,4194304] 0 2024-09-06T14:44:31.737 INFO:tasks.workunit.client.1.smithi165.stdout:7/490: symlink d20/d33/l9e 0 2024-09-06T14:44:31.737 INFO:tasks.workunit.client.1.smithi165.stdout:4/601: fsync d5/f2c 0 2024-09-06T14:44:31.738 INFO:tasks.workunit.client.1.smithi165.stdout:3/559: unlink d1/da/dc/d10/faa 0 2024-09-06T14:44:31.740 INFO:tasks.workunit.client.1.smithi165.stdout:7/491: symlink d20/d3b/d69/d88/d30/l9f 0 2024-09-06T14:44:31.741 INFO:tasks.workunit.client.1.smithi165.stdout:7/492: dread - d20/d3b/f74 zero size 2024-09-06T14:44:31.742 INFO:tasks.workunit.client.1.smithi165.stdout:7/493: readlink d20/d3b/d69/d88/d30/l3c 0 2024-09-06T14:44:31.744 INFO:tasks.workunit.client.1.smithi165.stdout:4/602: rename d5/d1b/d61/d97 to d5/d1b/d61/d77/d7c/dcd 0 2024-09-06T14:44:31.745 INFO:tasks.workunit.client.1.smithi165.stdout:7/494: mknod d20/d3b/d69/d88/d80/d81/ca0 0 2024-09-06T14:44:31.745 INFO:tasks.workunit.client.1.smithi165.stdout:4/603: mknod d5/d1b/d1c/d78/cce 0 2024-09-06T14:44:31.746 INFO:tasks.workunit.client.1.smithi165.stdout:7/495: symlink d20/d33/d6a/d9a/la1 0 2024-09-06T14:44:31.749 INFO:tasks.workunit.client.1.smithi165.stdout:7/496: truncate d20/d65/f61 3846393 0 2024-09-06T14:44:31.751 INFO:tasks.workunit.client.1.smithi165.stdout:7/497: write d20/d3b/f74 [58336,64787] 0 2024-09-06T14:44:31.752 INFO:tasks.workunit.client.1.smithi165.stdout:4/604: dwrite d5/d1b/d1c/d8c/f9a [0,4194304] 0 2024-09-06T14:44:31.760 INFO:tasks.workunit.client.1.smithi165.stdout:3/560: dwrite d1/d7c/fad [0,4194304] 0 2024-09-06T14:44:31.762 INFO:tasks.workunit.client.1.smithi165.stdout:3/561: chown d1/da/dc/d10/lb3 1918 1 2024-09-06T14:44:31.763 INFO:tasks.workunit.client.1.smithi165.stdout:4/605: dwrite d5/d1b/d1c/f22 [0,4194304] 0 2024-09-06T14:44:31.766 INFO:tasks.workunit.client.1.smithi165.stdout:7/498: dread d20/d3b/d69/d88/d30/f83 [0,4194304] 0 2024-09-06T14:44:31.768 INFO:tasks.workunit.client.1.smithi165.stdout:4/606: rmdir d5/d1b/d1c/d41 39 2024-09-06T14:44:31.769 INFO:tasks.workunit.client.1.smithi165.stdout:7/499: readlink l7 0 2024-09-06T14:44:31.770 INFO:tasks.workunit.client.1.smithi165.stdout:7/500: readlink d20/d40/l68 0 2024-09-06T14:44:31.773 INFO:tasks.workunit.client.1.smithi165.stdout:4/607: getdents d5/d1b 0 2024-09-06T14:44:31.775 INFO:tasks.workunit.client.1.smithi165.stdout:3/562: dwrite d1/da/d43/f96 [4194304,4194304] 0 2024-09-06T14:44:31.819 INFO:tasks.workunit.client.1.smithi165.stdout:6/608: sync 2024-09-06T14:44:31.819 INFO:tasks.workunit.client.1.smithi165.stdout:8/607: sync 2024-09-06T14:44:31.819 INFO:tasks.workunit.client.1.smithi165.stdout:9/708: sync 2024-09-06T14:44:31.819 INFO:tasks.workunit.client.1.smithi165.stdout:2/519: sync 2024-09-06T14:44:31.820 INFO:tasks.workunit.client.1.smithi165.stdout:8/608: chown d0/d19/d36/d2d/dc9 2597404 1 2024-09-06T14:44:31.820 INFO:tasks.workunit.client.1.smithi165.stdout:2/520: write d9/d25/d46/f7c [4509276,43982] 0 2024-09-06T14:44:31.822 INFO:tasks.workunit.client.1.smithi165.stdout:2/521: chown d9/d25/d45/d69 3960 1 2024-09-06T14:44:31.827 INFO:tasks.workunit.client.1.smithi165.stdout:9/709: dread db/de/d15/d7f/fe0 [4194304,4194304] 0 2024-09-06T14:44:31.828 INFO:tasks.workunit.client.1.smithi165.stdout:9/710: write db/de/d15/d17/f19 [981839,29127] 0 2024-09-06T14:44:31.834 INFO:tasks.workunit.client.1.smithi165.stdout:6/609: dread f22 [0,4194304] 0 2024-09-06T14:44:31.847 INFO:tasks.workunit.client.1.smithi165.stdout:6/610: dread f17 [4194304,4194304] 0 2024-09-06T14:44:31.847 INFO:tasks.workunit.client.1.smithi165.stdout:6/611: chown f16 891415942 1 2024-09-06T14:44:31.849 INFO:tasks.workunit.client.1.smithi165.stdout:2/522: mkdir d9/d23/d52/daa 0 2024-09-06T14:44:31.849 INFO:tasks.workunit.client.1.smithi165.stdout:5/678: sync 2024-09-06T14:44:31.849 INFO:tasks.workunit.client.1.smithi165.stdout:0/578: sync 2024-09-06T14:44:31.849 INFO:tasks.workunit.client.1.smithi165.stdout:1/582: sync 2024-09-06T14:44:31.851 INFO:tasks.workunit.client.1.smithi165.stdout:0/579: read - d15/d6e/faf zero size 2024-09-06T14:44:31.851 INFO:tasks.workunit.client.1.smithi165.stdout:8/609: fsync d0/d19/d36/d2d/d33/d3a/d46/f52 0 2024-09-06T14:44:31.851 INFO:tasks.workunit.client.1.smithi165.stdout:5/679: truncate d6/d1c/f9c 1761911 0 2024-09-06T14:44:31.856 INFO:tasks.workunit.client.1.smithi165.stdout:6/612: mkdir d29/d39/d5b/d62/d94/db7 0 2024-09-06T14:44:31.857 INFO:tasks.workunit.client.1.smithi165.stdout:1/583: rmdir d0/d1c/d40 39 2024-09-06T14:44:31.862 INFO:tasks.workunit.client.1.smithi165.stdout:0/580: unlink d15/d19/d50/d53/d7c/d9a/l97 0 2024-09-06T14:44:31.864 INFO:tasks.workunit.client.1.smithi165.stdout:9/711: link db/f1c db/de/d15/d17/dc3/fe2 0 2024-09-06T14:44:31.865 INFO:tasks.workunit.client.1.smithi165.stdout:5/680: mknod d6/d1c/d28/d4b/da7/dab/cf7 0 2024-09-06T14:44:31.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:31 smithi052 ceph-mon[28627]: Reconfiguring ceph-exporter.smithi052 (dependencies changed)... 2024-09-06T14:44:31.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:31 smithi052 ceph-mon[28627]: Deploying daemon ceph-exporter.smithi052 on smithi052 2024-09-06T14:44:31.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:31 smithi052 ceph-mon[28627]: pgmap v18: 65 pgs: 65 active+clean; 973 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 MiB/s rd, 110 MiB/s wr, 295 op/s 2024-09-06T14:44:31.874 INFO:tasks.workunit.client.1.smithi165.stdout:3/563: getdents d1/da/dc/d3b/d71 0 2024-09-06T14:44:31.876 INFO:tasks.workunit.client.1.smithi165.stdout:0/581: dread d15/d55/f84 [0,4194304] 0 2024-09-06T14:44:31.881 INFO:tasks.workunit.client.1.smithi165.stdout:2/523: link d9/d25/d45/d75/c42 d9/d25/d46/d7e/cab 0 2024-09-06T14:44:31.888 INFO:tasks.workunit.client.1.smithi165.stdout:3/564: dread d1/da/dd/fe [0,4194304] 0 2024-09-06T14:44:31.902 INFO:tasks.workunit.client.1.smithi165.stdout:3/565: dread d1/d4a/f55 [0,4194304] 0 2024-09-06T14:44:31.905 INFO:tasks.workunit.client.1.smithi165.stdout:8/610: rename d0/d19/d36/d28/d53 to d0/d14/d3e/dcf 0 2024-09-06T14:44:31.908 INFO:tasks.workunit.client.1.smithi165.stdout:8/611: chown d0/d19/d24/d26/f76 529026482 1 2024-09-06T14:44:31.908 INFO:tasks.workunit.client.1.smithi165.stdout:3/566: dread d1/da/dc/d3b/d83/f8f [0,4194304] 0 2024-09-06T14:44:31.909 INFO:tasks.workunit.client.1.smithi165.stdout:5/681: rename d6/f2a to d6/d1c/d64/ff8 0 2024-09-06T14:44:31.909 INFO:tasks.workunit.client.1.smithi165.stdout:8/612: write d0/d19/d36/fb [1213930,56169] 0 2024-09-06T14:44:31.909 INFO:tasks.workunit.client.1.smithi165.stdout:3/567: chown d1/da 1 1 2024-09-06T14:44:31.910 INFO:tasks.workunit.client.1.smithi165.stdout:3/568: stat d1/d19/f29 0 2024-09-06T14:44:31.911 INFO:tasks.workunit.client.1.smithi165.stdout:7/501: truncate d20/d33/d53/f7f 820883 0 2024-09-06T14:44:31.913 INFO:tasks.workunit.client.1.smithi165.stdout:2/524: rename d9/d25/d45/d69 to d9/d88/dac 0 2024-09-06T14:44:31.915 INFO:tasks.workunit.client.1.smithi165.stdout:5/682: creat d6/d1c/d28/d2d/dc0/ff9 x:0 0 0 2024-09-06T14:44:31.917 INFO:tasks.workunit.client.1.smithi165.stdout:3/569: chown d1/da/dd/d8c/dae 1051137551 1 2024-09-06T14:44:31.921 INFO:tasks.workunit.client.1.smithi165.stdout:2/525: write d9/d25/d45/d75/d67/d76/f47 [357936,105482] 0 2024-09-06T14:44:31.925 INFO:tasks.workunit.client.1.smithi165.stdout:2/526: creat d9/d23/d71/fad x:0 0 0 2024-09-06T14:44:31.925 INFO:tasks.workunit.client.1.smithi165.stdout:7/502: dwrite d20/d3b/d69/d88/d30/f83 [0,4194304] 0 2024-09-06T14:44:31.927 INFO:tasks.workunit.client.1.smithi165.stdout:2/527: write d9/d25/d45/d75/d67/d76/f3c [2401623,51960] 0 2024-09-06T14:44:31.927 INFO:tasks.workunit.client.1.smithi165.stdout:5/683: getdents d6/d1c/d28/d4b/d55/d8a/de1 0 2024-09-06T14:44:31.928 INFO:tasks.workunit.client.1.smithi165.stdout:5/684: dread - d6/d98/fa6 zero size 2024-09-06T14:44:31.929 INFO:tasks.workunit.client.1.smithi165.stdout:3/570: getdents d1/d41 0 2024-09-06T14:44:31.930 INFO:tasks.workunit.client.1.smithi165.stdout:3/571: write d1/da/dc/f5c [107689,70097] 0 2024-09-06T14:44:31.933 INFO:tasks.workunit.client.1.smithi165.stdout:5/685: symlink d6/d1c/d28/d4b/da7/lfa 0 2024-09-06T14:44:31.940 INFO:tasks.workunit.client.1.smithi165.stdout:5/686: mknod d6/d1c/d28/d4b/d55/d8a/da5/dc7/cfb 0 2024-09-06T14:44:31.941 INFO:tasks.workunit.client.1.smithi165.stdout:8/613: symlink d0/d19/ld0 0 2024-09-06T14:44:31.941 INFO:tasks.workunit.client.1.smithi165.stdout:6/613: write d29/d6a/f8d [666045,51827] 0 2024-09-06T14:44:31.943 INFO:tasks.workunit.client.1.smithi165.stdout:6/614: chown d29/l37 14951961 1 2024-09-06T14:44:31.947 INFO:tasks.workunit.client.1.smithi165.stdout:1/584: dwrite d0/f7 [0,4194304] 0 2024-09-06T14:44:31.948 INFO:tasks.workunit.client.1.smithi165.stdout:6/615: dread d29/d39/f64 [0,4194304] 0 2024-09-06T14:44:31.949 INFO:tasks.workunit.client.1.smithi165.stdout:3/572: dread d1/da/dd/f61 [0,4194304] 0 2024-09-06T14:44:31.949 INFO:tasks.workunit.client.1.smithi165.stdout:2/528: rename d9/c9f to d9/d23/cae 0 2024-09-06T14:44:31.951 INFO:tasks.workunit.client.1.smithi165.stdout:1/585: unlink d0/d2a/l8b 0 2024-09-06T14:44:31.952 INFO:tasks.workunit.client.1.smithi165.stdout:9/712: sync 2024-09-06T14:44:31.953 INFO:tasks.workunit.client.1.smithi165.stdout:6/616: mkdir d29/d39/d86/db8 0 2024-09-06T14:44:31.954 INFO:tasks.workunit.client.1.smithi165.stdout:4/608: rmdir d5/d1b/d1c/d78 39 2024-09-06T14:44:31.956 INFO:tasks.workunit.client.1.smithi165.stdout:2/529: read d9/d25/d45/d75/d34/f6c [373620,56061] 0 2024-09-06T14:44:31.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/609: creat d5/d1b/d1c/d8c/fcf x:0 0 0 2024-09-06T14:44:31.959 INFO:tasks.workunit.client.1.smithi165.stdout:1/586: rename d0/d2a/d18/d24/d4b/d93/d6a/d83 to d0/d2a/d18/d24/d4b/d93/dbd 0 2024-09-06T14:44:31.960 INFO:tasks.workunit.client.1.smithi165.stdout:6/617: mkdir d29/d93/d87/db9 0 2024-09-06T14:44:31.961 INFO:tasks.workunit.client.1.smithi165.stdout:2/530: mknod d9/d23/d29/caf 0 2024-09-06T14:44:31.963 INFO:tasks.workunit.client.1.smithi165.stdout:4/610: stat d5/d1b/d1c/d78/f92 0 2024-09-06T14:44:31.965 INFO:tasks.workunit.client.1.smithi165.stdout:1/587: rename d0/d1c/d1d/c3b to d0/d2a/d23/d56/cbe 0 2024-09-06T14:44:31.966 INFO:tasks.workunit.client.1.smithi165.stdout:2/531: creat d9/d23/d71/fb0 x:0 0 0 2024-09-06T14:44:31.968 INFO:tasks.workunit.client.1.smithi165.stdout:4/611: chown d5/d1b/d61/d77/d7c/dcd/c9c 57 1 2024-09-06T14:44:31.969 INFO:tasks.workunit.client.1.smithi165.stdout:9/713: getdents db/de/d15/d17/d18/d7d/d8e 0 2024-09-06T14:44:31.971 INFO:tasks.workunit.client.1.smithi165.stdout:1/588: dwrite d0/d2a/f53 [0,4194304] 0 2024-09-06T14:44:31.974 INFO:tasks.workunit.client.1.smithi165.stdout:4/612: truncate d5/d1b/d1c/f1d 4361680 0 2024-09-06T14:44:31.974 INFO:tasks.workunit.client.1.smithi165.stdout:1/589: write d0/d2a/d18/d24/d4b/d93/d2b/fb4 [665763,81296] 0 2024-09-06T14:44:31.976 INFO:tasks.workunit.client.1.smithi165.stdout:6/618: dread d29/d39/d5b/d62/f80 [0,4194304] 0 2024-09-06T14:44:31.979 INFO:tasks.workunit.client.1.smithi165.stdout:6/619: rmdir d29/d39/d5b 39 2024-09-06T14:44:31.980 INFO:tasks.workunit.client.1.smithi165.stdout:1/590: symlink d0/d2a/d18/d24/d4b/d93/dbd/lbf 0 2024-09-06T14:44:31.981 INFO:tasks.workunit.client.1.smithi165.stdout:1/591: write d0/d2a/d18/d24/d4b/d93/d68/f87 [265305,42471] 0 2024-09-06T14:44:31.982 INFO:tasks.workunit.client.1.smithi165.stdout:4/613: rename d5/d1b/f49 to d5/d1b/d1c/d41/d9e/fd0 0 2024-09-06T14:44:31.983 INFO:tasks.workunit.client.1.smithi165.stdout:3/573: mkdir d1/dbd 0 2024-09-06T14:44:31.985 INFO:tasks.workunit.client.1.smithi165.stdout:2/532: dread d9/d25/d45/d75/d67/d76/f30 [0,4194304] 0 2024-09-06T14:44:31.985 INFO:tasks.workunit.client.1.smithi165.stdout:7/503: truncate d20/d3b/d69/d88/d30/f31 2879404 0 2024-09-06T14:44:31.986 INFO:tasks.workunit.client.1.smithi165.stdout:4/614: symlink d5/d1b/d1c/d20/d75/d83/ld1 0 2024-09-06T14:44:31.986 INFO:tasks.workunit.client.1.smithi165.stdout:2/533: chown d9/d25/d45 726716 1 2024-09-06T14:44:31.987 INFO:tasks.workunit.client.1.smithi165.stdout:1/592: symlink d0/d1c/lc0 0 2024-09-06T14:44:31.988 INFO:tasks.workunit.client.1.smithi165.stdout:5/687: truncate d6/f19 1962539 0 2024-09-06T14:44:31.988 INFO:tasks.workunit.client.1.smithi165.stdout:6/620: mkdir d29/d39/d5b/d62/d94/db7/dba 0 2024-09-06T14:44:31.989 INFO:tasks.workunit.client.1.smithi165.stdout:8/614: write d0/d19/d36/d2d/d33/d3a/d46/f52 [92993,47108] 0 2024-09-06T14:44:31.990 INFO:tasks.workunit.client.1.smithi165.stdout:2/534: write d9/f35 [1297246,4] 0 2024-09-06T14:44:31.990 INFO:tasks.workunit.client.1.smithi165.stdout:6/621: write f1e [2763524,35254] 0 2024-09-06T14:44:31.991 INFO:tasks.workunit.client.1.smithi165.stdout:8/615: stat d0/d19/d36/d2d/d33/d3a 0 2024-09-06T14:44:31.992 INFO:tasks.workunit.client.1.smithi165.stdout:3/574: truncate d1/d19/f29 74128 0 2024-09-06T14:44:31.992 INFO:tasks.workunit.client.1.smithi165.stdout:2/535: chown d9/d88/c8a 10072 1 2024-09-06T14:44:31.992 INFO:tasks.workunit.client.1.smithi165.stdout:8/616: write d0/d14/f2b [3356995,13164] 0 2024-09-06T14:44:31.993 INFO:tasks.workunit.client.1.smithi165.stdout:7/504: mknod d20/d3b/d69/d88/d80/ca2 0 2024-09-06T14:44:31.997 INFO:tasks.workunit.client.1.smithi165.stdout:0/582: sync 2024-09-06T14:44:32.000 INFO:tasks.workunit.client.1.smithi165.stdout:8/617: creat d0/d19/d36/d28/d64/fd1 x:0 0 0 2024-09-06T14:44:32.001 INFO:tasks.workunit.client.1.smithi165.stdout:7/505: mkdir d20/d3b/d69/da3 0 2024-09-06T14:44:32.004 INFO:tasks.workunit.client.1.smithi165.stdout:9/714: truncate db/de/d16/d2e/f63 428401 0 2024-09-06T14:44:32.005 INFO:tasks.workunit.client.1.smithi165.stdout:8/618: write d0/d19/d36/d2d/d33/d3a/fb0 [1630214,6423] 0 2024-09-06T14:44:32.006 INFO:tasks.workunit.client.1.smithi165.stdout:8/619: chown d0/d34/d6b/d94 26312 1 2024-09-06T14:44:32.006 INFO:tasks.workunit.client.1.smithi165.stdout:7/506: unlink d20/c49 0 2024-09-06T14:44:32.008 INFO:tasks.workunit.client.1.smithi165.stdout:4/615: rmdir d5/d1b/d1c/d78/da9/db6 0 2024-09-06T14:44:32.008 INFO:tasks.workunit.client.1.smithi165.stdout:4/616: fdatasync d5/d1b/d1c/d20/d26/f96 0 2024-09-06T14:44:32.010 INFO:tasks.workunit.client.1.smithi165.stdout:1/593: creat d0/d1c/fc1 x:0 0 0 2024-09-06T14:44:32.011 INFO:tasks.workunit.client.1.smithi165.stdout:1/594: write d0/d45/f6e [1649192,24284] 0 2024-09-06T14:44:32.011 INFO:tasks.workunit.client.1.smithi165.stdout:5/688: rename d6/d1c/d28/d2d/d49/f4e to d6/d1c/d28/d4b/d55/d8a/ffc 0 2024-09-06T14:44:32.012 INFO:tasks.workunit.client.1.smithi165.stdout:1/595: stat d0/d2a/d18/d24/d4b/d93/d6a/cb1 0 2024-09-06T14:44:32.016 INFO:tasks.workunit.client.1.smithi165.stdout:7/507: creat d20/d4d/d54/fa4 x:0 0 0 2024-09-06T14:44:32.017 INFO:tasks.workunit.client.1.smithi165.stdout:7/508: read d20/d3b/f7e [5432971,68822] 0 2024-09-06T14:44:32.017 INFO:tasks.workunit.client.1.smithi165.stdout:4/617: rmdir d5/d1b/d1c/d20 39 2024-09-06T14:44:32.023 INFO:tasks.workunit.client.1.smithi165.stdout:6/622: rename d29/d6a/d71/c90 to d29/d6a/d83/d89/cbb 0 2024-09-06T14:44:32.024 INFO:tasks.workunit.client.1.smithi165.stdout:0/583: creat d15/d19/fc0 x:0 0 0 2024-09-06T14:44:32.025 INFO:tasks.workunit.client.1.smithi165.stdout:0/584: fsync d15/d19/d28/fa9 0 2024-09-06T14:44:32.025 INFO:tasks.workunit.client.1.smithi165.stdout:0/585: stat d15/d55/cb4 0 2024-09-06T14:44:32.026 INFO:tasks.workunit.client.1.smithi165.stdout:9/715: mkdir db/de/d15/de3 0 2024-09-06T14:44:32.028 INFO:tasks.workunit.client.1.smithi165.stdout:1/596: unlink d0/d1c/d1d/d57/l9b 0 2024-09-06T14:44:32.035 INFO:tasks.workunit.client.1.smithi165.stdout:6/623: creat d29/d39/d5b/d62/d94/fbc x:0 0 0 2024-09-06T14:44:32.036 INFO:tasks.workunit.client.1.smithi165.stdout:6/624: dread d29/d6a/f8a [0,4194304] 0 2024-09-06T14:44:32.038 INFO:tasks.workunit.client.1.smithi165.stdout:1/597: rmdir d0/d2a/d23/d56 39 2024-09-06T14:44:32.038 INFO:tasks.workunit.client.1.smithi165.stdout:8/620: link d0/f22 d0/d19/d36/fd2 0 2024-09-06T14:44:32.039 INFO:tasks.workunit.client.1.smithi165.stdout:7/509: symlink d20/d33/la5 0 2024-09-06T14:44:32.042 INFO:tasks.workunit.client.1.smithi165.stdout:5/689: getdents d6/d1c/d28/d4b/d55/d8a/de1 0 2024-09-06T14:44:32.042 INFO:tasks.workunit.client.1.smithi165.stdout:0/586: dwrite d15/f37 [0,4194304] 0 2024-09-06T14:44:32.044 INFO:tasks.workunit.client.1.smithi165.stdout:6/625: fsync d29/d32/f61 0 2024-09-06T14:44:32.047 INFO:tasks.workunit.client.1.smithi165.stdout:8/621: mknod d0/d34/d6b/d94/cd3 0 2024-09-06T14:44:32.048 INFO:tasks.workunit.client.1.smithi165.stdout:4/618: link d5/d1b/d1c/f6b d5/d1b/d61/d77/d7c/fd2 0 2024-09-06T14:44:32.049 INFO:tasks.workunit.client.1.smithi165.stdout:1/598: dwrite d0/d1c/d1d/d22/fab [0,4194304] 0 2024-09-06T14:44:32.049 INFO:tasks.workunit.client.1.smithi165.stdout:7/510: creat d20/d3b/d69/d88/d80/d81/fa6 x:0 0 0 2024-09-06T14:44:32.056 INFO:tasks.workunit.client.1.smithi165.stdout:3/575: dwrite d1/d19/f29 [0,4194304] 0 2024-09-06T14:44:32.057 INFO:tasks.workunit.client.1.smithi165.stdout:0/587: symlink d15/d19/lc1 0 2024-09-06T14:44:32.059 INFO:tasks.workunit.client.1.smithi165.stdout:0/588: chown d15/d19/d28/d3a/d3f/l98 170663 1 2024-09-06T14:44:32.059 INFO:tasks.workunit.client.1.smithi165.stdout:4/619: rename d5/d1b/d1c/db0/fc7 to d5/d1b/d61/fd3 0 2024-09-06T14:44:32.060 INFO:tasks.workunit.client.1.smithi165.stdout:9/716: truncate db/de/d15/d7f/d9b/f3c 1625249 0 2024-09-06T14:44:32.062 INFO:tasks.workunit.client.1.smithi165.stdout:9/717: write db/de/f10 [4336380,121924] 0 2024-09-06T14:44:32.064 INFO:tasks.workunit.client.1.smithi165.stdout:6/626: rename d29/d39/d5b/d68/f73 to d29/d39/d5b/d68/fbd 0 2024-09-06T14:44:32.066 INFO:tasks.workunit.client.1.smithi165.stdout:2/536: sync 2024-09-06T14:44:32.068 INFO:tasks.workunit.client.1.smithi165.stdout:1/599: rename d0/d2a/d18/d24/d4b/d93/d2b/c54 to d0/d1c/d1d/cc2 0 2024-09-06T14:44:32.069 INFO:tasks.workunit.client.1.smithi165.stdout:0/589: creat d15/d19/d28/d3a/d3f/fc2 x:0 0 0 2024-09-06T14:44:32.071 INFO:tasks.workunit.client.1.smithi165.stdout:1/600: chown d0/d1c/d1d/d22/fab 7711767 1 2024-09-06T14:44:32.071 INFO:tasks.workunit.client.1.smithi165.stdout:8/622: rename d0/d14/l7d to d0/d14/ld4 0 2024-09-06T14:44:32.071 INFO:tasks.workunit.client.1.smithi165.stdout:5/690: write d6/d1c/d28/d2d/f53 [1150418,62496] 0 2024-09-06T14:44:32.072 INFO:tasks.workunit.client.1.smithi165.stdout:9/718: dwrite db/f26 [0,4194304] 0 2024-09-06T14:44:32.072 INFO:tasks.workunit.client.1.smithi165.stdout:6/627: creat d29/d39/d5b/d62/d94/fbe x:0 0 0 2024-09-06T14:44:32.072 INFO:tasks.workunit.client.1.smithi165.stdout:2/537: mkdir d9/d23/d29/d48/db1 0 2024-09-06T14:44:32.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:31 smithi165 ceph-mon[36229]: Reconfiguring ceph-exporter.smithi052 (dependencies changed)... 2024-09-06T14:44:32.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:31 smithi165 ceph-mon[36229]: Deploying daemon ceph-exporter.smithi052 on smithi052 2024-09-06T14:44:32.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:31 smithi165 ceph-mon[36229]: pgmap v18: 65 pgs: 65 active+clean; 973 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 MiB/s rd, 110 MiB/s wr, 295 op/s 2024-09-06T14:44:32.075 INFO:tasks.workunit.client.1.smithi165.stdout:6/628: dread - d29/d6a/f8f zero size 2024-09-06T14:44:32.075 INFO:tasks.workunit.client.1.smithi165.stdout:8/623: readlink d0/d19/d36/d2d/d3f/daf/lce 0 2024-09-06T14:44:32.075 INFO:tasks.workunit.client.1.smithi165.stdout:2/538: chown d9/d88/dac/c73 28710263 1 2024-09-06T14:44:32.076 INFO:tasks.workunit.client.1.smithi165.stdout:2/539: dread - d9/f84 zero size 2024-09-06T14:44:32.077 INFO:tasks.workunit.client.1.smithi165.stdout:0/590: symlink d15/d19/lc3 0 2024-09-06T14:44:32.077 INFO:tasks.workunit.client.1.smithi165.stdout:4/620: getdents d5/d1b/d1c/d78 0 2024-09-06T14:44:32.078 INFO:tasks.workunit.client.1.smithi165.stdout:5/691: creat d6/d98/dd7/ffd x:0 0 0 2024-09-06T14:44:32.079 INFO:tasks.workunit.client.1.smithi165.stdout:6/629: symlink d29/d32/lbf 0 2024-09-06T14:44:32.081 INFO:tasks.workunit.client.1.smithi165.stdout:1/601: creat d0/d1c/fc3 x:0 0 0 2024-09-06T14:44:32.083 INFO:tasks.workunit.client.1.smithi165.stdout:7/511: dread d20/d3b/d69/d88/d80/f8d [0,4194304] 0 2024-09-06T14:44:32.085 INFO:tasks.workunit.client.1.smithi165.stdout:2/540: link d9/f1a d9/d3b/d78/fb2 0 2024-09-06T14:44:32.086 INFO:tasks.workunit.client.1.smithi165.stdout:4/621: mkdir d5/d1b/d1c/d20/d26/dd4 0 2024-09-06T14:44:32.087 INFO:tasks.workunit.client.1.smithi165.stdout:2/541: rmdir d9/d25 39 2024-09-06T14:44:32.088 INFO:tasks.workunit.client.1.smithi165.stdout:3/576: dread d1/f11 [4194304,4194304] 0 2024-09-06T14:44:32.088 INFO:tasks.workunit.client.1.smithi165.stdout:9/719: dwrite db/de/d15/d17/d18/f5d [0,4194304] 0 2024-09-06T14:44:32.088 INFO:tasks.workunit.client.1.smithi165.stdout:5/692: creat d6/d1c/d28/d2d/d3c/d81/d8e/ffe x:0 0 0 2024-09-06T14:44:32.090 INFO:tasks.workunit.client.1.smithi165.stdout:3/577: write d1/d19/f49 [5520339,100423] 0 2024-09-06T14:44:32.090 INFO:tasks.workunit.client.1.smithi165.stdout:1/602: creat d0/d2a/d18/d24/d4b/d93/d68/dae/fc4 x:0 0 0 2024-09-06T14:44:32.091 INFO:tasks.workunit.client.1.smithi165.stdout:7/512: rmdir d20/d33/d53 39 2024-09-06T14:44:32.095 INFO:tasks.workunit.client.1.smithi165.stdout:3/578: stat d1/d7c/d98/c99 0 2024-09-06T14:44:32.096 INFO:tasks.workunit.client.1.smithi165.stdout:8/624: dread d0/d14/d3e/dcf/fa1 [0,4194304] 0 2024-09-06T14:44:32.096 INFO:tasks.workunit.client.1.smithi165.stdout:7/513: creat d20/d3b/d69/d88/d80/d81/fa7 x:0 0 0 2024-09-06T14:44:32.098 INFO:tasks.workunit.client.1.smithi165.stdout:5/693: truncate d6/d1c/d28/d4b/d55/f6a 862625 0 2024-09-06T14:44:32.104 INFO:tasks.workunit.client.1.smithi165.stdout:6/630: dread d29/d39/d5b/d68/f7c [0,4194304] 0 2024-09-06T14:44:32.104 INFO:tasks.workunit.client.1.smithi165.stdout:3/579: dwrite d1/da/dc/d3b/d83/fba [0,4194304] 0 2024-09-06T14:44:32.107 INFO:tasks.workunit.client.1.smithi165.stdout:6/631: write d29/f49 [3942319,8096] 0 2024-09-06T14:44:32.108 INFO:tasks.workunit.client.1.smithi165.stdout:8/625: dwrite d0/d19/d36/d2d/d33/d3a/d46/db3/fb6 [0,4194304] 0 2024-09-06T14:44:32.110 INFO:tasks.workunit.client.1.smithi165.stdout:6/632: chown d29/d39/d5b/d62/d67/l6b 72550153 1 2024-09-06T14:44:32.111 INFO:tasks.workunit.client.1.smithi165.stdout:2/542: rename d9/d25/d45/d75/d67/d76/f5b to d9/d25/d45/d75/fb3 0 2024-09-06T14:44:32.115 INFO:tasks.workunit.client.1.smithi165.stdout:3/580: readlink d1/da/dc/l77 0 2024-09-06T14:44:32.117 INFO:tasks.workunit.client.1.smithi165.stdout:5/694: dwrite d6/d1c/d64/ff8 [0,4194304] 0 2024-09-06T14:44:32.118 INFO:tasks.workunit.client.1.smithi165.stdout:8/626: creat d0/d19/d36/d2d/d3f/d93/fd5 x:0 0 0 2024-09-06T14:44:32.119 INFO:tasks.workunit.client.1.smithi165.stdout:1/603: getdents d0/d2a/d23/d56 0 2024-09-06T14:44:32.120 INFO:tasks.workunit.client.1.smithi165.stdout:2/543: fdatasync d9/fc 0 2024-09-06T14:44:32.121 INFO:tasks.workunit.client.1.smithi165.stdout:6/633: creat d29/d39/d5b/d62/d9f/fc0 x:0 0 0 2024-09-06T14:44:32.122 INFO:tasks.workunit.client.1.smithi165.stdout:2/544: chown d9/d25/d45/d75/d34/c41 30436 1 2024-09-06T14:44:32.126 INFO:tasks.workunit.client.1.smithi165.stdout:1/604: symlink d0/d1c/d1d/lc5 0 2024-09-06T14:44:32.127 INFO:tasks.workunit.client.1.smithi165.stdout:9/720: write db/de/fc8 [1004226,20496] 0 2024-09-06T14:44:32.128 INFO:tasks.workunit.client.1.smithi165.stdout:3/581: symlink d1/dbd/lbe 0 2024-09-06T14:44:32.133 INFO:tasks.workunit.client.1.smithi165.stdout:1/605: dwrite d0/d1c/d41/f8c [0,4194304] 0 2024-09-06T14:44:32.136 INFO:tasks.workunit.client.1.smithi165.stdout:9/721: symlink db/de/d15/d7f/dbc/le4 0 2024-09-06T14:44:32.138 INFO:tasks.workunit.client.1.smithi165.stdout:2/545: unlink d9/d25/d46/d7e/cab 0 2024-09-06T14:44:32.138 INFO:tasks.workunit.client.1.smithi165.stdout:3/582: dwrite d1/da/dc/d10/f1a [0,4194304] 0 2024-09-06T14:44:32.139 INFO:tasks.workunit.client.1.smithi165.stdout:7/514: dwrite f17 [0,4194304] 0 2024-09-06T14:44:32.140 INFO:tasks.workunit.client.1.smithi165.stdout:5/695: write d6/d32/f3f [619640,22655] 0 2024-09-06T14:44:32.141 INFO:tasks.workunit.client.1.smithi165.stdout:2/546: truncate d9/d25/d45/f51 4639564 0 2024-09-06T14:44:32.143 INFO:tasks.workunit.client.1.smithi165.stdout:3/583: write d1/d7c/d7e/fa4 [3271918,2427] 0 2024-09-06T14:44:32.143 INFO:tasks.workunit.client.1.smithi165.stdout:8/627: creat d0/d34/d6b/d94/fd6 x:0 0 0 2024-09-06T14:44:32.144 INFO:tasks.workunit.client.1.smithi165.stdout:6/634: getdents d29/d39/d5b 0 2024-09-06T14:44:32.147 INFO:tasks.workunit.client.1.smithi165.stdout:9/722: symlink db/de/d15/d7f/d9b/d6c/d96/le5 0 2024-09-06T14:44:32.147 INFO:tasks.workunit.client.1.smithi165.stdout:5/696: mkdir d6/d1c/d28/d2d/d61/dde/dff 0 2024-09-06T14:44:32.147 INFO:tasks.workunit.client.1.smithi165.stdout:6/635: stat d29/d39/d5b/d62 0 2024-09-06T14:44:32.150 INFO:tasks.workunit.client.1.smithi165.stdout:3/584: creat d1/d7c/d7e/fbf x:0 0 0 2024-09-06T14:44:32.151 INFO:tasks.workunit.client.1.smithi165.stdout:3/585: write d1/da/dd/f57 [70741,113988] 0 2024-09-06T14:44:32.153 INFO:tasks.workunit.client.1.smithi165.stdout:1/606: getdents d0/d2a/d23 0 2024-09-06T14:44:32.154 INFO:tasks.workunit.client.1.smithi165.stdout:6/636: creat d29/d32/fc1 x:0 0 0 2024-09-06T14:44:32.158 INFO:tasks.workunit.client.1.smithi165.stdout:9/723: mkdir db/de/d15/d7f/d9b/d6c/daf/de6 0 2024-09-06T14:44:32.160 INFO:tasks.workunit.client.1.smithi165.stdout:8/628: getdents d0/d19/d24/db1 0 2024-09-06T14:44:32.161 INFO:tasks.workunit.client.1.smithi165.stdout:3/586: dwrite d1/da/f2a [0,4194304] 0 2024-09-06T14:44:32.163 INFO:tasks.workunit.client.1.smithi165.stdout:3/587: chown d1/da 1471 1 2024-09-06T14:44:32.164 INFO:tasks.workunit.client.1.smithi165.stdout:8/629: write d0/d14/fac [684639,63048] 0 2024-09-06T14:44:32.168 INFO:tasks.workunit.client.1.smithi165.stdout:3/588: fsync d1/da/dc/f30 0 2024-09-06T14:44:32.168 INFO:tasks.workunit.client.1.smithi165.stdout:1/607: dwrite d0/d2a/f8e [4194304,4194304] 0 2024-09-06T14:44:32.173 INFO:tasks.workunit.client.1.smithi165.stdout:8/630: creat d0/d5e/d65/fd7 x:0 0 0 2024-09-06T14:44:32.178 INFO:tasks.workunit.client.1.smithi165.stdout:9/724: write db/de/d15/d17/d18/f54 [592547,16805] 0 2024-09-06T14:44:32.179 INFO:tasks.workunit.client.1.smithi165.stdout:7/515: dread f12 [0,4194304] 0 2024-09-06T14:44:32.179 INFO:tasks.workunit.client.1.smithi165.stdout:8/631: rename d0/d19/d36/d2d/d3f/d93 to d0/d14/d3e/dd8 0 2024-09-06T14:44:32.181 INFO:tasks.workunit.client.1.smithi165.stdout:9/725: stat db/de/d16/d2e/l8d 0 2024-09-06T14:44:32.184 INFO:tasks.workunit.client.1.smithi165.stdout:6/637: dread d29/f66 [0,4194304] 0 2024-09-06T14:44:32.185 INFO:tasks.workunit.client.1.smithi165.stdout:7/516: mknod d20/d3b/d69/d88/d30/d78/ca8 0 2024-09-06T14:44:32.185 INFO:tasks.workunit.client.1.smithi165.stdout:2/547: dwrite d9/d25/f40 [0,4194304] 0 2024-09-06T14:44:32.186 INFO:tasks.workunit.client.1.smithi165.stdout:8/632: chown d0/d34/d6b/d94/d70/fc0 147 1 2024-09-06T14:44:32.190 INFO:tasks.workunit.client.1.smithi165.stdout:7/517: write d20/f2b [3578226,76174] 0 2024-09-06T14:44:32.191 INFO:tasks.workunit.client.1.smithi165.stdout:6/638: write d29/d39/d5b/d62/d67/f8e [62736,12597] 0 2024-09-06T14:44:32.193 INFO:tasks.workunit.client.1.smithi165.stdout:3/589: dwrite d1/da/dd/d4b/f5f [0,4194304] 0 2024-09-06T14:44:32.193 INFO:tasks.workunit.client.1.smithi165.stdout:7/518: read f12 [4586234,112537] 0 2024-09-06T14:44:32.197 INFO:tasks.workunit.client.1.smithi165.stdout:9/726: dwrite db/de/d15/fc5 [0,4194304] 0 2024-09-06T14:44:32.198 INFO:tasks.workunit.client.1.smithi165.stdout:7/519: fsync d20/d3b/d69/d88/d80/d81/fa7 0 2024-09-06T14:44:32.199 INFO:tasks.workunit.client.1.smithi165.stdout:6/639: mknod d29/d39/d5b/d62/d94/db7/cc2 0 2024-09-06T14:44:32.202 INFO:tasks.workunit.client.1.smithi165.stdout:3/590: rename d1/da/dd/f57 to d1/d7c/d7e/fc0 0 2024-09-06T14:44:32.204 INFO:tasks.workunit.client.1.smithi165.stdout:8/633: truncate d0/d19/d36/f2e 3941663 0 2024-09-06T14:44:32.205 INFO:tasks.workunit.client.1.smithi165.stdout:7/520: fdatasync d20/d4d/d54/f9d 0 2024-09-06T14:44:32.206 INFO:tasks.workunit.client.1.smithi165.stdout:3/591: read d1/d7c/d7e/fa4 [1815718,123979] 0 2024-09-06T14:44:32.206 INFO:tasks.workunit.client.1.smithi165.stdout:6/640: symlink d29/d32/d7a/lc3 0 2024-09-06T14:44:32.208 INFO:tasks.workunit.client.1.smithi165.stdout:9/727: dwrite db/de/d15/d17/d86/f8c [0,4194304] 0 2024-09-06T14:44:32.210 INFO:tasks.workunit.client.1.smithi165.stdout:9/728: stat db/de/d15/d7f/d9b/d6c/f7a 0 2024-09-06T14:44:32.211 INFO:tasks.workunit.client.1.smithi165.stdout:3/592: creat d1/dbd/fc1 x:0 0 0 2024-09-06T14:44:32.217 INFO:tasks.workunit.client.1.smithi165.stdout:8/634: dwrite d0/d19/d36/d2d/d33/d3a/d46/f7e [4194304,4194304] 0 2024-09-06T14:44:32.217 INFO:tasks.workunit.client.1.smithi165.stdout:3/593: rmdir d1/da/dc/d5d/d89 39 2024-09-06T14:44:32.220 INFO:tasks.workunit.client.1.smithi165.stdout:6/641: getdents d29/d39/d5b/d62/d67 0 2024-09-06T14:44:32.221 INFO:tasks.workunit.client.1.smithi165.stdout:9/729: rename db/de/d15/de3 to db/de/d15/d7f/d9b/de7 0 2024-09-06T14:44:32.222 INFO:tasks.workunit.client.1.smithi165.stdout:3/594: symlink d1/dbd/lc2 0 2024-09-06T14:44:32.224 INFO:tasks.workunit.client.1.smithi165.stdout:3/595: chown d1/da/f8e 68 1 2024-09-06T14:44:32.226 INFO:tasks.workunit.client.1.smithi165.stdout:8/635: link d0/d5e/d65/fd7 d0/d19/d24/db1/d8c/fd9 0 2024-09-06T14:44:32.228 INFO:tasks.workunit.client.1.smithi165.stdout:3/596: readlink d1/da/dc/l4e 0 2024-09-06T14:44:32.231 INFO:tasks.workunit.client.1.smithi165.stdout:6/642: dwrite d29/d6a/f70 [4194304,4194304] 0 2024-09-06T14:44:32.231 INFO:tasks.workunit.client.1.smithi165.stdout:8/636: unlink d0/d19/d24/d26/f29 0 2024-09-06T14:44:32.233 INFO:tasks.workunit.client.1.smithi165.stdout:9/730: dwrite db/de/d15/d17/d86/fb6 [0,4194304] 0 2024-09-06T14:44:32.233 INFO:tasks.workunit.client.1.smithi165.stdout:8/637: chown d0/d9e 127767 1 2024-09-06T14:44:32.235 INFO:tasks.workunit.client.1.smithi165.stdout:6/643: readlink d29/d39/d5b/d62/d67/l79 0 2024-09-06T14:44:32.235 INFO:tasks.workunit.client.1.smithi165.stdout:6/644: stat d29/l5d 0 2024-09-06T14:44:32.236 INFO:tasks.workunit.client.1.smithi165.stdout:6/645: fdatasync f16 0 2024-09-06T14:44:32.236 INFO:tasks.workunit.client.1.smithi165.stdout:8/638: mkdir d0/d19/d36/d28/dda 0 2024-09-06T14:44:32.238 INFO:tasks.workunit.client.1.smithi165.stdout:3/597: dread d1/da/dc/d10/f1a [0,4194304] 0 2024-09-06T14:44:32.243 INFO:tasks.workunit.client.1.smithi165.stdout:6/646: dwrite d29/d39/d5b/d62/d94/fbc [0,4194304] 0 2024-09-06T14:44:32.251 INFO:tasks.workunit.client.1.smithi165.stdout:3/598: dwrite d1/da/dd/d4b/f74 [0,4194304] 0 2024-09-06T14:44:32.251 INFO:tasks.workunit.client.1.smithi165.stdout:6/647: link d29/d93/f6e d29/d6a/d83/fc4 0 2024-09-06T14:44:32.254 INFO:tasks.workunit.client.1.smithi165.stdout:3/599: fdatasync d1/d19/f28 0 2024-09-06T14:44:32.255 INFO:tasks.workunit.client.1.smithi165.stdout:9/731: dwrite db/de/d16/d2e/f63 [0,4194304] 0 2024-09-06T14:44:32.255 INFO:tasks.workunit.client.1.smithi165.stdout:6/648: creat d29/d39/d5b/fc5 x:0 0 0 2024-09-06T14:44:32.258 INFO:tasks.workunit.client.1.smithi165.stdout:8/639: dread d0/d19/d36/d2d/d33/d3a/d46/d49/f4a [0,4194304] 0 2024-09-06T14:44:32.259 INFO:tasks.workunit.client.1.smithi165.stdout:3/600: unlink d1/d41/c45 0 2024-09-06T14:44:32.261 INFO:tasks.workunit.client.1.smithi165.stdout:9/732: dread db/de/d15/d17/f82 [0,4194304] 0 2024-09-06T14:44:32.261 INFO:tasks.workunit.client.1.smithi165.stdout:8/640: rmdir d0/d19/d24/db1/d8c 39 2024-09-06T14:44:32.262 INFO:tasks.workunit.client.1.smithi165.stdout:9/733: fsync db/de/d15/d17/d18/f4b 0 2024-09-06T14:44:32.263 INFO:tasks.workunit.client.1.smithi165.stdout:9/734: fdatasync db/de/d16/d2e/f70 0 2024-09-06T14:44:32.263 INFO:tasks.workunit.client.1.smithi165.stdout:9/735: readlink l5 0 2024-09-06T14:44:32.265 INFO:tasks.workunit.client.1.smithi165.stdout:9/736: write db/de/d15/d7f/d9b/d6c/f7a [1239212,129730] 0 2024-09-06T14:44:32.266 INFO:tasks.workunit.client.1.smithi165.stdout:3/601: unlink d1/d19/f3e 0 2024-09-06T14:44:32.266 INFO:tasks.workunit.client.1.smithi165.stdout:9/737: write db/de/d15/d17/d18/d59/d64/fd9 [957430,79997] 0 2024-09-06T14:44:32.271 INFO:tasks.workunit.client.1.smithi165.stdout:0/591: sync 2024-09-06T14:44:32.272 INFO:tasks.workunit.client.1.smithi165.stdout:6/649: rmdir d29/d39/d86/db8 0 2024-09-06T14:44:32.273 INFO:tasks.workunit.client.1.smithi165.stdout:6/650: fdatasync d29/d32/f56 0 2024-09-06T14:44:32.273 INFO:tasks.workunit.client.1.smithi165.stdout:9/738: creat db/de/d15/d7f/d9b/d6c/d96/fe8 x:0 0 0 2024-09-06T14:44:32.274 INFO:tasks.workunit.client.1.smithi165.stdout:8/641: creat d0/d14/d3e/db4/fdb x:0 0 0 2024-09-06T14:44:32.274 INFO:tasks.workunit.client.1.smithi165.stdout:3/602: symlink d1/da/dc/d5d/dbc/lc3 0 2024-09-06T14:44:32.277 INFO:tasks.workunit.client.1.smithi165.stdout:0/592: symlink d15/d19/d50/d53/dbf/lc4 0 2024-09-06T14:44:32.278 INFO:tasks.workunit.client.1.smithi165.stdout:3/603: creat d1/d41/fc4 x:0 0 0 2024-09-06T14:44:32.279 INFO:tasks.workunit.client.1.smithi165.stdout:9/739: dread db/de/d16/d2e/f3d [0,4194304] 0 2024-09-06T14:44:32.279 INFO:tasks.workunit.client.1.smithi165.stdout:8/642: mknod d0/d19/d36/d28/dda/cdc 0 2024-09-06T14:44:32.280 INFO:tasks.workunit.client.1.smithi165.stdout:0/593: mkdir d15/d19/d50/d53/dbf/dc5 0 2024-09-06T14:44:32.281 INFO:tasks.workunit.client.1.smithi165.stdout:6/651: creat d29/d39/fc6 x:0 0 0 2024-09-06T14:44:32.281 INFO:tasks.workunit.client.1.smithi165.stdout:0/594: fdatasync d15/f37 0 2024-09-06T14:44:32.282 INFO:tasks.workunit.client.1.smithi165.stdout:9/740: symlink db/de/d16/le9 0 2024-09-06T14:44:32.284 INFO:tasks.workunit.client.1.smithi165.stdout:9/741: stat db/de/d15/d17/d18/f54 0 2024-09-06T14:44:32.285 INFO:tasks.workunit.client.1.smithi165.stdout:0/595: symlink d15/d19/d28/d9e/lc6 0 2024-09-06T14:44:32.288 INFO:tasks.workunit.client.1.smithi165.stdout:3/604: dwrite d1/da/dd/d4b/f6e [0,4194304] 0 2024-09-06T14:44:32.288 INFO:tasks.workunit.client.1.smithi165.stdout:8/643: getdents d0/d19/d24/db1/d5b 0 2024-09-06T14:44:32.289 INFO:tasks.workunit.client.1.smithi165.stdout:3/605: stat d1/da/dd/l81 0 2024-09-06T14:44:32.290 INFO:tasks.workunit.client.1.smithi165.stdout:0/596: dread d15/f5a [0,4194304] 0 2024-09-06T14:44:32.290 INFO:tasks.workunit.client.1.smithi165.stdout:3/606: chown d1/d41/da1/lb0 27723031 1 2024-09-06T14:44:32.293 INFO:tasks.workunit.client.1.smithi165.stdout:9/742: rename db/f7b to db/de/fea 0 2024-09-06T14:44:32.295 INFO:tasks.workunit.client.1.smithi165.stdout:0/597: symlink d15/d19/d28/d3a/d5d/lc7 0 2024-09-06T14:44:32.297 INFO:tasks.workunit.client.1.smithi165.stdout:9/743: creat db/de/d15/d17/d86/feb x:0 0 0 2024-09-06T14:44:32.297 INFO:tasks.workunit.client.1.smithi165.stdout:3/607: dwrite d1/da/d43/f96 [4194304,4194304] 0 2024-09-06T14:44:32.299 INFO:tasks.workunit.client.1.smithi165.stdout:8/644: rename d0/d9e/fbf to d0/d19/d36/d2d/fdd 0 2024-09-06T14:44:32.300 INFO:tasks.workunit.client.1.smithi165.stdout:3/608: chown d1/lb 14592452 1 2024-09-06T14:44:32.302 INFO:tasks.workunit.client.1.smithi165.stdout:9/744: dread - db/de/d15/d7f/d9b/d6c/d96/fe8 zero size 2024-09-06T14:44:32.305 INFO:tasks.workunit.client.1.smithi165.stdout:6/652: dwrite d29/d6a/f8a [0,4194304] 0 2024-09-06T14:44:32.306 INFO:tasks.workunit.client.1.smithi165.stdout:0/598: rename d15/d19/d28/d4f/d52/l87 to d15/d19/d50/d53/d7c/dae/lc8 0 2024-09-06T14:44:32.317 INFO:tasks.workunit.client.1.smithi165.stdout:6/653: symlink d29/d39/lc7 0 2024-09-06T14:44:32.318 INFO:tasks.workunit.client.1.smithi165.stdout:9/745: creat db/de/d15/d17/fec x:0 0 0 2024-09-06T14:44:32.319 INFO:tasks.workunit.client.1.smithi165.stdout:6/654: write d29/d39/d5b/f78 [156931,34069] 0 2024-09-06T14:44:32.323 INFO:tasks.workunit.client.1.smithi165.stdout:3/609: getdents d1/d7c/d7e 0 2024-09-06T14:44:32.324 INFO:tasks.workunit.client.1.smithi165.stdout:6/655: dread d29/d6a/f70 [4194304,4194304] 0 2024-09-06T14:44:32.325 INFO:tasks.workunit.client.1.smithi165.stdout:6/656: stat d29/d39/f64 0 2024-09-06T14:44:32.326 INFO:tasks.workunit.client.1.smithi165.stdout:3/610: mkdir d1/d7c/d7e/dc5 0 2024-09-06T14:44:32.326 INFO:tasks.workunit.client.1.smithi165.stdout:9/746: getdents db/de/d15/d74 0 2024-09-06T14:44:32.326 INFO:tasks.workunit.client.1.smithi165.stdout:8/645: dread d0/d14/d3e/f4b [0,4194304] 0 2024-09-06T14:44:32.327 INFO:tasks.workunit.client.1.smithi165.stdout:6/657: mkdir d29/d6a/d83/dc8 0 2024-09-06T14:44:32.328 INFO:tasks.workunit.client.1.smithi165.stdout:6/658: fsync d29/d32/f85 0 2024-09-06T14:44:32.328 INFO:tasks.workunit.client.1.smithi165.stdout:8/646: dread - d0/d14/d3e/db4/fdb zero size 2024-09-06T14:44:32.329 INFO:tasks.workunit.client.1.smithi165.stdout:6/659: stat d29/d32/d7a/c9d 0 2024-09-06T14:44:32.330 INFO:tasks.workunit.client.1.smithi165.stdout:6/660: read - d29/d39/d5b/d62/d67/fb4 zero size 2024-09-06T14:44:32.330 INFO:tasks.workunit.client.1.smithi165.stdout:3/611: rename d1/da/dc/d5d to d1/da/dc/d3b/dc6 0 2024-09-06T14:44:32.332 INFO:tasks.workunit.client.1.smithi165.stdout:8/647: creat d0/d19/d36/d2d/d33/d3a/d46/dcd/fde x:0 0 0 2024-09-06T14:44:32.332 INFO:tasks.workunit.client.1.smithi165.stdout:9/747: getdents db/de/d15/d7f/dbc 0 2024-09-06T14:44:32.333 INFO:tasks.workunit.client.1.smithi165.stdout:6/661: creat d29/d39/d5b/d62/d94/db7/dba/fc9 x:0 0 0 2024-09-06T14:44:32.334 INFO:tasks.workunit.client.1.smithi165.stdout:8/648: rmdir d0/d19/d36/d2d 39 2024-09-06T14:44:32.336 INFO:tasks.workunit.client.1.smithi165.stdout:9/748: mkdir db/de/d15/d17/d18/d7d/d8e/ded 0 2024-09-06T14:44:32.336 INFO:tasks.workunit.client.1.smithi165.stdout:0/599: write d15/d19/d28/f42 [633918,27358] 0 2024-09-06T14:44:32.337 INFO:tasks.workunit.client.1.smithi165.stdout:6/662: rename d29/d93/f6e to d29/d39/d5b/d68/fca 0 2024-09-06T14:44:32.339 INFO:tasks.workunit.client.1.smithi165.stdout:3/612: dwrite d1/da/dd/f15 [0,4194304] 0 2024-09-06T14:44:32.340 INFO:tasks.workunit.client.1.smithi165.stdout:9/749: write db/de/d16/f6b [2365082,55077] 0 2024-09-06T14:44:32.341 INFO:tasks.workunit.client.1.smithi165.stdout:3/613: chown d1/da/dc/d3b/d71 1793083 1 2024-09-06T14:44:32.342 INFO:tasks.workunit.client.1.smithi165.stdout:8/649: rename d0/d19/d36/f12 to d0/d19/d36/d28/d64/fdf 0 2024-09-06T14:44:32.342 INFO:tasks.workunit.client.1.smithi165.stdout:3/614: chown d1/d4a/f7d 1797 1 2024-09-06T14:44:32.343 INFO:tasks.workunit.client.1.smithi165.stdout:0/600: creat d15/d19/d28/d9e/fc9 x:0 0 0 2024-09-06T14:44:32.350 INFO:tasks.workunit.client.1.smithi165.stdout:0/601: unlink d15/d19/d50/d53/fb2 0 2024-09-06T14:44:32.353 INFO:tasks.workunit.client.1.smithi165.stdout:9/750: dread db/de/d16/d2e/f55 [0,4194304] 0 2024-09-06T14:44:32.355 INFO:tasks.workunit.client.1.smithi165.stdout:3/615: dwrite d1/da/dd/fe [4194304,4194304] 0 2024-09-06T14:44:32.355 INFO:tasks.workunit.client.1.smithi165.stdout:0/602: symlink d15/d19/d50/d53/d7c/dbb/lca 0 2024-09-06T14:44:32.356 INFO:tasks.workunit.client.1.smithi165.stdout:9/751: write db/de/d15/d17/d86/feb [950632,35788] 0 2024-09-06T14:44:32.359 INFO:tasks.workunit.client.1.smithi165.stdout:3/616: mkdir d1/d4a/dc7 0 2024-09-06T14:44:32.363 INFO:tasks.workunit.client.1.smithi165.stdout:9/752: dread db/de/fb1 [0,4194304] 0 2024-09-06T14:44:32.364 INFO:tasks.workunit.client.1.smithi165.stdout:3/617: symlink d1/d4a/dc7/lc8 0 2024-09-06T14:44:32.364 INFO:tasks.workunit.client.1.smithi165.stdout:3/618: fsync d1/d41/f97 0 2024-09-06T14:44:32.364 INFO:tasks.workunit.client.1.smithi165.stdout:9/753: chown db/de/d15/d17/d18/d59/d64/l93 512 1 2024-09-06T14:44:32.365 INFO:tasks.workunit.client.1.smithi165.stdout:6/663: write d29/d39/d5b/d68/fca [2479213,85095] 0 2024-09-06T14:44:32.366 INFO:tasks.workunit.client.1.smithi165.stdout:8/650: write d0/d14/d3e/dd8/fa6 [1671682,33572] 0 2024-09-06T14:44:32.368 INFO:tasks.workunit.client.1.smithi165.stdout:9/754: mknod db/de/d16/d2e/da7/cee 0 2024-09-06T14:44:32.369 INFO:tasks.workunit.client.1.smithi165.stdout:3/619: truncate d1/da/dc/d3b/d83/f8f 2467871 0 2024-09-06T14:44:32.370 INFO:tasks.workunit.client.1.smithi165.stdout:8/651: dread - d0/d19/d24/db1/d8c/fd9 zero size 2024-09-06T14:44:32.371 INFO:tasks.workunit.client.1.smithi165.stdout:9/755: stat db/de/d15/d17/d18/f54 0 2024-09-06T14:44:32.372 INFO:tasks.workunit.client.1.smithi165.stdout:3/620: chown d1/da/dc/d10/l9a 11635 1 2024-09-06T14:44:32.375 INFO:tasks.workunit.client.1.smithi165.stdout:8/652: chown d0/d19/d36/d28/l67 20609 1 2024-09-06T14:44:32.376 INFO:tasks.workunit.client.1.smithi165.stdout:6/664: dwrite d29/d39/d5b/d62/d9f/fc0 [0,4194304] 0 2024-09-06T14:44:32.378 INFO:tasks.workunit.client.1.smithi165.stdout:0/603: dread f8 [0,4194304] 0 2024-09-06T14:44:32.379 INFO:tasks.workunit.client.1.smithi165.stdout:6/665: write d29/d6a/d83/fc4 [2333758,39330] 0 2024-09-06T14:44:32.381 INFO:tasks.workunit.client.1.smithi165.stdout:8/653: unlink d0/d14/d3e/dd8/fa5 0 2024-09-06T14:44:32.383 INFO:tasks.workunit.client.1.smithi165.stdout:8/654: write d0/d14/d3e/f35 [1135865,75343] 0 2024-09-06T14:44:32.383 INFO:tasks.workunit.client.1.smithi165.stdout:6/666: unlink d29/d32/la1 0 2024-09-06T14:44:32.383 INFO:tasks.workunit.client.1.smithi165.stdout:3/621: write d1/da/dc/d10/f35 [4358852,108230] 0 2024-09-06T14:44:32.386 INFO:tasks.workunit.client.1.smithi165.stdout:6/667: write d29/d39/d5b/d62/fa3 [384401,36913] 0 2024-09-06T14:44:32.390 INFO:tasks.workunit.client.1.smithi165.stdout:3/622: creat d1/dbd/fc9 x:0 0 0 2024-09-06T14:44:32.390 INFO:tasks.workunit.client.1.smithi165.stdout:8/655: mkdir d0/d19/d36/d28/de0 0 2024-09-06T14:44:32.392 INFO:tasks.workunit.client.1.smithi165.stdout:3/623: creat d1/d19/d92/fca x:0 0 0 2024-09-06T14:44:32.394 INFO:tasks.workunit.client.1.smithi165.stdout:4/622: sync 2024-09-06T14:44:32.394 INFO:tasks.workunit.client.1.smithi165.stdout:8/656: symlink d0/d19/d36/d2d/d33/da8/le1 0 2024-09-06T14:44:32.398 INFO:tasks.workunit.client.1.smithi165.stdout:8/657: creat d0/d14/d3e/db4/fe2 x:0 0 0 2024-09-06T14:44:32.399 INFO:tasks.workunit.client.1.smithi165.stdout:9/756: dread db/de/d15/d7f/d9b/f3c [0,4194304] 0 2024-09-06T14:44:32.400 INFO:tasks.workunit.client.1.smithi165.stdout:3/624: dwrite d1/da/dd/d4b/f8b [0,4194304] 0 2024-09-06T14:44:32.401 INFO:tasks.workunit.client.1.smithi165.stdout:8/658: creat d0/d19/d24/fe3 x:0 0 0 2024-09-06T14:44:32.403 INFO:tasks.workunit.client.1.smithi165.stdout:3/625: write d1/dbd/fc1 [283104,83471] 0 2024-09-06T14:44:32.403 INFO:tasks.workunit.client.1.smithi165.stdout:4/623: dwrite d5/d1b/d1c/d8c/f9a [0,4194304] 0 2024-09-06T14:44:32.404 INFO:tasks.workunit.client.1.smithi165.stdout:8/659: fsync d0/d19/d36/d2d/d33/d3a/d46/f52 0 2024-09-06T14:44:32.405 INFO:tasks.workunit.client.1.smithi165.stdout:9/757: creat db/de/d15/d91/fef x:0 0 0 2024-09-06T14:44:32.408 INFO:tasks.workunit.client.1.smithi165.stdout:3/626: unlink d1/da/dd/fb8 0 2024-09-06T14:44:32.412 INFO:tasks.workunit.client.1.smithi165.stdout:8/660: write d0/d34/d6b/d94/f5f [485785,24805] 0 2024-09-06T14:44:32.413 INFO:tasks.workunit.client.1.smithi165.stdout:4/624: mkdir d5/d1b/d61/d77/dd5 0 2024-09-06T14:44:32.413 INFO:tasks.workunit.client.1.smithi165.stdout:9/758: chown db/de/d15/d17/d18/d7d/f6d 7 1 2024-09-06T14:44:32.415 INFO:tasks.workunit.client.1.smithi165.stdout:3/627: creat d1/da/dc/d10/fcb x:0 0 0 2024-09-06T14:44:32.418 INFO:tasks.workunit.client.1.smithi165.stdout:4/625: dwrite d5/f8a [4194304,4194304] 0 2024-09-06T14:44:32.419 INFO:tasks.workunit.client.1.smithi165.stdout:4/626: chown d5/d1b/d1c/d20/d26/cc5 2805 1 2024-09-06T14:44:32.420 INFO:tasks.workunit.client.1.smithi165.stdout:4/627: stat d5/d1b/d1c/f6c 0 2024-09-06T14:44:32.422 INFO:tasks.workunit.client.1.smithi165.stdout:9/759: unlink db/de/d15/d17/d18/d59/d64/fd1 0 2024-09-06T14:44:32.424 INFO:tasks.workunit.client.1.smithi165.stdout:8/661: fsync d0/f22 0 2024-09-06T14:44:32.427 INFO:tasks.workunit.client.1.smithi165.stdout:4/628: dwrite d5/d1b/d1c/d55/fc4 [0,4194304] 0 2024-09-06T14:44:32.429 INFO:tasks.workunit.client.1.smithi165.stdout:8/662: symlink d0/d34/le4 0 2024-09-06T14:44:32.430 INFO:tasks.workunit.client.1.smithi165.stdout:3/628: dwrite d1/da/dc/d10/f1a [0,4194304] 0 2024-09-06T14:44:32.433 INFO:tasks.workunit.client.1.smithi165.stdout:8/663: creat d0/d19/d36/d28/dda/fe5 x:0 0 0 2024-09-06T14:44:32.435 INFO:tasks.workunit.client.1.smithi165.stdout:3/629: creat d1/d7c/fcc x:0 0 0 2024-09-06T14:44:32.442 INFO:tasks.workunit.client.1.smithi165.stdout:8/664: truncate d0/d19/d24/fbb 2273473 0 2024-09-06T14:44:32.445 INFO:tasks.workunit.client.1.smithi165.stdout:3/630: getdents d1/d19 0 2024-09-06T14:44:32.445 INFO:tasks.workunit.client.1.smithi165.stdout:9/760: write db/de/d15/d7f/f8b [924542,34804] 0 2024-09-06T14:44:32.446 INFO:tasks.workunit.client.1.smithi165.stdout:3/631: write d1/f2 [3732467,100598] 0 2024-09-06T14:44:32.447 INFO:tasks.workunit.client.1.smithi165.stdout:8/665: dread d0/d19/f86 [0,4194304] 0 2024-09-06T14:44:32.448 INFO:tasks.workunit.client.1.smithi165.stdout:9/761: read db/de/d15/fc9 [2870539,62662] 0 2024-09-06T14:44:32.450 INFO:tasks.workunit.client.1.smithi165.stdout:8/666: creat d0/d19/d7f/fe6 x:0 0 0 2024-09-06T14:44:32.451 INFO:tasks.workunit.client.1.smithi165.stdout:3/632: link d1/dbd/fc1 d1/d19/d92/fcd 0 2024-09-06T14:44:32.451 INFO:tasks.workunit.client.1.smithi165.stdout:9/762: readlink db/d40/l71 0 2024-09-06T14:44:32.454 INFO:tasks.workunit.client.1.smithi165.stdout:4/629: dwrite d5/fc [4194304,4194304] 0 2024-09-06T14:44:32.455 INFO:tasks.workunit.client.1.smithi165.stdout:4/630: read d5/d1b/d1c/d55/fc4 [2753926,78063] 0 2024-09-06T14:44:32.455 INFO:tasks.workunit.client.1.smithi165.stdout:3/633: mknod d1/da/dc/d3b/d71/cce 0 2024-09-06T14:44:32.459 INFO:tasks.workunit.client.1.smithi165.stdout:9/763: creat db/de/d15/d7f/d9b/d6c/d81/ff0 x:0 0 0 2024-09-06T14:44:32.461 INFO:tasks.workunit.client.1.smithi165.stdout:3/634: getdents d1/da/dd/d4b 0 2024-09-06T14:44:32.463 INFO:tasks.workunit.client.1.smithi165.stdout:4/631: rename d5/c11 to d5/d1b/d1c/d20/d75/d83/cd6 0 2024-09-06T14:44:32.463 INFO:tasks.workunit.client.1.smithi165.stdout:3/635: read d1/da/dc/d3b/d71/f7a [136491,111070] 0 2024-09-06T14:44:32.465 INFO:tasks.workunit.client.1.smithi165.stdout:4/632: truncate d5/d1b/d1c/d55/fa7 277588 0 2024-09-06T14:44:32.465 INFO:tasks.workunit.client.1.smithi165.stdout:3/636: chown d1/da/dc/d3b/dc6/cab 7 1 2024-09-06T14:44:32.467 INFO:tasks.workunit.client.1.smithi165.stdout:9/764: mkdir db/de/d15/d17/d18/d7d/d8e/ded/df1 0 2024-09-06T14:44:32.469 INFO:tasks.workunit.client.1.smithi165.stdout:4/633: mkdir d5/d1b/d61/dd7 0 2024-09-06T14:44:32.470 INFO:tasks.workunit.client.1.smithi165.stdout:4/634: stat d5/d1b/d61/d77/d7c/daa/lcb 0 2024-09-06T14:44:32.470 INFO:tasks.workunit.client.1.smithi165.stdout:3/637: creat d1/d7c/d98/fcf x:0 0 0 2024-09-06T14:44:32.470 INFO:tasks.workunit.client.1.smithi165.stdout:3/638: stat d1/l6f 0 2024-09-06T14:44:32.473 INFO:tasks.workunit.client.1.smithi165.stdout:4/635: mknod d5/d1b/d1c/d20/cd8 0 2024-09-06T14:44:32.474 INFO:tasks.workunit.client.1.smithi165.stdout:3/639: creat d1/d19/d4d/fd0 x:0 0 0 2024-09-06T14:44:32.479 INFO:tasks.workunit.client.1.smithi165.stdout:3/640: creat d1/d7c/d7e/dc5/fd1 x:0 0 0 2024-09-06T14:44:32.481 INFO:tasks.workunit.client.1.smithi165.stdout:3/641: symlink d1/d7c/ld2 0 2024-09-06T14:44:32.481 INFO:tasks.workunit.client.1.smithi165.stdout:9/765: write db/de/d15/d17/d18/fb3 [874137,104000] 0 2024-09-06T14:44:32.483 INFO:tasks.workunit.client.1.smithi165.stdout:3/642: write d1/d19/d4d/fd0 [861980,72880] 0 2024-09-06T14:44:32.484 INFO:tasks.workunit.client.1.smithi165.stdout:9/766: readlink db/de/d15/d17/d18/d59/le1 0 2024-09-06T14:44:32.486 INFO:tasks.workunit.client.1.smithi165.stdout:3/643: creat d1/da/dc/d3b/d83/fd3 x:0 0 0 2024-09-06T14:44:32.487 INFO:tasks.workunit.client.1.smithi165.stdout:3/644: readlink d1/d4a/l60 0 2024-09-06T14:44:32.487 INFO:tasks.workunit.client.1.smithi165.stdout:4/636: dwrite d5/d1b/d1c/d55/f68 [0,4194304] 0 2024-09-06T14:44:32.490 INFO:tasks.workunit.client.1.smithi165.stdout:3/645: creat d1/da/dc/d10/fd4 x:0 0 0 2024-09-06T14:44:32.493 INFO:tasks.workunit.client.1.smithi165.stdout:4/637: dwrite d5/d1b/d1c/d8c/fad [0,4194304] 0 2024-09-06T14:44:32.494 INFO:tasks.workunit.client.1.smithi165.stdout:4/638: stat d5/d1b/d1c/d20/d75/d83/fb1 0 2024-09-06T14:44:32.495 INFO:tasks.workunit.client.1.smithi165.stdout:3/646: rename d1/da/dc/d10/l3f to d1/d41/ld5 0 2024-09-06T14:44:32.498 INFO:tasks.workunit.client.1.smithi165.stdout:3/647: mknod d1/d4a/dc7/cd6 0 2024-09-06T14:44:32.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/639: creat d5/d1b/d61/d77/d7c/dcd/fd9 x:0 0 0 2024-09-06T14:44:32.504 INFO:tasks.workunit.client.1.smithi165.stdout:3/648: dwrite d1/da/f8e [0,4194304] 0 2024-09-06T14:44:32.506 INFO:tasks.workunit.client.1.smithi165.stdout:4/640: dread d5/d1b/d1c/d8c/f9a [0,4194304] 0 2024-09-06T14:44:32.507 INFO:tasks.workunit.client.1.smithi165.stdout:4/641: chown d5/d1b/d1c/d20/d26/dd4 1 1 2024-09-06T14:44:32.510 INFO:tasks.workunit.client.1.smithi165.stdout:4/642: unlink d5/d1b/d1c/d20/d26/cc0 0 2024-09-06T14:44:32.514 INFO:tasks.workunit.client.1.smithi165.stdout:4/643: fsync d5/d1b/d61/d77/d7c/dcd/fd9 0 2024-09-06T14:44:32.516 INFO:tasks.workunit.client.1.smithi165.stdout:4/644: fsync d5/f8 0 2024-09-06T14:44:32.521 INFO:tasks.workunit.client.1.smithi165.stdout:3/649: dwrite d1/d7c/d7e/fa4 [4194304,4194304] 0 2024-09-06T14:44:32.528 INFO:tasks.workunit.client.1.smithi165.stdout:4/645: dread d5/d1b/d1c/f34 [0,4194304] 0 2024-09-06T14:44:32.532 INFO:tasks.workunit.client.1.smithi165.stdout:3/650: dread d1/d41/f56 [0,4194304] 0 2024-09-06T14:44:32.532 INFO:tasks.workunit.client.1.smithi165.stdout:4/646: link d5/f5a d5/d1b/d1c/d20/d26/dd4/fda 0 2024-09-06T14:44:32.535 INFO:tasks.workunit.client.1.smithi165.stdout:3/651: rename d1/l9 to d1/da/dd/d8c/ld7 0 2024-09-06T14:44:32.536 INFO:tasks.workunit.client.1.smithi165.stdout:3/652: dread - d1/da/dc/d3b/f82 zero size 2024-09-06T14:44:32.536 INFO:tasks.workunit.client.1.smithi165.stdout:5/697: sync 2024-09-06T14:44:32.536 INFO:tasks.workunit.client.1.smithi165.stdout:1/608: sync 2024-09-06T14:44:32.539 INFO:tasks.workunit.client.1.smithi165.stdout:4/647: dwrite d5/d1b/d1c/d20/d75/d83/f64 [0,4194304] 0 2024-09-06T14:44:32.539 INFO:tasks.workunit.client.1.smithi165.stdout:3/653: dread d1/f69 [0,4194304] 0 2024-09-06T14:44:32.541 INFO:tasks.workunit.client.1.smithi165.stdout:5/698: creat d6/d1c/d28/d4b/d55/d8a/de1/f100 x:0 0 0 2024-09-06T14:44:32.542 INFO:tasks.workunit.client.1.smithi165.stdout:1/609: mkdir d0/d2a/d18/d24/d4b/d93/d68/dae/dc6 0 2024-09-06T14:44:32.542 INFO:tasks.workunit.client.1.smithi165.stdout:5/699: readlink d6/l52 0 2024-09-06T14:44:32.542 INFO:tasks.workunit.client.1.smithi165.stdout:3/654: dread d1/d41/f56 [0,4194304] 0 2024-09-06T14:44:32.547 INFO:tasks.workunit.client.1.smithi165.stdout:4/648: dwrite d5/d1b/d1c/d41/f99 [0,4194304] 0 2024-09-06T14:44:32.548 INFO:tasks.workunit.client.1.smithi165.stdout:1/610: symlink d0/d2a/d18/d24/d4b/d93/d2b/d3e/lc7 0 2024-09-06T14:44:32.552 INFO:tasks.workunit.client.1.smithi165.stdout:1/611: mkdir d0/dc8 0 2024-09-06T14:44:32.554 INFO:tasks.workunit.client.1.smithi165.stdout:4/649: symlink d5/d1b/d1c/d8c/ldb 0 2024-09-06T14:44:32.555 INFO:tasks.workunit.client.1.smithi165.stdout:3/655: mknod d1/da/dc/d3b/dc6/d89/cd8 0 2024-09-06T14:44:32.555 INFO:tasks.workunit.client.1.smithi165.stdout:3/656: dread - d1/d19/fb5 zero size 2024-09-06T14:44:32.557 INFO:tasks.workunit.client.1.smithi165.stdout:4/650: mkdir d5/d1b/d1c/d20/d26/ddc 0 2024-09-06T14:44:32.558 INFO:tasks.workunit.client.1.smithi165.stdout:3/657: creat d1/da/dc/d3b/d71/fd9 x:0 0 0 2024-09-06T14:44:32.560 INFO:tasks.workunit.client.1.smithi165.stdout:3/658: creat d1/dbd/fda x:0 0 0 2024-09-06T14:44:32.561 INFO:tasks.workunit.client.1.smithi165.stdout:4/651: unlink d5/d1b/f36 0 2024-09-06T14:44:32.562 INFO:tasks.workunit.client.1.smithi165.stdout:1/612: getdents d0/d2a 0 2024-09-06T14:44:32.563 INFO:tasks.workunit.client.1.smithi165.stdout:3/659: rename d1/da/f26 to d1/dbd/fdb 0 2024-09-06T14:44:32.563 INFO:tasks.workunit.client.1.smithi165.stdout:5/700: dread d6/d1c/d28/d2d/d3c/d81/d8e/f9f [0,4194304] 0 2024-09-06T14:44:32.565 INFO:tasks.workunit.client.1.smithi165.stdout:1/613: mknod d0/d1c/d1d/d57/cc9 0 2024-09-06T14:44:32.566 INFO:tasks.workunit.client.1.smithi165.stdout:4/652: truncate d5/d1b/d66/f85 2258884 0 2024-09-06T14:44:32.566 INFO:tasks.workunit.client.1.smithi165.stdout:1/614: chown d0/d1c/d1d/d57/ca2 2391 1 2024-09-06T14:44:32.568 INFO:tasks.workunit.client.1.smithi165.stdout:4/653: fdatasync d5/d1b/d1c/d55/d7d/fa8 0 2024-09-06T14:44:32.569 INFO:tasks.workunit.client.1.smithi165.stdout:1/615: mknod d0/d1c/d41/cca 0 2024-09-06T14:44:32.570 INFO:tasks.workunit.client.1.smithi165.stdout:5/701: dwrite d6/d1c/d28/d4b/d55/d8a/de1/fb7 [0,4194304] 0 2024-09-06T14:44:32.574 INFO:tasks.workunit.client.1.smithi165.stdout:1/616: unlink d0/d2a/d23/f66 0 2024-09-06T14:44:32.575 INFO:tasks.workunit.client.1.smithi165.stdout:5/702: creat d6/d98/f101 x:0 0 0 2024-09-06T14:44:32.577 INFO:tasks.workunit.client.1.smithi165.stdout:3/660: write d1/da/dc/d3b/fb1 [1662769,101825] 0 2024-09-06T14:44:32.577 INFO:tasks.workunit.client.1.smithi165.stdout:4/654: write d5/d1b/d61/f9d [425989,44564] 0 2024-09-06T14:44:32.579 INFO:tasks.workunit.client.1.smithi165.stdout:3/661: truncate d1/dbd/fc1 1380367 0 2024-09-06T14:44:32.580 INFO:tasks.workunit.client.1.smithi165.stdout:4/655: rmdir d5/db8 39 2024-09-06T14:44:32.580 INFO:tasks.workunit.client.1.smithi165.stdout:4/656: read - d5/d1b/d1c/d20/d26/f95 zero size 2024-09-06T14:44:32.592 INFO:tasks.workunit.client.1.smithi165.stdout:3/662: rename d1/da/dc/d3b/d83/fd3 to d1/da/dc/d3b/d71/fdc 0 2024-09-06T14:44:32.592 INFO:tasks.workunit.client.1.smithi165.stdout:5/703: write d6/d1c/f38 [1690525,85505] 0 2024-09-06T14:44:32.595 INFO:tasks.workunit.client.1.smithi165.stdout:4/657: dread d5/d1b/d1c/d55/f68 [0,4194304] 0 2024-09-06T14:44:32.596 INFO:tasks.workunit.client.1.smithi165.stdout:5/704: creat d6/d1c/d28/d4b/da7/dab/f102 x:0 0 0 2024-09-06T14:44:32.596 INFO:tasks.workunit.client.1.smithi165.stdout:3/663: dread d1/dbd/fc1 [0,4194304] 0 2024-09-06T14:44:32.597 INFO:tasks.workunit.client.1.smithi165.stdout:5/705: truncate d6/f13 4607392 0 2024-09-06T14:44:32.598 INFO:tasks.workunit.client.1.smithi165.stdout:5/706: write d6/dc1/fe2 [789154,49893] 0 2024-09-06T14:44:32.599 INFO:tasks.workunit.client.1.smithi165.stdout:3/664: creat d1/da/dc/d3b/fdd x:0 0 0 2024-09-06T14:44:32.600 INFO:tasks.workunit.client.1.smithi165.stdout:4/658: symlink d5/d1b/d1c/d20/d75/d83/d9f/ldd 0 2024-09-06T14:44:32.600 INFO:tasks.workunit.client.1.smithi165.stdout:4/659: dread - d5/d1b/d1c/d55/f56 zero size 2024-09-06T14:44:32.602 INFO:tasks.workunit.client.1.smithi165.stdout:5/707: unlink d6/c77 0 2024-09-06T14:44:32.604 INFO:tasks.workunit.client.1.smithi165.stdout:5/708: chown d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/la2 52 1 2024-09-06T14:44:32.604 INFO:tasks.workunit.client.1.smithi165.stdout:4/660: symlink d5/d1b/d1c/d55/d7d/lde 0 2024-09-06T14:44:32.604 INFO:tasks.workunit.client.1.smithi165.stdout:5/709: write d6/d1c/f9c [1723967,90322] 0 2024-09-06T14:44:32.604 INFO:tasks.workunit.client.1.smithi165.stdout:4/661: stat d5/d1b/d66 0 2024-09-06T14:44:32.605 INFO:tasks.workunit.client.1.smithi165.stdout:5/710: chown d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/de8 165068201 1 2024-09-06T14:44:32.606 INFO:tasks.workunit.client.1.smithi165.stdout:3/665: link d1/da/dd/d4b/f5f d1/da/dc/d3b/d83/fde 0 2024-09-06T14:44:32.607 INFO:tasks.workunit.client.1.smithi165.stdout:5/711: dread d6/d1c/f3a [0,4194304] 0 2024-09-06T14:44:32.607 INFO:tasks.workunit.client.1.smithi165.stdout:4/662: rename d5/d1b/d1c/d20/d26 to d5/d1b/d61/dd7/ddf 0 2024-09-06T14:44:32.608 INFO:tasks.workunit.client.1.smithi165.stdout:3/666: getdents d1/da/dd/d8c/dae 0 2024-09-06T14:44:32.610 INFO:tasks.workunit.client.1.smithi165.stdout:3/667: creat d1/d4a/dc7/fdf x:0 0 0 2024-09-06T14:44:32.611 INFO:tasks.workunit.client.1.smithi165.stdout:5/712: creat d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/f103 x:0 0 0 2024-09-06T14:44:32.612 INFO:tasks.workunit.client.1.smithi165.stdout:4/663: dread d5/d1b/d1c/d20/d75/d83/f62 [0,4194304] 0 2024-09-06T14:44:32.617 INFO:tasks.workunit.client.1.smithi165.stdout:5/713: rename d6/d1c/d28/d2d/d3c/d81/lec to d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/l104 0 2024-09-06T14:44:32.618 INFO:tasks.workunit.client.1.smithi165.stdout:4/664: dwrite d5/d1b/d1c/d20/d75/d83/f64 [0,4194304] 0 2024-09-06T14:44:32.618 INFO:tasks.workunit.client.1.smithi165.stdout:5/714: dread - d6/dc1/fcf zero size 2024-09-06T14:44:32.620 INFO:tasks.workunit.client.1.smithi165.stdout:4/665: write d5/d1b/d1c/d8c/fad [5101326,121488] 0 2024-09-06T14:44:32.620 INFO:tasks.workunit.client.1.smithi165.stdout:5/715: write d6/d1c/d28/d2d/d3c/d44/d90/ddf/fd2 [1674977,11143] 0 2024-09-06T14:44:32.621 INFO:tasks.workunit.client.1.smithi165.stdout:5/716: dread - d6/dc1/fcf zero size 2024-09-06T14:44:32.623 INFO:tasks.workunit.client.1.smithi165.stdout:3/668: dread d1/f2 [0,4194304] 0 2024-09-06T14:44:32.624 INFO:tasks.workunit.client.1.smithi165.stdout:7/521: sync 2024-09-06T14:44:32.624 INFO:tasks.workunit.client.1.smithi165.stdout:2/548: sync 2024-09-06T14:44:32.625 INFO:tasks.workunit.client.1.smithi165.stdout:3/669: write d1/da/dc/d10/f35 [3827472,2905] 0 2024-09-06T14:44:32.628 INFO:tasks.workunit.client.1.smithi165.stdout:3/670: truncate d1/da/dc/d10/fd4 63279 0 2024-09-06T14:44:32.631 INFO:tasks.workunit.client.1.smithi165.stdout:7/522: rmdir d20/d3b/d69/d88/d80/d81 39 2024-09-06T14:44:32.631 INFO:tasks.workunit.client.1.smithi165.stdout:2/549: chown d9/l21 57856791 1 2024-09-06T14:44:32.632 INFO:tasks.workunit.client.1.smithi165.stdout:5/717: dwrite d6/d1c/d28/d4b/d55/d8a/fa0 [0,4194304] 0 2024-09-06T14:44:32.633 INFO:tasks.workunit.client.1.smithi165.stdout:5/718: chown d6/d1c/f9c 934 1 2024-09-06T14:44:32.633 INFO:tasks.workunit.client.1.smithi165.stdout:7/523: chown d20/d33/d6a/d9a/la1 185204 1 2024-09-06T14:44:32.635 INFO:tasks.workunit.client.1.smithi165.stdout:3/671: dread d1/da/dd/fe [4194304,4194304] 0 2024-09-06T14:44:32.640 INFO:tasks.workunit.client.1.smithi165.stdout:7/524: rename d20/f70 to d20/d3b/d69/da3/fa9 0 2024-09-06T14:44:32.640 INFO:tasks.workunit.client.1.smithi165.stdout:2/550: dwrite d9/d23/d29/d48/d8c/f86 [0,4194304] 0 2024-09-06T14:44:32.642 INFO:tasks.workunit.client.1.smithi165.stdout:3/672: mkdir d1/d19/d92/de0 0 2024-09-06T14:44:32.648 INFO:tasks.workunit.client.1.smithi165.stdout:3/673: chown d1/da/c70 52011 1 2024-09-06T14:44:32.650 INFO:tasks.workunit.client.1.smithi165.stdout:3/674: write d1/da/dc/d3b/f82 [134393,96408] 0 2024-09-06T14:44:32.650 INFO:tasks.workunit.client.1.smithi165.stdout:2/551: link d9/d25/d45/d75/fb3 d9/d25/d46/d7e/d90/fb4 0 2024-09-06T14:44:32.652 INFO:tasks.workunit.client.1.smithi165.stdout:7/525: getdents d20/d65/d82/d97 0 2024-09-06T14:44:32.653 INFO:tasks.workunit.client.1.smithi165.stdout:2/552: read d9/d25/f61 [206830,115420] 0 2024-09-06T14:44:32.654 INFO:tasks.workunit.client.1.smithi165.stdout:4/666: dwrite d5/d1b/d66/f85 [0,4194304] 0 2024-09-06T14:44:32.654 INFO:tasks.workunit.client.1.smithi165.stdout:7/526: fsync d20/d3b/d69/d88/f94 0 2024-09-06T14:44:32.659 INFO:tasks.workunit.client.1.smithi165.stdout:7/527: mknod d20/d65/d82/caa 0 2024-09-06T14:44:32.659 INFO:tasks.workunit.client.1.smithi165.stdout:4/667: write d5/d1b/d1c/f4f [824977,126596] 0 2024-09-06T14:44:32.660 INFO:tasks.workunit.client.1.smithi165.stdout:2/553: creat d9/d23/d52/daa/fb5 x:0 0 0 2024-09-06T14:44:32.661 INFO:tasks.workunit.client.1.smithi165.stdout:3/675: dwrite d1/d4a/dc7/fdf [0,4194304] 0 2024-09-06T14:44:32.662 INFO:tasks.workunit.client.1.smithi165.stdout:4/668: chown d5/d1b/d1c/f60 43699792 1 2024-09-06T14:44:32.663 INFO:tasks.workunit.client.1.smithi165.stdout:7/528: symlink d20/d3b/lab 0 2024-09-06T14:44:32.664 INFO:tasks.workunit.client.1.smithi165.stdout:2/554: creat d9/d23/d29/d48/fb6 x:0 0 0 2024-09-06T14:44:32.665 INFO:tasks.workunit.client.1.smithi165.stdout:3/676: symlink d1/d19/d92/le1 0 2024-09-06T14:44:32.665 INFO:tasks.workunit.client.1.smithi165.stdout:4/669: rmdir d5/d1b/d1c/d78/da9 39 2024-09-06T14:44:32.671 INFO:tasks.workunit.client.1.smithi165.stdout:2/555: dwrite d9/d25/d45/f63 [0,4194304] 0 2024-09-06T14:44:32.671 INFO:tasks.workunit.client.1.smithi165.stdout:7/529: rename d20/d33/c60 to d20/d3b/d69/d88/d80/cac 0 2024-09-06T14:44:32.677 INFO:tasks.workunit.client.1.smithi165.stdout:4/670: rename d5/f8a to d5/d1b/d1c/d41/fe0 0 2024-09-06T14:44:32.681 INFO:tasks.workunit.client.1.smithi165.stdout:2/556: dwrite d9/d25/f57 [0,4194304] 0 2024-09-06T14:44:32.681 INFO:tasks.workunit.client.1.smithi165.stdout:4/671: creat d5/d1b/d1c/d41/d9e/fe1 x:0 0 0 2024-09-06T14:44:32.683 INFO:tasks.workunit.client.1.smithi165.stdout:2/557: creat d9/d88/dac/fb7 x:0 0 0 2024-09-06T14:44:32.684 INFO:tasks.workunit.client.1.smithi165.stdout:4/672: symlink d5/d1b/d1c/d41/d9e/le2 0 2024-09-06T14:44:32.685 INFO:tasks.workunit.client.1.smithi165.stdout:2/558: mkdir d9/d88/db8 0 2024-09-06T14:44:32.693 INFO:tasks.workunit.client.1.smithi165.stdout:2/559: dread d9/d25/f61 [0,4194304] 0 2024-09-06T14:44:32.694 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:32 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:32.697 INFO:tasks.workunit.client.1.smithi165.stdout:2/560: creat d9/d25/d46/d7e/d90/fb9 x:0 0 0 2024-09-06T14:44:32.698 INFO:tasks.workunit.client.1.smithi165.stdout:4/673: dread d5/d1b/d1c/d20/d75/d83/f4d [0,4194304] 0 2024-09-06T14:44:32.699 INFO:tasks.workunit.client.1.smithi165.stdout:7/530: truncate d20/d3b/d69/d88/f4e 828647 0 2024-09-06T14:44:32.700 INFO:tasks.workunit.client.1.smithi165.stdout:4/674: creat d5/d1b/d61/dd7/fe3 x:0 0 0 2024-09-06T14:44:32.701 INFO:tasks.workunit.client.1.smithi165.stdout:4/675: chown d5/d1b/d1c/d55/fa7 20 1 2024-09-06T14:44:32.704 INFO:tasks.workunit.client.1.smithi165.stdout:7/531: link d20/d65/f6c d20/d3b/d69/d88/d30/fad 0 2024-09-06T14:44:32.707 INFO:tasks.workunit.client.1.smithi165.stdout:4/676: dwrite d5/d1b/d1c/d55/d7d/fa8 [0,4194304] 0 2024-09-06T14:44:32.707 INFO:tasks.workunit.client.1.smithi165.stdout:7/532: rename d20/d65/l3d to d20/d65/d82/lae 0 2024-09-06T14:44:32.709 INFO:tasks.workunit.client.1.smithi165.stdout:2/561: truncate d9/d25/d45/d75/d67/d76/f3c 3242363 0 2024-09-06T14:44:32.709 INFO:tasks.workunit.client.1.smithi165.stdout:7/533: fdatasync d20/d4d/d54/fa4 0 2024-09-06T14:44:32.710 INFO:tasks.workunit.client.1.smithi165.stdout:7/534: fsync d20/d3b/d69/d88/d30/f83 0 2024-09-06T14:44:32.710 INFO:tasks.workunit.client.1.smithi165.stdout:4/677: creat d5/d1b/d1c/d8c/fe4 x:0 0 0 2024-09-06T14:44:32.711 INFO:tasks.workunit.client.1.smithi165.stdout:2/562: dread - d9/d23/d52/fa9 zero size 2024-09-06T14:44:32.715 INFO:tasks.workunit.client.1.smithi165.stdout:6/668: sync 2024-09-06T14:44:32.715 INFO:tasks.workunit.client.1.smithi165.stdout:8/667: sync 2024-09-06T14:44:32.715 INFO:tasks.workunit.client.1.smithi165.stdout:9/767: sync 2024-09-06T14:44:32.715 INFO:tasks.workunit.client.1.smithi165.stdout:0/604: sync 2024-09-06T14:44:32.716 INFO:tasks.workunit.client.1.smithi165.stdout:4/678: creat d5/d1b/d1c/d20/d75/d83/fe5 x:0 0 0 2024-09-06T14:44:32.717 INFO:tasks.workunit.client.1.smithi165.stdout:7/535: dwrite f1f [8388608,4194304] 0 2024-09-06T14:44:32.719 INFO:tasks.workunit.client.1.smithi165.stdout:4/679: dread - d5/d1b/d61/dd7/fe3 zero size 2024-09-06T14:44:32.719 INFO:tasks.workunit.client.1.smithi165.stdout:7/536: write d20/d3b/f3f [5097473,93496] 0 2024-09-06T14:44:32.723 INFO:tasks.workunit.client.1.smithi165.stdout:0/605: mknod d15/d19/d50/d53/d7c/dbb/ccb 0 2024-09-06T14:44:32.723 INFO:tasks.workunit.client.1.smithi165.stdout:0/606: dread - d15/d19/fc0 zero size 2024-09-06T14:44:32.724 INFO:tasks.workunit.client.0.smithi052.stdout:3/2: sync 2024-09-06T14:44:32.724 INFO:tasks.workunit.client.0.smithi052.stdout:3/3: unlink - no file 2024-09-06T14:44:32.726 INFO:tasks.workunit.client.1.smithi165.stdout:0/607: truncate d15/d19/d2c/f36 218999 0 2024-09-06T14:44:32.727 INFO:tasks.workunit.client.1.smithi165.stdout:6/669: dwrite d29/d39/d5b/d62/d94/db7/dba/fc9 [0,4194304] 0 2024-09-06T14:44:32.728 INFO:tasks.workunit.client.1.smithi165.stdout:4/680: rmdir d5/d1b/d1c/d20/d75 39 2024-09-06T14:44:32.729 INFO:tasks.workunit.client.1.smithi165.stdout:9/768: read db/de/d15/d17/d86/fac [6712605,90802] 0 2024-09-06T14:44:32.731 INFO:tasks.workunit.client.1.smithi165.stdout:7/537: getdents d20/d3b/d8c 0 2024-09-06T14:44:32.733 INFO:tasks.workunit.client.1.smithi165.stdout:6/670: creat d29/d6a/d71/fcb x:0 0 0 2024-09-06T14:44:32.734 INFO:tasks.workunit.client.1.smithi165.stdout:4/681: dread d5/d1b/d66/f85 [0,4194304] 0 2024-09-06T14:44:32.735 INFO:tasks.workunit.client.0.smithi052.stdout:3/4: mkdir d0 0 2024-09-06T14:44:32.735 INFO:tasks.workunit.client.0.smithi052.stdout:3/5: chown d0 174353460 1 2024-09-06T14:44:32.736 INFO:tasks.workunit.client.0.smithi052.stdout:3/6: fsync - no filename 2024-09-06T14:44:32.736 INFO:tasks.workunit.client.0.smithi052.stdout:3/7: truncate - no filename 2024-09-06T14:44:32.738 INFO:tasks.workunit.client.1.smithi165.stdout:2/563: dread d9/d4f/f5e [0,4194304] 0 2024-09-06T14:44:32.742 INFO:tasks.workunit.client.0.smithi052.stdout:3/8: symlink d0/l1 0 2024-09-06T14:44:32.742 INFO:tasks.workunit.client.0.smithi052.stdout:3/9: fdatasync - no filename 2024-09-06T14:44:32.742 INFO:tasks.workunit.client.0.smithi052.stdout:3/10: write - no filename 2024-09-06T14:44:32.742 INFO:tasks.workunit.client.0.smithi052.stdout:3/11: dread - no filename 2024-09-06T14:44:32.742 INFO:tasks.workunit.client.0.smithi052.stdout:3/12: chown d0/l1 2614702 1 2024-09-06T14:44:32.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/13: dwrite - no filename 2024-09-06T14:44:32.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/14: dread - no filename 2024-09-06T14:44:32.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/15: rename d0 to d0/d2 22 2024-09-06T14:44:32.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/16: unlink d0/l1 0 2024-09-06T14:44:32.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/17: dwrite - no filename 2024-09-06T14:44:32.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/18: dwrite - no filename 2024-09-06T14:44:32.747 INFO:tasks.workunit.client.0.smithi052.stdout:3/19: dwrite - no filename 2024-09-06T14:44:32.749 INFO:tasks.workunit.client.1.smithi165.stdout:8/668: dwrite d0/d14/d3e/f47 [0,4194304] 0 2024-09-06T14:44:32.750 INFO:tasks.workunit.client.1.smithi165.stdout:0/608: dread d15/d19/d28/d3a/f96 [0,4194304] 0 2024-09-06T14:44:32.750 INFO:tasks.workunit.client.1.smithi165.stdout:9/769: unlink db/de/d16/d2e/l6f 0 2024-09-06T14:44:32.750 INFO:tasks.workunit.client.1.smithi165.stdout:9/770: readlink l3 0 2024-09-06T14:44:32.752 INFO:tasks.workunit.client.0.smithi052.stdout:3/20: creat d0/f3 x:0 0 0 2024-09-06T14:44:32.756 INFO:tasks.workunit.client.1.smithi165.stdout:7/538: dwrite d20/d4d/d54/f9d [4194304,4194304] 0 2024-09-06T14:44:32.760 INFO:tasks.workunit.client.1.smithi165.stdout:6/671: dwrite f28 [0,4194304] 0 2024-09-06T14:44:32.762 INFO:tasks.workunit.client.1.smithi165.stdout:2/564: rename d9/f1c to d9/d25/d45/d75/fba 0 2024-09-06T14:44:32.764 INFO:tasks.workunit.client.1.smithi165.stdout:8/669: creat d0/d34/d6b/d94/d70/db7/fe7 x:0 0 0 2024-09-06T14:44:32.765 INFO:tasks.workunit.client.1.smithi165.stdout:7/539: fdatasync ff 0 2024-09-06T14:44:32.766 INFO:tasks.workunit.client.1.smithi165.stdout:8/670: stat d0/d14/d3e/db4/fdb 0 2024-09-06T14:44:32.769 INFO:tasks.workunit.client.1.smithi165.stdout:0/609: dwrite d15/d19/d28/d3a/d3f/f48 [0,4194304] 0 2024-09-06T14:44:32.769 INFO:tasks.workunit.client.1.smithi165.stdout:7/540: read d20/d3b/f86 [532185,84138] 0 2024-09-06T14:44:32.769 INFO:tasks.workunit.client.0.smithi052.stdout:3/21: fsync d0/f3 0 2024-09-06T14:44:32.770 INFO:tasks.workunit.client.1.smithi165.stdout:0/610: chown d15/d19/d2c/fb5 3726 1 2024-09-06T14:44:32.771 INFO:tasks.workunit.client.0.smithi052.stdout:3/22: dread - d0/f3 zero size 2024-09-06T14:44:32.771 INFO:tasks.workunit.client.0.smithi052.stdout:3/23: chown d0 91094959 1 2024-09-06T14:44:32.771 INFO:tasks.workunit.client.1.smithi165.stdout:7/541: stat d20/d3b/d69/d88/d30/d78/ca8 0 2024-09-06T14:44:32.771 INFO:tasks.workunit.client.1.smithi165.stdout:4/682: getdents d5/d1b/d61/d77/d7c/dcd 0 2024-09-06T14:44:32.774 INFO:tasks.workunit.client.0.smithi052.stdout:3/24: rmdir d0 39 2024-09-06T14:44:32.776 INFO:tasks.workunit.client.0.smithi052.stdout:3/25: dread - d0/f3 zero size 2024-09-06T14:44:32.777 INFO:tasks.workunit.client.1.smithi165.stdout:1/617: sync 2024-09-06T14:44:32.777 INFO:tasks.workunit.client.1.smithi165.stdout:5/719: sync 2024-09-06T14:44:32.778 INFO:tasks.workunit.client.1.smithi165.stdout:9/771: rmdir db/de/d15/d7f/dda 0 2024-09-06T14:44:32.779 INFO:tasks.workunit.client.1.smithi165.stdout:0/611: mkdir d15/d6e/dcc 0 2024-09-06T14:44:32.782 INFO:tasks.workunit.client.1.smithi165.stdout:2/565: symlink d9/d25/d45/d75/da5/lbb 0 2024-09-06T14:44:32.782 INFO:tasks.workunit.client.1.smithi165.stdout:2/566: truncate d9/f84 736714 0 2024-09-06T14:44:32.784 INFO:tasks.workunit.client.0.smithi052.stdout:3/26: dwrite d0/f3 [0,4194304] 0 2024-09-06T14:44:32.787 INFO:tasks.workunit.client.1.smithi165.stdout:5/720: mkdir d6/d1c/d28/d88/d105 0 2024-09-06T14:44:32.787 INFO:tasks.workunit.client.1.smithi165.stdout:1/618: rmdir d0/d2a/d18/d24/d4b/d93 39 2024-09-06T14:44:32.787 INFO:tasks.workunit.client.1.smithi165.stdout:9/772: mkdir db/dcf/df2 0 2024-09-06T14:44:32.788 INFO:tasks.workunit.client.1.smithi165.stdout:7/542: symlink d20/d33/d53/d66/laf 0 2024-09-06T14:44:32.789 INFO:tasks.workunit.client.1.smithi165.stdout:5/721: write d6/d32/f3f [3973897,109720] 0 2024-09-06T14:44:32.790 INFO:tasks.workunit.client.1.smithi165.stdout:7/543: write d20/f2b [432944,3671] 0 2024-09-06T14:44:32.790 INFO:tasks.workunit.client.0.smithi052.stdout:3/27: mknod d0/c4 0 2024-09-06T14:44:32.792 INFO:tasks.workunit.client.1.smithi165.stdout:0/612: symlink d15/d19/d50/d53/d7c/d9a/lcd 0 2024-09-06T14:44:32.794 INFO:tasks.workunit.client.1.smithi165.stdout:4/683: creat d5/d1b/d61/dd7/ddf/dd4/fe6 x:0 0 0 2024-09-06T14:44:32.795 INFO:tasks.workunit.client.0.smithi052.stdout:3/28: rename d0/c4 to d0/c5 0 2024-09-06T14:44:32.795 INFO:tasks.workunit.client.1.smithi165.stdout:6/672: dread d29/d32/f50 [0,4194304] 0 2024-09-06T14:44:32.796 INFO:tasks.workunit.client.0.smithi052.stdout:3/29: write d0/f3 [4075213,74671] 0 2024-09-06T14:44:32.796 INFO:tasks.workunit.client.1.smithi165.stdout:2/567: rename d9/d88/dac/c73 to d9/d88/cbc 0 2024-09-06T14:44:32.798 INFO:tasks.workunit.client.1.smithi165.stdout:9/773: dread db/de/d15/d7f/d9b/d6c/f7a [0,4194304] 0 2024-09-06T14:44:32.798 INFO:tasks.workunit.client.0.smithi052.stdout:5/3: sync 2024-09-06T14:44:32.799 INFO:tasks.workunit.client.0.smithi052.stdout:6/5: sync 2024-09-06T14:44:32.799 INFO:tasks.workunit.client.0.smithi052.stdout:8/14: sync 2024-09-06T14:44:32.799 INFO:tasks.workunit.client.0.smithi052.stdout:4/0: sync 2024-09-06T14:44:32.799 INFO:tasks.workunit.client.1.smithi165.stdout:6/673: write d29/d39/d5b/d62/d94/fb1 [880624,23564] 0 2024-09-06T14:44:32.799 INFO:tasks.workunit.client.1.smithi165.stdout:2/568: write d9/d23/f99 [49042,87144] 0 2024-09-06T14:44:32.800 INFO:tasks.workunit.client.1.smithi165.stdout:8/671: rename d0/d19/la3 to d0/d19/le8 0 2024-09-06T14:44:32.801 INFO:tasks.workunit.client.0.smithi052.stdout:8/15: stat f1 0 2024-09-06T14:44:32.802 INFO:tasks.workunit.client.0.smithi052.stdout:3/30: creat d0/f6 x:0 0 0 2024-09-06T14:44:32.804 INFO:tasks.workunit.client.1.smithi165.stdout:4/684: dwrite d5/d1b/d61/dd7/fe3 [0,4194304] 0 2024-09-06T14:44:32.807 INFO:tasks.workunit.client.1.smithi165.stdout:1/619: mknod d0/d2a/d18/d24/d4b/d5f/ccb 0 2024-09-06T14:44:32.808 INFO:tasks.workunit.client.0.smithi052.stdout:5/4: dread f0 [0,4194304] 0 2024-09-06T14:44:32.808 INFO:tasks.workunit.client.1.smithi165.stdout:6/674: dwrite f1d [4194304,4194304] 0 2024-09-06T14:44:32.817 INFO:tasks.workunit.client.1.smithi165.stdout:0/613: truncate d15/d55/f84 775415 0 2024-09-06T14:44:32.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/5: rename f0 to f1 0 2024-09-06T14:44:32.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/6: readlink - no filename 2024-09-06T14:44:32.827 INFO:tasks.workunit.client.0.smithi052.stdout:5/7: mkdir d2 0 2024-09-06T14:44:32.828 INFO:tasks.workunit.client.1.smithi165.stdout:9/774: mknod db/de/d15/d17/d18/d59/d64/cf3 0 2024-09-06T14:44:32.829 INFO:tasks.workunit.client.1.smithi165.stdout:4/685: symlink d5/d1b/d1c/d55/d7d/le7 0 2024-09-06T14:44:32.833 INFO:tasks.workunit.client.1.smithi165.stdout:2/569: dwrite d9/d88/dac/da4/fa8 [0,4194304] 0 2024-09-06T14:44:32.833 INFO:tasks.workunit.client.0.smithi052.stdout:6/6: dwrite f0 [0,4194304] 0 2024-09-06T14:44:32.834 INFO:tasks.workunit.client.1.smithi165.stdout:2/570: chown d9/d25/d45/d75/d67/d76/l7d 1295 1 2024-09-06T14:44:32.834 INFO:tasks.workunit.client.0.smithi052.stdout:8/16: dwrite f1 [0,4194304] 0 2024-09-06T14:44:32.835 INFO:tasks.workunit.client.1.smithi165.stdout:6/675: mkdir d29/d39/d5b/d62/d94/db7/dcc 0 2024-09-06T14:44:32.836 INFO:tasks.workunit.client.1.smithi165.stdout:8/672: dread d0/d19/d36/f7 [0,4194304] 0 2024-09-06T14:44:32.836 INFO:tasks.workunit.client.0.smithi052.stdout:3/31: getdents d0 0 2024-09-06T14:44:32.836 INFO:tasks.workunit.client.0.smithi052.stdout:3/32: readlink - no filename 2024-09-06T14:44:32.837 INFO:tasks.workunit.client.0.smithi052.stdout:3/33: write d0/f3 [4849927,63999] 0 2024-09-06T14:44:32.840 INFO:tasks.workunit.client.0.smithi052.stdout:3/34: write d0/f6 [547252,123098] 0 2024-09-06T14:44:32.844 INFO:tasks.workunit.client.0.smithi052.stdout:8/17: mknod c4 0 2024-09-06T14:44:32.847 INFO:tasks.workunit.client.1.smithi165.stdout:5/722: truncate d6/d1c/f1e 2157918 0 2024-09-06T14:44:32.851 INFO:tasks.workunit.client.1.smithi165.stdout:2/571: fsync d9/d25/d45/d75/d67/d76/f77 0 2024-09-06T14:44:32.851 INFO:tasks.workunit.client.0.smithi052.stdout:3/35: mkdir d0/d7 0 2024-09-06T14:44:32.853 INFO:tasks.workunit.client.1.smithi165.stdout:8/673: mkdir d0/d34/d6b/d94/d70/de9 0 2024-09-06T14:44:32.853 INFO:tasks.workunit.client.1.smithi165.stdout:5/723: dwrite d6/fac [0,4194304] 0 2024-09-06T14:44:32.854 INFO:tasks.workunit.client.1.smithi165.stdout:0/614: mknod d15/d19/d28/cce 0 2024-09-06T14:44:32.854 INFO:tasks.workunit.client.0.smithi052.stdout:6/7: dwrite f0 [4194304,4194304] 0 2024-09-06T14:44:32.855 INFO:tasks.workunit.client.1.smithi165.stdout:5/724: readlink d6/dc1/lc3 0 2024-09-06T14:44:32.855 INFO:tasks.workunit.client.0.smithi052.stdout:8/18: rename c3 to c5 0 2024-09-06T14:44:32.858 INFO:tasks.workunit.client.1.smithi165.stdout:7/544: rename d20/d3b/f6d to d20/d33/d53/fb0 0 2024-09-06T14:44:32.858 INFO:tasks.workunit.client.0.smithi052.stdout:5/8: write f1 [1160765,489] 0 2024-09-06T14:44:32.859 INFO:tasks.workunit.client.1.smithi165.stdout:9/775: getdents db/de/d15/d7f/d9b/de7 0 2024-09-06T14:44:32.860 INFO:tasks.workunit.client.0.smithi052.stdout:8/19: mkdir d6 0 2024-09-06T14:44:32.861 INFO:tasks.workunit.client.0.smithi052.stdout:8/20: write f1 [3931953,125244] 0 2024-09-06T14:44:32.864 INFO:tasks.workunit.client.1.smithi165.stdout:7/545: dread d20/d33/d53/fb0 [0,4194304] 0 2024-09-06T14:44:32.864 INFO:tasks.workunit.client.1.smithi165.stdout:2/572: creat d9/d3b/fbd x:0 0 0 2024-09-06T14:44:32.864 INFO:tasks.workunit.client.1.smithi165.stdout:6/676: creat d29/d93/d87/db9/fcd x:0 0 0 2024-09-06T14:44:32.865 INFO:tasks.workunit.client.1.smithi165.stdout:9/776: dread db/de/d15/d7f/d9b/d6c/f75 [0,4194304] 0 2024-09-06T14:44:32.865 INFO:tasks.workunit.client.0.smithi052.stdout:3/36: link d0/c5 d0/c8 0 2024-09-06T14:44:32.867 INFO:tasks.workunit.client.1.smithi165.stdout:7/546: fdatasync d20/d3b/d69/d88/f94 0 2024-09-06T14:44:32.868 INFO:tasks.workunit.client.0.smithi052.stdout:5/9: getdents d2 0 2024-09-06T14:44:32.868 INFO:tasks.workunit.client.1.smithi165.stdout:9/777: write db/de/d15/d17/d18/f5d [1591925,81617] 0 2024-09-06T14:44:32.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/21: mknod d6/c7 0 2024-09-06T14:44:32.872 INFO:tasks.workunit.client.1.smithi165.stdout:6/677: dread d29/d39/d5b/d62/d9f/fc0 [0,4194304] 0 2024-09-06T14:44:32.874 INFO:tasks.workunit.client.0.smithi052.stdout:3/37: stat d0/c8 0 2024-09-06T14:44:32.875 INFO:tasks.workunit.client.0.smithi052.stdout:3/38: write d0/f6 [560597,90811] 0 2024-09-06T14:44:32.875 INFO:tasks.workunit.client.0.smithi052.stdout:8/22: mkdir d6/d8 0 2024-09-06T14:44:32.878 INFO:tasks.workunit.client.0.smithi052.stdout:5/10: link f1 d2/f3 0 2024-09-06T14:44:32.878 INFO:tasks.workunit.client.0.smithi052.stdout:5/11: readlink - no filename 2024-09-06T14:44:32.879 INFO:tasks.workunit.client.0.smithi052.stdout:3/39: fsync d0/f6 0 2024-09-06T14:44:32.884 INFO:tasks.workunit.client.1.smithi165.stdout:3/677: sync 2024-09-06T14:44:32.884 INFO:tasks.workunit.client.1.smithi165.stdout:8/674: dread d0/d19/d36/d28/f3d [0,4194304] 0 2024-09-06T14:44:32.886 INFO:tasks.workunit.client.1.smithi165.stdout:4/686: dwrite d5/f58 [0,4194304] 0 2024-09-06T14:44:32.888 INFO:tasks.workunit.client.0.smithi052.stdout:3/40: creat d0/f9 x:0 0 0 2024-09-06T14:44:32.889 INFO:tasks.workunit.client.0.smithi052.stdout:3/41: chown d0/f6 717006103 1 2024-09-06T14:44:32.890 INFO:tasks.workunit.client.1.smithi165.stdout:2/573: symlink d9/d88/dac/d95/lbe 0 2024-09-06T14:44:32.891 INFO:tasks.workunit.client.0.smithi052.stdout:8/23: getdents d6/d8 0 2024-09-06T14:44:32.892 INFO:tasks.workunit.client.0.smithi052.stdout:8/24: read f1 [4033395,7153] 0 2024-09-06T14:44:32.894 INFO:tasks.workunit.client.1.smithi165.stdout:9/778: rename db/de/d15/d17/d86/fb6 to db/de/d15/d7f/d9b/d6c/daf/de6/ff4 0 2024-09-06T14:44:32.895 INFO:tasks.workunit.client.1.smithi165.stdout:2/574: dread d9/d25/d45/f63 [0,4194304] 0 2024-09-06T14:44:32.896 INFO:tasks.workunit.client.1.smithi165.stdout:9/779: chown db/de/d15/d17/d18/d59/d64/l67 801 1 2024-09-06T14:44:32.898 INFO:tasks.workunit.client.1.smithi165.stdout:0/615: rmdir d15/db9 0 2024-09-06T14:44:32.899 INFO:tasks.workunit.client.0.smithi052.stdout:3/42: dwrite d0/f9 [0,4194304] 0 2024-09-06T14:44:32.901 INFO:tasks.workunit.client.0.smithi052.stdout:3/43: fdatasync d0/f3 0 2024-09-06T14:44:32.901 INFO:tasks.workunit.client.0.smithi052.stdout:8/25: dread f1 [0,4194304] 0 2024-09-06T14:44:32.901 INFO:tasks.workunit.client.0.smithi052.stdout:8/26: readlink l0 0 2024-09-06T14:44:32.902 INFO:tasks.workunit.client.0.smithi052.stdout:8/27: stat c4 0 2024-09-06T14:44:32.902 INFO:tasks.workunit.client.0.smithi052.stdout:3/44: chown d0/f3 18356 1 2024-09-06T14:44:32.905 INFO:tasks.workunit.client.1.smithi165.stdout:4/687: dread d5/d1b/d1c/d41/fe0 [0,4194304] 0 2024-09-06T14:44:32.905 INFO:tasks.workunit.client.0.smithi052.stdout:8/28: dread f1 [0,4194304] 0 2024-09-06T14:44:32.906 INFO:tasks.workunit.client.1.smithi165.stdout:4/688: chown d5/d1b/d1c/d78/f92 4312 1 2024-09-06T14:44:32.907 INFO:tasks.workunit.client.1.smithi165.stdout:3/678: creat d1/dbd/fe2 x:0 0 0 2024-09-06T14:44:32.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/45: mknod d0/ca 0 2024-09-06T14:44:32.911 INFO:tasks.workunit.client.1.smithi165.stdout:8/675: dread d0/d19/d36/d2d/d33/d3a/d46/f7e [4194304,4194304] 0 2024-09-06T14:44:32.912 INFO:tasks.workunit.client.1.smithi165.stdout:3/679: dread d1/d19/f90 [0,4194304] 0 2024-09-06T14:44:32.912 INFO:tasks.workunit.client.1.smithi165.stdout:8/676: readlink d0/d14/d3e/dcf/l87 0 2024-09-06T14:44:32.913 INFO:tasks.workunit.client.1.smithi165.stdout:8/677: chown d0/d19/d36/d2d/d3f/daf 572569 1 2024-09-06T14:44:32.917 INFO:tasks.workunit.client.1.smithi165.stdout:7/547: dwrite d20/d3b/d69/d88/d30/f39 [0,4194304] 0 2024-09-06T14:44:32.919 INFO:tasks.workunit.client.1.smithi165.stdout:2/575: mkdir d9/d23/d29/d48/d8c/dbf 0 2024-09-06T14:44:32.920 INFO:tasks.workunit.client.0.smithi052.stdout:3/46: rmdir d0/d7 0 2024-09-06T14:44:32.922 INFO:tasks.workunit.client.1.smithi165.stdout:0/616: rmdir d15/d19/d50/d53 39 2024-09-06T14:44:32.922 INFO:tasks.workunit.client.0.smithi052.stdout:3/47: mkdir d0/db 0 2024-09-06T14:44:32.926 INFO:tasks.workunit.client.0.smithi052.stdout:3/48: creat d0/fc x:0 0 0 2024-09-06T14:44:32.926 INFO:tasks.workunit.client.0.smithi052.stdout:3/49: dread - d0/fc zero size 2024-09-06T14:44:32.927 INFO:tasks.workunit.client.1.smithi165.stdout:1/620: sync 2024-09-06T14:44:32.927 INFO:tasks.workunit.client.0.smithi052.stdout:3/50: chown d0/db 57 1 2024-09-06T14:44:32.927 INFO:tasks.workunit.client.0.smithi052.stdout:3/51: readlink - no filename 2024-09-06T14:44:32.928 INFO:tasks.workunit.client.0.smithi052.stdout:8/29: truncate f1 1662164 0 2024-09-06T14:44:32.929 INFO:tasks.workunit.client.1.smithi165.stdout:6/678: write d29/f47 [1773225,129158] 0 2024-09-06T14:44:32.930 INFO:tasks.workunit.client.0.smithi052.stdout:3/52: mknod d0/cd 0 2024-09-06T14:44:32.931 INFO:tasks.workunit.client.0.smithi052.stdout:8/30: mkdir d6/d9 0 2024-09-06T14:44:32.932 INFO:tasks.workunit.client.1.smithi165.stdout:7/548: creat d20/d3b/d69/d88/fb1 x:0 0 0 2024-09-06T14:44:32.933 INFO:tasks.workunit.client.1.smithi165.stdout:7/549: write d20/f21 [486637,114621] 0 2024-09-06T14:44:32.935 INFO:tasks.workunit.client.1.smithi165.stdout:0/617: chown d15/d19/d50/d53/c90 685 1 2024-09-06T14:44:32.936 INFO:tasks.workunit.client.1.smithi165.stdout:4/689: creat d5/d1b/d61/d77/dd5/fe8 x:0 0 0 2024-09-06T14:44:32.937 INFO:tasks.workunit.client.0.smithi052.stdout:3/53: rmdir d0/db 0 2024-09-06T14:44:32.937 INFO:tasks.workunit.client.1.smithi165.stdout:6/679: dwrite d29/d39/d5b/d62/fa3 [4194304,4194304] 0 2024-09-06T14:44:32.939 INFO:tasks.workunit.client.1.smithi165.stdout:3/680: link d1/d19/d4d/fa5 d1/da/dc/d3b/d71/fe3 0 2024-09-06T14:44:32.941 INFO:tasks.workunit.client.0.smithi052.stdout:3/54: dread d0/f9 [0,4194304] 0 2024-09-06T14:44:32.941 INFO:tasks.workunit.client.0.smithi052.stdout:8/31: link c5 d6/d9/ca 0 2024-09-06T14:44:32.942 INFO:tasks.workunit.client.1.smithi165.stdout:0/618: dread d15/d19/d28/d3a/d3f/f48 [0,4194304] 0 2024-09-06T14:44:32.944 INFO:tasks.workunit.client.0.smithi052.stdout:3/55: creat d0/fe x:0 0 0 2024-09-06T14:44:32.946 INFO:tasks.workunit.client.1.smithi165.stdout:9/780: mkdir db/de/d15/d91/df5 0 2024-09-06T14:44:32.949 INFO:tasks.workunit.client.0.smithi052.stdout:3/56: creat d0/ff x:0 0 0 2024-09-06T14:44:32.950 INFO:tasks.workunit.client.0.smithi052.stdout:3/57: write d0/fe [544390,129161] 0 2024-09-06T14:44:32.950 INFO:tasks.workunit.client.0.smithi052.stdout:3/58: rename d0 to d0/d10 22 2024-09-06T14:44:32.953 INFO:tasks.workunit.client.1.smithi165.stdout:6/680: mkdir d29/d39/d5b/d62/d9f/dce 0 2024-09-06T14:44:32.953 INFO:tasks.workunit.client.1.smithi165.stdout:9/781: dwrite db/de/d15/d74/fd5 [0,4194304] 0 2024-09-06T14:44:32.955 INFO:tasks.workunit.client.0.smithi052.stdout:3/59: mkdir d0/d11 0 2024-09-06T14:44:32.956 INFO:tasks.workunit.client.0.smithi052.stdout:3/60: write d0/fe [1044274,25181] 0 2024-09-06T14:44:32.957 INFO:tasks.workunit.client.1.smithi165.stdout:8/678: rename d0/f9 to d0/d14/fea 0 2024-09-06T14:44:32.957 INFO:tasks.workunit.client.0.smithi052.stdout:3/61: truncate d0/f6 1487949 0 2024-09-06T14:44:32.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/62: write d0/fc [575921,17026] 0 2024-09-06T14:44:32.959 INFO:tasks.workunit.client.0.smithi052.stdout:8/32: rmdir d6/d8 0 2024-09-06T14:44:32.959 INFO:tasks.workunit.client.0.smithi052.stdout:3/63: chown d0/d11 7974505 1 2024-09-06T14:44:32.960 INFO:tasks.workunit.client.0.smithi052.stdout:3/64: write d0/fc [416857,129274] 0 2024-09-06T14:44:32.962 INFO:tasks.workunit.client.1.smithi165.stdout:2/576: creat d9/d25/d45/d75/fc0 x:0 0 0 2024-09-06T14:44:32.968 INFO:tasks.workunit.client.1.smithi165.stdout:5/725: sync 2024-09-06T14:44:32.969 INFO:tasks.workunit.client.1.smithi165.stdout:5/726: stat d6/d1c/d28/d4b/d55/d8a/dda 0 2024-09-06T14:44:32.975 INFO:tasks.workunit.client.1.smithi165.stdout:4/690: rename d5/d1b/d61/d77/d7c/dcd/fd9 to d5/d1b/d61/d77/d93/fe9 0 2024-09-06T14:44:32.976 INFO:tasks.workunit.client.1.smithi165.stdout:8/679: creat d0/d19/d36/d2d/d33/da8/feb x:0 0 0 2024-09-06T14:44:32.977 INFO:tasks.workunit.client.1.smithi165.stdout:2/577: dread d9/fc [0,4194304] 0 2024-09-06T14:44:32.977 INFO:tasks.workunit.client.1.smithi165.stdout:2/578: readlink d9/d88/dac/d95/lbe 0 2024-09-06T14:44:32.978 INFO:tasks.workunit.client.1.smithi165.stdout:2/579: dread - d9/d23/d52/f7f zero size 2024-09-06T14:44:32.984 INFO:tasks.workunit.client.0.smithi052.stdout:3/65: truncate d0/f9 2977497 0 2024-09-06T14:44:32.985 INFO:tasks.workunit.client.1.smithi165.stdout:3/681: rename d1/d4a/l60 to d1/d4a/db4/le4 0 2024-09-06T14:44:32.985 INFO:tasks.workunit.client.1.smithi165.stdout:9/782: write db/de/d16/d2e/f3b [3634276,15869] 0 2024-09-06T14:44:32.987 INFO:tasks.workunit.client.1.smithi165.stdout:3/682: write d1/d19/f34 [1087673,80065] 0 2024-09-06T14:44:32.988 INFO:tasks.workunit.client.1.smithi165.stdout:9/783: read db/de/d15/d17/dad/fbb [255240,26257] 0 2024-09-06T14:44:32.990 INFO:tasks.workunit.client.0.smithi052.stdout:8/33: stat f1 0 2024-09-06T14:44:32.990 INFO:tasks.workunit.client.1.smithi165.stdout:7/550: getdents d20/d3b/d69 0 2024-09-06T14:44:32.991 INFO:tasks.workunit.client.0.smithi052.stdout:3/66: dwrite d0/f6 [0,4194304] 0 2024-09-06T14:44:32.991 INFO:tasks.workunit.client.1.smithi165.stdout:0/619: truncate d15/d19/f46 531371 0 2024-09-06T14:44:32.992 INFO:tasks.workunit.client.1.smithi165.stdout:0/620: fsync d15/d19/d50/d53/d57/f78 0 2024-09-06T14:44:32.993 INFO:tasks.workunit.client.0.smithi052.stdout:8/34: dread f1 [0,4194304] 0 2024-09-06T14:44:32.995 INFO:tasks.workunit.client.1.smithi165.stdout:1/621: link d0/d2a/d18/d24/d4b/d93/dbd/lbf d0/d1c/lcc 0 2024-09-06T14:44:32.995 INFO:tasks.workunit.client.1.smithi165.stdout:0/621: truncate d15/d19/d38/f5e 5907083 0 2024-09-06T14:44:32.996 INFO:tasks.workunit.client.1.smithi165.stdout:0/622: stat d15/d19/d50/d53 0 2024-09-06T14:44:32.997 INFO:tasks.workunit.client.0.smithi052.stdout:3/67: mkdir d0/d11/d12 0 2024-09-06T14:44:32.998 INFO:tasks.workunit.client.0.smithi052.stdout:3/68: chown d0/fe 84303 1 2024-09-06T14:44:32.999 INFO:tasks.workunit.client.1.smithi165.stdout:6/681: dwrite d29/d39/d5b/d68/fbd [0,4194304] 0 2024-09-06T14:44:33.000 INFO:tasks.workunit.client.1.smithi165.stdout:8/680: rename d0/d19/dc6/fca to d0/d19/d36/d2d/d33/d3a/d46/dcd/fec 0 2024-09-06T14:44:33.001 INFO:tasks.workunit.client.1.smithi165.stdout:8/681: readlink d0/d19/d36/d28/l67 0 2024-09-06T14:44:33.001 INFO:tasks.workunit.client.0.smithi052.stdout:8/35: symlink d6/d9/lb 0 2024-09-06T14:44:33.006 INFO:tasks.workunit.client.0.smithi052.stdout:3/69: dwrite d0/f3 [0,4194304] 0 2024-09-06T14:44:33.007 INFO:tasks.workunit.client.0.smithi052.stdout:3/70: chown d0/d11 869 1 2024-09-06T14:44:33.008 INFO:tasks.workunit.client.0.smithi052.stdout:3/71: write d0/ff [1045162,77059] 0 2024-09-06T14:44:33.010 INFO:tasks.workunit.client.0.smithi052.stdout:8/36: symlink d6/d9/lc 0 2024-09-06T14:44:33.013 INFO:tasks.workunit.client.1.smithi165.stdout:4/691: truncate d5/d1b/d1c/d20/d75/d83/f4d 1118510 0 2024-09-06T14:44:33.013 INFO:tasks.workunit.client.0.smithi052.stdout:8/37: dread f1 [0,4194304] 0 2024-09-06T14:44:33.013 INFO:tasks.workunit.client.0.smithi052.stdout:3/72: mknod d0/d11/c13 0 2024-09-06T14:44:33.013 INFO:tasks.workunit.client.0.smithi052.stdout:3/73: readlink - no filename 2024-09-06T14:44:33.014 INFO:tasks.workunit.client.0.smithi052.stdout:8/38: readlink d6/d9/lb 0 2024-09-06T14:44:33.015 INFO:tasks.workunit.client.1.smithi165.stdout:2/580: symlink d9/d88/db8/lc1 0 2024-09-06T14:44:33.016 INFO:tasks.workunit.client.1.smithi165.stdout:9/784: creat db/de/d15/d17/d18/d59/d64/ff6 x:0 0 0 2024-09-06T14:44:33.016 INFO:tasks.workunit.client.0.smithi052.stdout:8/39: dread f1 [0,4194304] 0 2024-09-06T14:44:33.017 INFO:tasks.workunit.client.1.smithi165.stdout:2/581: dread - d9/d23/d52/fa9 zero size 2024-09-06T14:44:33.018 INFO:tasks.workunit.client.1.smithi165.stdout:5/727: dwrite d6/f19 [0,4194304] 0 2024-09-06T14:44:33.018 INFO:tasks.workunit.client.0.smithi052.stdout:3/74: symlink d0/d11/d12/l14 0 2024-09-06T14:44:33.019 INFO:tasks.workunit.client.1.smithi165.stdout:7/551: dread d20/d33/f52 [0,4194304] 0 2024-09-06T14:44:33.024 INFO:tasks.workunit.client.1.smithi165.stdout:3/683: write d1/d19/f59 [5161750,89806] 0 2024-09-06T14:44:33.025 INFO:tasks.workunit.client.0.smithi052.stdout:3/75: mkdir d0/d11/d15 0 2024-09-06T14:44:33.025 INFO:tasks.workunit.client.0.smithi052.stdout:3/76: chown d0 258977 1 2024-09-06T14:44:33.028 INFO:tasks.workunit.client.0.smithi052.stdout:3/77: readlink d0/d11/d12/l14 0 2024-09-06T14:44:33.028 INFO:tasks.workunit.client.1.smithi165.stdout:8/682: mknod d0/d5e/d65/ced 0 2024-09-06T14:44:33.031 INFO:tasks.workunit.client.1.smithi165.stdout:3/684: dwrite d1/da/dd/d4b/f74 [0,4194304] 0 2024-09-06T14:44:33.031 INFO:tasks.workunit.client.0.smithi052.stdout:3/78: mknod d0/d11/d12/c16 0 2024-09-06T14:44:33.032 INFO:tasks.workunit.client.0.smithi052.stdout:3/79: write d0/f6 [3424414,89476] 0 2024-09-06T14:44:33.035 INFO:tasks.workunit.client.0.smithi052.stdout:8/40: link d6/d9/ca d6/d9/cd 0 2024-09-06T14:44:33.038 INFO:tasks.workunit.client.1.smithi165.stdout:3/685: dwrite d1/d7c/fad [0,4194304] 0 2024-09-06T14:44:33.040 INFO:tasks.workunit.client.1.smithi165.stdout:3/686: dread - d1/da/dc/d3b/d71/fdc zero size 2024-09-06T14:44:33.041 INFO:tasks.workunit.client.1.smithi165.stdout:3/687: chown d1/d4a/dc7 259676 1 2024-09-06T14:44:33.045 INFO:tasks.workunit.client.1.smithi165.stdout:2/582: chown d9/c16 0 1 2024-09-06T14:44:33.046 INFO:tasks.workunit.client.0.smithi052.stdout:3/80: dread d0/fe [0,4194304] 0 2024-09-06T14:44:33.047 INFO:tasks.workunit.client.1.smithi165.stdout:3/688: chown d1/da/dc/d3b/d71/cce 393702 1 2024-09-06T14:44:33.047 INFO:tasks.workunit.client.1.smithi165.stdout:5/728: dread d6/d1c/d28/d4b/d55/f6f [0,4194304] 0 2024-09-06T14:44:33.049 INFO:tasks.workunit.client.1.smithi165.stdout:0/623: dread d15/f4b [0,4194304] 0 2024-09-06T14:44:33.051 INFO:tasks.workunit.client.1.smithi165.stdout:5/729: dread d6/d1c/d28/fb8 [0,4194304] 0 2024-09-06T14:44:33.052 INFO:tasks.workunit.client.1.smithi165.stdout:5/730: dread - d6/d1c/d28/d4b/d55/d8a/de1/f100 zero size 2024-09-06T14:44:33.054 INFO:tasks.workunit.client.1.smithi165.stdout:4/692: write d5/f46 [1072738,73958] 0 2024-09-06T14:44:33.056 INFO:tasks.workunit.client.0.smithi052.stdout:3/81: dread d0/f9 [0,4194304] 0 2024-09-06T14:44:33.056 INFO:tasks.workunit.client.1.smithi165.stdout:2/583: chown d9/c22 8 1 2024-09-06T14:44:33.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/82: write d0/f6 [3076714,55196] 0 2024-09-06T14:44:33.062 INFO:tasks.workunit.client.1.smithi165.stdout:1/622: write d0/d1c/d41/f5e [3846404,88831] 0 2024-09-06T14:44:33.063 INFO:tasks.workunit.client.0.smithi052.stdout:3/83: dread d0/f3 [0,4194304] 0 2024-09-06T14:44:33.064 INFO:tasks.workunit.client.1.smithi165.stdout:8/683: creat d0/d19/d36/d2d/dc9/fee x:0 0 0 2024-09-06T14:44:33.065 INFO:tasks.workunit.client.1.smithi165.stdout:9/785: dwrite db/de/d15/d7f/d9b/f31 [0,4194304] 0 2024-09-06T14:44:33.065 INFO:tasks.workunit.client.0.smithi052.stdout:8/41: dwrite f1 [0,4194304] 0 2024-09-06T14:44:33.067 INFO:tasks.workunit.client.1.smithi165.stdout:9/786: read db/de/d15/d7f/dbc/ddf/fa6 [1055217,68398] 0 2024-09-06T14:44:33.068 INFO:tasks.workunit.client.0.smithi052.stdout:3/84: mkdir d0/d11/d12/d17 0 2024-09-06T14:44:33.069 INFO:tasks.workunit.client.0.smithi052.stdout:3/85: fsync d0/fc 0 2024-09-06T14:44:33.069 INFO:tasks.workunit.client.1.smithi165.stdout:0/624: mknod d15/d19/d28/ccf 0 2024-09-06T14:44:33.070 INFO:tasks.workunit.client.0.smithi052.stdout:3/86: read d0/fe [715372,80766] 0 2024-09-06T14:44:33.071 INFO:tasks.workunit.client.0.smithi052.stdout:3/87: chown d0/d11/d12/c16 1240527 1 2024-09-06T14:44:33.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:32 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:33.075 INFO:tasks.workunit.client.0.smithi052.stdout:3/88: dread d0/f3 [0,4194304] 0 2024-09-06T14:44:33.078 INFO:tasks.workunit.client.1.smithi165.stdout:3/689: creat d1/da/dc/fe5 x:0 0 0 2024-09-06T14:44:33.079 INFO:tasks.workunit.client.0.smithi052.stdout:3/89: mkdir d0/d11/d12/d18 0 2024-09-06T14:44:33.080 INFO:tasks.workunit.client.1.smithi165.stdout:6/682: sync 2024-09-06T14:44:33.081 INFO:tasks.workunit.client.0.smithi052.stdout:3/90: rmdir d0 39 2024-09-06T14:44:33.083 INFO:tasks.workunit.client.1.smithi165.stdout:9/787: creat db/de/d15/d17/d18/d7d/d61/ff7 x:0 0 0 2024-09-06T14:44:33.084 INFO:tasks.workunit.client.1.smithi165.stdout:0/625: mknod d15/d19/d28/d51/d60/cd0 0 2024-09-06T14:44:33.085 INFO:tasks.workunit.client.1.smithi165.stdout:5/731: creat d6/d1c/d28/d4b/d55/d8a/f106 x:0 0 0 2024-09-06T14:44:33.088 INFO:tasks.workunit.client.0.smithi052.stdout:3/91: dread d0/ff [0,4194304] 0 2024-09-06T14:44:33.089 INFO:tasks.workunit.client.0.smithi052.stdout:8/42: truncate f1 1989137 0 2024-09-06T14:44:33.090 INFO:tasks.workunit.client.1.smithi165.stdout:6/683: dread f5 [0,4194304] 0 2024-09-06T14:44:33.091 INFO:tasks.workunit.client.1.smithi165.stdout:7/552: link d20/d3b/d69/d88/l5b d20/d3b/d69/d88/d80/lb2 0 2024-09-06T14:44:33.092 INFO:tasks.workunit.client.1.smithi165.stdout:7/553: write d20/d4d/d54/f9d [9128049,51482] 0 2024-09-06T14:44:33.096 INFO:tasks.workunit.client.1.smithi165.stdout:2/584: getdents d9/d23/d71 0 2024-09-06T14:44:33.097 INFO:tasks.workunit.client.1.smithi165.stdout:5/732: rename d6/d32/f84 to d6/d98/dd7/f107 0 2024-09-06T14:44:33.100 INFO:tasks.workunit.client.1.smithi165.stdout:8/684: link d0/d19/d36/fb d0/d19/fef 0 2024-09-06T14:44:33.103 INFO:tasks.workunit.client.1.smithi165.stdout:1/623: truncate d0/d2a/d18/d24/d4b/d93/d68/f87 47574 0 2024-09-06T14:44:33.103 INFO:tasks.workunit.client.0.smithi052.stdout:8/43: dread f1 [0,4194304] 0 2024-09-06T14:44:33.104 INFO:tasks.workunit.client.1.smithi165.stdout:7/554: creat d20/d65/d82/d97/fb3 x:0 0 0 2024-09-06T14:44:33.105 INFO:tasks.workunit.client.0.smithi052.stdout:3/92: write d0/f9 [2353161,15468] 0 2024-09-06T14:44:33.105 INFO:tasks.workunit.client.1.smithi165.stdout:4/693: getdents d5/db8 0 2024-09-06T14:44:33.106 INFO:tasks.workunit.client.1.smithi165.stdout:7/555: write d20/d4d/d54/fa4 [715396,128192] 0 2024-09-06T14:44:33.107 INFO:tasks.workunit.client.1.smithi165.stdout:2/585: symlink d9/d3b/d78/lc2 0 2024-09-06T14:44:33.107 INFO:tasks.workunit.client.1.smithi165.stdout:4/694: fsync d5/d1b/d1c/d78/f92 0 2024-09-06T14:44:33.107 INFO:tasks.workunit.client.1.smithi165.stdout:9/788: write db/de/fc8 [1431574,79950] 0 2024-09-06T14:44:33.109 INFO:tasks.workunit.client.0.smithi052.stdout:0/42: sync 2024-09-06T14:44:33.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/24: sync 2024-09-06T14:44:33.109 INFO:tasks.workunit.client.0.smithi052.stdout:1/65: sync 2024-09-06T14:44:33.109 INFO:tasks.workunit.client.0.smithi052.stdout:2/28: sync 2024-09-06T14:44:33.110 INFO:tasks.workunit.client.0.smithi052.stdout:9/28: sync 2024-09-06T14:44:33.110 INFO:tasks.workunit.client.0.smithi052.stdout:8/44: stat d6/d9/cd 0 2024-09-06T14:44:33.111 INFO:tasks.workunit.client.0.smithi052.stdout:8/45: chown f1 194 1 2024-09-06T14:44:33.111 INFO:tasks.workunit.client.0.smithi052.stdout:1/66: chown d1/l3 7 1 2024-09-06T14:44:33.111 INFO:tasks.workunit.client.0.smithi052.stdout:3/93: dread d0/f3 [0,4194304] 0 2024-09-06T14:44:33.112 INFO:tasks.workunit.client.0.smithi052.stdout:8/46: dread f1 [0,4194304] 0 2024-09-06T14:44:33.114 INFO:tasks.workunit.client.0.smithi052.stdout:8/47: chown d6/d9/cd 1131 1 2024-09-06T14:44:33.114 INFO:tasks.workunit.client.1.smithi165.stdout:2/586: dwrite d9/d25/d45/f89 [0,4194304] 0 2024-09-06T14:44:33.114 INFO:tasks.workunit.client.1.smithi165.stdout:9/789: dwrite f4 [4194304,4194304] 0 2024-09-06T14:44:33.116 INFO:tasks.workunit.client.0.smithi052.stdout:8/48: dread f1 [0,4194304] 0 2024-09-06T14:44:33.116 INFO:tasks.workunit.client.0.smithi052.stdout:7/25: creat f9 x:0 0 0 2024-09-06T14:44:33.118 INFO:tasks.workunit.client.1.smithi165.stdout:6/684: symlink d29/d39/lcf 0 2024-09-06T14:44:33.119 INFO:tasks.workunit.client.0.smithi052.stdout:2/29: creat f9 x:0 0 0 2024-09-06T14:44:33.125 INFO:tasks.workunit.client.1.smithi165.stdout:6/685: dwrite d29/d32/fb5 [0,4194304] 0 2024-09-06T14:44:33.126 INFO:tasks.workunit.client.1.smithi165.stdout:7/556: creat d20/d3b/d69/da3/fb4 x:0 0 0 2024-09-06T14:44:33.127 INFO:tasks.workunit.client.1.smithi165.stdout:7/557: dread - d20/d40/f87 zero size 2024-09-06T14:44:33.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/43: mkdir d0/d8 0 2024-09-06T14:44:33.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/44: dread - no filename 2024-09-06T14:44:33.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/45: write - no filename 2024-09-06T14:44:33.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/46: truncate - no filename 2024-09-06T14:44:33.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/47: write - no filename 2024-09-06T14:44:33.128 INFO:tasks.workunit.client.1.smithi165.stdout:8/685: dwrite d0/fc [8388608,4194304] 0 2024-09-06T14:44:33.130 INFO:tasks.workunit.client.0.smithi052.stdout:7/26: dwrite f9 [0,4194304] 0 2024-09-06T14:44:33.130 INFO:tasks.workunit.client.0.smithi052.stdout:2/30: read f2 [2427416,43328] 0 2024-09-06T14:44:33.130 INFO:tasks.workunit.client.1.smithi165.stdout:8/686: dread - d0/d14/d3e/db4/fdb zero size 2024-09-06T14:44:33.131 INFO:tasks.workunit.client.0.smithi052.stdout:8/49: write f1 [2475221,29907] 0 2024-09-06T14:44:33.132 INFO:tasks.workunit.client.1.smithi165.stdout:8/687: chown d0/d34/d6b/d94/fd6 9383617 1 2024-09-06T14:44:33.132 INFO:tasks.workunit.client.1.smithi165.stdout:4/695: chown d5/d1b/d1c/d20/d75/d83/f4d 14 1 2024-09-06T14:44:33.133 INFO:tasks.workunit.client.0.smithi052.stdout:3/94: mkdir d0/d11/d15/d19 0 2024-09-06T14:44:33.137 INFO:tasks.workunit.client.1.smithi165.stdout:3/690: getdents d1/da/dc/d3b/dc6/d89 0 2024-09-06T14:44:33.139 INFO:tasks.workunit.client.0.smithi052.stdout:1/67: symlink d1/db/de/l10 0 2024-09-06T14:44:33.139 INFO:tasks.workunit.client.0.smithi052.stdout:2/31: dread f0 [0,4194304] 0 2024-09-06T14:44:33.139 INFO:tasks.workunit.client.0.smithi052.stdout:2/32: rmdir - no directory 2024-09-06T14:44:33.141 INFO:tasks.workunit.client.1.smithi165.stdout:2/587: creat d9/d23/d29/d48/fc3 x:0 0 0 2024-09-06T14:44:33.142 INFO:tasks.workunit.client.0.smithi052.stdout:1/68: readlink d1/l3 0 2024-09-06T14:44:33.144 INFO:tasks.workunit.client.0.smithi052.stdout:7/27: mknod ca 0 2024-09-06T14:44:33.145 INFO:tasks.workunit.client.0.smithi052.stdout:0/48: creat d0/d2/f9 x:0 0 0 2024-09-06T14:44:33.145 INFO:tasks.workunit.client.0.smithi052.stdout:8/50: symlink d6/d9/le 0 2024-09-06T14:44:33.146 INFO:tasks.workunit.client.1.smithi165.stdout:9/790: rmdir db/de/d15/d17/d18/d59/d64 39 2024-09-06T14:44:33.147 INFO:tasks.workunit.client.0.smithi052.stdout:7/28: chown f5 0 1 2024-09-06T14:44:33.148 INFO:tasks.workunit.client.0.smithi052.stdout:0/49: dread - d0/d2/f9 zero size 2024-09-06T14:44:33.148 INFO:tasks.workunit.client.0.smithi052.stdout:0/50: readlink - no filename 2024-09-06T14:44:33.149 INFO:tasks.workunit.client.0.smithi052.stdout:0/51: chown d0 14006605 1 2024-09-06T14:44:33.149 INFO:tasks.workunit.client.0.smithi052.stdout:2/33: mkdir da 0 2024-09-06T14:44:33.150 INFO:tasks.workunit.client.0.smithi052.stdout:1/69: symlink d1/l11 0 2024-09-06T14:44:33.152 INFO:tasks.workunit.client.0.smithi052.stdout:3/95: dwrite d0/fc [0,4194304] 0 2024-09-06T14:44:33.152 INFO:tasks.workunit.client.0.smithi052.stdout:0/52: dread - d0/d2/f9 zero size 2024-09-06T14:44:33.152 INFO:tasks.workunit.client.1.smithi165.stdout:6/686: mknod d29/d39/d5b/d62/d67/cd0 0 2024-09-06T14:44:33.153 INFO:tasks.workunit.client.0.smithi052.stdout:1/70: stat d1/f9 0 2024-09-06T14:44:33.153 INFO:tasks.workunit.client.1.smithi165.stdout:6/687: write d29/f48 [604843,95796] 0 2024-09-06T14:44:33.154 INFO:tasks.workunit.client.1.smithi165.stdout:7/558: mknod d20/d33/d53/d66/cb5 0 2024-09-06T14:44:33.156 INFO:tasks.workunit.client.0.smithi052.stdout:7/29: fdatasync f7 0 2024-09-06T14:44:33.159 INFO:tasks.workunit.client.0.smithi052.stdout:8/51: dwrite f1 [0,4194304] 0 2024-09-06T14:44:33.160 INFO:tasks.workunit.client.0.smithi052.stdout:8/52: chown d6/d9/cd 14331246 1 2024-09-06T14:44:33.161 INFO:tasks.workunit.client.0.smithi052.stdout:3/96: rename d0/f6 to d0/f1a 0 2024-09-06T14:44:33.164 INFO:tasks.workunit.client.0.smithi052.stdout:2/34: mkdir da/db 0 2024-09-06T14:44:33.165 INFO:tasks.workunit.client.0.smithi052.stdout:2/35: dread - f9 zero size 2024-09-06T14:44:33.166 INFO:tasks.workunit.client.0.smithi052.stdout:0/53: fsync d0/d2/f9 0 2024-09-06T14:44:33.167 INFO:tasks.workunit.client.0.smithi052.stdout:8/53: dread f1 [0,4194304] 0 2024-09-06T14:44:33.169 INFO:tasks.workunit.client.0.smithi052.stdout:0/54: write d0/d2/f9 [477275,37642] 0 2024-09-06T14:44:33.169 INFO:tasks.workunit.client.0.smithi052.stdout:8/54: chown d6/c7 0 1 2024-09-06T14:44:33.169 INFO:tasks.workunit.client.0.smithi052.stdout:3/97: dread d0/fc [0,4194304] 0 2024-09-06T14:44:33.171 INFO:tasks.workunit.client.1.smithi165.stdout:7/559: readlink d20/d3b/d69/l8f 0 2024-09-06T14:44:33.172 INFO:tasks.workunit.client.0.smithi052.stdout:7/30: rename ca to cb 0 2024-09-06T14:44:33.173 INFO:tasks.workunit.client.1.smithi165.stdout:1/624: dwrite d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f6c [0,4194304] 0 2024-09-06T14:44:33.175 INFO:tasks.workunit.client.0.smithi052.stdout:7/31: write f9 [1588292,10209] 0 2024-09-06T14:44:33.177 INFO:tasks.workunit.client.0.smithi052.stdout:0/55: dread d0/d2/f9 [0,4194304] 0 2024-09-06T14:44:33.178 INFO:tasks.workunit.client.0.smithi052.stdout:3/98: dread d0/fc [0,4194304] 0 2024-09-06T14:44:33.182 INFO:tasks.workunit.client.0.smithi052.stdout:0/56: read d0/d2/f9 [213466,20052] 0 2024-09-06T14:44:33.185 INFO:tasks.workunit.client.0.smithi052.stdout:2/36: creat da/fc x:0 0 0 2024-09-06T14:44:33.187 INFO:tasks.workunit.client.0.smithi052.stdout:1/71: dwrite d1/db/fd [0,4194304] 0 2024-09-06T14:44:33.193 INFO:tasks.workunit.client.0.smithi052.stdout:7/32: symlink lc 0 2024-09-06T14:44:33.194 INFO:tasks.workunit.client.0.smithi052.stdout:3/99: mkdir d0/d11/d15/d1b 0 2024-09-06T14:44:33.196 INFO:tasks.workunit.client.1.smithi165.stdout:5/733: getdents d6/d1c/d64 0 2024-09-06T14:44:33.196 INFO:tasks.workunit.client.1.smithi165.stdout:7/560: dread d20/d33/f8a [0,4194304] 0 2024-09-06T14:44:33.197 INFO:tasks.workunit.client.0.smithi052.stdout:2/37: symlink da/ld 0 2024-09-06T14:44:33.197 INFO:tasks.workunit.client.1.smithi165.stdout:3/691: link d1/da/dd/f61 d1/dbd/fe6 0 2024-09-06T14:44:33.197 INFO:tasks.workunit.client.1.smithi165.stdout:2/588: write f8 [4082061,95988] 0 2024-09-06T14:44:33.198 INFO:tasks.workunit.client.1.smithi165.stdout:4/696: write d5/f50 [145746,103693] 0 2024-09-06T14:44:33.199 INFO:tasks.workunit.client.1.smithi165.stdout:9/791: creat db/de/d15/d17/d18/d7d/d8e/ded/df1/ff8 x:0 0 0 2024-09-06T14:44:33.199 INFO:tasks.workunit.client.0.smithi052.stdout:1/72: fsync d1/f9 0 2024-09-06T14:44:33.201 INFO:tasks.workunit.client.1.smithi165.stdout:1/625: fdatasync d0/d2a/d18/d24/d4b/d95/f96 0 2024-09-06T14:44:33.202 INFO:tasks.workunit.client.1.smithi165.stdout:3/692: write d1/da/dd/d4b/f8b [57143,4609] 0 2024-09-06T14:44:33.202 INFO:tasks.workunit.client.0.smithi052.stdout:7/33: chown cb 1779 1 2024-09-06T14:44:33.203 INFO:tasks.workunit.client.0.smithi052.stdout:7/34: read f9 [161023,5365] 0 2024-09-06T14:44:33.203 INFO:tasks.workunit.client.1.smithi165.stdout:5/734: mkdir d6/d1c/d28/d88/d108 0 2024-09-06T14:44:33.204 INFO:tasks.workunit.client.0.smithi052.stdout:0/57: getdents d0/d8 0 2024-09-06T14:44:33.205 INFO:tasks.workunit.client.1.smithi165.stdout:1/626: chown d0/d1c/d1d/d22/f4c 127671 1 2024-09-06T14:44:33.206 INFO:tasks.workunit.client.1.smithi165.stdout:8/688: dwrite d0/d19/d7f/f9a [0,4194304] 0 2024-09-06T14:44:33.208 INFO:tasks.workunit.client.1.smithi165.stdout:8/689: fsync d0/d9e/fa4 0 2024-09-06T14:44:33.210 INFO:tasks.workunit.client.1.smithi165.stdout:7/561: mknod d20/d3b/d69/d88/d30/cb6 0 2024-09-06T14:44:33.212 INFO:tasks.workunit.client.1.smithi165.stdout:2/589: mknod d9/d23/d29/d48/cc4 0 2024-09-06T14:44:33.213 INFO:tasks.workunit.client.1.smithi165.stdout:9/792: dwrite db/de/d15/d17/dad/f46 [0,4194304] 0 2024-09-06T14:44:33.215 INFO:tasks.workunit.client.1.smithi165.stdout:2/590: write d9/d25/d45/d75/d67/f9a [925231,72676] 0 2024-09-06T14:44:33.216 INFO:tasks.workunit.client.1.smithi165.stdout:2/591: read d9/f84 [451674,20952] 0 2024-09-06T14:44:33.217 INFO:tasks.workunit.client.0.smithi052.stdout:7/35: mknod cd 0 2024-09-06T14:44:33.218 INFO:tasks.workunit.client.0.smithi052.stdout:7/36: chown cd 5561117 1 2024-09-06T14:44:33.221 INFO:tasks.workunit.client.1.smithi165.stdout:1/627: creat d0/d2a/d18/d24/d4b/d93/d97/fcd x:0 0 0 2024-09-06T14:44:33.221 INFO:tasks.workunit.client.1.smithi165.stdout:9/793: dwrite db/de/d15/d17/f19 [0,4194304] 0 2024-09-06T14:44:33.223 INFO:tasks.workunit.client.0.smithi052.stdout:8/55: getdents d6/d9 0 2024-09-06T14:44:33.225 INFO:tasks.workunit.client.1.smithi165.stdout:7/562: creat d20/d4d/d54/fb7 x:0 0 0 2024-09-06T14:44:33.226 INFO:tasks.workunit.client.0.smithi052.stdout:2/38: link da/fc da/db/fe 0 2024-09-06T14:44:33.227 INFO:tasks.workunit.client.1.smithi165.stdout:7/563: truncate d20/d40/f87 393210 0 2024-09-06T14:44:33.228 INFO:tasks.workunit.client.1.smithi165.stdout:5/735: dread d6/fb5 [0,4194304] 0 2024-09-06T14:44:33.229 INFO:tasks.workunit.client.1.smithi165.stdout:5/736: read d6/d1c/f39 [1292624,110381] 0 2024-09-06T14:44:33.233 INFO:tasks.workunit.client.1.smithi165.stdout:2/592: write d9/f1a [745135,62173] 0 2024-09-06T14:44:33.234 INFO:tasks.workunit.client.1.smithi165.stdout:2/593: dread - d9/d23/d71/f87 zero size 2024-09-06T14:44:33.234 INFO:tasks.workunit.client.0.smithi052.stdout:0/58: write d0/d2/f9 [1455441,13819] 0 2024-09-06T14:44:33.235 INFO:tasks.workunit.client.1.smithi165.stdout:2/594: chown d9/d23/l31 957012 1 2024-09-06T14:44:33.236 INFO:tasks.workunit.client.1.smithi165.stdout:1/628: unlink d0/d1c/d1d/d22/l76 0 2024-09-06T14:44:33.237 INFO:tasks.workunit.client.0.smithi052.stdout:3/100: link d0/d11/c13 d0/d11/d15/c1c 0 2024-09-06T14:44:33.238 INFO:tasks.workunit.client.0.smithi052.stdout:8/56: mkdir d6/d9/df 0 2024-09-06T14:44:33.240 INFO:tasks.workunit.client.1.smithi165.stdout:4/697: rename d5/d1b/d1c/d8c/fa3 to d5/d1b/d1c/fea 0 2024-09-06T14:44:33.242 INFO:tasks.workunit.client.0.smithi052.stdout:8/57: dread f1 [0,4194304] 0 2024-09-06T14:44:33.243 INFO:tasks.workunit.client.0.smithi052.stdout:7/37: rename c4 to ce 0 2024-09-06T14:44:33.245 INFO:tasks.workunit.client.1.smithi165.stdout:7/564: dread d20/d3b/d69/d88/f58 [0,4194304] 0 2024-09-06T14:44:33.245 INFO:tasks.workunit.client.0.smithi052.stdout:0/59: stat d0/c7 0 2024-09-06T14:44:33.246 INFO:tasks.workunit.client.0.smithi052.stdout:7/38: chown f7 3 1 2024-09-06T14:44:33.247 INFO:tasks.workunit.client.1.smithi165.stdout:5/737: mkdir d6/d1c/d28/d2d/d3c/d109 0 2024-09-06T14:44:33.247 INFO:tasks.workunit.client.1.smithi165.stdout:5/738: chown d6/d1c/d28/d2d/f7e 231616 1 2024-09-06T14:44:33.248 INFO:tasks.workunit.client.1.smithi165.stdout:0/626: sync 2024-09-06T14:44:33.248 INFO:tasks.workunit.client.1.smithi165.stdout:5/739: truncate d6/dc1/fe2 1726367 0 2024-09-06T14:44:33.249 INFO:tasks.workunit.client.0.smithi052.stdout:3/101: write d0/ff [88138,113277] 0 2024-09-06T14:44:33.249 INFO:tasks.workunit.client.0.smithi052.stdout:3/102: chown d0/d11 4238889 1 2024-09-06T14:44:33.251 INFO:tasks.workunit.client.0.smithi052.stdout:3/103: write d0/ff [1269703,61287] 0 2024-09-06T14:44:33.251 INFO:tasks.workunit.client.0.smithi052.stdout:3/104: read d0/f1a [3320081,39577] 0 2024-09-06T14:44:33.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/105: dread d0/ff [0,4194304] 0 2024-09-06T14:44:33.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/106: stat d0/f3 0 2024-09-06T14:44:33.255 INFO:tasks.workunit.client.1.smithi165.stdout:2/595: mkdir d9/d88/dc5 0 2024-09-06T14:44:33.255 INFO:tasks.workunit.client.1.smithi165.stdout:1/629: dread d0/d1c/d1d/d22/f32 [0,4194304] 0 2024-09-06T14:44:33.256 INFO:tasks.workunit.client.0.smithi052.stdout:1/73: truncate d1/db/fd 2751535 0 2024-09-06T14:44:33.256 INFO:tasks.workunit.client.0.smithi052.stdout:3/107: readlink d0/d11/d12/l14 0 2024-09-06T14:44:33.256 INFO:tasks.workunit.client.1.smithi165.stdout:2/596: fdatasync d9/d25/d45/d75/fc0 0 2024-09-06T14:44:33.259 INFO:tasks.workunit.client.1.smithi165.stdout:8/690: creat d0/d19/d36/d2d/d3f/ff0 x:0 0 0 2024-09-06T14:44:33.261 INFO:tasks.workunit.client.0.smithi052.stdout:8/58: mkdir d6/d9/df/d10 0 2024-09-06T14:44:33.262 INFO:tasks.workunit.client.0.smithi052.stdout:2/39: dwrite da/db/fe [0,4194304] 0 2024-09-06T14:44:33.263 INFO:tasks.workunit.client.1.smithi165.stdout:9/794: rename db/de/d15/d17/fec to db/de/d15/d17/d18/ff9 0 2024-09-06T14:44:33.266 INFO:tasks.workunit.client.0.smithi052.stdout:8/59: dread f1 [0,4194304] 0 2024-09-06T14:44:33.268 INFO:tasks.workunit.client.0.smithi052.stdout:7/39: write f7 [738140,130498] 0 2024-09-06T14:44:33.269 INFO:tasks.workunit.client.1.smithi165.stdout:9/795: dwrite db/de/d15/d7f/d9b/d6c/d96/fe8 [0,4194304] 0 2024-09-06T14:44:33.270 INFO:tasks.workunit.client.1.smithi165.stdout:9/796: readlink db/de/d15/lcd 0 2024-09-06T14:44:33.272 INFO:tasks.workunit.client.0.smithi052.stdout:7/40: read f7 [60342,21943] 0 2024-09-06T14:44:33.274 INFO:tasks.workunit.client.0.smithi052.stdout:3/108: creat d0/f1d x:0 0 0 2024-09-06T14:44:33.276 INFO:tasks.workunit.client.1.smithi165.stdout:5/740: mkdir d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a 0 2024-09-06T14:44:33.278 INFO:tasks.workunit.client.1.smithi165.stdout:3/693: getdents d1/d7c/d7e 0 2024-09-06T14:44:33.280 INFO:tasks.workunit.client.1.smithi165.stdout:1/630: rmdir d0/d2a/d18/d24/d4b/d5f 39 2024-09-06T14:44:33.284 INFO:tasks.workunit.client.1.smithi165.stdout:2/597: unlink d9/d23/d29/c3d 0 2024-09-06T14:44:33.284 INFO:tasks.workunit.client.1.smithi165.stdout:2/598: fdatasync d9/d23/d29/f2b 0 2024-09-06T14:44:33.285 INFO:tasks.workunit.client.1.smithi165.stdout:2/599: write d9/d25/d45/d75/d67/d76/fa2 [956576,85567] 0 2024-09-06T14:44:33.286 INFO:tasks.workunit.client.1.smithi165.stdout:4/698: write d5/d1b/d1c/d41/fb4 [686788,34935] 0 2024-09-06T14:44:33.288 INFO:tasks.workunit.client.0.smithi052.stdout:8/60: dwrite f1 [0,4194304] 0 2024-09-06T14:44:33.289 INFO:tasks.workunit.client.0.smithi052.stdout:1/74: write d1/f8 [304088,40697] 0 2024-09-06T14:44:33.290 INFO:tasks.workunit.client.0.smithi052.stdout:7/41: rename f9 to ff 0 2024-09-06T14:44:33.295 INFO:tasks.workunit.client.0.smithi052.stdout:0/60: rmdir d0/d8 0 2024-09-06T14:44:33.296 INFO:tasks.workunit.client.1.smithi165.stdout:0/627: symlink d15/ld1 0 2024-09-06T14:44:33.297 INFO:tasks.workunit.client.1.smithi165.stdout:7/565: truncate d20/d3b/d69/d88/f4e 1356990 0 2024-09-06T14:44:33.298 INFO:tasks.workunit.client.1.smithi165.stdout:7/566: truncate d20/d4d/d54/f9d 9745493 0 2024-09-06T14:44:33.300 INFO:tasks.workunit.client.1.smithi165.stdout:9/797: mknod db/de/d15/d17/d86/cfa 0 2024-09-06T14:44:33.303 INFO:tasks.workunit.client.0.smithi052.stdout:0/61: dread d0/d2/f9 [0,4194304] 0 2024-09-06T14:44:33.303 INFO:tasks.workunit.client.0.smithi052.stdout:3/109: dwrite d0/f1a [0,4194304] 0 2024-09-06T14:44:33.303 INFO:tasks.workunit.client.1.smithi165.stdout:5/741: mkdir d6/d1c/d28/d4b/d10b 0 2024-09-06T14:44:33.304 INFO:tasks.workunit.client.0.smithi052.stdout:2/40: dwrite f7 [0,4194304] 0 2024-09-06T14:44:33.304 INFO:tasks.workunit.client.1.smithi165.stdout:6/688: sync 2024-09-06T14:44:33.305 INFO:tasks.workunit.client.1.smithi165.stdout:6/689: write f16 [988905,130084] 0 2024-09-06T14:44:33.306 INFO:tasks.workunit.client.0.smithi052.stdout:8/61: fdatasync f1 0 2024-09-06T14:44:33.307 INFO:tasks.workunit.client.1.smithi165.stdout:1/631: symlink d0/d2a/lce 0 2024-09-06T14:44:33.308 INFO:tasks.workunit.client.1.smithi165.stdout:1/632: dread - d0/d1c/fa7 zero size 2024-09-06T14:44:33.308 INFO:tasks.workunit.client.1.smithi165.stdout:6/690: write d29/d39/d5b/d68/fbd [4626078,102828] 0 2024-09-06T14:44:33.309 INFO:tasks.workunit.client.1.smithi165.stdout:2/600: creat d9/d23/d52/daa/fc6 x:0 0 0 2024-09-06T14:44:33.310 INFO:tasks.workunit.client.1.smithi165.stdout:2/601: stat d9/c22 0 2024-09-06T14:44:33.313 INFO:tasks.workunit.client.0.smithi052.stdout:8/62: dwrite f1 [0,4194304] 0 2024-09-06T14:44:33.315 INFO:tasks.workunit.client.0.smithi052.stdout:8/63: write f1 [2667625,56425] 0 2024-09-06T14:44:33.315 INFO:tasks.workunit.client.1.smithi165.stdout:8/691: mknod d0/d34/d6b/d94/d68/cf1 0 2024-09-06T14:44:33.316 INFO:tasks.workunit.client.0.smithi052.stdout:8/64: read f1 [3085848,117757] 0 2024-09-06T14:44:33.320 INFO:tasks.workunit.client.0.smithi052.stdout:0/62: rmdir d0 39 2024-09-06T14:44:33.320 INFO:tasks.workunit.client.0.smithi052.stdout:0/63: readlink - no filename 2024-09-06T14:44:33.323 INFO:tasks.workunit.client.0.smithi052.stdout:3/110: mknod d0/d11/d12/c1e 0 2024-09-06T14:44:33.328 INFO:tasks.workunit.client.1.smithi165.stdout:0/628: rmdir d15/d19/d66 39 2024-09-06T14:44:33.329 INFO:tasks.workunit.client.1.smithi165.stdout:2/602: dwrite d9/d25/f40 [0,4194304] 0 2024-09-06T14:44:33.332 INFO:tasks.workunit.client.0.smithi052.stdout:8/65: creat d6/f11 x:0 0 0 2024-09-06T14:44:33.333 INFO:tasks.workunit.client.1.smithi165.stdout:2/603: write d9/d3b/d78/fb2 [1953600,96148] 0 2024-09-06T14:44:33.333 INFO:tasks.workunit.client.0.smithi052.stdout:8/66: chown d6/d9/df 1 1 2024-09-06T14:44:33.333 INFO:tasks.workunit.client.1.smithi165.stdout:4/699: symlink d5/d1b/d1c/d20/d75/d83/dae/leb 0 2024-09-06T14:44:33.336 INFO:tasks.workunit.client.1.smithi165.stdout:3/694: dwrite d1/d41/f56 [0,4194304] 0 2024-09-06T14:44:33.336 INFO:tasks.workunit.client.0.smithi052.stdout:3/111: symlink d0/d11/d12/l1f 0 2024-09-06T14:44:33.338 INFO:tasks.workunit.client.0.smithi052.stdout:2/41: write f2 [95105,30443] 0 2024-09-06T14:44:33.340 INFO:tasks.workunit.client.0.smithi052.stdout:8/67: symlink d6/d9/df/l12 0 2024-09-06T14:44:33.340 INFO:tasks.workunit.client.0.smithi052.stdout:8/68: chown d6/c7 48737032 1 2024-09-06T14:44:33.341 INFO:tasks.workunit.client.0.smithi052.stdout:8/69: chown c5 0 1 2024-09-06T14:44:33.342 INFO:tasks.workunit.client.0.smithi052.stdout:0/64: rename d0/d2/c3 to d0/d2/ca 0 2024-09-06T14:44:33.343 INFO:tasks.workunit.client.0.smithi052.stdout:7/42: write ff [4823794,63882] 0 2024-09-06T14:44:33.346 INFO:tasks.workunit.client.0.smithi052.stdout:3/112: symlink d0/d11/l20 0 2024-09-06T14:44:33.348 INFO:tasks.workunit.client.1.smithi165.stdout:2/604: dwrite d9/d25/d46/f7c [0,4194304] 0 2024-09-06T14:44:33.349 INFO:tasks.workunit.client.1.smithi165.stdout:7/567: dread d20/d65/f6c [0,4194304] 0 2024-09-06T14:44:33.349 INFO:tasks.workunit.client.1.smithi165.stdout:4/700: dwrite d5/d1b/d61/d77/dd5/fe8 [0,4194304] 0 2024-09-06T14:44:33.352 INFO:tasks.workunit.client.0.smithi052.stdout:8/70: mknod d6/c13 0 2024-09-06T14:44:33.352 INFO:tasks.workunit.client.1.smithi165.stdout:2/605: chown d9/d88/db8/lc1 595180 1 2024-09-06T14:44:33.353 INFO:tasks.workunit.client.0.smithi052.stdout:1/75: write d1/db/fd [3370798,79867] 0 2024-09-06T14:44:33.354 INFO:tasks.workunit.client.1.smithi165.stdout:2/606: dread - d9/d23/d29/d48/fb6 zero size 2024-09-06T14:44:33.354 INFO:tasks.workunit.client.1.smithi165.stdout:3/695: dwrite d1/d7c/fad [4194304,4194304] 0 2024-09-06T14:44:33.357 INFO:tasks.workunit.client.0.smithi052.stdout:3/113: chown d0/d11/c13 30 1 2024-09-06T14:44:33.358 INFO:tasks.workunit.client.0.smithi052.stdout:7/43: fsync ff 0 2024-09-06T14:44:33.362 INFO:tasks.workunit.client.0.smithi052.stdout:2/42: rename l3 to da/db/lf 0 2024-09-06T14:44:33.363 INFO:tasks.workunit.client.0.smithi052.stdout:2/43: write f9 [358276,28421] 0 2024-09-06T14:44:33.372 INFO:tasks.workunit.client.0.smithi052.stdout:2/44: dwrite f0 [0,4194304] 0 2024-09-06T14:44:33.378 INFO:tasks.workunit.client.1.smithi165.stdout:5/742: symlink d6/d1c/d28/d2d/d49/de9/l10c 0 2024-09-06T14:44:33.381 INFO:tasks.workunit.client.0.smithi052.stdout:8/71: mkdir d6/d9/df/d10/d14 0 2024-09-06T14:44:33.381 INFO:tasks.workunit.client.1.smithi165.stdout:6/691: mkdir d29/dd1 0 2024-09-06T14:44:33.383 INFO:tasks.workunit.client.0.smithi052.stdout:0/65: dwrite d0/d2/f9 [0,4194304] 0 2024-09-06T14:44:33.385 INFO:tasks.workunit.client.0.smithi052.stdout:3/114: dwrite d0/fc [0,4194304] 0 2024-09-06T14:44:33.385 INFO:tasks.workunit.client.0.smithi052.stdout:2/45: symlink da/db/l10 0 2024-09-06T14:44:33.392 INFO:tasks.workunit.client.0.smithi052.stdout:1/76: write d1/da/ff [725588,89013] 0 2024-09-06T14:44:33.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/66: dwrite d0/d2/f9 [0,4194304] 0 2024-09-06T14:44:33.399 INFO:tasks.workunit.client.0.smithi052.stdout:2/46: creat da/f11 x:0 0 0 2024-09-06T14:44:33.399 INFO:tasks.workunit.client.0.smithi052.stdout:3/115: dwrite d0/f9 [0,4194304] 0 2024-09-06T14:44:33.400 INFO:tasks.workunit.client.0.smithi052.stdout:7/44: link cb c10 0 2024-09-06T14:44:33.401 INFO:tasks.workunit.client.1.smithi165.stdout:7/568: rename d20/d3b/d69/d88/d80/f8d to d20/d4d/fb8 0 2024-09-06T14:44:33.401 INFO:tasks.workunit.client.1.smithi165.stdout:4/701: dread d5/d1b/d1c/f57 [0,4194304] 0 2024-09-06T14:44:33.403 INFO:tasks.workunit.client.0.smithi052.stdout:8/72: mknod d6/d9/df/d10/d14/c15 0 2024-09-06T14:44:33.404 INFO:tasks.workunit.client.1.smithi165.stdout:2/607: mknod d9/d25/d45/cc7 0 2024-09-06T14:44:33.404 INFO:tasks.workunit.client.1.smithi165.stdout:9/798: sync 2024-09-06T14:44:33.405 INFO:tasks.workunit.client.1.smithi165.stdout:9/799: chown db/de/d15/d17/f19 9060161 1 2024-09-06T14:44:33.406 INFO:tasks.workunit.client.1.smithi165.stdout:3/696: creat d1/d7c/d7e/dc5/fe7 x:0 0 0 2024-09-06T14:44:33.406 INFO:tasks.workunit.client.1.smithi165.stdout:4/702: read d5/d1b/d1c/d41/f99 [608621,123547] 0 2024-09-06T14:44:33.407 INFO:tasks.workunit.client.1.smithi165.stdout:3/697: fdatasync d1/d4a/dc7/fdf 0 2024-09-06T14:44:33.409 INFO:tasks.workunit.client.0.smithi052.stdout:1/77: dwrite d1/db/fd [0,4194304] 0 2024-09-06T14:44:33.413 INFO:tasks.workunit.client.0.smithi052.stdout:2/47: dread f0 [0,4194304] 0 2024-09-06T14:44:33.413 INFO:tasks.workunit.client.1.smithi165.stdout:1/633: rmdir d0/d2a/d18/d24 39 2024-09-06T14:44:33.414 INFO:tasks.workunit.client.0.smithi052.stdout:7/45: mkdir d11 0 2024-09-06T14:44:33.416 INFO:tasks.workunit.client.1.smithi165.stdout:0/629: dwrite d15/d19/d28/d3a/d3f/f48 [0,4194304] 0 2024-09-06T14:44:33.418 INFO:tasks.workunit.client.0.smithi052.stdout:0/67: creat d0/d2/fb x:0 0 0 2024-09-06T14:44:33.422 INFO:tasks.workunit.client.0.smithi052.stdout:1/78: mkdir d1/da/d12 0 2024-09-06T14:44:33.425 INFO:tasks.workunit.client.0.smithi052.stdout:2/48: creat da/db/f12 x:0 0 0 2024-09-06T14:44:33.425 INFO:tasks.workunit.client.0.smithi052.stdout:3/116: dwrite d0/fe [0,4194304] 0 2024-09-06T14:44:33.428 INFO:tasks.workunit.client.0.smithi052.stdout:3/117: write d0/f1a [961925,98867] 0 2024-09-06T14:44:33.428 INFO:tasks.workunit.client.1.smithi165.stdout:2/608: unlink d9/d4f/f91 0 2024-09-06T14:44:33.429 INFO:tasks.workunit.client.1.smithi165.stdout:2/609: write d9/d25/d46/f7c [4917957,41037] 0 2024-09-06T14:44:33.429 INFO:tasks.workunit.client.0.smithi052.stdout:0/68: symlink d0/d2/lc 0 2024-09-06T14:44:33.432 INFO:tasks.workunit.client.1.smithi165.stdout:3/698: creat d1/d41/fe8 x:0 0 0 2024-09-06T14:44:33.434 INFO:tasks.workunit.client.1.smithi165.stdout:4/703: symlink d5/d1b/d61/dd7/ddf/lec 0 2024-09-06T14:44:33.435 INFO:tasks.workunit.client.1.smithi165.stdout:3/699: readlink d1/da/dc/d3b/l3c 0 2024-09-06T14:44:33.436 INFO:tasks.workunit.client.1.smithi165.stdout:4/704: stat d5/d1b/d66 0 2024-09-06T14:44:33.436 INFO:tasks.workunit.client.0.smithi052.stdout:7/46: creat d11/f12 x:0 0 0 2024-09-06T14:44:33.438 INFO:tasks.workunit.client.1.smithi165.stdout:2/610: dwrite d9/d25/d45/d75/d67/d76/f77 [0,4194304] 0 2024-09-06T14:44:33.440 INFO:tasks.workunit.client.1.smithi165.stdout:6/692: mknod d29/d6a/cd2 0 2024-09-06T14:44:33.444 INFO:tasks.workunit.client.0.smithi052.stdout:2/49: dread f1 [0,4194304] 0 2024-09-06T14:44:33.445 INFO:tasks.workunit.client.0.smithi052.stdout:3/118: creat d0/f21 x:0 0 0 2024-09-06T14:44:33.453 INFO:tasks.workunit.client.0.smithi052.stdout:7/47: rename l6 to d11/l13 0 2024-09-06T14:44:33.458 INFO:tasks.workunit.client.0.smithi052.stdout:1/79: write d1/f4 [758108,71627] 0 2024-09-06T14:44:33.459 INFO:tasks.workunit.client.1.smithi165.stdout:4/705: dread d5/d1b/d61/d77/d7c/fd2 [0,4194304] 0 2024-09-06T14:44:33.459 INFO:tasks.workunit.client.1.smithi165.stdout:5/743: write d6/d1c/d28/d4b/d55/f6a [1412923,102202] 0 2024-09-06T14:44:33.459 INFO:tasks.workunit.client.0.smithi052.stdout:0/69: mkdir d0/dd 0 2024-09-06T14:44:33.460 INFO:tasks.workunit.client.0.smithi052.stdout:0/70: chown d0/dd 218994589 1 2024-09-06T14:44:33.461 INFO:tasks.workunit.client.0.smithi052.stdout:0/71: chown d0/d2/fb 111920950 1 2024-09-06T14:44:33.462 INFO:tasks.workunit.client.0.smithi052.stdout:0/72: write d0/d2/f9 [458702,63419] 0 2024-09-06T14:44:33.462 INFO:tasks.workunit.client.1.smithi165.stdout:3/700: creat d1/d19/d4d/fe9 x:0 0 0 2024-09-06T14:44:33.463 INFO:tasks.workunit.client.0.smithi052.stdout:8/73: getdents d6/d9/df/d10/d14 0 2024-09-06T14:44:33.463 INFO:tasks.workunit.client.1.smithi165.stdout:3/701: read d1/da/dd/f15 [3174787,95934] 0 2024-09-06T14:44:33.466 INFO:tasks.workunit.client.0.smithi052.stdout:7/48: fsync f7 0 2024-09-06T14:44:33.466 INFO:tasks.workunit.client.0.smithi052.stdout:7/49: fdatasync d11/f12 0 2024-09-06T14:44:33.467 INFO:tasks.workunit.client.0.smithi052.stdout:0/73: dread d0/d2/f9 [0,4194304] 0 2024-09-06T14:44:33.469 INFO:tasks.workunit.client.0.smithi052.stdout:2/50: write f0 [4934641,121275] 0 2024-09-06T14:44:33.470 INFO:tasks.workunit.client.0.smithi052.stdout:2/51: fsync da/db/fe 0 2024-09-06T14:44:33.471 INFO:tasks.workunit.client.1.smithi165.stdout:6/693: creat d29/d93/d87/db9/fd3 x:0 0 0 2024-09-06T14:44:33.471 INFO:tasks.workunit.client.0.smithi052.stdout:2/52: read f1 [2773961,52104] 0 2024-09-06T14:44:33.472 INFO:tasks.workunit.client.0.smithi052.stdout:2/53: write f2 [3197560,60064] 0 2024-09-06T14:44:33.474 INFO:tasks.workunit.client.1.smithi165.stdout:8/692: getdents d0/d5e/d65 0 2024-09-06T14:44:33.476 INFO:tasks.workunit.client.0.smithi052.stdout:2/54: dread f9 [0,4194304] 0 2024-09-06T14:44:33.477 INFO:tasks.workunit.client.1.smithi165.stdout:7/569: creat d20/d33/d53/fb9 x:0 0 0 2024-09-06T14:44:33.479 INFO:tasks.workunit.client.0.smithi052.stdout:3/119: dwrite d0/ff [0,4194304] 0 2024-09-06T14:44:33.481 INFO:tasks.workunit.client.1.smithi165.stdout:4/706: mknod d5/d1b/d61/d77/dbd/ced 0 2024-09-06T14:44:33.481 INFO:tasks.workunit.client.0.smithi052.stdout:3/120: write d0/f1d [338658,57708] 0 2024-09-06T14:44:33.482 INFO:tasks.workunit.client.0.smithi052.stdout:3/121: fdatasync d0/f21 0 2024-09-06T14:44:33.482 INFO:tasks.workunit.client.1.smithi165.stdout:7/570: dwrite d20/d33/d53/fb9 [0,4194304] 0 2024-09-06T14:44:33.483 INFO:tasks.workunit.client.1.smithi165.stdout:5/744: creat d6/d1c/d28/d2d/d49/f10d x:0 0 0 2024-09-06T14:44:33.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/745: truncate d6/d1c/d28/d2d/d61/fc9 568539 0 2024-09-06T14:44:33.485 INFO:tasks.workunit.client.1.smithi165.stdout:5/746: readlink d6/l52 0 2024-09-06T14:44:33.489 INFO:tasks.workunit.client.0.smithi052.stdout:7/50: write f5 [64044,50457] 0 2024-09-06T14:44:33.490 INFO:tasks.workunit.client.1.smithi165.stdout:1/634: getdents d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69 0 2024-09-06T14:44:33.492 INFO:tasks.workunit.client.0.smithi052.stdout:2/55: mknod da/db/c13 0 2024-09-06T14:44:33.493 INFO:tasks.workunit.client.0.smithi052.stdout:2/56: write f7 [2232569,7108] 0 2024-09-06T14:44:33.493 INFO:tasks.workunit.client.1.smithi165.stdout:5/747: dread d6/d1c/d28/d4b/d55/f6a [0,4194304] 0 2024-09-06T14:44:33.494 INFO:tasks.workunit.client.1.smithi165.stdout:0/630: creat d15/fd2 x:0 0 0 2024-09-06T14:44:33.494 INFO:tasks.workunit.client.1.smithi165.stdout:5/748: chown d6/d1c/f74 0 1 2024-09-06T14:44:33.500 INFO:tasks.workunit.client.1.smithi165.stdout:0/631: dwrite d15/f2f [0,4194304] 0 2024-09-06T14:44:33.506 INFO:tasks.workunit.client.1.smithi165.stdout:3/702: dread d1/da/d43/f96 [0,4194304] 0 2024-09-06T14:44:33.507 INFO:tasks.workunit.client.1.smithi165.stdout:7/571: creat d20/d3b/d69/da3/fba x:0 0 0 2024-09-06T14:44:33.508 INFO:tasks.workunit.client.1.smithi165.stdout:3/703: dread - d1/d19/d4d/fa5 zero size 2024-09-06T14:44:33.509 INFO:tasks.workunit.client.1.smithi165.stdout:3/704: read d1/d19/d92/fcd [1154707,8214] 0 2024-09-06T14:44:33.509 INFO:tasks.workunit.client.0.smithi052.stdout:0/74: creat d0/fe x:0 0 0 2024-09-06T14:44:33.510 INFO:tasks.workunit.client.1.smithi165.stdout:3/705: chown d1/da/dc/f5e 63 1 2024-09-06T14:44:33.515 INFO:tasks.workunit.client.0.smithi052.stdout:3/122: creat d0/d11/d12/d18/f22 x:0 0 0 2024-09-06T14:44:33.516 INFO:tasks.workunit.client.0.smithi052.stdout:3/123: fsync d0/f9 0 2024-09-06T14:44:33.517 INFO:tasks.workunit.client.0.smithi052.stdout:3/124: readlink d0/d11/d12/l14 0 2024-09-06T14:44:33.518 INFO:tasks.workunit.client.0.smithi052.stdout:7/51: link d11/f12 d11/f14 0 2024-09-06T14:44:33.519 INFO:tasks.workunit.client.0.smithi052.stdout:2/57: dwrite f0 [0,4194304] 0 2024-09-06T14:44:33.521 INFO:tasks.workunit.client.1.smithi165.stdout:9/800: sync 2024-09-06T14:44:33.523 INFO:tasks.workunit.client.0.smithi052.stdout:0/75: dread d0/d2/f9 [0,4194304] 0 2024-09-06T14:44:33.524 INFO:tasks.workunit.client.0.smithi052.stdout:0/76: rename d0/d2 to d0/d2/df 22 2024-09-06T14:44:33.526 INFO:tasks.workunit.client.1.smithi165.stdout:9/801: dread db/de/d15/d74/fb0 [0,4194304] 0 2024-09-06T14:44:33.526 INFO:tasks.workunit.client.0.smithi052.stdout:0/77: write d0/d2/fb [268518,23244] 0 2024-09-06T14:44:33.529 INFO:tasks.workunit.client.1.smithi165.stdout:9/802: read - db/de/d15/d17/d18/d7d/d8e/ded/df1/ff8 zero size 2024-09-06T14:44:33.529 INFO:tasks.workunit.client.1.smithi165.stdout:4/707: write d5/f2b [1156013,58863] 0 2024-09-06T14:44:33.529 INFO:tasks.workunit.client.1.smithi165.stdout:2/611: dwrite d9/d25/d45/f89 [0,4194304] 0 2024-09-06T14:44:33.531 INFO:tasks.workunit.client.0.smithi052.stdout:0/78: dread d0/d2/f9 [0,4194304] 0 2024-09-06T14:44:33.531 INFO:tasks.workunit.client.1.smithi165.stdout:4/708: write d5/d1b/d1c/d78/f92 [2611062,65578] 0 2024-09-06T14:44:33.532 INFO:tasks.workunit.client.0.smithi052.stdout:0/79: chown d0/d2/f9 16746723 1 2024-09-06T14:44:33.535 INFO:tasks.workunit.client.0.smithi052.stdout:7/52: symlink d11/l15 0 2024-09-06T14:44:33.537 INFO:tasks.workunit.client.0.smithi052.stdout:2/58: mknod da/db/c14 0 2024-09-06T14:44:33.539 INFO:tasks.workunit.client.1.smithi165.stdout:0/632: symlink d15/d19/d50/d53/d7c/d9a/ld3 0 2024-09-06T14:44:33.542 INFO:tasks.workunit.client.0.smithi052.stdout:3/125: creat d0/d11/d12/d17/f23 x:0 0 0 2024-09-06T14:44:33.545 INFO:tasks.workunit.client.0.smithi052.stdout:7/53: mknod d11/c16 0 2024-09-06T14:44:33.546 INFO:tasks.workunit.client.1.smithi165.stdout:3/706: mknod d1/da/dd/d4b/cea 0 2024-09-06T14:44:33.547 INFO:tasks.workunit.client.0.smithi052.stdout:2/59: fdatasync f0 0 2024-09-06T14:44:33.549 INFO:tasks.workunit.client.0.smithi052.stdout:3/126: symlink d0/l24 0 2024-09-06T14:44:33.550 INFO:tasks.workunit.client.0.smithi052.stdout:3/127: write d0/fc [3716910,67041] 0 2024-09-06T14:44:33.551 INFO:tasks.workunit.client.0.smithi052.stdout:3/128: chown d0/ca 16648 1 2024-09-06T14:44:33.551 INFO:tasks.workunit.client.0.smithi052.stdout:3/129: chown d0/f1d 240342102 1 2024-09-06T14:44:33.555 INFO:tasks.workunit.client.1.smithi165.stdout:7/572: dread d20/d3b/d69/d88/d30/f31 [0,4194304] 0 2024-09-06T14:44:33.555 INFO:tasks.workunit.client.0.smithi052.stdout:7/54: creat d11/f17 x:0 0 0 2024-09-06T14:44:33.556 INFO:tasks.workunit.client.1.smithi165.stdout:7/573: readlink d20/d33/d53/l77 0 2024-09-06T14:44:33.558 INFO:tasks.workunit.client.0.smithi052.stdout:2/60: creat da/f15 x:0 0 0 2024-09-06T14:44:33.558 INFO:tasks.workunit.client.0.smithi052.stdout:2/61: fdatasync f1 0 2024-09-06T14:44:33.560 INFO:tasks.workunit.client.0.smithi052.stdout:2/62: write f7 [5059720,97957] 0 2024-09-06T14:44:33.560 INFO:tasks.workunit.client.0.smithi052.stdout:2/63: dread - da/db/f12 zero size 2024-09-06T14:44:33.564 INFO:tasks.workunit.client.1.smithi165.stdout:1/635: dread d0/d2a/d18/d24/d4b/d5f/f61 [0,4194304] 0 2024-09-06T14:44:33.564 INFO:tasks.workunit.client.0.smithi052.stdout:3/130: creat d0/d11/d12/d18/f25 x:0 0 0 2024-09-06T14:44:33.566 INFO:tasks.workunit.client.1.smithi165.stdout:9/803: creat db/de/d15/d17/d72/da3/ffb x:0 0 0 2024-09-06T14:44:33.566 INFO:tasks.workunit.client.0.smithi052.stdout:3/131: write d0/d11/d12/d18/f22 [870994,125976] 0 2024-09-06T14:44:33.567 INFO:tasks.workunit.client.0.smithi052.stdout:7/55: fsync d11/f12 0 2024-09-06T14:44:33.568 INFO:tasks.workunit.client.0.smithi052.stdout:3/132: write d0/d11/d12/d18/f25 [152106,74882] 0 2024-09-06T14:44:33.569 INFO:tasks.workunit.client.0.smithi052.stdout:3/133: stat d0/fc 0 2024-09-06T14:44:33.571 INFO:tasks.workunit.client.0.smithi052.stdout:2/64: rename da/f15 to da/db/f16 0 2024-09-06T14:44:33.571 INFO:tasks.workunit.client.1.smithi165.stdout:0/633: write d15/d19/d66/f95 [2078818,91178] 0 2024-09-06T14:44:33.573 INFO:tasks.workunit.client.0.smithi052.stdout:0/80: link d0/c7 d0/dd/c10 0 2024-09-06T14:44:33.574 INFO:tasks.workunit.client.1.smithi165.stdout:3/707: chown d1/da/c7f 24 1 2024-09-06T14:44:33.574 INFO:tasks.workunit.client.1.smithi165.stdout:3/708: chown d1/d19/f29 589 1 2024-09-06T14:44:33.576 INFO:tasks.workunit.client.0.smithi052.stdout:3/134: dwrite d0/fe [0,4194304] 0 2024-09-06T14:44:33.578 INFO:tasks.workunit.client.1.smithi165.stdout:7/574: unlink d20/d3b/d69/d88/f4c 0 2024-09-06T14:44:33.578 INFO:tasks.workunit.client.1.smithi165.stdout:6/694: link d29/d32/c38 d29/d39/d5b/d62/cd4 0 2024-09-06T14:44:33.580 INFO:tasks.workunit.client.1.smithi165.stdout:2/612: chown d9/d25/d46/d7e/d90 97 1 2024-09-06T14:44:33.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/65: symlink da/l17 0 2024-09-06T14:44:33.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/66: fsync f1 0 2024-09-06T14:44:33.583 INFO:tasks.workunit.client.1.smithi165.stdout:8/693: getdents d0 0 2024-09-06T14:44:33.583 INFO:tasks.workunit.client.0.smithi052.stdout:0/81: creat d0/d2/f11 x:0 0 0 2024-09-06T14:44:33.584 INFO:tasks.workunit.client.1.smithi165.stdout:2/613: read d9/d25/f61 [771818,123448] 0 2024-09-06T14:44:33.584 INFO:tasks.workunit.client.1.smithi165.stdout:8/694: chown d0/d19/d24/db1/d5b 3141 1 2024-09-06T14:44:33.586 INFO:tasks.workunit.client.1.smithi165.stdout:9/804: rmdir db/de/d15/d7f/d9b/d6c/daf 39 2024-09-06T14:44:33.588 INFO:tasks.workunit.client.0.smithi052.stdout:3/135: mknod d0/d11/d12/d18/c26 0 2024-09-06T14:44:33.589 INFO:tasks.workunit.client.0.smithi052.stdout:3/136: fdatasync d0/d11/d12/d18/f25 0 2024-09-06T14:44:33.590 INFO:tasks.workunit.client.0.smithi052.stdout:2/67: mkdir da/db/d18 0 2024-09-06T14:44:33.591 INFO:tasks.workunit.client.0.smithi052.stdout:3/137: chown d0/f1a 103405 1 2024-09-06T14:44:33.591 INFO:tasks.workunit.client.0.smithi052.stdout:3/138: write d0/f21 [416514,29755] 0 2024-09-06T14:44:33.592 INFO:tasks.workunit.client.1.smithi165.stdout:5/749: rename d6/f23 to d6/f10e 0 2024-09-06T14:44:33.593 INFO:tasks.workunit.client.1.smithi165.stdout:5/750: chown d6/d98/fa6 6006 1 2024-09-06T14:44:33.593 INFO:tasks.workunit.client.0.smithi052.stdout:7/56: link cd d11/c18 0 2024-09-06T14:44:33.598 INFO:tasks.workunit.client.1.smithi165.stdout:0/634: mknod d15/d19/d50/d53/cd4 0 2024-09-06T14:44:33.599 INFO:tasks.workunit.client.0.smithi052.stdout:2/68: mkdir da/d19 0 2024-09-06T14:44:33.602 INFO:tasks.workunit.client.0.smithi052.stdout:7/57: write d11/f12 [709740,72044] 0 2024-09-06T14:44:33.603 INFO:tasks.workunit.client.1.smithi165.stdout:7/575: truncate d20/d33/f8a 1602943 0 2024-09-06T14:44:33.608 INFO:tasks.workunit.client.0.smithi052.stdout:7/58: rename lc to d11/l19 0 2024-09-06T14:44:33.610 INFO:tasks.workunit.client.0.smithi052.stdout:2/69: creat da/d19/f1a x:0 0 0 2024-09-06T14:44:33.610 INFO:tasks.workunit.client.1.smithi165.stdout:2/614: fsync d9/d23/d52/f7f 0 2024-09-06T14:44:33.611 INFO:tasks.workunit.client.1.smithi165.stdout:6/695: dwrite d29/d39/f54 [4194304,4194304] 0 2024-09-06T14:44:33.611 INFO:tasks.workunit.client.1.smithi165.stdout:3/709: dread d1/da/dd/f15 [0,4194304] 0 2024-09-06T14:44:33.612 INFO:tasks.workunit.client.1.smithi165.stdout:3/710: stat d1/f11 0 2024-09-06T14:44:33.612 INFO:tasks.workunit.client.1.smithi165.stdout:6/696: chown d29/d93/d87/db9/fd3 3144005 1 2024-09-06T14:44:33.614 INFO:tasks.workunit.client.1.smithi165.stdout:8/695: creat d0/d19/d24/d26/ff2 x:0 0 0 2024-09-06T14:44:33.617 INFO:tasks.workunit.client.0.smithi052.stdout:2/70: dwrite f7 [0,4194304] 0 2024-09-06T14:44:33.618 INFO:tasks.workunit.client.1.smithi165.stdout:6/697: dwrite d29/d39/d5b/d62/d94/fb1 [0,4194304] 0 2024-09-06T14:44:33.621 INFO:tasks.workunit.client.1.smithi165.stdout:4/709: rename d5/d1b/d66/l8e to d5/lee 0 2024-09-06T14:44:33.623 INFO:tasks.workunit.client.0.smithi052.stdout:2/71: creat da/f1b x:0 0 0 2024-09-06T14:44:33.626 INFO:tasks.workunit.client.0.smithi052.stdout:2/72: write da/fc [4504186,122235] 0 2024-09-06T14:44:33.627 INFO:tasks.workunit.client.0.smithi052.stdout:2/73: chown da/db/f12 30 1 2024-09-06T14:44:33.630 INFO:tasks.workunit.client.1.smithi165.stdout:0/635: rmdir d15/d19/d50/d53/d7c/dae 39 2024-09-06T14:44:33.632 INFO:tasks.workunit.client.0.smithi052.stdout:7/59: getdents d11 0 2024-09-06T14:44:33.633 INFO:tasks.workunit.client.1.smithi165.stdout:7/576: write d20/d3b/d69/d88/f58 [1783648,40203] 0 2024-09-06T14:44:33.636 INFO:tasks.workunit.client.0.smithi052.stdout:2/74: rename f7 to da/d19/f1c 0 2024-09-06T14:44:33.636 INFO:tasks.workunit.client.0.smithi052.stdout:2/75: chown da 11987 1 2024-09-06T14:44:33.636 INFO:tasks.workunit.client.1.smithi165.stdout:1/636: dwrite d0/d2a/d23/d56/f71 [0,4194304] 0 2024-09-06T14:44:33.636 INFO:tasks.workunit.client.1.smithi165.stdout:2/615: fdatasync d9/d25/d45/d75/fba 0 2024-09-06T14:44:33.642 INFO:tasks.workunit.client.1.smithi165.stdout:3/711: mknod d1/d19/d4d/ceb 0 2024-09-06T14:44:33.643 INFO:tasks.workunit.client.1.smithi165.stdout:8/696: mkdir d0/d19/d24/db1/d8c/df3 0 2024-09-06T14:44:33.644 INFO:tasks.workunit.client.0.smithi052.stdout:2/76: link da/db/f12 da/f1d 0 2024-09-06T14:44:33.644 INFO:tasks.workunit.client.1.smithi165.stdout:9/805: dwrite db/de/d15/d7f/d9b/d6c/f75 [0,4194304] 0 2024-09-06T14:44:33.645 INFO:tasks.workunit.client.0.smithi052.stdout:2/77: read f2 [2152649,77225] 0 2024-09-06T14:44:33.648 INFO:tasks.workunit.client.1.smithi165.stdout:4/710: creat d5/d1b/d61/fef x:0 0 0 2024-09-06T14:44:33.648 INFO:tasks.workunit.client.1.smithi165.stdout:5/751: creat d6/d98/dd7/dd9/f10f x:0 0 0 2024-09-06T14:44:33.649 INFO:tasks.workunit.client.1.smithi165.stdout:0/636: mknod d15/d19/d2c/cd5 0 2024-09-06T14:44:33.651 INFO:tasks.workunit.client.1.smithi165.stdout:6/698: creat d29/d39/d5b/d62/d9f/dce/fd5 x:0 0 0 2024-09-06T14:44:33.653 INFO:tasks.workunit.client.1.smithi165.stdout:2/616: mknod d9/d88/db8/cc8 0 2024-09-06T14:44:33.653 INFO:tasks.workunit.client.1.smithi165.stdout:5/752: fsync d6/d98/fa6 0 2024-09-06T14:44:33.653 INFO:tasks.workunit.client.1.smithi165.stdout:1/637: dwrite d0/d2a/d18/d24/d4b/d93/dbd/fa6 [0,4194304] 0 2024-09-06T14:44:33.654 INFO:tasks.workunit.client.1.smithi165.stdout:0/637: chown d15/d55/f82 34439 1 2024-09-06T14:44:33.656 INFO:tasks.workunit.client.1.smithi165.stdout:9/806: truncate db/de/d15/d17/d18/fb3 5219654 0 2024-09-06T14:44:33.658 INFO:tasks.workunit.client.1.smithi165.stdout:0/638: fsync d15/d19/d38/f4c 0 2024-09-06T14:44:33.659 INFO:tasks.workunit.client.1.smithi165.stdout:8/697: rename d0/d34/d6b/d94/fd6 to d0/d34/d6b/d94/ff4 0 2024-09-06T14:44:33.661 INFO:tasks.workunit.client.1.smithi165.stdout:4/711: symlink d5/d1b/d61/dd7/ddf/ddc/lf0 0 2024-09-06T14:44:33.662 INFO:tasks.workunit.client.1.smithi165.stdout:8/698: chown d0/d19/d7f/f82 13577 1 2024-09-06T14:44:33.666 INFO:tasks.workunit.client.1.smithi165.stdout:9/807: creat db/de/d16/d2e/da7/ffc x:0 0 0 2024-09-06T14:44:33.667 INFO:tasks.workunit.client.1.smithi165.stdout:3/712: dread d1/d4a/dc7/fdf [0,4194304] 0 2024-09-06T14:44:33.667 INFO:tasks.workunit.client.1.smithi165.stdout:2/617: symlink d9/d23/d29/d48/d8c/dbf/lc9 0 2024-09-06T14:44:33.668 INFO:tasks.workunit.client.1.smithi165.stdout:1/638: dwrite d0/d2a/d18/d24/d4b/d93/d2b/f38 [0,4194304] 0 2024-09-06T14:44:33.669 INFO:tasks.workunit.client.1.smithi165.stdout:5/753: dwrite d6/f10e [0,4194304] 0 2024-09-06T14:44:33.671 INFO:tasks.workunit.client.1.smithi165.stdout:1/639: chown d0/d2a/d18/d24/d4b/d5f/f60 246720291 1 2024-09-06T14:44:33.672 INFO:tasks.workunit.client.1.smithi165.stdout:1/640: dread - d0/fba zero size 2024-09-06T14:44:33.672 INFO:tasks.workunit.client.0.smithi052.stdout:7/60: dwrite f7 [0,4194304] 0 2024-09-06T14:44:33.673 INFO:tasks.workunit.client.1.smithi165.stdout:8/699: creat d0/d19/d36/d28/d64/ff5 x:0 0 0 2024-09-06T14:44:33.678 INFO:tasks.workunit.client.0.smithi052.stdout:7/61: unlink d11/f17 0 2024-09-06T14:44:33.679 INFO:tasks.workunit.client.1.smithi165.stdout:1/641: dwrite d0/f14 [0,4194304] 0 2024-09-06T14:44:33.681 INFO:tasks.workunit.client.1.smithi165.stdout:3/713: mknod d1/d19/d92/cec 0 2024-09-06T14:44:33.687 INFO:tasks.workunit.client.1.smithi165.stdout:2/618: rename d9/d23/l50 to d9/d25/d46/d7e/d90/lca 0 2024-09-06T14:44:33.689 INFO:tasks.workunit.client.0.smithi052.stdout:7/62: dwrite d11/f14 [0,4194304] 0 2024-09-06T14:44:33.691 INFO:tasks.workunit.client.1.smithi165.stdout:5/754: creat d6/d1c/d28/d4b/d55/d8a/dda/f110 x:0 0 0 2024-09-06T14:44:33.696 INFO:tasks.workunit.client.0.smithi052.stdout:7/63: mknod d11/c1a 0 2024-09-06T14:44:33.696 INFO:tasks.workunit.client.0.smithi052.stdout:7/64: fdatasync ff 0 2024-09-06T14:44:33.698 INFO:tasks.workunit.client.1.smithi165.stdout:0/639: dwrite d15/f4b [4194304,4194304] 0 2024-09-06T14:44:33.699 INFO:tasks.workunit.client.1.smithi165.stdout:6/699: truncate d29/f47 314574 0 2024-09-06T14:44:33.700 INFO:tasks.workunit.client.1.smithi165.stdout:6/700: read d29/d39/d5b/d62/fa3 [4234584,15200] 0 2024-09-06T14:44:33.701 INFO:tasks.workunit.client.1.smithi165.stdout:1/642: symlink d0/d2a/d18/d24/d4b/d93/dbd/lcf 0 2024-09-06T14:44:33.702 INFO:tasks.workunit.client.0.smithi052.stdout:7/65: mknod d11/c1b 0 2024-09-06T14:44:33.704 INFO:tasks.workunit.client.0.smithi052.stdout:7/66: chown d11/c1b 127653 1 2024-09-06T14:44:33.704 INFO:tasks.workunit.client.1.smithi165.stdout:3/714: mkdir d1/d7c/ded 0 2024-09-06T14:44:33.704 INFO:tasks.workunit.client.1.smithi165.stdout:2/619: rmdir d9/d23/d29/d48/d8c 39 2024-09-06T14:44:33.705 INFO:tasks.workunit.client.1.smithi165.stdout:2/620: fdatasync d9/d25/d46/f7c 0 2024-09-06T14:44:33.707 INFO:tasks.workunit.client.1.smithi165.stdout:6/701: dread d29/d32/fb5 [0,4194304] 0 2024-09-06T14:44:33.707 INFO:tasks.workunit.client.1.smithi165.stdout:4/712: creat d5/d1b/d1c/ff1 x:0 0 0 2024-09-06T14:44:33.709 INFO:tasks.workunit.client.1.smithi165.stdout:5/755: creat d6/d1c/d28/d2d/d3c/f111 x:0 0 0 2024-09-06T14:44:33.710 INFO:tasks.workunit.client.1.smithi165.stdout:3/715: dwrite d1/d19/f91 [0,4194304] 0 2024-09-06T14:44:33.710 INFO:tasks.workunit.client.1.smithi165.stdout:5/756: fsync d6/dc1/ff4 0 2024-09-06T14:44:33.711 INFO:tasks.workunit.client.1.smithi165.stdout:3/716: chown d1/dbd 632999260 1 2024-09-06T14:44:33.711 INFO:tasks.workunit.client.0.smithi052.stdout:7/67: dwrite d11/f14 [0,4194304] 0 2024-09-06T14:44:33.714 INFO:tasks.workunit.client.1.smithi165.stdout:8/700: link d0/d19/d36/d2d/d3f/ff0 d0/d14/d3e/dd8/ff6 0 2024-09-06T14:44:33.715 INFO:tasks.workunit.client.1.smithi165.stdout:9/808: rmdir db/dcf/df2 0 2024-09-06T14:44:33.717 INFO:tasks.workunit.client.0.smithi052.stdout:7/68: mkdir d11/d1c 0 2024-09-06T14:44:33.718 INFO:tasks.workunit.client.0.smithi052.stdout:7/69: chown d11/c16 33322350 1 2024-09-06T14:44:33.722 INFO:tasks.workunit.client.1.smithi165.stdout:0/640: mkdir d15/d19/d28/d3a/d5d/dd6 0 2024-09-06T14:44:33.723 INFO:tasks.workunit.client.0.smithi052.stdout:7/70: read f5 [853621,106380] 0 2024-09-06T14:44:33.724 INFO:tasks.workunit.client.1.smithi165.stdout:0/641: stat d15/d19/d38/c3c 0 2024-09-06T14:44:33.724 INFO:tasks.workunit.client.0.smithi052.stdout:7/71: read ff [3861892,13244] 0 2024-09-06T14:44:33.725 INFO:tasks.workunit.client.0.smithi052.stdout:7/72: write d11/f12 [3754550,1579] 0 2024-09-06T14:44:33.727 INFO:tasks.workunit.client.1.smithi165.stdout:1/643: creat d0/d1c/d1d/d57/fd0 x:0 0 0 2024-09-06T14:44:33.729 INFO:tasks.workunit.client.1.smithi165.stdout:4/713: dread d5/d1b/d1c/d55/d7d/fa8 [0,4194304] 0 2024-09-06T14:44:33.729 INFO:tasks.workunit.client.0.smithi052.stdout:7/73: dread d11/f12 [0,4194304] 0 2024-09-06T14:44:33.730 INFO:tasks.workunit.client.1.smithi165.stdout:4/714: write d5/d1b/d1c/d78/f91 [293369,69203] 0 2024-09-06T14:44:33.732 INFO:tasks.workunit.client.0.smithi052.stdout:7/74: rmdir d11 39 2024-09-06T14:44:33.733 INFO:tasks.workunit.client.1.smithi165.stdout:6/702: rmdir d29/d39/d5b/d62/d9f/dce 39 2024-09-06T14:44:33.734 INFO:tasks.workunit.client.1.smithi165.stdout:7/577: sync 2024-09-06T14:44:33.739 INFO:tasks.workunit.client.1.smithi165.stdout:3/717: creat d1/d41/fee x:0 0 0 2024-09-06T14:44:33.741 INFO:tasks.workunit.client.1.smithi165.stdout:8/701: creat d0/d14/d3e/dcf/ff7 x:0 0 0 2024-09-06T14:44:33.741 INFO:tasks.workunit.client.1.smithi165.stdout:5/757: dread d6/d1c/f74 [0,4194304] 0 2024-09-06T14:44:33.742 INFO:tasks.workunit.client.0.smithi052.stdout:7/75: creat d11/d1c/f1d x:0 0 0 2024-09-06T14:44:33.742 INFO:tasks.workunit.client.0.smithi052.stdout:7/76: read d11/f14 [1482917,19341] 0 2024-09-06T14:44:33.746 INFO:tasks.workunit.client.0.smithi052.stdout:7/77: chown c10 870252 1 2024-09-06T14:44:33.747 INFO:tasks.workunit.client.1.smithi165.stdout:4/715: dread d5/d1b/d1c/d8c/fad [0,4194304] 0 2024-09-06T14:44:33.749 INFO:tasks.workunit.client.1.smithi165.stdout:4/716: write d5/d1b/d61/dd7/ddf/f4b [6613467,82671] 0 2024-09-06T14:44:33.749 INFO:tasks.workunit.client.0.smithi052.stdout:7/78: creat d11/d1c/f1e x:0 0 0 2024-09-06T14:44:33.753 INFO:tasks.workunit.client.1.smithi165.stdout:8/702: dread d0/d19/d36/d2d/d33/d3a/fb0 [0,4194304] 0 2024-09-06T14:44:33.753 INFO:tasks.workunit.client.1.smithi165.stdout:6/703: dread d29/d39/d5b/d62/d94/fbc [0,4194304] 0 2024-09-06T14:44:33.753 INFO:tasks.workunit.client.1.smithi165.stdout:4/717: fdatasync d5/d1b/d1c/d78/f92 0 2024-09-06T14:44:33.755 INFO:tasks.workunit.client.1.smithi165.stdout:6/704: readlink d29/d6a/la4 0 2024-09-06T14:44:33.755 INFO:tasks.workunit.client.1.smithi165.stdout:7/578: symlink d20/d33/d6a/lbb 0 2024-09-06T14:44:33.757 INFO:tasks.workunit.client.1.smithi165.stdout:7/579: chown d20/f2b 0 1 2024-09-06T14:44:33.757 INFO:tasks.workunit.client.1.smithi165.stdout:3/718: rename d1/da/dd/l81 to d1/da/dd/d8c/dae/lef 0 2024-09-06T14:44:33.758 INFO:tasks.workunit.client.1.smithi165.stdout:1/644: dwrite d0/d1c/d40/f7a [0,4194304] 0 2024-09-06T14:44:33.759 INFO:tasks.workunit.client.1.smithi165.stdout:5/758: unlink d6/d1c/d28/d2d/d3c/l5c 0 2024-09-06T14:44:33.761 INFO:tasks.workunit.client.1.smithi165.stdout:2/621: write d9/f68 [4965057,80739] 0 2024-09-06T14:44:33.764 INFO:tasks.workunit.client.1.smithi165.stdout:4/718: unlink d5/d1b/d1c/d20/d75/caf 0 2024-09-06T14:44:33.767 INFO:tasks.workunit.client.1.smithi165.stdout:6/705: dwrite d29/d6a/d83/fc4 [0,4194304] 0 2024-09-06T14:44:33.768 INFO:tasks.workunit.client.1.smithi165.stdout:4/719: chown d5/fc 11468890 1 2024-09-06T14:44:33.768 INFO:tasks.workunit.client.1.smithi165.stdout:0/642: dread d15/d19/f1e [0,4194304] 0 2024-09-06T14:44:33.773 INFO:tasks.workunit.client.1.smithi165.stdout:1/645: dwrite d0/d1c/d41/f5e [4194304,4194304] 0 2024-09-06T14:44:33.773 INFO:tasks.workunit.client.1.smithi165.stdout:5/759: dwrite d6/d98/f101 [0,4194304] 0 2024-09-06T14:44:33.780 INFO:tasks.workunit.client.1.smithi165.stdout:9/809: link db/de/d15/d17/d18/d7d/d61/cd4 db/de/d15/d17/dad/cfd 0 2024-09-06T14:44:33.781 INFO:tasks.workunit.client.1.smithi165.stdout:0/643: chown d15/d19/l4d 632217 1 2024-09-06T14:44:33.783 INFO:tasks.workunit.client.1.smithi165.stdout:5/760: rmdir d6/d1c/d64 39 2024-09-06T14:44:33.783 INFO:tasks.workunit.client.1.smithi165.stdout:1/646: rmdir d0/d2a/d18 39 2024-09-06T14:44:33.784 INFO:tasks.workunit.client.1.smithi165.stdout:4/720: dwrite d5/d1b/d1c/d55/f56 [0,4194304] 0 2024-09-06T14:44:33.785 INFO:tasks.workunit.client.1.smithi165.stdout:8/703: rmdir d0/d19/dc6 0 2024-09-06T14:44:33.788 INFO:tasks.workunit.client.1.smithi165.stdout:5/761: write d6/d1c/d28/d4b/da7/dab/fe5 [55667,53869] 0 2024-09-06T14:44:33.788 INFO:tasks.workunit.client.1.smithi165.stdout:7/580: write f8 [1359832,86953] 0 2024-09-06T14:44:33.788 INFO:tasks.workunit.client.1.smithi165.stdout:6/706: getdents d29/d39/d5b/d68/db3 0 2024-09-06T14:44:33.790 INFO:tasks.workunit.client.1.smithi165.stdout:7/581: readlink d20/d3b/d69/d88/d30/l3c 0 2024-09-06T14:44:33.790 INFO:tasks.workunit.client.1.smithi165.stdout:6/707: chown d29/d39/d5b/c81 34032100 1 2024-09-06T14:44:33.793 INFO:tasks.workunit.client.1.smithi165.stdout:8/704: read d0/d19/d36/fb [2380876,104002] 0 2024-09-06T14:44:33.795 INFO:tasks.workunit.client.1.smithi165.stdout:2/622: getdents d9 0 2024-09-06T14:44:33.795 INFO:tasks.workunit.client.1.smithi165.stdout:4/721: symlink d5/lf2 0 2024-09-06T14:44:33.796 INFO:tasks.workunit.client.1.smithi165.stdout:1/647: read d0/d2a/d18/f43 [1539435,78750] 0 2024-09-06T14:44:33.796 INFO:tasks.workunit.client.1.smithi165.stdout:8/705: write d0/d14/d3e/f35 [1677435,40485] 0 2024-09-06T14:44:33.797 INFO:tasks.workunit.client.1.smithi165.stdout:7/582: chown d20/d3b/d69/d88/d80/d81 161806 1 2024-09-06T14:44:33.797 INFO:tasks.workunit.client.1.smithi165.stdout:6/708: rmdir d29/d6a/d71 39 2024-09-06T14:44:33.800 INFO:tasks.workunit.client.1.smithi165.stdout:2/623: unlink d9/d25/c8f 0 2024-09-06T14:44:33.801 INFO:tasks.workunit.client.1.smithi165.stdout:9/810: dwrite db/de/d15/d17/dad/fbb [0,4194304] 0 2024-09-06T14:44:33.802 INFO:tasks.workunit.client.1.smithi165.stdout:2/624: stat d9/d3b 0 2024-09-06T14:44:33.805 INFO:tasks.workunit.client.1.smithi165.stdout:4/722: link d5/d1b/d1c/fa0 d5/d1b/d1c/d41/ff3 0 2024-09-06T14:44:33.806 INFO:tasks.workunit.client.1.smithi165.stdout:9/811: fdatasync db/de/d15/d17/d18/f54 0 2024-09-06T14:44:33.806 INFO:tasks.workunit.client.1.smithi165.stdout:8/706: mknod d0/d34/d6b/d94/d70/de9/cf8 0 2024-09-06T14:44:33.810 INFO:tasks.workunit.client.1.smithi165.stdout:6/709: link d29/d39/d86/ca9 d29/d39/d5b/cd6 0 2024-09-06T14:44:33.812 INFO:tasks.workunit.client.1.smithi165.stdout:7/583: dwrite d20/f6f [0,4194304] 0 2024-09-06T14:44:33.812 INFO:tasks.workunit.client.1.smithi165.stdout:4/723: creat d5/d1b/d61/d77/dd5/ff4 x:0 0 0 2024-09-06T14:44:33.813 INFO:tasks.workunit.client.1.smithi165.stdout:7/584: readlink d20/d3b/d69/l8f 0 2024-09-06T14:44:33.815 INFO:tasks.workunit.client.1.smithi165.stdout:8/707: creat d0/d34/d6b/d94/d68/ff9 x:0 0 0 2024-09-06T14:44:33.817 INFO:tasks.workunit.client.1.smithi165.stdout:9/812: write db/de/d15/d17/d72/f76 [578015,70690] 0 2024-09-06T14:44:33.817 INFO:tasks.workunit.client.1.smithi165.stdout:6/710: fdatasync d29/d39/d5b/d62/d9f/fc0 0 2024-09-06T14:44:33.818 INFO:tasks.workunit.client.1.smithi165.stdout:4/724: mkdir d5/d1b/d61/d77/d7c/daa/df5 0 2024-09-06T14:44:33.818 INFO:tasks.workunit.client.1.smithi165.stdout:2/625: dread d9/d3b/d78/f79 [0,4194304] 0 2024-09-06T14:44:33.819 INFO:tasks.workunit.client.1.smithi165.stdout:6/711: stat f1c 0 2024-09-06T14:44:33.821 INFO:tasks.workunit.client.1.smithi165.stdout:0/644: write d15/d6e/f85 [938203,91632] 0 2024-09-06T14:44:33.822 INFO:tasks.workunit.client.1.smithi165.stdout:6/712: chown d29/d32/f61 245829492 1 2024-09-06T14:44:33.823 INFO:tasks.workunit.client.1.smithi165.stdout:8/708: write d0/d19/d36/fb [254008,103185] 0 2024-09-06T14:44:33.824 INFO:tasks.workunit.client.1.smithi165.stdout:7/585: link f15 d20/d3b/d69/d88/d30/fbc 0 2024-09-06T14:44:33.826 INFO:tasks.workunit.client.1.smithi165.stdout:5/762: dwrite d6/d1c/f3a [0,4194304] 0 2024-09-06T14:44:33.826 INFO:tasks.workunit.client.1.smithi165.stdout:0/645: dread d15/d19/d2c/f36 [0,4194304] 0 2024-09-06T14:44:33.832 INFO:tasks.workunit.client.1.smithi165.stdout:2/626: rename d9/d25/d46/f7c to d9/d25/d46/d7e/d90/fcb 0 2024-09-06T14:44:33.835 INFO:tasks.workunit.client.1.smithi165.stdout:4/725: creat d5/d1b/d61/d77/d7c/daa/df5/ff6 x:0 0 0 2024-09-06T14:44:33.836 INFO:tasks.workunit.client.1.smithi165.stdout:6/713: dwrite d29/f48 [0,4194304] 0 2024-09-06T14:44:33.839 INFO:tasks.workunit.client.1.smithi165.stdout:7/586: dwrite d20/d3b/d69/d88/f94 [0,4194304] 0 2024-09-06T14:44:33.842 INFO:tasks.workunit.client.1.smithi165.stdout:1/648: dread d0/d2a/f8e [4194304,4194304] 0 2024-09-06T14:44:33.842 INFO:tasks.workunit.client.1.smithi165.stdout:7/587: write d20/d3b/f74 [481143,108750] 0 2024-09-06T14:44:33.843 INFO:tasks.workunit.client.1.smithi165.stdout:0/646: mknod d15/d19/d50/d53/d7c/cd7 0 2024-09-06T14:44:33.847 INFO:tasks.workunit.client.1.smithi165.stdout:5/763: mknod d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/c112 0 2024-09-06T14:44:33.847 INFO:tasks.workunit.client.1.smithi165.stdout:6/714: truncate d29/d39/d5b/d62/d94/fa0 131567 0 2024-09-06T14:44:33.850 INFO:tasks.workunit.client.1.smithi165.stdout:0/647: creat d15/d19/d66/fd8 x:0 0 0 2024-09-06T14:44:33.851 INFO:tasks.workunit.client.1.smithi165.stdout:8/709: rename d0/d34/d6b/d94/f7c to d0/d19/d36/d2d/d33/d3a/d46/ffa 0 2024-09-06T14:44:33.852 INFO:tasks.workunit.client.1.smithi165.stdout:5/764: creat d6/d98/f113 x:0 0 0 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/1: sync 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/2: write - no filename 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/3: dwrite - no filename 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/4: rename - no filename 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/5: truncate - no filename 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/6: link - no file 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/7: dread - no filename 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/8: dread - no filename 2024-09-06T14:44:33.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/9: rmdir - no directory 2024-09-06T14:44:33.855 INFO:tasks.workunit.client.1.smithi165.stdout:0/648: rmdir d15/d6e 39 2024-09-06T14:44:33.856 INFO:tasks.workunit.client.1.smithi165.stdout:0/649: read - d15/d19/d28/d9e/fc9 zero size 2024-09-06T14:44:33.858 INFO:tasks.workunit.client.1.smithi165.stdout:6/715: rename f5 to d29/d6a/d83/d89/fd7 0 2024-09-06T14:44:33.859 INFO:tasks.workunit.client.1.smithi165.stdout:8/710: mknod d0/d19/d24/cfb 0 2024-09-06T14:44:33.861 INFO:tasks.workunit.client.1.smithi165.stdout:5/765: symlink d6/d1c/d28/d2d/d61/dde/l114 0 2024-09-06T14:44:33.862 INFO:tasks.workunit.client.1.smithi165.stdout:5/766: chown d6/d1c/d28/d2d/d3c/d44/d90/ddf/lad 15 1 2024-09-06T14:44:33.863 INFO:tasks.workunit.client.0.smithi052.stdout:4/10: mknod c0 0 2024-09-06T14:44:33.863 INFO:tasks.workunit.client.0.smithi052.stdout:4/11: rmdir - no directory 2024-09-06T14:44:33.864 INFO:tasks.workunit.client.1.smithi165.stdout:4/726: dread d5/f8 [0,4194304] 0 2024-09-06T14:44:33.866 INFO:tasks.workunit.client.1.smithi165.stdout:5/767: dread d6/d1c/d28/d4b/d55/d8a/ffc [0,4194304] 0 2024-09-06T14:44:33.866 INFO:tasks.workunit.client.1.smithi165.stdout:4/727: write d5/d1b/d61/dd7/ddf/dd4/fe6 [658701,84803] 0 2024-09-06T14:44:33.866 INFO:tasks.workunit.client.1.smithi165.stdout:2/627: write d9/d23/d29/d48/f62 [677791,51304] 0 2024-09-06T14:44:33.868 INFO:tasks.workunit.client.1.smithi165.stdout:7/588: getdents d20/d4d 0 2024-09-06T14:44:33.871 INFO:tasks.workunit.client.1.smithi165.stdout:8/711: unlink d0/d19/f7b 0 2024-09-06T14:44:33.871 INFO:tasks.workunit.client.1.smithi165.stdout:2/628: dread d9/f1b [0,4194304] 0 2024-09-06T14:44:33.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:33 smithi052 ceph-mon[28627]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 191 MiB/s wr, 472 op/s 2024-09-06T14:44:33.876 INFO:tasks.workunit.client.0.smithi052.stdout:4/12: link c0 c1 0 2024-09-06T14:44:33.878 INFO:tasks.workunit.client.1.smithi165.stdout:1/649: truncate d0/d2a/d23/d56/f71 342465 0 2024-09-06T14:44:33.880 INFO:tasks.workunit.client.1.smithi165.stdout:5/768: read d6/d1c/d64/f6e [6231334,26723] 0 2024-09-06T14:44:33.881 INFO:tasks.workunit.client.1.smithi165.stdout:5/769: truncate d6/d98/fa6 105329 0 2024-09-06T14:44:33.882 INFO:tasks.workunit.client.1.smithi165.stdout:4/728: symlink d5/d1b/d61/d77/d93/lf7 0 2024-09-06T14:44:33.883 INFO:tasks.workunit.client.0.smithi052.stdout:4/13: chown c1 367 1 2024-09-06T14:44:33.886 INFO:tasks.workunit.client.0.smithi052.stdout:4/14: creat f2 x:0 0 0 2024-09-06T14:44:33.887 INFO:tasks.workunit.client.1.smithi165.stdout:2/629: mknod d9/d3b/ccc 0 2024-09-06T14:44:33.888 INFO:tasks.workunit.client.0.smithi052.stdout:4/15: creat f3 x:0 0 0 2024-09-06T14:44:33.888 INFO:tasks.workunit.client.0.smithi052.stdout:4/16: dread - f3 zero size 2024-09-06T14:44:33.889 INFO:tasks.workunit.client.1.smithi165.stdout:2/630: write d9/d23/d71/fb0 [138081,119197] 0 2024-09-06T14:44:33.890 INFO:tasks.workunit.client.1.smithi165.stdout:6/716: creat d29/d39/fd8 x:0 0 0 2024-09-06T14:44:33.891 INFO:tasks.workunit.client.1.smithi165.stdout:1/650: dread d0/d1c/d40/f4d [0,4194304] 0 2024-09-06T14:44:33.893 INFO:tasks.workunit.client.1.smithi165.stdout:5/770: unlink d6/d1c/d28/d4b/d55/d8a/ffc 0 2024-09-06T14:44:33.894 INFO:tasks.workunit.client.1.smithi165.stdout:0/650: dwrite d15/d19/f46 [0,4194304] 0 2024-09-06T14:44:33.894 INFO:tasks.workunit.client.0.smithi052.stdout:4/17: rename c0 to c4 0 2024-09-06T14:44:33.896 INFO:tasks.workunit.client.1.smithi165.stdout:1/651: dread - d0/d2a/d18/d24/d4b/d93/d68/dae/fc4 zero size 2024-09-06T14:44:33.897 INFO:tasks.workunit.client.0.smithi052.stdout:4/18: creat f5 x:0 0 0 2024-09-06T14:44:33.898 INFO:tasks.workunit.client.1.smithi165.stdout:1/652: write d0/d1c/d1d/fb2 [530791,66375] 0 2024-09-06T14:44:33.898 INFO:tasks.workunit.client.1.smithi165.stdout:6/717: dread d29/d6a/d83/fc4 [0,4194304] 0 2024-09-06T14:44:33.899 INFO:tasks.workunit.client.0.smithi052.stdout:4/19: write f5 [160937,129231] 0 2024-09-06T14:44:33.901 INFO:tasks.workunit.client.1.smithi165.stdout:1/653: stat d0/d2a/d18/d24/d4b/d93/d2b/d3e/l52 0 2024-09-06T14:44:33.903 INFO:tasks.workunit.client.1.smithi165.stdout:0/651: dwrite ff [0,4194304] 0 2024-09-06T14:44:33.903 INFO:tasks.workunit.client.0.smithi052.stdout:4/20: creat f6 x:0 0 0 2024-09-06T14:44:33.904 INFO:tasks.workunit.client.0.smithi052.stdout:4/21: chown f3 1 1 2024-09-06T14:44:33.904 INFO:tasks.workunit.client.0.smithi052.stdout:4/22: rmdir - no directory 2024-09-06T14:44:33.906 INFO:tasks.workunit.client.1.smithi165.stdout:5/771: creat d6/d1c/d28/d2d/dc0/f115 x:0 0 0 2024-09-06T14:44:33.908 INFO:tasks.workunit.client.0.smithi052.stdout:4/23: creat f7 x:0 0 0 2024-09-06T14:44:33.909 INFO:tasks.workunit.client.1.smithi165.stdout:5/772: truncate d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/ff0 4654638 0 2024-09-06T14:44:33.912 INFO:tasks.workunit.client.1.smithi165.stdout:1/654: write d0/d2a/f9d [518540,20548] 0 2024-09-06T14:44:33.912 INFO:tasks.workunit.client.1.smithi165.stdout:0/652: write f3 [45761,64366] 0 2024-09-06T14:44:33.913 INFO:tasks.workunit.client.1.smithi165.stdout:4/729: link d5/d1b/d1c/d20/d75/d83/fe5 d5/d1b/d1c/d20/d75/ff8 0 2024-09-06T14:44:33.915 INFO:tasks.workunit.client.1.smithi165.stdout:1/655: dread - d0/d2a/d18/d24/d4b/d93/d6a/fac zero size 2024-09-06T14:44:33.915 INFO:tasks.workunit.client.0.smithi052.stdout:4/24: dwrite f5 [0,4194304] 0 2024-09-06T14:44:33.916 INFO:tasks.workunit.client.1.smithi165.stdout:5/773: mkdir d6/d1c/d28/d4b/d10b/d116 0 2024-09-06T14:44:33.917 INFO:tasks.workunit.client.1.smithi165.stdout:6/718: dwrite d29/d6a/d83/d89/fd7 [4194304,4194304] 0 2024-09-06T14:44:33.920 INFO:tasks.workunit.client.1.smithi165.stdout:5/774: chown d6/d1c/f9c 211000 1 2024-09-06T14:44:33.920 INFO:tasks.workunit.client.1.smithi165.stdout:2/631: getdents d9/d23/d29/d48/d8c/dbf 0 2024-09-06T14:44:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4/25: dwrite f3 [0,4194304] 0 2024-09-06T14:44:33.925 INFO:tasks.workunit.client.1.smithi165.stdout:4/730: mknod d5/d1b/d61/dd7/ddf/ddc/cf9 0 2024-09-06T14:44:33.929 INFO:tasks.workunit.client.1.smithi165.stdout:5/775: write d6/d1c/f68 [4195076,76923] 0 2024-09-06T14:44:33.930 INFO:tasks.workunit.client.1.smithi165.stdout:2/632: mknod d9/d25/d45/ccd 0 2024-09-06T14:44:33.930 INFO:tasks.workunit.client.1.smithi165.stdout:5/776: readlink d6/d1c/d28/d2d/d3c/l5d 0 2024-09-06T14:44:33.931 INFO:tasks.workunit.client.1.smithi165.stdout:5/777: readlink d6/d1c/d28/l9d 0 2024-09-06T14:44:33.933 INFO:tasks.workunit.client.1.smithi165.stdout:6/719: creat d29/d39/d5b/d62/d94/db7/dcc/fd9 x:0 0 0 2024-09-06T14:44:33.934 INFO:tasks.workunit.client.1.smithi165.stdout:4/731: symlink d5/d1b/d61/dd7/lfa 0 2024-09-06T14:44:33.935 INFO:tasks.workunit.client.0.smithi052.stdout:4/26: dwrite f2 [0,4194304] 0 2024-09-06T14:44:33.936 INFO:tasks.workunit.client.1.smithi165.stdout:4/732: write d5/d1b/d61/dd7/ddf/f4b [8424917,111748] 0 2024-09-06T14:44:33.940 INFO:tasks.workunit.client.1.smithi165.stdout:5/778: unlink d6/d1c/d28/d2d/d3c/d44/f47 0 2024-09-06T14:44:33.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/27: rename f5 to f8 0 2024-09-06T14:44:33.945 INFO:tasks.workunit.client.1.smithi165.stdout:0/653: truncate f8 7823280 0 2024-09-06T14:44:33.946 INFO:tasks.workunit.client.0.smithi052.stdout:4/28: mkdir d9 0 2024-09-06T14:44:33.946 INFO:tasks.workunit.client.1.smithi165.stdout:0/654: fsync d15/d19/d28/d3a/d3f/f6f 0 2024-09-06T14:44:33.947 INFO:tasks.workunit.client.0.smithi052.stdout:4/29: truncate f7 63007 0 2024-09-06T14:44:33.947 INFO:tasks.workunit.client.0.smithi052.stdout:4/30: readlink - no filename 2024-09-06T14:44:33.947 INFO:tasks.workunit.client.0.smithi052.stdout:4/31: dread - f6 zero size 2024-09-06T14:44:33.947 INFO:tasks.workunit.client.1.smithi165.stdout:0/655: readlink d15/d19/d50/d53/d7c/d9a/lcd 0 2024-09-06T14:44:33.948 INFO:tasks.workunit.client.1.smithi165.stdout:2/633: mkdir d9/d23/d29/d48/dce 0 2024-09-06T14:44:33.948 INFO:tasks.workunit.client.1.smithi165.stdout:0/656: fdatasync d15/d19/d28/d4f/f9b 0 2024-09-06T14:44:33.949 INFO:tasks.workunit.client.1.smithi165.stdout:2/634: chown d9/d25/d45/d75/d67/d76/l7d 7 1 2024-09-06T14:44:33.952 INFO:tasks.workunit.client.0.smithi052.stdout:4/32: mknod d9/ca 0 2024-09-06T14:44:33.953 INFO:tasks.workunit.client.1.smithi165.stdout:6/720: symlink d29/d39/d5b/d62/lda 0 2024-09-06T14:44:33.954 INFO:tasks.workunit.client.1.smithi165.stdout:6/721: write d29/d93/d87/db9/fcd [599419,51876] 0 2024-09-06T14:44:33.955 INFO:tasks.workunit.client.0.smithi052.stdout:4/33: mknod d9/cb 0 2024-09-06T14:44:33.956 INFO:tasks.workunit.client.1.smithi165.stdout:1/656: dread d0/d2a/d23/d56/f8d [0,4194304] 0 2024-09-06T14:44:33.956 INFO:tasks.workunit.client.0.smithi052.stdout:4/34: write f6 [663711,77442] 0 2024-09-06T14:44:33.957 INFO:tasks.workunit.client.0.smithi052.stdout:4/35: stat f6 0 2024-09-06T14:44:33.957 INFO:tasks.workunit.client.1.smithi165.stdout:1/657: stat d0/d2a/d18/d24/d4b/d5f/f63 0 2024-09-06T14:44:33.957 INFO:tasks.workunit.client.1.smithi165.stdout:1/658: fsync d0/d1c/d40/f7a 0 2024-09-06T14:44:33.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/733: link d5/f2b d5/d1b/d1c/d41/ffb 0 2024-09-06T14:44:33.961 INFO:tasks.workunit.client.1.smithi165.stdout:2/635: fdatasync d9/d25/d45/d75/d34/f6c 0 2024-09-06T14:44:33.962 INFO:tasks.workunit.client.1.smithi165.stdout:4/734: read d5/f58 [1892578,95251] 0 2024-09-06T14:44:33.963 INFO:tasks.workunit.client.1.smithi165.stdout:6/722: mkdir d29/d6a/d83/d89/ddb 0 2024-09-06T14:44:33.963 INFO:tasks.workunit.client.1.smithi165.stdout:6/723: fsync d29/d39/f54 0 2024-09-06T14:44:33.965 INFO:tasks.workunit.client.1.smithi165.stdout:6/724: dread d29/d6a/d83/f8c [0,4194304] 0 2024-09-06T14:44:33.965 INFO:tasks.workunit.client.1.smithi165.stdout:6/725: stat d29/d32/d7a 0 2024-09-06T14:44:33.965 INFO:tasks.workunit.client.1.smithi165.stdout:6/726: stat d29/d39/lcf 0 2024-09-06T14:44:33.968 INFO:tasks.workunit.client.1.smithi165.stdout:2/636: creat d9/d25/d46/d7e/d90/fcf x:0 0 0 2024-09-06T14:44:33.970 INFO:tasks.workunit.client.1.smithi165.stdout:4/735: fdatasync d5/d1b/d1c/f39 0 2024-09-06T14:44:33.970 INFO:tasks.workunit.client.1.smithi165.stdout:2/637: fsync d9/d23/d29/d48/f62 0 2024-09-06T14:44:33.970 INFO:tasks.workunit.client.1.smithi165.stdout:1/659: dread d0/d2a/d18/d24/d4b/d93/d2b/f50 [0,4194304] 0 2024-09-06T14:44:33.971 INFO:tasks.workunit.client.1.smithi165.stdout:1/660: write d0/d1c/d1d/fb2 [1302118,93403] 0 2024-09-06T14:44:33.974 INFO:tasks.workunit.client.1.smithi165.stdout:0/657: creat d15/d19/d50/fd9 x:0 0 0 2024-09-06T14:44:33.975 INFO:tasks.workunit.client.1.smithi165.stdout:5/779: dread d6/f18 [0,4194304] 0 2024-09-06T14:44:33.975 INFO:tasks.workunit.client.1.smithi165.stdout:6/727: rmdir d29/d39/d5b/d62/d94/db7 39 2024-09-06T14:44:33.979 INFO:tasks.workunit.client.0.smithi052.stdout:4/36: truncate f8 403039 0 2024-09-06T14:44:33.980 INFO:tasks.workunit.client.1.smithi165.stdout:1/661: write d0/d1c/d40/f4d [3107220,8059] 0 2024-09-06T14:44:33.980 INFO:tasks.workunit.client.1.smithi165.stdout:3/719: sync 2024-09-06T14:44:33.980 INFO:tasks.workunit.client.1.smithi165.stdout:9/813: sync 2024-09-06T14:44:33.981 INFO:tasks.workunit.client.1.smithi165.stdout:0/658: dwrite d15/d19/d66/fd8 [0,4194304] 0 2024-09-06T14:44:33.982 INFO:tasks.workunit.client.1.smithi165.stdout:0/659: dread - d15/d19/d50/fd9 zero size 2024-09-06T14:44:33.983 INFO:tasks.workunit.client.1.smithi165.stdout:5/780: creat d6/d1c/d28/d2d/d3c/d81/f117 x:0 0 0 2024-09-06T14:44:33.985 INFO:tasks.workunit.client.1.smithi165.stdout:2/638: dread d9/f1a [0,4194304] 0 2024-09-06T14:44:33.986 INFO:tasks.workunit.client.0.smithi052.stdout:4/37: dwrite f3 [0,4194304] 0 2024-09-06T14:44:33.990 INFO:tasks.workunit.client.1.smithi165.stdout:1/662: chown d0/d2a/c8 3 1 2024-09-06T14:44:33.992 INFO:tasks.workunit.client.0.smithi052.stdout:4/38: rename f3 to d9/fc 0 2024-09-06T14:44:33.993 INFO:tasks.workunit.client.0.smithi052.stdout:4/39: dread f7 [0,4194304] 0 2024-09-06T14:44:33.994 INFO:tasks.workunit.client.1.smithi165.stdout:5/781: dwrite d6/d1c/d28/d4b/d55/fbe [0,4194304] 0 2024-09-06T14:44:33.995 INFO:tasks.workunit.client.0.smithi052.stdout:4/40: truncate f7 208962 0 2024-09-06T14:44:34.000 INFO:tasks.workunit.client.1.smithi165.stdout:2/639: dwrite d9/d25/d45/d75/d67/d76/fa2 [0,4194304] 0 2024-09-06T14:44:34.004 INFO:tasks.workunit.client.1.smithi165.stdout:4/736: truncate d5/d1b/d61/dd7/fe3 3567940 0 2024-09-06T14:44:34.006 INFO:tasks.workunit.client.1.smithi165.stdout:6/728: dwrite d29/d6a/d83/fc4 [0,4194304] 0 2024-09-06T14:44:34.009 INFO:tasks.workunit.client.1.smithi165.stdout:1/663: mkdir d0/d2a/d18/d24/d4b/d93/dbd/dd1 0 2024-09-06T14:44:34.011 INFO:tasks.workunit.client.1.smithi165.stdout:3/720: mkdir d1/da/dc/d3b/dc6/df0 0 2024-09-06T14:44:34.011 INFO:tasks.workunit.client.1.smithi165.stdout:0/660: creat d15/d19/d50/d53/d8d/fda x:0 0 0 2024-09-06T14:44:34.013 INFO:tasks.workunit.client.1.smithi165.stdout:2/640: mknod d9/d23/d29/d48/d8c/dbf/cd0 0 2024-09-06T14:44:34.014 INFO:tasks.workunit.client.1.smithi165.stdout:4/737: mkdir d5/d1b/d66/dfc 0 2024-09-06T14:44:34.015 INFO:tasks.workunit.client.1.smithi165.stdout:2/641: chown d9/d25/f33 2851 1 2024-09-06T14:44:34.017 INFO:tasks.workunit.client.1.smithi165.stdout:9/814: dwrite db/f57 [0,4194304] 0 2024-09-06T14:44:34.017 INFO:tasks.workunit.client.1.smithi165.stdout:4/738: stat d5/d1b/d61/d77/d7c/fd2 0 2024-09-06T14:44:34.021 INFO:tasks.workunit.client.1.smithi165.stdout:5/782: symlink d6/d1c/d28/d4b/d55/d8a/l118 0 2024-09-06T14:44:34.022 INFO:tasks.workunit.client.1.smithi165.stdout:3/721: mkdir d1/d19/d92/df1 0 2024-09-06T14:44:34.027 INFO:tasks.workunit.client.1.smithi165.stdout:9/815: creat db/de/d16/d2e/ffe x:0 0 0 2024-09-06T14:44:34.029 INFO:tasks.workunit.client.1.smithi165.stdout:3/722: creat d1/da/dc/d10/ff2 x:0 0 0 2024-09-06T14:44:34.030 INFO:tasks.workunit.client.0.smithi052.stdout:4/41: truncate f8 1270584 0 2024-09-06T14:44:34.032 INFO:tasks.workunit.client.0.smithi052.stdout:4/42: rmdir d9 39 2024-09-06T14:44:34.034 INFO:tasks.workunit.client.1.smithi165.stdout:5/783: symlink d6/d1c/d28/d2d/d3c/d81/l119 0 2024-09-06T14:44:34.035 INFO:tasks.workunit.client.1.smithi165.stdout:0/661: creat d15/d19/d50/d53/d7c/fdb x:0 0 0 2024-09-06T14:44:34.036 INFO:tasks.workunit.client.1.smithi165.stdout:1/664: getdents d0/d2a/d18/da0 0 2024-09-06T14:44:34.037 INFO:tasks.workunit.client.1.smithi165.stdout:8/712: sync 2024-09-06T14:44:34.037 INFO:tasks.workunit.client.1.smithi165.stdout:7/589: sync 2024-09-06T14:44:34.038 INFO:tasks.workunit.client.1.smithi165.stdout:6/729: dread d29/d39/d5b/d62/d94/db7/dba/fc9 [0,4194304] 0 2024-09-06T14:44:34.040 INFO:tasks.workunit.client.1.smithi165.stdout:4/739: dread d5/d1b/d61/f9d [0,4194304] 0 2024-09-06T14:44:34.040 INFO:tasks.workunit.client.1.smithi165.stdout:0/662: symlink d15/d19/d50/d53/dbf/ldc 0 2024-09-06T14:44:34.042 INFO:tasks.workunit.client.1.smithi165.stdout:5/784: write d6/d1c/d28/fb8 [19211,127512] 0 2024-09-06T14:44:34.042 INFO:tasks.workunit.client.1.smithi165.stdout:2/642: dread d9/d25/d45/d75/d67/d76/f47 [0,4194304] 0 2024-09-06T14:44:34.042 INFO:tasks.workunit.client.0.smithi052.stdout:4/43: dwrite d9/fc [0,4194304] 0 2024-09-06T14:44:34.043 INFO:tasks.workunit.client.0.smithi052.stdout:4/44: readlink - no filename 2024-09-06T14:44:34.043 INFO:tasks.workunit.client.0.smithi052.stdout:4/45: read d9/fc [901356,74769] 0 2024-09-06T14:44:34.044 INFO:tasks.workunit.client.1.smithi165.stdout:8/713: rmdir d0/d19/d36/d2d/d33/d3a 39 2024-09-06T14:44:34.045 INFO:tasks.workunit.client.1.smithi165.stdout:2/643: stat d9/d4f/f5e 0 2024-09-06T14:44:34.047 INFO:tasks.workunit.client.0.smithi052.stdout:4/46: mknod d9/cd 0 2024-09-06T14:44:34.050 INFO:tasks.workunit.client.1.smithi165.stdout:6/730: creat d29/fdc x:0 0 0 2024-09-06T14:44:34.052 INFO:tasks.workunit.client.0.smithi052.stdout:4/47: rename d9/fc to d9/fe 0 2024-09-06T14:44:34.053 INFO:tasks.workunit.client.1.smithi165.stdout:9/816: dread db/de/d15/d17/d18/f5d [0,4194304] 0 2024-09-06T14:44:34.053 INFO:tasks.workunit.client.1.smithi165.stdout:1/665: dwrite d0/fba [0,4194304] 0 2024-09-06T14:44:34.053 INFO:tasks.workunit.client.1.smithi165.stdout:5/785: write d6/f16 [2753676,84121] 0 2024-09-06T14:44:34.055 INFO:tasks.workunit.client.0.smithi052.stdout:4/48: dread f7 [0,4194304] 0 2024-09-06T14:44:34.055 INFO:tasks.workunit.client.1.smithi165.stdout:8/714: mkdir d0/d34/d6b/dfc 0 2024-09-06T14:44:34.059 INFO:tasks.workunit.client.1.smithi165.stdout:2/644: mkdir d9/d25/d45/d75/d67/dd1 0 2024-09-06T14:44:34.059 INFO:tasks.workunit.client.1.smithi165.stdout:8/715: dread - d0/d14/d3e/db4/fdb zero size 2024-09-06T14:44:34.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/49: dread f8 [0,4194304] 0 2024-09-06T14:44:34.061 INFO:tasks.workunit.client.1.smithi165.stdout:3/723: dwrite d1/d19/d4d/fa5 [0,4194304] 0 2024-09-06T14:44:34.062 INFO:tasks.workunit.client.1.smithi165.stdout:6/731: mkdir d29/d6a/d83/d89/ddb/ddd 0 2024-09-06T14:44:34.063 INFO:tasks.workunit.client.1.smithi165.stdout:0/663: rename d15/d19/d28/d3a/f9f to d15/d19/d50/d53/d7c/fdd 0 2024-09-06T14:44:34.064 INFO:tasks.workunit.client.0.smithi052.stdout:4/50: mknod d9/cf 0 2024-09-06T14:44:34.066 INFO:tasks.workunit.client.1.smithi165.stdout:2/645: mknod d9/d88/cd2 0 2024-09-06T14:44:34.067 INFO:tasks.workunit.client.1.smithi165.stdout:1/666: dwrite d0/d45/f6e [0,4194304] 0 2024-09-06T14:44:34.070 INFO:tasks.workunit.client.0.smithi052.stdout:4/51: mkdir d9/d10 0 2024-09-06T14:44:34.071 INFO:tasks.workunit.client.0.smithi052.stdout:4/52: fsync f2 0 2024-09-06T14:44:34.071 INFO:tasks.workunit.client.0.smithi052.stdout:4/53: fsync f2 0 2024-09-06T14:44:34.072 INFO:tasks.workunit.client.1.smithi165.stdout:3/724: creat d1/da/dc/d3b/d71/ff3 x:0 0 0 2024-09-06T14:44:34.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:33 smithi165 ceph-mon[36229]: pgmap v19: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 191 MiB/s wr, 472 op/s 2024-09-06T14:44:34.074 INFO:tasks.workunit.client.1.smithi165.stdout:3/725: chown d1/d19/d92 908 1 2024-09-06T14:44:34.074 INFO:tasks.workunit.client.1.smithi165.stdout:4/740: rename d5/d1b/d61/d77/d7c/daa/df5 to d5/d1b/d1c/d41/d9e/dfd 0 2024-09-06T14:44:34.076 INFO:tasks.workunit.client.1.smithi165.stdout:1/667: dwrite d0/d1c/fa7 [0,4194304] 0 2024-09-06T14:44:34.076 INFO:tasks.workunit.client.1.smithi165.stdout:3/726: stat d1/d7c/ded 0 2024-09-06T14:44:34.082 INFO:tasks.workunit.client.1.smithi165.stdout:2/646: mkdir d9/d23/d29/d48/d8c/dbf/dd3 0 2024-09-06T14:44:34.086 INFO:tasks.workunit.client.1.smithi165.stdout:9/817: rename db/de/d15/d17/d86/f8c to db/de/d15/d74/fff 0 2024-09-06T14:44:34.087 INFO:tasks.workunit.client.1.smithi165.stdout:1/668: dwrite d0/d1c/d40/f7a [0,4194304] 0 2024-09-06T14:44:34.089 INFO:tasks.workunit.client.1.smithi165.stdout:9/818: chown db/de/d15/d74/fd5 3779314 1 2024-09-06T14:44:34.090 INFO:tasks.workunit.client.1.smithi165.stdout:6/732: dread f22 [0,4194304] 0 2024-09-06T14:44:34.091 INFO:tasks.workunit.client.1.smithi165.stdout:0/664: dread d15/d19/d28/d9e/da3/fb1 [0,4194304] 0 2024-09-06T14:44:34.092 INFO:tasks.workunit.client.1.smithi165.stdout:2/647: creat d9/d88/fd4 x:0 0 0 2024-09-06T14:44:34.092 INFO:tasks.workunit.client.1.smithi165.stdout:5/786: dread d6/d1c/d28/f43 [0,4194304] 0 2024-09-06T14:44:34.093 INFO:tasks.workunit.client.1.smithi165.stdout:5/787: chown c5 0 1 2024-09-06T14:44:34.093 INFO:tasks.workunit.client.1.smithi165.stdout:0/665: chown d15/d19/d66/c68 16239401 1 2024-09-06T14:44:34.093 INFO:tasks.workunit.client.0.smithi052.stdout:4/54: write f7 [614676,122327] 0 2024-09-06T14:44:34.094 INFO:tasks.workunit.client.1.smithi165.stdout:1/669: mkdir d0/d2a/d18/d24/d4b/d93/d6a/dd2 0 2024-09-06T14:44:34.097 INFO:tasks.workunit.client.0.smithi052.stdout:4/55: mknod d9/c11 0 2024-09-06T14:44:34.097 INFO:tasks.workunit.client.1.smithi165.stdout:2/648: dread d9/d4f/f5e [0,4194304] 0 2024-09-06T14:44:34.099 INFO:tasks.workunit.client.1.smithi165.stdout:3/727: creat d1/da/dc/ff4 x:0 0 0 2024-09-06T14:44:34.101 INFO:tasks.workunit.client.1.smithi165.stdout:0/666: rename d15/d19/d28/d4f/da7/fb0 to d15/d19/d50/d53/d8d/fde 0 2024-09-06T14:44:34.101 INFO:tasks.workunit.client.1.smithi165.stdout:3/728: read - d1/da/dc/d3b/dc6/d89/fac zero size 2024-09-06T14:44:34.102 INFO:tasks.workunit.client.0.smithi052.stdout:4/56: creat d9/d10/f12 x:0 0 0 2024-09-06T14:44:34.102 INFO:tasks.workunit.client.1.smithi165.stdout:0/667: stat d15/f1f 0 2024-09-06T14:44:34.103 INFO:tasks.workunit.client.1.smithi165.stdout:1/670: creat d0/d2a/d18/d24/d4b/d93/d2b/d3e/fd3 x:0 0 0 2024-09-06T14:44:34.103 INFO:tasks.workunit.client.1.smithi165.stdout:0/668: chown d15/d19/d50/d53/dbf 3013 1 2024-09-06T14:44:34.104 INFO:tasks.workunit.client.0.smithi052.stdout:4/57: symlink d9/d10/l13 0 2024-09-06T14:44:34.104 INFO:tasks.workunit.client.1.smithi165.stdout:4/741: dwrite d5/d1b/d1c/d20/d75/d83/f87 [0,4194304] 0 2024-09-06T14:44:34.107 INFO:tasks.workunit.client.1.smithi165.stdout:3/729: mknod d1/da/d43/cf5 0 2024-09-06T14:44:34.108 INFO:tasks.workunit.client.1.smithi165.stdout:3/730: write d1/d19/d4d/f87 [38666,86651] 0 2024-09-06T14:44:34.109 INFO:tasks.workunit.client.1.smithi165.stdout:9/819: getdents db/de/d15/d7f/d9b/d6c/d96 0 2024-09-06T14:44:34.110 INFO:tasks.workunit.client.1.smithi165.stdout:1/671: mknod d0/d2a/d18/d24/d4b/d93/d68/d75/cd4 0 2024-09-06T14:44:34.113 INFO:tasks.workunit.client.1.smithi165.stdout:4/742: mknod d5/d1b/d61/d77/cfe 0 2024-09-06T14:44:34.115 INFO:tasks.workunit.client.1.smithi165.stdout:6/733: getdents d29/d6a/d83/d89 0 2024-09-06T14:44:34.116 INFO:tasks.workunit.client.1.smithi165.stdout:5/788: getdents d6/d98 0 2024-09-06T14:44:34.117 INFO:tasks.workunit.client.1.smithi165.stdout:5/789: chown d6/d1c/d28/l71 44146313 1 2024-09-06T14:44:34.118 INFO:tasks.workunit.client.1.smithi165.stdout:5/790: chown d6/d1c/d28/d4b/fae 6 1 2024-09-06T14:44:34.118 INFO:tasks.workunit.client.0.smithi052.stdout:4/58: getdents d9/d10 0 2024-09-06T14:44:34.119 INFO:tasks.workunit.client.1.smithi165.stdout:9/820: readlink db/de/d15/d17/d18/d59/d64/l93 0 2024-09-06T14:44:34.121 INFO:tasks.workunit.client.1.smithi165.stdout:4/743: symlink d5/d1b/d66/lff 0 2024-09-06T14:44:34.122 INFO:tasks.workunit.client.1.smithi165.stdout:4/744: stat d5/d1b/d61/d77/cfe 0 2024-09-06T14:44:34.122 INFO:tasks.workunit.client.1.smithi165.stdout:6/734: unlink d29/d39/d5b/d62/d9f/caa 0 2024-09-06T14:44:34.123 INFO:tasks.workunit.client.1.smithi165.stdout:1/672: mkdir d0/d1c/dd5 0 2024-09-06T14:44:34.124 INFO:tasks.workunit.client.0.smithi052.stdout:4/59: link d9/cf d9/c14 0 2024-09-06T14:44:34.124 INFO:tasks.workunit.client.0.smithi052.stdout:4/60: fsync d9/fe 0 2024-09-06T14:44:34.125 INFO:tasks.workunit.client.1.smithi165.stdout:4/745: dread - d5/d1b/d1c/ff1 zero size 2024-09-06T14:44:34.126 INFO:tasks.workunit.client.0.smithi052.stdout:4/61: mknod d9/c15 0 2024-09-06T14:44:34.126 INFO:tasks.workunit.client.1.smithi165.stdout:3/731: dread d1/d4a/f55 [0,4194304] 0 2024-09-06T14:44:34.127 INFO:tasks.workunit.client.1.smithi165.stdout:1/673: chown d0/d2a/d18/d24/d4b/d5f 8 1 2024-09-06T14:44:34.128 INFO:tasks.workunit.client.1.smithi165.stdout:9/821: dwrite db/de/d16/d2e/ffe [0,4194304] 0 2024-09-06T14:44:34.129 INFO:tasks.workunit.client.1.smithi165.stdout:6/735: rename d29/dd1 to d29/d39/d5b/d62/d94/db7/dde 0 2024-09-06T14:44:34.129 INFO:tasks.workunit.client.1.smithi165.stdout:3/732: fdatasync d1/da/dd/d4b/f8b 0 2024-09-06T14:44:34.130 INFO:tasks.workunit.client.0.smithi052.stdout:4/62: rmdir d9/d10 39 2024-09-06T14:44:34.132 INFO:tasks.workunit.client.1.smithi165.stdout:6/736: dread - d29/d39/d5b/d62/d94/fbe zero size 2024-09-06T14:44:34.132 INFO:tasks.workunit.client.1.smithi165.stdout:5/791: dwrite d6/f24 [0,4194304] 0 2024-09-06T14:44:34.133 INFO:tasks.workunit.client.1.smithi165.stdout:4/746: creat d5/d1b/d61/dd7/ddf/ddc/f100 x:0 0 0 2024-09-06T14:44:34.135 INFO:tasks.workunit.client.0.smithi052.stdout:4/63: symlink d9/l16 0 2024-09-06T14:44:34.135 INFO:tasks.workunit.client.1.smithi165.stdout:5/792: write d6/f16 [1107980,90700] 0 2024-09-06T14:44:34.136 INFO:tasks.workunit.client.1.smithi165.stdout:9/822: unlink db/de/d15/d7f/dbc/ddf/c9f 0 2024-09-06T14:44:34.136 INFO:tasks.workunit.client.1.smithi165.stdout:5/793: fdatasync d6/d1c/d28/d2d/d61/ddc/fdd 0 2024-09-06T14:44:34.137 INFO:tasks.workunit.client.1.smithi165.stdout:6/737: readlink l24 0 2024-09-06T14:44:34.140 INFO:tasks.workunit.client.0.smithi052.stdout:4/64: mkdir d9/d10/d17 0 2024-09-06T14:44:34.141 INFO:tasks.workunit.client.1.smithi165.stdout:3/733: symlink d1/da/dc/d3b/dc6/df0/lf6 0 2024-09-06T14:44:34.141 INFO:tasks.workunit.client.1.smithi165.stdout:3/734: read d1/f69 [397472,55718] 0 2024-09-06T14:44:34.143 INFO:tasks.workunit.client.1.smithi165.stdout:5/794: mknod d6/d98/c11a 0 2024-09-06T14:44:34.145 INFO:tasks.workunit.client.0.smithi052.stdout:4/65: mknod d9/d10/d17/c18 0 2024-09-06T14:44:34.146 INFO:tasks.workunit.client.1.smithi165.stdout:6/738: mknod d29/d39/d5b/d62/d94/db7/dde/cdf 0 2024-09-06T14:44:34.146 INFO:tasks.workunit.client.1.smithi165.stdout:4/747: mkdir d5/d1b/d61/d77/d7c/dcd/dc9/d101 0 2024-09-06T14:44:34.147 INFO:tasks.workunit.client.0.smithi052.stdout:4/66: mkdir d9/d10/d19 0 2024-09-06T14:44:34.148 INFO:tasks.workunit.client.1.smithi165.stdout:9/823: mkdir db/de/d100 0 2024-09-06T14:44:34.149 INFO:tasks.workunit.client.1.smithi165.stdout:9/824: chown db/de/d15/d74 486370 1 2024-09-06T14:44:34.150 INFO:tasks.workunit.client.1.smithi165.stdout:5/795: dwrite d6/d32/f33 [0,4194304] 0 2024-09-06T14:44:34.150 INFO:tasks.workunit.client.1.smithi165.stdout:3/735: symlink d1/da/dc/lf7 0 2024-09-06T14:44:34.151 INFO:tasks.workunit.client.1.smithi165.stdout:4/748: truncate d5/d1b/d61/dd7/ddf/f96 769223 0 2024-09-06T14:44:34.152 INFO:tasks.workunit.client.1.smithi165.stdout:5/796: write d6/d98/f101 [3404614,127887] 0 2024-09-06T14:44:34.152 INFO:tasks.workunit.client.1.smithi165.stdout:6/739: rename d29/d93/l7b to d29/d6a/d83/d89/ddb/le0 0 2024-09-06T14:44:34.153 INFO:tasks.workunit.client.0.smithi052.stdout:4/67: creat d9/d10/d19/f1a x:0 0 0 2024-09-06T14:44:34.155 INFO:tasks.workunit.client.1.smithi165.stdout:5/797: truncate d6/d1c/d28/d2d/d49/f10d 669411 0 2024-09-06T14:44:34.156 INFO:tasks.workunit.client.1.smithi165.stdout:5/798: write d6/d1c/d28/d4b/da7/dab/f102 [536922,43209] 0 2024-09-06T14:44:34.159 INFO:tasks.workunit.client.1.smithi165.stdout:3/736: mkdir d1/d19/df8 0 2024-09-06T14:44:34.159 INFO:tasks.workunit.client.0.smithi052.stdout:4/68: mknod d9/d10/c1b 0 2024-09-06T14:44:34.160 INFO:tasks.workunit.client.1.smithi165.stdout:6/740: dwrite d29/d39/d5b/f78 [0,4194304] 0 2024-09-06T14:44:34.162 INFO:tasks.workunit.client.1.smithi165.stdout:9/825: mkdir db/de/d15/d7f/d9b/d6c/d96/d101 0 2024-09-06T14:44:34.162 INFO:tasks.workunit.client.1.smithi165.stdout:4/749: fdatasync d5/d1b/d61/dd7/ddf/dd4/fda 0 2024-09-06T14:44:34.163 INFO:tasks.workunit.client.0.smithi052.stdout:4/69: creat d9/d10/d17/f1c x:0 0 0 2024-09-06T14:44:34.164 INFO:tasks.workunit.client.1.smithi165.stdout:1/674: truncate d0/d2a/fd 922525 0 2024-09-06T14:44:34.165 INFO:tasks.workunit.client.1.smithi165.stdout:4/750: readlink d5/d1b/d1c/d78/l81 0 2024-09-06T14:44:34.166 INFO:tasks.workunit.client.1.smithi165.stdout:5/799: creat d6/d1c/d28/d2d/d3c/f11b x:0 0 0 2024-09-06T14:44:34.166 INFO:tasks.workunit.client.0.smithi052.stdout:4/70: chown c4 13 1 2024-09-06T14:44:34.170 INFO:tasks.workunit.client.1.smithi165.stdout:6/741: chown d29/d39/d5b/d62/d67/c9a 3 1 2024-09-06T14:44:34.173 INFO:tasks.workunit.client.1.smithi165.stdout:4/751: dwrite d5/d1b/d61/fef [0,4194304] 0 2024-09-06T14:44:34.173 INFO:tasks.workunit.client.0.smithi052.stdout:4/71: dwrite f6 [0,4194304] 0 2024-09-06T14:44:34.174 INFO:tasks.workunit.client.0.smithi052.stdout:6/8: sync 2024-09-06T14:44:34.174 INFO:tasks.workunit.client.0.smithi052.stdout:4/72: fsync f7 0 2024-09-06T14:44:34.174 INFO:tasks.workunit.client.0.smithi052.stdout:5/12: sync 2024-09-06T14:44:34.181 INFO:tasks.workunit.client.0.smithi052.stdout:6/9: mkdir d2 0 2024-09-06T14:44:34.182 INFO:tasks.workunit.client.1.smithi165.stdout:7/590: sync 2024-09-06T14:44:34.184 INFO:tasks.workunit.client.1.smithi165.stdout:7/591: dread - d20/d3b/d69/f85 zero size 2024-09-06T14:44:34.184 INFO:tasks.workunit.client.0.smithi052.stdout:6/10: write f0 [1887496,115157] 0 2024-09-06T14:44:34.184 INFO:tasks.workunit.client.0.smithi052.stdout:5/13: rmdir d2 39 2024-09-06T14:44:34.185 INFO:tasks.workunit.client.0.smithi052.stdout:4/73: dwrite d9/d10/d19/f1a [0,4194304] 0 2024-09-06T14:44:34.186 INFO:tasks.workunit.client.1.smithi165.stdout:5/800: mknod d6/d1c/d28/d88/d105/c11c 0 2024-09-06T14:44:34.187 INFO:tasks.workunit.client.0.smithi052.stdout:4/74: write d9/d10/d17/f1c [598878,2943] 0 2024-09-06T14:44:34.189 INFO:tasks.workunit.client.0.smithi052.stdout:4/75: write d9/fe [2327461,123096] 0 2024-09-06T14:44:34.189 INFO:tasks.workunit.client.1.smithi165.stdout:4/752: symlink d5/d1b/d1c/d41/d9e/l102 0 2024-09-06T14:44:34.190 INFO:tasks.workunit.client.1.smithi165.stdout:6/742: dwrite d29/d39/d5b/d62/d94/db7/dba/fc9 [0,4194304] 0 2024-09-06T14:44:34.190 INFO:tasks.workunit.client.0.smithi052.stdout:6/11: dread f0 [0,4194304] 0 2024-09-06T14:44:34.190 INFO:tasks.workunit.client.0.smithi052.stdout:6/12: chown f0 15180967 1 2024-09-06T14:44:34.194 INFO:tasks.workunit.client.1.smithi165.stdout:6/743: write d29/d39/d5b/f92 [394904,36030] 0 2024-09-06T14:44:34.198 INFO:tasks.workunit.client.0.smithi052.stdout:4/76: symlink d9/d10/d19/l1d 0 2024-09-06T14:44:34.198 INFO:tasks.workunit.client.1.smithi165.stdout:9/826: dread f4 [0,4194304] 0 2024-09-06T14:44:34.199 INFO:tasks.workunit.client.0.smithi052.stdout:4/77: read - d9/d10/f12 zero size 2024-09-06T14:44:34.200 INFO:tasks.workunit.client.1.smithi165.stdout:3/737: dwrite d1/da/dc/d3b/d83/fde [0,4194304] 0 2024-09-06T14:44:34.201 INFO:tasks.workunit.client.1.smithi165.stdout:9/827: read db/de/d16/d2e/ffe [1636165,96741] 0 2024-09-06T14:44:34.202 INFO:tasks.workunit.client.1.smithi165.stdout:7/592: read d20/d3b/d69/da3/fa9 [1418665,83923] 0 2024-09-06T14:44:34.203 INFO:tasks.workunit.client.1.smithi165.stdout:3/738: write d1/da/dc/d3b/fdd [128863,101645] 0 2024-09-06T14:44:34.203 INFO:tasks.workunit.client.0.smithi052.stdout:5/14: creat d2/f4 x:0 0 0 2024-09-06T14:44:34.204 INFO:tasks.workunit.client.1.smithi165.stdout:7/593: write d20/d3b/d69/d88/d30/f83 [1725055,18033] 0 2024-09-06T14:44:34.205 INFO:tasks.workunit.client.1.smithi165.stdout:1/675: truncate d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f6b 3395559 0 2024-09-06T14:44:34.209 INFO:tasks.workunit.client.0.smithi052.stdout:6/13: creat d2/f3 x:0 0 0 2024-09-06T14:44:34.210 INFO:tasks.workunit.client.1.smithi165.stdout:7/594: dread f17 [0,4194304] 0 2024-09-06T14:44:34.210 INFO:tasks.workunit.client.0.smithi052.stdout:6/14: dread - d2/f3 zero size 2024-09-06T14:44:34.211 INFO:tasks.workunit.client.1.smithi165.stdout:6/744: creat d29/d39/d5b/d62/d94/db7/fe1 x:0 0 0 2024-09-06T14:44:34.211 INFO:tasks.workunit.client.1.smithi165.stdout:7/595: dread d20/d40/f87 [0,4194304] 0 2024-09-06T14:44:34.212 INFO:tasks.workunit.client.1.smithi165.stdout:4/753: dread d5/d1b/d61/dd7/ddf/f38 [0,4194304] 0 2024-09-06T14:44:34.212 INFO:tasks.workunit.client.0.smithi052.stdout:4/78: creat d9/d10/d19/f1e x:0 0 0 2024-09-06T14:44:34.212 INFO:tasks.workunit.client.1.smithi165.stdout:9/828: read db/de/d15/d17/dad/f46 [1740889,112446] 0 2024-09-06T14:44:34.213 INFO:tasks.workunit.client.0.smithi052.stdout:4/79: chown d9/d10/d19/f1e 28 1 2024-09-06T14:44:34.214 INFO:tasks.workunit.client.0.smithi052.stdout:4/80: dread f8 [0,4194304] 0 2024-09-06T14:44:34.215 INFO:tasks.workunit.client.0.smithi052.stdout:5/15: rename d2/f4 to d2/f5 0 2024-09-06T14:44:34.218 INFO:tasks.workunit.client.0.smithi052.stdout:6/15: unlink d2/f3 0 2024-09-06T14:44:34.219 INFO:tasks.workunit.client.1.smithi165.stdout:5/801: truncate d6/d1c/d28/d4b/d55/fca 528997 0 2024-09-06T14:44:34.223 INFO:tasks.workunit.client.1.smithi165.stdout:1/676: dread d0/d2a/d18/f67 [0,4194304] 0 2024-09-06T14:44:34.224 INFO:tasks.workunit.client.1.smithi165.stdout:1/677: fsync d0/d1c/d41/f9f 0 2024-09-06T14:44:34.234 INFO:tasks.workunit.client.0.smithi052.stdout:4/81: link d9/d10/d19/f1a d9/d10/f1f 0 2024-09-06T14:44:34.235 INFO:tasks.workunit.client.0.smithi052.stdout:6/16: dwrite f0 [4194304,4194304] 0 2024-09-06T14:44:34.236 INFO:tasks.workunit.client.0.smithi052.stdout:4/82: dread - d9/d10/d19/f1e zero size 2024-09-06T14:44:34.236 INFO:tasks.workunit.client.0.smithi052.stdout:6/17: read f0 [7317159,38970] 0 2024-09-06T14:44:34.237 INFO:tasks.workunit.client.0.smithi052.stdout:6/18: readlink - no filename 2024-09-06T14:44:34.237 INFO:tasks.workunit.client.0.smithi052.stdout:5/16: rename d2/f5 to d2/f6 0 2024-09-06T14:44:34.239 INFO:tasks.workunit.client.1.smithi165.stdout:4/754: rename d5/d1b/d61/d77/c89 to d5/d1b/d1c/d41/c103 0 2024-09-06T14:44:34.239 INFO:tasks.workunit.client.0.smithi052.stdout:2/78: sync 2024-09-06T14:44:34.239 INFO:tasks.workunit.client.0.smithi052.stdout:7/79: sync 2024-09-06T14:44:34.239 INFO:tasks.workunit.client.0.smithi052.stdout:0/82: sync 2024-09-06T14:44:34.239 INFO:tasks.workunit.client.0.smithi052.stdout:9/29: sync 2024-09-06T14:44:34.240 INFO:tasks.workunit.client.0.smithi052.stdout:1/80: sync 2024-09-06T14:44:34.240 INFO:tasks.workunit.client.0.smithi052.stdout:8/74: sync 2024-09-06T14:44:34.240 INFO:tasks.workunit.client.0.smithi052.stdout:3/139: sync 2024-09-06T14:44:34.242 INFO:tasks.workunit.client.0.smithi052.stdout:7/80: write d11/d1c/f1d [1018618,120415] 0 2024-09-06T14:44:34.242 INFO:tasks.workunit.client.0.smithi052.stdout:2/79: dread f0 [4194304,4194304] 0 2024-09-06T14:44:34.243 INFO:tasks.workunit.client.0.smithi052.stdout:6/19: creat d2/f4 x:0 0 0 2024-09-06T14:44:34.243 INFO:tasks.workunit.client.0.smithi052.stdout:7/81: chown d11/d1c/f1d 2564244 1 2024-09-06T14:44:34.245 INFO:tasks.workunit.client.1.smithi165.stdout:3/739: mknod d1/da/dc/d3b/dc6/cf9 0 2024-09-06T14:44:34.246 INFO:tasks.workunit.client.1.smithi165.stdout:9/829: dwrite db/de/d16/d2e/f3d [0,4194304] 0 2024-09-06T14:44:34.248 INFO:tasks.workunit.client.1.smithi165.stdout:1/678: rmdir d0 39 2024-09-06T14:44:34.250 INFO:tasks.workunit.client.0.smithi052.stdout:3/140: write d0/fe [39594,57456] 0 2024-09-06T14:44:34.250 INFO:tasks.workunit.client.0.smithi052.stdout:8/75: mkdir d6/d16 0 2024-09-06T14:44:34.251 INFO:tasks.workunit.client.1.smithi165.stdout:6/745: creat d29/d6a/d71/fe2 x:0 0 0 2024-09-06T14:44:34.252 INFO:tasks.workunit.client.1.smithi165.stdout:6/746: truncate d29/d93/d87/db9/fd3 792872 0 2024-09-06T14:44:34.253 INFO:tasks.workunit.client.1.smithi165.stdout:6/747: fsync d29/d39/f64 0 2024-09-06T14:44:34.253 INFO:tasks.workunit.client.0.smithi052.stdout:9/30: dread d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:34.256 INFO:tasks.workunit.client.0.smithi052.stdout:6/20: mknod d2/c5 0 2024-09-06T14:44:34.259 INFO:tasks.workunit.client.0.smithi052.stdout:7/82: write d11/f12 [3189496,27668] 0 2024-09-06T14:44:34.265 INFO:tasks.workunit.client.0.smithi052.stdout:4/83: rename d9/d10/d19/f1a to d9/d10/d17/f20 0 2024-09-06T14:44:34.265 INFO:tasks.workunit.client.0.smithi052.stdout:7/83: read ff [732543,81765] 0 2024-09-06T14:44:34.265 INFO:tasks.workunit.client.0.smithi052.stdout:1/81: dread d1/da/fc [0,4194304] 0 2024-09-06T14:44:34.265 INFO:tasks.workunit.client.1.smithi165.stdout:5/802: symlink d6/d1c/l11d 0 2024-09-06T14:44:34.266 INFO:tasks.workunit.client.0.smithi052.stdout:3/141: dwrite d0/f1d [0,4194304] 0 2024-09-06T14:44:34.269 INFO:tasks.workunit.client.0.smithi052.stdout:4/84: truncate d9/d10/d17/f1c 692544 0 2024-09-06T14:44:34.270 INFO:tasks.workunit.client.1.smithi165.stdout:7/596: truncate d20/d3b/d69/d88/f94 9097461 0 2024-09-06T14:44:34.271 INFO:tasks.workunit.client.0.smithi052.stdout:3/142: readlink d0/d11/l20 0 2024-09-06T14:44:34.271 INFO:tasks.workunit.client.0.smithi052.stdout:5/17: dwrite f1 [0,4194304] 0 2024-09-06T14:44:34.271 INFO:tasks.workunit.client.1.smithi165.stdout:5/803: dwrite d6/d1c/d28/d4b/feb [0,4194304] 0 2024-09-06T14:44:34.272 INFO:tasks.workunit.client.1.smithi165.stdout:7/597: chown d20/d33/d53/fb9 313 1 2024-09-06T14:44:34.273 INFO:tasks.workunit.client.1.smithi165.stdout:7/598: write d20/d3b/d69/d88/fb1 [978418,113035] 0 2024-09-06T14:44:34.277 INFO:tasks.workunit.client.0.smithi052.stdout:8/76: mknod d6/d9/df/d10/c17 0 2024-09-06T14:44:34.278 INFO:tasks.workunit.client.0.smithi052.stdout:2/80: write da/db/f12 [927111,5366] 0 2024-09-06T14:44:34.279 INFO:tasks.workunit.client.0.smithi052.stdout:8/77: chown d6 1 1 2024-09-06T14:44:34.279 INFO:tasks.workunit.client.0.smithi052.stdout:6/21: symlink d2/l6 0 2024-09-06T14:44:34.280 INFO:tasks.workunit.client.0.smithi052.stdout:8/78: read - d6/f11 zero size 2024-09-06T14:44:34.282 INFO:tasks.workunit.client.1.smithi165.stdout:3/740: creat d1/d7c/ded/ffa x:0 0 0 2024-09-06T14:44:34.283 INFO:tasks.workunit.client.0.smithi052.stdout:1/82: creat d1/db/f13 x:0 0 0 2024-09-06T14:44:34.284 INFO:tasks.workunit.client.1.smithi165.stdout:4/755: dwrite d5/d1b/d1c/fa0 [0,4194304] 0 2024-09-06T14:44:34.284 INFO:tasks.workunit.client.1.smithi165.stdout:5/804: dwrite d6/d1c/f38 [0,4194304] 0 2024-09-06T14:44:34.284 INFO:tasks.workunit.client.1.smithi165.stdout:9/830: symlink db/d40/d9a/l102 0 2024-09-06T14:44:34.285 INFO:tasks.workunit.client.1.smithi165.stdout:1/679: truncate d0/d2a/d18/d24/d4b/d93/d68/f86 4825002 0 2024-09-06T14:44:34.287 INFO:tasks.workunit.client.0.smithi052.stdout:0/83: rename d0/d2 to d0/d12 0 2024-09-06T14:44:34.287 INFO:tasks.workunit.client.1.smithi165.stdout:6/748: mknod d29/ce3 0 2024-09-06T14:44:34.287 INFO:tasks.workunit.client.1.smithi165.stdout:7/599: symlink d20/d3b/d69/d88/d80/d81/lbd 0 2024-09-06T14:44:34.288 INFO:tasks.workunit.client.1.smithi165.stdout:1/680: stat d0/d2a/d23/d56/c89 0 2024-09-06T14:44:34.289 INFO:tasks.workunit.client.0.smithi052.stdout:5/18: creat d2/f7 x:0 0 0 2024-09-06T14:44:34.289 INFO:tasks.workunit.client.1.smithi165.stdout:4/756: truncate d5/d1b/d1c/f34 3083002 0 2024-09-06T14:44:34.290 INFO:tasks.workunit.client.1.smithi165.stdout:9/831: write db/de/d15/d17/d72/da3/fd3 [21997,53568] 0 2024-09-06T14:44:34.290 INFO:tasks.workunit.client.0.smithi052.stdout:8/79: dwrite d6/f11 [0,4194304] 0 2024-09-06T14:44:34.291 INFO:tasks.workunit.client.1.smithi165.stdout:3/741: symlink d1/dbd/lfb 0 2024-09-06T14:44:34.298 INFO:tasks.workunit.client.1.smithi165.stdout:6/749: mknod d29/d39/d5b/d68/ce4 0 2024-09-06T14:44:34.298 INFO:tasks.workunit.client.1.smithi165.stdout:3/742: dwrite d1/d41/f97 [0,4194304] 0 2024-09-06T14:44:34.302 INFO:tasks.workunit.client.0.smithi052.stdout:9/31: mknod d1/d4/d6/cb 0 2024-09-06T14:44:34.306 INFO:tasks.workunit.client.1.smithi165.stdout:5/805: symlink d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/de8/l11e 0 2024-09-06T14:44:34.309 INFO:tasks.workunit.client.1.smithi165.stdout:6/750: dread d29/d6a/d83/d89/fd7 [0,4194304] 0 2024-09-06T14:44:34.311 INFO:tasks.workunit.client.0.smithi052.stdout:7/84: link ff d11/d1c/f1f 0 2024-09-06T14:44:34.312 INFO:tasks.workunit.client.0.smithi052.stdout:7/85: stat d11/c16 0 2024-09-06T14:44:34.314 INFO:tasks.workunit.client.0.smithi052.stdout:1/83: mkdir d1/da/d14 0 2024-09-06T14:44:34.314 INFO:tasks.workunit.client.0.smithi052.stdout:6/22: dwrite f0 [0,4194304] 0 2024-09-06T14:44:34.316 INFO:tasks.workunit.client.1.smithi165.stdout:2/649: sync 2024-09-06T14:44:34.316 INFO:tasks.workunit.client.1.smithi165.stdout:8/716: sync 2024-09-06T14:44:34.317 INFO:tasks.workunit.client.1.smithi165.stdout:0/669: sync 2024-09-06T14:44:34.317 INFO:tasks.workunit.client.1.smithi165.stdout:2/650: dread - d9/d88/fd4 zero size 2024-09-06T14:44:34.323 INFO:tasks.workunit.client.1.smithi165.stdout:1/681: link d0/d1c/d40/f7a d0/dc8/fd6 0 2024-09-06T14:44:34.325 INFO:tasks.workunit.client.0.smithi052.stdout:2/81: mknod da/db/d18/c1e 0 2024-09-06T14:44:34.326 INFO:tasks.workunit.client.1.smithi165.stdout:4/757: dread d5/d1b/d1c/f6b [0,4194304] 0 2024-09-06T14:44:34.326 INFO:tasks.workunit.client.0.smithi052.stdout:9/32: truncate d1/fa 682602 0 2024-09-06T14:44:34.326 INFO:tasks.workunit.client.0.smithi052.stdout:3/143: dwrite d0/f1d [4194304,4194304] 0 2024-09-06T14:44:34.331 INFO:tasks.workunit.client.0.smithi052.stdout:3/144: stat d0/f1a 0 2024-09-06T14:44:34.332 INFO:tasks.workunit.client.1.smithi165.stdout:6/751: creat d29/d39/d5b/d62/d67/fe5 x:0 0 0 2024-09-06T14:44:34.333 INFO:tasks.workunit.client.1.smithi165.stdout:9/832: mkdir db/de/d15/d7f/d9b/d6c/d96/d101/d103 0 2024-09-06T14:44:34.334 INFO:tasks.workunit.client.1.smithi165.stdout:8/717: dwrite d0/d34/d6b/d94/d70/fc0 [0,4194304] 0 2024-09-06T14:44:34.334 INFO:tasks.workunit.client.1.smithi165.stdout:0/670: dwrite d15/d19/d2c/fb5 [0,4194304] 0 2024-09-06T14:44:34.334 INFO:tasks.workunit.client.0.smithi052.stdout:7/86: write f5 [1235620,119656] 0 2024-09-06T14:44:34.335 INFO:tasks.workunit.client.0.smithi052.stdout:6/23: dwrite f0 [0,4194304] 0 2024-09-06T14:44:34.335 INFO:tasks.workunit.client.0.smithi052.stdout:1/84: symlink d1/da/l15 0 2024-09-06T14:44:34.336 INFO:tasks.workunit.client.1.smithi165.stdout:0/671: write d15/fbe [764151,104685] 0 2024-09-06T14:44:34.338 INFO:tasks.workunit.client.1.smithi165.stdout:0/672: fdatasync ff 0 2024-09-06T14:44:34.338 INFO:tasks.workunit.client.0.smithi052.stdout:1/85: stat d1/l3 0 2024-09-06T14:44:34.339 INFO:tasks.workunit.client.0.smithi052.stdout:4/85: rename d9/d10/d17/c18 to d9/c21 0 2024-09-06T14:44:34.340 INFO:tasks.workunit.client.0.smithi052.stdout:3/145: write d0/d11/d12/d17/f23 [25696,82365] 0 2024-09-06T14:44:34.342 INFO:tasks.workunit.client.0.smithi052.stdout:0/84: rename d0 to d0/dd/d13 22 2024-09-06T14:44:34.343 INFO:tasks.workunit.client.0.smithi052.stdout:8/80: dwrite f1 [4194304,4194304] 0 2024-09-06T14:44:34.343 INFO:tasks.workunit.client.1.smithi165.stdout:8/718: fdatasync d0/d14/d3e/db4/fe2 0 2024-09-06T14:44:34.343 INFO:tasks.workunit.client.1.smithi165.stdout:3/743: creat d1/d19/d92/df1/ffc x:0 0 0 2024-09-06T14:44:34.344 INFO:tasks.workunit.client.1.smithi165.stdout:8/719: fdatasync d0/d19/d24/fe3 0 2024-09-06T14:44:34.345 INFO:tasks.workunit.client.0.smithi052.stdout:2/82: readlink l5 0 2024-09-06T14:44:34.348 INFO:tasks.workunit.client.1.smithi165.stdout:1/682: write d0/d2a/d18/d24/d4b/d93/d68/f88 [405984,90949] 0 2024-09-06T14:44:34.355 INFO:tasks.workunit.client.0.smithi052.stdout:4/86: creat d9/d10/f22 x:0 0 0 2024-09-06T14:44:34.359 INFO:tasks.workunit.client.0.smithi052.stdout:0/85: stat d0/c7 0 2024-09-06T14:44:34.361 INFO:tasks.workunit.client.0.smithi052.stdout:3/146: fdatasync d0/d11/d12/d18/f25 0 2024-09-06T14:44:34.362 INFO:tasks.workunit.client.0.smithi052.stdout:4/87: chown d9/l16 7 1 2024-09-06T14:44:34.369 INFO:tasks.workunit.client.0.smithi052.stdout:1/86: dread d1/da/ff [0,4194304] 0 2024-09-06T14:44:34.371 INFO:tasks.workunit.client.0.smithi052.stdout:5/19: dwrite d2/f6 [0,4194304] 0 2024-09-06T14:44:34.371 INFO:tasks.workunit.client.1.smithi165.stdout:6/752: mknod d29/d32/d7a/ce6 0 2024-09-06T14:44:34.371 INFO:tasks.workunit.client.0.smithi052.stdout:4/88: chown c1 159615872 1 2024-09-06T14:44:34.372 INFO:tasks.workunit.client.1.smithi165.stdout:0/673: dread d15/f37 [0,4194304] 0 2024-09-06T14:44:34.374 INFO:tasks.workunit.client.1.smithi165.stdout:2/651: creat d9/d25/d45/d75/d67/dd1/fd5 x:0 0 0 2024-09-06T14:44:34.374 INFO:tasks.workunit.client.1.smithi165.stdout:5/806: truncate d6/d1c/d28/d2d/d3c/d44/d90/ddf/fd2 373938 0 2024-09-06T14:44:34.376 INFO:tasks.workunit.client.1.smithi165.stdout:7/600: getdents d20/d3b/d69/d88/d80 0 2024-09-06T14:44:34.377 INFO:tasks.workunit.client.1.smithi165.stdout:3/744: fsync d1/da/f8e 0 2024-09-06T14:44:34.378 INFO:tasks.workunit.client.0.smithi052.stdout:1/87: chown d1/db/de 5976844 1 2024-09-06T14:44:34.381 INFO:tasks.workunit.client.0.smithi052.stdout:7/87: dwrite d11/f12 [4194304,4194304] 0 2024-09-06T14:44:34.383 INFO:tasks.workunit.client.1.smithi165.stdout:5/807: dwrite d6/d1c/d28/f46 [0,4194304] 0 2024-09-06T14:44:34.383 INFO:tasks.workunit.client.0.smithi052.stdout:6/24: dwrite d2/f4 [0,4194304] 0 2024-09-06T14:44:34.383 INFO:tasks.workunit.client.0.smithi052.stdout:3/147: unlink d0/d11/d12/d17/f23 0 2024-09-06T14:44:34.387 INFO:tasks.workunit.client.0.smithi052.stdout:6/25: readlink d2/l6 0 2024-09-06T14:44:34.390 INFO:tasks.workunit.client.0.smithi052.stdout:7/88: fsync f7 0 2024-09-06T14:44:34.390 INFO:tasks.workunit.client.0.smithi052.stdout:8/81: dwrite d6/f11 [4194304,4194304] 0 2024-09-06T14:44:34.390 INFO:tasks.workunit.client.0.smithi052.stdout:5/20: mknod d2/c8 0 2024-09-06T14:44:34.390 INFO:tasks.workunit.client.0.smithi052.stdout:1/88: chown d1/da/d12 55899 1 2024-09-06T14:44:34.392 INFO:tasks.workunit.client.0.smithi052.stdout:2/83: dwrite da/f11 [0,4194304] 0 2024-09-06T14:44:34.398 INFO:tasks.workunit.client.1.smithi165.stdout:6/753: dwrite d29/f66 [4194304,4194304] 0 2024-09-06T14:44:34.403 INFO:tasks.workunit.client.0.smithi052.stdout:9/33: dwrite d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:34.404 INFO:tasks.workunit.client.0.smithi052.stdout:0/86: dread d0/d12/f9 [0,4194304] 0 2024-09-06T14:44:34.409 INFO:tasks.workunit.client.0.smithi052.stdout:5/21: dread d2/f3 [0,4194304] 0 2024-09-06T14:44:34.410 INFO:tasks.workunit.client.1.smithi165.stdout:7/601: creat d20/d4d/d54/fbe x:0 0 0 2024-09-06T14:44:34.412 INFO:tasks.workunit.client.1.smithi165.stdout:7/602: readlink l9 0 2024-09-06T14:44:34.412 INFO:tasks.workunit.client.1.smithi165.stdout:3/745: dread d1/d7c/fad [0,4194304] 0 2024-09-06T14:44:34.412 INFO:tasks.workunit.client.0.smithi052.stdout:5/22: fdatasync d2/f3 0 2024-09-06T14:44:34.412 INFO:tasks.workunit.client.0.smithi052.stdout:6/26: unlink f0 0 2024-09-06T14:44:34.412 INFO:tasks.workunit.client.0.smithi052.stdout:7/89: fsync ff 0 2024-09-06T14:44:34.422 INFO:tasks.workunit.client.0.smithi052.stdout:6/27: dread d2/f4 [0,4194304] 0 2024-09-06T14:44:34.425 INFO:tasks.workunit.client.1.smithi165.stdout:4/758: write d5/d1b/d61/dd7/fe3 [4324433,85379] 0 2024-09-06T14:44:34.426 INFO:tasks.workunit.client.0.smithi052.stdout:1/89: rename d1/l3 to d1/da/d14/l16 0 2024-09-06T14:44:34.426 INFO:tasks.workunit.client.0.smithi052.stdout:3/148: dwrite d0/f3 [0,4194304] 0 2024-09-06T14:44:34.427 INFO:tasks.workunit.client.1.smithi165.stdout:5/808: symlink d6/d98/dd7/l11f 0 2024-09-06T14:44:34.428 INFO:tasks.workunit.client.1.smithi165.stdout:4/759: truncate d5/d1b/d1c/d41/d9e/fe1 560702 0 2024-09-06T14:44:34.430 INFO:tasks.workunit.client.1.smithi165.stdout:1/683: mknod d0/d2a/d18/d24/d4b/d93/dbd/dd1/cd7 0 2024-09-06T14:44:34.431 INFO:tasks.workunit.client.1.smithi165.stdout:9/833: truncate db/de/d15/d17/f82 612759 0 2024-09-06T14:44:34.431 INFO:tasks.workunit.client.1.smithi165.stdout:0/674: dwrite d15/f5a [0,4194304] 0 2024-09-06T14:44:34.431 INFO:tasks.workunit.client.1.smithi165.stdout:1/684: chown d0/d2a/d18/f43 141357746 1 2024-09-06T14:44:34.435 INFO:tasks.workunit.client.0.smithi052.stdout:3/149: dread d0/d11/d12/d18/f22 [0,4194304] 0 2024-09-06T14:44:34.435 INFO:tasks.workunit.client.0.smithi052.stdout:2/84: write f9 [1094019,90755] 0 2024-09-06T14:44:34.437 INFO:tasks.workunit.client.1.smithi165.stdout:8/720: write d0/f16 [4609620,50397] 0 2024-09-06T14:44:34.438 INFO:tasks.workunit.client.0.smithi052.stdout:9/34: mkdir d1/d4/d6/dc 0 2024-09-06T14:44:34.440 INFO:tasks.workunit.client.0.smithi052.stdout:8/82: creat d6/d9/f18 x:0 0 0 2024-09-06T14:44:34.440 INFO:tasks.workunit.client.0.smithi052.stdout:1/90: dwrite d1/f4 [0,4194304] 0 2024-09-06T14:44:34.441 INFO:tasks.workunit.client.0.smithi052.stdout:0/87: truncate d0/d12/f9 340114 0 2024-09-06T14:44:34.447 INFO:tasks.workunit.client.1.smithi165.stdout:5/809: truncate d6/f37 1212201 0 2024-09-06T14:44:34.449 INFO:tasks.workunit.client.0.smithi052.stdout:0/88: chown d0/d12/lc 12 1 2024-09-06T14:44:34.449 INFO:tasks.workunit.client.1.smithi165.stdout:4/760: symlink d5/d1b/d1c/d41/d9e/l104 0 2024-09-06T14:44:34.451 INFO:tasks.workunit.client.0.smithi052.stdout:6/28: mknod d2/c7 0 2024-09-06T14:44:34.456 INFO:tasks.workunit.client.1.smithi165.stdout:0/675: dread d15/d19/d28/d4f/d52/f63 [0,4194304] 0 2024-09-06T14:44:34.457 INFO:tasks.workunit.client.0.smithi052.stdout:3/150: dwrite d0/f9 [0,4194304] 0 2024-09-06T14:44:34.457 INFO:tasks.workunit.client.0.smithi052.stdout:2/85: dwrite da/db/f12 [0,4194304] 0 2024-09-06T14:44:34.458 INFO:tasks.workunit.client.1.smithi165.stdout:0/676: write d15/d19/d28/d3a/d3f/f48 [2707993,52180] 0 2024-09-06T14:44:34.458 INFO:tasks.workunit.client.0.smithi052.stdout:2/86: fsync f0 0 2024-09-06T14:44:34.459 INFO:tasks.workunit.client.1.smithi165.stdout:0/677: fsync d15/d19/d28/d3a/f86 0 2024-09-06T14:44:34.463 INFO:tasks.workunit.client.0.smithi052.stdout:3/151: dread d0/f1a [0,4194304] 0 2024-09-06T14:44:34.464 INFO:tasks.workunit.client.1.smithi165.stdout:7/603: write d20/d4d/fb8 [3153288,79920] 0 2024-09-06T14:44:34.469 INFO:tasks.workunit.client.1.smithi165.stdout:8/721: dread d0/f17 [0,4194304] 0 2024-09-06T14:44:34.470 INFO:tasks.workunit.client.1.smithi165.stdout:6/754: symlink d29/d6a/d83/dc8/le7 0 2024-09-06T14:44:34.470 INFO:tasks.workunit.client.0.smithi052.stdout:3/152: dread d0/d11/d12/d18/f25 [0,4194304] 0 2024-09-06T14:44:34.470 INFO:tasks.workunit.client.0.smithi052.stdout:9/35: mkdir d1/d4/d6/dd 0 2024-09-06T14:44:34.470 INFO:tasks.workunit.client.1.smithi165.stdout:2/652: dwrite d9/d25/d45/d75/d67/d76/f3c [0,4194304] 0 2024-09-06T14:44:34.472 INFO:tasks.workunit.client.0.smithi052.stdout:1/91: rmdir d1/da 39 2024-09-06T14:44:34.473 INFO:tasks.workunit.client.1.smithi165.stdout:4/761: dread d5/d1b/d61/dd7/ddf/dd4/fda [0,4194304] 0 2024-09-06T14:44:34.475 INFO:tasks.workunit.client.0.smithi052.stdout:8/83: unlink d6/d9/lc 0 2024-09-06T14:44:34.477 INFO:tasks.workunit.client.1.smithi165.stdout:5/810: creat d6/d1c/d28/d2d/d49/de9/f120 x:0 0 0 2024-09-06T14:44:34.481 INFO:tasks.workunit.client.0.smithi052.stdout:0/89: unlink d0/dd/c10 0 2024-09-06T14:44:34.483 INFO:tasks.workunit.client.0.smithi052.stdout:7/90: rename d11/c18 to d11/c20 0 2024-09-06T14:44:34.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/91: chown d11/d1c/f1f 1228 1 2024-09-06T14:44:34.484 INFO:tasks.workunit.client.1.smithi165.stdout:1/685: symlink d0/d2a/d18/d24/d4b/d5f/db8/ld8 0 2024-09-06T14:44:34.485 INFO:tasks.workunit.client.0.smithi052.stdout:6/29: write d2/f4 [1701610,64796] 0 2024-09-06T14:44:34.486 INFO:tasks.workunit.client.0.smithi052.stdout:6/30: read d2/f4 [4079301,130547] 0 2024-09-06T14:44:34.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/87: symlink da/db/l1f 0 2024-09-06T14:44:34.490 INFO:tasks.workunit.client.0.smithi052.stdout:6/31: dread d2/f4 [0,4194304] 0 2024-09-06T14:44:34.491 INFO:tasks.workunit.client.0.smithi052.stdout:4/89: getdents d9/d10 0 2024-09-06T14:44:34.493 INFO:tasks.workunit.client.1.smithi165.stdout:8/722: creat d0/d34/d6b/d94/d70/ffd x:0 0 0 2024-09-06T14:44:34.493 INFO:tasks.workunit.client.0.smithi052.stdout:5/23: truncate d2/f3 396138 0 2024-09-06T14:44:34.493 INFO:tasks.workunit.client.0.smithi052.stdout:9/36: dread - d1/d4/f9 zero size 2024-09-06T14:44:34.494 INFO:tasks.workunit.client.1.smithi165.stdout:9/834: truncate db/de/d15/d74/fca 288503 0 2024-09-06T14:44:34.494 INFO:tasks.workunit.client.0.smithi052.stdout:9/37: fdatasync d1/d4/f5 0 2024-09-06T14:44:34.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/38: stat d1/d4/d6/dc 0 2024-09-06T14:44:34.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/39: fsync d1/d4/f5 0 2024-09-06T14:44:34.496 INFO:tasks.workunit.client.1.smithi165.stdout:6/755: rename d29/d39/fc6 to d29/d39/d5b/fe8 0 2024-09-06T14:44:34.498 INFO:tasks.workunit.client.1.smithi165.stdout:2/653: symlink d9/d23/d52/ld6 0 2024-09-06T14:44:34.500 INFO:tasks.workunit.client.1.smithi165.stdout:4/762: mkdir d5/d1b/d61/d77/d7c/dcd/dc9/d105 0 2024-09-06T14:44:34.501 INFO:tasks.workunit.client.0.smithi052.stdout:9/40: dwrite d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:34.501 INFO:tasks.workunit.client.0.smithi052.stdout:8/84: rmdir d6 39 2024-09-06T14:44:34.503 INFO:tasks.workunit.client.1.smithi165.stdout:5/811: readlink d6/l9 0 2024-09-06T14:44:34.503 INFO:tasks.workunit.client.1.smithi165.stdout:5/812: write d6/d1c/d28/f46 [806491,11652] 0 2024-09-06T14:44:34.504 INFO:tasks.workunit.client.0.smithi052.stdout:0/90: mkdir d0/dd/d14 0 2024-09-06T14:44:34.506 INFO:tasks.workunit.client.0.smithi052.stdout:7/92: creat d11/f21 x:0 0 0 2024-09-06T14:44:34.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/93: stat d11/c16 0 2024-09-06T14:44:34.509 INFO:tasks.workunit.client.1.smithi165.stdout:7/604: symlink d20/d65/lbf 0 2024-09-06T14:44:34.510 INFO:tasks.workunit.client.0.smithi052.stdout:2/88: mkdir da/d19/d20 0 2024-09-06T14:44:34.514 INFO:tasks.workunit.client.1.smithi165.stdout:8/723: rename d0/d19/d36/d28/l30 to d0/d34/d6b/d94/d68/lfe 0 2024-09-06T14:44:34.516 INFO:tasks.workunit.client.0.smithi052.stdout:4/90: creat d9/d10/d17/f23 x:0 0 0 2024-09-06T14:44:34.526 INFO:tasks.workunit.client.0.smithi052.stdout:1/92: stat d1/da/d14/l16 0 2024-09-06T14:44:34.527 INFO:tasks.workunit.client.0.smithi052.stdout:1/93: chown d1/da/d14 42776 1 2024-09-06T14:44:34.531 INFO:tasks.workunit.client.0.smithi052.stdout:1/94: dread d1/f4 [0,4194304] 0 2024-09-06T14:44:34.531 INFO:tasks.workunit.client.0.smithi052.stdout:8/85: write d6/f11 [9367428,40187] 0 2024-09-06T14:44:34.532 INFO:tasks.workunit.client.0.smithi052.stdout:1/95: rename d1 to d1/da/d17 22 2024-09-06T14:44:34.533 INFO:tasks.workunit.client.0.smithi052.stdout:1/96: write d1/f8 [2228822,64327] 0 2024-09-06T14:44:34.534 INFO:tasks.workunit.client.1.smithi165.stdout:4/763: mkdir d5/d1b/d1c/d8c/d106 0 2024-09-06T14:44:34.534 INFO:tasks.workunit.client.1.smithi165.stdout:3/746: getdents d1/d4a/db4 0 2024-09-06T14:44:34.535 INFO:tasks.workunit.client.1.smithi165.stdout:5/813: creat d6/d1c/d28/d4b/da7/f121 x:0 0 0 2024-09-06T14:44:34.535 INFO:tasks.workunit.client.1.smithi165.stdout:1/686: mknod d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98/cd9 0 2024-09-06T14:44:34.535 INFO:tasks.workunit.client.1.smithi165.stdout:0/678: truncate d15/f4b 6438271 0 2024-09-06T14:44:34.536 INFO:tasks.workunit.client.1.smithi165.stdout:7/605: mkdir d20/d40/dc0 0 2024-09-06T14:44:34.537 INFO:tasks.workunit.client.1.smithi165.stdout:8/724: read d0/d19/d36/d28/f3d [1948926,118019] 0 2024-09-06T14:44:34.537 INFO:tasks.workunit.client.1.smithi165.stdout:2/654: link d9/d4f/f5e d9/d88/dac/da4/fd7 0 2024-09-06T14:44:34.538 INFO:tasks.workunit.client.1.smithi165.stdout:0/679: fsync d15/d19/d38/f5e 0 2024-09-06T14:44:34.538 INFO:tasks.workunit.client.1.smithi165.stdout:2/655: readlink d9/l15 0 2024-09-06T14:44:34.539 INFO:tasks.workunit.client.1.smithi165.stdout:6/756: rename d29/c99 to d29/d39/d5b/d62/d94/db7/dcc/ce9 0 2024-09-06T14:44:34.540 INFO:tasks.workunit.client.0.smithi052.stdout:2/89: symlink da/l21 0 2024-09-06T14:44:34.542 INFO:tasks.workunit.client.1.smithi165.stdout:4/764: creat d5/d1b/d61/d77/d93/f107 x:0 0 0 2024-09-06T14:44:34.542 INFO:tasks.workunit.client.1.smithi165.stdout:3/747: dread d1/da/dc/d3b/d83/fde [0,4194304] 0 2024-09-06T14:44:34.543 INFO:tasks.workunit.client.0.smithi052.stdout:6/32: rename d2/f4 to d2/f8 0 2024-09-06T14:44:34.543 INFO:tasks.workunit.client.1.smithi165.stdout:1/687: mknod d0/cda 0 2024-09-06T14:44:34.545 INFO:tasks.workunit.client.1.smithi165.stdout:1/688: fdatasync d0/d1c/fc1 0 2024-09-06T14:44:34.546 INFO:tasks.workunit.client.0.smithi052.stdout:3/153: truncate d0/fc 2228742 0 2024-09-06T14:44:34.546 INFO:tasks.workunit.client.0.smithi052.stdout:5/24: fdatasync f1 0 2024-09-06T14:44:34.547 INFO:tasks.workunit.client.1.smithi165.stdout:6/757: dwrite d29/d39/d5b/d62/d94/db7/fe1 [0,4194304] 0 2024-09-06T14:44:34.548 INFO:tasks.workunit.client.0.smithi052.stdout:4/91: dread d9/d10/d17/f20 [0,4194304] 0 2024-09-06T14:44:34.550 INFO:tasks.workunit.client.0.smithi052.stdout:4/92: write f6 [3677789,128602] 0 2024-09-06T14:44:34.551 INFO:tasks.workunit.client.0.smithi052.stdout:4/93: dread - d9/d10/f22 zero size 2024-09-06T14:44:34.555 INFO:tasks.workunit.client.1.smithi165.stdout:5/814: creat d6/d1c/d28/d4b/d55/d8a/dda/f122 x:0 0 0 2024-09-06T14:44:34.558 INFO:tasks.workunit.client.0.smithi052.stdout:8/86: mkdir d6/d9/df/d10/d19 0 2024-09-06T14:44:34.559 INFO:tasks.workunit.client.1.smithi165.stdout:0/680: mknod d15/d19/d38/cdf 0 2024-09-06T14:44:34.560 INFO:tasks.workunit.client.1.smithi165.stdout:2/656: mkdir d9/d25/d46/d7e/d90/dd8 0 2024-09-06T14:44:34.561 INFO:tasks.workunit.client.0.smithi052.stdout:8/87: dread d6/f11 [4194304,4194304] 0 2024-09-06T14:44:34.561 INFO:tasks.workunit.client.1.smithi165.stdout:4/765: mkdir d5/d1b/d61/d77/d108 0 2024-09-06T14:44:34.562 INFO:tasks.workunit.client.0.smithi052.stdout:1/97: write d1/da/ff [266454,50283] 0 2024-09-06T14:44:34.563 INFO:tasks.workunit.client.1.smithi165.stdout:3/748: mkdir d1/dbd/dfd 0 2024-09-06T14:44:34.564 INFO:tasks.workunit.client.1.smithi165.stdout:3/749: write d1/d7c/fcc [468815,18954] 0 2024-09-06T14:44:34.564 INFO:tasks.workunit.client.0.smithi052.stdout:0/91: creat d0/dd/d14/f15 x:0 0 0 2024-09-06T14:44:34.564 INFO:tasks.workunit.client.1.smithi165.stdout:3/750: chown d1/d41/fe8 146 1 2024-09-06T14:44:34.567 INFO:tasks.workunit.client.0.smithi052.stdout:2/90: symlink da/l22 0 2024-09-06T14:44:34.568 INFO:tasks.workunit.client.1.smithi165.stdout:3/751: dread d1/da/dc/d3b/d71/fe3 [0,4194304] 0 2024-09-06T14:44:34.569 INFO:tasks.workunit.client.1.smithi165.stdout:3/752: chown d1/d7c/fad 618460 1 2024-09-06T14:44:34.571 INFO:tasks.workunit.client.0.smithi052.stdout:6/33: mknod d2/c9 0 2024-09-06T14:44:34.573 INFO:tasks.workunit.client.0.smithi052.stdout:3/154: read d0/f1a [2660680,89913] 0 2024-09-06T14:44:34.573 INFO:tasks.workunit.client.0.smithi052.stdout:3/155: chown d0/cd 422000 1 2024-09-06T14:44:34.574 INFO:tasks.workunit.client.0.smithi052.stdout:3/156: readlink d0/d11/d12/l1f 0 2024-09-06T14:44:34.575 INFO:tasks.workunit.client.0.smithi052.stdout:5/25: symlink d2/l9 0 2024-09-06T14:44:34.576 INFO:tasks.workunit.client.0.smithi052.stdout:5/26: write d2/f7 [537115,54418] 0 2024-09-06T14:44:34.577 INFO:tasks.workunit.client.1.smithi165.stdout:5/815: write d6/fb5 [3276033,14295] 0 2024-09-06T14:44:34.578 INFO:tasks.workunit.client.1.smithi165.stdout:5/816: readlink d6/d1c/d28/l93 0 2024-09-06T14:44:34.580 INFO:tasks.workunit.client.1.smithi165.stdout:8/725: mknod d0/d19/d36/d2d/cff 0 2024-09-06T14:44:34.581 INFO:tasks.workunit.client.0.smithi052.stdout:4/94: symlink d9/d10/d17/l24 0 2024-09-06T14:44:34.582 INFO:tasks.workunit.client.0.smithi052.stdout:3/157: dwrite d0/f9 [0,4194304] 0 2024-09-06T14:44:34.582 INFO:tasks.workunit.client.1.smithi165.stdout:0/681: symlink d15/d19/d28/d4f/le0 0 2024-09-06T14:44:34.584 INFO:tasks.workunit.client.1.smithi165.stdout:4/766: creat d5/d1b/f109 x:0 0 0 2024-09-06T14:44:34.587 INFO:tasks.workunit.client.0.smithi052.stdout:5/27: dwrite d2/f7 [0,4194304] 0 2024-09-06T14:44:34.587 INFO:tasks.workunit.client.0.smithi052.stdout:9/41: truncate d1/d4/f5 3934852 0 2024-09-06T14:44:34.589 INFO:tasks.workunit.client.0.smithi052.stdout:1/98: write d1/f4 [5170650,38812] 0 2024-09-06T14:44:34.593 INFO:tasks.workunit.client.0.smithi052.stdout:0/92: dread d0/d12/f9 [0,4194304] 0 2024-09-06T14:44:34.594 INFO:tasks.workunit.client.0.smithi052.stdout:0/93: fdatasync d0/dd/d14/f15 0 2024-09-06T14:44:34.595 INFO:tasks.workunit.client.0.smithi052.stdout:0/94: chown d0/d12/lc 30 1 2024-09-06T14:44:34.596 INFO:tasks.workunit.client.0.smithi052.stdout:2/91: rename da/fc to da/f23 0 2024-09-06T14:44:34.601 INFO:tasks.workunit.client.1.smithi165.stdout:5/817: symlink d6/d1c/d28/d2d/d61/ddc/l123 0 2024-09-06T14:44:34.601 INFO:tasks.workunit.client.1.smithi165.stdout:5/818: chown d6/d1c/d28/d88/d108 7329756 1 2024-09-06T14:44:34.602 INFO:tasks.workunit.client.1.smithi165.stdout:5/819: truncate d6/d1c/d64/ff8 4811476 0 2024-09-06T14:44:34.603 INFO:tasks.workunit.client.1.smithi165.stdout:8/726: creat d0/d14/d3e/dcf/f100 x:0 0 0 2024-09-06T14:44:34.603 INFO:tasks.workunit.client.0.smithi052.stdout:0/95: dwrite d0/d12/fb [0,4194304] 0 2024-09-06T14:44:34.605 INFO:tasks.workunit.client.1.smithi165.stdout:1/689: write d0/d2a/d18/f43 [896578,49981] 0 2024-09-06T14:44:34.608 INFO:tasks.workunit.client.1.smithi165.stdout:7/606: truncate f12 2817830 0 2024-09-06T14:44:34.608 INFO:tasks.workunit.client.0.smithi052.stdout:5/28: fdatasync d2/f7 0 2024-09-06T14:44:34.609 INFO:tasks.workunit.client.0.smithi052.stdout:5/29: write d2/f3 [960470,60567] 0 2024-09-06T14:44:34.609 INFO:tasks.workunit.client.0.smithi052.stdout:5/30: fdatasync d2/f7 0 2024-09-06T14:44:34.610 INFO:tasks.workunit.client.1.smithi165.stdout:8/727: dwrite d0/d14/d3e/dcf/f100 [0,4194304] 0 2024-09-06T14:44:34.612 INFO:tasks.workunit.client.1.smithi165.stdout:4/767: unlink d5/d1b/d1c/d41/d9e/dfd/ff6 0 2024-09-06T14:44:34.613 INFO:tasks.workunit.client.0.smithi052.stdout:4/95: rename c4 to d9/d10/d19/c25 0 2024-09-06T14:44:34.613 INFO:tasks.workunit.client.0.smithi052.stdout:9/42: rename d1/d4/d6 to d1/d4/d6/de 22 2024-09-06T14:44:34.614 INFO:tasks.workunit.client.1.smithi165.stdout:4/768: write d5/d1b/f5b [2636724,50239] 0 2024-09-06T14:44:34.614 INFO:tasks.workunit.client.0.smithi052.stdout:5/31: dread d2/f7 [0,4194304] 0 2024-09-06T14:44:34.615 INFO:tasks.workunit.client.0.smithi052.stdout:9/43: chown d1/d4/f9 0 1 2024-09-06T14:44:34.617 INFO:tasks.workunit.client.1.smithi165.stdout:3/753: creat d1/d19/df8/ffe x:0 0 0 2024-09-06T14:44:34.618 INFO:tasks.workunit.client.1.smithi165.stdout:3/754: fdatasync d1/da/dd/d4b/f8b 0 2024-09-06T14:44:34.622 INFO:tasks.workunit.client.0.smithi052.stdout:7/94: getdents d11 0 2024-09-06T14:44:34.625 INFO:tasks.workunit.client.1.smithi165.stdout:5/820: dwrite d6/d1c/d28/d4b/d55/f6f [0,4194304] 0 2024-09-06T14:44:34.627 INFO:tasks.workunit.client.1.smithi165.stdout:6/758: truncate d29/d39/d5b/d68/fbd 4322612 0 2024-09-06T14:44:34.627 INFO:tasks.workunit.client.1.smithi165.stdout:1/690: dread d0/d2a/d18/d24/d4b/d93/d2b/d3e/f49 [0,4194304] 0 2024-09-06T14:44:34.628 INFO:tasks.workunit.client.0.smithi052.stdout:2/92: rmdir da 39 2024-09-06T14:44:34.630 INFO:tasks.workunit.client.0.smithi052.stdout:6/34: write d2/f8 [4249295,39194] 0 2024-09-06T14:44:34.633 INFO:tasks.workunit.client.1.smithi165.stdout:7/607: dwrite d20/d65/f6c [4194304,4194304] 0 2024-09-06T14:44:34.635 INFO:tasks.workunit.client.0.smithi052.stdout:4/96: chown d9/c14 94840 1 2024-09-06T14:44:34.635 INFO:tasks.workunit.client.0.smithi052.stdout:6/35: dread d2/f8 [0,4194304] 0 2024-09-06T14:44:34.636 INFO:tasks.workunit.client.1.smithi165.stdout:4/769: mknod d5/d1b/d61/d77/dbd/c10a 0 2024-09-06T14:44:34.639 INFO:tasks.workunit.client.1.smithi165.stdout:4/770: write d5/d1b/f109 [232180,87838] 0 2024-09-06T14:44:34.640 INFO:tasks.workunit.client.0.smithi052.stdout:4/97: dread d9/d10/d17/f20 [0,4194304] 0 2024-09-06T14:44:34.640 INFO:tasks.workunit.client.1.smithi165.stdout:3/755: rmdir d1/d19/d92/df1 39 2024-09-06T14:44:34.641 INFO:tasks.workunit.client.1.smithi165.stdout:0/682: dwrite d15/d19/d28/d4f/f7b [0,4194304] 0 2024-09-06T14:44:34.642 INFO:tasks.workunit.client.1.smithi165.stdout:9/835: sync 2024-09-06T14:44:34.643 INFO:tasks.workunit.client.0.smithi052.stdout:0/96: rename d0/d12/lc to d0/dd/l16 0 2024-09-06T14:44:34.643 INFO:tasks.workunit.client.1.smithi165.stdout:0/683: fdatasync d15/d19/d28/d3a/d3f/f48 0 2024-09-06T14:44:34.644 INFO:tasks.workunit.client.0.smithi052.stdout:5/32: symlink d2/la 0 2024-09-06T14:44:34.646 INFO:tasks.workunit.client.0.smithi052.stdout:5/33: fdatasync d2/f7 0 2024-09-06T14:44:34.647 INFO:tasks.workunit.client.0.smithi052.stdout:8/88: link c4 d6/d9/df/d10/c1a 0 2024-09-06T14:44:34.649 INFO:tasks.workunit.client.0.smithi052.stdout:9/44: mkdir d1/d4/df 0 2024-09-06T14:44:34.655 INFO:tasks.workunit.client.1.smithi165.stdout:8/728: readlink d0/d19/d36/d2d/d33/d3a/d46/l8e 0 2024-09-06T14:44:34.655 INFO:tasks.workunit.client.1.smithi165.stdout:8/729: fdatasync d0/d19/d36/d2d/dc9/fee 0 2024-09-06T14:44:34.660 INFO:tasks.workunit.client.1.smithi165.stdout:3/756: symlink d1/d19/df8/lff 0 2024-09-06T14:44:34.660 INFO:tasks.workunit.client.1.smithi165.stdout:3/757: readlink d1/d19/d92/le1 0 2024-09-06T14:44:34.661 INFO:tasks.workunit.client.1.smithi165.stdout:3/758: fsync d1/da/dd/d4b/f74 0 2024-09-06T14:44:34.662 INFO:tasks.workunit.client.1.smithi165.stdout:4/771: unlink d5/d1b/d1c/d20/d75/d83/f64 0 2024-09-06T14:44:34.664 INFO:tasks.workunit.client.0.smithi052.stdout:6/36: symlink d2/la 0 2024-09-06T14:44:34.664 INFO:tasks.workunit.client.0.smithi052.stdout:2/93: dwrite da/f1b [0,4194304] 0 2024-09-06T14:44:34.664 INFO:tasks.workunit.client.0.smithi052.stdout:6/37: chown d2 2273 1 2024-09-06T14:44:34.664 INFO:tasks.workunit.client.0.smithi052.stdout:2/94: rename da to da/d24 22 2024-09-06T14:44:34.666 INFO:tasks.workunit.client.0.smithi052.stdout:4/98: symlink d9/d10/d17/l26 0 2024-09-06T14:44:34.666 INFO:tasks.workunit.client.0.smithi052.stdout:1/99: truncate d1/f4 4239993 0 2024-09-06T14:44:34.667 INFO:tasks.workunit.client.1.smithi165.stdout:9/836: chown db/de/d15/d17/d18/cde 63988343 1 2024-09-06T14:44:34.670 INFO:tasks.workunit.client.0.smithi052.stdout:5/34: creat d2/fb x:0 0 0 2024-09-06T14:44:34.672 INFO:tasks.workunit.client.0.smithi052.stdout:5/35: write f1 [1199307,118556] 0 2024-09-06T14:44:34.673 INFO:tasks.workunit.client.1.smithi165.stdout:5/821: rename d6/d1c/d28/d2d/d3c/d44/d90/ddf/fd2 to d6/d1c/d28/d4b/d55/d8a/de1/dbd/f124 0 2024-09-06T14:44:34.674 INFO:tasks.workunit.client.0.smithi052.stdout:8/89: mkdir d6/d9/df/d1b 0 2024-09-06T14:44:34.674 INFO:tasks.workunit.client.1.smithi165.stdout:5/822: dread - d6/d1c/d28/d4b/d55/d8a/dda/f122 zero size 2024-09-06T14:44:34.675 INFO:tasks.workunit.client.1.smithi165.stdout:2/657: sync 2024-09-06T14:44:34.675 INFO:tasks.workunit.client.1.smithi165.stdout:6/759: symlink d29/d6a/lea 0 2024-09-06T14:44:34.675 INFO:tasks.workunit.client.1.smithi165.stdout:3/759: dread d1/da/dc/d10/f35 [0,4194304] 0 2024-09-06T14:44:34.677 INFO:tasks.workunit.client.1.smithi165.stdout:1/691: mknod d0/d1c/cdb 0 2024-09-06T14:44:34.678 INFO:tasks.workunit.client.1.smithi165.stdout:8/730: symlink d0/d19/d7f/l101 0 2024-09-06T14:44:34.680 INFO:tasks.workunit.client.1.smithi165.stdout:7/608: truncate d20/d65/f61 201659 0 2024-09-06T14:44:34.681 INFO:tasks.workunit.client.0.smithi052.stdout:0/97: write d0/d12/f9 [446233,76177] 0 2024-09-06T14:44:34.682 INFO:tasks.workunit.client.1.smithi165.stdout:3/760: dwrite d1/d19/f91 [0,4194304] 0 2024-09-06T14:44:34.684 INFO:tasks.workunit.client.0.smithi052.stdout:3/158: getdents d0 0 2024-09-06T14:44:34.684 INFO:tasks.workunit.client.1.smithi165.stdout:3/761: dread - d1/da/dc/d3b/dc6/d89/fac zero size 2024-09-06T14:44:34.686 INFO:tasks.workunit.client.0.smithi052.stdout:6/38: fsync d2/f8 0 2024-09-06T14:44:34.689 INFO:tasks.workunit.client.0.smithi052.stdout:2/95: rename da/db/l1f to da/l25 0 2024-09-06T14:44:34.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/98: dwrite d0/dd/d14/f15 [0,4194304] 0 2024-09-06T14:44:34.693 INFO:tasks.workunit.client.1.smithi165.stdout:5/823: dread d6/d1c/d28/d4b/d55/d8a/de1/fa4 [0,4194304] 0 2024-09-06T14:44:34.694 INFO:tasks.workunit.client.1.smithi165.stdout:9/837: mkdir db/de/d15/d7f/dbc/d104 0 2024-09-06T14:44:34.696 INFO:tasks.workunit.client.0.smithi052.stdout:1/100: mkdir d1/db/d18 0 2024-09-06T14:44:34.701 INFO:tasks.workunit.client.0.smithi052.stdout:5/36: symlink d2/lc 0 2024-09-06T14:44:34.703 INFO:tasks.workunit.client.0.smithi052.stdout:9/45: mkdir d1/d4/d6/dc/d10 0 2024-09-06T14:44:34.704 INFO:tasks.workunit.client.0.smithi052.stdout:7/95: getdents d11 0 2024-09-06T14:44:34.705 INFO:tasks.workunit.client.1.smithi165.stdout:6/760: rmdir d29/d39/d5b/d62/d94/db7/dcc 39 2024-09-06T14:44:34.705 INFO:tasks.workunit.client.1.smithi165.stdout:6/761: fdatasync d29/d39/d5b/d62/d67/fb4 0 2024-09-06T14:44:34.706 INFO:tasks.workunit.client.1.smithi165.stdout:1/692: mknod d0/d2a/d18/d24/d4b/d93/dbd/dd1/cdc 0 2024-09-06T14:44:34.708 INFO:tasks.workunit.client.1.smithi165.stdout:8/731: symlink d0/d19/d36/d28/dda/l102 0 2024-09-06T14:44:34.708 INFO:tasks.workunit.client.1.smithi165.stdout:8/732: dread - d0/d19/d7f/fe6 zero size 2024-09-06T14:44:34.711 INFO:tasks.workunit.client.0.smithi052.stdout:6/39: creat d2/fb x:0 0 0 2024-09-06T14:44:34.712 INFO:tasks.workunit.client.1.smithi165.stdout:3/762: symlink d1/da/dd/d8c/l100 0 2024-09-06T14:44:34.712 INFO:tasks.workunit.client.0.smithi052.stdout:6/40: dread - d2/fb zero size 2024-09-06T14:44:34.714 INFO:tasks.workunit.client.0.smithi052.stdout:6/41: write d2/fb [696308,35107] 0 2024-09-06T14:44:34.714 INFO:tasks.workunit.client.0.smithi052.stdout:8/90: rename c5 to d6/d9/df/d10/c1c 0 2024-09-06T14:44:34.714 INFO:tasks.workunit.client.0.smithi052.stdout:4/99: dwrite d9/d10/f1f [0,4194304] 0 2024-09-06T14:44:34.716 INFO:tasks.workunit.client.0.smithi052.stdout:2/96: creat da/d19/f26 x:0 0 0 2024-09-06T14:44:34.717 INFO:tasks.workunit.client.1.smithi165.stdout:4/772: truncate d5/d1b/d1c/d41/ffb 792520 0 2024-09-06T14:44:34.721 INFO:tasks.workunit.client.1.smithi165.stdout:4/773: fdatasync d5/d1b/d61/dd7/ddf/ddc/f100 0 2024-09-06T14:44:34.721 INFO:tasks.workunit.client.1.smithi165.stdout:5/824: symlink d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/l125 0 2024-09-06T14:44:34.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/42: dread d2/fb [0,4194304] 0 2024-09-06T14:44:34.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/43: readlink d2/l6 0 2024-09-06T14:44:34.722 INFO:tasks.workunit.client.0.smithi052.stdout:0/99: mknod d0/dd/c17 0 2024-09-06T14:44:34.722 INFO:tasks.workunit.client.1.smithi165.stdout:9/838: dread - db/de/d16/f43 zero size 2024-09-06T14:44:34.724 INFO:tasks.workunit.client.0.smithi052.stdout:5/37: creat d2/fd x:0 0 0 2024-09-06T14:44:34.725 INFO:tasks.workunit.client.0.smithi052.stdout:6/44: dread d2/f8 [0,4194304] 0 2024-09-06T14:44:34.726 INFO:tasks.workunit.client.0.smithi052.stdout:3/159: creat d0/d11/d15/d1b/f27 x:0 0 0 2024-09-06T14:44:34.727 INFO:tasks.workunit.client.1.smithi165.stdout:4/774: dwrite d5/d1b/d61/dd7/ddf/dd4/fe6 [0,4194304] 0 2024-09-06T14:44:34.727 INFO:tasks.workunit.client.0.smithi052.stdout:3/160: write d0/ff [4466941,87779] 0 2024-09-06T14:44:34.728 INFO:tasks.workunit.client.0.smithi052.stdout:7/96: rename d11/c1a to d11/d1c/c22 0 2024-09-06T14:44:34.729 INFO:tasks.workunit.client.0.smithi052.stdout:7/97: fdatasync d11/f21 0 2024-09-06T14:44:34.733 INFO:tasks.workunit.client.1.smithi165.stdout:3/763: symlink d1/d7c/d7e/dc5/l101 0 2024-09-06T14:44:34.734 INFO:tasks.workunit.client.1.smithi165.stdout:1/693: dread d0/d2a/d18/d24/d4b/d5f/f61 [0,4194304] 0 2024-09-06T14:44:34.734 INFO:tasks.workunit.client.0.smithi052.stdout:2/97: symlink da/db/l27 0 2024-09-06T14:44:34.736 INFO:tasks.workunit.client.0.smithi052.stdout:2/98: dread - da/d19/f1a zero size 2024-09-06T14:44:34.736 INFO:tasks.workunit.client.0.smithi052.stdout:7/98: dread d11/d1c/f1d [0,4194304] 0 2024-09-06T14:44:34.737 INFO:tasks.workunit.client.0.smithi052.stdout:1/101: truncate d1/f4 151468 0 2024-09-06T14:44:34.738 INFO:tasks.workunit.client.1.smithi165.stdout:0/684: getdents d15/d19/d50/d53/d7c/dbb 0 2024-09-06T14:44:34.738 INFO:tasks.workunit.client.0.smithi052.stdout:1/102: chown d1/da/d14 3500 1 2024-09-06T14:44:34.739 INFO:tasks.workunit.client.0.smithi052.stdout:1/103: chown d1/db/fd 142862 1 2024-09-06T14:44:34.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/46: mknod d1/c11 0 2024-09-06T14:44:34.740 INFO:tasks.workunit.client.0.smithi052.stdout:9/47: dread d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:34.742 INFO:tasks.workunit.client.0.smithi052.stdout:5/38: mknod d2/ce 0 2024-09-06T14:44:34.743 INFO:tasks.workunit.client.0.smithi052.stdout:5/39: fsync d2/f6 0 2024-09-06T14:44:34.743 INFO:tasks.workunit.client.1.smithi165.stdout:5/825: creat d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/f126 x:0 0 0 2024-09-06T14:44:34.746 INFO:tasks.workunit.client.0.smithi052.stdout:6/45: rename d2/f8 to d2/fc 0 2024-09-06T14:44:34.746 INFO:tasks.workunit.client.0.smithi052.stdout:1/104: dwrite d1/f8 [0,4194304] 0 2024-09-06T14:44:34.747 INFO:tasks.workunit.client.1.smithi165.stdout:2/658: creat d9/d25/d45/d75/fd9 x:0 0 0 2024-09-06T14:44:34.753 INFO:tasks.workunit.client.1.smithi165.stdout:6/762: creat d29/d6a/d83/d89/ddb/ddd/feb x:0 0 0 2024-09-06T14:44:34.756 INFO:tasks.workunit.client.0.smithi052.stdout:8/91: rename d6/d9/df/d10/c17 to d6/d9/df/d10/d14/c1d 0 2024-09-06T14:44:34.757 INFO:tasks.workunit.client.0.smithi052.stdout:8/92: dread - d6/d9/f18 zero size 2024-09-06T14:44:34.758 INFO:tasks.workunit.client.1.smithi165.stdout:8/733: mkdir d0/d34/d6b/d94/d103 0 2024-09-06T14:44:34.760 INFO:tasks.workunit.client.1.smithi165.stdout:8/734: chown d0/f16 403 1 2024-09-06T14:44:34.760 INFO:tasks.workunit.client.1.smithi165.stdout:6/763: dwrite d29/d39/d5b/d62/d94/fb1 [0,4194304] 0 2024-09-06T14:44:34.761 INFO:tasks.workunit.client.1.smithi165.stdout:3/764: unlink d1/da/dd/f61 0 2024-09-06T14:44:34.762 INFO:tasks.workunit.client.1.smithi165.stdout:9/839: dread db/de/d15/d17/dad/f46 [0,4194304] 0 2024-09-06T14:44:34.763 INFO:tasks.workunit.client.0.smithi052.stdout:0/100: mkdir d0/d18 0 2024-09-06T14:44:34.763 INFO:tasks.workunit.client.1.smithi165.stdout:0/685: creat d15/d19/d28/d4f/da7/fe1 x:0 0 0 2024-09-06T14:44:34.764 INFO:tasks.workunit.client.1.smithi165.stdout:6/764: chown d29/d39/d5b/d62 5649389 1 2024-09-06T14:44:34.765 INFO:tasks.workunit.client.1.smithi165.stdout:8/735: chown d0/d34/d6b/d94/d70/fc0 2439 1 2024-09-06T14:44:34.766 INFO:tasks.workunit.client.1.smithi165.stdout:7/609: dwrite d20/d3b/d69/d88/f4e [0,4194304] 0 2024-09-06T14:44:34.767 INFO:tasks.workunit.client.0.smithi052.stdout:2/99: write da/d19/f1c [6128253,43225] 0 2024-09-06T14:44:34.768 INFO:tasks.workunit.client.1.smithi165.stdout:2/659: fdatasync d9/d25/d45/d75/d34/f6c 0 2024-09-06T14:44:34.773 INFO:tasks.workunit.client.1.smithi165.stdout:2/660: write d9/d25/d46/d7e/d90/fcf [897337,104285] 0 2024-09-06T14:44:34.773 INFO:tasks.workunit.client.0.smithi052.stdout:7/99: creat d11/f23 x:0 0 0 2024-09-06T14:44:34.777 INFO:tasks.workunit.client.1.smithi165.stdout:9/840: dwrite db/de/d15/d7f/d9b/d6c/f75 [0,4194304] 0 2024-09-06T14:44:34.782 INFO:tasks.workunit.client.0.smithi052.stdout:5/40: creat d2/ff x:0 0 0 2024-09-06T14:44:34.782 INFO:tasks.workunit.client.1.smithi165.stdout:4/775: dwrite d5/d1b/d1c/d20/d75/d83/f4d [0,4194304] 0 2024-09-06T14:44:34.783 INFO:tasks.workunit.client.0.smithi052.stdout:5/41: chown d2/la 776359589 1 2024-09-06T14:44:34.785 INFO:tasks.workunit.client.1.smithi165.stdout:6/765: mkdir d29/d39/d5b/d68/dec 0 2024-09-06T14:44:34.785 INFO:tasks.workunit.client.1.smithi165.stdout:6/766: write d29/d32/f85 [1065522,10310] 0 2024-09-06T14:44:34.790 INFO:tasks.workunit.client.1.smithi165.stdout:7/610: mkdir d20/d4d/d54/dc1 0 2024-09-06T14:44:34.795 INFO:tasks.workunit.client.1.smithi165.stdout:2/661: dread d9/d25/f57 [0,4194304] 0 2024-09-06T14:44:34.798 INFO:tasks.workunit.client.1.smithi165.stdout:0/686: rename d15/d19/d50/d53/dbf/lc4 to d15/d19/d50/d53/d57/le2 0 2024-09-06T14:44:34.799 INFO:tasks.workunit.client.0.smithi052.stdout:6/46: dwrite d2/fc [0,4194304] 0 2024-09-06T14:44:34.808 INFO:tasks.workunit.client.1.smithi165.stdout:1/694: sync 2024-09-06T14:44:34.809 INFO:tasks.workunit.client.0.smithi052.stdout:2/100: creat da/db/d18/f28 x:0 0 0 2024-09-06T14:44:34.809 INFO:tasks.workunit.client.1.smithi165.stdout:9/841: mkdir db/d40/d105 0 2024-09-06T14:44:34.809 INFO:tasks.workunit.client.0.smithi052.stdout:7/100: mkdir d11/d1c/d24 0 2024-09-06T14:44:34.810 INFO:tasks.workunit.client.0.smithi052.stdout:2/101: write f0 [1206011,120442] 0 2024-09-06T14:44:34.810 INFO:tasks.workunit.client.0.smithi052.stdout:2/102: stat da/db 0 2024-09-06T14:44:34.810 INFO:tasks.workunit.client.0.smithi052.stdout:7/101: chown d11/c1b 114 1 2024-09-06T14:44:34.812 INFO:tasks.workunit.client.0.smithi052.stdout:2/103: chown da/db/l10 4 1 2024-09-06T14:44:34.813 INFO:tasks.workunit.client.0.smithi052.stdout:2/104: chown da/db/f12 28 1 2024-09-06T14:44:34.814 INFO:tasks.workunit.client.1.smithi165.stdout:1/695: dread d0/d2a/d18/d24/d4b/d93/d68/f88 [0,4194304] 0 2024-09-06T14:44:34.814 INFO:tasks.workunit.client.0.smithi052.stdout:5/42: symlink d2/l10 0 2024-09-06T14:44:34.815 INFO:tasks.workunit.client.1.smithi165.stdout:5/826: link d6/d1c/d28/d2d/d49/c50 d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/c127 0 2024-09-06T14:44:34.815 INFO:tasks.workunit.client.1.smithi165.stdout:5/827: dread - d6/d1c/d28/d2d/dc0/f115 zero size 2024-09-06T14:44:34.816 INFO:tasks.workunit.client.0.smithi052.stdout:5/43: write d2/f6 [4355829,23999] 0 2024-09-06T14:44:34.817 INFO:tasks.workunit.client.1.smithi165.stdout:3/765: write d1/dbd/fe6 [3257624,127049] 0 2024-09-06T14:44:34.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/102: dread f5 [0,4194304] 0 2024-09-06T14:44:34.818 INFO:tasks.workunit.client.1.smithi165.stdout:3/766: write d1/d7c/d7e/dc5/fe7 [352466,61276] 0 2024-09-06T14:44:34.818 INFO:tasks.workunit.client.0.smithi052.stdout:7/103: dread - d11/f21 zero size 2024-09-06T14:44:34.819 INFO:tasks.workunit.client.1.smithi165.stdout:5/828: dread d6/f24 [0,4194304] 0 2024-09-06T14:44:34.821 INFO:tasks.workunit.client.0.smithi052.stdout:7/104: read d11/f14 [2658783,30515] 0 2024-09-06T14:44:34.823 INFO:tasks.workunit.client.0.smithi052.stdout:2/105: dwrite da/f1b [4194304,4194304] 0 2024-09-06T14:44:34.823 INFO:tasks.workunit.client.0.smithi052.stdout:8/93: link d6/f11 d6/d16/f1e 0 2024-09-06T14:44:34.825 INFO:tasks.workunit.client.1.smithi165.stdout:7/611: symlink d20/d3b/d69/lc2 0 2024-09-06T14:44:34.827 INFO:tasks.workunit.client.0.smithi052.stdout:2/106: write da/db/d18/f28 [404983,118976] 0 2024-09-06T14:44:34.827 INFO:tasks.workunit.client.1.smithi165.stdout:6/767: write d29/d32/fb5 [5237242,113003] 0 2024-09-06T14:44:34.829 INFO:tasks.workunit.client.0.smithi052.stdout:4/100: getdents d9/d10/d17 0 2024-09-06T14:44:34.830 INFO:tasks.workunit.client.1.smithi165.stdout:6/768: truncate d29/d32/d7a/fb6 762891 0 2024-09-06T14:44:34.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/101: mkdir d0/d19 0 2024-09-06T14:44:34.831 INFO:tasks.workunit.client.0.smithi052.stdout:5/44: dwrite d2/f3 [0,4194304] 0 2024-09-06T14:44:34.831 INFO:tasks.workunit.client.1.smithi165.stdout:6/769: chown d29/d6a/d71 173289 1 2024-09-06T14:44:34.833 INFO:tasks.workunit.client.1.smithi165.stdout:7/612: dwrite d20/d3b/d69/d88/d30/d78/f84 [0,4194304] 0 2024-09-06T14:44:34.836 INFO:tasks.workunit.client.0.smithi052.stdout:5/45: dread d2/f7 [0,4194304] 0 2024-09-06T14:44:34.836 INFO:tasks.workunit.client.1.smithi165.stdout:8/736: link d0/d34/d6b/d94/d70/f88 d0/d14/d3e/db4/f104 0 2024-09-06T14:44:34.837 INFO:tasks.workunit.client.0.smithi052.stdout:4/101: dread f7 [0,4194304] 0 2024-09-06T14:44:34.837 INFO:tasks.workunit.client.1.smithi165.stdout:8/737: fsync d0/d5e/d65/f99 0 2024-09-06T14:44:34.838 INFO:tasks.workunit.client.1.smithi165.stdout:8/738: chown d0/d19/d36/d2d/d3f/ff0 4677534 1 2024-09-06T14:44:34.838 INFO:tasks.workunit.client.0.smithi052.stdout:5/46: write d2/f3 [2010969,110998] 0 2024-09-06T14:44:34.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/161: getdents d0/d11 0 2024-09-06T14:44:34.844 INFO:tasks.workunit.client.0.smithi052.stdout:3/162: stat d0/d11/d12/d18/f25 0 2024-09-06T14:44:34.845 INFO:tasks.workunit.client.0.smithi052.stdout:1/105: write d1/f4 [548686,40679] 0 2024-09-06T14:44:34.846 INFO:tasks.workunit.client.1.smithi165.stdout:9/842: write db/de/d15/d7f/dbc/ddf/fa6 [1220477,106952] 0 2024-09-06T14:44:34.847 INFO:tasks.workunit.client.0.smithi052.stdout:1/106: chown d1/da/ff 1 1 2024-09-06T14:44:34.848 INFO:tasks.workunit.client.1.smithi165.stdout:1/696: mknod d0/d2a/d18/d24/d4b/d93/d68/d75/cdd 0 2024-09-06T14:44:34.850 INFO:tasks.workunit.client.1.smithi165.stdout:2/662: dwrite d9/f84 [0,4194304] 0 2024-09-06T14:44:34.851 INFO:tasks.workunit.client.1.smithi165.stdout:2/663: readlink d9/d25/d45/d75/d67/d76/l98 0 2024-09-06T14:44:34.852 INFO:tasks.workunit.client.1.smithi165.stdout:2/664: stat d9/d88/db8 0 2024-09-06T14:44:34.852 INFO:tasks.workunit.client.1.smithi165.stdout:4/776: mknod d5/d1b/d1c/c10b 0 2024-09-06T14:44:34.853 INFO:tasks.workunit.client.0.smithi052.stdout:3/163: dwrite d0/fe [0,4194304] 0 2024-09-06T14:44:34.855 INFO:tasks.workunit.client.1.smithi165.stdout:3/767: fsync d1/da/dc/d10/f35 0 2024-09-06T14:44:34.856 INFO:tasks.workunit.client.1.smithi165.stdout:3/768: stat d1/da/dd/c1d 0 2024-09-06T14:44:34.861 INFO:tasks.workunit.client.0.smithi052.stdout:2/107: creat da/d19/f29 x:0 0 0 2024-09-06T14:44:34.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/108: chown da/l17 136784004 1 2024-09-06T14:44:34.864 INFO:tasks.workunit.client.1.smithi165.stdout:5/829: rename d6/d1c/d28/ff2 to d6/d1c/d28/d4b/da7/dab/f128 0 2024-09-06T14:44:34.864 INFO:tasks.workunit.client.0.smithi052.stdout:8/94: write d6/f11 [938702,92243] 0 2024-09-06T14:44:34.865 INFO:tasks.workunit.client.0.smithi052.stdout:0/102: stat d0/c7 0 2024-09-06T14:44:34.865 INFO:tasks.workunit.client.0.smithi052.stdout:8/95: chown l0 1357 1 2024-09-06T14:44:34.866 INFO:tasks.workunit.client.0.smithi052.stdout:6/47: truncate d2/fc 3421592 0 2024-09-06T14:44:34.871 INFO:tasks.workunit.client.0.smithi052.stdout:5/47: rmdir d2 39 2024-09-06T14:44:34.873 INFO:tasks.workunit.client.0.smithi052.stdout:4/102: mknod d9/d10/d19/c27 0 2024-09-06T14:44:34.876 INFO:tasks.workunit.client.0.smithi052.stdout:4/103: dread - d9/d10/f22 zero size 2024-09-06T14:44:34.877 INFO:tasks.workunit.client.0.smithi052.stdout:8/96: fsync d6/d16/f1e 0 2024-09-06T14:44:34.877 INFO:tasks.workunit.client.0.smithi052.stdout:8/97: chown d6/d9/lb 213752 1 2024-09-06T14:44:34.878 INFO:tasks.workunit.client.1.smithi165.stdout:0/687: truncate d15/d19/d50/d53/d57/f78 2820103 0 2024-09-06T14:44:34.878 INFO:tasks.workunit.client.1.smithi165.stdout:0/688: chown fb 7553 1 2024-09-06T14:44:34.878 INFO:tasks.workunit.client.0.smithi052.stdout:5/48: dwrite f1 [0,4194304] 0 2024-09-06T14:44:34.879 INFO:tasks.workunit.client.1.smithi165.stdout:7/613: symlink d20/d65/d82/d97/lc3 0 2024-09-06T14:44:34.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/105: creat d11/d1c/d24/f25 x:0 0 0 2024-09-06T14:44:34.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/106: dread - d11/f23 zero size 2024-09-06T14:44:34.884 INFO:tasks.workunit.client.1.smithi165.stdout:8/739: rmdir d0/d19/d36/d28/dda 39 2024-09-06T14:44:34.885 INFO:tasks.workunit.client.1.smithi165.stdout:7/614: dwrite f8 [4194304,4194304] 0 2024-09-06T14:44:34.887 INFO:tasks.workunit.client.0.smithi052.stdout:1/107: rename d1/f8 to d1/da/f19 0 2024-09-06T14:44:34.888 INFO:tasks.workunit.client.0.smithi052.stdout:1/108: truncate d1/f4 771101 0 2024-09-06T14:44:34.893 INFO:tasks.workunit.client.1.smithi165.stdout:1/697: chown d0/d2a/fb 1975839 1 2024-09-06T14:44:34.895 INFO:tasks.workunit.client.0.smithi052.stdout:6/48: mkdir d2/dd 0 2024-09-06T14:44:34.896 INFO:tasks.workunit.client.1.smithi165.stdout:2/665: creat d9/d88/dac/da4/fda x:0 0 0 2024-09-06T14:44:34.899 INFO:tasks.workunit.client.0.smithi052.stdout:4/104: creat d9/d10/d19/f28 x:0 0 0 2024-09-06T14:44:34.904 INFO:tasks.workunit.client.0.smithi052.stdout:7/107: mkdir d11/d1c/d26 0 2024-09-06T14:44:34.904 INFO:tasks.workunit.client.0.smithi052.stdout:7/108: chown d11/c16 5841044 1 2024-09-06T14:44:34.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/109: dread - d11/f23 zero size 2024-09-06T14:44:34.906 INFO:tasks.workunit.client.1.smithi165.stdout:5/830: unlink d6/d1c/f1f 0 2024-09-06T14:44:34.906 INFO:tasks.workunit.client.1.smithi165.stdout:5/831: write d6/d1c/f9c [1920108,19002] 0 2024-09-06T14:44:34.913 INFO:tasks.workunit.client.1.smithi165.stdout:8/740: read - d0/d34/d6b/d94/f59 zero size 2024-09-06T14:44:34.914 INFO:tasks.workunit.client.0.smithi052.stdout:2/109: mkdir da/d19/d20/d2a 0 2024-09-06T14:44:34.915 INFO:tasks.workunit.client.1.smithi165.stdout:4/777: dwrite d5/d1b/d1c/f60 [0,4194304] 0 2024-09-06T14:44:34.915 INFO:tasks.workunit.client.1.smithi165.stdout:4/778: write d5/f86 [250247,1660] 0 2024-09-06T14:44:34.919 INFO:tasks.workunit.client.0.smithi052.stdout:4/105: creat d9/d10/d19/f29 x:0 0 0 2024-09-06T14:44:34.922 INFO:tasks.workunit.client.0.smithi052.stdout:6/49: read d2/fc [2902661,61610] 0 2024-09-06T14:44:34.923 INFO:tasks.workunit.client.0.smithi052.stdout:1/109: dwrite d1/da/fc [0,4194304] 0 2024-09-06T14:44:34.923 INFO:tasks.workunit.client.1.smithi165.stdout:0/689: dwrite d15/d19/d2c/f36 [0,4194304] 0 2024-09-06T14:44:34.928 INFO:tasks.workunit.client.0.smithi052.stdout:5/49: creat d2/f11 x:0 0 0 2024-09-06T14:44:34.931 INFO:tasks.workunit.client.0.smithi052.stdout:4/106: dwrite d9/d10/f1f [0,4194304] 0 2024-09-06T14:44:34.935 INFO:tasks.workunit.client.1.smithi165.stdout:5/832: mknod d6/d1c/d28/d4b/d55/d8a/dda/c129 0 2024-09-06T14:44:34.935 INFO:tasks.workunit.client.0.smithi052.stdout:7/110: creat d11/d1c/f27 x:0 0 0 2024-09-06T14:44:34.936 INFO:tasks.workunit.client.1.smithi165.stdout:5/833: read - d6/d1c/d28/d4b/d55/f8c zero size 2024-09-06T14:44:34.936 INFO:tasks.workunit.client.0.smithi052.stdout:7/111: stat c8 0 2024-09-06T14:44:34.937 INFO:tasks.workunit.client.1.smithi165.stdout:5/834: truncate d6/dc1/fcf 171041 0 2024-09-06T14:44:34.937 INFO:tasks.workunit.client.0.smithi052.stdout:4/107: readlink d9/d10/d17/l24 0 2024-09-06T14:44:34.937 INFO:tasks.workunit.client.0.smithi052.stdout:8/98: truncate f1 4536821 0 2024-09-06T14:44:34.938 INFO:tasks.workunit.client.1.smithi165.stdout:5/835: stat d6/d1c/d28/d4b/d55/d8a/de1/f78 0 2024-09-06T14:44:34.938 INFO:tasks.workunit.client.0.smithi052.stdout:2/110: unlink l5 0 2024-09-06T14:44:34.939 INFO:tasks.workunit.client.0.smithi052.stdout:5/50: dread d2/f7 [0,4194304] 0 2024-09-06T14:44:34.940 INFO:tasks.workunit.client.0.smithi052.stdout:8/99: write d6/d9/f18 [719291,87728] 0 2024-09-06T14:44:34.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/108: write d9/d10/d17/f1c [811948,130305] 0 2024-09-06T14:44:34.941 INFO:tasks.workunit.client.0.smithi052.stdout:2/111: write da/f11 [2925895,128110] 0 2024-09-06T14:44:34.942 INFO:tasks.workunit.client.0.smithi052.stdout:4/109: write d9/d10/d19/f29 [643415,42429] 0 2024-09-06T14:44:34.943 INFO:tasks.workunit.client.1.smithi165.stdout:8/741: fdatasync d0/d5e/d65/fd7 0 2024-09-06T14:44:34.944 INFO:tasks.workunit.client.0.smithi052.stdout:6/50: rename c1 to d2/dd/ce 0 2024-09-06T14:44:34.946 INFO:tasks.workunit.client.1.smithi165.stdout:5/836: dwrite d6/d1c/d28/d4b/d55/fbe [4194304,4194304] 0 2024-09-06T14:44:34.947 INFO:tasks.workunit.client.0.smithi052.stdout:3/164: getdents d0/d11/d12 0 2024-09-06T14:44:34.947 INFO:tasks.workunit.client.1.smithi165.stdout:9/843: creat db/de/d15/f106 x:0 0 0 2024-09-06T14:44:34.950 INFO:tasks.workunit.client.0.smithi052.stdout:4/110: dread d9/d10/d19/f29 [0,4194304] 0 2024-09-06T14:44:34.951 INFO:tasks.workunit.client.1.smithi165.stdout:6/770: sync 2024-09-06T14:44:34.952 INFO:tasks.workunit.client.1.smithi165.stdout:4/779: rename d5/d1b/d61/d77/d7c/daa/lbc to d5/d1b/d1c/d41/l10c 0 2024-09-06T14:44:34.953 INFO:tasks.workunit.client.1.smithi165.stdout:4/780: dread - d5/d1b/d1c/d20/d75/d83/fb1 zero size 2024-09-06T14:44:34.955 INFO:tasks.workunit.client.1.smithi165.stdout:4/781: write d5/d1b/d1c/d78/f92 [1930507,130469] 0 2024-09-06T14:44:34.957 INFO:tasks.workunit.client.1.smithi165.stdout:9/844: dread db/de/d15/d17/d86/feb [0,4194304] 0 2024-09-06T14:44:34.958 INFO:tasks.workunit.client.1.smithi165.stdout:9/845: stat db/de/d15/d74/fb0 0 2024-09-06T14:44:34.959 INFO:tasks.workunit.client.1.smithi165.stdout:4/782: read d5/d1b/d61/dd7/ddf/dd4/fda [2860922,95794] 0 2024-09-06T14:44:34.960 INFO:tasks.workunit.client.1.smithi165.stdout:6/771: dwrite d29/d39/d5b/d62/d67/f8e [0,4194304] 0 2024-09-06T14:44:34.960 INFO:tasks.workunit.client.0.smithi052.stdout:4/111: dwrite d9/d10/d17/f1c [0,4194304] 0 2024-09-06T14:44:34.965 INFO:tasks.workunit.client.0.smithi052.stdout:5/51: rename d2/f3 to d2/f12 0 2024-09-06T14:44:34.970 INFO:tasks.workunit.client.0.smithi052.stdout:2/112: rmdir da 39 2024-09-06T14:44:34.974 INFO:tasks.workunit.client.1.smithi165.stdout:1/698: write d0/d2a/d18/d24/d4b/d93/d2b/f50 [1544884,25216] 0 2024-09-06T14:44:34.976 INFO:tasks.workunit.client.1.smithi165.stdout:5/837: rmdir d6/d1c/d28/d2d/d49 39 2024-09-06T14:44:34.979 INFO:tasks.workunit.client.0.smithi052.stdout:8/100: rename d6/d9/df/d10 to d6/d9/d1f 0 2024-09-06T14:44:34.980 INFO:tasks.workunit.client.0.smithi052.stdout:6/51: mknod d2/cf 0 2024-09-06T14:44:34.982 INFO:tasks.workunit.client.1.smithi165.stdout:5/838: dwrite d6/d1c/d28/d2d/d61/ddc/fdd [0,4194304] 0 2024-09-06T14:44:34.982 INFO:tasks.workunit.client.0.smithi052.stdout:3/165: creat d0/d11/d12/d18/f28 x:0 0 0 2024-09-06T14:44:34.984 INFO:tasks.workunit.client.0.smithi052.stdout:1/110: truncate d1/db/fd 3416734 0 2024-09-06T14:44:34.987 INFO:tasks.workunit.client.0.smithi052.stdout:4/112: creat d9/d10/d17/f2a x:0 0 0 2024-09-06T14:44:34.989 INFO:tasks.workunit.client.1.smithi165.stdout:4/783: fdatasync d5/d1b/d61/dd7/ddf/f84 0 2024-09-06T14:44:34.990 INFO:tasks.workunit.client.0.smithi052.stdout:5/52: rmdir d2 39 2024-09-06T14:44:34.990 INFO:tasks.workunit.client.1.smithi165.stdout:4/784: write d5/d1b/d1c/d41/fb4 [638750,53934] 0 2024-09-06T14:44:34.999 INFO:tasks.workunit.client.1.smithi165.stdout:9/846: dwrite db/de/d15/d17/d18/d7d/f5f [0,4194304] 0 2024-09-06T14:44:35.000 INFO:tasks.workunit.client.0.smithi052.stdout:8/101: rename d6/f11 to d6/d9/d1f/d14/f20 0 2024-09-06T14:44:35.000 INFO:tasks.workunit.client.0.smithi052.stdout:2/113: rename da/db to da/db/d18/d2b 22 2024-09-06T14:44:35.002 INFO:tasks.workunit.client.0.smithi052.stdout:6/52: creat d2/dd/f10 x:0 0 0 2024-09-06T14:44:35.002 INFO:tasks.workunit.client.0.smithi052.stdout:6/53: readlink d2/la 0 2024-09-06T14:44:35.003 INFO:tasks.workunit.client.1.smithi165.stdout:8/742: rename d0/d19/d36/l10 to d0/d5e/l105 0 2024-09-06T14:44:35.004 INFO:tasks.workunit.client.1.smithi165.stdout:8/743: chown d0/f2f 75176685 1 2024-09-06T14:44:35.004 INFO:tasks.workunit.client.0.smithi052.stdout:3/166: mkdir d0/d11/d29 0 2024-09-06T14:44:35.005 INFO:tasks.workunit.client.1.smithi165.stdout:8/744: fdatasync d0/d19/d7f/fe6 0 2024-09-06T14:44:35.006 INFO:tasks.workunit.client.1.smithi165.stdout:8/745: write d0/d14/d3e/f47 [4453981,33249] 0 2024-09-06T14:44:35.006 INFO:tasks.workunit.client.1.smithi165.stdout:1/699: write d0/d2a/d18/d24/d4b/d5f/f60 [4793020,28771] 0 2024-09-06T14:44:35.007 INFO:tasks.workunit.client.0.smithi052.stdout:2/114: dwrite da/db/f12 [0,4194304] 0 2024-09-06T14:44:35.007 INFO:tasks.workunit.client.0.smithi052.stdout:4/113: chown c1 424161 1 2024-09-06T14:44:35.008 INFO:tasks.workunit.client.1.smithi165.stdout:3/769: sync 2024-09-06T14:44:35.008 INFO:tasks.workunit.client.1.smithi165.stdout:8/746: write d0/d19/f95 [1499159,20546] 0 2024-09-06T14:44:35.008 INFO:tasks.workunit.client.1.smithi165.stdout:6/772: creat d29/d39/d5b/d68/db3/fed x:0 0 0 2024-09-06T14:44:35.010 INFO:tasks.workunit.client.1.smithi165.stdout:3/770: write d1/da/dc/d10/fcb [633865,63675] 0 2024-09-06T14:44:35.011 INFO:tasks.workunit.client.1.smithi165.stdout:2/666: getdents d9/d88/dac 0 2024-09-06T14:44:35.014 INFO:tasks.workunit.client.1.smithi165.stdout:2/667: fdatasync d9/d25/d46/d7e/d90/fcf 0 2024-09-06T14:44:35.014 INFO:tasks.workunit.client.0.smithi052.stdout:6/54: creat d2/f11 x:0 0 0 2024-09-06T14:44:35.015 INFO:tasks.workunit.client.1.smithi165.stdout:2/668: stat d9/d3b/d78/f79 0 2024-09-06T14:44:35.015 INFO:tasks.workunit.client.0.smithi052.stdout:4/114: dwrite f2 [0,4194304] 0 2024-09-06T14:44:35.017 INFO:tasks.workunit.client.0.smithi052.stdout:8/102: dread f1 [0,4194304] 0 2024-09-06T14:44:35.018 INFO:tasks.workunit.client.1.smithi165.stdout:6/773: dwrite d29/d39/d5b/d62/d94/db7/dba/fc9 [0,4194304] 0 2024-09-06T14:44:35.020 INFO:tasks.workunit.client.1.smithi165.stdout:5/839: mknod d6/d1c/d28/d2d/d49/de9/c12a 0 2024-09-06T14:44:35.020 INFO:tasks.workunit.client.0.smithi052.stdout:5/53: creat d2/f13 x:0 0 0 2024-09-06T14:44:35.022 INFO:tasks.workunit.client.0.smithi052.stdout:5/54: write d2/fd [213006,109412] 0 2024-09-06T14:44:35.026 INFO:tasks.workunit.client.0.smithi052.stdout:2/115: dwrite da/f23 [0,4194304] 0 2024-09-06T14:44:35.028 INFO:tasks.workunit.client.0.smithi052.stdout:2/116: fdatasync da/f1b 0 2024-09-06T14:44:35.030 INFO:tasks.workunit.client.0.smithi052.stdout:6/55: creat d2/f12 x:0 0 0 2024-09-06T14:44:35.034 INFO:tasks.workunit.client.1.smithi165.stdout:0/690: getdents d15/d19/d50/d53/d7c/d9a 0 2024-09-06T14:44:35.034 INFO:tasks.workunit.client.0.smithi052.stdout:4/115: rmdir d9/d10/d17 39 2024-09-06T14:44:35.037 INFO:tasks.workunit.client.0.smithi052.stdout:8/103: mkdir d6/d9/d21 0 2024-09-06T14:44:35.039 INFO:tasks.workunit.client.1.smithi165.stdout:3/771: creat d1/da/dd/d8c/f102 x:0 0 0 2024-09-06T14:44:35.040 INFO:tasks.workunit.client.1.smithi165.stdout:9/847: write db/de/d15/fc9 [43960,32265] 0 2024-09-06T14:44:35.042 INFO:tasks.workunit.client.0.smithi052.stdout:8/104: dread d6/d16/f1e [0,4194304] 0 2024-09-06T14:44:35.044 INFO:tasks.workunit.client.0.smithi052.stdout:2/117: creat da/d19/f2c x:0 0 0 2024-09-06T14:44:35.046 INFO:tasks.workunit.client.0.smithi052.stdout:6/56: unlink d2/cf 0 2024-09-06T14:44:35.047 INFO:tasks.workunit.client.0.smithi052.stdout:6/57: truncate d2/dd/f10 870195 0 2024-09-06T14:44:35.047 INFO:tasks.workunit.client.0.smithi052.stdout:3/167: truncate d0/f3 3282629 0 2024-09-06T14:44:35.048 INFO:tasks.workunit.client.0.smithi052.stdout:6/58: readlink d2/la 0 2024-09-06T14:44:35.049 INFO:tasks.workunit.client.1.smithi165.stdout:6/774: mkdir d29/d32/dee 0 2024-09-06T14:44:35.050 INFO:tasks.workunit.client.0.smithi052.stdout:1/111: write d1/db/fd [4093356,111081] 0 2024-09-06T14:44:35.056 INFO:tasks.workunit.client.0.smithi052.stdout:2/118: mkdir da/d2d 0 2024-09-06T14:44:35.056 INFO:tasks.workunit.client.0.smithi052.stdout:2/119: write da/d19/f1c [6416235,80332] 0 2024-09-06T14:44:35.056 INFO:tasks.workunit.client.0.smithi052.stdout:4/116: symlink d9/d10/l2b 0 2024-09-06T14:44:35.058 INFO:tasks.workunit.client.1.smithi165.stdout:6/775: dwrite d29/d32/d7a/fb6 [0,4194304] 0 2024-09-06T14:44:35.058 INFO:tasks.workunit.client.1.smithi165.stdout:3/772: dread d1/da/dc/d3b/d83/fba [0,4194304] 0 2024-09-06T14:44:35.058 INFO:tasks.workunit.client.1.smithi165.stdout:0/691: symlink d15/d19/d28/d9e/le3 0 2024-09-06T14:44:35.058 INFO:tasks.workunit.client.1.smithi165.stdout:7/615: sync 2024-09-06T14:44:35.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/59: mknod d2/c13 0 2024-09-06T14:44:35.060 INFO:tasks.workunit.client.1.smithi165.stdout:7/616: chown d20/d3b/d69/d88/d30/fbc 33671 1 2024-09-06T14:44:35.061 INFO:tasks.workunit.client.0.smithi052.stdout:6/60: fsync d2/f12 0 2024-09-06T14:44:35.063 INFO:tasks.workunit.client.1.smithi165.stdout:7/617: write d20/d4d/d54/fb7 [424498,87298] 0 2024-09-06T14:44:35.064 INFO:tasks.workunit.client.0.smithi052.stdout:3/168: creat d0/d11/d12/d18/f2a x:0 0 0 2024-09-06T14:44:35.064 INFO:tasks.workunit.client.0.smithi052.stdout:8/105: write f1 [204076,37381] 0 2024-09-06T14:44:35.064 INFO:tasks.workunit.client.1.smithi165.stdout:7/618: readlink d20/d33/l43 0 2024-09-06T14:44:35.064 INFO:tasks.workunit.client.1.smithi165.stdout:3/773: dwrite d1/da/dc/f5c [0,4194304] 0 2024-09-06T14:44:35.065 INFO:tasks.workunit.client.1.smithi165.stdout:9/848: creat db/de/d15/d7f/d9b/de7/f107 x:0 0 0 2024-09-06T14:44:35.065 INFO:tasks.workunit.client.0.smithi052.stdout:4/117: dwrite d9/d10/f22 [0,4194304] 0 2024-09-06T14:44:35.066 INFO:tasks.workunit.client.1.smithi165.stdout:9/849: write db/de/d15/f48 [1452982,115224] 0 2024-09-06T14:44:35.068 INFO:tasks.workunit.client.1.smithi165.stdout:4/785: rename d5/d1b/d1c/l37 to d5/d1b/d1c/d78/l10d 0 2024-09-06T14:44:35.071 INFO:tasks.workunit.client.0.smithi052.stdout:1/112: mknod d1/da/c1a 0 2024-09-06T14:44:35.072 INFO:tasks.workunit.client.1.smithi165.stdout:2/669: mkdir d9/d25/d46/d7e/d90/dd8/ddb 0 2024-09-06T14:44:35.072 INFO:tasks.workunit.client.1.smithi165.stdout:7/619: dread d20/d4d/d54/fb7 [0,4194304] 0 2024-09-06T14:44:35.073 INFO:tasks.workunit.client.1.smithi165.stdout:7/620: chown d20/d40/l68 0 1 2024-09-06T14:44:35.076 INFO:tasks.workunit.client.0.smithi052.stdout:2/120: unlink da/l22 0 2024-09-06T14:44:35.079 INFO:tasks.workunit.client.0.smithi052.stdout:6/61: mkdir d2/d14 0 2024-09-06T14:44:35.080 INFO:tasks.workunit.client.0.smithi052.stdout:3/169: creat d0/d11/d12/d18/f2b x:0 0 0 2024-09-06T14:44:35.081 INFO:tasks.workunit.client.0.smithi052.stdout:2/121: dread da/f1b [0,4194304] 0 2024-09-06T14:44:35.081 INFO:tasks.workunit.client.1.smithi165.stdout:6/776: mknod d29/d6a/d83/cef 0 2024-09-06T14:44:35.082 INFO:tasks.workunit.client.0.smithi052.stdout:8/106: write d6/d9/d1f/d14/f20 [39490,91583] 0 2024-09-06T14:44:35.084 INFO:tasks.workunit.client.0.smithi052.stdout:4/118: rename d9/d10/d19/f1e to d9/d10/d19/f2c 0 2024-09-06T14:44:35.085 INFO:tasks.workunit.client.0.smithi052.stdout:2/122: dread da/f1b [0,4194304] 0 2024-09-06T14:44:35.086 INFO:tasks.workunit.client.0.smithi052.stdout:1/113: mknod d1/db/c1b 0 2024-09-06T14:44:35.087 INFO:tasks.workunit.client.1.smithi165.stdout:6/777: dwrite d29/d93/fb0 [0,4194304] 0 2024-09-06T14:44:35.090 INFO:tasks.workunit.client.0.smithi052.stdout:6/62: fdatasync d2/fb 0 2024-09-06T14:44:35.091 INFO:tasks.workunit.client.0.smithi052.stdout:6/63: rename d2 to d2/d14/d15 22 2024-09-06T14:44:35.091 INFO:tasks.workunit.client.1.smithi165.stdout:6/778: dread d29/d32/d7a/fb6 [0,4194304] 0 2024-09-06T14:44:35.092 INFO:tasks.workunit.client.0.smithi052.stdout:3/170: rmdir d0 39 2024-09-06T14:44:35.092 INFO:tasks.workunit.client.0.smithi052.stdout:6/64: dread d2/dd/f10 [0,4194304] 0 2024-09-06T14:44:35.093 INFO:tasks.workunit.client.1.smithi165.stdout:2/670: dread d9/d23/f28 [0,4194304] 0 2024-09-06T14:44:35.097 INFO:tasks.workunit.client.1.smithi165.stdout:8/747: rename d0/d19/d36/d2d/d33/d3a/d46/f7e to d0/d19/d36/d28/d64/f106 0 2024-09-06T14:44:35.097 INFO:tasks.workunit.client.1.smithi165.stdout:2/671: read d9/d88/dac/da4/fd7 [3268993,25794] 0 2024-09-06T14:44:35.098 INFO:tasks.workunit.client.0.smithi052.stdout:8/107: mkdir d6/d22 0 2024-09-06T14:44:35.098 INFO:tasks.workunit.client.1.smithi165.stdout:9/850: symlink db/de/d15/d17/d18/d7d/d61/l108 0 2024-09-06T14:44:35.099 INFO:tasks.workunit.client.1.smithi165.stdout:6/779: dwrite d29/d39/d5b/d68/db3/fed [0,4194304] 0 2024-09-06T14:44:35.100 INFO:tasks.workunit.client.1.smithi165.stdout:8/748: chown d0/d19/d36/d2d/d33/d3a/d46/ffa 8 1 2024-09-06T14:44:35.104 INFO:tasks.workunit.client.1.smithi165.stdout:6/780: write d29/d39/d5b/d68/f91 [963409,113337] 0 2024-09-06T14:44:35.104 INFO:tasks.workunit.client.1.smithi165.stdout:1/700: getdents d0/d1c/d1d 0 2024-09-06T14:44:35.105 INFO:tasks.workunit.client.1.smithi165.stdout:6/781: dread - d29/d39/d5b/d62/d67/fe5 zero size 2024-09-06T14:44:35.109 INFO:tasks.workunit.client.1.smithi165.stdout:0/692: mkdir d15/d19/d50/d53/d7c/de4 0 2024-09-06T14:44:35.109 INFO:tasks.workunit.client.1.smithi165.stdout:0/693: stat d15/d19/d50/d53/dbf/ldc 0 2024-09-06T14:44:35.110 INFO:tasks.workunit.client.0.smithi052.stdout:6/65: symlink d2/dd/l16 0 2024-09-06T14:44:35.110 INFO:tasks.workunit.client.0.smithi052.stdout:3/171: dread d0/f1a [0,4194304] 0 2024-09-06T14:44:35.111 INFO:tasks.workunit.client.0.smithi052.stdout:3/172: fsync d0/d11/d15/d1b/f27 0 2024-09-06T14:44:35.113 INFO:tasks.workunit.client.0.smithi052.stdout:3/173: fdatasync d0/d11/d15/d1b/f27 0 2024-09-06T14:44:35.114 INFO:tasks.workunit.client.0.smithi052.stdout:8/108: symlink d6/d9/l23 0 2024-09-06T14:44:35.115 INFO:tasks.workunit.client.0.smithi052.stdout:8/109: truncate f1 4887256 0 2024-09-06T14:44:35.115 INFO:tasks.workunit.client.0.smithi052.stdout:4/119: mkdir d9/d2d 0 2024-09-06T14:44:35.116 INFO:tasks.workunit.client.0.smithi052.stdout:3/174: dread d0/f21 [0,4194304] 0 2024-09-06T14:44:35.116 INFO:tasks.workunit.client.1.smithi165.stdout:3/774: getdents d1/d19/d92/de0 0 2024-09-06T14:44:35.116 INFO:tasks.workunit.client.0.smithi052.stdout:3/175: fdatasync d0/fe 0 2024-09-06T14:44:35.117 INFO:tasks.workunit.client.0.smithi052.stdout:3/176: fsync d0/ff 0 2024-09-06T14:44:35.118 INFO:tasks.workunit.client.0.smithi052.stdout:2/123: symlink da/d2d/l2e 0 2024-09-06T14:44:35.119 INFO:tasks.workunit.client.0.smithi052.stdout:2/124: chown c4 0 1 2024-09-06T14:44:35.121 INFO:tasks.workunit.client.0.smithi052.stdout:1/114: write d1/f9 [3234181,92325] 0 2024-09-06T14:44:35.121 INFO:tasks.workunit.client.1.smithi165.stdout:2/672: dread d9/d25/d45/d75/d67/d76/f77 [0,4194304] 0 2024-09-06T14:44:35.123 INFO:tasks.workunit.client.0.smithi052.stdout:1/115: fsync d1/da/fc 0 2024-09-06T14:44:35.125 INFO:tasks.workunit.client.0.smithi052.stdout:1/116: fdatasync d1/da/ff 0 2024-09-06T14:44:35.125 INFO:tasks.workunit.client.0.smithi052.stdout:6/66: unlink d2/f11 0 2024-09-06T14:44:35.126 INFO:tasks.workunit.client.0.smithi052.stdout:3/177: dwrite d0/f9 [4194304,4194304] 0 2024-09-06T14:44:35.127 INFO:tasks.workunit.client.0.smithi052.stdout:1/117: readlink d1/da/l15 0 2024-09-06T14:44:35.127 INFO:tasks.workunit.client.0.smithi052.stdout:1/118: fsync d1/da/fc 0 2024-09-06T14:44:35.128 INFO:tasks.workunit.client.1.smithi165.stdout:9/851: fsync f4 0 2024-09-06T14:44:35.128 INFO:tasks.workunit.client.0.smithi052.stdout:1/119: dread - d1/db/f13 zero size 2024-09-06T14:44:35.130 INFO:tasks.workunit.client.1.smithi165.stdout:7/621: fsync d20/d65/f61 0 2024-09-06T14:44:35.130 INFO:tasks.workunit.client.1.smithi165.stdout:7/622: readlink d20/d33/l71 0 2024-09-06T14:44:35.130 INFO:tasks.workunit.client.1.smithi165.stdout:7/623: chown d20/d3b/d69/da3 1687 1 2024-09-06T14:44:35.131 INFO:tasks.workunit.client.1.smithi165.stdout:7/624: chown d20/d4d/l6e 480639 1 2024-09-06T14:44:35.132 INFO:tasks.workunit.client.1.smithi165.stdout:5/840: getdents d6/d1c/d28/d4b/da7 0 2024-09-06T14:44:35.137 INFO:tasks.workunit.client.0.smithi052.stdout:1/120: dwrite d1/db/f13 [0,4194304] 0 2024-09-06T14:44:35.140 INFO:tasks.workunit.client.0.smithi052.stdout:2/125: rename da/db/d18/f28 to da/f2f 0 2024-09-06T14:44:35.147 INFO:tasks.workunit.client.0.smithi052.stdout:6/67: creat d2/f17 x:0 0 0 2024-09-06T14:44:35.147 INFO:tasks.workunit.client.0.smithi052.stdout:3/178: chown d0/c8 687 1 2024-09-06T14:44:35.150 INFO:tasks.workunit.client.1.smithi165.stdout:0/694: dwrite d15/d19/d50/d53/d7c/fdd [0,4194304] 0 2024-09-06T14:44:35.152 INFO:tasks.workunit.client.0.smithi052.stdout:8/110: mknod d6/d9/d1f/d19/c24 0 2024-09-06T14:44:35.154 INFO:tasks.workunit.client.0.smithi052.stdout:8/111: truncate d6/d9/f18 1571911 0 2024-09-06T14:44:35.154 INFO:tasks.workunit.client.1.smithi165.stdout:5/841: creat d6/d1c/d64/f12b x:0 0 0 2024-09-06T14:44:35.155 INFO:tasks.workunit.client.1.smithi165.stdout:7/625: dread d20/d33/d53/f7f [0,4194304] 0 2024-09-06T14:44:35.156 INFO:tasks.workunit.client.0.smithi052.stdout:6/68: dwrite d2/fb [0,4194304] 0 2024-09-06T14:44:35.157 INFO:tasks.workunit.client.0.smithi052.stdout:6/69: chown d2/la 181200 1 2024-09-06T14:44:35.157 INFO:tasks.workunit.client.0.smithi052.stdout:6/70: fdatasync d2/f12 0 2024-09-06T14:44:35.158 INFO:tasks.workunit.client.1.smithi165.stdout:0/695: dwrite d15/d19/d28/f42 [0,4194304] 0 2024-09-06T14:44:35.159 INFO:tasks.workunit.client.1.smithi165.stdout:0/696: write d15/f37 [413140,57342] 0 2024-09-06T14:44:35.162 INFO:tasks.workunit.client.1.smithi165.stdout:1/701: mkdir d0/d2a/d18/dde 0 2024-09-06T14:44:35.163 INFO:tasks.workunit.client.0.smithi052.stdout:2/126: symlink da/d19/d20/l30 0 2024-09-06T14:44:35.164 INFO:tasks.workunit.client.0.smithi052.stdout:2/127: stat f2 0 2024-09-06T14:44:35.164 INFO:tasks.workunit.client.1.smithi165.stdout:9/852: write db/de/d15/f2b [2854246,15947] 0 2024-09-06T14:44:35.165 INFO:tasks.workunit.client.0.smithi052.stdout:2/128: write da/f1d [2895753,111202] 0 2024-09-06T14:44:35.166 INFO:tasks.workunit.client.0.smithi052.stdout:2/129: readlink da/db/l10 0 2024-09-06T14:44:35.169 INFO:tasks.workunit.client.1.smithi165.stdout:4/786: rename d5/d1b/d1c/d41/f99 to d5/d1b/d61/d77/d7c/f10e 0 2024-09-06T14:44:35.169 INFO:tasks.workunit.client.0.smithi052.stdout:4/120: creat d9/f2e x:0 0 0 2024-09-06T14:44:35.169 INFO:tasks.workunit.client.0.smithi052.stdout:4/121: fsync f6 0 2024-09-06T14:44:35.170 INFO:tasks.workunit.client.1.smithi165.stdout:4/787: chown d5/d1b/d61/dd7/ddf/ddc 85513086 1 2024-09-06T14:44:35.173 INFO:tasks.workunit.client.0.smithi052.stdout:1/121: rename d1/da/fc to d1/db/de/f1c 0 2024-09-06T14:44:35.174 INFO:tasks.workunit.client.0.smithi052.stdout:1/122: stat d1/db/de 0 2024-09-06T14:44:35.174 INFO:tasks.workunit.client.1.smithi165.stdout:3/775: write d1/da/f2f [2911728,35380] 0 2024-09-06T14:44:35.174 INFO:tasks.workunit.client.1.smithi165.stdout:4/788: truncate d5/d1b/d1c/d20/d75/d83/fe5 371652 0 2024-09-06T14:44:35.175 INFO:tasks.workunit.client.1.smithi165.stdout:4/789: readlink d5/d1b/d1c/d20/d75/d83/d9f/ldd 0 2024-09-06T14:44:35.177 INFO:tasks.workunit.client.0.smithi052.stdout:1/123: dread d1/f4 [0,4194304] 0 2024-09-06T14:44:35.177 INFO:tasks.workunit.client.0.smithi052.stdout:3/179: creat d0/d11/d15/d19/f2c x:0 0 0 2024-09-06T14:44:35.179 INFO:tasks.workunit.client.0.smithi052.stdout:3/180: write d0/f1d [7385072,120401] 0 2024-09-06T14:44:35.182 INFO:tasks.workunit.client.1.smithi165.stdout:9/853: symlink db/de/d15/d7f/l109 0 2024-09-06T14:44:35.185 INFO:tasks.workunit.client.1.smithi165.stdout:2/673: rename d9/d88/db8/lc1 to d9/d88/dac/d95/ldc 0 2024-09-06T14:44:35.189 INFO:tasks.workunit.client.0.smithi052.stdout:3/181: read d0/f21 [303933,34439] 0 2024-09-06T14:44:35.190 INFO:tasks.workunit.client.0.smithi052.stdout:4/122: mknod d9/d2d/c2f 0 2024-09-06T14:44:35.190 INFO:tasks.workunit.client.1.smithi165.stdout:5/842: getdents d6/d1c/d28/d88/d108 0 2024-09-06T14:44:35.192 INFO:tasks.workunit.client.0.smithi052.stdout:8/112: rename c2 to d6/d9/d1f/d14/c25 0 2024-09-06T14:44:35.194 INFO:tasks.workunit.client.0.smithi052.stdout:3/182: dread d0/f1a [0,4194304] 0 2024-09-06T14:44:35.194 INFO:tasks.workunit.client.0.smithi052.stdout:3/183: chown d0/d11/d15/d19/f2c 3521002 1 2024-09-06T14:44:35.195 INFO:tasks.workunit.client.1.smithi165.stdout:7/626: dwrite d20/d3b/f86 [0,4194304] 0 2024-09-06T14:44:35.195 INFO:tasks.workunit.client.1.smithi165.stdout:8/749: getdents d0/d5e 0 2024-09-06T14:44:35.198 INFO:tasks.workunit.client.1.smithi165.stdout:5/843: dread d6/d1c/d28/d2d/d3c/d44/f7f [0,4194304] 0 2024-09-06T14:44:35.199 INFO:tasks.workunit.client.1.smithi165.stdout:6/782: rename d29/d6a/d83/d89/ddb/ddd to d29/d39/d5b/d62/d94/db7/dcc/df0 0 2024-09-06T14:44:35.199 INFO:tasks.workunit.client.0.smithi052.stdout:4/123: creat d9/d2d/f30 x:0 0 0 2024-09-06T14:44:35.200 INFO:tasks.workunit.client.1.smithi165.stdout:3/776: dwrite d1/da/dd/f2c [0,4194304] 0 2024-09-06T14:44:35.202 INFO:tasks.workunit.client.1.smithi165.stdout:2/674: unlink d9/d25/d45/d75/d67/d76/fa2 0 2024-09-06T14:44:35.203 INFO:tasks.workunit.client.1.smithi165.stdout:9/854: write db/de/d15/d17/dc3/fe2 [1126675,117779] 0 2024-09-06T14:44:35.203 INFO:tasks.workunit.client.0.smithi052.stdout:8/113: mknod d6/c26 0 2024-09-06T14:44:35.204 INFO:tasks.workunit.client.0.smithi052.stdout:8/114: write f1 [2846159,34362] 0 2024-09-06T14:44:35.205 INFO:tasks.workunit.client.1.smithi165.stdout:9/855: readlink db/de/d15/d17/d18/d7d/la5 0 2024-09-06T14:44:35.205 INFO:tasks.workunit.client.0.smithi052.stdout:3/184: truncate d0/f21 609297 0 2024-09-06T14:44:35.205 INFO:tasks.workunit.client.0.smithi052.stdout:8/115: read f1 [3432166,15426] 0 2024-09-06T14:44:35.206 INFO:tasks.workunit.client.0.smithi052.stdout:1/124: creat d1/f1d x:0 0 0 2024-09-06T14:44:35.211 INFO:tasks.workunit.client.1.smithi165.stdout:7/627: creat d20/d4d/fc4 x:0 0 0 2024-09-06T14:44:35.214 INFO:tasks.workunit.client.1.smithi165.stdout:8/750: symlink d0/d19/d24/db1/d5b/l107 0 2024-09-06T14:44:35.216 INFO:tasks.workunit.client.0.smithi052.stdout:8/116: symlink d6/d9/d1f/d14/l27 0 2024-09-06T14:44:35.218 INFO:tasks.workunit.client.1.smithi165.stdout:4/790: truncate d5/d1b/d1c/d20/d75/d83/f4d 1570762 0 2024-09-06T14:44:35.219 INFO:tasks.workunit.client.1.smithi165.stdout:6/783: fdatasync d29/d6a/d83/f8c 0 2024-09-06T14:44:35.220 INFO:tasks.workunit.client.0.smithi052.stdout:4/124: mknod d9/c31 0 2024-09-06T14:44:35.220 INFO:tasks.workunit.client.0.smithi052.stdout:8/117: dread d6/d16/f1e [0,4194304] 0 2024-09-06T14:44:35.220 INFO:tasks.workunit.client.0.smithi052.stdout:4/125: fsync f6 0 2024-09-06T14:44:35.223 INFO:tasks.workunit.client.0.smithi052.stdout:3/185: creat d0/d11/d29/f2d x:0 0 0 2024-09-06T14:44:35.225 INFO:tasks.workunit.client.0.smithi052.stdout:4/126: dread d9/d10/f22 [0,4194304] 0 2024-09-06T14:44:35.225 INFO:tasks.workunit.client.0.smithi052.stdout:1/125: creat d1/da/d12/f1e x:0 0 0 2024-09-06T14:44:35.226 INFO:tasks.workunit.client.1.smithi165.stdout:9/856: rmdir db/de/d15/d17/d86 39 2024-09-06T14:44:35.228 INFO:tasks.workunit.client.1.smithi165.stdout:7/628: chown d20/d40/c9b 762757672 1 2024-09-06T14:44:35.234 INFO:tasks.workunit.client.1.smithi165.stdout:1/702: rename d0/d2a/d18/d24/d4b/d93/d68/c7d to d0/d2a/d18/d24/d4b/d95/cdf 0 2024-09-06T14:44:35.235 INFO:tasks.workunit.client.1.smithi165.stdout:1/703: chown d0/d2a/d18/d24/d4b/d93/dbd/dd1/cd7 42 1 2024-09-06T14:44:35.236 INFO:tasks.workunit.client.0.smithi052.stdout:4/127: symlink d9/d2d/l32 0 2024-09-06T14:44:35.238 INFO:tasks.workunit.client.0.smithi052.stdout:1/126: unlink d1/c2 0 2024-09-06T14:44:35.241 INFO:tasks.workunit.client.1.smithi165.stdout:5/844: write d6/d1c/d28/d4b/d55/d8a/de1/fa4 [4683321,93073] 0 2024-09-06T14:44:35.241 INFO:tasks.workunit.client.1.smithi165.stdout:2/675: dwrite d9/f1b [0,4194304] 0 2024-09-06T14:44:35.242 INFO:tasks.workunit.client.0.smithi052.stdout:4/128: dwrite d9/f2e [0,4194304] 0 2024-09-06T14:44:35.243 INFO:tasks.workunit.client.0.smithi052.stdout:3/186: unlink d0/f21 0 2024-09-06T14:44:35.245 INFO:tasks.workunit.client.0.smithi052.stdout:1/127: creat d1/da/d14/f1f x:0 0 0 2024-09-06T14:44:35.248 INFO:tasks.workunit.client.1.smithi165.stdout:7/629: unlink d20/d3b/d69/f85 0 2024-09-06T14:44:35.248 INFO:tasks.workunit.client.1.smithi165.stdout:7/630: fdatasync d20/f2b 0 2024-09-06T14:44:35.250 INFO:tasks.workunit.client.0.smithi052.stdout:8/118: link d6/c13 d6/d16/c28 0 2024-09-06T14:44:35.251 INFO:tasks.workunit.client.1.smithi165.stdout:0/697: sync 2024-09-06T14:44:35.252 INFO:tasks.workunit.client.1.smithi165.stdout:9/857: rename db/de/d16/f66 to db/de/d15/d17/d72/da3/f10a 0 2024-09-06T14:44:35.253 INFO:tasks.workunit.client.1.smithi165.stdout:9/858: rename db/de to db/de/d15/d74/d10b 22 2024-09-06T14:44:35.255 INFO:tasks.workunit.client.0.smithi052.stdout:3/187: rename d0/f9 to d0/d11/f2e 0 2024-09-06T14:44:35.258 INFO:tasks.workunit.client.0.smithi052.stdout:1/128: unlink d1/db/de/l10 0 2024-09-06T14:44:35.260 INFO:tasks.workunit.client.1.smithi165.stdout:2/676: dread f8 [0,4194304] 0 2024-09-06T14:44:35.260 INFO:tasks.workunit.client.0.smithi052.stdout:1/129: dread - d1/da/d14/f1f zero size 2024-09-06T14:44:35.260 INFO:tasks.workunit.client.0.smithi052.stdout:8/119: creat d6/d9/d1f/d14/f29 x:0 0 0 2024-09-06T14:44:35.265 INFO:tasks.workunit.client.0.smithi052.stdout:3/188: dwrite d0/d11/d12/d18/f28 [0,4194304] 0 2024-09-06T14:44:35.272 INFO:tasks.workunit.client.1.smithi165.stdout:3/777: creat d1/da/dc/d3b/dc6/f103 x:0 0 0 2024-09-06T14:44:35.274 INFO:tasks.workunit.client.0.smithi052.stdout:1/130: symlink d1/db/l20 0 2024-09-06T14:44:35.275 INFO:tasks.workunit.client.0.smithi052.stdout:8/120: stat d6/d9/d1f/c1c 0 2024-09-06T14:44:35.277 INFO:tasks.workunit.client.0.smithi052.stdout:3/189: creat d0/d11/d15/d19/f2f x:0 0 0 2024-09-06T14:44:35.278 INFO:tasks.workunit.client.0.smithi052.stdout:4/129: getdents d9/d10 0 2024-09-06T14:44:35.279 INFO:tasks.workunit.client.1.smithi165.stdout:0/698: mkdir d15/d19/d28/d9e/da3/de5 0 2024-09-06T14:44:35.279 INFO:tasks.workunit.client.0.smithi052.stdout:1/131: symlink d1/db/l21 0 2024-09-06T14:44:35.280 INFO:tasks.workunit.client.0.smithi052.stdout:4/130: write d9/d10/d17/f1c [1090465,16775] 0 2024-09-06T14:44:35.280 INFO:tasks.workunit.client.0.smithi052.stdout:3/190: dread d0/fc [0,4194304] 0 2024-09-06T14:44:35.284 INFO:tasks.workunit.client.1.smithi165.stdout:6/784: creat d29/d39/ff1 x:0 0 0 2024-09-06T14:44:35.284 INFO:tasks.workunit.client.1.smithi165.stdout:6/785: write f28 [3758966,8687] 0 2024-09-06T14:44:35.285 INFO:tasks.workunit.client.0.smithi052.stdout:8/121: creat d6/d9/d21/f2a x:0 0 0 2024-09-06T14:44:35.286 INFO:tasks.workunit.client.1.smithi165.stdout:2/677: fdatasync d9/d4f/f5e 0 2024-09-06T14:44:35.287 INFO:tasks.workunit.client.1.smithi165.stdout:2/678: readlink d9/d25/d45/d75/da5/lbb 0 2024-09-06T14:44:35.288 INFO:tasks.workunit.client.0.smithi052.stdout:4/131: unlink d9/d2d/c2f 0 2024-09-06T14:44:35.288 INFO:tasks.workunit.client.0.smithi052.stdout:4/132: stat d9/d10/d19 0 2024-09-06T14:44:35.289 INFO:tasks.workunit.client.1.smithi165.stdout:5/845: mknod d6/d32/c12c 0 2024-09-06T14:44:35.292 INFO:tasks.workunit.client.0.smithi052.stdout:1/132: symlink d1/l22 0 2024-09-06T14:44:35.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/122: creat d6/d9/d1f/d14/f2b x:0 0 0 2024-09-06T14:44:35.299 INFO:tasks.workunit.client.1.smithi165.stdout:4/791: getdents d5/d1b/d1c/d55/d7d 0 2024-09-06T14:44:35.299 INFO:tasks.workunit.client.1.smithi165.stdout:3/778: write d1/da/dc/d3b/d71/fe3 [2525455,119219] 0 2024-09-06T14:44:35.300 INFO:tasks.workunit.client.1.smithi165.stdout:4/792: fdatasync d5/d1b/d1c/d55/f8f 0 2024-09-06T14:44:35.300 INFO:tasks.workunit.client.1.smithi165.stdout:3/779: chown d1/da/dc/d10 838840 1 2024-09-06T14:44:35.300 INFO:tasks.workunit.client.0.smithi052.stdout:8/123: rename d6/d9/d1f/d14/f20 to d6/d16/f2c 0 2024-09-06T14:44:35.300 INFO:tasks.workunit.client.0.smithi052.stdout:8/124: readlink l0 0 2024-09-06T14:44:35.301 INFO:tasks.workunit.client.1.smithi165.stdout:4/793: chown d5/d1b/d61/fd3 0 1 2024-09-06T14:44:35.301 INFO:tasks.workunit.client.1.smithi165.stdout:9/859: symlink db/de/d15/d17/d18/d59/l10c 0 2024-09-06T14:44:35.304 INFO:tasks.workunit.client.0.smithi052.stdout:3/191: getdents d0/d11/d12/d17 0 2024-09-06T14:44:35.305 INFO:tasks.workunit.client.1.smithi165.stdout:6/786: mkdir d29/d93/d87/df2 0 2024-09-06T14:44:35.307 INFO:tasks.workunit.client.0.smithi052.stdout:8/125: creat d6/d9/d1f/d19/f2d x:0 0 0 2024-09-06T14:44:35.307 INFO:tasks.workunit.client.1.smithi165.stdout:1/704: truncate d0/d2a/f53 2255475 0 2024-09-06T14:44:35.308 INFO:tasks.workunit.client.0.smithi052.stdout:1/133: link d1/db/c1b d1/da/c23 0 2024-09-06T14:44:35.310 INFO:tasks.workunit.client.0.smithi052.stdout:3/192: creat d0/d11/d12/f30 x:0 0 0 2024-09-06T14:44:35.310 INFO:tasks.workunit.client.1.smithi165.stdout:5/846: creat d6/d1c/d28/d2d/d49/de9/f12d x:0 0 0 2024-09-06T14:44:35.311 INFO:tasks.workunit.client.1.smithi165.stdout:5/847: stat d6/d1c/d28/d2d/d3c/c85 0 2024-09-06T14:44:35.312 INFO:tasks.workunit.client.1.smithi165.stdout:8/751: getdents d0/d19/d36/d28/dda 0 2024-09-06T14:44:35.313 INFO:tasks.workunit.client.1.smithi165.stdout:0/699: mknod d15/d19/d50/d53/d7c/dae/ce6 0 2024-09-06T14:44:35.316 INFO:tasks.workunit.client.0.smithi052.stdout:8/126: dwrite d6/d9/d1f/d19/f2d [0,4194304] 0 2024-09-06T14:44:35.317 INFO:tasks.workunit.client.0.smithi052.stdout:1/134: dread d1/db/de/f1c [0,4194304] 0 2024-09-06T14:44:35.318 INFO:tasks.workunit.client.0.smithi052.stdout:1/135: write d1/f9 [5398709,96908] 0 2024-09-06T14:44:35.319 INFO:tasks.workunit.client.0.smithi052.stdout:8/127: write d6/d9/d1f/d14/f2b [452953,12109] 0 2024-09-06T14:44:35.319 INFO:tasks.workunit.client.0.smithi052.stdout:3/193: rename d0/d11/d12/d18/f25 to d0/d11/d29/f31 0 2024-09-06T14:44:35.320 INFO:tasks.workunit.client.0.smithi052.stdout:8/128: chown d6/d9/d21 186325061 1 2024-09-06T14:44:35.322 INFO:tasks.workunit.client.0.smithi052.stdout:1/136: dread d1/da/ff [0,4194304] 0 2024-09-06T14:44:35.323 INFO:tasks.workunit.client.0.smithi052.stdout:1/137: chown d1/db/l21 2 1 2024-09-06T14:44:35.329 INFO:tasks.workunit.client.0.smithi052.stdout:3/194: truncate d0/f1a 4935876 0 2024-09-06T14:44:35.329 INFO:tasks.workunit.client.0.smithi052.stdout:3/195: dread - d0/d11/d15/d19/f2c zero size 2024-09-06T14:44:35.330 INFO:tasks.workunit.client.1.smithi165.stdout:2/679: mkdir d9/d25/d46/ddd 0 2024-09-06T14:44:35.331 INFO:tasks.workunit.client.0.smithi052.stdout:3/196: write d0/d11/d15/d19/f2f [234389,38037] 0 2024-09-06T14:44:35.337 INFO:tasks.workunit.client.0.smithi052.stdout:3/197: creat d0/d11/d15/d1b/f32 x:0 0 0 2024-09-06T14:44:35.337 INFO:tasks.workunit.client.1.smithi165.stdout:5/848: symlink d6/d1c/d28/d2d/d61/ddc/l12e 0 2024-09-06T14:44:35.337 INFO:tasks.workunit.client.1.smithi165.stdout:8/752: symlink d0/d19/d36/d2d/d3f/daf/l108 0 2024-09-06T14:44:35.337 INFO:tasks.workunit.client.1.smithi165.stdout:8/753: write d0/f6 [5337122,94588] 0 2024-09-06T14:44:35.341 INFO:tasks.workunit.client.1.smithi165.stdout:9/860: mknod db/de/d15/d7f/d9b/d6c/c10d 0 2024-09-06T14:44:35.341 INFO:tasks.workunit.client.1.smithi165.stdout:9/861: write db/f26 [1634053,116118] 0 2024-09-06T14:44:35.342 INFO:tasks.workunit.client.0.smithi052.stdout:3/198: mknod d0/d11/d12/d17/c33 0 2024-09-06T14:44:35.344 INFO:tasks.workunit.client.1.smithi165.stdout:6/787: mkdir d29/d39/d5b/d62/d94/df3 0 2024-09-06T14:44:35.346 INFO:tasks.workunit.client.1.smithi165.stdout:4/794: truncate d5/d1b/d1c/f6f 3562585 0 2024-09-06T14:44:35.347 INFO:tasks.workunit.client.0.smithi052.stdout:1/138: getdents d1/db/de 0 2024-09-06T14:44:35.348 INFO:tasks.workunit.client.0.smithi052.stdout:3/199: symlink d0/d11/d15/d1b/l34 0 2024-09-06T14:44:35.350 INFO:tasks.workunit.client.0.smithi052.stdout:8/129: dwrite d6/d16/f1e [8388608,4194304] 0 2024-09-06T14:44:35.350 INFO:tasks.workunit.client.0.smithi052.stdout:1/139: creat d1/db/de/f24 x:0 0 0 2024-09-06T14:44:35.362 INFO:tasks.workunit.client.0.smithi052.stdout:1/140: dwrite d1/db/fd [4194304,4194304] 0 2024-09-06T14:44:35.367 INFO:tasks.workunit.client.0.smithi052.stdout:1/141: creat d1/da/d14/f25 x:0 0 0 2024-09-06T14:44:35.376 INFO:tasks.workunit.client.1.smithi165.stdout:7/631: sync 2024-09-06T14:44:35.380 INFO:tasks.workunit.client.0.smithi052.stdout:3/200: dwrite d0/d11/d12/d18/f22 [0,4194304] 0 2024-09-06T14:44:35.382 INFO:tasks.workunit.client.0.smithi052.stdout:8/130: dwrite f1 [0,4194304] 0 2024-09-06T14:44:35.382 INFO:tasks.workunit.client.1.smithi165.stdout:8/754: symlink d0/d19/d36/d2d/d33/d3a/d46/dcd/l109 0 2024-09-06T14:44:35.383 INFO:tasks.workunit.client.0.smithi052.stdout:3/201: write d0/d11/d15/d1b/f27 [232989,11263] 0 2024-09-06T14:44:35.385 INFO:tasks.workunit.client.0.smithi052.stdout:3/202: write d0/d11/d12/d18/f22 [1296313,100895] 0 2024-09-06T14:44:35.386 INFO:tasks.workunit.client.1.smithi165.stdout:9/862: truncate db/de/d15/d17/d18/fb4 562274 0 2024-09-06T14:44:35.388 INFO:tasks.workunit.client.1.smithi165.stdout:7/632: dread d20/d3b/f72 [0,4194304] 0 2024-09-06T14:44:35.390 INFO:tasks.workunit.client.0.smithi052.stdout:3/203: write d0/d11/d12/d18/f28 [4003246,38227] 0 2024-09-06T14:44:35.392 INFO:tasks.workunit.client.1.smithi165.stdout:4/795: creat d5/d1b/d1c/d20/d75/d83/d9f/f10f x:0 0 0 2024-09-06T14:44:35.394 INFO:tasks.workunit.client.0.smithi052.stdout:8/131: dwrite d6/d9/f18 [0,4194304] 0 2024-09-06T14:44:35.398 INFO:tasks.workunit.client.1.smithi165.stdout:3/780: getdents d1/da/dc/d3b/d71 0 2024-09-06T14:44:35.398 INFO:tasks.workunit.client.1.smithi165.stdout:3/781: stat d1/da/c7f 0 2024-09-06T14:44:35.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/204: rename d0/d11/d12/d18 to d0/d11/d29/d35 0 2024-09-06T14:44:35.401 INFO:tasks.workunit.client.0.smithi052.stdout:1/142: truncate d1/db/f13 4151023 0 2024-09-06T14:44:35.402 INFO:tasks.workunit.client.0.smithi052.stdout:8/132: rmdir d6/d9/df 39 2024-09-06T14:44:35.402 INFO:tasks.workunit.client.0.smithi052.stdout:8/133: dread - d6/d9/d21/f2a zero size 2024-09-06T14:44:35.403 INFO:tasks.workunit.client.1.smithi165.stdout:0/700: link d15/d6e/f85 d15/d19/d50/d53/dbf/fe7 0 2024-09-06T14:44:35.404 INFO:tasks.workunit.client.0.smithi052.stdout:3/205: dread d0/ff [0,4194304] 0 2024-09-06T14:44:35.405 INFO:tasks.workunit.client.0.smithi052.stdout:1/143: symlink d1/db/l26 0 2024-09-06T14:44:35.406 INFO:tasks.workunit.client.1.smithi165.stdout:8/755: mkdir d0/d10a 0 2024-09-06T14:44:35.408 INFO:tasks.workunit.client.1.smithi165.stdout:6/788: mkdir d29/d39/df4 0 2024-09-06T14:44:35.408 INFO:tasks.workunit.client.1.smithi165.stdout:5/849: write d6/d1c/d28/d2d/d3c/fa8 [1464172,57167] 0 2024-09-06T14:44:35.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/206: symlink d0/d11/d29/d35/l36 0 2024-09-06T14:44:35.410 INFO:tasks.workunit.client.1.smithi165.stdout:9/863: fdatasync db/de/d15/d7f/fe0 0 2024-09-06T14:44:35.411 INFO:tasks.workunit.client.1.smithi165.stdout:5/850: write d6/d1c/d28/d4b/d55/d8a/f106 [213205,51061] 0 2024-09-06T14:44:35.411 INFO:tasks.workunit.client.1.smithi165.stdout:1/705: getdents d0/d1c/d1d 0 2024-09-06T14:44:35.412 INFO:tasks.workunit.client.0.smithi052.stdout:1/144: dwrite d1/da/d14/f25 [0,4194304] 0 2024-09-06T14:44:35.413 INFO:tasks.workunit.client.0.smithi052.stdout:1/145: dread - d1/db/de/f24 zero size 2024-09-06T14:44:35.414 INFO:tasks.workunit.client.1.smithi165.stdout:1/706: fdatasync d0/d1c/d1d/d57/fd0 0 2024-09-06T14:44:35.414 INFO:tasks.workunit.client.1.smithi165.stdout:7/633: unlink l9 0 2024-09-06T14:44:35.416 INFO:tasks.workunit.client.1.smithi165.stdout:6/789: dread d29/d39/d5b/d68/db3/fed [0,4194304] 0 2024-09-06T14:44:35.420 INFO:tasks.workunit.client.1.smithi165.stdout:9/864: dwrite db/de/d15/d17/d18/f54 [0,4194304] 0 2024-09-06T14:44:35.429 INFO:tasks.workunit.client.1.smithi165.stdout:8/756: dread d0/d19/d36/d2d/d33/d3a/d46/d49/f4a [0,4194304] 0 2024-09-06T14:44:35.430 INFO:tasks.workunit.client.1.smithi165.stdout:8/757: chown d0/d14/d3e/dcf/fa1 501155445 1 2024-09-06T14:44:35.434 INFO:tasks.workunit.client.1.smithi165.stdout:0/701: dread f3 [0,4194304] 0 2024-09-06T14:44:35.483 INFO:tasks.workunit.client.0.smithi052.stdout:8/134: creat d6/d9/f2e x:0 0 0 2024-09-06T14:44:35.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/146: mknod d1/db/de/c27 0 2024-09-06T14:44:35.488 INFO:tasks.workunit.client.0.smithi052.stdout:8/135: dread f1 [4194304,4194304] 0 2024-09-06T14:44:35.489 INFO:tasks.workunit.client.0.smithi052.stdout:8/136: write d6/d9/f18 [90494,56668] 0 2024-09-06T14:44:35.489 INFO:tasks.workunit.client.0.smithi052.stdout:3/207: truncate d0/f1a 3313740 0 2024-09-06T14:44:35.489 INFO:tasks.workunit.client.0.smithi052.stdout:3/208: dread - d0/d11/d15/d19/f2c zero size 2024-09-06T14:44:35.490 INFO:tasks.workunit.client.0.smithi052.stdout:3/209: dread - d0/d11/d15/d1b/f32 zero size 2024-09-06T14:44:35.491 INFO:tasks.workunit.client.1.smithi165.stdout:3/782: fdatasync d1/d41/f79 0 2024-09-06T14:44:35.492 INFO:tasks.workunit.client.0.smithi052.stdout:1/147: creat d1/da/d14/f28 x:0 0 0 2024-09-06T14:44:35.500 INFO:tasks.workunit.client.0.smithi052.stdout:1/148: dwrite d1/db/de/f24 [0,4194304] 0 2024-09-06T14:44:35.500 INFO:tasks.workunit.client.0.smithi052.stdout:3/210: rename d0/f1d to d0/d11/d29/f37 0 2024-09-06T14:44:35.501 INFO:tasks.workunit.client.0.smithi052.stdout:1/149: chown d1/db/fd 4029714 1 2024-09-06T14:44:35.501 INFO:tasks.workunit.client.1.smithi165.stdout:5/851: mknod d6/d1c/d28/d2d/d3c/d81/c12f 0 2024-09-06T14:44:35.502 INFO:tasks.workunit.client.0.smithi052.stdout:1/150: write d1/db/fd [3063163,100943] 0 2024-09-06T14:44:35.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/151: write d1/f9 [9254502,52483] 0 2024-09-06T14:44:35.509 INFO:tasks.workunit.client.1.smithi165.stdout:7/634: mknod d20/d3b/d69/d88/cc5 0 2024-09-06T14:44:35.511 INFO:tasks.workunit.client.0.smithi052.stdout:3/211: mknod d0/c38 0 2024-09-06T14:44:35.518 INFO:tasks.workunit.client.1.smithi165.stdout:2/680: getdents d9/d23 0 2024-09-06T14:44:35.518 INFO:tasks.workunit.client.0.smithi052.stdout:1/152: mknod d1/da/d14/c29 0 2024-09-06T14:44:35.521 INFO:tasks.workunit.client.0.smithi052.stdout:8/137: creat d6/d9/df/d1b/f2f x:0 0 0 2024-09-06T14:44:35.521 INFO:tasks.workunit.client.1.smithi165.stdout:3/783: mknod d1/d7c/d7e/dc5/c104 0 2024-09-06T14:44:35.522 INFO:tasks.workunit.client.0.smithi052.stdout:3/212: symlink d0/d11/d15/d1b/l39 0 2024-09-06T14:44:35.523 INFO:tasks.workunit.client.1.smithi165.stdout:2/681: dwrite d9/f13 [0,4194304] 0 2024-09-06T14:44:35.525 INFO:tasks.workunit.client.0.smithi052.stdout:1/153: mknod d1/db/de/c2a 0 2024-09-06T14:44:35.526 INFO:tasks.workunit.client.0.smithi052.stdout:1/154: write d1/f9 [669371,4131] 0 2024-09-06T14:44:35.528 INFO:tasks.workunit.client.0.smithi052.stdout:8/138: creat d6/d9/df/d1b/f30 x:0 0 0 2024-09-06T14:44:35.528 INFO:tasks.workunit.client.1.smithi165.stdout:4/796: truncate d5/d1b/d1c/d20/f27 53604 0 2024-09-06T14:44:35.529 INFO:tasks.workunit.client.0.smithi052.stdout:1/155: write d1/db/de/f24 [3931932,127362] 0 2024-09-06T14:44:35.530 INFO:tasks.workunit.client.1.smithi165.stdout:5/852: mknod d6/d1c/d28/d4b/d55/d8a/da5/c130 0 2024-09-06T14:44:35.536 INFO:tasks.workunit.client.1.smithi165.stdout:1/707: rename d0/d2a/c37 to d0/d2a/d23/ce0 0 2024-09-06T14:44:35.537 INFO:tasks.workunit.client.1.smithi165.stdout:1/708: stat d0/d2a/d23/d56/f8d 0 2024-09-06T14:44:35.539 INFO:tasks.workunit.client.0.smithi052.stdout:1/156: creat d1/db/de/f2b x:0 0 0 2024-09-06T14:44:35.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/157: write d1/da/d12/f1e [384667,82163] 0 2024-09-06T14:44:35.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/158: readlink d1/l11 0 2024-09-06T14:44:35.541 INFO:tasks.workunit.client.0.smithi052.stdout:3/213: link d0/d11/d29/f37 d0/d11/d29/d35/f3a 0 2024-09-06T14:44:35.543 INFO:tasks.workunit.client.0.smithi052.stdout:8/139: mkdir d6/d22/d31 0 2024-09-06T14:44:35.546 INFO:tasks.workunit.client.1.smithi165.stdout:3/784: fsync d1/da/dd/d4b/f5f 0 2024-09-06T14:44:35.548 INFO:tasks.workunit.client.0.smithi052.stdout:3/214: creat d0/d11/d15/d19/f3b x:0 0 0 2024-09-06T14:44:35.552 INFO:tasks.workunit.client.1.smithi165.stdout:4/797: creat d5/d1b/d61/d77/d7c/dcd/dc9/f110 x:0 0 0 2024-09-06T14:44:35.553 INFO:tasks.workunit.client.1.smithi165.stdout:4/798: write d5/d1b/d61/fef [1865872,56267] 0 2024-09-06T14:44:35.555 INFO:tasks.workunit.client.0.smithi052.stdout:1/159: mknod d1/db/d18/c2c 0 2024-09-06T14:44:35.558 INFO:tasks.workunit.client.1.smithi165.stdout:0/702: rename d15/d19/d50/d53/d7c/cd7 to d15/d19/d28/d4f/da7/ce8 0 2024-09-06T14:44:35.560 INFO:tasks.workunit.client.1.smithi165.stdout:6/790: creat d29/d6a/ff5 x:0 0 0 2024-09-06T14:44:35.562 INFO:tasks.workunit.client.0.smithi052.stdout:1/160: dwrite d1/da/ff [0,4194304] 0 2024-09-06T14:44:35.563 INFO:tasks.workunit.client.1.smithi165.stdout:9/865: creat db/de/f10e x:0 0 0 2024-09-06T14:44:35.565 INFO:tasks.workunit.client.1.smithi165.stdout:0/703: dread d15/d19/d38/fa0 [0,4194304] 0 2024-09-06T14:44:35.565 INFO:tasks.workunit.client.1.smithi165.stdout:0/704: readlink d15/d19/d38/lb6 0 2024-09-06T14:44:35.568 INFO:tasks.workunit.client.0.smithi052.stdout:1/161: fsync d1/db/de/f1c 0 2024-09-06T14:44:35.573 INFO:tasks.workunit.client.0.smithi052.stdout:1/162: symlink d1/da/l2d 0 2024-09-06T14:44:35.575 INFO:tasks.workunit.client.0.smithi052.stdout:3/215: getdents d0/d11/d15/d1b 0 2024-09-06T14:44:35.577 INFO:tasks.workunit.client.1.smithi165.stdout:2/682: rename d9/d23/d29/l2f to d9/d23/d29/d48/dce/lde 0 2024-09-06T14:44:35.578 INFO:tasks.workunit.client.0.smithi052.stdout:3/216: dread d0/fe [0,4194304] 0 2024-09-06T14:44:35.579 INFO:tasks.workunit.client.0.smithi052.stdout:1/163: mkdir d1/da/d14/d2e 0 2024-09-06T14:44:35.579 INFO:tasks.workunit.client.0.smithi052.stdout:3/217: read - d0/d11/d29/f2d zero size 2024-09-06T14:44:35.581 INFO:tasks.workunit.client.0.smithi052.stdout:1/164: truncate d1/db/de/f24 4678958 0 2024-09-06T14:44:35.581 INFO:tasks.workunit.client.0.smithi052.stdout:3/218: dread d0/d11/d29/f31 [0,4194304] 0 2024-09-06T14:44:35.584 INFO:tasks.workunit.client.0.smithi052.stdout:1/165: dread d1/db/de/f1c [0,4194304] 0 2024-09-06T14:44:35.584 INFO:tasks.workunit.client.1.smithi165.stdout:9/866: unlink db/de/l20 0 2024-09-06T14:44:35.584 INFO:tasks.workunit.client.1.smithi165.stdout:8/758: getdents d0/d19/d24/d26 0 2024-09-06T14:44:35.585 INFO:tasks.workunit.client.1.smithi165.stdout:8/759: chown d0/d19/d36/d2d/d33/d3a/d46/f52 21 1 2024-09-06T14:44:35.586 INFO:tasks.workunit.client.0.smithi052.stdout:3/219: symlink d0/d11/d15/d19/l3c 0 2024-09-06T14:44:35.586 INFO:tasks.workunit.client.0.smithi052.stdout:3/220: chown d0/d11/d15/d19/f3b 31260 1 2024-09-06T14:44:35.587 INFO:tasks.workunit.client.1.smithi165.stdout:8/760: chown d0/d19/d36/d2d/d33/d3a/fb0 10490 1 2024-09-06T14:44:35.588 INFO:tasks.workunit.client.0.smithi052.stdout:1/166: rename d1/da/f19 to d1/da/f2f 0 2024-09-06T14:44:35.589 INFO:tasks.workunit.client.1.smithi165.stdout:9/867: dwrite db/de/d15/d7f/f8b [0,4194304] 0 2024-09-06T14:44:35.589 INFO:tasks.workunit.client.0.smithi052.stdout:8/140: truncate d6/d16/f1e 12131692 0 2024-09-06T14:44:35.593 INFO:tasks.workunit.client.1.smithi165.stdout:7/635: mkdir d20/d3b/d69/d88/dc6 0 2024-09-06T14:44:35.594 INFO:tasks.workunit.client.0.smithi052.stdout:1/167: fdatasync d1/da/f2f 0 2024-09-06T14:44:35.595 INFO:tasks.workunit.client.0.smithi052.stdout:1/168: dread - d1/da/d14/f1f zero size 2024-09-06T14:44:35.595 INFO:tasks.workunit.client.0.smithi052.stdout:1/169: readlink d1/l22 0 2024-09-06T14:44:35.596 INFO:tasks.workunit.client.1.smithi165.stdout:4/799: write d5/d1b/d61/dd7/ddf/f98 [935078,106172] 0 2024-09-06T14:44:35.598 INFO:tasks.workunit.client.1.smithi165.stdout:2/683: chown d9/d88/dac/d95/ldc 124 1 2024-09-06T14:44:35.598 INFO:tasks.workunit.client.1.smithi165.stdout:5/853: fsync d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/ff0 0 2024-09-06T14:44:35.602 INFO:tasks.workunit.client.0.smithi052.stdout:1/170: dwrite d1/da/d14/f25 [0,4194304] 0 2024-09-06T14:44:35.604 INFO:tasks.workunit.client.1.smithi165.stdout:5/854: dwrite d6/f1a [0,4194304] 0 2024-09-06T14:44:35.604 INFO:tasks.workunit.client.1.smithi165.stdout:4/800: dread d5/f86 [0,4194304] 0 2024-09-06T14:44:35.606 INFO:tasks.workunit.client.0.smithi052.stdout:8/141: link d6/d9/d1f/d14/c25 d6/d9/df/d1b/c32 0 2024-09-06T14:44:35.607 INFO:tasks.workunit.client.0.smithi052.stdout:8/142: fsync d6/d9/f18 0 2024-09-06T14:44:35.609 INFO:tasks.workunit.client.1.smithi165.stdout:6/791: link d29/d32/fc1 d29/d39/d5b/d62/d67/ff6 0 2024-09-06T14:44:35.610 INFO:tasks.workunit.client.0.smithi052.stdout:8/143: truncate d6/d9/df/d1b/f2f 659559 0 2024-09-06T14:44:35.611 INFO:tasks.workunit.client.0.smithi052.stdout:1/171: symlink d1/db/l30 0 2024-09-06T14:44:35.613 INFO:tasks.workunit.client.0.smithi052.stdout:3/221: write d0/d11/d29/d35/f3a [9183148,73287] 0 2024-09-06T14:44:35.614 INFO:tasks.workunit.client.0.smithi052.stdout:3/222: write d0/ff [2647937,38479] 0 2024-09-06T14:44:35.615 INFO:tasks.workunit.client.1.smithi165.stdout:0/705: symlink d15/d19/d28/le9 0 2024-09-06T14:44:35.616 INFO:tasks.workunit.client.0.smithi052.stdout:8/144: mkdir d6/d9/d1f/d33 0 2024-09-06T14:44:35.618 INFO:tasks.workunit.client.0.smithi052.stdout:1/172: mknod d1/db/c31 0 2024-09-06T14:44:35.618 INFO:tasks.workunit.client.0.smithi052.stdout:8/145: read d6/d9/df/d1b/f2f [624126,64103] 0 2024-09-06T14:44:35.618 INFO:tasks.workunit.client.1.smithi165.stdout:0/706: read d15/d19/d28/f67 [72608,59697] 0 2024-09-06T14:44:35.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/146: chown d6/d9/d1f/d14/f29 207228 1 2024-09-06T14:44:35.620 INFO:tasks.workunit.client.1.smithi165.stdout:1/709: sync 2024-09-06T14:44:35.623 INFO:tasks.workunit.client.1.smithi165.stdout:7/636: rename ld to d20/d3b/d69/lc7 0 2024-09-06T14:44:35.625 INFO:tasks.workunit.client.0.smithi052.stdout:1/173: creat d1/da/f32 x:0 0 0 2024-09-06T14:44:35.628 INFO:tasks.workunit.client.1.smithi165.stdout:2/684: mknod d9/d23/d71/cdf 0 2024-09-06T14:44:35.630 INFO:tasks.workunit.client.1.smithi165.stdout:2/685: read d9/d23/f99 [62532,84524] 0 2024-09-06T14:44:35.632 INFO:tasks.workunit.client.1.smithi165.stdout:4/801: creat d5/d1b/f111 x:0 0 0 2024-09-06T14:44:35.632 INFO:tasks.workunit.client.1.smithi165.stdout:8/761: write d0/f22 [326562,65368] 0 2024-09-06T14:44:35.634 INFO:tasks.workunit.client.1.smithi165.stdout:8/762: chown d0/d19/d24/db1/d8c 2821 1 2024-09-06T14:44:35.634 INFO:tasks.workunit.client.1.smithi165.stdout:5/855: creat d6/d1c/d28/d4b/d10b/f131 x:0 0 0 2024-09-06T14:44:35.634 INFO:tasks.workunit.client.1.smithi165.stdout:4/802: write d5/d1b/f109 [1058295,18069] 0 2024-09-06T14:44:35.635 INFO:tasks.workunit.client.1.smithi165.stdout:2/686: dread d9/f68 [4194304,4194304] 0 2024-09-06T14:44:35.636 INFO:tasks.workunit.client.1.smithi165.stdout:6/792: write d29/d39/d5b/d68/db3/fed [3404016,75712] 0 2024-09-06T14:44:35.636 INFO:tasks.workunit.client.1.smithi165.stdout:6/793: chown c2 1588485 1 2024-09-06T14:44:35.638 INFO:tasks.workunit.client.0.smithi052.stdout:3/223: truncate d0/d11/d29/d35/f3a 5601001 0 2024-09-06T14:44:35.640 INFO:tasks.workunit.client.1.smithi165.stdout:6/794: dread d29/d6a/f8d [0,4194304] 0 2024-09-06T14:44:35.642 INFO:tasks.workunit.client.1.smithi165.stdout:3/785: mknod d1/dbd/dfd/c105 0 2024-09-06T14:44:35.642 INFO:tasks.workunit.client.1.smithi165.stdout:3/786: readlink d1/d7c/ld2 0 2024-09-06T14:44:35.643 INFO:tasks.workunit.client.1.smithi165.stdout:7/637: write d20/d65/d82/d97/fb3 [201055,5524] 0 2024-09-06T14:44:35.643 INFO:tasks.workunit.client.0.smithi052.stdout:8/147: getdents d6/d9/d21 0 2024-09-06T14:44:35.646 INFO:tasks.workunit.client.0.smithi052.stdout:3/224: dwrite d0/d11/d12/f30 [0,4194304] 0 2024-09-06T14:44:35.647 INFO:tasks.workunit.client.0.smithi052.stdout:3/225: dread - d0/d11/d15/d1b/f32 zero size 2024-09-06T14:44:35.651 INFO:tasks.workunit.client.0.smithi052.stdout:1/174: write d1/db/f13 [4316353,100292] 0 2024-09-06T14:44:35.652 INFO:tasks.workunit.client.0.smithi052.stdout:1/175: chown d1/da 1764366 1 2024-09-06T14:44:35.653 INFO:tasks.workunit.client.0.smithi052.stdout:8/148: creat d6/d22/d31/f34 x:0 0 0 2024-09-06T14:44:35.654 INFO:tasks.workunit.client.1.smithi165.stdout:8/763: rmdir d0/d14/d3e/dcf 39 2024-09-06T14:44:35.655 INFO:tasks.workunit.client.1.smithi165.stdout:4/803: mkdir d5/d1b/d61/dd7/ddf/d112 0 2024-09-06T14:44:35.656 INFO:tasks.workunit.client.0.smithi052.stdout:8/149: write d6/d9/d1f/d14/f29 [416984,79365] 0 2024-09-06T14:44:35.656 INFO:tasks.workunit.client.1.smithi165.stdout:2/687: creat d9/d23/d29/d48/d8c/fe0 x:0 0 0 2024-09-06T14:44:35.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/176: mknod d1/da/d14/c33 0 2024-09-06T14:44:35.658 INFO:tasks.workunit.client.1.smithi165.stdout:2/688: dread - d9/d25/d45/d75/d67/dd1/fd5 zero size 2024-09-06T14:44:35.659 INFO:tasks.workunit.client.0.smithi052.stdout:3/226: dwrite d0/d11/d29/d35/f2b [0,4194304] 0 2024-09-06T14:44:35.659 INFO:tasks.workunit.client.1.smithi165.stdout:2/689: write d9/d88/dac/fb7 [721626,29112] 0 2024-09-06T14:44:35.660 INFO:tasks.workunit.client.0.smithi052.stdout:8/150: truncate d6/d9/f2e 826032 0 2024-09-06T14:44:35.661 INFO:tasks.workunit.client.0.smithi052.stdout:8/151: write d6/d9/f18 [887826,51686] 0 2024-09-06T14:44:35.661 INFO:tasks.workunit.client.1.smithi165.stdout:4/804: dwrite d5/d1b/d61/dd7/ddf/f3c [0,4194304] 0 2024-09-06T14:44:35.662 INFO:tasks.workunit.client.1.smithi165.stdout:0/707: symlink d15/d19/d50/lea 0 2024-09-06T14:44:35.663 INFO:tasks.workunit.client.1.smithi165.stdout:0/708: chown d15/d19/d50/d53/d8d/fde 92428 1 2024-09-06T14:44:35.666 INFO:tasks.workunit.client.1.smithi165.stdout:9/868: link db/de/d15/fc5 db/de/d15/d17/d18/d7d/f10f 0 2024-09-06T14:44:35.666 INFO:tasks.workunit.client.1.smithi165.stdout:4/805: dread d5/d1b/d61/dd7/ddf/f98 [0,4194304] 0 2024-09-06T14:44:35.666 INFO:tasks.workunit.client.1.smithi165.stdout:9/869: readlink db/de/d15/lc4 0 2024-09-06T14:44:35.667 INFO:tasks.workunit.client.1.smithi165.stdout:9/870: dread - db/de/d15/fdc zero size 2024-09-06T14:44:35.667 INFO:tasks.workunit.client.1.smithi165.stdout:4/806: write d5/d1b/d1c/d55/f8f [2578805,54365] 0 2024-09-06T14:44:35.668 INFO:tasks.workunit.client.1.smithi165.stdout:9/871: fdatasync db/de/d16/f6b 0 2024-09-06T14:44:35.669 INFO:tasks.workunit.client.1.smithi165.stdout:4/807: chown d5/d1b/d1c/c29 4 1 2024-09-06T14:44:35.671 INFO:tasks.workunit.client.0.smithi052.stdout:8/152: mkdir d6/d22/d35 0 2024-09-06T14:44:35.672 INFO:tasks.workunit.client.0.smithi052.stdout:8/153: chown d6/d9/df/d1b 2165 1 2024-09-06T14:44:35.674 INFO:tasks.workunit.client.0.smithi052.stdout:1/177: unlink d1/da/c23 0 2024-09-06T14:44:35.675 INFO:tasks.workunit.client.1.smithi165.stdout:3/787: fdatasync d1/da/dd/d4b/f5f 0 2024-09-06T14:44:35.676 INFO:tasks.workunit.client.1.smithi165.stdout:4/808: dwrite d5/d1b/d1c/d78/f91 [0,4194304] 0 2024-09-06T14:44:35.677 INFO:tasks.workunit.client.1.smithi165.stdout:3/788: readlink d1/da/dc/lf 0 2024-09-06T14:44:35.679 INFO:tasks.workunit.client.1.smithi165.stdout:1/710: dwrite d0/d2a/f12 [0,4194304] 0 2024-09-06T14:44:35.679 INFO:tasks.workunit.client.0.smithi052.stdout:8/154: mkdir d6/d22/d36 0 2024-09-06T14:44:35.682 INFO:tasks.workunit.client.0.smithi052.stdout:1/178: rename d1/da/f2f to d1/da/d12/f34 0 2024-09-06T14:44:35.682 INFO:tasks.workunit.client.0.smithi052.stdout:1/179: fsync d1/da/d14/f1f 0 2024-09-06T14:44:35.683 INFO:tasks.workunit.client.1.smithi165.stdout:6/795: write d29/d32/fc1 [1018729,89906] 0 2024-09-06T14:44:35.684 INFO:tasks.workunit.client.1.smithi165.stdout:5/856: mknod d6/d32/c132 0 2024-09-06T14:44:35.685 INFO:tasks.workunit.client.0.smithi052.stdout:8/155: creat d6/d9/df/d1b/f37 x:0 0 0 2024-09-06T14:44:35.688 INFO:tasks.workunit.client.1.smithi165.stdout:6/796: read d29/d6a/f8a [1581689,60737] 0 2024-09-06T14:44:35.688 INFO:tasks.workunit.client.1.smithi165.stdout:8/764: fsync d0/d19/d36/d2d/d3f/ff0 0 2024-09-06T14:44:35.690 INFO:tasks.workunit.client.0.smithi052.stdout:1/180: symlink d1/da/d14/l35 0 2024-09-06T14:44:35.691 INFO:tasks.workunit.client.1.smithi165.stdout:7/638: dwrite d20/d33/d53/fb9 [4194304,4194304] 0 2024-09-06T14:44:35.691 INFO:tasks.workunit.client.1.smithi165.stdout:1/711: dread d0/d2a/d18/d24/d4b/d93/d2b/fad [0,4194304] 0 2024-09-06T14:44:35.692 INFO:tasks.workunit.client.0.smithi052.stdout:1/181: mkdir d1/da/d36 0 2024-09-06T14:44:35.694 INFO:tasks.workunit.client.1.smithi165.stdout:8/765: write d0/d19/d36/d2d/d33/d3a/d46/fa7 [6321157,34641] 0 2024-09-06T14:44:35.695 INFO:tasks.workunit.client.1.smithi165.stdout:0/709: read fb [3362838,6107] 0 2024-09-06T14:44:35.696 INFO:tasks.workunit.client.0.smithi052.stdout:1/182: symlink d1/db/d18/l37 0 2024-09-06T14:44:35.697 INFO:tasks.workunit.client.1.smithi165.stdout:1/712: chown d0/d2a/d18/d24/d4b/d93/d68/dae 693447638 1 2024-09-06T14:44:35.698 INFO:tasks.workunit.client.0.smithi052.stdout:3/227: truncate d0/d11/d29/f37 3068497 0 2024-09-06T14:44:35.700 INFO:tasks.workunit.client.1.smithi165.stdout:9/872: creat db/de/d15/d17/d72/d9e/f110 x:0 0 0 2024-09-06T14:44:35.701 INFO:tasks.workunit.client.1.smithi165.stdout:6/797: dwrite d29/d6a/f8f [0,4194304] 0 2024-09-06T14:44:35.701 INFO:tasks.workunit.client.0.smithi052.stdout:1/183: mknod d1/da/d12/c38 0 2024-09-06T14:44:35.701 INFO:tasks.workunit.client.0.smithi052.stdout:1/184: readlink d1/l11 0 2024-09-06T14:44:35.701 INFO:tasks.workunit.client.0.smithi052.stdout:1/185: chown d1/db/de/f24 934316 1 2024-09-06T14:44:35.702 INFO:tasks.workunit.client.0.smithi052.stdout:3/228: rmdir d0/d11/d12/d17 39 2024-09-06T14:44:35.703 INFO:tasks.workunit.client.1.smithi165.stdout:3/789: fsync d1/d7c/d7e/fc0 0 2024-09-06T14:44:35.704 INFO:tasks.workunit.client.0.smithi052.stdout:8/156: write f1 [398804,83303] 0 2024-09-06T14:44:35.704 INFO:tasks.workunit.client.0.smithi052.stdout:8/157: write f1 [3655750,18179] 0 2024-09-06T14:44:35.708 INFO:tasks.workunit.client.0.smithi052.stdout:3/229: rename d0/d11/l20 to d0/d11/d29/d35/l3d 0 2024-09-06T14:44:35.710 INFO:tasks.workunit.client.0.smithi052.stdout:8/158: symlink d6/d9/d1f/d14/l38 0 2024-09-06T14:44:35.711 INFO:tasks.workunit.client.0.smithi052.stdout:3/230: dread d0/d11/d15/d19/f2f [0,4194304] 0 2024-09-06T14:44:35.714 INFO:tasks.workunit.client.1.smithi165.stdout:5/857: rename d6/l9 to d6/d1c/d28/d2d/d3c/d44/l133 0 2024-09-06T14:44:35.715 INFO:tasks.workunit.client.0.smithi052.stdout:8/159: mknod d6/d22/d31/c39 0 2024-09-06T14:44:35.718 INFO:tasks.workunit.client.0.smithi052.stdout:8/160: dread d6/d9/d1f/d14/f29 [0,4194304] 0 2024-09-06T14:44:35.719 INFO:tasks.workunit.client.0.smithi052.stdout:8/161: chown d6/d9/d1f/d14 19 1 2024-09-06T14:44:35.719 INFO:tasks.workunit.client.0.smithi052.stdout:3/231: rename d0/fc to d0/d11/d29/f3e 0 2024-09-06T14:44:35.721 INFO:tasks.workunit.client.0.smithi052.stdout:3/232: truncate d0/d11/d29/f2d 616084 0 2024-09-06T14:44:35.729 INFO:tasks.workunit.client.1.smithi165.stdout:0/710: truncate d15/d19/f1e 2596590 0 2024-09-06T14:44:35.729 INFO:tasks.workunit.client.0.smithi052.stdout:8/162: dwrite d6/d22/d31/f34 [0,4194304] 0 2024-09-06T14:44:35.730 INFO:tasks.workunit.client.0.smithi052.stdout:1/186: dwrite d1/db/de/f1c [0,4194304] 0 2024-09-06T14:44:35.731 INFO:tasks.workunit.client.1.smithi165.stdout:8/766: dwrite d0/d14/d3e/dcf/fa1 [0,4194304] 0 2024-09-06T14:44:35.731 INFO:tasks.workunit.client.1.smithi165.stdout:1/713: symlink d0/d2a/d18/d24/d4b/d93/d6a/le1 0 2024-09-06T14:44:35.732 INFO:tasks.workunit.client.0.smithi052.stdout:8/163: write d6/d9/d1f/d19/f2d [5069649,15439] 0 2024-09-06T14:44:35.732 INFO:tasks.workunit.client.1.smithi165.stdout:8/767: fdatasync d0/d19/d36/d28/f90 0 2024-09-06T14:44:35.739 INFO:tasks.workunit.client.1.smithi165.stdout:6/798: symlink d29/d32/d7a/lf7 0 2024-09-06T14:44:35.739 INFO:tasks.workunit.client.1.smithi165.stdout:9/873: creat db/de/d16/d2e/da7/f111 x:0 0 0 2024-09-06T14:44:35.739 INFO:tasks.workunit.client.1.smithi165.stdout:6/799: chown d29/d39/c4d 14819 1 2024-09-06T14:44:35.739 INFO:tasks.workunit.client.0.smithi052.stdout:8/164: dread d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:35.741 INFO:tasks.workunit.client.0.smithi052.stdout:8/165: dread d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:35.742 INFO:tasks.workunit.client.1.smithi165.stdout:3/790: mkdir d1/d4a/db4/d106 0 2024-09-06T14:44:35.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/233: truncate d0/d11/d15/d19/f2f 919792 0 2024-09-06T14:44:35.744 INFO:tasks.workunit.client.1.smithi165.stdout:2/690: sync 2024-09-06T14:44:35.746 INFO:tasks.workunit.client.1.smithi165.stdout:4/809: link d5/d1b/d1c/d8c/fcf d5/d1b/d1c/d20/d75/d83/dae/f113 0 2024-09-06T14:44:35.747 INFO:tasks.workunit.client.1.smithi165.stdout:4/810: chown d5/d1b/d61/d77/cb9 8940 1 2024-09-06T14:44:35.750 INFO:tasks.workunit.client.0.smithi052.stdout:1/187: mknod d1/da/d14/d2e/c39 0 2024-09-06T14:44:35.752 INFO:tasks.workunit.client.0.smithi052.stdout:8/166: chown d6/d9/d1f/d14/c1d 434534 1 2024-09-06T14:44:35.755 INFO:tasks.workunit.client.1.smithi165.stdout:5/858: fsync d6/d1c/d28/f42 0 2024-09-06T14:44:35.755 INFO:tasks.workunit.client.1.smithi165.stdout:5/859: chown d6/d1c/d28/d4b/d55/d8a/caf 1596965 1 2024-09-06T14:44:35.756 INFO:tasks.workunit.client.0.smithi052.stdout:3/234: dread d0/f3 [0,4194304] 0 2024-09-06T14:44:35.757 INFO:tasks.workunit.client.0.smithi052.stdout:3/235: readlink d0/d11/d15/d1b/l39 0 2024-09-06T14:44:35.757 INFO:tasks.workunit.client.1.smithi165.stdout:7/639: creat d20/d33/d6a/d90/fc8 x:0 0 0 2024-09-06T14:44:35.757 INFO:tasks.workunit.client.0.smithi052.stdout:3/236: chown d0/fe 45059972 1 2024-09-06T14:44:35.757 INFO:tasks.workunit.client.0.smithi052.stdout:1/188: rmdir d1/db 39 2024-09-06T14:44:35.758 INFO:tasks.workunit.client.0.smithi052.stdout:1/189: chown d1/da/l15 52293 1 2024-09-06T14:44:35.760 INFO:tasks.workunit.client.1.smithi165.stdout:5/860: dwrite d6/f27 [0,4194304] 0 2024-09-06T14:44:35.761 INFO:tasks.workunit.client.0.smithi052.stdout:3/237: dread d0/fe [0,4194304] 0 2024-09-06T14:44:35.763 INFO:tasks.workunit.client.1.smithi165.stdout:8/768: rename d0 to d0/d14/d10b 22 2024-09-06T14:44:35.767 INFO:tasks.workunit.client.1.smithi165.stdout:3/791: mkdir d1/da/dc/d3b/dc6/d89/d107 0 2024-09-06T14:44:35.769 INFO:tasks.workunit.client.1.smithi165.stdout:2/691: symlink d9/d88/dac/da4/le1 0 2024-09-06T14:44:35.773 INFO:tasks.workunit.client.1.smithi165.stdout:7/640: rmdir d20/d33/d53 39 2024-09-06T14:44:35.774 INFO:tasks.workunit.client.1.smithi165.stdout:5/861: mkdir d6/d1c/d28/d88/d134 0 2024-09-06T14:44:35.776 INFO:tasks.workunit.client.1.smithi165.stdout:1/714: rename d0/d1c/d1d/d22/fab to d0/d2a/d18/d24/d4b/d93/d68/d75/fe2 0 2024-09-06T14:44:35.777 INFO:tasks.workunit.client.1.smithi165.stdout:4/811: dwrite d5/d1b/d1c/d41/d9e/fd0 [4194304,4194304] 0 2024-09-06T14:44:35.777 INFO:tasks.workunit.client.1.smithi165.stdout:6/800: creat d29/d93/d87/df2/ff8 x:0 0 0 2024-09-06T14:44:35.778 INFO:tasks.workunit.client.1.smithi165.stdout:6/801: chown d29/d6a/d83/la5 51188 1 2024-09-06T14:44:35.780 INFO:tasks.workunit.client.1.smithi165.stdout:0/711: fsync f3 0 2024-09-06T14:44:35.780 INFO:tasks.workunit.client.1.smithi165.stdout:6/802: chown d29/d39/d5b/d62/d94/db7/dde 4944803 1 2024-09-06T14:44:35.780 INFO:tasks.workunit.client.1.smithi165.stdout:1/715: truncate d0/d2a/d18/d24/d4b/d5f/f63 1359284 0 2024-09-06T14:44:35.783 INFO:tasks.workunit.client.1.smithi165.stdout:9/874: rename db/de/d15/f28 to db/de/d15/d17/dc3/f112 0 2024-09-06T14:44:35.783 INFO:tasks.workunit.client.1.smithi165.stdout:6/803: chown d29/d6a/d71 12384 1 2024-09-06T14:44:35.784 INFO:tasks.workunit.client.1.smithi165.stdout:0/712: write d15/d19/d2c/fb5 [80582,78308] 0 2024-09-06T14:44:35.784 INFO:tasks.workunit.client.1.smithi165.stdout:4/812: symlink d5/d1b/d1c/d55/d7d/l114 0 2024-09-06T14:44:35.786 INFO:tasks.workunit.client.1.smithi165.stdout:3/792: mkdir d1/da/dc/d3b/dc6/d108 0 2024-09-06T14:44:35.786 INFO:tasks.workunit.client.1.smithi165.stdout:9/875: chown db/de/d16/d2e/l8d 74 1 2024-09-06T14:44:35.788 INFO:tasks.workunit.client.1.smithi165.stdout:1/716: truncate d0/d1c/d41/f5e 8928403 0 2024-09-06T14:44:35.788 INFO:tasks.workunit.client.1.smithi165.stdout:7/641: creat d20/d4d/fc9 x:0 0 0 2024-09-06T14:44:35.788 INFO:tasks.workunit.client.1.smithi165.stdout:8/769: link d0/d14/d3e/l5d d0/d34/d6b/d94/d70/db7/l10c 0 2024-09-06T14:44:35.789 INFO:tasks.workunit.client.1.smithi165.stdout:3/793: chown d1/da/dc/d3b/dc6/d108 242 1 2024-09-06T14:44:35.790 INFO:tasks.workunit.client.1.smithi165.stdout:6/804: creat d29/d32/ff9 x:0 0 0 2024-09-06T14:44:35.791 INFO:tasks.workunit.client.1.smithi165.stdout:9/876: read db/de/d15/d17/d18/d7d/f5f [470070,96491] 0 2024-09-06T14:44:35.791 INFO:tasks.workunit.client.1.smithi165.stdout:2/692: dwrite d9/d25/d45/d75/d67/d76/f6a [0,4194304] 0 2024-09-06T14:44:35.792 INFO:tasks.workunit.client.1.smithi165.stdout:7/642: dread - d20/d3b/d69/da3/fba zero size 2024-09-06T14:44:35.793 INFO:tasks.workunit.client.1.smithi165.stdout:5/862: rename d6/d1c/f3a to d6/d1c/d28/d2d/dc0/f135 0 2024-09-06T14:44:35.796 INFO:tasks.workunit.client.1.smithi165.stdout:7/643: stat d20/d3b/c93 0 2024-09-06T14:44:35.799 INFO:tasks.workunit.client.1.smithi165.stdout:0/713: dwrite d15/d19/d28/f71 [0,4194304] 0 2024-09-06T14:44:35.800 INFO:tasks.workunit.client.1.smithi165.stdout:1/717: dwrite d0/d2a/f12 [0,4194304] 0 2024-09-06T14:44:35.802 INFO:tasks.workunit.client.1.smithi165.stdout:3/794: rmdir d1/d7c 39 2024-09-06T14:44:35.804 INFO:tasks.workunit.client.1.smithi165.stdout:1/718: truncate d0/d2a/d18/d24/d4b/d93/d6a/fac 352254 0 2024-09-06T14:44:35.807 INFO:tasks.workunit.client.1.smithi165.stdout:6/805: write d29/d39/d5b/d62/d94/fbc [2754349,5642] 0 2024-09-06T14:44:35.813 INFO:tasks.workunit.client.1.smithi165.stdout:0/714: mknod d15/d19/d28/d51/ceb 0 2024-09-06T14:44:35.814 INFO:tasks.workunit.client.1.smithi165.stdout:3/795: mkdir d1/da/dc/d3b/d71/d109 0 2024-09-06T14:44:35.815 INFO:tasks.workunit.client.1.smithi165.stdout:3/796: dread - d1/da/dc/d3b/d71/fdc zero size 2024-09-06T14:44:35.816 INFO:tasks.workunit.client.1.smithi165.stdout:2/693: mkdir d9/d25/d46/de2 0 2024-09-06T14:44:35.816 INFO:tasks.workunit.client.1.smithi165.stdout:3/797: fdatasync d1/da/dc/d3b/d71/fe3 0 2024-09-06T14:44:35.816 INFO:tasks.workunit.client.1.smithi165.stdout:8/770: getdents d0/d34/d6b/d94/d103 0 2024-09-06T14:44:35.818 INFO:tasks.workunit.client.1.smithi165.stdout:1/719: unlink d0/d1c/d1d/f3c 0 2024-09-06T14:44:35.819 INFO:tasks.workunit.client.1.smithi165.stdout:9/877: mkdir db/de/d15/d17/d18/d59/d113 0 2024-09-06T14:44:35.820 INFO:tasks.workunit.client.1.smithi165.stdout:5/863: rename d6/lb1 to d6/d1c/d28/d2d/d3c/d109/l136 0 2024-09-06T14:44:35.822 INFO:tasks.workunit.client.1.smithi165.stdout:4/813: dwrite d5/d1b/d61/dd7/ddf/f38 [0,4194304] 0 2024-09-06T14:44:35.822 INFO:tasks.workunit.client.1.smithi165.stdout:2/694: creat d9/d25/d45/d75/d67/fe3 x:0 0 0 2024-09-06T14:44:35.823 INFO:tasks.workunit.client.1.smithi165.stdout:4/814: chown d5/d1b/d1c/d20/cd8 226 1 2024-09-06T14:44:35.823 INFO:tasks.workunit.client.1.smithi165.stdout:8/771: creat d0/d34/f10d x:0 0 0 2024-09-06T14:44:35.824 INFO:tasks.workunit.client.1.smithi165.stdout:4/815: chown c3 628974618 1 2024-09-06T14:44:35.824 INFO:tasks.workunit.client.1.smithi165.stdout:6/806: mkdir d29/d39/d5b/d62/d94/db7/dfa 0 2024-09-06T14:44:35.824 INFO:tasks.workunit.client.1.smithi165.stdout:8/772: fdatasync d0/d34/d6b/fa0 0 2024-09-06T14:44:35.825 INFO:tasks.workunit.client.1.smithi165.stdout:1/720: mkdir d0/d1c/d41/de3 0 2024-09-06T14:44:35.827 INFO:tasks.workunit.client.1.smithi165.stdout:9/878: write db/de/d15/d17/d18/f5d [3034083,91478] 0 2024-09-06T14:44:35.828 INFO:tasks.workunit.client.1.smithi165.stdout:5/864: chown d6/f37 861 1 2024-09-06T14:44:35.829 INFO:tasks.workunit.client.1.smithi165.stdout:8/773: truncate d0/d19/d36/d28/dda/fe5 273526 0 2024-09-06T14:44:35.829 INFO:tasks.workunit.client.1.smithi165.stdout:3/798: mkdir d1/d19/d92/d10a 0 2024-09-06T14:44:35.831 INFO:tasks.workunit.client.1.smithi165.stdout:4/816: dread d5/d1b/d66/f7f [0,4194304] 0 2024-09-06T14:44:35.832 INFO:tasks.workunit.client.1.smithi165.stdout:7/644: rename d20/l38 to d20/d3b/d69/d88/dc6/lca 0 2024-09-06T14:44:35.834 INFO:tasks.workunit.client.1.smithi165.stdout:9/879: creat db/de/d15/d17/d18/d7d/d8e/ded/df1/f114 x:0 0 0 2024-09-06T14:44:35.835 INFO:tasks.workunit.client.1.smithi165.stdout:2/695: creat d9/d88/dc5/fe4 x:0 0 0 2024-09-06T14:44:35.836 INFO:tasks.workunit.client.1.smithi165.stdout:2/696: write d9/d23/d52/daa/fc6 [169544,23239] 0 2024-09-06T14:44:35.838 INFO:tasks.workunit.client.1.smithi165.stdout:5/865: symlink d6/d1c/d28/d2d/d49/de9/l137 0 2024-09-06T14:44:35.842 INFO:tasks.workunit.client.1.smithi165.stdout:0/715: getdents d15/d19/d28 0 2024-09-06T14:44:35.844 INFO:tasks.workunit.client.1.smithi165.stdout:8/774: dwrite d0/d19/f86 [0,4194304] 0 2024-09-06T14:44:35.851 INFO:tasks.workunit.client.1.smithi165.stdout:2/697: dread d9/f1e [0,4194304] 0 2024-09-06T14:44:35.852 INFO:tasks.workunit.client.1.smithi165.stdout:2/698: read d9/f1e [3691368,70303] 0 2024-09-06T14:44:35.852 INFO:tasks.workunit.client.1.smithi165.stdout:2/699: chown d9/d3b/c8d 48 1 2024-09-06T14:44:35.897 INFO:tasks.workunit.client.0.smithi052.stdout:8/167: getdents d6/d9/d1f/d33 0 2024-09-06T14:44:35.898 INFO:tasks.workunit.client.0.smithi052.stdout:3/238: rename d0/cd to d0/c3f 0 2024-09-06T14:44:35.899 INFO:tasks.workunit.client.0.smithi052.stdout:1/190: dread d1/db/de/f1c [0,4194304] 0 2024-09-06T14:44:35.899 INFO:tasks.workunit.client.0.smithi052.stdout:1/191: stat d1/db/l21 0 2024-09-06T14:44:35.902 INFO:tasks.workunit.client.1.smithi165.stdout:1/721: rename d0/d2a/d23/d56 to d0/d2a/d18/d24/d4b/d5f/db8/de4 0 2024-09-06T14:44:35.903 INFO:tasks.workunit.client.1.smithi165.stdout:1/722: chown d0/d1c/d1d/cc2 7182 1 2024-09-06T14:44:35.903 INFO:tasks.workunit.client.1.smithi165.stdout:1/723: chown d0/d2a/d18/d24/d4b/d93/d68/dae/fc4 10 1 2024-09-06T14:44:35.905 INFO:tasks.workunit.client.0.smithi052.stdout:3/239: rmdir d0/d11 39 2024-09-06T14:44:35.907 INFO:tasks.workunit.client.1.smithi165.stdout:6/807: creat d29/d6a/ffb x:0 0 0 2024-09-06T14:44:35.907 INFO:tasks.workunit.client.0.smithi052.stdout:8/168: creat d6/d22/f3a x:0 0 0 2024-09-06T14:44:35.908 INFO:tasks.workunit.client.1.smithi165.stdout:1/724: dread d0/d2a/d18/d24/d4b/d93/d68/fa3 [0,4194304] 0 2024-09-06T14:44:35.909 INFO:tasks.workunit.client.0.smithi052.stdout:1/192: mknod d1/da/d14/d2e/c3a 0 2024-09-06T14:44:35.910 INFO:tasks.workunit.client.1.smithi165.stdout:4/817: write d5/d1b/d61/dd7/ddf/f32 [2456959,20315] 0 2024-09-06T14:44:35.912 INFO:tasks.workunit.client.0.smithi052.stdout:3/240: truncate d0/d11/d29/f2d 961164 0 2024-09-06T14:44:35.913 INFO:tasks.workunit.client.0.smithi052.stdout:8/169: rename d6/d9/d1f/d19/c24 to d6/d9/d1f/d33/c3b 0 2024-09-06T14:44:35.914 INFO:tasks.workunit.client.1.smithi165.stdout:5/866: dwrite d6/d1c/d28/d4b/d55/d8a/f8d [4194304,4194304] 0 2024-09-06T14:44:35.914 INFO:tasks.workunit.client.0.smithi052.stdout:8/170: stat d6/d9/d1f/d14/f29 0 2024-09-06T14:44:35.915 INFO:tasks.workunit.client.0.smithi052.stdout:1/193: symlink d1/db/l3b 0 2024-09-06T14:44:35.917 INFO:tasks.workunit.client.1.smithi165.stdout:0/716: truncate d15/d19/d2c/f45 880401 0 2024-09-06T14:44:35.918 INFO:tasks.workunit.client.1.smithi165.stdout:0/717: stat d15/d19/d28/d3a/d5d/fb7 0 2024-09-06T14:44:35.919 INFO:tasks.workunit.client.1.smithi165.stdout:2/700: symlink d9/d25/d46/d7e/d90/dd8/le5 0 2024-09-06T14:44:35.920 INFO:tasks.workunit.client.0.smithi052.stdout:3/241: creat d0/d11/f40 x:0 0 0 2024-09-06T14:44:35.922 INFO:tasks.workunit.client.1.smithi165.stdout:8/775: rename d0/d34/d6b/d94/d68 to d0/d10a/d10e 0 2024-09-06T14:44:35.925 INFO:tasks.workunit.client.0.smithi052.stdout:1/194: creat d1/da/d36/f3c x:0 0 0 2024-09-06T14:44:35.926 INFO:tasks.workunit.client.0.smithi052.stdout:1/195: chown d1/da 161130 1 2024-09-06T14:44:35.928 INFO:tasks.workunit.client.1.smithi165.stdout:5/867: dread d6/d1c/d28/d4b/d55/d8a/de1/fa4 [0,4194304] 0 2024-09-06T14:44:35.929 INFO:tasks.workunit.client.1.smithi165.stdout:6/808: unlink d29/d39/d5b/d62/d9f/cb2 0 2024-09-06T14:44:35.929 INFO:tasks.workunit.client.1.smithi165.stdout:6/809: chown d29/ce3 306000 1 2024-09-06T14:44:35.931 INFO:tasks.workunit.client.1.smithi165.stdout:4/818: stat d5/d1b/c3e 0 2024-09-06T14:44:35.932 INFO:tasks.workunit.client.1.smithi165.stdout:4/819: chown d5/d1b/d61/d77/d93/lf7 366830781 1 2024-09-06T14:44:35.935 INFO:tasks.workunit.client.0.smithi052.stdout:1/196: dwrite d1/db/de/f24 [4194304,4194304] 0 2024-09-06T14:44:35.937 INFO:tasks.workunit.client.1.smithi165.stdout:2/701: rmdir d9/d25/d45/d75/d67 39 2024-09-06T14:44:35.938 INFO:tasks.workunit.client.1.smithi165.stdout:2/702: chown d9/d23/d29/d48/db1 108309 1 2024-09-06T14:44:35.940 INFO:tasks.workunit.client.0.smithi052.stdout:1/197: unlink d1/db/de/f1c 0 2024-09-06T14:44:35.942 INFO:tasks.workunit.client.1.smithi165.stdout:9/880: mkdir db/de/d15/d17/d86/ddd/d115 0 2024-09-06T14:44:35.943 INFO:tasks.workunit.client.0.smithi052.stdout:1/198: truncate d1/da/f32 825483 0 2024-09-06T14:44:35.947 INFO:tasks.workunit.client.0.smithi052.stdout:3/242: dwrite d0/d11/d29/f37 [0,4194304] 0 2024-09-06T14:44:35.948 INFO:tasks.workunit.client.0.smithi052.stdout:1/199: fsync d1/f4 0 2024-09-06T14:44:35.950 INFO:tasks.workunit.client.1.smithi165.stdout:5/868: read d6/d1c/d64/f65 [668037,57013] 0 2024-09-06T14:44:35.951 INFO:tasks.workunit.client.1.smithi165.stdout:5/869: chown d6/d1c/c56 4 1 2024-09-06T14:44:35.951 INFO:tasks.workunit.client.1.smithi165.stdout:5/870: write d6/fac [433972,29382] 0 2024-09-06T14:44:35.951 INFO:tasks.workunit.client.1.smithi165.stdout:6/810: creat d29/d93/d87/df2/ffc x:0 0 0 2024-09-06T14:44:35.952 INFO:tasks.workunit.client.1.smithi165.stdout:6/811: stat d29/d32/d7a 0 2024-09-06T14:44:35.953 INFO:tasks.workunit.client.1.smithi165.stdout:6/812: dread - d29/d39/d5b/d62/d94/db7/dcc/df0/feb zero size 2024-09-06T14:44:35.954 INFO:tasks.workunit.client.1.smithi165.stdout:6/813: write d29/d32/fb5 [1707387,53207] 0 2024-09-06T14:44:35.955 INFO:tasks.workunit.client.0.smithi052.stdout:1/200: creat d1/da/d36/f3d x:0 0 0 2024-09-06T14:44:35.955 INFO:tasks.workunit.client.1.smithi165.stdout:4/820: rmdir d5/d1b/d61/dd7/ddf/ddc 39 2024-09-06T14:44:35.956 INFO:tasks.workunit.client.0.smithi052.stdout:1/201: truncate d1/da/d36/f3d 515650 0 2024-09-06T14:44:35.958 INFO:tasks.workunit.client.1.smithi165.stdout:2/703: unlink d9/d25/d46/d7e/ca1 0 2024-09-06T14:44:35.959 INFO:tasks.workunit.client.0.smithi052.stdout:1/202: mkdir d1/da/d3e 0 2024-09-06T14:44:35.960 INFO:tasks.workunit.client.0.smithi052.stdout:1/203: chown d1/da/d14/f25 57043057 1 2024-09-06T14:44:35.961 INFO:tasks.workunit.client.1.smithi165.stdout:7/645: write d20/d3b/d69/d88/d30/f31 [1507094,53479] 0 2024-09-06T14:44:35.963 INFO:tasks.workunit.client.0.smithi052.stdout:1/204: creat d1/db/f3f x:0 0 0 2024-09-06T14:44:35.965 INFO:tasks.workunit.client.0.smithi052.stdout:3/243: write d0/f1a [2454796,34383] 0 2024-09-06T14:44:35.969 INFO:tasks.workunit.client.1.smithi165.stdout:5/871: creat d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/f138 x:0 0 0 2024-09-06T14:44:35.970 INFO:tasks.workunit.client.1.smithi165.stdout:5/872: write d6/d1c/d64/f12b [217714,67991] 0 2024-09-06T14:44:35.971 INFO:tasks.workunit.client.0.smithi052.stdout:1/205: symlink d1/da/d3e/l40 0 2024-09-06T14:44:35.972 INFO:tasks.workunit.client.1.smithi165.stdout:3/799: getdents d1/d19/d92/df1 0 2024-09-06T14:44:35.973 INFO:tasks.workunit.client.1.smithi165.stdout:3/800: chown d1/da/dc/d3b 226659312 1 2024-09-06T14:44:35.977 INFO:tasks.workunit.client.1.smithi165.stdout:4/821: truncate d5/f5a 561528 0 2024-09-06T14:44:35.977 INFO:tasks.workunit.client.0.smithi052.stdout:3/244: creat d0/d11/d12/f41 x:0 0 0 2024-09-06T14:44:35.978 INFO:tasks.workunit.client.1.smithi165.stdout:0/718: creat d15/d19/d50/fec x:0 0 0 2024-09-06T14:44:35.978 INFO:tasks.workunit.client.0.smithi052.stdout:3/245: stat d0/d11/d12/l1f 0 2024-09-06T14:44:35.978 INFO:tasks.workunit.client.0.smithi052.stdout:1/206: dwrite d1/da/ff [0,4194304] 0 2024-09-06T14:44:35.980 INFO:tasks.workunit.client.0.smithi052.stdout:1/207: chown d1/db/de/f24 478431995 1 2024-09-06T14:44:35.980 INFO:tasks.workunit.client.1.smithi165.stdout:2/704: write d9/d25/d45/d75/d67/d76/f3c [3414842,20378] 0 2024-09-06T14:44:35.981 INFO:tasks.workunit.client.1.smithi165.stdout:9/881: mkdir db/de/d15/d17/d86/ddd/d115/d116 0 2024-09-06T14:44:35.982 INFO:tasks.workunit.client.0.smithi052.stdout:1/208: dread d1/da/f32 [0,4194304] 0 2024-09-06T14:44:35.983 INFO:tasks.workunit.client.0.smithi052.stdout:1/209: rename d1 to d1/da/d14/d41 22 2024-09-06T14:44:35.983 INFO:tasks.workunit.client.1.smithi165.stdout:8/776: rmdir d0/d5e/dba 0 2024-09-06T14:44:35.984 INFO:tasks.workunit.client.0.smithi052.stdout:1/210: dread - d1/db/de/f2b zero size 2024-09-06T14:44:35.985 INFO:tasks.workunit.client.0.smithi052.stdout:3/246: dread d0/d11/d29/d35/f28 [0,4194304] 0 2024-09-06T14:44:35.987 INFO:tasks.workunit.client.1.smithi165.stdout:1/725: getdents d0/d1c 0 2024-09-06T14:44:35.988 INFO:tasks.workunit.client.0.smithi052.stdout:1/211: creat d1/da/d14/d2e/f42 x:0 0 0 2024-09-06T14:44:35.991 INFO:tasks.workunit.client.0.smithi052.stdout:1/212: symlink d1/da/l43 0 2024-09-06T14:44:35.992 INFO:tasks.workunit.client.0.smithi052.stdout:3/247: dread d0/d11/d29/f3e [0,4194304] 0 2024-09-06T14:44:35.994 INFO:tasks.workunit.client.0.smithi052.stdout:1/213: write d1/da/d36/f3d [887048,79192] 0 2024-09-06T14:44:35.995 INFO:tasks.workunit.client.0.smithi052.stdout:1/214: stat d1/l22 0 2024-09-06T14:44:35.995 INFO:tasks.workunit.client.1.smithi165.stdout:0/719: rename d15/d19/d66/fd8 to d15/d19/d28/fed 0 2024-09-06T14:44:35.995 INFO:tasks.workunit.client.1.smithi165.stdout:8/777: dwrite d0/d19/d7f/f9a [0,4194304] 0 2024-09-06T14:44:35.996 INFO:tasks.workunit.client.1.smithi165.stdout:1/726: dwrite d0/d2a/d18/d24/d4b/d93/dbd/fa6 [0,4194304] 0 2024-09-06T14:44:36.001 INFO:tasks.workunit.client.0.smithi052.stdout:3/248: creat d0/d11/d15/f42 x:0 0 0 2024-09-06T14:44:36.004 INFO:tasks.workunit.client.0.smithi052.stdout:1/215: rename d1/f4 to d1/da/d3e/f44 0 2024-09-06T14:44:36.004 INFO:tasks.workunit.client.1.smithi165.stdout:9/882: dread db/de/d15/d17/d18/d7d/f10f [0,4194304] 0 2024-09-06T14:44:36.006 INFO:tasks.workunit.client.1.smithi165.stdout:7/646: fsync d20/d65/f34 0 2024-09-06T14:44:36.009 INFO:tasks.workunit.client.0.smithi052.stdout:3/249: creat d0/d11/d15/f43 x:0 0 0 2024-09-06T14:44:36.010 INFO:tasks.workunit.client.1.smithi165.stdout:5/873: dwrite d6/f37 [0,4194304] 0 2024-09-06T14:44:36.012 INFO:tasks.workunit.client.0.smithi052.stdout:1/216: dwrite d1/da/ff [0,4194304] 0 2024-09-06T14:44:36.015 INFO:tasks.workunit.client.1.smithi165.stdout:6/814: truncate d29/f66 5284162 0 2024-09-06T14:44:36.017 INFO:tasks.workunit.client.1.smithi165.stdout:5/874: dwrite d6/d1c/d28/d2d/d61/ddc/fe7 [0,4194304] 0 2024-09-06T14:44:36.018 INFO:tasks.workunit.client.0.smithi052.stdout:3/250: write d0/d11/d29/d35/f28 [1547772,97107] 0 2024-09-06T14:44:36.025 INFO:tasks.workunit.client.0.smithi052.stdout:1/217: dwrite d1/da/d36/f3c [0,4194304] 0 2024-09-06T14:44:36.029 INFO:tasks.workunit.client.1.smithi165.stdout:8/778: creat d0/d9e/f10f x:0 0 0 2024-09-06T14:44:36.030 INFO:tasks.workunit.client.1.smithi165.stdout:0/720: dread d15/d55/f84 [0,4194304] 0 2024-09-06T14:44:36.033 INFO:tasks.workunit.client.1.smithi165.stdout:9/883: symlink db/de/d15/d17/d18/l117 0 2024-09-06T14:44:36.035 INFO:tasks.workunit.client.0.smithi052.stdout:3/251: symlink d0/d11/d12/l44 0 2024-09-06T14:44:36.035 INFO:tasks.workunit.client.1.smithi165.stdout:1/727: dread d0/fa4 [0,4194304] 0 2024-09-06T14:44:36.039 INFO:tasks.workunit.client.1.smithi165.stdout:7/647: truncate d20/d3b/f8b 483290 0 2024-09-06T14:44:36.039 INFO:tasks.workunit.client.1.smithi165.stdout:7/648: readlink d20/d3b/d69/d88/d30/l3c 0 2024-09-06T14:44:36.040 INFO:tasks.workunit.client.1.smithi165.stdout:7/649: chown d20/d3b/d69/d88/d30/cb6 756 1 2024-09-06T14:44:36.042 INFO:tasks.workunit.client.0.smithi052.stdout:1/218: link d1/da/l43 d1/db/d18/l45 0 2024-09-06T14:44:36.043 INFO:tasks.workunit.client.0.smithi052.stdout:1/219: write d1/da/d14/f25 [1786239,36321] 0 2024-09-06T14:44:36.050 INFO:tasks.workunit.client.0.smithi052.stdout:1/220: creat d1/da/d12/f46 x:0 0 0 2024-09-06T14:44:36.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:35 smithi165 ceph-mon[36229]: pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 177 MiB/s wr, 358 op/s 2024-09-06T14:44:36.095 INFO:tasks.workunit.client.1.smithi165.stdout:2/705: sync 2024-09-06T14:44:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:35 smithi052 ceph-mon[28627]: pgmap v20: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 177 MiB/s wr, 358 op/s 2024-09-06T14:44:36.155 INFO:tasks.workunit.client.1.smithi165.stdout:0/721: symlink d15/d19/d50/d53/d7c/dbb/lee 0 2024-09-06T14:44:36.156 INFO:tasks.workunit.client.0.smithi052.stdout:3/252: link d0/d11/d12/d17/c33 d0/d11/d15/d19/c45 0 2024-09-06T14:44:36.157 INFO:tasks.workunit.client.1.smithi165.stdout:9/884: write db/de/d15/d17/d86/fac [405250,55002] 0 2024-09-06T14:44:36.158 INFO:tasks.workunit.client.0.smithi052.stdout:1/221: mkdir d1/da/d3e/d47 0 2024-09-06T14:44:36.160 INFO:tasks.workunit.client.0.smithi052.stdout:1/222: symlink d1/da/d14/d2e/l48 0 2024-09-06T14:44:36.162 INFO:tasks.workunit.client.1.smithi165.stdout:6/815: creat d29/d32/dee/ffd x:0 0 0 2024-09-06T14:44:36.162 INFO:tasks.workunit.client.1.smithi165.stdout:6/816: stat l1b 0 2024-09-06T14:44:36.162 INFO:tasks.workunit.client.0.smithi052.stdout:1/223: creat d1/da/f49 x:0 0 0 2024-09-06T14:44:36.163 INFO:tasks.workunit.client.1.smithi165.stdout:5/875: mknod d6/d1c/d28/d4b/d55/d8a/c139 0 2024-09-06T14:44:36.163 INFO:tasks.workunit.client.0.smithi052.stdout:1/224: chown d1/da/d14/c33 28940 1 2024-09-06T14:44:36.163 INFO:tasks.workunit.client.1.smithi165.stdout:3/801: getdents d1/da/dc/d3b/dc6/dbc 0 2024-09-06T14:44:36.165 INFO:tasks.workunit.client.0.smithi052.stdout:3/253: getdents d0/d11/d15 0 2024-09-06T14:44:36.165 INFO:tasks.workunit.client.1.smithi165.stdout:4/822: getdents d5/d1b/d61/dd7/ddf 0 2024-09-06T14:44:36.166 INFO:tasks.workunit.client.0.smithi052.stdout:3/254: write d0/ff [3641891,27223] 0 2024-09-06T14:44:36.166 INFO:tasks.workunit.client.1.smithi165.stdout:8/779: mkdir d0/d19/d36/d2d/d110 0 2024-09-06T14:44:36.168 INFO:tasks.workunit.client.1.smithi165.stdout:2/706: mkdir d9/d25/d45/d75/d67/dd1/de6 0 2024-09-06T14:44:36.170 INFO:tasks.workunit.client.1.smithi165.stdout:6/817: rmdir d29/d39/d5b/d68 39 2024-09-06T14:44:36.173 INFO:tasks.workunit.client.1.smithi165.stdout:4/823: unlink d5/d1b/d1c/d55/d7d/fa8 0 2024-09-06T14:44:36.174 INFO:tasks.workunit.client.1.smithi165.stdout:1/728: creat d0/d2a/d18/fe5 x:0 0 0 2024-09-06T14:44:36.174 INFO:tasks.workunit.client.1.smithi165.stdout:5/876: mknod d6/d1c/d28/d4b/d10b/d116/c13a 0 2024-09-06T14:44:36.175 INFO:tasks.workunit.client.1.smithi165.stdout:0/722: fsync d15/d19/d28/d3a/d3f/f48 0 2024-09-06T14:44:36.175 INFO:tasks.workunit.client.1.smithi165.stdout:3/802: unlink d1/dbd/fc9 0 2024-09-06T14:44:36.176 INFO:tasks.workunit.client.1.smithi165.stdout:7/650: dread d20/f21 [0,4194304] 0 2024-09-06T14:44:36.176 INFO:tasks.workunit.client.1.smithi165.stdout:6/818: creat d29/d93/d87/df2/ffe x:0 0 0 2024-09-06T14:44:36.177 INFO:tasks.workunit.client.1.smithi165.stdout:2/707: dwrite d9/d25/d46/d7e/d90/fb9 [0,4194304] 0 2024-09-06T14:44:36.181 INFO:tasks.workunit.client.0.smithi052.stdout:1/225: mkdir d1/da/d3e/d47/d4a 0 2024-09-06T14:44:36.181 INFO:tasks.workunit.client.0.smithi052.stdout:3/255: mkdir d0/d11/d29/d35/d46 0 2024-09-06T14:44:36.182 INFO:tasks.workunit.client.0.smithi052.stdout:3/256: chown d0/d11/d15/d19 122862687 1 2024-09-06T14:44:36.182 INFO:tasks.workunit.client.0.smithi052.stdout:1/226: write d1/f9 [698474,123752] 0 2024-09-06T14:44:36.183 INFO:tasks.workunit.client.0.smithi052.stdout:3/257: readlink d0/d11/d15/d19/l3c 0 2024-09-06T14:44:36.184 INFO:tasks.workunit.client.0.smithi052.stdout:3/258: fsync d0/d11/d15/f42 0 2024-09-06T14:44:36.185 INFO:tasks.workunit.client.0.smithi052.stdout:1/227: mknod d1/da/d14/c4b 0 2024-09-06T14:44:36.188 INFO:tasks.workunit.client.0.smithi052.stdout:3/259: creat d0/d11/d12/f47 x:0 0 0 2024-09-06T14:44:36.191 INFO:tasks.workunit.client.0.smithi052.stdout:1/228: dwrite d1/da/d14/f25 [0,4194304] 0 2024-09-06T14:44:36.197 INFO:tasks.workunit.client.0.smithi052.stdout:1/229: rename d1/db/c1b to d1/db/d18/c4c 0 2024-09-06T14:44:36.198 INFO:tasks.workunit.client.0.smithi052.stdout:3/260: dwrite d0/d11/d12/f47 [0,4194304] 0 2024-09-06T14:44:36.201 INFO:tasks.workunit.client.0.smithi052.stdout:1/230: rename d1/da/d14/l35 to d1/db/l4d 0 2024-09-06T14:44:36.203 INFO:tasks.workunit.client.0.smithi052.stdout:3/261: rename d0/d11/d29/f31 to d0/d11/d12/d17/f48 0 2024-09-06T14:44:36.204 INFO:tasks.workunit.client.0.smithi052.stdout:1/231: creat d1/da/d3e/d47/d4a/f4e x:0 0 0 2024-09-06T14:44:36.205 INFO:tasks.workunit.client.0.smithi052.stdout:3/262: chown d0/c3f 125632 1 2024-09-06T14:44:36.205 INFO:tasks.workunit.client.0.smithi052.stdout:1/232: write d1/f1d [524554,68215] 0 2024-09-06T14:44:36.206 INFO:tasks.workunit.client.0.smithi052.stdout:1/233: fsync d1/da/ff 0 2024-09-06T14:44:36.206 INFO:tasks.workunit.client.0.smithi052.stdout:1/234: dread - d1/db/f3f zero size 2024-09-06T14:44:36.209 INFO:tasks.workunit.client.0.smithi052.stdout:1/235: link d1/db/l26 d1/da/d36/l4f 0 2024-09-06T14:44:36.211 INFO:tasks.workunit.client.0.smithi052.stdout:1/236: mkdir d1/db/d50 0 2024-09-06T14:44:36.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/237: mknod d1/db/de/c51 0 2024-09-06T14:44:36.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/238: fdatasync d1/db/de/f2b 0 2024-09-06T14:44:36.220 INFO:tasks.workunit.client.1.smithi165.stdout:1/729: mknod d0/d2a/d23/ce6 0 2024-09-06T14:44:36.222 INFO:tasks.workunit.client.1.smithi165.stdout:2/708: chown d9/d3b/d78/lc2 3 1 2024-09-06T14:44:36.222 INFO:tasks.workunit.client.1.smithi165.stdout:8/780: dread d0/d19/d36/fb [0,4194304] 0 2024-09-06T14:44:36.223 INFO:tasks.workunit.client.1.smithi165.stdout:2/709: chown d9/l15 16428064 1 2024-09-06T14:44:36.223 INFO:tasks.workunit.client.1.smithi165.stdout:3/803: symlink d1/d41/l10b 0 2024-09-06T14:44:36.223 INFO:tasks.workunit.client.1.smithi165.stdout:0/723: write d15/d19/d50/f7f [149206,31596] 0 2024-09-06T14:44:36.223 INFO:tasks.workunit.client.1.smithi165.stdout:7/651: mknod d20/d3b/d69/d88/ccb 0 2024-09-06T14:44:36.225 INFO:tasks.workunit.client.1.smithi165.stdout:1/730: creat d0/d1c/d41/de3/fe7 x:0 0 0 2024-09-06T14:44:36.227 INFO:tasks.workunit.client.0.smithi052.stdout:1/239: fsync d1/da/d14/f25 0 2024-09-06T14:44:36.227 INFO:tasks.workunit.client.1.smithi165.stdout:0/724: mknod d15/d19/d50/d53/d7c/dbb/cef 0 2024-09-06T14:44:36.229 INFO:tasks.workunit.client.1.smithi165.stdout:7/652: mknod d20/d3b/d69/ccc 0 2024-09-06T14:44:36.232 INFO:tasks.workunit.client.1.smithi165.stdout:2/710: rename d9/d3b/l85 to d9/d88/dac/d95/le7 0 2024-09-06T14:44:36.234 INFO:tasks.workunit.client.1.smithi165.stdout:1/731: mknod d0/d2a/d18/d24/d4b/d93/ce8 0 2024-09-06T14:44:36.234 INFO:tasks.workunit.client.0.smithi052.stdout:1/240: dwrite d1/da/f49 [0,4194304] 0 2024-09-06T14:44:36.235 INFO:tasks.workunit.client.1.smithi165.stdout:3/804: dwrite d1/dbd/fda [0,4194304] 0 2024-09-06T14:44:36.236 INFO:tasks.workunit.client.1.smithi165.stdout:0/725: dwrite d15/d19/d50/fd9 [0,4194304] 0 2024-09-06T14:44:36.239 INFO:tasks.workunit.client.0.smithi052.stdout:1/241: creat d1/db/f52 x:0 0 0 2024-09-06T14:44:36.241 INFO:tasks.workunit.client.1.smithi165.stdout:2/711: fdatasync d9/d25/d45/d75/d67/f92 0 2024-09-06T14:44:36.241 INFO:tasks.workunit.client.1.smithi165.stdout:9/885: sync 2024-09-06T14:44:36.246 INFO:tasks.workunit.client.1.smithi165.stdout:2/712: mkdir d9/d88/dac/da4/de8 0 2024-09-06T14:44:36.249 INFO:tasks.workunit.client.1.smithi165.stdout:3/805: symlink d1/da/l10c 0 2024-09-06T14:44:36.250 INFO:tasks.workunit.client.0.smithi052.stdout:1/242: dwrite d1/da/d3e/d47/d4a/f4e [0,4194304] 0 2024-09-06T14:44:36.251 INFO:tasks.workunit.client.1.smithi165.stdout:8/781: dwrite d0/fd [4194304,4194304] 0 2024-09-06T14:44:36.255 INFO:tasks.workunit.client.0.smithi052.stdout:1/243: dread d1/da/d3e/d47/d4a/f4e [0,4194304] 0 2024-09-06T14:44:36.256 INFO:tasks.workunit.client.0.smithi052.stdout:1/244: fsync d1/da/d14/d2e/f42 0 2024-09-06T14:44:36.261 INFO:tasks.workunit.client.1.smithi165.stdout:9/886: truncate db/de/d15/d17/dc3/f112 951068 0 2024-09-06T14:44:36.262 INFO:tasks.workunit.client.1.smithi165.stdout:9/887: chown db/de/d15/d7f/d9b/de7 25949 1 2024-09-06T14:44:36.264 INFO:tasks.workunit.client.0.smithi052.stdout:1/245: symlink d1/da/d3e/d47/d4a/l53 0 2024-09-06T14:44:36.265 INFO:tasks.workunit.client.1.smithi165.stdout:1/732: dwrite d0/dc8/fd6 [0,4194304] 0 2024-09-06T14:44:36.268 INFO:tasks.workunit.client.1.smithi165.stdout:2/713: write d9/d4f/f5e [4345864,108109] 0 2024-09-06T14:44:36.268 INFO:tasks.workunit.client.1.smithi165.stdout:0/726: link d15/d19/d50/d53/d57/f7d d15/d19/d50/d53/d7c/dae/ff0 0 2024-09-06T14:44:36.269 INFO:tasks.workunit.client.1.smithi165.stdout:2/714: chown d9/d25/d46 507308917 1 2024-09-06T14:44:36.270 INFO:tasks.workunit.client.1.smithi165.stdout:9/888: mknod db/d40/c118 0 2024-09-06T14:44:36.273 INFO:tasks.workunit.client.0.smithi052.stdout:1/246: dwrite d1/da/d36/f3d [0,4194304] 0 2024-09-06T14:44:36.273 INFO:tasks.workunit.client.1.smithi165.stdout:9/889: truncate db/de/d15/d17/d18/d7d/d8e/ded/df1/f114 365471 0 2024-09-06T14:44:36.275 INFO:tasks.workunit.client.1.smithi165.stdout:2/715: mknod d9/d25/d45/d75/d67/ce9 0 2024-09-06T14:44:36.279 INFO:tasks.workunit.client.0.smithi052.stdout:1/247: readlink d1/da/d36/l4f 0 2024-09-06T14:44:36.280 INFO:tasks.workunit.client.0.smithi052.stdout:1/248: chown d1/db/l20 18191 1 2024-09-06T14:44:36.282 INFO:tasks.workunit.client.1.smithi165.stdout:9/890: creat db/de/d16/d2e/da7/f119 x:0 0 0 2024-09-06T14:44:36.283 INFO:tasks.workunit.client.1.smithi165.stdout:2/716: creat d9/d88/dc5/fea x:0 0 0 2024-09-06T14:44:36.285 INFO:tasks.workunit.client.1.smithi165.stdout:8/782: dread d0/d14/fac [0,4194304] 0 2024-09-06T14:44:36.285 INFO:tasks.workunit.client.1.smithi165.stdout:2/717: write d9/d25/f57 [2356088,56440] 0 2024-09-06T14:44:36.285 INFO:tasks.workunit.client.1.smithi165.stdout:9/891: unlink db/de/fc8 0 2024-09-06T14:44:36.286 INFO:tasks.workunit.client.1.smithi165.stdout:3/806: getdents d1/da/dc 0 2024-09-06T14:44:36.288 INFO:tasks.workunit.client.1.smithi165.stdout:1/733: dread d0/d2a/d18/d24/d4b/d93/d2b/f4a [0,4194304] 0 2024-09-06T14:44:36.288 INFO:tasks.workunit.client.1.smithi165.stdout:8/783: symlink d0/d19/d36/d28/d64/l111 0 2024-09-06T14:44:36.289 INFO:tasks.workunit.client.1.smithi165.stdout:2/718: truncate d9/d25/d45/d75/d67/f92 4910215 0 2024-09-06T14:44:36.290 INFO:tasks.workunit.client.1.smithi165.stdout:9/892: symlink db/de/d15/d17/d72/da3/l11a 0 2024-09-06T14:44:36.290 INFO:tasks.workunit.client.1.smithi165.stdout:8/784: stat d0/d19/d7f/fe6 0 2024-09-06T14:44:36.291 INFO:tasks.workunit.client.1.smithi165.stdout:2/719: unlink d9/d23/f99 0 2024-09-06T14:44:36.293 INFO:tasks.workunit.client.1.smithi165.stdout:3/807: creat d1/da/dd/f10d x:0 0 0 2024-09-06T14:44:36.294 INFO:tasks.workunit.client.1.smithi165.stdout:1/734: creat d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98/fe9 x:0 0 0 2024-09-06T14:44:36.295 INFO:tasks.workunit.client.1.smithi165.stdout:1/735: read - d0/d1c/d1d/d57/fd0 zero size 2024-09-06T14:44:36.295 INFO:tasks.workunit.client.1.smithi165.stdout:8/785: mknod d0/d34/c112 0 2024-09-06T14:44:36.298 INFO:tasks.workunit.client.1.smithi165.stdout:1/736: chown d0/d2a/l15 9935 1 2024-09-06T14:44:36.299 INFO:tasks.workunit.client.1.smithi165.stdout:8/786: mkdir d0/d19/d36/d2d/d33/d3a/d46/dcd/d113 0 2024-09-06T14:44:36.301 INFO:tasks.workunit.client.1.smithi165.stdout:8/787: read d0/d19/d36/d28/dda/fe5 [222635,22185] 0 2024-09-06T14:44:36.304 INFO:tasks.workunit.client.1.smithi165.stdout:1/737: creat d0/d1c/d1d/d57/fea x:0 0 0 2024-09-06T14:44:36.306 INFO:tasks.workunit.client.1.smithi165.stdout:9/893: dread db/f57 [0,4194304] 0 2024-09-06T14:44:36.308 INFO:tasks.workunit.client.1.smithi165.stdout:8/788: dwrite d0/d19/f86 [0,4194304] 0 2024-09-06T14:44:36.310 INFO:tasks.workunit.client.1.smithi165.stdout:1/738: dwrite d0/f7 [0,4194304] 0 2024-09-06T14:44:36.313 INFO:tasks.workunit.client.1.smithi165.stdout:1/739: write d0/f7 [2318904,50229] 0 2024-09-06T14:44:36.316 INFO:tasks.workunit.client.1.smithi165.stdout:8/789: mkdir d0/d19/d36/d2d/d33/d3a/d46/d49/d114 0 2024-09-06T14:44:36.317 INFO:tasks.workunit.client.1.smithi165.stdout:2/720: symlink d9/d23/d29/d48/d8c/dbf/dd3/leb 0 2024-09-06T14:44:36.318 INFO:tasks.workunit.client.1.smithi165.stdout:1/740: write d0/f14 [3646433,17411] 0 2024-09-06T14:44:36.319 INFO:tasks.workunit.client.1.smithi165.stdout:3/808: dwrite d1/da/f9f [0,4194304] 0 2024-09-06T14:44:36.324 INFO:tasks.workunit.client.1.smithi165.stdout:8/790: read d0/d5e/d65/f99 [2057445,7483] 0 2024-09-06T14:44:36.325 INFO:tasks.workunit.client.1.smithi165.stdout:2/721: creat d9/d25/d46/fec x:0 0 0 2024-09-06T14:44:36.327 INFO:tasks.workunit.client.1.smithi165.stdout:1/741: rename d0/d2a/d18/d24/d4b/d95/cdf to d0/d2a/d18/d24/d4b/d93/d2b/ceb 0 2024-09-06T14:44:36.329 INFO:tasks.workunit.client.1.smithi165.stdout:1/742: symlink d0/d1c/lec 0 2024-09-06T14:44:36.332 INFO:tasks.workunit.client.1.smithi165.stdout:2/722: write f8 [5030981,101082] 0 2024-09-06T14:44:36.333 INFO:tasks.workunit.client.1.smithi165.stdout:1/743: truncate d0/d2a/d18/d24/d4b/d95/f96 1069702 0 2024-09-06T14:44:36.333 INFO:tasks.workunit.client.1.smithi165.stdout:8/791: dwrite d0/d19/d36/d2d/d33/d3a/d46/fa7 [0,4194304] 0 2024-09-06T14:44:36.336 INFO:tasks.workunit.client.1.smithi165.stdout:1/744: symlink d0/d45/led 0 2024-09-06T14:44:36.343 INFO:tasks.workunit.client.1.smithi165.stdout:8/792: creat d0/d19/d36/d2d/d33/d84/f115 x:0 0 0 2024-09-06T14:44:36.344 INFO:tasks.workunit.client.1.smithi165.stdout:9/894: dread db/d40/f53 [0,4194304] 0 2024-09-06T14:44:36.345 INFO:tasks.workunit.client.1.smithi165.stdout:2/723: write d9/f18 [131297,33322] 0 2024-09-06T14:44:36.346 INFO:tasks.workunit.client.1.smithi165.stdout:6/819: sync 2024-09-06T14:44:36.346 INFO:tasks.workunit.client.1.smithi165.stdout:0/727: sync 2024-09-06T14:44:36.346 INFO:tasks.workunit.client.1.smithi165.stdout:7/653: sync 2024-09-06T14:44:36.346 INFO:tasks.workunit.client.1.smithi165.stdout:4/824: sync 2024-09-06T14:44:36.346 INFO:tasks.workunit.client.1.smithi165.stdout:5/877: sync 2024-09-06T14:44:36.346 INFO:tasks.workunit.client.1.smithi165.stdout:6/820: stat d29/f49 0 2024-09-06T14:44:36.347 INFO:tasks.workunit.client.1.smithi165.stdout:3/809: dread d1/d4a/f7d [0,4194304] 0 2024-09-06T14:44:36.348 INFO:tasks.workunit.client.1.smithi165.stdout:2/724: read - d9/d88/dc5/fea zero size 2024-09-06T14:44:36.349 INFO:tasks.workunit.client.1.smithi165.stdout:1/745: write d0/d2a/d18/d24/d4b/d93/d2b/d3e/f49 [2154370,98164] 0 2024-09-06T14:44:36.350 INFO:tasks.workunit.client.1.smithi165.stdout:4/825: chown d5/d1b/d61/d77/d93/lf7 372992366 1 2024-09-06T14:44:36.359 INFO:tasks.workunit.client.1.smithi165.stdout:8/793: symlink d0/d34/d6b/d94/d70/l116 0 2024-09-06T14:44:36.359 INFO:tasks.workunit.client.1.smithi165.stdout:7/654: mknod d20/d65/d82/ccd 0 2024-09-06T14:44:36.362 INFO:tasks.workunit.client.1.smithi165.stdout:3/810: unlink d1/d41/fe8 0 2024-09-06T14:44:36.363 INFO:tasks.workunit.client.1.smithi165.stdout:6/821: creat d29/d39/d5b/d62/d94/db7/dcc/fff x:0 0 0 2024-09-06T14:44:36.364 INFO:tasks.workunit.client.1.smithi165.stdout:2/725: dread d9/f84 [0,4194304] 0 2024-09-06T14:44:36.367 INFO:tasks.workunit.client.1.smithi165.stdout:9/895: dread db/de/d15/d17/d86/feb [0,4194304] 0 2024-09-06T14:44:36.369 INFO:tasks.workunit.client.1.smithi165.stdout:3/811: mknod d1/d4a/db4/c10e 0 2024-09-06T14:44:36.369 INFO:tasks.workunit.client.1.smithi165.stdout:8/794: dwrite d0/d19/d36/d2d/d33/d3a/d46/fa7 [4194304,4194304] 0 2024-09-06T14:44:36.372 INFO:tasks.workunit.client.1.smithi165.stdout:9/896: rename db to db/de/d15/d17/d86/ddd/d115/d11b 22 2024-09-06T14:44:36.374 INFO:tasks.workunit.client.1.smithi165.stdout:7/655: stat d20/d33/d53/f57 0 2024-09-06T14:44:36.374 INFO:tasks.workunit.client.1.smithi165.stdout:3/812: symlink d1/dbd/dfd/l10f 0 2024-09-06T14:44:36.379 INFO:tasks.workunit.client.1.smithi165.stdout:6/822: dwrite d29/d93/fb0 [4194304,4194304] 0 2024-09-06T14:44:36.379 INFO:tasks.workunit.client.1.smithi165.stdout:3/813: write d1/d41/f56 [4773044,17349] 0 2024-09-06T14:44:36.380 INFO:tasks.workunit.client.1.smithi165.stdout:1/746: dwrite d0/d1c/fa7 [4194304,4194304] 0 2024-09-06T14:44:36.386 INFO:tasks.workunit.client.1.smithi165.stdout:8/795: getdents d0/d14/d3e/dd8 0 2024-09-06T14:44:36.386 INFO:tasks.workunit.client.1.smithi165.stdout:2/726: rename d9/d23/d71/fad to d9/d23/d71/fed 0 2024-09-06T14:44:36.389 INFO:tasks.workunit.client.1.smithi165.stdout:5/878: write d6/d1c/d28/d2d/d3c/d44/d90/fb3 [2515749,15953] 0 2024-09-06T14:44:36.391 INFO:tasks.workunit.client.1.smithi165.stdout:7/656: dread d20/d3b/f74 [0,4194304] 0 2024-09-06T14:44:36.395 INFO:tasks.workunit.client.1.smithi165.stdout:6/823: link d29/f49 d29/d6a/d83/d89/f100 0 2024-09-06T14:44:36.395 INFO:tasks.workunit.client.1.smithi165.stdout:5/879: readlink d6/d1c/d28/d2d/d49/l4d 0 2024-09-06T14:44:36.396 INFO:tasks.workunit.client.1.smithi165.stdout:2/727: mkdir d9/d23/d29/d48/d8c/dee 0 2024-09-06T14:44:36.396 INFO:tasks.workunit.client.1.smithi165.stdout:8/796: rmdir d0/d19/d36/d2d/d3f/daf 39 2024-09-06T14:44:36.397 INFO:tasks.workunit.client.1.smithi165.stdout:7/657: rmdir d20/d3b/d69/d88/d30 39 2024-09-06T14:44:36.398 INFO:tasks.workunit.client.1.smithi165.stdout:1/747: getdents d0/d2a/d18/d24/d4b/d93/dbd 0 2024-09-06T14:44:36.399 INFO:tasks.workunit.client.1.smithi165.stdout:3/814: dwrite d1/d19/d4d/fa5 [0,4194304] 0 2024-09-06T14:44:36.402 INFO:tasks.workunit.client.1.smithi165.stdout:4/826: dwrite d5/f8 [4194304,4194304] 0 2024-09-06T14:44:36.408 INFO:tasks.workunit.client.1.smithi165.stdout:8/797: dread d0/d19/d36/fd2 [0,4194304] 0 2024-09-06T14:44:36.411 INFO:tasks.workunit.client.1.smithi165.stdout:6/824: creat d29/d39/d5b/d68/dec/f101 x:0 0 0 2024-09-06T14:44:36.414 INFO:tasks.workunit.client.1.smithi165.stdout:3/815: fsync d1/da/d43/f96 0 2024-09-06T14:44:36.416 INFO:tasks.workunit.client.1.smithi165.stdout:6/825: readlink d29/d39/d5b/d62/lda 0 2024-09-06T14:44:36.416 INFO:tasks.workunit.client.1.smithi165.stdout:4/827: symlink d5/d1b/d1c/d20/d75/l115 0 2024-09-06T14:44:36.417 INFO:tasks.workunit.client.1.smithi165.stdout:1/748: dwrite d0/d2a/f16 [0,4194304] 0 2024-09-06T14:44:36.418 INFO:tasks.workunit.client.1.smithi165.stdout:2/728: rename d9/d25/d45/d75/d34/f43 to d9/d25/fef 0 2024-09-06T14:44:36.419 INFO:tasks.workunit.client.1.smithi165.stdout:1/749: fdatasync d0/d1c/fc1 0 2024-09-06T14:44:36.424 INFO:tasks.workunit.client.1.smithi165.stdout:3/816: truncate d1/d19/d92/fca 972742 0 2024-09-06T14:44:36.424 INFO:tasks.workunit.client.1.smithi165.stdout:5/880: dwrite d6/f24 [4194304,4194304] 0 2024-09-06T14:44:36.427 INFO:tasks.workunit.client.1.smithi165.stdout:4/828: write d5/d1b/d61/dd7/ddf/f88 [3905274,85603] 0 2024-09-06T14:44:36.429 INFO:tasks.workunit.client.1.smithi165.stdout:7/658: dread d20/d3b/d69/da3/fa9 [0,4194304] 0 2024-09-06T14:44:36.430 INFO:tasks.workunit.client.1.smithi165.stdout:3/817: fsync d1/d19/f28 0 2024-09-06T14:44:36.430 INFO:tasks.workunit.client.1.smithi165.stdout:2/729: write d9/d23/d29/d48/d8c/f86 [1906702,37223] 0 2024-09-06T14:44:36.432 INFO:tasks.workunit.client.1.smithi165.stdout:9/897: dread db/de/d15/d17/d18/d7d/f6d [0,4194304] 0 2024-09-06T14:44:36.433 INFO:tasks.workunit.client.1.smithi165.stdout:8/798: dread d0/d19/f3b [0,4194304] 0 2024-09-06T14:44:36.434 INFO:tasks.workunit.client.1.smithi165.stdout:5/881: write d6/d1c/d28/d4b/d55/d8a/fa0 [2912009,90829] 0 2024-09-06T14:44:36.435 INFO:tasks.workunit.client.1.smithi165.stdout:3/818: dread - d1/da/dd/f10d zero size 2024-09-06T14:44:36.436 INFO:tasks.workunit.client.0.smithi052.stdout:9/48: sync 2024-09-06T14:44:36.436 INFO:tasks.workunit.client.0.smithi052.stdout:0/103: sync 2024-09-06T14:44:36.438 INFO:tasks.workunit.client.1.smithi165.stdout:6/826: dwrite d29/d39/f54 [4194304,4194304] 0 2024-09-06T14:44:36.438 INFO:tasks.workunit.client.1.smithi165.stdout:7/659: rename d20/d33/l43 to d20/d33/d53/lce 0 2024-09-06T14:44:36.439 INFO:tasks.workunit.client.1.smithi165.stdout:1/750: dread d0/fa4 [0,4194304] 0 2024-09-06T14:44:36.439 INFO:tasks.workunit.client.1.smithi165.stdout:8/799: read - d0/d14/d3e/dd8/ff6 zero size 2024-09-06T14:44:36.441 INFO:tasks.workunit.client.0.smithi052.stdout:0/104: mkdir d0/d1a 0 2024-09-06T14:44:36.441 INFO:tasks.workunit.client.0.smithi052.stdout:0/105: chown d0 211179 1 2024-09-06T14:44:36.441 INFO:tasks.workunit.client.1.smithi165.stdout:5/882: truncate d6/d1c/d28/d4b/d55/f8c 991628 0 2024-09-06T14:44:36.442 INFO:tasks.workunit.client.1.smithi165.stdout:1/751: write d0/f14 [5176937,54636] 0 2024-09-06T14:44:36.442 INFO:tasks.workunit.client.1.smithi165.stdout:2/730: creat d9/d25/d45/d75/d67/dd1/de6/ff0 x:0 0 0 2024-09-06T14:44:36.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/49: getdents d1/d4/d6/dd 0 2024-09-06T14:44:36.442 INFO:tasks.workunit.client.0.smithi052.stdout:0/106: write d0/dd/d14/f15 [325604,89695] 0 2024-09-06T14:44:36.443 INFO:tasks.workunit.client.0.smithi052.stdout:9/50: rename d1/d4/d6 to d1/d4/d6/dc/d12 22 2024-09-06T14:44:36.445 INFO:tasks.workunit.client.1.smithi165.stdout:3/819: mkdir d1/da/dc/d10/d110 0 2024-09-06T14:44:36.445 INFO:tasks.workunit.client.1.smithi165.stdout:0/728: sync 2024-09-06T14:44:36.446 INFO:tasks.workunit.client.0.smithi052.stdout:0/107: symlink d0/d12/l1b 0 2024-09-06T14:44:36.446 INFO:tasks.workunit.client.1.smithi165.stdout:2/731: chown d9/d25/d45/d75/d34/l6f 56507636 1 2024-09-06T14:44:36.448 INFO:tasks.workunit.client.0.smithi052.stdout:9/51: dread d1/fa [0,4194304] 0 2024-09-06T14:44:36.450 INFO:tasks.workunit.client.1.smithi165.stdout:6/827: fsync d29/d39/d5b/fe8 0 2024-09-06T14:44:36.451 INFO:tasks.workunit.client.1.smithi165.stdout:8/800: dread - d0/d19/d24/db1/fc5 zero size 2024-09-06T14:44:36.452 INFO:tasks.workunit.client.0.smithi052.stdout:0/108: creat d0/f1c x:0 0 0 2024-09-06T14:44:36.453 INFO:tasks.workunit.client.0.smithi052.stdout:9/52: truncate d1/f8 331674 0 2024-09-06T14:44:36.453 INFO:tasks.workunit.client.1.smithi165.stdout:3/820: dwrite d1/d19/d4d/fd0 [0,4194304] 0 2024-09-06T14:44:36.454 INFO:tasks.workunit.client.1.smithi165.stdout:5/883: dwrite d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/f138 [0,4194304] 0 2024-09-06T14:44:36.456 INFO:tasks.workunit.client.1.smithi165.stdout:6/828: write d29/d39/d5b/d62/d94/db7/dcc/df0/feb [533282,97186] 0 2024-09-06T14:44:36.456 INFO:tasks.workunit.client.1.smithi165.stdout:1/752: mknod d0/d2a/d18/d24/d4b/d5f/db8/cee 0 2024-09-06T14:44:36.456 INFO:tasks.workunit.client.1.smithi165.stdout:0/729: mkdir d15/d19/d2c/df1 0 2024-09-06T14:44:36.457 INFO:tasks.workunit.client.0.smithi052.stdout:9/53: rmdir d1/d4/d6 39 2024-09-06T14:44:36.459 INFO:tasks.workunit.client.1.smithi165.stdout:6/829: chown d29/d6a/d83/d89/fd7 4 1 2024-09-06T14:44:36.460 INFO:tasks.workunit.client.1.smithi165.stdout:7/660: write f15 [1643060,2170] 0 2024-09-06T14:44:36.461 INFO:tasks.workunit.client.1.smithi165.stdout:5/884: read d6/d1c/d28/d2d/f7e [2810990,78360] 0 2024-09-06T14:44:36.462 INFO:tasks.workunit.client.1.smithi165.stdout:4/829: truncate d5/d1b/d61/dd7/ddf/f88 4081702 0 2024-09-06T14:44:36.464 INFO:tasks.workunit.client.0.smithi052.stdout:0/109: creat d0/f1d x:0 0 0 2024-09-06T14:44:36.465 INFO:tasks.workunit.client.0.smithi052.stdout:0/110: write d0/dd/d14/f15 [2181829,28411] 0 2024-09-06T14:44:36.467 INFO:tasks.workunit.client.0.smithi052.stdout:0/111: truncate d0/d12/f9 691906 0 2024-09-06T14:44:36.467 INFO:tasks.workunit.client.0.smithi052.stdout:0/112: dread - d0/d12/f11 zero size 2024-09-06T14:44:36.468 INFO:tasks.workunit.client.1.smithi165.stdout:6/830: dwrite d29/d32/ff9 [0,4194304] 0 2024-09-06T14:44:36.468 INFO:tasks.workunit.client.1.smithi165.stdout:8/801: rename d0/d34/c48 to d0/d34/d6b/d94/d70/db8/c117 0 2024-09-06T14:44:36.471 INFO:tasks.workunit.client.0.smithi052.stdout:9/54: creat d1/d4/d6/dd/f13 x:0 0 0 2024-09-06T14:44:36.471 INFO:tasks.workunit.client.0.smithi052.stdout:9/55: read d1/fa [628312,52715] 0 2024-09-06T14:44:36.474 INFO:tasks.workunit.client.1.smithi165.stdout:1/753: rmdir d0/d2a/d18 39 2024-09-06T14:44:36.477 INFO:tasks.workunit.client.1.smithi165.stdout:0/730: fsync d15/d19/d28/d3a/f94 0 2024-09-06T14:44:36.479 INFO:tasks.workunit.client.0.smithi052.stdout:9/56: symlink d1/d4/d6/dc/l14 0 2024-09-06T14:44:36.479 INFO:tasks.workunit.client.1.smithi165.stdout:2/732: symlink d9/d25/d46/ddd/lf1 0 2024-09-06T14:44:36.480 INFO:tasks.workunit.client.0.smithi052.stdout:0/113: symlink d0/d18/l1e 0 2024-09-06T14:44:36.481 INFO:tasks.workunit.client.1.smithi165.stdout:2/733: stat d9/d3b/d78 0 2024-09-06T14:44:36.481 INFO:tasks.workunit.client.0.smithi052.stdout:0/114: truncate d0/f1c 131984 0 2024-09-06T14:44:36.482 INFO:tasks.workunit.client.0.smithi052.stdout:0/115: write d0/d12/f9 [742071,119699] 0 2024-09-06T14:44:36.482 INFO:tasks.workunit.client.1.smithi165.stdout:9/898: link db/de/d15/d17/d18/d7d/d8e/c90 db/de/d16/d2e/c11c 0 2024-09-06T14:44:36.483 INFO:tasks.workunit.client.1.smithi165.stdout:9/899: chown db/de/d15/d17/d18/d59/d64 474 1 2024-09-06T14:44:36.488 INFO:tasks.workunit.client.1.smithi165.stdout:3/821: dread d1/d19/f27 [0,4194304] 0 2024-09-06T14:44:36.488 INFO:tasks.workunit.client.0.smithi052.stdout:9/57: mknod d1/d4/c15 0 2024-09-06T14:44:36.489 INFO:tasks.workunit.client.0.smithi052.stdout:0/116: dwrite d0/f1c [0,4194304] 0 2024-09-06T14:44:36.490 INFO:tasks.workunit.client.1.smithi165.stdout:4/830: rename d5/d1b/d1c/d41/d9e/dfd to d5/d1b/d116 0 2024-09-06T14:44:36.492 INFO:tasks.workunit.client.1.smithi165.stdout:4/831: write d5/d1b/d1c/d41/fb4 [342958,23091] 0 2024-09-06T14:44:36.493 INFO:tasks.workunit.client.0.smithi052.stdout:0/117: dread d0/d12/f9 [0,4194304] 0 2024-09-06T14:44:36.494 INFO:tasks.workunit.client.1.smithi165.stdout:4/832: chown d5/d1b/d1c/d20/d75/d83/cb3 245243928 1 2024-09-06T14:44:36.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/58: truncate d1/d4/f9 914888 0 2024-09-06T14:44:36.495 INFO:tasks.workunit.client.1.smithi165.stdout:4/833: truncate d5/f50 1775577 0 2024-09-06T14:44:36.496 INFO:tasks.workunit.client.1.smithi165.stdout:7/661: write d20/d65/f61 [686687,97134] 0 2024-09-06T14:44:36.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/118: dread d0/dd/d14/f15 [0,4194304] 0 2024-09-06T14:44:36.498 INFO:tasks.workunit.client.1.smithi165.stdout:0/731: dread d15/f2f [0,4194304] 0 2024-09-06T14:44:36.498 INFO:tasks.workunit.client.1.smithi165.stdout:7/662: chown d20/d33/d53/f57 403812775 1 2024-09-06T14:44:36.499 INFO:tasks.workunit.client.1.smithi165.stdout:1/754: chown d0/d2a/d18/d24 38796 1 2024-09-06T14:44:36.500 INFO:tasks.workunit.client.1.smithi165.stdout:1/755: readlink d0/d2a/lce 0 2024-09-06T14:44:36.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/59: unlink d1/l2 0 2024-09-06T14:44:36.505 INFO:tasks.workunit.client.1.smithi165.stdout:2/734: mknod d9/cf2 0 2024-09-06T14:44:36.505 INFO:tasks.workunit.client.1.smithi165.stdout:2/735: stat d9/d23/d29/d48/d8c/dee 0 2024-09-06T14:44:36.508 INFO:tasks.workunit.client.1.smithi165.stdout:5/885: symlink d6/d1c/d28/d2d/d61/dde/dff/l13b 0 2024-09-06T14:44:36.509 INFO:tasks.workunit.client.0.smithi052.stdout:9/60: creat d1/d4/d6/f16 x:0 0 0 2024-09-06T14:44:36.509 INFO:tasks.workunit.client.0.smithi052.stdout:0/119: mkdir d0/d1a/d1f 0 2024-09-06T14:44:36.510 INFO:tasks.workunit.client.1.smithi165.stdout:8/802: link d0/d19/d36/d28/d64/fdf d0/d19/d36/d28/dda/f118 0 2024-09-06T14:44:36.510 INFO:tasks.workunit.client.1.smithi165.stdout:8/803: chown d0/d5e/d65 168 1 2024-09-06T14:44:36.511 INFO:tasks.workunit.client.0.smithi052.stdout:9/61: truncate d1/d4/f7 1151983 0 2024-09-06T14:44:36.511 INFO:tasks.workunit.client.1.smithi165.stdout:7/663: write d20/d3b/d69/d88/d30/fbc [779565,25932] 0 2024-09-06T14:44:36.512 INFO:tasks.workunit.client.1.smithi165.stdout:4/834: rename d5/d1b/d1c/d55/f71 to d5/d1b/d61/d77/dbd/f117 0 2024-09-06T14:44:36.512 INFO:tasks.workunit.client.0.smithi052.stdout:0/120: fsync d0/dd/d14/f15 0 2024-09-06T14:44:36.515 INFO:tasks.workunit.client.1.smithi165.stdout:1/756: creat d0/fef x:0 0 0 2024-09-06T14:44:36.516 INFO:tasks.workunit.client.0.smithi052.stdout:0/121: mkdir d0/dd/d14/d20 0 2024-09-06T14:44:36.518 INFO:tasks.workunit.client.1.smithi165.stdout:2/736: creat d9/d88/dac/ff3 x:0 0 0 2024-09-06T14:44:36.519 INFO:tasks.workunit.client.1.smithi165.stdout:5/886: creat d6/d1c/d28/d88/f13c x:0 0 0 2024-09-06T14:44:36.520 INFO:tasks.workunit.client.0.smithi052.stdout:0/122: symlink d0/dd/l21 0 2024-09-06T14:44:36.521 INFO:tasks.workunit.client.1.smithi165.stdout:6/831: link f16 d29/d39/d5b/d62/d9f/f102 0 2024-09-06T14:44:36.522 INFO:tasks.workunit.client.0.smithi052.stdout:9/62: creat d1/f17 x:0 0 0 2024-09-06T14:44:36.527 INFO:tasks.workunit.client.1.smithi165.stdout:8/804: symlink d0/d19/d36/d2d/dc9/l119 0 2024-09-06T14:44:36.528 INFO:tasks.workunit.client.1.smithi165.stdout:8/805: write d0/d14/d3e/f47 [4867486,57053] 0 2024-09-06T14:44:36.528 INFO:tasks.workunit.client.0.smithi052.stdout:0/123: mkdir d0/dd/d14/d20/d22 0 2024-09-06T14:44:36.529 INFO:tasks.workunit.client.1.smithi165.stdout:8/806: dread - d0/d34/d6b/fa0 zero size 2024-09-06T14:44:36.530 INFO:tasks.workunit.client.1.smithi165.stdout:4/835: creat d5/d1b/d1c/d20/d75/d83/d9f/f118 x:0 0 0 2024-09-06T14:44:36.533 INFO:tasks.workunit.client.1.smithi165.stdout:2/737: write d9/f84 [2881047,96251] 0 2024-09-06T14:44:36.534 INFO:tasks.workunit.client.1.smithi165.stdout:2/738: fdatasync d9/d23/d29/f2b 0 2024-09-06T14:44:36.535 INFO:tasks.workunit.client.0.smithi052.stdout:0/124: dwrite d0/f1d [0,4194304] 0 2024-09-06T14:44:36.535 INFO:tasks.workunit.client.1.smithi165.stdout:5/887: unlink d6/d1c/d28/d4b/d55/d8a/cb6 0 2024-09-06T14:44:36.537 INFO:tasks.workunit.client.0.smithi052.stdout:9/63: getdents d1/d4/d6 0 2024-09-06T14:44:36.538 INFO:tasks.workunit.client.1.smithi165.stdout:6/832: rename d29/d6a/d71/l7f to d29/d39/d5b/d62/d94/db7/dcc/l103 0 2024-09-06T14:44:36.544 INFO:tasks.workunit.client.1.smithi165.stdout:4/836: fdatasync d5/d1b/d1c/d8c/f8d 0 2024-09-06T14:44:36.544 INFO:tasks.workunit.client.1.smithi165.stdout:4/837: readlink d5/d1b/d1c/d41/d9e/le2 0 2024-09-06T14:44:36.545 INFO:tasks.workunit.client.1.smithi165.stdout:4/838: stat d5/d1b/d1c/fa0 0 2024-09-06T14:44:36.545 INFO:tasks.workunit.client.0.smithi052.stdout:0/125: symlink d0/d19/l23 0 2024-09-06T14:44:36.551 INFO:tasks.workunit.client.1.smithi165.stdout:1/757: link d0/d2a/f9d d0/d2a/d18/d24/d4b/d93/dbd/dd1/ff0 0 2024-09-06T14:44:36.553 INFO:tasks.workunit.client.1.smithi165.stdout:2/739: rename d9/d88/dac/fb7 to d9/d88/dac/ff4 0 2024-09-06T14:44:36.554 INFO:tasks.workunit.client.1.smithi165.stdout:2/740: chown d9/d23/d29/d48/d8c 3 1 2024-09-06T14:44:36.554 INFO:tasks.workunit.client.0.smithi052.stdout:0/126: mknod d0/d18/c24 0 2024-09-06T14:44:36.556 INFO:tasks.workunit.client.1.smithi165.stdout:5/888: symlink d6/d1c/d28/d4b/da7/l13d 0 2024-09-06T14:44:36.558 INFO:tasks.workunit.client.1.smithi165.stdout:7/664: rename d20/d33/d53/fb9 to d20/d4d/d54/dc1/fcf 0 2024-09-06T14:44:36.559 INFO:tasks.workunit.client.1.smithi165.stdout:7/665: read - d20/d33/d6a/d90/fc8 zero size 2024-09-06T14:44:36.560 INFO:tasks.workunit.client.1.smithi165.stdout:2/741: dwrite d9/d25/d45/d75/d67/d76/f6a [0,4194304] 0 2024-09-06T14:44:36.560 INFO:tasks.workunit.client.1.smithi165.stdout:7/666: readlink d20/d3b/d69/l8f 0 2024-09-06T14:44:36.560 INFO:tasks.workunit.client.1.smithi165.stdout:8/807: mkdir d0/d19/d24/db1/d11a 0 2024-09-06T14:44:36.561 INFO:tasks.workunit.client.1.smithi165.stdout:8/808: chown d0/d19/d36/d28 2035618 1 2024-09-06T14:44:36.561 INFO:tasks.workunit.client.1.smithi165.stdout:2/742: chown d9/d25/d46/d7e/d90/fcb 644 1 2024-09-06T14:44:36.562 INFO:tasks.workunit.client.1.smithi165.stdout:2/743: chown d9/d25/d45/d75/d67/dd1 7 1 2024-09-06T14:44:36.562 INFO:tasks.workunit.client.0.smithi052.stdout:0/127: link d0/c7 d0/d18/c25 0 2024-09-06T14:44:36.564 INFO:tasks.workunit.client.1.smithi165.stdout:0/732: getdents d15/d19/d2c 0 2024-09-06T14:44:36.565 INFO:tasks.workunit.client.1.smithi165.stdout:0/733: chown d15/d19/d38/f4c 189166 1 2024-09-06T14:44:36.568 INFO:tasks.workunit.client.1.smithi165.stdout:4/839: dwrite d5/d1b/d61/fd3 [0,4194304] 0 2024-09-06T14:44:36.568 INFO:tasks.workunit.client.0.smithi052.stdout:0/128: rename d0/d1a/d1f to d0/d1a/d26 0 2024-09-06T14:44:36.568 INFO:tasks.workunit.client.1.smithi165.stdout:4/840: chown d5/d1b/c73 1029 1 2024-09-06T14:44:36.569 INFO:tasks.workunit.client.0.smithi052.stdout:0/129: stat d0/dd/d14/d20 0 2024-09-06T14:44:36.572 INFO:tasks.workunit.client.1.smithi165.stdout:5/889: symlink d6/d1c/d28/d4b/l13e 0 2024-09-06T14:44:36.573 INFO:tasks.workunit.client.1.smithi165.stdout:5/890: chown d6/d1c/d28/d2d/d49/de9/l10c 52 1 2024-09-06T14:44:36.576 INFO:tasks.workunit.client.1.smithi165.stdout:2/744: symlink d9/d25/d45/d75/da5/lf5 0 2024-09-06T14:44:36.579 INFO:tasks.workunit.client.1.smithi165.stdout:0/734: symlink d15/d19/d38/lf2 0 2024-09-06T14:44:36.580 INFO:tasks.workunit.client.1.smithi165.stdout:5/891: rename d6/d1c/d28/l9d to d6/d1c/d28/d4b/d55/d8a/da5/l13f 0 2024-09-06T14:44:36.581 INFO:tasks.workunit.client.1.smithi165.stdout:2/745: fsync d9/f68 0 2024-09-06T14:44:36.581 INFO:tasks.workunit.client.1.smithi165.stdout:6/833: getdents d29/d39/d5b/d68/dec 0 2024-09-06T14:44:36.584 INFO:tasks.workunit.client.1.smithi165.stdout:2/746: fdatasync d9/d25/d45/d75/d67/f9a 0 2024-09-06T14:44:36.586 INFO:tasks.workunit.client.1.smithi165.stdout:4/841: dread d5/d1b/d1c/d8c/f9a [0,4194304] 0 2024-09-06T14:44:36.587 INFO:tasks.workunit.client.1.smithi165.stdout:6/834: rename d29/d32/fb5 to d29/d32/dee/f104 0 2024-09-06T14:44:36.587 INFO:tasks.workunit.client.1.smithi165.stdout:0/735: dwrite d15/d19/d50/d53/d8d/fda [0,4194304] 0 2024-09-06T14:44:36.587 INFO:tasks.workunit.client.1.smithi165.stdout:2/747: mknod d9/d88/cf6 0 2024-09-06T14:44:36.588 INFO:tasks.workunit.client.1.smithi165.stdout:5/892: link d6/d32/lb2 d6/d32/l140 0 2024-09-06T14:44:36.588 INFO:tasks.workunit.client.1.smithi165.stdout:2/748: stat d9/d25 0 2024-09-06T14:44:36.589 INFO:tasks.workunit.client.1.smithi165.stdout:4/842: mknod d5/d1b/d1c/d41/d9e/c119 0 2024-09-06T14:44:36.592 INFO:tasks.workunit.client.1.smithi165.stdout:6/835: creat d29/d39/d5b/d62/d9f/dce/f105 x:0 0 0 2024-09-06T14:44:36.593 INFO:tasks.workunit.client.1.smithi165.stdout:4/843: truncate d5/d1b/d61/d77/dd5/ff4 322601 0 2024-09-06T14:44:36.593 INFO:tasks.workunit.client.1.smithi165.stdout:2/749: creat d9/d25/d46/ddd/ff7 x:0 0 0 2024-09-06T14:44:36.593 INFO:tasks.workunit.client.1.smithi165.stdout:6/836: dread - d29/d39/ff1 zero size 2024-09-06T14:44:36.594 INFO:tasks.workunit.client.1.smithi165.stdout:5/893: rename d6/l6c to d6/d1c/d28/d2d/d61/ddc/l141 0 2024-09-06T14:44:36.594 INFO:tasks.workunit.client.1.smithi165.stdout:0/736: read d15/d19/d50/d53/d57/f7d [3131074,52768] 0 2024-09-06T14:44:36.595 INFO:tasks.workunit.client.1.smithi165.stdout:2/750: write d9/d25/fa3 [444927,66268] 0 2024-09-06T14:44:36.597 INFO:tasks.workunit.client.1.smithi165.stdout:6/837: mknod d29/c106 0 2024-09-06T14:44:36.597 INFO:tasks.workunit.client.1.smithi165.stdout:1/758: read d0/d1c/d1d/d22/f32 [1756091,122864] 0 2024-09-06T14:44:36.602 INFO:tasks.workunit.client.1.smithi165.stdout:1/759: creat d0/d2a/d18/d24/d4b/d5f/ff1 x:0 0 0 2024-09-06T14:44:36.603 INFO:tasks.workunit.client.1.smithi165.stdout:2/751: creat d9/d25/d46/d7e/d90/dd8/ddb/ff8 x:0 0 0 2024-09-06T14:44:36.605 INFO:tasks.workunit.client.1.smithi165.stdout:2/752: fdatasync d9/d25/f57 0 2024-09-06T14:44:36.606 INFO:tasks.workunit.client.1.smithi165.stdout:1/760: dread d0/d2a/d18/d24/d4b/d93/d6a/fac [0,4194304] 0 2024-09-06T14:44:36.607 INFO:tasks.workunit.client.1.smithi165.stdout:0/737: creat d15/d19/d28/d9e/da3/de5/ff3 x:0 0 0 2024-09-06T14:44:36.609 INFO:tasks.workunit.client.1.smithi165.stdout:2/753: mknod d9/d25/d45/d75/d34/cf9 0 2024-09-06T14:44:36.609 INFO:tasks.workunit.client.1.smithi165.stdout:5/894: dread d6/d1c/f74 [0,4194304] 0 2024-09-06T14:44:36.611 INFO:tasks.workunit.client.1.smithi165.stdout:1/761: symlink d0/d1c/d1d/d22/lf2 0 2024-09-06T14:44:36.613 INFO:tasks.workunit.client.1.smithi165.stdout:4/844: dread d5/d1b/d1c/d55/f56 [0,4194304] 0 2024-09-06T14:44:36.613 INFO:tasks.workunit.client.1.smithi165.stdout:5/895: rename d6/d1c/d28/d4b/da7/dab/cf7 to d6/d98/dd7/c142 0 2024-09-06T14:44:36.614 INFO:tasks.workunit.client.1.smithi165.stdout:0/738: creat d15/d19/d28/d3a/d5d/dd6/ff4 x:0 0 0 2024-09-06T14:44:36.615 INFO:tasks.workunit.client.1.smithi165.stdout:4/845: chown d5/d1b/d61/f9d 205704281 1 2024-09-06T14:44:36.616 INFO:tasks.workunit.client.1.smithi165.stdout:8/809: dread d0/d14/f1b [0,4194304] 0 2024-09-06T14:44:36.617 INFO:tasks.workunit.client.1.smithi165.stdout:1/762: link d0/d2a/d23/l62 d0/lf3 0 2024-09-06T14:44:36.619 INFO:tasks.workunit.client.1.smithi165.stdout:4/846: mknod d5/d1b/d1c/d55/d7d/c11a 0 2024-09-06T14:44:36.620 INFO:tasks.workunit.client.1.smithi165.stdout:0/739: symlink d15/d19/d2c/df1/lf5 0 2024-09-06T14:44:36.625 INFO:tasks.workunit.client.1.smithi165.stdout:1/763: unlink d0/d2a/d18/d24/d4b/d93/d97/faa 0 2024-09-06T14:44:36.625 INFO:tasks.workunit.client.1.smithi165.stdout:2/754: dread d9/d25/d45/d75/d67/d76/f30 [0,4194304] 0 2024-09-06T14:44:36.627 INFO:tasks.workunit.client.1.smithi165.stdout:2/755: write d9/d88/dc5/fe4 [839642,85930] 0 2024-09-06T14:44:36.627 INFO:tasks.workunit.client.1.smithi165.stdout:1/764: dread - d0/d2a/d18/d24/d4b/d93/d68/dae/fbb zero size 2024-09-06T14:44:36.627 INFO:tasks.workunit.client.1.smithi165.stdout:8/810: symlink d0/d19/d36/d2d/d33/l11b 0 2024-09-06T14:44:36.628 INFO:tasks.workunit.client.1.smithi165.stdout:8/811: dread - d0/d34/d6b/fa0 zero size 2024-09-06T14:44:36.628 INFO:tasks.workunit.client.1.smithi165.stdout:5/896: link d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/cc2 d6/dc1/c143 0 2024-09-06T14:44:36.629 INFO:tasks.workunit.client.1.smithi165.stdout:9/900: sync 2024-09-06T14:44:36.631 INFO:tasks.workunit.client.1.smithi165.stdout:4/847: symlink d5/d1b/d1c/l11b 0 2024-09-06T14:44:36.631 INFO:tasks.workunit.client.1.smithi165.stdout:5/897: dread d6/d1c/d28/f2e [0,4194304] 0 2024-09-06T14:44:36.631 INFO:tasks.workunit.client.1.smithi165.stdout:8/812: read d0/d19/d36/d2d/d33/d3a/d46/f52 [206003,24486] 0 2024-09-06T14:44:36.631 INFO:tasks.workunit.client.1.smithi165.stdout:9/901: fsync db/de/d15/d17/d18/d7d/fae 0 2024-09-06T14:44:36.632 INFO:tasks.workunit.client.1.smithi165.stdout:2/756: creat d9/d23/d29/d48/d8c/ffa x:0 0 0 2024-09-06T14:44:36.632 INFO:tasks.workunit.client.1.smithi165.stdout:9/902: readlink db/de/d15/d17/d72/da3/l11a 0 2024-09-06T14:44:36.633 INFO:tasks.workunit.client.1.smithi165.stdout:8/813: write d0/d34/d6b/d94/d70/ffd [765662,76970] 0 2024-09-06T14:44:36.633 INFO:tasks.workunit.client.1.smithi165.stdout:1/765: rename d0/d2a/d18/d24/d4b/d5f/ccb to d0/d45/cf4 0 2024-09-06T14:44:36.635 INFO:tasks.workunit.client.1.smithi165.stdout:1/766: rename d0 to d0/d2a/d18/d24/d4b/d93/dbd/df5 22 2024-09-06T14:44:36.636 INFO:tasks.workunit.client.1.smithi165.stdout:4/848: rmdir d5/d1b/d61/d77/d93 39 2024-09-06T14:44:36.637 INFO:tasks.workunit.client.1.smithi165.stdout:6/838: write d29/f49 [5007832,85343] 0 2024-09-06T14:44:36.637 INFO:tasks.workunit.client.1.smithi165.stdout:2/757: rmdir d9/d25/d45/d75/d34 39 2024-09-06T14:44:36.639 INFO:tasks.workunit.client.1.smithi165.stdout:5/898: dwrite d6/d1c/d28/d4b/d55/d8a/fa0 [0,4194304] 0 2024-09-06T14:44:36.639 INFO:tasks.workunit.client.1.smithi165.stdout:9/903: truncate db/d40/f53 525678 0 2024-09-06T14:44:36.640 INFO:tasks.workunit.client.1.smithi165.stdout:8/814: chown d0/d19/d36/f2e 2949 1 2024-09-06T14:44:36.640 INFO:tasks.workunit.client.1.smithi165.stdout:4/849: truncate d5/d1b/d1c/d41/d9e/fe1 568573 0 2024-09-06T14:44:36.641 INFO:tasks.workunit.client.1.smithi165.stdout:1/767: unlink d0/d1c/d1d/d22/l7f 0 2024-09-06T14:44:36.643 INFO:tasks.workunit.client.1.smithi165.stdout:4/850: readlink d5/d1b/d1c/d41/d9e/le2 0 2024-09-06T14:44:36.644 INFO:tasks.workunit.client.1.smithi165.stdout:2/758: chown d9/d23/d52/l74 1273769635 1 2024-09-06T14:44:36.645 INFO:tasks.workunit.client.1.smithi165.stdout:5/899: mknod d6/d1c/d28/d2d/d49/c144 0 2024-09-06T14:44:36.645 INFO:tasks.workunit.client.1.smithi165.stdout:9/904: mkdir db/de/d15/d7f/d9b/d11d 0 2024-09-06T14:44:36.648 INFO:tasks.workunit.client.1.smithi165.stdout:1/768: creat d0/d2a/d18/d24/d4b/d93/d97/ff6 x:0 0 0 2024-09-06T14:44:36.650 INFO:tasks.workunit.client.1.smithi165.stdout:8/815: dwrite d0/d5e/d65/f99 [0,4194304] 0 2024-09-06T14:44:36.650 INFO:tasks.workunit.client.1.smithi165.stdout:6/839: rename d29/d39/d5b/d62/d67/ff6 to d29/d39/d5b/d68/db3/f107 0 2024-09-06T14:44:36.653 INFO:tasks.workunit.client.1.smithi165.stdout:2/759: write d9/d25/f61 [1109562,12031] 0 2024-09-06T14:44:36.654 INFO:tasks.workunit.client.1.smithi165.stdout:9/905: creat db/de/d15/d17/d18/d7d/d61/f11e x:0 0 0 2024-09-06T14:44:36.655 INFO:tasks.workunit.client.1.smithi165.stdout:4/851: dwrite d5/d1b/d61/dd7/ddf/f3c [0,4194304] 0 2024-09-06T14:44:36.655 INFO:tasks.workunit.client.1.smithi165.stdout:3/822: sync 2024-09-06T14:44:36.657 INFO:tasks.workunit.client.1.smithi165.stdout:5/900: mkdir d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/d145 0 2024-09-06T14:44:36.658 INFO:tasks.workunit.client.1.smithi165.stdout:0/740: write d15/d19/d50/d53/d7c/dae/ff0 [2208361,104532] 0 2024-09-06T14:44:36.662 INFO:tasks.workunit.client.1.smithi165.stdout:6/840: creat d29/d6a/d83/d89/f108 x:0 0 0 2024-09-06T14:44:36.663 INFO:tasks.workunit.client.1.smithi165.stdout:0/741: write d15/d19/d50/d53/d57/f7d [3226361,18084] 0 2024-09-06T14:44:36.667 INFO:tasks.workunit.client.0.smithi052.stdout:0/130: rename d0/dd/d14/f15 to d0/d1a/d26/f27 0 2024-09-06T14:44:36.669 INFO:tasks.workunit.client.0.smithi052.stdout:9/64: dwrite d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:36.670 INFO:tasks.workunit.client.1.smithi165.stdout:5/901: write d6/d1c/d28/d4b/da7/dab/f128 [732346,70692] 0 2024-09-06T14:44:36.671 INFO:tasks.workunit.client.0.smithi052.stdout:9/65: chown d1/d4/d6/dd 2 1 2024-09-06T14:44:36.672 INFO:tasks.workunit.client.0.smithi052.stdout:0/131: fsync d0/d12/f9 0 2024-09-06T14:44:36.672 INFO:tasks.workunit.client.1.smithi165.stdout:1/769: dwrite d0/d1c/d40/f7a [0,4194304] 0 2024-09-06T14:44:36.672 INFO:tasks.workunit.client.0.smithi052.stdout:9/66: dread - d1/d4/d6/dd/f13 zero size 2024-09-06T14:44:36.673 INFO:tasks.workunit.client.1.smithi165.stdout:9/906: dwrite db/de/d15/d17/d18/d7d/d61/f11e [0,4194304] 0 2024-09-06T14:44:36.674 INFO:tasks.workunit.client.0.smithi052.stdout:9/67: readlink d1/d4/d6/dc/l14 0 2024-09-06T14:44:36.677 INFO:tasks.workunit.client.1.smithi165.stdout:0/742: fdatasync d15/d19/d28/d3a/d5d/fb7 0 2024-09-06T14:44:36.679 INFO:tasks.workunit.client.1.smithi165.stdout:9/907: fdatasync db/de/d16/f6b 0 2024-09-06T14:44:36.680 INFO:tasks.workunit.client.0.smithi052.stdout:0/132: write d0/d1a/d26/f27 [423113,28227] 0 2024-09-06T14:44:36.682 INFO:tasks.workunit.client.1.smithi165.stdout:3/823: dwrite d1/d19/d92/fcd [0,4194304] 0 2024-09-06T14:44:36.682 INFO:tasks.workunit.client.1.smithi165.stdout:6/841: rename d29/d39/fd8 to d29/d39/d5b/d62/d94/db7/dcc/df0/f109 0 2024-09-06T14:44:36.684 INFO:tasks.workunit.client.1.smithi165.stdout:0/743: dread - d15/d19/d50/d53/d7c/fdb zero size 2024-09-06T14:44:36.686 INFO:tasks.workunit.client.1.smithi165.stdout:8/816: write d0/d19/d36/d28/f78 [671208,69290] 0 2024-09-06T14:44:36.692 INFO:tasks.workunit.client.0.smithi052.stdout:9/68: mkdir d1/d4/d6/dc/d10/d18 0 2024-09-06T14:44:36.693 INFO:tasks.workunit.client.1.smithi165.stdout:1/770: dwrite d0/d2a/f16 [0,4194304] 0 2024-09-06T14:44:36.697 INFO:tasks.workunit.client.1.smithi165.stdout:4/852: getdents d5/d1b/d1c 0 2024-09-06T14:44:36.698 INFO:tasks.workunit.client.1.smithi165.stdout:0/744: unlink d15/d19/d2c/fb5 0 2024-09-06T14:44:36.699 INFO:tasks.workunit.client.1.smithi165.stdout:3/824: mkdir d1/da/dd/d8c/d111 0 2024-09-06T14:44:36.699 INFO:tasks.workunit.client.1.smithi165.stdout:2/760: dread d9/d25/d45/d75/d67/d76/f77 [0,4194304] 0 2024-09-06T14:44:36.702 INFO:tasks.workunit.client.1.smithi165.stdout:0/745: chown d15/d19/d50/d53/d8d 2272 1 2024-09-06T14:44:36.703 INFO:tasks.workunit.client.1.smithi165.stdout:6/842: dwrite d29/d39/d5b/d62/d94/fbe [0,4194304] 0 2024-09-06T14:44:36.703 INFO:tasks.workunit.client.0.smithi052.stdout:0/133: dwrite d0/d12/f9 [0,4194304] 0 2024-09-06T14:44:36.703 INFO:tasks.workunit.client.0.smithi052.stdout:9/69: dwrite d1/d4/d6/dd/f13 [0,4194304] 0 2024-09-06T14:44:36.704 INFO:tasks.workunit.client.1.smithi165.stdout:8/817: mkdir d0/d34/d6b/d94/d70/db8/d11c 0 2024-09-06T14:44:36.706 INFO:tasks.workunit.client.0.smithi052.stdout:9/70: dread d1/fa [0,4194304] 0 2024-09-06T14:44:36.711 INFO:tasks.workunit.client.1.smithi165.stdout:2/761: dwrite d9/d25/d45/f51 [0,4194304] 0 2024-09-06T14:44:36.712 INFO:tasks.workunit.client.0.smithi052.stdout:9/71: mknod d1/d4/d6/dd/c19 0 2024-09-06T14:44:36.713 INFO:tasks.workunit.client.1.smithi165.stdout:7/667: sync 2024-09-06T14:44:36.714 INFO:tasks.workunit.client.1.smithi165.stdout:7/668: readlink d20/d33/d6a/d9a/la1 0 2024-09-06T14:44:36.714 INFO:tasks.workunit.client.1.smithi165.stdout:1/771: rename d0/cda to d0/d2a/d18/d24/d4b/d93/d68/dae/cf7 0 2024-09-06T14:44:36.715 INFO:tasks.workunit.client.0.smithi052.stdout:0/134: symlink d0/dd/d14/d20/d22/l28 0 2024-09-06T14:44:36.716 INFO:tasks.workunit.client.1.smithi165.stdout:7/669: readlink d20/d65/l8e 0 2024-09-06T14:44:36.716 INFO:tasks.workunit.client.0.smithi052.stdout:9/72: mknod d1/d4/d6/dd/c1a 0 2024-09-06T14:44:36.718 INFO:tasks.workunit.client.1.smithi165.stdout:1/772: truncate d0/d1c/d1d/d57/fd0 474179 0 2024-09-06T14:44:36.719 INFO:tasks.workunit.client.0.smithi052.stdout:0/135: mkdir d0/d19/d29 0 2024-09-06T14:44:36.721 INFO:tasks.workunit.client.1.smithi165.stdout:5/902: dread d6/d1c/d28/d4b/feb [0,4194304] 0 2024-09-06T14:44:36.722 INFO:tasks.workunit.client.1.smithi165.stdout:6/843: stat d29/d39/d5b/d62/d94/db7/dcc/ce9 0 2024-09-06T14:44:36.724 INFO:tasks.workunit.client.1.smithi165.stdout:9/908: dread db/de/d15/d17/d18/d7d/fae [0,4194304] 0 2024-09-06T14:44:36.726 INFO:tasks.workunit.client.1.smithi165.stdout:4/853: rename d5/d1b/d66 to d5/d1b/d1c/d8c/d106/d11c 0 2024-09-06T14:44:36.728 INFO:tasks.workunit.client.0.smithi052.stdout:0/136: unlink d0/dd/l16 0 2024-09-06T14:44:36.729 INFO:tasks.workunit.client.1.smithi165.stdout:7/670: write d20/f21 [612946,73226] 0 2024-09-06T14:44:36.731 INFO:tasks.workunit.client.1.smithi165.stdout:0/746: link ff d15/d6e/ff6 0 2024-09-06T14:44:36.731 INFO:tasks.workunit.client.1.smithi165.stdout:6/844: dwrite d29/d32/ff9 [4194304,4194304] 0 2024-09-06T14:44:36.732 INFO:tasks.workunit.client.0.smithi052.stdout:0/137: mknod d0/dd/d14/d20/d22/c2a 0 2024-09-06T14:44:36.734 INFO:tasks.workunit.client.1.smithi165.stdout:2/762: mknod d9/d88/dac/da4/de8/cfb 0 2024-09-06T14:44:36.736 INFO:tasks.workunit.client.1.smithi165.stdout:2/763: dread - d9/d25/d45/d75/fb3 zero size 2024-09-06T14:44:36.736 INFO:tasks.workunit.client.0.smithi052.stdout:0/138: rename d0/d12/f9 to d0/d12/f2b 0 2024-09-06T14:44:36.738 INFO:tasks.workunit.client.1.smithi165.stdout:1/773: dwrite d0/d2a/d18/d24/d4b/d93/d2b/f4a [0,4194304] 0 2024-09-06T14:44:36.739 INFO:tasks.workunit.client.1.smithi165.stdout:9/909: chown db/de/d15/d7f/d9b/cbf 4056080 1 2024-09-06T14:44:36.740 INFO:tasks.workunit.client.1.smithi165.stdout:1/774: dread - d0/d2a/d18/d24/d4b/d93/d68/dae/fbb zero size 2024-09-06T14:44:36.740 INFO:tasks.workunit.client.1.smithi165.stdout:3/825: rename d1/da/dc/d3b/dc6/d89 to d1/da/dd/d4b/d112 0 2024-09-06T14:44:36.742 INFO:tasks.workunit.client.0.smithi052.stdout:9/73: dwrite d1/d4/f9 [0,4194304] 0 2024-09-06T14:44:36.742 INFO:tasks.workunit.client.1.smithi165.stdout:7/671: creat d20/d4d/d54/fd0 x:0 0 0 2024-09-06T14:44:36.743 INFO:tasks.workunit.client.0.smithi052.stdout:9/74: rename d1 to d1/d4/d6/dc/d10/d1b 22 2024-09-06T14:44:36.744 INFO:tasks.workunit.client.1.smithi165.stdout:7/672: write d20/d3b/d69/d88/d80/d81/fa7 [821184,121300] 0 2024-09-06T14:44:36.747 INFO:tasks.workunit.client.0.smithi052.stdout:0/139: symlink d0/dd/l2c 0 2024-09-06T14:44:36.750 INFO:tasks.workunit.client.1.smithi165.stdout:0/747: creat d15/d19/d28/d3a/d3f/ff7 x:0 0 0 2024-09-06T14:44:36.751 INFO:tasks.workunit.client.1.smithi165.stdout:0/748: chown d15/d19/d28/d3a/d3f/l98 8698071 1 2024-09-06T14:44:36.754 INFO:tasks.workunit.client.0.smithi052.stdout:7/112: sync 2024-09-06T14:44:36.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/113: stat d11/f12 0 2024-09-06T14:44:36.755 INFO:tasks.workunit.client.0.smithi052.stdout:0/140: rmdir d0/d18 39 2024-09-06T14:44:36.755 INFO:tasks.workunit.client.0.smithi052.stdout:0/141: chown d0/d19/d29 97658 1 2024-09-06T14:44:36.758 INFO:tasks.workunit.client.1.smithi165.stdout:8/818: dwrite d0/d14/fae [0,4194304] 0 2024-09-06T14:44:36.762 INFO:tasks.workunit.client.0.smithi052.stdout:0/142: dwrite d0/d12/f11 [0,4194304] 0 2024-09-06T14:44:36.764 INFO:tasks.workunit.client.0.smithi052.stdout:0/143: chown d0/fe 16 1 2024-09-06T14:44:36.764 INFO:tasks.workunit.client.0.smithi052.stdout:0/144: readlink d0/d12/l1b 0 2024-09-06T14:44:36.765 INFO:tasks.workunit.client.0.smithi052.stdout:0/145: write d0/fe [624289,30044] 0 2024-09-06T14:44:36.769 INFO:tasks.workunit.client.1.smithi165.stdout:5/903: rename d6/d32/cc5 to d6/d1c/d28/d2d/d3c/d44/d90/c146 0 2024-09-06T14:44:36.770 INFO:tasks.workunit.client.1.smithi165.stdout:5/904: chown d6/d98/f101 518672507 1 2024-09-06T14:44:36.771 INFO:tasks.workunit.client.0.smithi052.stdout:7/114: creat d11/d1c/d26/f28 x:0 0 0 2024-09-06T14:44:36.771 INFO:tasks.workunit.client.0.smithi052.stdout:9/75: write d1/f8 [394569,808] 0 2024-09-06T14:44:36.771 INFO:tasks.workunit.client.0.smithi052.stdout:7/115: fdatasync f7 0 2024-09-06T14:44:36.772 INFO:tasks.workunit.client.1.smithi165.stdout:4/854: mknod d5/d1b/d61/d77/d93/c11d 0 2024-09-06T14:44:36.774 INFO:tasks.workunit.client.0.smithi052.stdout:0/146: rename d0/d12 to d0/dd/d14/d2d 0 2024-09-06T14:44:36.775 INFO:tasks.workunit.client.1.smithi165.stdout:7/673: mkdir d20/d3b/d69/dd1 0 2024-09-06T14:44:36.776 INFO:tasks.workunit.client.1.smithi165.stdout:7/674: chown d20/d3b/d69/da3/fba 1155949 1 2024-09-06T14:44:36.777 INFO:tasks.workunit.client.0.smithi052.stdout:0/147: chown d0/dd/d14/d2d/l1b 51677980 1 2024-09-06T14:44:36.777 INFO:tasks.workunit.client.0.smithi052.stdout:0/148: readlink d0/dd/l21 0 2024-09-06T14:44:36.779 INFO:tasks.workunit.client.1.smithi165.stdout:9/910: dwrite db/de/d15/f69 [0,4194304] 0 2024-09-06T14:44:36.779 INFO:tasks.workunit.client.0.smithi052.stdout:7/116: dwrite d11/d1c/f1e [0,4194304] 0 2024-09-06T14:44:36.780 INFO:tasks.workunit.client.1.smithi165.stdout:9/911: chown db/de/d15/d17/dc3 6856975 1 2024-09-06T14:44:36.780 INFO:tasks.workunit.client.1.smithi165.stdout:9/912: dread - db/de/d16/f43 zero size 2024-09-06T14:44:36.812 INFO:tasks.workunit.client.0.smithi052.stdout:9/76: unlink d1/d4/d6/dd/c19 0 2024-09-06T14:44:36.813 INFO:tasks.workunit.client.0.smithi052.stdout:9/77: write d1/d4/d6/dd/f13 [1331921,122732] 0 2024-09-06T14:44:36.815 INFO:tasks.workunit.client.1.smithi165.stdout:6/845: mkdir d29/d39/d5b/d62/d9f/d10a 0 2024-09-06T14:44:36.821 INFO:tasks.workunit.client.1.smithi165.stdout:6/846: dwrite d29/d6a/f70 [8388608,4194304] 0 2024-09-06T14:44:36.825 INFO:tasks.workunit.client.0.smithi052.stdout:7/117: creat d11/d1c/d24/f29 x:0 0 0 2024-09-06T14:44:36.832 INFO:tasks.workunit.client.0.smithi052.stdout:7/118: truncate d11/f12 1082613 0 2024-09-06T14:44:36.832 INFO:tasks.workunit.client.0.smithi052.stdout:7/119: dread - d11/f21 zero size 2024-09-06T14:44:36.833 INFO:tasks.workunit.client.1.smithi165.stdout:5/905: creat d6/d1c/d64/f147 x:0 0 0 2024-09-06T14:44:36.834 INFO:tasks.workunit.client.0.smithi052.stdout:7/120: truncate d11/d1c/d24/f25 873969 0 2024-09-06T14:44:36.834 INFO:tasks.workunit.client.0.smithi052.stdout:7/121: read - d11/d1c/d24/f29 zero size 2024-09-06T14:44:36.835 INFO:tasks.workunit.client.1.smithi165.stdout:4/855: symlink d5/d1b/d61/d77/d7c/dcd/l11e 0 2024-09-06T14:44:36.836 INFO:tasks.workunit.client.1.smithi165.stdout:4/856: read d5/f50 [1103468,98343] 0 2024-09-06T14:44:36.837 INFO:tasks.workunit.client.1.smithi165.stdout:7/675: readlink d20/d40/l89 0 2024-09-06T14:44:36.839 INFO:tasks.workunit.client.0.smithi052.stdout:7/122: creat d11/d1c/f2a x:0 0 0 2024-09-06T14:44:36.840 INFO:tasks.workunit.client.1.smithi165.stdout:9/913: fdatasync db/de/d15/fc5 0 2024-09-06T14:44:36.843 INFO:tasks.workunit.client.0.smithi052.stdout:7/123: creat d11/d1c/d26/f2b x:0 0 0 2024-09-06T14:44:36.843 INFO:tasks.workunit.client.0.smithi052.stdout:7/124: truncate f7 4457140 0 2024-09-06T14:44:36.844 INFO:tasks.workunit.client.1.smithi165.stdout:6/847: mknod d29/d39/d5b/d62/d67/c10b 0 2024-09-06T14:44:36.849 INFO:tasks.workunit.client.1.smithi165.stdout:6/848: dwrite d29/f48 [0,4194304] 0 2024-09-06T14:44:36.853 INFO:tasks.workunit.client.0.smithi052.stdout:7/125: dwrite d11/d1c/d26/f2b [0,4194304] 0 2024-09-06T14:44:36.854 INFO:tasks.workunit.client.1.smithi165.stdout:8/819: creat d0/d14/f11d x:0 0 0 2024-09-06T14:44:36.855 INFO:tasks.workunit.client.0.smithi052.stdout:7/126: fsync ff 0 2024-09-06T14:44:36.856 INFO:tasks.workunit.client.0.smithi052.stdout:7/127: dread - d11/d1c/d26/f28 zero size 2024-09-06T14:44:36.863 INFO:tasks.workunit.client.1.smithi165.stdout:4/857: creat d5/d1b/d1c/d20/f11f x:0 0 0 2024-09-06T14:44:36.864 INFO:tasks.workunit.client.1.smithi165.stdout:4/858: chown d5/d1b/d1c/l11b 2397882 1 2024-09-06T14:44:36.864 INFO:tasks.workunit.client.1.smithi165.stdout:7/676: rmdir d20/d40/dc0 0 2024-09-06T14:44:36.865 INFO:tasks.workunit.client.1.smithi165.stdout:9/914: link db/de/d16/f24 db/de/d15/d17/dad/f11f 0 2024-09-06T14:44:36.866 INFO:tasks.workunit.client.1.smithi165.stdout:8/820: link d0/d19/d36/d28/f90 d0/d19/d36/d28/d64/f11e 0 2024-09-06T14:44:36.867 INFO:tasks.workunit.client.1.smithi165.stdout:4/859: dread - d5/d1b/d61/d77/dbd/f117 zero size 2024-09-06T14:44:36.871 INFO:tasks.workunit.client.1.smithi165.stdout:9/915: mknod db/de/d15/d7f/d9b/d6c/d96/d101/d103/c120 0 2024-09-06T14:44:36.872 INFO:tasks.workunit.client.1.smithi165.stdout:4/860: fdatasync d5/d1b/d61/d77/dbd/f117 0 2024-09-06T14:44:36.873 INFO:tasks.workunit.client.1.smithi165.stdout:8/821: creat d0/d34/d6b/dbe/f11f x:0 0 0 2024-09-06T14:44:36.873 INFO:tasks.workunit.client.1.smithi165.stdout:4/861: truncate d5/d1b/d1c/d41/fb4 854238 0 2024-09-06T14:44:36.875 INFO:tasks.workunit.client.1.smithi165.stdout:4/862: write d5/d1b/d1c/d41/d9e/fe1 [1196094,88633] 0 2024-09-06T14:44:36.875 INFO:tasks.workunit.client.1.smithi165.stdout:9/916: creat db/de/d15/d17/d72/f121 x:0 0 0 2024-09-06T14:44:36.878 INFO:tasks.workunit.client.1.smithi165.stdout:8/822: creat d0/d19/d36/d2d/d33/d84/f120 x:0 0 0 2024-09-06T14:44:36.878 INFO:tasks.workunit.client.1.smithi165.stdout:7/677: link d20/d65/f2d d20/d65/fd2 0 2024-09-06T14:44:36.880 INFO:tasks.workunit.client.1.smithi165.stdout:9/917: creat db/de/d16/d2e/f122 x:0 0 0 2024-09-06T14:44:36.882 INFO:tasks.workunit.client.1.smithi165.stdout:9/918: truncate db/de/d15/d7f/d9b/d6c/d81/ff0 668252 0 2024-09-06T14:44:36.883 INFO:tasks.workunit.client.1.smithi165.stdout:2/764: rename d9/d88/dac/da4 to d9/d23/d29/d48/dce/dfc 0 2024-09-06T14:44:36.884 INFO:tasks.workunit.client.1.smithi165.stdout:4/863: dread d5/d1b/f74 [0,4194304] 0 2024-09-06T14:44:36.885 INFO:tasks.workunit.client.1.smithi165.stdout:3/826: rename d1/d19/d4d/fe9 to d1/da/dc/d3b/dc6/df0/f113 0 2024-09-06T14:44:36.886 INFO:tasks.workunit.client.1.smithi165.stdout:2/765: rmdir d9/d88 39 2024-09-06T14:44:36.887 INFO:tasks.workunit.client.1.smithi165.stdout:2/766: write d9/d23/d52/fa9 [25714,93887] 0 2024-09-06T14:44:36.887 INFO:tasks.workunit.client.1.smithi165.stdout:8/823: creat d0/d34/d6b/d94/f121 x:0 0 0 2024-09-06T14:44:36.890 INFO:tasks.workunit.client.1.smithi165.stdout:9/919: mkdir db/de/d15/d7f/dbc/ddf/d123 0 2024-09-06T14:44:36.891 INFO:tasks.workunit.client.1.smithi165.stdout:9/920: readlink db/de/d16/le9 0 2024-09-06T14:44:36.892 INFO:tasks.workunit.client.1.smithi165.stdout:9/921: chown db/de/d15/d17/d18/d7d/d61/fa0 2758594 1 2024-09-06T14:44:36.892 INFO:tasks.workunit.client.1.smithi165.stdout:1/775: rename d0/d1c/lec to d0/d1c/d41/de3/lf8 0 2024-09-06T14:44:36.893 INFO:tasks.workunit.client.1.smithi165.stdout:3/827: creat d1/da/dd/d8c/dae/f114 x:0 0 0 2024-09-06T14:44:36.898 INFO:tasks.workunit.client.0.smithi052.stdout:0/149: mkdir d0/d2e 0 2024-09-06T14:44:36.899 INFO:tasks.workunit.client.1.smithi165.stdout:7/678: dread d20/d3b/f3f [0,4194304] 0 2024-09-06T14:44:36.901 INFO:tasks.workunit.client.1.smithi165.stdout:2/767: mkdir d9/d25/dfd 0 2024-09-06T14:44:36.901 INFO:tasks.workunit.client.1.smithi165.stdout:7/679: chown d20/d33/d6a/d9a/la1 63494 1 2024-09-06T14:44:36.902 INFO:tasks.workunit.client.1.smithi165.stdout:3/828: dread d1/d19/d92/fcd [0,4194304] 0 2024-09-06T14:44:36.902 INFO:tasks.workunit.client.1.smithi165.stdout:0/749: dwrite d15/d55/f84 [0,4194304] 0 2024-09-06T14:44:36.904 INFO:tasks.workunit.client.1.smithi165.stdout:8/824: creat d0/d19/d36/d28/de0/f122 x:0 0 0 2024-09-06T14:44:36.904 INFO:tasks.workunit.client.1.smithi165.stdout:0/750: stat d15/d19/d50/fec 0 2024-09-06T14:44:36.905 INFO:tasks.workunit.client.0.smithi052.stdout:0/150: link d0/fe d0/dd/d14/d20/f2f 0 2024-09-06T14:44:36.906 INFO:tasks.workunit.client.1.smithi165.stdout:9/922: creat db/de/d15/d7f/d9b/d11d/f124 x:0 0 0 2024-09-06T14:44:36.911 INFO:tasks.workunit.client.1.smithi165.stdout:1/776: dread d0/d2a/d18/d24/d4b/d93/d2b/d3e/f49 [0,4194304] 0 2024-09-06T14:44:36.913 INFO:tasks.workunit.client.1.smithi165.stdout:0/751: dwrite d15/fbe [0,4194304] 0 2024-09-06T14:44:36.916 INFO:tasks.workunit.client.1.smithi165.stdout:7/680: mkdir d20/d3b/d69/d88/d80/dd3 0 2024-09-06T14:44:36.918 INFO:tasks.workunit.client.1.smithi165.stdout:3/829: creat d1/da/dc/d3b/d83/f115 x:0 0 0 2024-09-06T14:44:36.918 INFO:tasks.workunit.client.1.smithi165.stdout:1/777: dread d0/fa4 [0,4194304] 0 2024-09-06T14:44:36.921 INFO:tasks.workunit.client.1.smithi165.stdout:0/752: dwrite d15/d19/f46 [0,4194304] 0 2024-09-06T14:44:36.921 INFO:tasks.workunit.client.1.smithi165.stdout:9/923: creat db/de/d15/d7f/d9b/d11d/f125 x:0 0 0 2024-09-06T14:44:36.921 INFO:tasks.workunit.client.0.smithi052.stdout:0/151: dread d0/dd/d14/d2d/fb [0,4194304] 0 2024-09-06T14:44:36.924 INFO:tasks.workunit.client.1.smithi165.stdout:2/768: rename d9/d23/f28 to d9/d25/d46/de2/ffe 0 2024-09-06T14:44:36.927 INFO:tasks.workunit.client.1.smithi165.stdout:7/681: mkdir d20/d4d/dd4 0 2024-09-06T14:44:36.930 INFO:tasks.workunit.client.1.smithi165.stdout:3/830: write d1/da/dc/d3b/dc6/df0/f113 [209878,42649] 0 2024-09-06T14:44:36.931 INFO:tasks.workunit.client.1.smithi165.stdout:3/831: write d1/d4a/dc7/fdf [2086885,90902] 0 2024-09-06T14:44:36.933 INFO:tasks.workunit.client.0.smithi052.stdout:0/152: dwrite d0/dd/d14/d2d/fb [0,4194304] 0 2024-09-06T14:44:36.936 INFO:tasks.workunit.client.1.smithi165.stdout:8/825: creat d0/d19/d36/d2d/d33/d3a/d46/f123 x:0 0 0 2024-09-06T14:44:36.938 INFO:tasks.workunit.client.0.smithi052.stdout:0/153: mknod d0/dd/d14/c30 0 2024-09-06T14:44:36.944 INFO:tasks.workunit.client.1.smithi165.stdout:8/826: symlink d0/d34/d6b/d94/d70/l124 0 2024-09-06T14:44:36.945 INFO:tasks.workunit.client.1.smithi165.stdout:2/769: dread d9/f17 [4194304,4194304] 0 2024-09-06T14:44:36.945 INFO:tasks.workunit.client.1.smithi165.stdout:8/827: chown d0/d34/d6b/d94/d70/fc0 0 1 2024-09-06T14:44:36.947 INFO:tasks.workunit.client.1.smithi165.stdout:7/682: rename d20/d3b/d69/d88/d30/f31 to d20/d33/fd5 0 2024-09-06T14:44:36.951 INFO:tasks.workunit.client.1.smithi165.stdout:8/828: rename d0/d34/d6b/d94/d70/db7 to d0/d19/d24/db1/d5b/d125 0 2024-09-06T14:44:36.954 INFO:tasks.workunit.client.1.smithi165.stdout:8/829: dread d0/d19/d36/d28/f78 [0,4194304] 0 2024-09-06T14:44:36.955 INFO:tasks.workunit.client.1.smithi165.stdout:4/864: link d5/d1b/d61/dd7/ddf/l65 d5/d1b/d61/d77/d7c/l120 0 2024-09-06T14:44:36.956 INFO:tasks.workunit.client.1.smithi165.stdout:7/683: mkdir d20/d3b/d69/dd1/dd6 0 2024-09-06T14:44:36.956 INFO:tasks.workunit.client.1.smithi165.stdout:8/830: truncate d0/d34/d6b/fa0 44269 0 2024-09-06T14:44:36.956 INFO:tasks.workunit.client.1.smithi165.stdout:4/865: write d5/d1b/d1c/d20/d75/d83/f4d [1586397,88535] 0 2024-09-06T14:44:36.962 INFO:tasks.workunit.client.1.smithi165.stdout:4/866: truncate d5/f2c 1286254 0 2024-09-06T14:44:36.962 INFO:tasks.workunit.client.1.smithi165.stdout:7/684: dread d20/d65/fd2 [0,4194304] 0 2024-09-06T14:44:36.963 INFO:tasks.workunit.client.1.smithi165.stdout:6/849: sync 2024-09-06T14:44:36.963 INFO:tasks.workunit.client.1.smithi165.stdout:6/850: chown f3 10741759 1 2024-09-06T14:44:36.964 INFO:tasks.workunit.client.1.smithi165.stdout:8/831: link d0/d19/d36/d2d/d33/da8/le1 d0/d14/d3e/db4/l126 0 2024-09-06T14:44:36.967 INFO:tasks.workunit.client.1.smithi165.stdout:7/685: symlink d20/d33/d6a/d9a/ld7 0 2024-09-06T14:44:36.967 INFO:tasks.workunit.client.1.smithi165.stdout:7/686: dread - d20/d4d/d54/f9c zero size 2024-09-06T14:44:36.968 INFO:tasks.workunit.client.1.smithi165.stdout:5/906: link d6/d1c/d28/d2d/d3c/d81/f117 d6/f148 0 2024-09-06T14:44:36.968 INFO:tasks.workunit.client.1.smithi165.stdout:6/851: symlink d29/d39/d5b/d68/l10c 0 2024-09-06T14:44:36.969 INFO:tasks.workunit.client.0.smithi052.stdout:0/154: rmdir d0 39 2024-09-06T14:44:36.970 INFO:tasks.workunit.client.1.smithi165.stdout:4/867: mknod d5/d1b/d61/d77/d7c/dcd/dc9/d105/c121 0 2024-09-06T14:44:36.971 INFO:tasks.workunit.client.1.smithi165.stdout:8/832: truncate d0/d34/d6b/d94/f59 362363 0 2024-09-06T14:44:36.972 INFO:tasks.workunit.client.1.smithi165.stdout:7/687: readlink d20/d33/d53/lce 0 2024-09-06T14:44:36.974 INFO:tasks.workunit.client.0.smithi052.stdout:0/155: symlink d0/d1a/l31 0 2024-09-06T14:44:36.975 INFO:tasks.workunit.client.1.smithi165.stdout:8/833: unlink d0/d19/d24/db1/d5b/c63 0 2024-09-06T14:44:36.976 INFO:tasks.workunit.client.1.smithi165.stdout:6/852: dwrite d29/d93/d87/df2/ffc [0,4194304] 0 2024-09-06T14:44:36.978 INFO:tasks.workunit.client.0.smithi052.stdout:0/156: creat d0/dd/d14/d20/f32 x:0 0 0 2024-09-06T14:44:36.978 INFO:tasks.workunit.client.1.smithi165.stdout:4/868: dwrite d5/d1b/d61/dd7/ddf/dd4/fe6 [0,4194304] 0 2024-09-06T14:44:36.981 INFO:tasks.workunit.client.1.smithi165.stdout:6/853: unlink d29/d6a/c96 0 2024-09-06T14:44:36.983 INFO:tasks.workunit.client.1.smithi165.stdout:8/834: creat d0/d19/d24/db1/d5b/d125/f127 x:0 0 0 2024-09-06T14:44:36.984 INFO:tasks.workunit.client.0.smithi052.stdout:0/157: rename d0/dd/d14/d2d/fb to d0/dd/d14/d2d/f33 0 2024-09-06T14:44:36.986 INFO:tasks.workunit.client.0.smithi052.stdout:0/158: read d0/f1d [818790,9459] 0 2024-09-06T14:44:36.987 INFO:tasks.workunit.client.1.smithi165.stdout:7/688: link d20/d3b/d69/d88/d30/d78/f84 d20/d3b/d8c/fd8 0 2024-09-06T14:44:36.988 INFO:tasks.workunit.client.1.smithi165.stdout:7/689: write d20/d3b/d69/da3/fb4 [391927,13925] 0 2024-09-06T14:44:36.992 INFO:tasks.workunit.client.0.smithi052.stdout:0/159: mknod d0/dd/d14/d2d/c34 0 2024-09-06T14:44:36.996 INFO:tasks.workunit.client.1.smithi165.stdout:7/690: dread d20/d40/f87 [0,4194304] 0 2024-09-06T14:44:36.998 INFO:tasks.workunit.client.0.smithi052.stdout:0/160: mknod d0/d1a/d26/c35 0 2024-09-06T14:44:36.999 INFO:tasks.workunit.client.1.smithi165.stdout:6/854: mknod d29/d39/d5b/d62/d94/df3/c10d 0 2024-09-06T14:44:36.999 INFO:tasks.workunit.client.1.smithi165.stdout:7/691: dread d20/d3b/d69/da3/fb4 [0,4194304] 0 2024-09-06T14:44:37.000 INFO:tasks.workunit.client.0.smithi052.stdout:0/161: creat d0/dd/f36 x:0 0 0 2024-09-06T14:44:37.001 INFO:tasks.workunit.client.0.smithi052.stdout:0/162: chown d0/dd/d14/d20/f2f 156032 1 2024-09-06T14:44:37.003 INFO:tasks.workunit.client.1.smithi165.stdout:9/924: truncate db/de/d15/f1a 3239703 0 2024-09-06T14:44:37.005 INFO:tasks.workunit.client.1.smithi165.stdout:8/835: creat d0/d19/d36/d2d/d33/f128 x:0 0 0 2024-09-06T14:44:37.006 INFO:tasks.workunit.client.0.smithi052.stdout:0/163: mknod d0/d2e/c37 0 2024-09-06T14:44:37.008 INFO:tasks.workunit.client.1.smithi165.stdout:1/778: dwrite d0/d2a/d18/d24/d4b/d5f/f61 [0,4194304] 0 2024-09-06T14:44:37.009 INFO:tasks.workunit.client.1.smithi165.stdout:7/692: symlink d20/d65/d82/d97/ld9 0 2024-09-06T14:44:37.009 INFO:tasks.workunit.client.1.smithi165.stdout:0/753: dwrite d15/d19/d38/fa0 [0,4194304] 0 2024-09-06T14:44:37.010 INFO:tasks.workunit.client.0.smithi052.stdout:0/164: mknod d0/dd/d14/d20/c38 0 2024-09-06T14:44:37.013 INFO:tasks.workunit.client.1.smithi165.stdout:6/855: rename d29/c2b to d29/d39/d5b/d62/d9f/d10a/c10e 0 2024-09-06T14:44:37.014 INFO:tasks.workunit.client.0.smithi052.stdout:5/55: sync 2024-09-06T14:44:37.014 INFO:tasks.workunit.client.0.smithi052.stdout:2/130: sync 2024-09-06T14:44:37.014 INFO:tasks.workunit.client.0.smithi052.stdout:8/171: sync 2024-09-06T14:44:37.014 INFO:tasks.workunit.client.0.smithi052.stdout:1/249: sync 2024-09-06T14:44:37.014 INFO:tasks.workunit.client.0.smithi052.stdout:4/133: sync 2024-09-06T14:44:37.014 INFO:tasks.workunit.client.0.smithi052.stdout:3/263: sync 2024-09-06T14:44:37.014 INFO:tasks.workunit.client.0.smithi052.stdout:6/71: sync 2024-09-06T14:44:37.015 INFO:tasks.workunit.client.1.smithi165.stdout:3/832: dwrite d1/d4a/f50 [0,4194304] 0 2024-09-06T14:44:37.016 INFO:tasks.workunit.client.0.smithi052.stdout:0/165: rename d0/d2e/c37 to d0/d1a/d26/c39 0 2024-09-06T14:44:37.018 INFO:tasks.workunit.client.1.smithi165.stdout:2/770: creat d9/d23/d29/d48/d8c/fff x:0 0 0 2024-09-06T14:44:37.018 INFO:tasks.workunit.client.1.smithi165.stdout:4/869: getdents d5/d1b/d61/d77 0 2024-09-06T14:44:37.019 INFO:tasks.workunit.client.1.smithi165.stdout:2/771: dread - d9/d25/d45/d75/fd9 zero size 2024-09-06T14:44:37.019 INFO:tasks.workunit.client.0.smithi052.stdout:8/172: write d6/d9/df/d1b/f37 [1019472,101544] 0 2024-09-06T14:44:37.020 INFO:tasks.workunit.client.1.smithi165.stdout:0/754: truncate d15/d19/f25 3475807 0 2024-09-06T14:44:37.020 INFO:tasks.workunit.client.0.smithi052.stdout:5/56: mknod d2/c14 0 2024-09-06T14:44:37.025 INFO:tasks.workunit.client.1.smithi165.stdout:4/870: dwrite d5/d1b/d1c/ff1 [0,4194304] 0 2024-09-06T14:44:37.027 INFO:tasks.workunit.client.1.smithi165.stdout:4/871: truncate d5/d1b/d61/d77/d93/f107 918028 0 2024-09-06T14:44:37.028 INFO:tasks.workunit.client.0.smithi052.stdout:3/264: dread d0/d11/d29/f3e [0,4194304] 0 2024-09-06T14:44:37.028 INFO:tasks.workunit.client.0.smithi052.stdout:5/57: readlink d2/lc 0 2024-09-06T14:44:37.028 INFO:tasks.workunit.client.0.smithi052.stdout:4/134: mkdir d9/d2d/d33 0 2024-09-06T14:44:37.028 INFO:tasks.workunit.client.1.smithi165.stdout:4/872: write d5/d1b/d61/d77/dd5/fe8 [1357776,69718] 0 2024-09-06T14:44:37.032 INFO:tasks.workunit.client.0.smithi052.stdout:3/265: chown d0/d11/d15/f42 3994 1 2024-09-06T14:44:37.032 INFO:tasks.workunit.client.0.smithi052.stdout:6/72: dread d2/fb [0,4194304] 0 2024-09-06T14:44:37.033 INFO:tasks.workunit.client.0.smithi052.stdout:4/135: write f2 [627485,118413] 0 2024-09-06T14:44:37.034 INFO:tasks.workunit.client.1.smithi165.stdout:7/693: fdatasync d20/d33/d53/f55 0 2024-09-06T14:44:37.037 INFO:tasks.workunit.client.0.smithi052.stdout:6/73: stat d2/fb 0 2024-09-06T14:44:37.037 INFO:tasks.workunit.client.1.smithi165.stdout:1/779: creat d0/d2a/d18/d24/d4b/d95/ff9 x:0 0 0 2024-09-06T14:44:37.038 INFO:tasks.workunit.client.0.smithi052.stdout:3/266: chown d0/fe 2167627 1 2024-09-06T14:44:37.039 INFO:tasks.workunit.client.0.smithi052.stdout:1/250: dwrite d1/da/d12/f1e [0,4194304] 0 2024-09-06T14:44:37.039 INFO:tasks.workunit.client.0.smithi052.stdout:0/166: dread d0/fe [0,4194304] 0 2024-09-06T14:44:37.041 INFO:tasks.workunit.client.0.smithi052.stdout:6/74: write d2/f12 [172056,84990] 0 2024-09-06T14:44:37.044 INFO:tasks.workunit.client.0.smithi052.stdout:1/251: read - d1/da/d14/f28 zero size 2024-09-06T14:44:37.047 INFO:tasks.workunit.client.1.smithi165.stdout:6/856: rename d29/d32/c46 to d29/d6a/d83/dc8/c10f 0 2024-09-06T14:44:37.048 INFO:tasks.workunit.client.0.smithi052.stdout:8/173: mkdir d6/d3c 0 2024-09-06T14:44:37.053 INFO:tasks.workunit.client.0.smithi052.stdout:5/58: dwrite d2/fb [0,4194304] 0 2024-09-06T14:44:37.054 INFO:tasks.workunit.client.0.smithi052.stdout:8/174: readlink d6/d9/df/l12 0 2024-09-06T14:44:37.055 INFO:tasks.workunit.client.1.smithi165.stdout:2/772: read d9/d23/d52/fa9 [23212,74769] 0 2024-09-06T14:44:37.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/167: dwrite d0/dd/d14/d20/f32 [0,4194304] 0 2024-09-06T14:44:37.062 INFO:tasks.workunit.client.1.smithi165.stdout:2/773: dwrite d9/d25/d45/d75/fc0 [0,4194304] 0 2024-09-06T14:44:37.065 INFO:tasks.workunit.client.1.smithi165.stdout:4/873: creat d5/d1b/d1c/d8c/d106/f122 x:0 0 0 2024-09-06T14:44:37.066 INFO:tasks.workunit.client.1.smithi165.stdout:2/774: dread d9/d23/d52/fa9 [0,4194304] 0 2024-09-06T14:44:37.068 INFO:tasks.workunit.client.1.smithi165.stdout:6/857: dread d29/d32/d7a/fb6 [0,4194304] 0 2024-09-06T14:44:37.070 INFO:tasks.workunit.client.0.smithi052.stdout:4/136: dread f6 [0,4194304] 0 2024-09-06T14:44:37.071 INFO:tasks.workunit.client.0.smithi052.stdout:6/75: dread d2/fc [0,4194304] 0 2024-09-06T14:44:37.072 INFO:tasks.workunit.client.0.smithi052.stdout:6/76: chown d2/c9 40249167 1 2024-09-06T14:44:37.073 INFO:tasks.workunit.client.0.smithi052.stdout:2/131: getdents da/d19/d20 0 2024-09-06T14:44:37.075 INFO:tasks.workunit.client.1.smithi165.stdout:6/858: dwrite d29/d39/d5b/d62/d67/fe5 [0,4194304] 0 2024-09-06T14:44:37.080 INFO:tasks.workunit.client.0.smithi052.stdout:3/267: mknod d0/d11/d29/d35/d46/c49 0 2024-09-06T14:44:37.081 INFO:tasks.workunit.client.0.smithi052.stdout:4/137: dread d9/d10/f22 [0,4194304] 0 2024-09-06T14:44:37.083 INFO:tasks.workunit.client.0.smithi052.stdout:1/252: rename d1/da/l43 to d1/db/d18/l54 0 2024-09-06T14:44:37.083 INFO:tasks.workunit.client.0.smithi052.stdout:2/132: dwrite da/f11 [0,4194304] 0 2024-09-06T14:44:37.084 INFO:tasks.workunit.client.0.smithi052.stdout:4/138: dread - d9/d10/d19/f28 zero size 2024-09-06T14:44:37.086 INFO:tasks.workunit.client.1.smithi165.stdout:1/780: symlink d0/d1c/d1d/lfa 0 2024-09-06T14:44:37.087 INFO:tasks.workunit.client.0.smithi052.stdout:2/133: truncate da/d19/f29 16762 0 2024-09-06T14:44:37.087 INFO:tasks.workunit.client.0.smithi052.stdout:6/77: mkdir d2/dd/d18 0 2024-09-06T14:44:37.087 INFO:tasks.workunit.client.1.smithi165.stdout:3/833: write d1/da/dc/d10/f35 [3149299,57338] 0 2024-09-06T14:44:37.088 INFO:tasks.workunit.client.0.smithi052.stdout:2/134: write f2 [1390574,19788] 0 2024-09-06T14:44:37.089 INFO:tasks.workunit.client.0.smithi052.stdout:8/175: mknod d6/d3c/c3d 0 2024-09-06T14:44:37.089 INFO:tasks.workunit.client.0.smithi052.stdout:2/135: chown da/l21 51 1 2024-09-06T14:44:37.089 INFO:tasks.workunit.client.0.smithi052.stdout:8/176: readlink d6/d9/l23 0 2024-09-06T14:44:37.093 INFO:tasks.workunit.client.0.smithi052.stdout:3/268: unlink d0/d11/d15/d19/f3b 0 2024-09-06T14:44:37.094 INFO:tasks.workunit.client.1.smithi165.stdout:0/755: write d15/d6e/f85 [234454,124092] 0 2024-09-06T14:44:37.096 INFO:tasks.workunit.client.1.smithi165.stdout:5/907: sync 2024-09-06T14:44:37.098 INFO:tasks.workunit.client.0.smithi052.stdout:0/168: rename d0/dd to d0/d1a/d26/d3a 0 2024-09-06T14:44:37.099 INFO:tasks.workunit.client.0.smithi052.stdout:0/169: read d0/d1a/d26/f27 [185931,28212] 0 2024-09-06T14:44:37.102 INFO:tasks.workunit.client.0.smithi052.stdout:4/139: mknod d9/d10/d17/c34 0 2024-09-06T14:44:37.103 INFO:tasks.workunit.client.1.smithi165.stdout:4/874: symlink d5/d1b/d61/d77/d93/l123 0 2024-09-06T14:44:37.103 INFO:tasks.workunit.client.1.smithi165.stdout:4/875: stat d5/d1b/d1c/d78/f91 0 2024-09-06T14:44:37.105 INFO:tasks.workunit.client.1.smithi165.stdout:2/775: symlink d9/d25/d46/d7e/l100 0 2024-09-06T14:44:37.111 INFO:tasks.workunit.client.0.smithi052.stdout:8/177: unlink d6/d9/d21/f2a 0 2024-09-06T14:44:37.113 INFO:tasks.workunit.client.1.smithi165.stdout:6/859: symlink d29/d6a/d83/d89/ddb/l110 0 2024-09-06T14:44:37.116 INFO:tasks.workunit.client.1.smithi165.stdout:8/836: rmdir d0/d34/d6b/d94/d103 0 2024-09-06T14:44:37.117 INFO:tasks.workunit.client.1.smithi165.stdout:8/837: chown d0/d19/d36/d2d/d33/d3a/lc4 0 1 2024-09-06T14:44:37.120 INFO:tasks.workunit.client.0.smithi052.stdout:3/269: unlink d0/d11/d29/d35/f2b 0 2024-09-06T14:44:37.120 INFO:tasks.workunit.client.0.smithi052.stdout:3/270: readlink d0/d11/d12/l44 0 2024-09-06T14:44:37.122 INFO:tasks.workunit.client.0.smithi052.stdout:1/253: truncate d1/da/d3e/f44 997103 0 2024-09-06T14:44:37.124 INFO:tasks.workunit.client.1.smithi165.stdout:1/781: mknod d0/d1c/d1d/d22/cfb 0 2024-09-06T14:44:37.126 INFO:tasks.workunit.client.1.smithi165.stdout:3/834: mknod d1/da/d43/c116 0 2024-09-06T14:44:37.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/170: symlink d0/d2e/l3b 0 2024-09-06T14:44:37.129 INFO:tasks.workunit.client.0.smithi052.stdout:0/171: readlink d0/d1a/d26/d3a/d14/d2d/l1b 0 2024-09-06T14:44:37.130 INFO:tasks.workunit.client.1.smithi165.stdout:0/756: mkdir d15/d19/d66/df8 0 2024-09-06T14:44:37.130 INFO:tasks.workunit.client.0.smithi052.stdout:0/172: read d0/d1a/d26/d3a/d14/d20/f2f [178757,7606] 0 2024-09-06T14:44:37.131 INFO:tasks.workunit.client.0.smithi052.stdout:4/140: unlink d9/d10/d17/l24 0 2024-09-06T14:44:37.134 INFO:tasks.workunit.client.1.smithi165.stdout:5/908: creat d6/d1c/d28/d2d/d3c/d81/f149 x:0 0 0 2024-09-06T14:44:37.136 INFO:tasks.workunit.client.0.smithi052.stdout:2/136: mkdir da/d19/d20/d2a/d31 0 2024-09-06T14:44:37.139 INFO:tasks.workunit.client.1.smithi165.stdout:9/925: getdents db/de/d15/d17/d18/d59 0 2024-09-06T14:44:37.139 INFO:tasks.workunit.client.1.smithi165.stdout:9/926: fdatasync db/de/d15/fc9 0 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 -- 172.21.15.52:0/3958082647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100200 msgr2=0x7f7420100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 --2- 172.21.15.52:0/3958082647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100200 0x7f7420100600 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7410009880 tx=0x7f741002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 -- 172.21.15.52:0/3958082647 shutdown_connections 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 --2- 172.21.15.52:0/3958082647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7420100b40 0x7f7420100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 --2- 172.21.15.52:0/3958082647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100200 0x7f7420100600 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 -- 172.21.15.52:0/3958082647 >> 172.21.15.52:0/3958082647 conn(0x7f74200fc030 msgr2=0x7f74200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 -- 172.21.15.52:0/3958082647 shutdown_connections 2024-09-06T14:44:37.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.144+0000 7f742592e640 1 -- 172.21.15.52:0/3958082647 wait complete. 2024-09-06T14:44:37.143 INFO:tasks.workunit.client.1.smithi165.stdout:8/838: rename d0/d19/ld0 to d0/d34/d6b/dbe/l129 0 2024-09-06T14:44:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.145+0000 7f742592e640 1 Processor -- start 2024-09-06T14:44:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.145+0000 7f742592e640 1 -- start start 2024-09-06T14:44:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.145+0000 7f742592e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7420100200 0x7f74201996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.145+0000 7f742592e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100b40 0x7f7420199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.145+0000 7f742592e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f742010c990 con 0x7f7420100b40 2024-09-06T14:44:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.145+0000 7f742592e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f742010c810 con 0x7f7420100200 2024-09-06T14:44:37.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f7417fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100b40 0x7f7420199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f741effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7420100200 0x7f74201996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f7417fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100b40 0x7f7420199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41124/0 (socket says 172.21.15.52:41124) 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f7417fff640 1 -- 172.21.15.52:0/964964103 learned_addr learned my addr 172.21.15.52:0/964964103 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f7417fff640 1 -- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7420100200 msgr2=0x7f74201996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f7417fff640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7420100200 0x7f74201996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f7417fff640 1 -- 172.21.15.52:0/964964103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742019a270 con 0x7f7420100b40 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f741effd640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7420100200 0x7f74201996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f7417fff640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100b40 0x7f7420199bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f740800e970 tx=0x7f740800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.146+0000 7f742492c640 1 -- 172.21.15.52:0/964964103 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f740800cac0 con 0x7f7420100b40 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.147+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742019ecb0 con 0x7f7420100b40 2024-09-06T14:44:37.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.147+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742019f1e0 con 0x7f7420100b40 2024-09-06T14:44:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.147+0000 7f742492c640 1 -- 172.21.15.52:0/964964103 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f740800cc60 con 0x7f7420100b40 2024-09-06T14:44:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.147+0000 7f742492c640 1 -- 172.21.15.52:0/964964103 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7408018720 con 0x7f7420100b40 2024-09-06T14:44:37.147 INFO:tasks.workunit.client.0.smithi052.stdout:1/254: unlink d1/db/l30 0 2024-09-06T14:44:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.148+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7420100600 con 0x7f7420100b40 2024-09-06T14:44:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.149+0000 7f742492c640 1 -- 172.21.15.52:0/964964103 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7f7408010430 con 0x7f7420100b40 2024-09-06T14:44:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.149+0000 7f742492c640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f74000729a0 0x7f7400074e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.149+0000 7f742492c640 1 -- 172.21.15.52:0/964964103 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f7408093e30 con 0x7f7420100b40 2024-09-06T14:44:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.150+0000 7f741effd640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f74000729a0 0x7f7400074e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.150+0000 7f741effd640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f74000729a0 0x7f7400074e60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f74100058d0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:37.149 INFO:tasks.workunit.client.1.smithi165.stdout:8/839: readlink d0/d19/d36/d2d/d33/d3a/d46/d49/l7a 0 2024-09-06T14:44:37.149 INFO:tasks.workunit.client.1.smithi165.stdout:1/782: creat d0/d2a/d18/d24/d4b/d93/dbd/dd1/ffc x:0 0 0 2024-09-06T14:44:37.149 INFO:tasks.workunit.client.1.smithi165.stdout:3/835: rmdir d1/d19/d4d 39 2024-09-06T14:44:37.149 INFO:tasks.workunit.client.1.smithi165.stdout:3/836: truncate d1/da/dc/d10/fd4 443311 0 2024-09-06T14:44:37.150 INFO:tasks.workunit.client.0.smithi052.stdout:0/173: unlink d0/d1a/d26/d3a/l21 0 2024-09-06T14:44:37.150 INFO:tasks.workunit.client.1.smithi165.stdout:9/927: dread db/de/d16/d2e/ffe [0,4194304] 0 2024-09-06T14:44:37.151 INFO:tasks.workunit.client.1.smithi165.stdout:9/928: chown db/dcf/fd8 10334418 1 2024-09-06T14:44:37.151 INFO:tasks.workunit.client.1.smithi165.stdout:5/909: mkdir d6/d1c/d28/d14a 0 2024-09-06T14:44:37.151 INFO:tasks.workunit.client.1.smithi165.stdout:5/910: dread - d6/d1c/d64/f147 zero size 2024-09-06T14:44:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.155+0000 7f742492c640 1 -- 172.21.15.52:0/964964103 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f7408061180 con 0x7f7420100b40 2024-09-06T14:44:37.152 INFO:tasks.workunit.client.1.smithi165.stdout:5/911: chown d6/d1c/d28/d2d/d3c/d44/d90/ddf 2347770 1 2024-09-06T14:44:37.153 INFO:tasks.workunit.client.0.smithi052.stdout:6/78: rmdir d2/d14 0 2024-09-06T14:44:37.155 INFO:tasks.workunit.client.1.smithi165.stdout:2/776: mkdir d9/d88/db8/d101 0 2024-09-06T14:44:37.156 INFO:tasks.workunit.client.0.smithi052.stdout:2/137: unlink c6 0 2024-09-06T14:44:37.158 INFO:tasks.workunit.client.0.smithi052.stdout:8/178: mkdir d6/d22/d36/d3e 0 2024-09-06T14:44:37.159 INFO:tasks.workunit.client.1.smithi165.stdout:6/860: mkdir d29/d39/d5b/d62/d94/db7/dfa/d111 0 2024-09-06T14:44:37.160 INFO:tasks.workunit.client.1.smithi165.stdout:6/861: write d29/d6a/d71/fe2 [21481,33516] 0 2024-09-06T14:44:37.160 INFO:tasks.workunit.client.1.smithi165.stdout:7/694: getdents d20/d33/d6a/d9a 0 2024-09-06T14:44:37.162 INFO:tasks.workunit.client.0.smithi052.stdout:1/255: mknod d1/da/d3e/d47/d4a/c55 0 2024-09-06T14:44:37.163 INFO:tasks.workunit.client.0.smithi052.stdout:0/174: symlink d0/d1a/d26/d3a/d14/d20/d22/l3c 0 2024-09-06T14:44:37.165 INFO:tasks.workunit.client.1.smithi165.stdout:0/757: symlink d15/d19/lf9 0 2024-09-06T14:44:37.166 INFO:tasks.workunit.client.0.smithi052.stdout:6/79: fsync d2/dd/f10 0 2024-09-06T14:44:37.167 INFO:tasks.workunit.client.1.smithi165.stdout:3/837: mknod d1/da/dc/d3b/dc6/df0/c117 0 2024-09-06T14:44:37.170 INFO:tasks.workunit.client.0.smithi052.stdout:8/179: creat d6/d9/d21/f3f x:0 0 0 2024-09-06T14:44:37.172 INFO:tasks.workunit.client.1.smithi165.stdout:4/876: link d5/d1b/d61/d77/d7c/daa/cac d5/d1b/d1c/d41/c124 0 2024-09-06T14:44:37.175 INFO:tasks.workunit.client.1.smithi165.stdout:2/777: mknod d9/d25/d46/d7e/c102 0 2024-09-06T14:44:37.176 INFO:tasks.workunit.client.1.smithi165.stdout:0/758: dread f3 [0,4194304] 0 2024-09-06T14:44:37.176 INFO:tasks.workunit.client.1.smithi165.stdout:2/778: read d9/f18 [384158,39830] 0 2024-09-06T14:44:37.176 INFO:tasks.workunit.client.1.smithi165.stdout:0/759: fsync d15/d19/d28/d3a/f86 0 2024-09-06T14:44:37.177 INFO:tasks.workunit.client.0.smithi052.stdout:1/256: mknod d1/db/de/c56 0 2024-09-06T14:44:37.180 INFO:tasks.workunit.client.1.smithi165.stdout:6/862: creat d29/d93/d87/f112 x:0 0 0 2024-09-06T14:44:37.181 INFO:tasks.workunit.client.1.smithi165.stdout:6/863: write d29/d39/d5b/d62/d94/fbc [1207145,24131] 0 2024-09-06T14:44:37.182 INFO:tasks.workunit.client.1.smithi165.stdout:6/864: chown d29/d39/d5b/d68/dec/f101 9536 1 2024-09-06T14:44:37.183 INFO:tasks.workunit.client.1.smithi165.stdout:6/865: dread - d29/d93/d87/df2/ff8 zero size 2024-09-06T14:44:37.184 INFO:tasks.workunit.client.0.smithi052.stdout:4/141: creat d9/f35 x:0 0 0 2024-09-06T14:44:37.189 INFO:tasks.workunit.client.0.smithi052.stdout:6/80: creat d2/f19 x:0 0 0 2024-09-06T14:44:37.192 INFO:tasks.workunit.client.1.smithi165.stdout:3/838: chown d1/da/dd/c36 44 1 2024-09-06T14:44:37.197 INFO:tasks.workunit.client.1.smithi165.stdout:4/877: mkdir d5/d1b/d1c/d8c/d106/d125 0 2024-09-06T14:44:37.197 INFO:tasks.workunit.client.1.smithi165.stdout:4/878: chown d5/cd 908 1 2024-09-06T14:44:37.198 INFO:tasks.workunit.client.0.smithi052.stdout:3/271: getdents d0 0 2024-09-06T14:44:37.199 INFO:tasks.workunit.client.0.smithi052.stdout:3/272: dread - d0/d11/d15/f43 zero size 2024-09-06T14:44:37.201 INFO:tasks.workunit.client.0.smithi052.stdout:1/257: mknod d1/db/d18/c57 0 2024-09-06T14:44:37.201 INFO:tasks.workunit.client.1.smithi165.stdout:4/879: dread d5/d1b/d61/f9d [0,4194304] 0 2024-09-06T14:44:37.205 INFO:tasks.workunit.client.0.smithi052.stdout:3/273: dwrite d0/d11/d29/d35/f22 [0,4194304] 0 2024-09-06T14:44:37.208 INFO:tasks.workunit.client.0.smithi052.stdout:0/175: mkdir d0/d3d 0 2024-09-06T14:44:37.209 INFO:tasks.workunit.client.0.smithi052.stdout:0/176: fsync d0/f1c 0 2024-09-06T14:44:37.209 INFO:tasks.workunit.client.0.smithi052.stdout:3/274: dread d0/d11/d15/d1b/f27 [0,4194304] 0 2024-09-06T14:44:37.215 INFO:tasks.workunit.client.1.smithi165.stdout:8/840: link d0/d19/d36/l71 d0/d19/d36/d2d/d33/da8/l12a 0 2024-09-06T14:44:37.217 INFO:tasks.workunit.client.1.smithi165.stdout:1/783: mknod d0/d1c/dd5/cfd 0 2024-09-06T14:44:37.219 INFO:tasks.workunit.client.0.smithi052.stdout:1/258: chown d1/db/d18/l45 1720986 1 2024-09-06T14:44:37.225 INFO:tasks.workunit.client.0.smithi052.stdout:0/177: creat d0/d1a/d26/d3a/d14/f3e x:0 0 0 2024-09-06T14:44:37.227 INFO:tasks.workunit.client.0.smithi052.stdout:3/275: rename d0/d11/d15/d1b/l34 to d0/d11/d15/l4a 0 2024-09-06T14:44:37.229 INFO:tasks.workunit.client.0.smithi052.stdout:2/138: truncate f9 428110 0 2024-09-06T14:44:37.232 INFO:tasks.workunit.client.0.smithi052.stdout:1/259: creat d1/da/f58 x:0 0 0 2024-09-06T14:44:37.235 INFO:tasks.workunit.client.0.smithi052.stdout:0/178: fsync d0/fe 0 2024-09-06T14:44:37.237 INFO:tasks.workunit.client.0.smithi052.stdout:3/276: mknod d0/d11/d15/c4b 0 2024-09-06T14:44:37.237 INFO:tasks.workunit.client.0.smithi052.stdout:3/277: stat d0/c5 0 2024-09-06T14:44:37.238 INFO:tasks.workunit.client.0.smithi052.stdout:2/139: mknod da/d19/c32 0 2024-09-06T14:44:37.238 INFO:tasks.workunit.client.0.smithi052.stdout:3/278: write d0/d11/d15/d1b/f32 [781866,63123] 0 2024-09-06T14:44:37.239 INFO:tasks.workunit.client.0.smithi052.stdout:2/140: readlink da/db/l10 0 2024-09-06T14:44:37.239 INFO:tasks.workunit.client.1.smithi165.stdout:9/929: write db/de/d15/d17/dc3/f112 [234057,106789] 0 2024-09-06T14:44:37.239 INFO:tasks.workunit.client.0.smithi052.stdout:4/142: link d9/c15 d9/d10/d17/c36 0 2024-09-06T14:44:37.240 INFO:tasks.workunit.client.1.smithi165.stdout:7/695: truncate d20/d33/fd5 1603059 0 2024-09-06T14:44:37.240 INFO:tasks.workunit.client.0.smithi052.stdout:2/141: chown da/l17 3 1 2024-09-06T14:44:37.241 INFO:tasks.workunit.client.0.smithi052.stdout:3/279: fsync d0/ff 0 2024-09-06T14:44:37.241 INFO:tasks.workunit.client.0.smithi052.stdout:8/180: truncate d6/d22/d31/f34 2614452 0 2024-09-06T14:44:37.242 INFO:tasks.workunit.client.0.smithi052.stdout:1/260: mknod d1/da/d3e/c59 0 2024-09-06T14:44:37.242 INFO:tasks.workunit.client.1.smithi165.stdout:9/930: stat db/de/d15/d7f/d9b/d11d/f125 0 2024-09-06T14:44:37.242 INFO:tasks.workunit.client.0.smithi052.stdout:2/142: write da/f23 [5103482,81880] 0 2024-09-06T14:44:37.244 INFO:tasks.workunit.client.1.smithi165.stdout:3/839: fsync d1/dbd/fc1 0 2024-09-06T14:44:37.244 INFO:tasks.workunit.client.1.smithi165.stdout:8/841: dwrite d0/d19/f95 [0,4194304] 0 2024-09-06T14:44:37.247 INFO:tasks.workunit.client.1.smithi165.stdout:2/779: dwrite d9/d25/d45/f89 [0,4194304] 0 2024-09-06T14:44:37.247 INFO:tasks.workunit.client.0.smithi052.stdout:2/143: dread da/f11 [0,4194304] 0 2024-09-06T14:44:37.248 INFO:tasks.workunit.client.0.smithi052.stdout:0/179: symlink d0/d1a/l3f 0 2024-09-06T14:44:37.249 INFO:tasks.workunit.client.0.smithi052.stdout:2/144: readlink da/d19/d20/l30 0 2024-09-06T14:44:37.249 INFO:tasks.workunit.client.0.smithi052.stdout:2/145: stat da/d19/f29 0 2024-09-06T14:44:37.253 INFO:tasks.workunit.client.1.smithi165.stdout:4/880: write d5/d1b/d1c/d20/d75/d83/fe5 [501062,31452] 0 2024-09-06T14:44:37.263 INFO:tasks.workunit.client.1.smithi165.stdout:7/696: dread f8 [0,4194304] 0 2024-09-06T14:44:37.264 INFO:tasks.workunit.client.0.smithi052.stdout:1/261: dread d1/f9 [0,4194304] 0 2024-09-06T14:44:37.264 INFO:tasks.workunit.client.1.smithi165.stdout:1/784: mknod d0/d2a/d18/cfe 0 2024-09-06T14:44:37.265 INFO:tasks.workunit.client.1.smithi165.stdout:0/760: dwrite d15/d19/d50/d53/d57/f78 [0,4194304] 0 2024-09-06T14:44:37.269 INFO:tasks.workunit.client.0.smithi052.stdout:1/262: dread d1/da/f49 [0,4194304] 0 2024-09-06T14:44:37.270 INFO:tasks.workunit.client.1.smithi165.stdout:8/842: mkdir d0/d19/d24/db1/d5b/d125/d12b 0 2024-09-06T14:44:37.273 INFO:tasks.workunit.client.1.smithi165.stdout:5/912: sync 2024-09-06T14:44:37.274 INFO:tasks.workunit.client.0.smithi052.stdout:0/180: creat d0/d1a/f40 x:0 0 0 2024-09-06T14:44:37.277 INFO:tasks.workunit.client.0.smithi052.stdout:2/146: creat da/db/d18/f33 x:0 0 0 2024-09-06T14:44:37.278 INFO:tasks.workunit.client.1.smithi165.stdout:4/881: creat d5/d1b/d116/f126 x:0 0 0 2024-09-06T14:44:37.279 INFO:tasks.workunit.client.0.smithi052.stdout:8/181: mkdir d6/d22/d36/d3e/d40 0 2024-09-06T14:44:37.281 INFO:tasks.workunit.client.0.smithi052.stdout:0/181: dwrite d0/f1c [0,4194304] 0 2024-09-06T14:44:37.282 INFO:tasks.workunit.client.1.smithi165.stdout:3/840: creat d1/da/dc/d3b/d83/d86/f118 x:0 0 0 2024-09-06T14:44:37.284 INFO:tasks.workunit.client.1.smithi165.stdout:1/785: symlink d0/d45/lff 0 2024-09-06T14:44:37.284 INFO:tasks.workunit.client.1.smithi165.stdout:1/786: chown d0/d1c/d40/f7a 3539 1 2024-09-06T14:44:37.285 INFO:tasks.workunit.client.0.smithi052.stdout:0/182: readlink d0/d1a/d26/d3a/d14/d20/d22/l28 0 2024-09-06T14:44:37.286 INFO:tasks.workunit.client.1.smithi165.stdout:7/697: rmdir d20/d33/d6a 39 2024-09-06T14:44:37.286 INFO:tasks.workunit.client.0.smithi052.stdout:0/183: readlink d0/d1a/d26/d3a/d14/d20/d22/l28 0 2024-09-06T14:44:37.288 INFO:tasks.workunit.client.0.smithi052.stdout:4/143: dwrite d9/d10/f22 [0,4194304] 0 2024-09-06T14:44:37.290 INFO:tasks.workunit.client.1.smithi165.stdout:0/761: unlink d15/f2f 0 2024-09-06T14:44:37.292 INFO:tasks.workunit.client.0.smithi052.stdout:1/263: unlink d1/da/d3e/l40 0 2024-09-06T14:44:37.299 INFO:tasks.workunit.client.1.smithi165.stdout:2/780: symlink d9/d23/d29/d48/l103 0 2024-09-06T14:44:37.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/182: fdatasync d6/d9/d1f/d14/f2b 0 2024-09-06T14:44:37.301 INFO:tasks.workunit.client.1.smithi165.stdout:9/931: creat db/de/d15/d17/f126 x:0 0 0 2024-09-06T14:44:37.302 INFO:tasks.workunit.client.1.smithi165.stdout:3/841: creat d1/d4a/db4/f119 x:0 0 0 2024-09-06T14:44:37.302 INFO:tasks.workunit.client.1.smithi165.stdout:9/932: read db/de/d15/d17/f29 [1878301,2068] 0 2024-09-06T14:44:37.304 INFO:tasks.workunit.client.1.smithi165.stdout:1/787: readlink d0/d1c/lc0 0 2024-09-06T14:44:37.306 INFO:tasks.workunit.client.0.smithi052.stdout:0/184: read d0/f1d [1890312,123739] 0 2024-09-06T14:44:37.306 INFO:tasks.workunit.client.0.smithi052.stdout:2/147: dread da/f1d [0,4194304] 0 2024-09-06T14:44:37.307 INFO:tasks.workunit.client.0.smithi052.stdout:0/185: read - d0/d1a/f40 zero size 2024-09-06T14:44:37.307 INFO:tasks.workunit.client.1.smithi165.stdout:7/698: rename d20/d33/d53/d66/cb5 to d20/d4d/d54/cda 0 2024-09-06T14:44:37.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/144: rename d9/d10/d17/f20 to d9/d2d/d33/f37 0 2024-09-06T14:44:37.310 INFO:tasks.workunit.client.0.smithi052.stdout:0/186: dread d0/f1d [0,4194304] 0 2024-09-06T14:44:37.311 INFO:tasks.workunit.client.0.smithi052.stdout:0/187: stat d0/d1a/d26/d3a/d14/d20/d22 0 2024-09-06T14:44:37.311 INFO:tasks.workunit.client.1.smithi165.stdout:0/762: symlink d15/d19/d50/d53/d7c/d9a/lfa 0 2024-09-06T14:44:37.314 INFO:tasks.workunit.client.0.smithi052.stdout:1/264: unlink d1/da/f58 0 2024-09-06T14:44:37.317 INFO:tasks.workunit.client.0.smithi052.stdout:4/145: dwrite d9/d10/f12 [0,4194304] 0 2024-09-06T14:44:37.317 INFO:tasks.workunit.client.1.smithi165.stdout:0/763: dwrite d15/fd2 [0,4194304] 0 2024-09-06T14:44:37.321 INFO:tasks.workunit.client.0.smithi052.stdout:3/280: getdents d0/d11/d15 0 2024-09-06T14:44:37.326 INFO:tasks.workunit.client.1.smithi165.stdout:8/843: write d0/d14/d3e/fad [973519,76503] 0 2024-09-06T14:44:37.329 INFO:tasks.workunit.client.0.smithi052.stdout:2/148: mkdir da/d2d/d34 0 2024-09-06T14:44:37.330 INFO:tasks.workunit.client.0.smithi052.stdout:3/281: dwrite d0/d11/f40 [0,4194304] 0 2024-09-06T14:44:37.332 INFO:tasks.workunit.client.1.smithi165.stdout:5/913: dwrite d6/d1c/d28/d2d/d3c/d44/f7f [0,4194304] 0 2024-09-06T14:44:37.333 INFO:tasks.workunit.client.1.smithi165.stdout:7/699: mknod d20/d65/d82/cdb 0 2024-09-06T14:44:37.335 INFO:tasks.workunit.client.0.smithi052.stdout:0/188: mkdir d0/d1a/d26/d3a/d14/d20/d22/d41 0 2024-09-06T14:44:37.338 INFO:tasks.workunit.client.0.smithi052.stdout:1/265: rmdir d1/da/d14 39 2024-09-06T14:44:37.338 INFO:tasks.workunit.client.1.smithi165.stdout:2/781: unlink d9/d25/d46/d7e/d90/lca 0 2024-09-06T14:44:37.338 INFO:tasks.workunit.client.1.smithi165.stdout:6/866: sync 2024-09-06T14:44:37.339 INFO:tasks.workunit.client.0.smithi052.stdout:1/266: read d1/f9 [549929,29009] 0 2024-09-06T14:44:37.340 INFO:tasks.workunit.client.0.smithi052.stdout:1/267: chown d1/da/l2d 15664 1 2024-09-06T14:44:37.340 INFO:tasks.workunit.client.1.smithi165.stdout:6/867: write d29/d39/d5b/fe8 [553861,33954] 0 2024-09-06T14:44:37.341 INFO:tasks.workunit.client.1.smithi165.stdout:2/782: write d9/d23/d52/daa/fc6 [486030,121553] 0 2024-09-06T14:44:37.348 INFO:tasks.workunit.client.0.smithi052.stdout:3/282: fsync d0/d11/d12/d17/f48 0 2024-09-06T14:44:37.349 INFO:tasks.workunit.client.0.smithi052.stdout:3/283: chown d0/d11/d15 936335 1 2024-09-06T14:44:37.350 INFO:tasks.workunit.client.0.smithi052.stdout:2/149: rename da/d2d/l2e to da/l35 0 2024-09-06T14:44:37.351 INFO:tasks.workunit.client.1.smithi165.stdout:7/700: chown d20/d65/d82/lae 12405676 1 2024-09-06T14:44:37.355 INFO:tasks.workunit.client.1.smithi165.stdout:5/914: rename d6/d98/f113 to d6/d1c/d28/d4b/da7/dab/f14b 0 2024-09-06T14:44:37.356 INFO:tasks.workunit.client.1.smithi165.stdout:1/788: dwrite d0/d2a/d18/d24/d4b/d93/dbd/dd1/ff0 [0,4194304] 0 2024-09-06T14:44:37.356 INFO:tasks.workunit.client.0.smithi052.stdout:2/150: dwrite da/f1b [4194304,4194304] 0 2024-09-06T14:44:37.357 INFO:tasks.workunit.client.1.smithi165.stdout:9/933: creat db/de/d16/f127 x:0 0 0 2024-09-06T14:44:37.358 INFO:tasks.workunit.client.0.smithi052.stdout:1/268: write d1/da/d14/f1f [382805,15277] 0 2024-09-06T14:44:37.358 INFO:tasks.workunit.client.0.smithi052.stdout:2/151: dread da/d19/f29 [0,4194304] 0 2024-09-06T14:44:37.359 INFO:tasks.workunit.client.0.smithi052.stdout:1/269: readlink d1/db/l26 0 2024-09-06T14:44:37.360 INFO:tasks.workunit.client.1.smithi165.stdout:6/868: mkdir d29/d39/d5b/d62/d67/d113 0 2024-09-06T14:44:37.360 INFO:tasks.workunit.client.0.smithi052.stdout:1/270: dread - d1/da/d14/f28 zero size 2024-09-06T14:44:37.362 INFO:tasks.workunit.client.0.smithi052.stdout:1/271: stat d1/da/l2d 0 2024-09-06T14:44:37.362 INFO:tasks.workunit.client.0.smithi052.stdout:2/152: write da/db/d18/f33 [426990,6194] 0 2024-09-06T14:44:37.362 INFO:tasks.workunit.client.1.smithi165.stdout:3/842: link d1/da/l10c d1/d4a/dc7/l11a 0 2024-09-06T14:44:37.364 INFO:tasks.workunit.client.1.smithi165.stdout:4/882: sync 2024-09-06T14:44:37.366 INFO:tasks.workunit.client.1.smithi165.stdout:3/843: chown d1/da/dd/d4b/d112/d107 893 1 2024-09-06T14:44:37.366 INFO:tasks.workunit.client.1.smithi165.stdout:2/783: creat d9/d25/d45/d75/d67/d76/f104 x:0 0 0 2024-09-06T14:44:37.367 INFO:tasks.workunit.client.1.smithi165.stdout:0/764: dwrite d15/fbe [4194304,4194304] 0 2024-09-06T14:44:37.367 INFO:tasks.workunit.client.0.smithi052.stdout:4/146: creat d9/f38 x:0 0 0 2024-09-06T14:44:37.368 INFO:tasks.workunit.client.1.smithi165.stdout:2/784: read - d9/d3b/fbd zero size 2024-09-06T14:44:37.368 INFO:tasks.workunit.client.1.smithi165.stdout:3/844: write d1/da/dc/d3b/fdd [976876,83710] 0 2024-09-06T14:44:37.371 INFO:tasks.workunit.client.0.smithi052.stdout:0/189: write d0/fe [1097384,2421] 0 2024-09-06T14:44:37.371 INFO:tasks.workunit.client.1.smithi165.stdout:0/765: fdatasync d15/d19/d50/d53/dbf/fe7 0 2024-09-06T14:44:37.372 INFO:tasks.workunit.client.0.smithi052.stdout:3/284: mkdir d0/d11/d12/d4c 0 2024-09-06T14:44:37.373 INFO:tasks.workunit.client.1.smithi165.stdout:2/785: dread - d9/d25/d45/d75/fb3 zero size 2024-09-06T14:44:37.374 INFO:tasks.workunit.client.0.smithi052.stdout:2/153: readlink da/db/lf 0 2024-09-06T14:44:37.394 INFO:tasks.workunit.client.1.smithi165.stdout:8/844: creat d0/d19/d24/db1/d11a/f12c x:0 0 0 2024-09-06T14:44:37.400 INFO:tasks.workunit.client.1.smithi165.stdout:3/845: write d1/d4a/f55 [1672524,11434] 0 2024-09-06T14:44:37.401 INFO:tasks.workunit.client.1.smithi165.stdout:0/766: creat d15/d19/d50/d53/d7c/dbb/ffb x:0 0 0 2024-09-06T14:44:37.403 INFO:tasks.workunit.client.1.smithi165.stdout:0/767: read d15/d19/d50/d53/d8d/fda [3737134,88298] 0 2024-09-06T14:44:37.404 INFO:tasks.workunit.client.1.smithi165.stdout:0/768: chown d15/f1f 1305833 1 2024-09-06T14:44:37.404 INFO:tasks.workunit.client.1.smithi165.stdout:8/845: mknod d0/d34/d6b/d94/d70/db8/c12d 0 2024-09-06T14:44:37.406 INFO:tasks.workunit.client.1.smithi165.stdout:5/915: rename d6/d1c/d28/d4b/l7a to d6/d1c/d28/d4b/da7/dab/l14c 0 2024-09-06T14:44:37.406 INFO:tasks.workunit.client.1.smithi165.stdout:5/916: write d6/f16 [3457267,116877] 0 2024-09-06T14:44:37.417 INFO:tasks.workunit.client.1.smithi165.stdout:5/917: unlink d6/d1c/d28/d4b/d55/d8a/fe4 0 2024-09-06T14:44:37.418 INFO:tasks.workunit.client.1.smithi165.stdout:1/789: link d0/d2a/d18/d24/d4b/d93/d2b/d3e/f7b d0/d2a/d18/d24/d4b/d93/dbd/f100 0 2024-09-06T14:44:37.419 INFO:tasks.workunit.client.1.smithi165.stdout:3/846: symlink d1/d19/d92/de0/l11b 0 2024-09-06T14:44:37.419 INFO:tasks.workunit.client.1.smithi165.stdout:3/847: dread - d1/da/dd/fa0 zero size 2024-09-06T14:44:37.420 INFO:tasks.workunit.client.1.smithi165.stdout:3/848: readlink d1/d41/da1/lb0 0 2024-09-06T14:44:37.420 INFO:tasks.workunit.client.1.smithi165.stdout:2/786: link d9/d25/d45/d75/d67/d76/f47 d9/d25/d45/d75/d34/f105 0 2024-09-06T14:44:37.421 INFO:tasks.workunit.client.1.smithi165.stdout:7/701: link d20/d65/d82/d97/ld9 d20/d33/ldc 0 2024-09-06T14:44:37.422 INFO:tasks.workunit.client.1.smithi165.stdout:0/769: mknod d15/d19/d50/d53/d7c/cfc 0 2024-09-06T14:44:37.423 INFO:tasks.workunit.client.0.smithi052.stdout:0/190: dread - d0/d1a/d26/d3a/f36 zero size 2024-09-06T14:44:37.423 INFO:tasks.workunit.client.0.smithi052.stdout:8/183: dwrite d6/d16/f1e [4194304,4194304] 0 2024-09-06T14:44:37.424 INFO:tasks.workunit.client.1.smithi165.stdout:5/918: fsync d6/d1c/f8f 0 2024-09-06T14:44:37.425 INFO:tasks.workunit.client.0.smithi052.stdout:4/147: dwrite f2 [4194304,4194304] 0 2024-09-06T14:44:37.428 INFO:tasks.workunit.client.1.smithi165.stdout:1/790: fdatasync d0/d2a/d18/d24/d4b/d5f/d7c/f92 0 2024-09-06T14:44:37.429 INFO:tasks.workunit.client.0.smithi052.stdout:2/154: mknod da/d2d/c36 0 2024-09-06T14:44:37.432 INFO:tasks.workunit.client.1.smithi165.stdout:5/919: dwrite d6/d1c/d28/d2d/d3c/fa8 [0,4194304] 0 2024-09-06T14:44:37.435 INFO:tasks.workunit.client.0.smithi052.stdout:1/272: getdents d1/da/d14/d2e 0 2024-09-06T14:44:37.440 INFO:tasks.workunit.client.1.smithi165.stdout:7/702: rename d20/d3b/d69/da3 to d20/d4d/ddd 0 2024-09-06T14:44:37.443 INFO:tasks.workunit.client.0.smithi052.stdout:1/273: dwrite d1/db/de/f24 [0,4194304] 0 2024-09-06T14:44:37.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/285: rename d0/d11/d12/l44 to d0/d11/d12/d17/l4d 0 2024-09-06T14:44:37.447 INFO:tasks.workunit.client.1.smithi165.stdout:0/770: stat d15/d19/d28/d51/la8 0 2024-09-06T14:44:37.449 INFO:tasks.workunit.client.0.smithi052.stdout:8/184: mkdir d6/d9/df/d41 0 2024-09-06T14:44:37.450 INFO:tasks.workunit.client.0.smithi052.stdout:8/185: stat d6/d22/d36/d3e/d40 0 2024-09-06T14:44:37.454 INFO:tasks.workunit.client.0.smithi052.stdout:4/148: mkdir d9/d10/d17/d39 0 2024-09-06T14:44:37.455 INFO:tasks.workunit.client.0.smithi052.stdout:4/149: readlink d9/d10/d17/l26 0 2024-09-06T14:44:37.457 INFO:tasks.workunit.client.1.smithi165.stdout:1/791: creat d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98/f101 x:0 0 0 2024-09-06T14:44:37.459 INFO:tasks.workunit.client.0.smithi052.stdout:2/155: dread da/f11 [0,4194304] 0 2024-09-06T14:44:37.460 INFO:tasks.workunit.client.1.smithi165.stdout:5/920: creat d6/d1c/d28/d4b/f14d x:0 0 0 2024-09-06T14:44:37.461 INFO:tasks.workunit.client.1.smithi165.stdout:5/921: write d6/f24 [2221696,80997] 0 2024-09-06T14:44:37.461 INFO:tasks.workunit.client.0.smithi052.stdout:1/274: creat d1/da/d3e/f5a x:0 0 0 2024-09-06T14:44:37.462 INFO:tasks.workunit.client.1.smithi165.stdout:5/922: chown d6/d1c/d28/d2d/d61/dde 9845361 1 2024-09-06T14:44:37.462 INFO:tasks.workunit.client.1.smithi165.stdout:2/787: symlink d9/d25/d46/l106 0 2024-09-06T14:44:37.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.467+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7420109bb0 con 0x7f74000729a0 2024-09-06T14:44:37.465 INFO:tasks.workunit.client.0.smithi052.stdout:1/275: dread d1/f1d [0,4194304] 0 2024-09-06T14:44:37.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.468+0000 7f742492c640 1 -- 172.21.15.52:0/964964103 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f7420109bb0 con 0x7f74000729a0 2024-09-06T14:44:37.467 INFO:tasks.workunit.client.1.smithi165.stdout:0/771: read d15/d19/d50/d53/d8d/fda [3440241,64675] 0 2024-09-06T14:44:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.470+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f74000729a0 msgr2=0x7f7400074e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.470+0000 7f742592e640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f74000729a0 0x7f7400074e60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7410000c00 tx=0x7f74100058d0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.470+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100b40 msgr2=0x7f7420199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.470+0000 7f742592e640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100b40 0x7f7420199bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f740800e970 tx=0x7f740800ee30 comp rx=0 tx=0).stop 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.470+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 shutdown_connections 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.470+0000 7f742592e640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f74000729a0 0x7f7400074e60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.470+0000 7f742592e640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7420100b40 0x7f7420199bf0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.471+0000 7f742592e640 1 --2- 172.21.15.52:0/964964103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7420100200 0x7f74201996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.471+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 >> 172.21.15.52:0/964964103 conn(0x7f74200fc030 msgr2=0x7f74200fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.471+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 shutdown_connections 2024-09-06T14:44:37.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.471+0000 7f742592e640 1 -- 172.21.15.52:0/964964103 wait complete. 2024-09-06T14:44:37.469 INFO:tasks.workunit.client.1.smithi165.stdout:1/792: fsync d0/d1c/d1d/d22/f4c 0 2024-09-06T14:44:37.472 INFO:tasks.workunit.client.1.smithi165.stdout:5/923: creat d6/d1c/d28/d4b/d55/f14e x:0 0 0 2024-09-06T14:44:37.473 INFO:tasks.workunit.client.1.smithi165.stdout:2/788: mknod d9/d88/db8/c107 0 2024-09-06T14:44:37.474 INFO:tasks.workunit.client.1.smithi165.stdout:9/934: write db/de/d15/fbe [689065,101663] 0 2024-09-06T14:44:37.478 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:44:37.478 INFO:tasks.workunit.client.0.smithi052.stdout:2/156: creat da/d19/d20/d2a/d31/f37 x:0 0 0 2024-09-06T14:44:37.479 INFO:tasks.workunit.client.1.smithi165.stdout:9/935: dread db/de/d15/d17/d18/d7d/d61/f11e [0,4194304] 0 2024-09-06T14:44:37.481 INFO:tasks.workunit.client.1.smithi165.stdout:9/936: chown db/de/d15/d7f/d9b/f3c 130797 1 2024-09-06T14:44:37.481 INFO:tasks.workunit.client.1.smithi165.stdout:6/869: truncate d29/f35 7781513 0 2024-09-06T14:44:37.482 INFO:tasks.workunit.client.1.smithi165.stdout:4/883: truncate d5/d1b/d1c/d41/fb4 389661 0 2024-09-06T14:44:37.483 INFO:tasks.workunit.client.0.smithi052.stdout:8/186: link d6/d9/d1f/d14/c15 d6/d9/df/d41/c42 0 2024-09-06T14:44:37.484 INFO:tasks.workunit.client.1.smithi165.stdout:5/924: dread d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/f138 [0,4194304] 0 2024-09-06T14:44:37.484 INFO:tasks.workunit.client.0.smithi052.stdout:8/187: write d6/d22/f3a [651049,21108] 0 2024-09-06T14:44:37.485 INFO:tasks.workunit.client.0.smithi052.stdout:8/188: chown d6/d9/le 1442272773 1 2024-09-06T14:44:37.487 INFO:tasks.workunit.client.0.smithi052.stdout:1/276: creat d1/db/d50/f5b x:0 0 0 2024-09-06T14:44:37.488 INFO:tasks.workunit.client.0.smithi052.stdout:0/191: getdents d0/d1a/d26/d3a/d14/d2d 0 2024-09-06T14:44:37.491 INFO:tasks.workunit.client.1.smithi165.stdout:3/849: rename d1/d19/d4d/f87 to d1/dbd/f11c 0 2024-09-06T14:44:37.491 INFO:tasks.workunit.client.1.smithi165.stdout:8/846: dwrite d0/d19/d36/d2d/f72 [0,4194304] 0 2024-09-06T14:44:37.492 INFO:tasks.workunit.client.0.smithi052.stdout:2/157: creat da/db/d18/f38 x:0 0 0 2024-09-06T14:44:37.493 INFO:tasks.workunit.client.1.smithi165.stdout:7/703: creat d20/d3b/d69/d88/fde x:0 0 0 2024-09-06T14:44:37.498 INFO:tasks.workunit.client.1.smithi165.stdout:0/772: mkdir d15/d19/d66/df8/dfd 0 2024-09-06T14:44:37.499 INFO:tasks.workunit.client.0.smithi052.stdout:2/158: rmdir da/d19/d20 39 2024-09-06T14:44:37.501 INFO:tasks.workunit.client.1.smithi165.stdout:9/937: creat db/de/d15/d7f/dbc/ddf/f128 x:0 0 0 2024-09-06T14:44:37.502 INFO:tasks.workunit.client.0.smithi052.stdout:8/189: unlink d6/d16/c28 0 2024-09-06T14:44:37.504 INFO:tasks.workunit.client.0.smithi052.stdout:8/190: dread d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:37.505 INFO:tasks.workunit.client.0.smithi052.stdout:0/192: mkdir d0/d18/d42 0 2024-09-06T14:44:37.506 INFO:tasks.workunit.client.1.smithi165.stdout:8/847: dread d0/f16 [0,4194304] 0 2024-09-06T14:44:37.506 INFO:tasks.workunit.client.1.smithi165.stdout:8/848: write d0/d19/f95 [4149105,43079] 0 2024-09-06T14:44:37.509 INFO:tasks.workunit.client.0.smithi052.stdout:8/191: dread d6/d9/df/d1b/f37 [0,4194304] 0 2024-09-06T14:44:37.512 INFO:tasks.workunit.client.1.smithi165.stdout:2/789: mknod d9/d23/c108 0 2024-09-06T14:44:37.514 INFO:tasks.workunit.client.0.smithi052.stdout:2/159: dwrite da/db/f12 [4194304,4194304] 0 2024-09-06T14:44:37.515 INFO:tasks.workunit.client.0.smithi052.stdout:9/78: sync 2024-09-06T14:44:37.515 INFO:tasks.workunit.client.0.smithi052.stdout:9/79: stat d1/f8 0 2024-09-06T14:44:37.517 INFO:tasks.workunit.client.0.smithi052.stdout:9/80: write d1/f8 [660392,85007] 0 2024-09-06T14:44:37.518 INFO:tasks.workunit.client.1.smithi165.stdout:6/870: rename d29/d39/c77 to d29/d6a/d71/c114 0 2024-09-06T14:44:37.522 INFO:tasks.workunit.client.0.smithi052.stdout:8/192: mknod d6/d9/d21/c43 0 2024-09-06T14:44:37.523 INFO:tasks.workunit.client.1.smithi165.stdout:3/850: stat d1/da/dc/d3b/d71/ca9 0 2024-09-06T14:44:37.524 INFO:tasks.workunit.client.0.smithi052.stdout:3/286: truncate d0/d11/d29/d35/f22 430707 0 2024-09-06T14:44:37.525 INFO:tasks.workunit.client.0.smithi052.stdout:3/287: write d0/d11/d29/f37 [3234022,89497] 0 2024-09-06T14:44:37.527 INFO:tasks.workunit.client.0.smithi052.stdout:3/288: chown d0/d11/d29/d35/d46/c49 456 1 2024-09-06T14:44:37.528 INFO:tasks.workunit.client.0.smithi052.stdout:3/289: chown d0/d11/f40 887137 1 2024-09-06T14:44:37.532 INFO:tasks.workunit.client.1.smithi165.stdout:7/704: creat d20/d65/d82/d97/fdf x:0 0 0 2024-09-06T14:44:37.540 INFO:tasks.workunit.client.0.smithi052.stdout:0/193: rename d0/d1a/d26/d3a/d14/d2d/ca to d0/d1a/d26/d3a/d14/d20/d22/d41/c43 0 2024-09-06T14:44:37.540 INFO:tasks.workunit.client.0.smithi052.stdout:0/194: read d0/f1d [3885200,113025] 0 2024-09-06T14:44:37.541 INFO:tasks.workunit.client.1.smithi165.stdout:9/938: creat db/de/d15/d17/d18/d7d/d61/f129 x:0 0 0 2024-09-06T14:44:37.541 INFO:tasks.workunit.client.0.smithi052.stdout:0/195: dread - d0/d1a/d26/d3a/f36 zero size 2024-09-06T14:44:37.547 INFO:tasks.workunit.client.1.smithi165.stdout:8/849: mknod d0/d19/d24/d26/c12e 0 2024-09-06T14:44:37.548 INFO:tasks.workunit.client.1.smithi165.stdout:8/850: chown d0/d5e/d65/fd7 74 1 2024-09-06T14:44:37.549 INFO:tasks.workunit.client.1.smithi165.stdout:8/851: dread - d0/d19/d36/d28/f90 zero size 2024-09-06T14:44:37.549 INFO:tasks.workunit.client.0.smithi052.stdout:2/160: symlink da/d2d/d34/l39 0 2024-09-06T14:44:37.549 INFO:tasks.workunit.client.0.smithi052.stdout:2/161: fsync da/f1b 0 2024-09-06T14:44:37.552 INFO:tasks.workunit.client.0.smithi052.stdout:9/81: mknod d1/d4/c1c 0 2024-09-06T14:44:37.553 INFO:tasks.workunit.client.1.smithi165.stdout:6/871: creat d29/d6a/d83/d89/ddb/f115 x:0 0 0 2024-09-06T14:44:37.556 INFO:tasks.workunit.client.1.smithi165.stdout:4/884: dwrite d5/d1b/d1c/f39 [0,4194304] 0 2024-09-06T14:44:37.560 INFO:tasks.workunit.client.1.smithi165.stdout:4/885: chown d5/d1b/d1c/f1d 1 1 2024-09-06T14:44:37.563 INFO:tasks.workunit.client.1.smithi165.stdout:2/790: dwrite d9/d23/d29/d48/fc3 [0,4194304] 0 2024-09-06T14:44:37.564 INFO:tasks.workunit.client.1.smithi165.stdout:5/925: sync 2024-09-06T14:44:37.567 INFO:tasks.workunit.client.1.smithi165.stdout:0/773: creat d15/d19/d66/df8/dfd/ffe x:0 0 0 2024-09-06T14:44:37.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/82: rename d1/d4/c15 to d1/d4/df/c1d 0 2024-09-06T14:44:37.568 INFO:tasks.workunit.client.1.smithi165.stdout:6/872: dwrite d29/d39/d5b/d68/f91 [0,4194304] 0 2024-09-06T14:44:37.573 INFO:tasks.workunit.client.1.smithi165.stdout:1/793: getdents d0/d1c/d1d/d57 0 2024-09-06T14:44:37.574 INFO:tasks.workunit.client.0.smithi052.stdout:8/193: link d6/c26 d6/d22/d36/c44 0 2024-09-06T14:44:37.577 INFO:tasks.workunit.client.0.smithi052.stdout:8/194: dread d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:37.579 INFO:tasks.workunit.client.1.smithi165.stdout:1/794: dwrite d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98/f101 [0,4194304] 0 2024-09-06T14:44:37.581 INFO:tasks.workunit.client.1.smithi165.stdout:6/873: dread d29/d39/d5b/f92 [0,4194304] 0 2024-09-06T14:44:37.581 INFO:tasks.workunit.client.1.smithi165.stdout:1/795: fdatasync d0/d2a/d18/d24/d4b/d5f/f63 0 2024-09-06T14:44:37.582 INFO:tasks.workunit.client.0.smithi052.stdout:9/83: symlink d1/d4/df/l1e 0 2024-09-06T14:44:37.588 INFO:tasks.workunit.client.1.smithi165.stdout:3/851: creat d1/da/dc/d3b/d71/d109/f11d x:0 0 0 2024-09-06T14:44:37.590 INFO:tasks.workunit.client.0.smithi052.stdout:9/84: dwrite d1/d4/f9 [4194304,4194304] 0 2024-09-06T14:44:37.591 INFO:tasks.workunit.client.0.smithi052.stdout:9/85: read d1/f8 [547569,62047] 0 2024-09-06T14:44:37.593 INFO:tasks.workunit.client.0.smithi052.stdout:8/195: truncate d6/d9/df/d1b/f37 859132 0 2024-09-06T14:44:37.593 INFO:tasks.workunit.client.0.smithi052.stdout:9/86: dread - d1/d4/d6/f16 zero size 2024-09-06T14:44:37.594 INFO:tasks.workunit.client.0.smithi052.stdout:8/196: read - d6/d9/d21/f3f zero size 2024-09-06T14:44:37.596 INFO:tasks.workunit.client.1.smithi165.stdout:5/926: mkdir d6/d98/d14f 0 2024-09-06T14:44:37.596 INFO:tasks.workunit.client.1.smithi165.stdout:6/874: dread d29/d39/d5b/f78 [0,4194304] 0 2024-09-06T14:44:37.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 -- 172.21.15.52:0/4112761268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c100880 msgr2=0x7fce9c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 --2- 172.21.15.52:0/4112761268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c100880 0x7fce9c100c80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009880 tx=0x7fce8c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 -- 172.21.15.52:0/4112761268 shutdown_connections 2024-09-06T14:44:37.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 --2- 172.21.15.52:0/4112761268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c101a80 0x7fce9c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 --2- 172.21.15.52:0/4112761268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c100880 0x7fce9c100c80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 -- 172.21.15.52:0/4112761268 >> 172.21.15.52:0/4112761268 conn(0x7fce9c0fc030 msgr2=0x7fce9c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 -- 172.21.15.52:0/4112761268 shutdown_connections 2024-09-06T14:44:37.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 -- 172.21.15.52:0/4112761268 wait complete. 2024-09-06T14:44:37.599 INFO:tasks.workunit.client.1.smithi165.stdout:4/886: rename d5/d1b/d61/d77/dbd/c10a to d5/d1b/d1c/d20/d75/d83/dae/c127 0 2024-09-06T14:44:37.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.601+0000 7fcea1baf640 1 Processor -- start 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fcea1baf640 1 -- start start 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fcea1baf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c100880 0x7fce9c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fcea1baf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c101a80 0x7fce9c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fcea1baf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c10a820 con 0x7fce9c101a80 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fcea1baf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c10a6a0 con 0x7fce9c100880 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fce9affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c101a80 0x7fce9c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fce9affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c101a80 0x7fce9c197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41136/0 (socket says 172.21.15.52:41136) 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.602+0000 7fce9affd640 1 -- 172.21.15.52:0/1565850899 learned_addr learned my addr 172.21.15.52:0/1565850899 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.603+0000 7fce9b7fe640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c100880 0x7fce9c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:37.602 INFO:tasks.workunit.client.0.smithi052.stdout:0/196: getdents d0 0 2024-09-06T14:44:37.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.603+0000 7fce9affd640 1 -- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c100880 msgr2=0x7fce9c197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.603+0000 7fce9affd640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c100880 0x7fce9c197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.603+0000 7fce9affd640 1 -- 172.21.15.52:0/1565850899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c1982c0 con 0x7fce9c101a80 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.603+0000 7fce9affd640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c101a80 0x7fce9c197c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fce9000b420 tx=0x7fce9000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.604+0000 7fce98ff9640 1 -- 172.21.15.52:0/1565850899 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce90011630 con 0x7fce9c101a80 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.604+0000 7fce98ff9640 1 -- 172.21.15.52:0/1565850899 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce90016070 con 0x7fce9c101a80 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.604+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c19cd00 con 0x7fce9c101a80 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.604+0000 7fce98ff9640 1 -- 172.21.15.52:0/1565850899 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce90010d40 con 0x7fce9c101a80 2024-09-06T14:44:37.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.605+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c19d2b0 con 0x7fce9c101a80 2024-09-06T14:44:37.604 INFO:tasks.workunit.client.1.smithi165.stdout:0/774: mkdir d15/d19/d50/d53/d8d/dff 0 2024-09-06T14:44:37.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.606+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c100c80 con 0x7fce9c101a80 2024-09-06T14:44:37.604 INFO:tasks.workunit.client.0.smithi052.stdout:2/162: rename da/d19/d20/d2a to da/d19/d3a 0 2024-09-06T14:44:37.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.607+0000 7fce98ff9640 1 -- 172.21.15.52:0/1565850899 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7fce900117d0 con 0x7fce9c101a80 2024-09-06T14:44:37.605 INFO:tasks.workunit.client.0.smithi052.stdout:2/163: write f1 [5606353,106204] 0 2024-09-06T14:44:37.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.608+0000 7fce98ff9640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fce84072950 0x7fce84074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:37.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.608+0000 7fce98ff9640 1 -- 172.21.15.52:0/1565850899 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fce90092e10 con 0x7fce9c101a80 2024-09-06T14:44:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.608+0000 7fce9b7fe640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fce84072950 0x7fce84074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:37.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.609+0000 7fce9b7fe640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fce84072950 0x7fce84074e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c00 tx=0x7fce8c004120 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:37.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.614+0000 7fce98ff9640 1 -- 172.21.15.52:0/1565850899 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fce90020020 con 0x7fce9c101a80 2024-09-06T14:44:37.612 INFO:tasks.workunit.client.1.smithi165.stdout:8/852: creat d0/d34/d6b/d94/d70/db8/d11c/f12f x:0 0 0 2024-09-06T14:44:37.612 INFO:tasks.workunit.client.0.smithi052.stdout:9/87: mknod d1/d4/d6/dc/d10/d18/c1f 0 2024-09-06T14:44:37.613 INFO:tasks.workunit.client.1.smithi165.stdout:8/853: fdatasync d0/d19/d36/d28/de0/f122 0 2024-09-06T14:44:37.615 INFO:tasks.workunit.client.0.smithi052.stdout:2/164: rename da/l17 to da/d19/d20/l3b 0 2024-09-06T14:44:37.616 INFO:tasks.workunit.client.1.smithi165.stdout:7/705: dwrite d20/d33/d53/f67 [4194304,4194304] 0 2024-09-06T14:44:37.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/165: dread da/f2f [0,4194304] 0 2024-09-06T14:44:37.619 INFO:tasks.workunit.client.1.smithi165.stdout:1/796: truncate d0/d2a/d18/d24/d4b/d93/f3a 1621096 0 2024-09-06T14:44:37.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/166: chown da/f11 12 1 2024-09-06T14:44:37.621 INFO:tasks.workunit.client.1.smithi165.stdout:8/854: dwrite d0/d19/d36/d2d/d33/d84/f120 [0,4194304] 0 2024-09-06T14:44:37.622 INFO:tasks.workunit.client.1.smithi165.stdout:1/797: write d0/d2a/d18/d24/d4b/d5f/f60 [668365,128726] 0 2024-09-06T14:44:37.623 INFO:tasks.workunit.client.1.smithi165.stdout:8/855: write d0/d14/f11d [877301,39853] 0 2024-09-06T14:44:37.624 INFO:tasks.workunit.client.0.smithi052.stdout:2/167: dread da/db/d18/f33 [0,4194304] 0 2024-09-06T14:44:37.629 INFO:tasks.workunit.client.1.smithi165.stdout:4/887: mknod d5/d1b/d1c/c128 0 2024-09-06T14:44:37.629 INFO:tasks.workunit.client.0.smithi052.stdout:0/197: getdents d0/d1a/d26/d3a/d14/d20/d22/d41 0 2024-09-06T14:44:37.631 INFO:tasks.workunit.client.1.smithi165.stdout:2/791: dwrite d9/d25/f33 [4194304,4194304] 0 2024-09-06T14:44:37.632 INFO:tasks.workunit.client.1.smithi165.stdout:0/775: write d15/d19/d28/d4f/da7/fe1 [567859,78767] 0 2024-09-06T14:44:37.633 INFO:tasks.workunit.client.1.smithi165.stdout:2/792: read d9/f1a [3372958,115289] 0 2024-09-06T14:44:37.633 INFO:tasks.workunit.client.1.smithi165.stdout:9/939: creat db/de/d16/f12a x:0 0 0 2024-09-06T14:44:37.638 INFO:tasks.workunit.client.0.smithi052.stdout:0/198: mknod d0/d1a/d26/c44 0 2024-09-06T14:44:37.640 INFO:tasks.workunit.client.0.smithi052.stdout:2/168: fdatasync f9 0 2024-09-06T14:44:37.641 INFO:tasks.workunit.client.1.smithi165.stdout:7/706: fdatasync d20/d3b/f72 0 2024-09-06T14:44:37.642 INFO:tasks.workunit.client.0.smithi052.stdout:0/199: symlink d0/d1a/d26/d3a/d14/d20/d22/d41/l45 0 2024-09-06T14:44:37.650 INFO:tasks.workunit.client.1.smithi165.stdout:6/875: symlink d29/d39/d5b/d62/l116 0 2024-09-06T14:44:37.651 INFO:tasks.workunit.client.0.smithi052.stdout:9/88: write d1/d4/f5 [743642,9623] 0 2024-09-06T14:44:37.652 INFO:tasks.workunit.client.1.smithi165.stdout:6/876: write d29/d32/f85 [2389499,95864] 0 2024-09-06T14:44:37.653 INFO:tasks.workunit.client.1.smithi165.stdout:1/798: mkdir d0/d2a/d23/d102 0 2024-09-06T14:44:37.654 INFO:tasks.workunit.client.0.smithi052.stdout:2/169: truncate da/f1b 1428701 0 2024-09-06T14:44:37.655 INFO:tasks.workunit.client.1.smithi165.stdout:8/856: fdatasync d0/d19/f1f 0 2024-09-06T14:44:37.657 INFO:tasks.workunit.client.1.smithi165.stdout:8/857: dread - d0/d19/d36/d2d/d33/d84/f115 zero size 2024-09-06T14:44:37.661 INFO:tasks.workunit.client.0.smithi052.stdout:9/89: dread d1/f8 [0,4194304] 0 2024-09-06T14:44:37.663 INFO:tasks.workunit.client.0.smithi052.stdout:2/170: write f9 [1352432,17782] 0 2024-09-06T14:44:37.664 INFO:tasks.workunit.client.0.smithi052.stdout:2/171: truncate da/d19/f26 532582 0 2024-09-06T14:44:37.666 INFO:tasks.workunit.client.0.smithi052.stdout:9/90: rmdir d1/d4/d6/dd 39 2024-09-06T14:44:37.667 INFO:tasks.workunit.client.0.smithi052.stdout:9/91: read d1/f8 [328949,30581] 0 2024-09-06T14:44:37.667 INFO:tasks.workunit.client.1.smithi165.stdout:3/852: truncate d1/f2 2112258 0 2024-09-06T14:44:37.668 INFO:tasks.workunit.client.1.smithi165.stdout:3/853: write d1/da/dc/d10/ff2 [108177,75550] 0 2024-09-06T14:44:37.668 INFO:tasks.workunit.client.1.smithi165.stdout:1/799: dread d0/d2a/d18/f43 [0,4194304] 0 2024-09-06T14:44:37.669 INFO:tasks.workunit.client.1.smithi165.stdout:1/800: readlink d0/d1c/d1d/lc5 0 2024-09-06T14:44:37.674 INFO:tasks.workunit.client.0.smithi052.stdout:0/200: dwrite d0/d1a/d26/f27 [0,4194304] 0 2024-09-06T14:44:37.675 INFO:tasks.workunit.client.1.smithi165.stdout:6/877: symlink d29/d39/d5b/d62/d94/df3/l117 0 2024-09-06T14:44:37.678 INFO:tasks.workunit.client.1.smithi165.stdout:9/940: write db/de/d15/d17/d18/d7d/f5f [4583182,76391] 0 2024-09-06T14:44:37.679 INFO:tasks.workunit.client.1.smithi165.stdout:8/858: write d0/d19/f1f [1590576,117821] 0 2024-09-06T14:44:37.681 INFO:tasks.workunit.client.1.smithi165.stdout:5/927: link d6/d1c/d28/d2d/d61/f79 d6/d1c/d64/f150 0 2024-09-06T14:44:37.682 INFO:tasks.workunit.client.0.smithi052.stdout:2/172: write da/d19/f29 [262775,101376] 0 2024-09-06T14:44:37.682 INFO:tasks.workunit.client.1.smithi165.stdout:5/928: dread - d6/d1c/d28/d4b/d10b/f131 zero size 2024-09-06T14:44:37.683 INFO:tasks.workunit.client.0.smithi052.stdout:2/173: write f9 [437033,58886] 0 2024-09-06T14:44:37.684 INFO:tasks.workunit.client.1.smithi165.stdout:5/929: chown d6/d1c/d28/d4b/da7/dab/fe5 2 1 2024-09-06T14:44:37.684 INFO:tasks.workunit.client.1.smithi165.stdout:5/930: fsync d6/d98/dd7/dd9/f10f 0 2024-09-06T14:44:37.685 INFO:tasks.workunit.client.0.smithi052.stdout:9/92: getdents d1/d4/d6/dc 0 2024-09-06T14:44:37.689 INFO:tasks.workunit.client.0.smithi052.stdout:2/174: creat da/db/d18/f3c x:0 0 0 2024-09-06T14:44:37.690 INFO:tasks.workunit.client.0.smithi052.stdout:2/175: fdatasync da/f1d 0 2024-09-06T14:44:37.692 INFO:tasks.workunit.client.0.smithi052.stdout:9/93: rename d1/d4/d6/cb to d1/d4/df/c20 0 2024-09-06T14:44:37.694 INFO:tasks.workunit.client.1.smithi165.stdout:4/888: truncate d5/d1b/f109 355685 0 2024-09-06T14:44:37.695 INFO:tasks.workunit.client.0.smithi052.stdout:9/94: dread d1/f8 [0,4194304] 0 2024-09-06T14:44:37.695 INFO:tasks.workunit.client.1.smithi165.stdout:7/707: creat d20/d4d/dd4/fe0 x:0 0 0 2024-09-06T14:44:37.697 INFO:tasks.workunit.client.0.smithi052.stdout:2/176: dwrite da/db/fe [0,4194304] 0 2024-09-06T14:44:37.697 INFO:tasks.workunit.client.0.smithi052.stdout:0/201: truncate d0/fe 275951 0 2024-09-06T14:44:37.698 INFO:tasks.workunit.client.0.smithi052.stdout:2/177: stat c8 0 2024-09-06T14:44:37.700 INFO:tasks.workunit.client.1.smithi165.stdout:1/801: creat d0/d2a/d18/d24/d4b/d93/dbd/f103 x:0 0 0 2024-09-06T14:44:37.701 INFO:tasks.workunit.client.0.smithi052.stdout:0/202: rmdir d0/d18 39 2024-09-06T14:44:37.703 INFO:tasks.workunit.client.1.smithi165.stdout:6/878: creat d29/d39/d86/f118 x:0 0 0 2024-09-06T14:44:37.705 INFO:tasks.workunit.client.0.smithi052.stdout:2/178: mknod da/d2d/d34/c3d 0 2024-09-06T14:44:37.707 INFO:tasks.workunit.client.0.smithi052.stdout:9/95: creat d1/d4/d6/dd/f21 x:0 0 0 2024-09-06T14:44:37.708 INFO:tasks.workunit.client.1.smithi165.stdout:9/941: symlink db/de/d15/d17/dc3/l12b 0 2024-09-06T14:44:37.712 INFO:tasks.workunit.client.0.smithi052.stdout:2/179: symlink da/db/d18/l3e 0 2024-09-06T14:44:37.718 INFO:tasks.workunit.client.1.smithi165.stdout:3/854: dwrite d1/d19/f27 [0,4194304] 0 2024-09-06T14:44:37.724 INFO:tasks.workunit.client.1.smithi165.stdout:8/859: write d0/d19/d36/d28/dda/f118 [3944973,8090] 0 2024-09-06T14:44:37.732 INFO:tasks.workunit.client.1.smithi165.stdout:5/931: dwrite d6/d1c/d28/d4b/d55/f6a [0,4194304] 0 2024-09-06T14:44:37.734 INFO:tasks.workunit.client.1.smithi165.stdout:9/942: creat db/de/d15/d17/d86/ddd/d115/f12c x:0 0 0 2024-09-06T14:44:37.735 INFO:tasks.workunit.client.0.smithi052.stdout:2/180: dread da/d19/f1c [0,4194304] 0 2024-09-06T14:44:37.735 INFO:tasks.workunit.client.0.smithi052.stdout:9/96: truncate d1/d4/f9 8150793 0 2024-09-06T14:44:37.736 INFO:tasks.workunit.client.0.smithi052.stdout:2/181: truncate da/f2f 885691 0 2024-09-06T14:44:37.737 INFO:tasks.workunit.client.0.smithi052.stdout:0/203: rmdir d0/d18/d42 0 2024-09-06T14:44:37.739 INFO:tasks.workunit.client.1.smithi165.stdout:0/776: getdents d15/d19/d28/d4f/da7 0 2024-09-06T14:44:37.740 INFO:tasks.workunit.client.1.smithi165.stdout:0/777: write d15/d19/d50/d53/d57/f7d [4915695,58792] 0 2024-09-06T14:44:37.740 INFO:tasks.workunit.client.1.smithi165.stdout:2/793: link d9/d25/d45/d75/d67/d76/l36 d9/d25/l109 0 2024-09-06T14:44:37.741 INFO:tasks.workunit.client.1.smithi165.stdout:2/794: chown d9/d25/d46/c81 612 1 2024-09-06T14:44:37.742 INFO:tasks.workunit.client.1.smithi165.stdout:0/778: truncate d15/d19/d50/d53/d7c/fdb 298139 0 2024-09-06T14:44:37.743 INFO:tasks.workunit.client.1.smithi165.stdout:2/795: write d9/d25/d45/d75/d67/d76/f3c [2704465,45874] 0 2024-09-06T14:44:37.744 INFO:tasks.workunit.client.0.smithi052.stdout:2/182: link da/db/fe da/d19/d3a/f3f 0 2024-09-06T14:44:37.745 INFO:tasks.workunit.client.0.smithi052.stdout:2/183: chown da/ld 3443 1 2024-09-06T14:44:37.746 INFO:tasks.workunit.client.1.smithi165.stdout:8/860: creat d0/d19/d24/f130 x:0 0 0 2024-09-06T14:44:37.750 INFO:tasks.workunit.client.1.smithi165.stdout:6/879: symlink d29/d39/d5b/d62/d94/db7/dfa/d111/l119 0 2024-09-06T14:44:37.751 INFO:tasks.workunit.client.0.smithi052.stdout:9/97: dread d1/d4/f9 [4194304,4194304] 0 2024-09-06T14:44:37.753 INFO:tasks.workunit.client.1.smithi165.stdout:4/889: truncate d5/d1b/d61/d77/d7c/fd2 2371769 0 2024-09-06T14:44:37.754 INFO:tasks.workunit.client.1.smithi165.stdout:5/932: rename d6/d1c/d28/d2d/d49/de9/l137 to d6/d1c/d28/d2d/d3c/d44/d90/ddf/l151 0 2024-09-06T14:44:37.757 INFO:tasks.workunit.client.0.smithi052.stdout:0/204: truncate d0/fe 257424 0 2024-09-06T14:44:37.760 INFO:tasks.workunit.client.0.smithi052.stdout:9/98: mkdir d1/d4/d6/dd/d22 0 2024-09-06T14:44:37.761 INFO:tasks.workunit.client.0.smithi052.stdout:2/184: truncate f1 3916245 0 2024-09-06T14:44:37.764 INFO:tasks.workunit.client.0.smithi052.stdout:0/205: readlink d0/d1a/d26/d3a/d14/d2d/l1b 0 2024-09-06T14:44:37.766 INFO:tasks.workunit.client.1.smithi165.stdout:2/796: mknod d9/d88/dac/d95/c10a 0 2024-09-06T14:44:37.767 INFO:tasks.workunit.client.1.smithi165.stdout:2/797: write d9/d23/d29/d48/d8c/f86 [1932029,12472] 0 2024-09-06T14:44:37.767 INFO:tasks.workunit.client.1.smithi165.stdout:7/708: mkdir d20/d3b/d69/d88/d80/d81/de1 0 2024-09-06T14:44:37.768 INFO:tasks.workunit.client.0.smithi052.stdout:9/99: dwrite d1/f17 [0,4194304] 0 2024-09-06T14:44:37.768 INFO:tasks.workunit.client.1.smithi165.stdout:2/798: write d9/d25/d45/d75/fc0 [3616085,6288] 0 2024-09-06T14:44:37.772 INFO:tasks.workunit.client.1.smithi165.stdout:1/802: creat d0/d2a/d18/d24/f104 x:0 0 0 2024-09-06T14:44:37.773 INFO:tasks.workunit.client.1.smithi165.stdout:1/803: write d0/d1c/d1d/fb2 [1130700,51697] 0 2024-09-06T14:44:37.774 INFO:tasks.workunit.client.1.smithi165.stdout:6/880: chown d29/d6a/d83/d89/ddb/le0 306647002 1 2024-09-06T14:44:37.778 INFO:tasks.workunit.client.0.smithi052.stdout:9/100: truncate d1/f8 514384 0 2024-09-06T14:44:37.783 INFO:tasks.workunit.client.1.smithi165.stdout:3/855: creat d1/da/f11e x:0 0 0 2024-09-06T14:44:37.785 INFO:tasks.workunit.client.1.smithi165.stdout:0/779: mknod d15/d19/c100 0 2024-09-06T14:44:37.786 INFO:tasks.workunit.client.0.smithi052.stdout:2/185: link da/l21 da/db/l40 0 2024-09-06T14:44:37.787 INFO:tasks.workunit.client.0.smithi052.stdout:0/206: getdents d0/d19/d29 0 2024-09-06T14:44:37.790 INFO:tasks.workunit.client.1.smithi165.stdout:1/804: mkdir d0/d2a/d18/d24/d4b/d93/dbd/d105 0 2024-09-06T14:44:37.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/207: write d0/d1a/d26/d3a/d14/d2d/f11 [4132425,54473] 0 2024-09-06T14:44:37.791 INFO:tasks.workunit.client.0.smithi052.stdout:9/101: dwrite d1/f17 [4194304,4194304] 0 2024-09-06T14:44:37.792 INFO:tasks.workunit.client.0.smithi052.stdout:0/208: read - d0/d1a/d26/d3a/f36 zero size 2024-09-06T14:44:37.793 INFO:tasks.workunit.client.1.smithi165.stdout:5/933: fsync d6/d1c/d28/d4b/d55/fca 0 2024-09-06T14:44:37.794 INFO:tasks.workunit.client.1.smithi165.stdout:5/934: dread - d6/d1c/d28/d4b/d10b/f131 zero size 2024-09-06T14:44:37.797 INFO:tasks.workunit.client.1.smithi165.stdout:3/856: stat d1/da/dd/d8c/ld7 0 2024-09-06T14:44:37.798 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:37 smithi052 ceph-mon[28627]: pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 177 MiB/s wr, 358 op/s 2024-09-06T14:44:37.798 INFO:tasks.workunit.client.0.smithi052.stdout:0/209: creat d0/d1a/d26/d3a/d14/d20/f46 x:0 0 0 2024-09-06T14:44:37.801 INFO:tasks.workunit.client.1.smithi165.stdout:0/780: unlink d15/d19/d28/d9e/da3/lad 0 2024-09-06T14:44:37.802 INFO:tasks.workunit.client.1.smithi165.stdout:4/890: dwrite d5/f86 [0,4194304] 0 2024-09-06T14:44:37.814 INFO:tasks.workunit.client.1.smithi165.stdout:1/805: truncate d0/f10 2781157 0 2024-09-06T14:44:37.817 INFO:tasks.workunit.client.1.smithi165.stdout:1/806: dread d0/d1c/d41/f8c [0,4194304] 0 2024-09-06T14:44:37.821 INFO:tasks.workunit.client.0.smithi052.stdout:9/102: creat d1/f23 x:0 0 0 2024-09-06T14:44:37.822 INFO:tasks.workunit.client.1.smithi165.stdout:6/881: write d29/d32/f50 [1973760,17509] 0 2024-09-06T14:44:37.823 INFO:tasks.workunit.client.1.smithi165.stdout:9/943: getdents db/d40 0 2024-09-06T14:44:37.826 INFO:tasks.workunit.client.0.smithi052.stdout:9/103: creat d1/d4/df/f24 x:0 0 0 2024-09-06T14:44:37.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/210: creat d0/d3d/f47 x:0 0 0 2024-09-06T14:44:37.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/211: chown d0/d1a/d26/d3a/d14/d20/c38 382777263 1 2024-09-06T14:44:37.833 INFO:tasks.workunit.client.1.smithi165.stdout:2/799: truncate d9/d25/fef 1776515 0 2024-09-06T14:44:37.836 INFO:tasks.workunit.client.1.smithi165.stdout:4/891: creat d5/d1b/d61/d77/d7c/daa/f129 x:0 0 0 2024-09-06T14:44:37.836 INFO:tasks.workunit.client.0.smithi052.stdout:9/104: fsync d1/f8 0 2024-09-06T14:44:37.839 INFO:tasks.workunit.client.0.smithi052.stdout:0/212: rename d0/d1a/d26/d3a/d14/d20/f46 to d0/d1a/d26/d3a/d14/d20/f48 0 2024-09-06T14:44:37.840 INFO:tasks.workunit.client.1.smithi165.stdout:2/800: dwrite d9/d25/d45/d75/d67/f92 [4194304,4194304] 0 2024-09-06T14:44:37.840 INFO:tasks.workunit.client.1.smithi165.stdout:1/807: chown d0/d1c/lcc 30809 1 2024-09-06T14:44:37.840 INFO:tasks.workunit.client.0.smithi052.stdout:2/186: truncate f1 3649998 0 2024-09-06T14:44:37.841 INFO:tasks.workunit.client.1.smithi165.stdout:1/808: fdatasync d0/fef 0 2024-09-06T14:44:37.841 INFO:tasks.workunit.client.1.smithi165.stdout:3/857: write d1/d4a/f7d [5239434,32654] 0 2024-09-06T14:44:37.841 INFO:tasks.workunit.client.1.smithi165.stdout:3/858: chown d1/dbd 1 1 2024-09-06T14:44:37.845 INFO:tasks.workunit.client.1.smithi165.stdout:9/944: mkdir db/de/d15/d17/d18/d59/d64/d12d 0 2024-09-06T14:44:37.848 INFO:tasks.workunit.client.1.smithi165.stdout:6/882: dwrite d29/d39/d5b/d68/db3/f107 [0,4194304] 0 2024-09-06T14:44:37.850 INFO:tasks.workunit.client.1.smithi165.stdout:6/883: write d29/d39/d5b/fe8 [1025363,41149] 0 2024-09-06T14:44:37.854 INFO:tasks.workunit.client.1.smithi165.stdout:0/781: mkdir d15/d19/d101 0 2024-09-06T14:44:37.854 INFO:tasks.workunit.client.1.smithi165.stdout:0/782: chown d15/d19/d28/d51/d60/f74 16091795 1 2024-09-06T14:44:37.857 INFO:tasks.workunit.client.0.smithi052.stdout:0/213: rename d0/d1a/d26/d3a/d14/d20/c38 to d0/d2e/c49 0 2024-09-06T14:44:37.857 INFO:tasks.workunit.client.1.smithi165.stdout:7/709: link d20/d4d/d54/l64 d20/le2 0 2024-09-06T14:44:37.861 INFO:tasks.workunit.client.1.smithi165.stdout:2/801: unlink d9/d88/dac/ff4 0 2024-09-06T14:44:37.863 INFO:tasks.workunit.client.0.smithi052.stdout:9/105: dwrite d1/fa [0,4194304] 0 2024-09-06T14:44:37.864 INFO:tasks.workunit.client.0.smithi052.stdout:9/106: dread - d1/d4/df/f24 zero size 2024-09-06T14:44:37.865 INFO:tasks.workunit.client.0.smithi052.stdout:9/107: write d1/f23 [119216,111468] 0 2024-09-06T14:44:37.867 INFO:tasks.workunit.client.0.smithi052.stdout:0/214: creat d0/d1a/d26/d3a/d14/d20/d22/f4a x:0 0 0 2024-09-06T14:44:37.868 INFO:tasks.workunit.client.1.smithi165.stdout:1/809: dwrite d0/d2a/d18/d24/d4b/d93/d68/d75/f99 [0,4194304] 0 2024-09-06T14:44:37.868 INFO:tasks.workunit.client.0.smithi052.stdout:9/108: chown d1/d4/d6/dd/f13 580991131 1 2024-09-06T14:44:37.868 INFO:tasks.workunit.client.0.smithi052.stdout:2/187: getdents da/d19/d20 0 2024-09-06T14:44:37.871 INFO:tasks.workunit.client.1.smithi165.stdout:6/884: rename d29/d39/d5b/fe8 to d29/d39/d5b/d62/d94/db7/dba/f11a 0 2024-09-06T14:44:37.872 INFO:tasks.workunit.client.0.smithi052.stdout:0/215: creat d0/d2e/f4b x:0 0 0 2024-09-06T14:44:37.874 INFO:tasks.workunit.client.0.smithi052.stdout:2/188: symlink da/db/d18/l41 0 2024-09-06T14:44:37.875 INFO:tasks.workunit.client.0.smithi052.stdout:0/216: truncate d0/d1a/d26/d3a/d14/d20/d22/f4a 631503 0 2024-09-06T14:44:37.881 INFO:tasks.workunit.client.0.smithi052.stdout:9/109: mknod d1/d4/d6/dc/c25 0 2024-09-06T14:44:37.883 INFO:tasks.workunit.client.0.smithi052.stdout:2/189: dwrite da/db/d18/f38 [0,4194304] 0 2024-09-06T14:44:37.884 INFO:tasks.workunit.client.0.smithi052.stdout:2/190: chown da/f2f 49 1 2024-09-06T14:44:37.887 INFO:tasks.workunit.client.1.smithi165.stdout:2/802: dread d9/d25/d45/f63 [0,4194304] 0 2024-09-06T14:44:37.887 INFO:tasks.workunit.client.1.smithi165.stdout:9/945: getdents db/de/d15/d7f/dbc/ddf/d123 0 2024-09-06T14:44:37.890 INFO:tasks.workunit.client.1.smithi165.stdout:5/935: getdents d6/d1c/d28/d2d/d61 0 2024-09-06T14:44:37.891 INFO:tasks.workunit.client.1.smithi165.stdout:5/936: chown d6/d1c/d28/d2d/d3c/d81/f117 57919786 1 2024-09-06T14:44:37.897 INFO:tasks.workunit.client.0.smithi052.stdout:0/217: rename d0/f1d to d0/d1a/d26/d3a/d14/d20/d22/d41/f4c 0 2024-09-06T14:44:37.898 INFO:tasks.workunit.client.1.smithi165.stdout:0/783: dwrite d15/d19/d28/d3a/d3f/f83 [0,4194304] 0 2024-09-06T14:44:37.898 INFO:tasks.workunit.client.1.smithi165.stdout:6/885: symlink d29/d39/d5b/d68/l11b 0 2024-09-06T14:44:37.899 INFO:tasks.workunit.client.1.smithi165.stdout:6/886: chown d29/d39/d86 94726 1 2024-09-06T14:44:37.899 INFO:tasks.workunit.client.0.smithi052.stdout:0/218: write d0/d1a/d26/d3a/f36 [126793,17308] 0 2024-09-06T14:44:37.899 INFO:tasks.workunit.client.0.smithi052.stdout:9/110: mkdir d1/d26 0 2024-09-06T14:44:37.899 INFO:tasks.workunit.client.1.smithi165.stdout:0/784: readlink d15/d19/d50/d53/d7c/dbb/lca 0 2024-09-06T14:44:37.900 INFO:tasks.workunit.client.0.smithi052.stdout:9/111: write d1/f8 [64767,72526] 0 2024-09-06T14:44:37.901 INFO:tasks.workunit.client.1.smithi165.stdout:4/892: unlink d5/d1b/d1c/d8c/d106/d11c/f7f 0 2024-09-06T14:44:37.902 INFO:tasks.workunit.client.0.smithi052.stdout:9/112: read d1/d4/f5 [1079067,29932] 0 2024-09-06T14:44:37.903 INFO:tasks.workunit.client.0.smithi052.stdout:2/191: read f1 [2790155,5395] 0 2024-09-06T14:44:37.904 INFO:tasks.workunit.client.1.smithi165.stdout:7/710: creat d20/d3b/d69/d88/dc6/fe3 x:0 0 0 2024-09-06T14:44:37.904 INFO:tasks.workunit.client.0.smithi052.stdout:9/113: dread d1/f8 [0,4194304] 0 2024-09-06T14:44:37.905 INFO:tasks.workunit.client.0.smithi052.stdout:2/192: fsync da/db/d18/f38 0 2024-09-06T14:44:37.908 INFO:tasks.workunit.client.1.smithi165.stdout:9/946: rename db/de/d15/d17/d18/d7d/ld0 to db/de/d15/d17/d18/d59/d64/d12d/l12e 0 2024-09-06T14:44:37.909 INFO:tasks.workunit.client.0.smithi052.stdout:0/219: write d0/d1a/d26/d3a/d14/d20/f48 [466401,42252] 0 2024-09-06T14:44:37.911 INFO:tasks.workunit.client.0.smithi052.stdout:9/114: dread d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:37.912 INFO:tasks.workunit.client.0.smithi052.stdout:2/193: dread da/f11 [0,4194304] 0 2024-09-06T14:44:37.915 INFO:tasks.workunit.client.1.smithi165.stdout:6/887: creat d29/d32/dee/f11c x:0 0 0 2024-09-06T14:44:37.916 INFO:tasks.workunit.client.0.smithi052.stdout:9/115: dread d1/f17 [0,4194304] 0 2024-09-06T14:44:37.917 INFO:tasks.workunit.client.1.smithi165.stdout:4/893: mknod d5/d1b/d1c/d8c/d106/c12a 0 2024-09-06T14:44:37.918 INFO:tasks.workunit.client.0.smithi052.stdout:0/220: write d0/d1a/d26/d3a/d14/d2d/f2b [624525,45813] 0 2024-09-06T14:44:37.921 INFO:tasks.workunit.client.0.smithi052.stdout:2/194: mknod da/d19/d20/c42 0 2024-09-06T14:44:37.922 INFO:tasks.workunit.client.1.smithi165.stdout:9/947: unlink db/de/d15/d17/l60 0 2024-09-06T14:44:37.922 INFO:tasks.workunit.client.1.smithi165.stdout:8/861: sync 2024-09-06T14:44:37.923 INFO:tasks.workunit.client.0.smithi052.stdout:9/116: mknod d1/d4/d6/dc/d10/d18/c27 0 2024-09-06T14:44:37.923 INFO:tasks.workunit.client.0.smithi052.stdout:9/117: read d1/d4/f9 [5259965,22449] 0 2024-09-06T14:44:37.924 INFO:tasks.workunit.client.0.smithi052.stdout:9/118: chown d1/d4/df/l1e 191 1 2024-09-06T14:44:37.926 INFO:tasks.workunit.client.1.smithi165.stdout:6/888: mknod d29/d39/d5b/d62/d9f/dce/c11d 0 2024-09-06T14:44:37.927 INFO:tasks.workunit.client.1.smithi165.stdout:6/889: write d29/d39/d5b/d62/d94/db7/fe1 [3214591,65710] 0 2024-09-06T14:44:37.929 INFO:tasks.workunit.client.1.smithi165.stdout:6/890: write d29/d93/d87/df2/ffc [458704,35079] 0 2024-09-06T14:44:37.929 INFO:tasks.workunit.client.0.smithi052.stdout:9/119: creat d1/d4/d6/dd/d22/f28 x:0 0 0 2024-09-06T14:44:37.930 INFO:tasks.workunit.client.1.smithi165.stdout:2/803: link d9/cf2 d9/d3b/d78/c10b 0 2024-09-06T14:44:37.931 INFO:tasks.workunit.client.1.smithi165.stdout:2/804: stat d9/d25/d45/d75/d67/ce9 0 2024-09-06T14:44:37.931 INFO:tasks.workunit.client.0.smithi052.stdout:2/195: link da/f1b da/d19/d3a/d31/f43 0 2024-09-06T14:44:37.932 INFO:tasks.workunit.client.1.smithi165.stdout:2/805: readlink d9/d23/d29/d48/d8c/dbf/lc9 0 2024-09-06T14:44:37.933 INFO:tasks.workunit.client.1.smithi165.stdout:4/894: mknod d5/c12b 0 2024-09-06T14:44:37.933 INFO:tasks.workunit.client.1.smithi165.stdout:7/711: dwrite d20/d4d/d54/dc1/fcf [4194304,4194304] 0 2024-09-06T14:44:37.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.937+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce9c1063d0 con 0x7fce84072950 2024-09-06T14:44:37.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.938+0000 7fce98ff9640 1 -- 172.21.15.52:0/1565850899 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fce9c1063d0 con 0x7fce84072950 2024-09-06T14:44:37.936 INFO:tasks.workunit.client.0.smithi052.stdout:9/120: link c0 d1/c29 0 2024-09-06T14:44:37.938 INFO:tasks.workunit.client.1.smithi165.stdout:0/785: getdents d15/d19/d66 0 2024-09-06T14:44:37.938 INFO:tasks.workunit.client.1.smithi165.stdout:2/806: mkdir d9/d88/dac/d10c 0 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fce84072950 msgr2=0x7fce84074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fce84072950 0x7fce84074e10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c00 tx=0x7fce8c004120 comp rx=0 tx=0).stop 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c101a80 msgr2=0x7fce9c197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c101a80 0x7fce9c197c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fce9000b420 tx=0x7fce9000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 shutdown_connections 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fce84072950 0x7fce84074e10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce9c101a80 0x7fce9c197c40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 --2- 172.21.15.52:0/1565850899 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce9c100880 0x7fce9c197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:37.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.941+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 >> 172.21.15.52:0/1565850899 conn(0x7fce9c0fc030 msgr2=0x7fce9c104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:37.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.942+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 shutdown_connections 2024-09-06T14:44:37.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:37.942+0000 7fcea1baf640 1 -- 172.21.15.52:0/1565850899 wait complete. 2024-09-06T14:44:37.941 INFO:tasks.workunit.client.1.smithi165.stdout:7/712: creat d20/d3b/d69/d88/d30/fe4 x:0 0 0 2024-09-06T14:44:37.941 INFO:tasks.workunit.client.1.smithi165.stdout:9/948: creat db/f12f x:0 0 0 2024-09-06T14:44:37.944 INFO:tasks.workunit.client.1.smithi165.stdout:8/862: creat d0/d19/d36/d2d/f131 x:0 0 0 2024-09-06T14:44:37.944 INFO:tasks.workunit.client.1.smithi165.stdout:2/807: symlink d9/d3b/l10d 0 2024-09-06T14:44:37.945 INFO:tasks.workunit.client.0.smithi052.stdout:9/121: dwrite d1/d4/f5 [4194304,4194304] 0 2024-09-06T14:44:37.945 INFO:tasks.workunit.client.1.smithi165.stdout:4/895: creat d5/d1b/d1c/d20/d75/d83/f12c x:0 0 0 2024-09-06T14:44:37.947 INFO:tasks.workunit.client.1.smithi165.stdout:0/786: dwrite d15/d19/d2c/f36 [4194304,4194304] 0 2024-09-06T14:44:37.951 INFO:tasks.workunit.client.1.smithi165.stdout:0/787: fsync d15/d19/d66/f95 0 2024-09-06T14:44:37.952 INFO:tasks.workunit.client.1.smithi165.stdout:3/859: sync 2024-09-06T14:44:37.954 INFO:tasks.workunit.client.1.smithi165.stdout:4/896: unlink d5/d1b/d1c/f6c 0 2024-09-06T14:44:37.956 INFO:tasks.workunit.client.1.smithi165.stdout:0/788: readlink d15/d19/d50/l76 0 2024-09-06T14:44:37.956 INFO:tasks.workunit.client.1.smithi165.stdout:8/863: dwrite d0/d14/fae [0,4194304] 0 2024-09-06T14:44:37.958 INFO:tasks.workunit.client.1.smithi165.stdout:7/713: getdents d20/d65/d82/d97 0 2024-09-06T14:44:37.958 INFO:tasks.workunit.client.1.smithi165.stdout:9/949: dwrite db/de/d15/d17/dad/fbb [0,4194304] 0 2024-09-06T14:44:37.960 INFO:tasks.workunit.client.1.smithi165.stdout:7/714: chown d20/d4d 1 1 2024-09-06T14:44:37.961 INFO:tasks.workunit.client.1.smithi165.stdout:2/808: dwrite d9/d23/d29/d48/d8c/f86 [0,4194304] 0 2024-09-06T14:44:37.968 INFO:tasks.workunit.client.1.smithi165.stdout:8/864: read d0/d19/d36/fb [4089408,129032] 0 2024-09-06T14:44:37.974 INFO:tasks.workunit.client.1.smithi165.stdout:0/789: mknod d15/d19/d28/d3a/d3f/c102 0 2024-09-06T14:44:37.976 INFO:tasks.workunit.client.1.smithi165.stdout:1/810: write d0/d2a/f53 [1010519,10470] 0 2024-09-06T14:44:37.977 INFO:tasks.workunit.client.1.smithi165.stdout:9/950: creat db/de/d15/d17/dad/f130 x:0 0 0 2024-09-06T14:44:37.977 INFO:tasks.workunit.client.1.smithi165.stdout:1/811: dread - d0/d1c/d1d/d57/fea zero size 2024-09-06T14:44:37.981 INFO:tasks.workunit.client.1.smithi165.stdout:2/809: rename d9/d25/d45/d75/da5 to d9/d25/d45/d75/d67/dd1/de6/d10e 0 2024-09-06T14:44:37.981 INFO:tasks.workunit.client.1.smithi165.stdout:3/860: getdents d1/da/dc/d3b/dc6/d108 0 2024-09-06T14:44:37.983 INFO:tasks.workunit.client.1.smithi165.stdout:8/865: unlink d0/d19/d24/db1/fc5 0 2024-09-06T14:44:37.985 INFO:tasks.workunit.client.1.smithi165.stdout:0/790: fdatasync d15/f1f 0 2024-09-06T14:44:37.986 INFO:tasks.workunit.client.1.smithi165.stdout:0/791: chown d15/d19/d50/d53/d7c/fdd 354730 1 2024-09-06T14:44:37.987 INFO:tasks.workunit.client.1.smithi165.stdout:7/715: creat d20/d3b/d8c/fe5 x:0 0 0 2024-09-06T14:44:37.988 INFO:tasks.workunit.client.1.smithi165.stdout:1/812: mknod d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98/c106 0 2024-09-06T14:44:37.989 INFO:tasks.workunit.client.1.smithi165.stdout:2/810: truncate d9/f1a 1975555 0 2024-09-06T14:44:37.990 INFO:tasks.workunit.client.1.smithi165.stdout:3/861: mknod d1/da/dc/d3b/d83/d86/c11f 0 2024-09-06T14:44:37.991 INFO:tasks.workunit.client.1.smithi165.stdout:3/862: chown d1/da/dd/fb7 185 1 2024-09-06T14:44:37.992 INFO:tasks.workunit.client.1.smithi165.stdout:5/937: truncate d6/d1c/d28/d4b/d55/f6f 1624362 0 2024-09-06T14:44:37.993 INFO:tasks.workunit.client.1.smithi165.stdout:3/863: dread - d1/da/dd/f10d zero size 2024-09-06T14:44:37.996 INFO:tasks.workunit.client.1.smithi165.stdout:2/811: dwrite d9/d25/d45/d75/d67/f9a [0,4194304] 0 2024-09-06T14:44:37.998 INFO:tasks.workunit.client.1.smithi165.stdout:1/813: rename d0/d2a/d18/c33 to d0/d2a/d18/d24/d4b/d93/d2b/d3e/c107 0 2024-09-06T14:44:38.002 INFO:tasks.workunit.client.0.smithi052.stdout:0/221: dwrite d0/fe [0,4194304] 0 2024-09-06T14:44:38.003 INFO:tasks.workunit.client.0.smithi052.stdout:0/222: fdatasync d0/d1a/d26/d3a/d14/d20/f48 0 2024-09-06T14:44:38.006 INFO:tasks.workunit.client.1.smithi165.stdout:3/864: rmdir d1/da/dc/d3b/dc6/df0 39 2024-09-06T14:44:38.007 INFO:tasks.workunit.client.0.smithi052.stdout:2/196: write da/f1b [1909025,115883] 0 2024-09-06T14:44:38.007 INFO:tasks.workunit.client.1.smithi165.stdout:3/865: fdatasync d1/da/dc/d3b/d83/f115 0 2024-09-06T14:44:38.008 INFO:tasks.workunit.client.0.smithi052.stdout:2/197: chown da/db/d18/f38 2054 1 2024-09-06T14:44:38.019 INFO:tasks.workunit.client.1.smithi165.stdout:2/812: creat d9/d23/d29/d48/dce/dfc/f10f x:0 0 0 2024-09-06T14:44:38.019 INFO:tasks.workunit.client.1.smithi165.stdout:2/813: chown d9/f1e 282859065 1 2024-09-06T14:44:38.020 INFO:tasks.workunit.client.1.smithi165.stdout:1/814: chown d0/d1c/cdb 109554 1 2024-09-06T14:44:38.020 INFO:tasks.workunit.client.1.smithi165.stdout:2/814: write d9/d25/d45/d75/d67/dd1/de6/ff0 [287872,105550] 0 2024-09-06T14:44:38.021 INFO:tasks.workunit.client.0.smithi052.stdout:9/122: truncate d1/fa 3196827 0 2024-09-06T14:44:38.021 INFO:tasks.workunit.client.1.smithi165.stdout:9/951: getdents db/de/d15/d17/d86/ddd 0 2024-09-06T14:44:38.022 INFO:tasks.workunit.client.0.smithi052.stdout:9/123: write d1/d4/d6/dd/f13 [2008564,97469] 0 2024-09-06T14:44:38.022 INFO:tasks.workunit.client.1.smithi165.stdout:9/952: readlink db/d40/d9a/l102 0 2024-09-06T14:44:38.028 INFO:tasks.workunit.client.1.smithi165.stdout:2/815: dread - d9/d23/d71/fed zero size 2024-09-06T14:44:38.030 INFO:tasks.workunit.client.1.smithi165.stdout:4/897: dwrite d5/f2b [0,4194304] 0 2024-09-06T14:44:38.032 INFO:tasks.workunit.client.1.smithi165.stdout:3/866: dwrite d1/d7c/d7e/dc5/fe7 [0,4194304] 0 2024-09-06T14:44:38.033 INFO:tasks.workunit.client.1.smithi165.stdout:9/953: unlink db/de/d15/d17/f45 0 2024-09-06T14:44:38.035 INFO:tasks.workunit.client.1.smithi165.stdout:5/938: link d6/d1c/f39 d6/d1c/d28/d2d/d3c/d109/f152 0 2024-09-06T14:44:38.040 INFO:tasks.workunit.client.1.smithi165.stdout:1/815: mknod d0/d2a/d18/d24/d4b/c108 0 2024-09-06T14:44:38.041 INFO:tasks.workunit.client.1.smithi165.stdout:8/866: write d0/d19/d36/d28/fc3 [930827,30298] 0 2024-09-06T14:44:38.042 INFO:tasks.workunit.client.1.smithi165.stdout:2/816: mknod d9/d25/d45/d75/d67/dd1/de6/c110 0 2024-09-06T14:44:38.047 INFO:tasks.workunit.client.1.smithi165.stdout:3/867: creat d1/d41/f120 x:0 0 0 2024-09-06T14:44:38.048 INFO:tasks.workunit.client.1.smithi165.stdout:9/954: rename db/de/d16/d2e/f70 to db/de/d15/d74/f131 0 2024-09-06T14:44:38.049 INFO:tasks.workunit.client.1.smithi165.stdout:6/891: sync 2024-09-06T14:44:38.052 INFO:tasks.workunit.client.1.smithi165.stdout:4/898: dread d5/d1b/f109 [0,4194304] 0 2024-09-06T14:44:38.053 INFO:tasks.workunit.client.1.smithi165.stdout:1/816: creat d0/d2a/d18/d24/d4b/d93/dbd/dd1/f109 x:0 0 0 2024-09-06T14:44:38.053 INFO:tasks.workunit.client.1.smithi165.stdout:0/792: truncate d15/d19/f46 723731 0 2024-09-06T14:44:38.053 INFO:tasks.workunit.client.1.smithi165.stdout:7/716: dwrite d20/d4d/ddd/fb4 [0,4194304] 0 2024-09-06T14:44:38.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/223: truncate d0/d1a/d26/d3a/d14/d20/f32 925045 0 2024-09-06T14:44:38.055 INFO:tasks.workunit.client.1.smithi165.stdout:4/899: dread - d5/d1b/d1c/d20/d75/d83/f12c zero size 2024-09-06T14:44:38.058 INFO:tasks.workunit.client.0.smithi052.stdout:2/198: dwrite f1 [0,4194304] 0 2024-09-06T14:44:38.060 INFO:tasks.workunit.client.1.smithi165.stdout:7/717: dread d20/d3b/f74 [0,4194304] 0 2024-09-06T14:44:38.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/224: mknod d0/d18/c4d 0 2024-09-06T14:44:38.061 INFO:tasks.workunit.client.1.smithi165.stdout:8/867: dread d0/d5e/d65/f99 [0,4194304] 0 2024-09-06T14:44:38.062 INFO:tasks.workunit.client.0.smithi052.stdout:0/225: fsync d0/d1a/d26/f27 0 2024-09-06T14:44:38.063 INFO:tasks.workunit.client.0.smithi052.stdout:0/226: write d0/d1a/d26/f27 [2996075,62202] 0 2024-09-06T14:44:38.065 INFO:tasks.workunit.client.1.smithi165.stdout:9/955: mknod db/de/d15/d17/d18/d59/d64/d12d/c132 0 2024-09-06T14:44:38.066 INFO:tasks.workunit.client.1.smithi165.stdout:7/718: dread d20/d3b/d69/d88/fb1 [0,4194304] 0 2024-09-06T14:44:38.068 INFO:tasks.workunit.client.1.smithi165.stdout:9/956: chown db/de/d15/d17/d18/d7d/d61/fa0 56408865 1 2024-09-06T14:44:38.068 INFO:tasks.workunit.client.0.smithi052.stdout:9/124: dwrite d1/d4/f9 [0,4194304] 0 2024-09-06T14:44:38.070 INFO:tasks.workunit.client.1.smithi165.stdout:3/868: mknod d1/d19/c121 0 2024-09-06T14:44:38.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:37 smithi165 ceph-mon[36229]: pgmap v21: 65 pgs: 65 active+clean; 1.4 GiB data, 4.2 GiB used, 532 GiB / 536 GiB avail; 54 MiB/s rd, 177 MiB/s wr, 358 op/s 2024-09-06T14:44:38.073 INFO:tasks.workunit.client.1.smithi165.stdout:3/869: write d1/d19/d4d/fd0 [1662686,11088] 0 2024-09-06T14:44:38.074 INFO:tasks.workunit.client.1.smithi165.stdout:3/870: write d1/da/dd/f10d [208668,36619] 0 2024-09-06T14:44:38.075 INFO:tasks.workunit.client.1.smithi165.stdout:1/817: creat d0/d1c/d40/f10a x:0 0 0 2024-09-06T14:44:38.076 INFO:tasks.workunit.client.1.smithi165.stdout:3/871: fsync d1/da/dd/d8c/dae/f114 0 2024-09-06T14:44:38.076 INFO:tasks.workunit.client.1.smithi165.stdout:0/793: mknod d15/d19/d28/d9e/c103 0 2024-09-06T14:44:38.077 INFO:tasks.workunit.client.0.smithi052.stdout:9/125: symlink d1/d4/df/l2a 0 2024-09-06T14:44:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.080+0000 7fab6dd23640 1 -- 172.21.15.52:0/1698925399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68101a60 msgr2=0x7fab68101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.080+0000 7fab6dd23640 1 --2- 172.21.15.52:0/1698925399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68101a60 0x7fab68101ee0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fab5c009880 tx=0x7fab5c02c6e0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.080+0000 7fab6dd23640 1 -- 172.21.15.52:0/1698925399 shutdown_connections 2024-09-06T14:44:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.080+0000 7fab6dd23640 1 --2- 172.21.15.52:0/1698925399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68101a60 0x7fab68101ee0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.080+0000 7fab6dd23640 1 --2- 172.21.15.52:0/1698925399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab68100860 0x7fab68100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.080+0000 7fab6dd23640 1 -- 172.21.15.52:0/1698925399 >> 172.21.15.52:0/1698925399 conn(0x7fab680fc010 msgr2=0x7fab680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:38.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.081+0000 7fab6dd23640 1 -- 172.21.15.52:0/1698925399 shutdown_connections 2024-09-06T14:44:38.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.081+0000 7fab6dd23640 1 -- 172.21.15.52:0/1698925399 wait complete. 2024-09-06T14:44:38.079 INFO:tasks.workunit.client.1.smithi165.stdout:3/872: truncate d1/da/dd/d4b/f74 4589932 0 2024-09-06T14:44:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.081+0000 7fab6dd23640 1 Processor -- start 2024-09-06T14:44:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab6dd23640 1 -- start start 2024-09-06T14:44:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab6dd23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68100860 0x7fab68195310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab6dd23640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab68101a60 0x7fab68195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab6dd23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fab68108610 con 0x7fab68100860 2024-09-06T14:44:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab6dd23640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fab68108490 con 0x7fab68101a60 2024-09-06T14:44:38.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab677fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68100860 0x7fab68195310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab677fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68100860 0x7fab68195310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41150/0 (socket says 172.21.15.52:41150) 2024-09-06T14:44:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab677fe640 1 -- 172.21.15.52:0/493715976 learned_addr learned my addr 172.21.15.52:0/493715976 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.082+0000 7fab66ffd640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab68101a60 0x7fab68195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab677fe640 1 -- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab68101a60 msgr2=0x7fab68195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab677fe640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab68101a60 0x7fab68195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab677fe640 1 -- 172.21.15.52:0/493715976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab68195ed0 con 0x7fab68100860 2024-09-06T14:44:38.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab677fe640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68100860 0x7fab68195310 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fab5800b3d0 tx=0x7fab5800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab64ff9640 1 -- 172.21.15.52:0/493715976 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab58015020 con 0x7fab68100860 2024-09-06T14:44:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab64ff9640 1 -- 172.21.15.52:0/493715976 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab58011af0 con 0x7fab68100860 2024-09-06T14:44:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6819a910 con 0x7fab68100860 2024-09-06T14:44:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.083+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6819aef0 con 0x7fab68100860 2024-09-06T14:44:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.084+0000 7fab64ff9640 1 -- 172.21.15.52:0/493715976 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab58010da0 con 0x7fab68100860 2024-09-06T14:44:38.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.085+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab540052c0 con 0x7fab68100860 2024-09-06T14:44:38.083 INFO:tasks.workunit.client.1.smithi165.stdout:5/939: mkdir d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/d153 0 2024-09-06T14:44:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.085+0000 7fab64ff9640 1 -- 172.21.15.52:0/493715976 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7fab58018020 con 0x7fab68100860 2024-09-06T14:44:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.086+0000 7fab64ff9640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fab50072950 0x7fab50074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.086+0000 7fab64ff9640 1 -- 172.21.15.52:0/493715976 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fab580931e0 con 0x7fab68100860 2024-09-06T14:44:38.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.087+0000 7fab66ffd640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fab50072950 0x7fab50074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:38.084 INFO:tasks.workunit.client.0.smithi052.stdout:9/126: mkdir d1/d4/d6/dd/d2b 0 2024-09-06T14:44:38.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.087+0000 7fab66ffd640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fab50072950 0x7fab50074e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000c00 tx=0x7fab5c0058d0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:38.087 INFO:tasks.workunit.client.1.smithi165.stdout:8/868: dread d0/d19/d36/d2d/f75 [0,4194304] 0 2024-09-06T14:44:38.087 INFO:tasks.workunit.client.1.smithi165.stdout:8/869: chown d0/d34/d6b 1777029910 1 2024-09-06T14:44:38.088 INFO:tasks.workunit.client.1.smithi165.stdout:8/870: fdatasync d0/d19/d36/d28/d64/fdf 0 2024-09-06T14:44:38.089 INFO:tasks.workunit.client.1.smithi165.stdout:8/871: fdatasync d0/d19/d36/d28/d64/ff5 0 2024-09-06T14:44:38.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.092+0000 7fab64ff9640 1 -- 172.21.15.52:0/493715976 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fab5801f020 con 0x7fab68100860 2024-09-06T14:44:38.091 INFO:tasks.workunit.client.1.smithi165.stdout:6/892: write d29/d6a/f75 [352808,116324] 0 2024-09-06T14:44:38.092 INFO:tasks.workunit.client.1.smithi165.stdout:2/817: creat d9/d23/f111 x:0 0 0 2024-09-06T14:44:38.097 INFO:tasks.workunit.client.0.smithi052.stdout:2/199: truncate da/d19/f29 247823 0 2024-09-06T14:44:38.098 INFO:tasks.workunit.client.0.smithi052.stdout:2/200: readlink da/d19/d20/l3b 0 2024-09-06T14:44:38.101 INFO:tasks.workunit.client.0.smithi052.stdout:2/201: symlink da/d2d/d34/l44 0 2024-09-06T14:44:38.103 INFO:tasks.workunit.client.1.smithi165.stdout:3/873: symlink d1/da/dd/d8c/l122 0 2024-09-06T14:44:38.107 INFO:tasks.workunit.client.1.smithi165.stdout:5/940: dread d6/d1c/d28/d2d/d61/ddc/fdd [0,4194304] 0 2024-09-06T14:44:38.108 INFO:tasks.workunit.client.0.smithi052.stdout:2/202: dwrite da/d19/f26 [0,4194304] 0 2024-09-06T14:44:38.112 INFO:tasks.workunit.client.1.smithi165.stdout:8/872: readlink d0/l3 0 2024-09-06T14:44:38.113 INFO:tasks.workunit.client.1.smithi165.stdout:6/893: stat d29/d39/d5b/d62/d94/db7/dcc/l103 0 2024-09-06T14:44:38.116 INFO:tasks.workunit.client.1.smithi165.stdout:9/957: mknod db/de/d15/d7f/d9b/d6c/c133 0 2024-09-06T14:44:38.117 INFO:tasks.workunit.client.1.smithi165.stdout:1/818: mknod d0/d2a/d18/d24/d4b/d93/d6a/dd2/c10b 0 2024-09-06T14:44:38.118 INFO:tasks.workunit.client.0.smithi052.stdout:9/127: dwrite d1/d4/f7 [4194304,4194304] 0 2024-09-06T14:44:38.119 INFO:tasks.workunit.client.1.smithi165.stdout:7/719: dwrite d20/d4d/ddd/fa9 [0,4194304] 0 2024-09-06T14:44:38.121 INFO:tasks.workunit.client.1.smithi165.stdout:3/874: chown d1/dbd/lbe 83 1 2024-09-06T14:44:38.122 INFO:tasks.workunit.client.1.smithi165.stdout:3/875: fsync d1/d4a/dc7/fdf 0 2024-09-06T14:44:38.122 INFO:tasks.workunit.client.1.smithi165.stdout:4/900: link d5/d1b/d61/dd7/ddf/f2a d5/d1b/d1c/d20/d75/d83/f12d 0 2024-09-06T14:44:38.123 INFO:tasks.workunit.client.1.smithi165.stdout:3/876: readlink d1/l6f 0 2024-09-06T14:44:38.126 INFO:tasks.workunit.client.1.smithi165.stdout:8/873: readlink d0/d34/lb9 0 2024-09-06T14:44:38.133 INFO:tasks.workunit.client.1.smithi165.stdout:1/819: rename d0/d2a/d18/d24/f104 to d0/d1c/dd5/f10c 0 2024-09-06T14:44:38.133 INFO:tasks.workunit.client.1.smithi165.stdout:8/874: dwrite d0/d19/f86 [0,4194304] 0 2024-09-06T14:44:38.139 INFO:tasks.workunit.client.1.smithi165.stdout:4/901: creat d5/d1b/d1c/d20/d75/d83/dae/f12e x:0 0 0 2024-09-06T14:44:38.141 INFO:tasks.workunit.client.0.smithi052.stdout:9/128: truncate d1/d4/f5 8053182 0 2024-09-06T14:44:38.144 INFO:tasks.workunit.client.0.smithi052.stdout:9/129: creat d1/d4/d6/dd/f2c x:0 0 0 2024-09-06T14:44:38.145 INFO:tasks.workunit.client.1.smithi165.stdout:7/720: stat d20/d33/ldc 0 2024-09-06T14:44:38.146 INFO:tasks.workunit.client.1.smithi165.stdout:8/875: rename d0/d5e/l105 to d0/d19/d24/l132 0 2024-09-06T14:44:38.148 INFO:tasks.workunit.client.1.smithi165.stdout:3/877: truncate d1/dbd/fdb 3180284 0 2024-09-06T14:44:38.149 INFO:tasks.workunit.client.1.smithi165.stdout:3/878: write d1/da/dd/d4b/d112/fac [93482,84815] 0 2024-09-06T14:44:38.150 INFO:tasks.workunit.client.1.smithi165.stdout:2/818: getdents d9/d25/d45/d75/d67/d76 0 2024-09-06T14:44:38.153 INFO:tasks.workunit.client.1.smithi165.stdout:7/721: rename d20/d3b/f3f to d20/d3b/d69/d88/d30/d78/fe6 0 2024-09-06T14:44:38.157 INFO:tasks.workunit.client.1.smithi165.stdout:2/819: symlink d9/d88/dac/d95/l112 0 2024-09-06T14:44:38.160 INFO:tasks.workunit.client.1.smithi165.stdout:4/902: dread d5/d1b/d61/fd3 [0,4194304] 0 2024-09-06T14:44:38.161 INFO:tasks.workunit.client.1.smithi165.stdout:4/903: write d5/d1b/d61/dd7/fe3 [3403234,80005] 0 2024-09-06T14:44:38.162 INFO:tasks.workunit.client.1.smithi165.stdout:6/894: write d29/f47 [1291361,3908] 0 2024-09-06T14:44:38.163 INFO:tasks.workunit.client.1.smithi165.stdout:8/876: link d0/d19/d36/d2d/d33/f4c d0/d34/d6b/d94/d70/db8/f133 0 2024-09-06T14:44:38.167 INFO:tasks.workunit.client.1.smithi165.stdout:2/820: dwrite d9/d25/d45/f63 [0,4194304] 0 2024-09-06T14:44:38.169 INFO:tasks.workunit.client.1.smithi165.stdout:4/904: symlink d5/d1b/d1c/d20/d75/d83/dae/l12f 0 2024-09-06T14:44:38.170 INFO:tasks.workunit.client.1.smithi165.stdout:2/821: read d9/d25/d45/d75/d67/dd1/de6/ff0 [365633,3575] 0 2024-09-06T14:44:38.172 INFO:tasks.workunit.client.1.smithi165.stdout:7/722: getdents d20/d4d/d54/dc1 0 2024-09-06T14:44:38.173 INFO:tasks.workunit.client.1.smithi165.stdout:1/820: write d0/d1c/fc3 [4417,86922] 0 2024-09-06T14:44:38.174 INFO:tasks.workunit.client.1.smithi165.stdout:6/895: dwrite d29/d6a/d71/fcb [0,4194304] 0 2024-09-06T14:44:38.176 INFO:tasks.workunit.client.1.smithi165.stdout:0/794: write d15/d19/d38/fa2 [330884,11038] 0 2024-09-06T14:44:38.177 INFO:tasks.workunit.client.1.smithi165.stdout:2/822: fdatasync d9/d23/d29/d48/fc3 0 2024-09-06T14:44:38.180 INFO:tasks.workunit.client.1.smithi165.stdout:2/823: chown d9/d23/d29/d48/cc4 73796 1 2024-09-06T14:44:38.181 INFO:tasks.workunit.client.1.smithi165.stdout:1/821: rename d0/d2a/d18/da0/caf to d0/d45/c10d 0 2024-09-06T14:44:38.185 INFO:tasks.workunit.client.0.smithi052.stdout:9/130: dread d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:38.186 INFO:tasks.workunit.client.1.smithi165.stdout:0/795: mkdir d15/d19/d2c/df1/d104 0 2024-09-06T14:44:38.186 INFO:tasks.workunit.client.1.smithi165.stdout:8/877: link d0/d34/d6b/dbe/l129 d0/d14/d3e/dcf/l134 0 2024-09-06T14:44:38.186 INFO:tasks.workunit.client.1.smithi165.stdout:4/905: dwrite d5/d1b/d61/d77/dd5/fe8 [4194304,4194304] 0 2024-09-06T14:44:38.188 INFO:tasks.workunit.client.0.smithi052.stdout:9/131: symlink d1/d4/d6/dc/d10/l2d 0 2024-09-06T14:44:38.189 INFO:tasks.workunit.client.1.smithi165.stdout:0/796: write d15/d19/d50/d53/d7c/dbb/ffb [59788,85455] 0 2024-09-06T14:44:38.190 INFO:tasks.workunit.client.1.smithi165.stdout:4/906: fdatasync d5/d1b/d61/dd7/ddf/f4b 0 2024-09-06T14:44:38.194 INFO:tasks.workunit.client.1.smithi165.stdout:8/878: dwrite d0/d34/d6b/fa0 [0,4194304] 0 2024-09-06T14:44:38.195 INFO:tasks.workunit.client.1.smithi165.stdout:8/879: stat d0/d19/d36/fb 0 2024-09-06T14:44:38.195 INFO:tasks.workunit.client.1.smithi165.stdout:0/797: dread - d15/d6e/fa5 zero size 2024-09-06T14:44:38.200 INFO:tasks.workunit.client.1.smithi165.stdout:1/822: link d0/d2a/d18/d24/d4b/d93/f3a d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f10e 0 2024-09-06T14:44:38.203 INFO:tasks.workunit.client.0.smithi052.stdout:9/132: getdents d1/d4/d6/dd 0 2024-09-06T14:44:38.204 INFO:tasks.workunit.client.1.smithi165.stdout:6/896: write d29/d39/d5b/f92 [1256777,89799] 0 2024-09-06T14:44:38.205 INFO:tasks.workunit.client.1.smithi165.stdout:8/880: symlink d0/d34/d6b/l135 0 2024-09-06T14:44:38.206 INFO:tasks.workunit.client.1.smithi165.stdout:4/907: symlink d5/d1b/d1c/d8c/d106/d11c/dfc/l130 0 2024-09-06T14:44:38.206 INFO:tasks.workunit.client.1.smithi165.stdout:8/881: write d0/d19/d24/fe3 [633956,58051] 0 2024-09-06T14:44:38.207 INFO:tasks.workunit.client.1.smithi165.stdout:7/723: truncate d20/d65/f6c 3605295 0 2024-09-06T14:44:38.208 INFO:tasks.workunit.client.1.smithi165.stdout:1/823: symlink d0/d2a/d23/l10f 0 2024-09-06T14:44:38.209 INFO:tasks.workunit.client.1.smithi165.stdout:6/897: dread d29/d39/f64 [0,4194304] 0 2024-09-06T14:44:38.210 INFO:tasks.workunit.client.1.smithi165.stdout:1/824: write d0/d2a/d18/d24/d4b/d95/ff9 [494710,74819] 0 2024-09-06T14:44:38.211 INFO:tasks.workunit.client.0.smithi052.stdout:9/133: creat d1/d4/d6/dd/d2b/f2e x:0 0 0 2024-09-06T14:44:38.214 INFO:tasks.workunit.client.1.smithi165.stdout:4/908: creat d5/d1b/f131 x:0 0 0 2024-09-06T14:44:38.217 INFO:tasks.workunit.client.1.smithi165.stdout:8/882: rename d0/f17 to d0/d19/d36/d28/d64/f136 0 2024-09-06T14:44:38.219 INFO:tasks.workunit.client.0.smithi052.stdout:9/134: dread d1/f17 [4194304,4194304] 0 2024-09-06T14:44:38.225 INFO:tasks.workunit.client.0.smithi052.stdout:9/135: unlink d1/f8 0 2024-09-06T14:44:38.227 INFO:tasks.workunit.client.1.smithi165.stdout:6/898: rename d29/d6a/f8a to d29/d6a/d83/d89/ddb/f11e 0 2024-09-06T14:44:38.228 INFO:tasks.workunit.client.1.smithi165.stdout:7/724: write d20/d3b/d8c/fd8 [259724,126814] 0 2024-09-06T14:44:38.228 INFO:tasks.workunit.client.1.smithi165.stdout:6/899: write f28 [4415529,25969] 0 2024-09-06T14:44:38.229 INFO:tasks.workunit.client.1.smithi165.stdout:0/798: getdents d15/d19/d28/d51 0 2024-09-06T14:44:38.231 INFO:tasks.workunit.client.0.smithi052.stdout:9/136: dwrite d1/d4/d6/dd/f21 [0,4194304] 0 2024-09-06T14:44:38.232 INFO:tasks.workunit.client.1.smithi165.stdout:8/883: unlink d0/d19/d36/d2d/d33/d3a/d46/la2 0 2024-09-06T14:44:38.233 INFO:tasks.workunit.client.1.smithi165.stdout:8/884: write d0/d19/d36/d28/dda/f118 [4362677,94803] 0 2024-09-06T14:44:38.233 INFO:tasks.workunit.client.0.smithi052.stdout:9/137: fsync d1/d4/d6/dd/d2b/f2e 0 2024-09-06T14:44:38.237 INFO:tasks.workunit.client.1.smithi165.stdout:4/909: dread d5/d1b/d1c/ff1 [0,4194304] 0 2024-09-06T14:44:38.243 INFO:tasks.workunit.client.1.smithi165.stdout:6/900: rename d29/d6a/ffb to d29/d39/d5b/d62/d94/db7/dcc/f11f 0 2024-09-06T14:44:38.243 INFO:tasks.workunit.client.1.smithi165.stdout:5/941: sync 2024-09-06T14:44:38.245 INFO:tasks.workunit.client.1.smithi165.stdout:8/885: mkdir d0/d34/d6b/d94/d70/db8/d137 0 2024-09-06T14:44:38.249 INFO:tasks.workunit.client.1.smithi165.stdout:1/825: write d0/d2a/d18/d24/d4b/d93/dbd/f100 [5196484,94200] 0 2024-09-06T14:44:38.250 INFO:tasks.workunit.client.1.smithi165.stdout:4/910: read d5/d1b/d1c/d8c/fad [2657453,13635] 0 2024-09-06T14:44:38.253 INFO:tasks.workunit.client.1.smithi165.stdout:0/799: rename d15/d19/d50/d53/d57/l75 to d15/d19/d66/df8/dfd/l105 0 2024-09-06T14:44:38.254 INFO:tasks.workunit.client.0.smithi052.stdout:9/138: truncate d1/d4/f7 3541545 0 2024-09-06T14:44:38.255 INFO:tasks.workunit.client.0.smithi052.stdout:9/139: dread - d1/d4/d6/f16 zero size 2024-09-06T14:44:38.256 INFO:tasks.workunit.client.1.smithi165.stdout:7/725: write d20/d3b/f7e [3114803,48238] 0 2024-09-06T14:44:38.257 INFO:tasks.workunit.client.0.smithi052.stdout:9/140: write d1/d4/f9 [2413149,117313] 0 2024-09-06T14:44:38.257 INFO:tasks.workunit.client.1.smithi165.stdout:5/942: mknod d6/d98/c154 0 2024-09-06T14:44:38.257 INFO:tasks.workunit.client.0.smithi052.stdout:9/141: dread - d1/d4/d6/f16 zero size 2024-09-06T14:44:38.262 INFO:tasks.workunit.client.1.smithi165.stdout:5/943: dwrite d6/d1c/d64/ff8 [0,4194304] 0 2024-09-06T14:44:38.262 INFO:tasks.workunit.client.1.smithi165.stdout:0/800: symlink d15/d19/d2c/df1/l106 0 2024-09-06T14:44:38.267 INFO:tasks.workunit.client.0.smithi052.stdout:9/142: dwrite d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:38.268 INFO:tasks.workunit.client.0.smithi052.stdout:9/143: fdatasync d1/d4/d6/f16 0 2024-09-06T14:44:38.270 INFO:tasks.workunit.client.0.smithi052.stdout:9/144: write d1/d4/d6/dd/d22/f28 [315127,70795] 0 2024-09-06T14:44:38.271 INFO:tasks.workunit.client.1.smithi165.stdout:7/726: creat d20/d3b/d69/d88/d80/d81/fe7 x:0 0 0 2024-09-06T14:44:38.272 INFO:tasks.workunit.client.1.smithi165.stdout:4/911: getdents d5/d1b/d61/d77/d108 0 2024-09-06T14:44:38.273 INFO:tasks.workunit.client.1.smithi165.stdout:7/727: readlink d20/d3b/d69/d88/d30/l9f 0 2024-09-06T14:44:38.274 INFO:tasks.workunit.client.1.smithi165.stdout:5/944: mkdir d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d155 0 2024-09-06T14:44:38.276 INFO:tasks.workunit.client.1.smithi165.stdout:7/728: stat d20/d4d/d54/l64 0 2024-09-06T14:44:38.277 INFO:tasks.workunit.client.1.smithi165.stdout:8/886: creat d0/d19/d36/d2d/d3f/f138 x:0 0 0 2024-09-06T14:44:38.279 INFO:tasks.workunit.client.1.smithi165.stdout:6/901: dwrite d29/d32/f56 [4194304,4194304] 0 2024-09-06T14:44:38.279 INFO:tasks.workunit.client.1.smithi165.stdout:0/801: symlink d15/d19/d50/l107 0 2024-09-06T14:44:38.280 INFO:tasks.workunit.client.1.smithi165.stdout:6/902: readlink d29/d39/lcf 0 2024-09-06T14:44:38.281 INFO:tasks.workunit.client.1.smithi165.stdout:4/912: creat d5/d1b/d1c/d8c/f132 x:0 0 0 2024-09-06T14:44:38.283 INFO:tasks.workunit.client.1.smithi165.stdout:5/945: fsync d6/d1c/d28/d2d/fc8 0 2024-09-06T14:44:38.285 INFO:tasks.workunit.client.1.smithi165.stdout:7/729: creat d20/d3b/d69/fe8 x:0 0 0 2024-09-06T14:44:38.287 INFO:tasks.workunit.client.1.smithi165.stdout:1/826: truncate d0/d45/f91 34496 0 2024-09-06T14:44:38.288 INFO:tasks.workunit.client.1.smithi165.stdout:8/887: mknod d0/d5e/c139 0 2024-09-06T14:44:38.293 INFO:tasks.workunit.client.1.smithi165.stdout:4/913: unlink d5/d1b/d1c/d20/d75/l115 0 2024-09-06T14:44:38.293 INFO:tasks.workunit.client.1.smithi165.stdout:8/888: dwrite d0/d19/d7f/f9a [0,4194304] 0 2024-09-06T14:44:38.295 INFO:tasks.workunit.client.1.smithi165.stdout:8/889: read d0/d34/d6b/fa0 [2861870,11086] 0 2024-09-06T14:44:38.296 INFO:tasks.workunit.client.1.smithi165.stdout:1/827: rmdir d0/d2a/d18/d24/d4b/d93 39 2024-09-06T14:44:38.300 INFO:tasks.workunit.client.1.smithi165.stdout:6/903: mknod d29/c120 0 2024-09-06T14:44:38.301 INFO:tasks.workunit.client.1.smithi165.stdout:6/904: fsync d29/d39/d5b/d68/fca 0 2024-09-06T14:44:38.301 INFO:tasks.workunit.client.1.smithi165.stdout:4/914: unlink d5/d1b/d61/d77/d7c/cb5 0 2024-09-06T14:44:38.307 INFO:tasks.workunit.client.1.smithi165.stdout:8/890: creat d0/d19/d36/d28/d64/f13a x:0 0 0 2024-09-06T14:44:38.309 INFO:tasks.workunit.client.1.smithi165.stdout:6/905: mknod d29/d39/d5b/d62/d94/db7/dcc/c121 0 2024-09-06T14:44:38.310 INFO:tasks.workunit.client.1.smithi165.stdout:5/946: link d6/d1c/d28/d4b/d55/cb0 d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/c156 0 2024-09-06T14:44:38.311 INFO:tasks.workunit.client.1.smithi165.stdout:5/947: chown d6/d1c/d28/d4b/l54 4955 1 2024-09-06T14:44:38.311 INFO:tasks.workunit.client.1.smithi165.stdout:6/906: write d29/d39/d5b/d62/d94/db7/dcc/df0/feb [545143,60177] 0 2024-09-06T14:44:38.312 INFO:tasks.workunit.client.1.smithi165.stdout:0/802: dwrite d15/d19/d50/d53/f91 [0,4194304] 0 2024-09-06T14:44:38.325 INFO:tasks.workunit.client.1.smithi165.stdout:3/879: sync 2024-09-06T14:44:38.325 INFO:tasks.workunit.client.1.smithi165.stdout:9/958: sync 2024-09-06T14:44:38.341 INFO:tasks.workunit.client.1.smithi165.stdout:9/959: dread db/de/d16/d2e/ffe [0,4194304] 0 2024-09-06T14:44:38.356 INFO:tasks.workunit.client.1.smithi165.stdout:7/730: rename d20/d3b/d69/d88/c3a to d20/d33/d6a/d90/ce9 0 2024-09-06T14:44:38.357 INFO:tasks.workunit.client.1.smithi165.stdout:7/731: fdatasync d20/d4d/d54/fbe 0 2024-09-06T14:44:38.358 INFO:tasks.workunit.client.1.smithi165.stdout:4/915: mkdir d5/d1b/d1c/d55/d133 0 2024-09-06T14:44:38.359 INFO:tasks.workunit.client.1.smithi165.stdout:5/948: mknod d6/d1c/d28/d2d/d61/c157 0 2024-09-06T14:44:38.361 INFO:tasks.workunit.client.1.smithi165.stdout:6/907: mkdir d29/d39/d5b/d62/d94/db7/dcc/d122 0 2024-09-06T14:44:38.362 INFO:tasks.workunit.client.1.smithi165.stdout:0/803: creat d15/d19/d2c/df1/f108 x:0 0 0 2024-09-06T14:44:38.363 INFO:tasks.workunit.client.1.smithi165.stdout:1/828: dread d0/dc8/fd6 [0,4194304] 0 2024-09-06T14:44:38.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.366+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fab54000bf0 con 0x7fab50072950 2024-09-06T14:44:38.364 INFO:tasks.workunit.client.1.smithi165.stdout:1/829: dread - d0/d1c/dd5/f10c zero size 2024-09-06T14:44:38.368 INFO:tasks.workunit.client.0.smithi052.stdout:9/145: write d1/d4/f7 [992590,33421] 0 2024-09-06T14:44:38.369 INFO:tasks.workunit.client.0.smithi052.stdout:9/146: readlink d1/d4/d6/dc/d10/l2d 0 2024-09-06T14:44:38.370 INFO:tasks.workunit.client.0.smithi052.stdout:9/147: truncate d1/f23 772301 0 2024-09-06T14:44:38.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.376+0000 7fab64ff9640 1 -- 172.21.15.52:0/493715976 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fab54000bf0 con 0x7fab50072950 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (6m) 23s ago 7m 24.3M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (8m) 23s ago 8m 8648k - 19.1.1-268-g635ed4cf b6db46a449e5 9152c789e0ae 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (7m) 30s ago 7m 5268k - 19.1.1-268-g635ed4cf b6db46a449e5 92f6280b935c 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (8m) 23s ago 8m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (7m) 30s ago 7m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (6m) 23s ago 7m 79.7M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (2m) 23s ago 2m 172M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (2m) 23s ago 2m 158M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:44:38.374 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (2m) 30s ago 2m 22.6M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (2m) 30s ago 2m 20.1M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:9283,8765,8443 running (9m) 23s ago 9m 276M - 19.1.1-268-g635ed4cf b6db46a449e5 39e44f4c0904 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (45s) 30s ago 7m 494M - 19.3.0-4704-g8b38c33c 1c45aca0610a 53aea8d00134 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (9m) 23s ago 9m 53.6M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (7m) 30s ago 7m 42.4M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (8m) 23s ago 8m 17.0M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (7m) 30s ago 7m 14.9M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (6m) 23s ago 6m 80.6M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (5m) 23s ago 5m 96.5M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (5m) 23s ago 5m 83.4M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (4m) 30s ago 4m 95.4M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (4m) 30s ago 4m 88.5M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:44:38.375 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (3m) 30s ago 3m 78.6M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:44:38.376 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (6m) 23s ago 7m 61.4M - 2.43.0 a07b618ecd1d 1b767954d6f6 2024-09-06T14:44:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fab50072950 msgr2=0x7fab50074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fab50072950 0x7fab50074e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab5c000c00 tx=0x7fab5c0058d0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68100860 msgr2=0x7fab68195310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68100860 0x7fab68195310 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fab5800b3d0 tx=0x7fab5800b890 comp rx=0 tx=0).stop 2024-09-06T14:44:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 shutdown_connections 2024-09-06T14:44:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fab50072950 0x7fab50074e10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fab68101a60 0x7fab68195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 --2- 172.21.15.52:0/493715976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab68100860 0x7fab68195310 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 >> 172.21.15.52:0/493715976 conn(0x7fab680fc010 msgr2=0x7fab68104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 shutdown_connections 2024-09-06T14:44:38.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.379+0000 7fab6dd23640 1 -- 172.21.15.52:0/493715976 wait complete. 2024-09-06T14:44:38.377 INFO:tasks.workunit.client.0.smithi052.stdout:9/148: link d1/d4/c1c d1/d4/d6/dd/d22/c2f 0 2024-09-06T14:44:38.377 INFO:tasks.workunit.client.0.smithi052.stdout:9/149: stat d1/d26 0 2024-09-06T14:44:38.378 INFO:tasks.workunit.client.1.smithi165.stdout:8/891: dwrite d0/d14/d3e/dd8/fd5 [0,4194304] 0 2024-09-06T14:44:38.379 INFO:tasks.workunit.client.1.smithi165.stdout:8/892: write d0/d34/d6b/d94/d70/fc0 [1844289,110318] 0 2024-09-06T14:44:38.382 INFO:tasks.workunit.client.1.smithi165.stdout:2/824: sync 2024-09-06T14:44:38.383 INFO:tasks.workunit.client.0.smithi052.stdout:9/150: link d1/d4/df/f24 d1/f30 0 2024-09-06T14:44:38.384 INFO:tasks.workunit.client.1.smithi165.stdout:8/893: dwrite d0/fd [4194304,4194304] 0 2024-09-06T14:44:38.387 INFO:tasks.workunit.client.0.smithi052.stdout:9/151: symlink d1/d4/d6/dd/d22/l31 0 2024-09-06T14:44:38.390 INFO:tasks.workunit.client.0.smithi052.stdout:9/152: creat d1/d4/df/f32 x:0 0 0 2024-09-06T14:44:38.391 INFO:tasks.workunit.client.0.smithi052.stdout:9/153: chown d1/d4/f7 11464 1 2024-09-06T14:44:38.393 INFO:tasks.workunit.client.0.smithi052.stdout:9/154: chown d1/d4/d6/dd/d22/f28 205818 1 2024-09-06T14:44:38.401 INFO:tasks.workunit.client.0.smithi052.stdout:9/155: dwrite d1/d4/d6/dd/d2b/f2e [0,4194304] 0 2024-09-06T14:44:38.402 INFO:tasks.workunit.client.1.smithi165.stdout:4/916: creat d5/d1b/d1c/d8c/d106/d11c/dfc/f134 x:0 0 0 2024-09-06T14:44:38.403 INFO:tasks.workunit.client.1.smithi165.stdout:5/949: symlink d6/d1c/d28/d2d/d61/dde/l158 0 2024-09-06T14:44:38.408 INFO:tasks.workunit.client.0.smithi052.stdout:7/128: sync 2024-09-06T14:44:38.409 INFO:tasks.workunit.client.1.smithi165.stdout:3/880: unlink d1/dbd/fe6 0 2024-09-06T14:44:38.411 INFO:tasks.workunit.client.1.smithi165.stdout:1/830: mkdir d0/d2a/d18/d24/d4b/d5f/d7c/d110 0 2024-09-06T14:44:38.415 INFO:tasks.workunit.client.0.smithi052.stdout:7/129: dwrite d11/d1c/d24/f25 [0,4194304] 0 2024-09-06T14:44:38.416 INFO:tasks.workunit.client.0.smithi052.stdout:7/130: read - d11/d1c/f27 zero size 2024-09-06T14:44:38.419 INFO:tasks.workunit.client.1.smithi165.stdout:8/894: unlink d0/d19/f95 0 2024-09-06T14:44:38.421 INFO:tasks.workunit.client.0.smithi052.stdout:7/131: creat d11/f2c x:0 0 0 2024-09-06T14:44:38.422 INFO:tasks.workunit.client.1.smithi165.stdout:7/732: mknod d20/d3b/d69/d88/d80/cea 0 2024-09-06T14:44:38.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/132: creat d11/d1c/d24/f2d x:0 0 0 2024-09-06T14:44:38.426 INFO:tasks.workunit.client.1.smithi165.stdout:0/804: fsync d15/d19/d28/f67 0 2024-09-06T14:44:38.427 INFO:tasks.workunit.client.0.smithi052.stdout:7/133: creat d11/d1c/d26/f2e x:0 0 0 2024-09-06T14:44:38.428 INFO:tasks.workunit.client.1.smithi165.stdout:7/733: dwrite d20/d65/f61 [0,4194304] 0 2024-09-06T14:44:38.429 INFO:tasks.workunit.client.1.smithi165.stdout:1/831: readlink d0/lf3 0 2024-09-06T14:44:38.430 INFO:tasks.workunit.client.0.smithi052.stdout:7/134: symlink d11/d1c/l2f 0 2024-09-06T14:44:38.435 INFO:tasks.workunit.client.1.smithi165.stdout:8/895: mkdir d0/d19/d36/d2d/d33/d3a/d46/d49/d13b 0 2024-09-06T14:44:38.438 INFO:tasks.workunit.client.1.smithi165.stdout:4/917: rename d5/d1b/d116 to d5/d1b/d1c/db0/d135 0 2024-09-06T14:44:38.439 INFO:tasks.workunit.client.0.smithi052.stdout:7/135: dwrite d11/f21 [0,4194304] 0 2024-09-06T14:44:38.441 INFO:tasks.workunit.client.1.smithi165.stdout:5/950: chown d6/d1c/d28/d2d/d3c/d44/d90/ddf/df6/ff0 3015535 1 2024-09-06T14:44:38.442 INFO:tasks.workunit.client.1.smithi165.stdout:6/908: creat d29/d6a/f123 x:0 0 0 2024-09-06T14:44:38.444 INFO:tasks.workunit.client.0.smithi052.stdout:7/136: symlink d11/d1c/d26/l30 0 2024-09-06T14:44:38.446 INFO:tasks.workunit.client.1.smithi165.stdout:3/881: symlink d1/da/dc/d3b/dc6/l123 0 2024-09-06T14:44:38.447 INFO:tasks.workunit.client.1.smithi165.stdout:5/951: dwrite d6/d1c/d28/d2d/d3c/d44/d90/fb3 [0,4194304] 0 2024-09-06T14:44:38.447 INFO:tasks.workunit.client.1.smithi165.stdout:3/882: readlink d1/da/dd/d8c/l122 0 2024-09-06T14:44:38.448 INFO:tasks.workunit.client.1.smithi165.stdout:5/952: write d6/d1c/d64/f12b [853368,47605] 0 2024-09-06T14:44:38.449 INFO:tasks.workunit.client.1.smithi165.stdout:9/960: link db/de/d15/d7f/d9b/c41 db/de/d15/d7f/d9b/d6c/daf/de6/c134 0 2024-09-06T14:44:38.451 INFO:tasks.workunit.client.0.smithi052.stdout:7/137: rename d11/l13 to d11/d1c/d26/l31 0 2024-09-06T14:44:38.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/138: read - d11/f23 zero size 2024-09-06T14:44:38.452 INFO:tasks.workunit.client.1.smithi165.stdout:7/734: rmdir d20/d65/d82 39 2024-09-06T14:44:38.453 INFO:tasks.workunit.client.0.smithi052.stdout:7/139: read d11/f21 [1507224,8928] 0 2024-09-06T14:44:38.453 INFO:tasks.workunit.client.0.smithi052.stdout:7/140: dread - d11/f23 zero size 2024-09-06T14:44:38.455 INFO:tasks.workunit.client.1.smithi165.stdout:8/896: creat d0/d10a/f13c x:0 0 0 2024-09-06T14:44:38.457 INFO:tasks.workunit.client.1.smithi165.stdout:4/918: chown d5/d1b/d1c/d41/ffb 127 1 2024-09-06T14:44:38.461 INFO:tasks.workunit.client.1.smithi165.stdout:6/909: dread d29/d32/f50 [0,4194304] 0 2024-09-06T14:44:38.462 INFO:tasks.workunit.client.0.smithi052.stdout:7/141: truncate d11/f12 2116039 0 2024-09-06T14:44:38.462 INFO:tasks.workunit.client.1.smithi165.stdout:6/910: read d29/d39/d5b/d68/f91 [758911,52991] 0 2024-09-06T14:44:38.465 INFO:tasks.workunit.client.0.smithi052.stdout:7/142: rmdir d11/d1c/d24 39 2024-09-06T14:44:38.469 INFO:tasks.workunit.client.1.smithi165.stdout:1/832: symlink d0/d2a/d18/d24/d4b/d93/d68/dae/l111 0 2024-09-06T14:44:38.470 INFO:tasks.workunit.client.1.smithi165.stdout:8/897: mknod d0/d34/d6b/d94/d70/db8/d11c/c13d 0 2024-09-06T14:44:38.474 INFO:tasks.workunit.client.0.smithi052.stdout:7/143: creat d11/d1c/f32 x:0 0 0 2024-09-06T14:44:38.474 INFO:tasks.workunit.client.0.smithi052.stdout:9/156: dwrite d1/fa [0,4194304] 0 2024-09-06T14:44:38.476 INFO:tasks.workunit.client.1.smithi165.stdout:6/911: fdatasync d29/d39/d5b/d62/d94/db7/dba/f11a 0 2024-09-06T14:44:38.477 INFO:tasks.workunit.client.1.smithi165.stdout:6/912: dread - d29/d6a/d83/d89/ddb/f115 zero size 2024-09-06T14:44:38.478 INFO:tasks.workunit.client.0.smithi052.stdout:7/144: write d11/d1c/d24/f29 [753862,2125] 0 2024-09-06T14:44:38.479 INFO:tasks.workunit.client.0.smithi052.stdout:7/145: dread - d11/d1c/f27 zero size 2024-09-06T14:44:38.480 INFO:tasks.workunit.client.0.smithi052.stdout:9/157: dread d1/d4/d6/dd/d2b/f2e [0,4194304] 0 2024-09-06T14:44:38.487 INFO:tasks.workunit.client.1.smithi165.stdout:1/833: rename d0/d2a/d23/c5c to d0/dc8/c112 0 2024-09-06T14:44:38.489 INFO:tasks.workunit.client.1.smithi165.stdout:8/898: rmdir d0/d19/d36 39 2024-09-06T14:44:38.489 INFO:tasks.workunit.client.0.smithi052.stdout:9/158: dwrite d1/d4/df/f32 [0,4194304] 0 2024-09-06T14:44:38.490 INFO:tasks.workunit.client.0.smithi052.stdout:7/146: dwrite d11/d1c/f27 [0,4194304] 0 2024-09-06T14:44:38.493 INFO:tasks.workunit.client.0.smithi052.stdout:5/59: sync 2024-09-06T14:44:38.493 INFO:tasks.workunit.client.0.smithi052.stdout:9/159: read d1/d4/f5 [55091,18720] 0 2024-09-06T14:44:38.494 INFO:tasks.workunit.client.1.smithi165.stdout:2/825: truncate d9/d25/d45/f63 3402974 0 2024-09-06T14:44:38.495 INFO:tasks.workunit.client.0.smithi052.stdout:5/60: write d2/ff [559457,8822] 0 2024-09-06T14:44:38.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/160: chown d1/d4/f9 2 1 2024-09-06T14:44:38.496 INFO:tasks.workunit.client.0.smithi052.stdout:5/61: chown d2/fd 11 1 2024-09-06T14:44:38.497 INFO:tasks.workunit.client.0.smithi052.stdout:5/62: readlink d2/la 0 2024-09-06T14:44:38.497 INFO:tasks.workunit.client.0.smithi052.stdout:7/147: stat d11/d1c/c22 0 2024-09-06T14:44:38.497 INFO:tasks.workunit.client.0.smithi052.stdout:9/161: readlink d1/d4/d6/dc/l14 0 2024-09-06T14:44:38.498 INFO:tasks.workunit.client.1.smithi165.stdout:6/913: mknod d29/d39/d5b/d62/d9f/d10a/c124 0 2024-09-06T14:44:38.499 INFO:tasks.workunit.client.0.smithi052.stdout:7/148: write d11/d1c/f2a [88085,129487] 0 2024-09-06T14:44:38.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/162: stat d1/d4/df/c1d 0 2024-09-06T14:44:38.504 INFO:tasks.workunit.client.1.smithi165.stdout:5/953: creat d6/d1c/d28/d4b/d55/d8a/f159 x:0 0 0 2024-09-06T14:44:38.504 INFO:tasks.workunit.client.1.smithi165.stdout:9/961: link db/de/d15/d17/d72/da3/l11a db/de/d15/d7f/dbc/ddf/l135 0 2024-09-06T14:44:38.504 INFO:tasks.workunit.client.1.smithi165.stdout:0/805: write d15/f1f [336116,65899] 0 2024-09-06T14:44:38.505 INFO:tasks.workunit.client.0.smithi052.stdout:5/63: symlink d2/l15 0 2024-09-06T14:44:38.506 INFO:tasks.workunit.client.0.smithi052.stdout:5/64: write d2/f6 [1281197,38185] 0 2024-09-06T14:44:38.507 INFO:tasks.workunit.client.1.smithi165.stdout:7/735: creat d20/d33/feb x:0 0 0 2024-09-06T14:44:38.507 INFO:tasks.workunit.client.0.smithi052.stdout:5/65: dread - d2/f11 zero size 2024-09-06T14:44:38.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/163: dread d1/d4/d6/dd/d22/f28 [0,4194304] 0 2024-09-06T14:44:38.509 INFO:tasks.workunit.client.0.smithi052.stdout:5/66: write d2/f13 [766313,44425] 0 2024-09-06T14:44:38.509 INFO:tasks.workunit.client.0.smithi052.stdout:9/164: stat d1/d4/df/f32 0 2024-09-06T14:44:38.509 INFO:tasks.workunit.client.0.smithi052.stdout:5/67: readlink d2/la 0 2024-09-06T14:44:38.512 INFO:tasks.workunit.client.1.smithi165.stdout:3/883: write d1/da/dc/fe5 [241172,122173] 0 2024-09-06T14:44:38.514 INFO:tasks.workunit.client.1.smithi165.stdout:2/826: dread d9/d25/d45/d75/d67/d76/f30 [0,4194304] 0 2024-09-06T14:44:38.514 INFO:tasks.workunit.client.1.smithi165.stdout:6/914: symlink d29/d6a/d83/d89/l125 0 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 -- 172.21.15.52:0/2597127782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8102b70 msgr2=0x7fece8102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 --2- 172.21.15.52:0/2597127782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8102b70 0x7fece8102ff0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009880 tx=0x7fecdc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 -- 172.21.15.52:0/2597127782 shutdown_connections 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 --2- 172.21.15.52:0/2597127782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8102b70 0x7fece8102ff0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 --2- 172.21.15.52:0/2597127782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8101970 0x7fece8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 -- 172.21.15.52:0/2597127782 >> 172.21.15.52:0/2597127782 conn(0x7fece80fd140 msgr2=0x7fece80ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 -- 172.21.15.52:0/2597127782 shutdown_connections 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.517+0000 7fecedeac640 1 -- 172.21.15.52:0/2597127782 wait complete. 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.518+0000 7fecedeac640 1 Processor -- start 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.518+0000 7fecedeac640 1 -- start start 2024-09-06T14:44:38.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.518+0000 7fecedeac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8101970 0x7fece819db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:38.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.518+0000 7fecedeac640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8102b70 0x7fece819e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:38.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.518+0000 7fecedeac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fece810a830 con 0x7fece8101970 2024-09-06T14:44:38.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.518+0000 7fecedeac640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fece810a6b0 con 0x7fece8102b70 2024-09-06T14:44:38.517 INFO:tasks.workunit.client.1.smithi165.stdout:9/962: mknod db/d40/c136 0 2024-09-06T14:44:38.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8102b70 0x7fece819e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8101970 0x7fece819db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece6ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8102b70 0x7fece819e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:54766/0 (socket says 172.21.15.52:54766) 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece6ffd640 1 -- 172.21.15.52:0/1355117829 learned_addr learned my addr 172.21.15.52:0/1355117829 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece6ffd640 1 -- 172.21.15.52:0/1355117829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8101970 msgr2=0x7fece819db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece6ffd640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8101970 0x7fece819db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece6ffd640 1 -- 172.21.15.52:0/1355117829 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece819e6d0 con 0x7fece8102b70 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.519+0000 7fece6ffd640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8102b70 0x7fece819e050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009230 tx=0x7fecdc032b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.520+0000 7fece4ff9640 1 -- 172.21.15.52:0/1355117829 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fecdc035030 con 0x7fece8102b70 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.520+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece81a30b0 con 0x7fece8102b70 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.520+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece81a36c0 con 0x7fece8102b70 2024-09-06T14:44:38.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.520+0000 7fece4ff9640 1 -- 172.21.15.52:0/1355117829 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fecdc0044d0 con 0x7fece8102b70 2024-09-06T14:44:38.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.520+0000 7fece4ff9640 1 -- 172.21.15.52:0/1355117829 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fecdc04a060 con 0x7fece8102b70 2024-09-06T14:44:38.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.521+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd40052c0 con 0x7fece8102b70 2024-09-06T14:44:38.520 INFO:tasks.workunit.client.1.smithi165.stdout:4/919: dwrite d5/d1b/d1c/d20/d75/d83/f62 [0,4194304] 0 2024-09-06T14:44:38.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.522+0000 7fece4ff9640 1 -- 172.21.15.52:0/1355117829 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7fecdc003b50 con 0x7fece8102b70 2024-09-06T14:44:38.521 INFO:tasks.workunit.client.1.smithi165.stdout:4/920: write d5/d1b/d1c/d20/d75/d83/f12c [988947,118302] 0 2024-09-06T14:44:38.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.524+0000 7fece4ff9640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fecd0072b10 0x7fecd0074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:38.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.524+0000 7fece4ff9640 1 -- 172.21.15.52:0/1355117829 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fecdc0b4310 con 0x7fece8102b70 2024-09-06T14:44:38.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.525+0000 7fece77fe640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fecd0072b10 0x7fecd0074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:38.523 INFO:tasks.workunit.client.1.smithi165.stdout:5/954: mknod d6/d1c/d28/d4b/d55/d8a/dda/de3/c15a 0 2024-09-06T14:44:38.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.527+0000 7fece77fe640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fecd0072b10 0x7fecd0074fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fece81029d0 tx=0x7fecd8009110 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:38.524 INFO:tasks.workunit.client.0.smithi052.stdout:5/68: creat d2/f16 x:0 0 0 2024-09-06T14:44:38.525 INFO:tasks.workunit.client.0.smithi052.stdout:5/69: dread - d2/f11 zero size 2024-09-06T14:44:38.529 INFO:tasks.workunit.client.1.smithi165.stdout:1/834: mknod d0/d1c/c113 0 2024-09-06T14:44:38.529 INFO:tasks.workunit.client.1.smithi165.stdout:7/736: dread d20/d4d/d54/fb7 [0,4194304] 0 2024-09-06T14:44:38.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.532+0000 7fece4ff9640 1 -- 172.21.15.52:0/1355117829 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fecdc041020 con 0x7fece8102b70 2024-09-06T14:44:38.530 INFO:tasks.workunit.client.1.smithi165.stdout:4/921: dwrite d5/d1b/d1c/d20/d75/d83/fb1 [0,4194304] 0 2024-09-06T14:44:38.533 INFO:tasks.workunit.client.1.smithi165.stdout:8/899: chown d0/d19/d36/l71 593376 1 2024-09-06T14:44:38.535 INFO:tasks.workunit.client.1.smithi165.stdout:3/884: creat d1/dbd/dfd/f124 x:0 0 0 2024-09-06T14:44:38.539 INFO:tasks.workunit.client.1.smithi165.stdout:6/915: write d29/d6a/d83/d89/ddb/f11e [1469519,119227] 0 2024-09-06T14:44:38.539 INFO:tasks.workunit.client.1.smithi165.stdout:6/916: stat d29/d32/c3e 0 2024-09-06T14:44:38.542 INFO:tasks.workunit.client.1.smithi165.stdout:0/806: write d15/d6e/faa [227010,18386] 0 2024-09-06T14:44:38.543 INFO:tasks.workunit.client.0.smithi052.stdout:7/149: dread d11/f14 [0,4194304] 0 2024-09-06T14:44:38.543 INFO:tasks.workunit.client.1.smithi165.stdout:0/807: dread - d15/d19/d28/d3a/d3f/ff7 zero size 2024-09-06T14:44:38.544 INFO:tasks.workunit.client.1.smithi165.stdout:0/808: write d15/d19/d66/f95 [1059098,124981] 0 2024-09-06T14:44:38.545 INFO:tasks.workunit.client.1.smithi165.stdout:0/809: chown f3 7434 1 2024-09-06T14:44:38.545 INFO:tasks.workunit.client.1.smithi165.stdout:0/810: readlink d15/d19/d38/lb6 0 2024-09-06T14:44:38.546 INFO:tasks.workunit.client.1.smithi165.stdout:0/811: readlink d15/d19/d38/lb6 0 2024-09-06T14:44:38.547 INFO:tasks.workunit.client.0.smithi052.stdout:7/150: mknod d11/d1c/d24/c33 0 2024-09-06T14:44:38.548 INFO:tasks.workunit.client.1.smithi165.stdout:3/885: symlink d1/d4a/dc7/l125 0 2024-09-06T14:44:38.550 INFO:tasks.workunit.client.0.smithi052.stdout:9/165: dwrite d1/d4/df/f24 [0,4194304] 0 2024-09-06T14:44:38.553 INFO:tasks.workunit.client.1.smithi165.stdout:1/835: dread d0/f14 [0,4194304] 0 2024-09-06T14:44:38.553 INFO:tasks.workunit.client.1.smithi165.stdout:6/917: creat d29/d93/d87/f126 x:0 0 0 2024-09-06T14:44:38.555 INFO:tasks.workunit.client.0.smithi052.stdout:9/166: rmdir d1/d4/d6/dd 39 2024-09-06T14:44:38.555 INFO:tasks.workunit.client.1.smithi165.stdout:1/836: write d0/d1c/d41/f5e [862149,88574] 0 2024-09-06T14:44:38.558 INFO:tasks.workunit.client.1.smithi165.stdout:6/918: read d29/d6a/d83/d89/f100 [536794,130009] 0 2024-09-06T14:44:38.559 INFO:tasks.workunit.client.0.smithi052.stdout:5/70: truncate f1 1685066 0 2024-09-06T14:44:38.560 INFO:tasks.workunit.client.1.smithi165.stdout:7/737: symlink d20/d65/d82/lec 0 2024-09-06T14:44:38.562 INFO:tasks.workunit.client.1.smithi165.stdout:8/900: symlink d0/d19/d24/db1/d5b/d125/d12b/l13e 0 2024-09-06T14:44:38.562 INFO:tasks.workunit.client.1.smithi165.stdout:7/738: write d20/d3b/d69/d88/f58 [4449778,46913] 0 2024-09-06T14:44:38.563 INFO:tasks.workunit.client.0.smithi052.stdout:7/151: creat d11/d1c/f34 x:0 0 0 2024-09-06T14:44:38.564 INFO:tasks.workunit.client.0.smithi052.stdout:7/152: write d11/d1c/f34 [426695,88059] 0 2024-09-06T14:44:38.567 INFO:tasks.workunit.client.1.smithi165.stdout:0/812: creat d15/d19/d50/d53/d57/f109 x:0 0 0 2024-09-06T14:44:38.568 INFO:tasks.workunit.client.0.smithi052.stdout:5/71: mknod d2/c17 0 2024-09-06T14:44:38.568 INFO:tasks.workunit.client.1.smithi165.stdout:3/886: mkdir d1/da/d43/d126 0 2024-09-06T14:44:38.568 INFO:tasks.workunit.client.1.smithi165.stdout:3/887: dread - d1/da/dc/d3b/d71/d109/f11d zero size 2024-09-06T14:44:38.569 INFO:tasks.workunit.client.0.smithi052.stdout:9/167: dread d1/d4/d6/dd/d22/f28 [0,4194304] 0 2024-09-06T14:44:38.573 INFO:tasks.workunit.client.0.smithi052.stdout:5/72: rename d2/fb to d2/f18 0 2024-09-06T14:44:38.573 INFO:tasks.workunit.client.1.smithi165.stdout:5/955: creat d6/d1c/f15b x:0 0 0 2024-09-06T14:44:38.574 INFO:tasks.workunit.client.1.smithi165.stdout:5/956: chown d6/d1c/d28/d4b/fbf 783733189 1 2024-09-06T14:44:38.578 INFO:tasks.workunit.client.0.smithi052.stdout:9/168: dread d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:38.580 INFO:tasks.workunit.client.0.smithi052.stdout:9/169: chown d1/d4/d6/dc/d10/d18/c27 258 1 2024-09-06T14:44:38.582 INFO:tasks.workunit.client.1.smithi165.stdout:1/837: rename d0/d1c/d41/de3/fe7 to d0/d1c/d1d/d22/f114 0 2024-09-06T14:44:38.583 INFO:tasks.workunit.client.1.smithi165.stdout:1/838: chown d0/d2a/d18/d24/d4b/d93/d68 6974 1 2024-09-06T14:44:38.588 INFO:tasks.workunit.client.1.smithi165.stdout:1/839: dwrite d0/d2a/d18/f43 [0,4194304] 0 2024-09-06T14:44:38.591 INFO:tasks.workunit.client.1.smithi165.stdout:8/901: fdatasync d0/d5e/d65/fc7 0 2024-09-06T14:44:38.595 INFO:tasks.workunit.client.0.smithi052.stdout:7/153: dwrite f5 [0,4194304] 0 2024-09-06T14:44:38.597 INFO:tasks.workunit.client.0.smithi052.stdout:7/154: write d11/d1c/d26/f2b [5172497,4397] 0 2024-09-06T14:44:38.598 INFO:tasks.workunit.client.1.smithi165.stdout:2/827: getdents d9/d25/d46/ddd 0 2024-09-06T14:44:38.601 INFO:tasks.workunit.client.1.smithi165.stdout:6/919: write f1e [2974358,56027] 0 2024-09-06T14:44:38.603 INFO:tasks.workunit.client.0.smithi052.stdout:5/73: getdents d2 0 2024-09-06T14:44:38.605 INFO:tasks.workunit.client.1.smithi165.stdout:0/813: rename d15/fbe to d15/d19/d66/df8/dfd/f10a 0 2024-09-06T14:44:38.606 INFO:tasks.workunit.client.1.smithi165.stdout:0/814: write d15/d19/d28/d4f/f9b [2310543,76687] 0 2024-09-06T14:44:38.608 INFO:tasks.workunit.client.0.smithi052.stdout:7/155: stat ce 0 2024-09-06T14:44:38.608 INFO:tasks.workunit.client.1.smithi165.stdout:0/815: write d15/d19/d50/d53/d7c/dae/ff0 [728131,57671] 0 2024-09-06T14:44:38.608 INFO:tasks.workunit.client.0.smithi052.stdout:9/170: getdents d1/d4/d6/dc 0 2024-09-06T14:44:38.609 INFO:tasks.workunit.client.0.smithi052.stdout:7/156: read d11/d1c/d26/f2b [3326084,29946] 0 2024-09-06T14:44:38.609 INFO:tasks.workunit.client.1.smithi165.stdout:7/739: truncate f1f 5969752 0 2024-09-06T14:44:38.610 INFO:tasks.workunit.client.1.smithi165.stdout:7/740: write d20/d3b/d8c/fe5 [356036,85175] 0 2024-09-06T14:44:38.610 INFO:tasks.workunit.client.0.smithi052.stdout:5/74: mknod d2/c19 0 2024-09-06T14:44:38.611 INFO:tasks.workunit.client.0.smithi052.stdout:9/171: write d1/d4/d6/dd/f21 [2432000,116029] 0 2024-09-06T14:44:38.611 INFO:tasks.workunit.client.1.smithi165.stdout:1/840: dread d0/d2a/d18/d24/d4b/d93/d6a/fac [0,4194304] 0 2024-09-06T14:44:38.612 INFO:tasks.workunit.client.0.smithi052.stdout:5/75: truncate d2/ff 813303 0 2024-09-06T14:44:38.616 INFO:tasks.workunit.client.0.smithi052.stdout:7/157: unlink d11/d1c/f2a 0 2024-09-06T14:44:38.617 INFO:tasks.workunit.client.1.smithi165.stdout:3/888: fsync d1/da/f2a 0 2024-09-06T14:44:38.619 INFO:tasks.workunit.client.0.smithi052.stdout:9/172: dwrite d1/d4/f9 [0,4194304] 0 2024-09-06T14:44:38.619 INFO:tasks.workunit.client.1.smithi165.stdout:5/957: mkdir d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d155/d15c 0 2024-09-06T14:44:38.620 INFO:tasks.workunit.client.1.smithi165.stdout:5/958: write d6/d1c/d28/d4b/da7/f121 [152767,114475] 0 2024-09-06T14:44:38.621 INFO:tasks.workunit.client.0.smithi052.stdout:5/76: mkdir d2/d1a 0 2024-09-06T14:44:38.623 INFO:tasks.workunit.client.1.smithi165.stdout:6/920: creat d29/d39/d5b/d62/d94/db7/dcc/f127 x:0 0 0 2024-09-06T14:44:38.623 INFO:tasks.workunit.client.1.smithi165.stdout:6/921: stat d29/d6a/d83/dc8 0 2024-09-06T14:44:38.626 INFO:tasks.workunit.client.0.smithi052.stdout:7/158: unlink f7 0 2024-09-06T14:44:38.627 INFO:tasks.workunit.client.0.smithi052.stdout:7/159: chown d11/l15 24509789 1 2024-09-06T14:44:38.628 INFO:tasks.workunit.client.1.smithi165.stdout:1/841: dread d0/d2a/d18/d24/d4b/d5f/f61 [0,4194304] 0 2024-09-06T14:44:38.630 INFO:tasks.workunit.client.1.smithi165.stdout:6/922: dwrite d29/d6a/f123 [0,4194304] 0 2024-09-06T14:44:38.632 INFO:tasks.workunit.client.1.smithi165.stdout:0/816: mkdir d15/d19/d50/d53/d8d/d10b 0 2024-09-06T14:44:38.632 INFO:tasks.workunit.client.0.smithi052.stdout:4/150: sync 2024-09-06T14:44:38.632 INFO:tasks.workunit.client.0.smithi052.stdout:6/81: sync 2024-09-06T14:44:38.633 INFO:tasks.workunit.client.1.smithi165.stdout:6/923: dread - d29/d39/d5b/d62/d94/db7/dcc/fff zero size 2024-09-06T14:44:38.633 INFO:tasks.workunit.client.1.smithi165.stdout:8/902: write d0/d19/d36/f2e [2398346,127149] 0 2024-09-06T14:44:38.633 INFO:tasks.workunit.client.0.smithi052.stdout:6/82: truncate d2/f17 714271 0 2024-09-06T14:44:38.634 INFO:tasks.workunit.client.1.smithi165.stdout:6/924: write d29/d32/fc1 [886119,65309] 0 2024-09-06T14:44:38.634 INFO:tasks.workunit.client.1.smithi165.stdout:7/741: mkdir d20/d4d/d54/ded 0 2024-09-06T14:44:38.634 INFO:tasks.workunit.client.1.smithi165.stdout:8/903: fsync d0/d19/d36/d28/dda/f118 0 2024-09-06T14:44:38.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/160: creat d11/d1c/d24/f35 x:0 0 0 2024-09-06T14:44:38.640 INFO:tasks.workunit.client.0.smithi052.stdout:5/77: creat d2/d1a/f1b x:0 0 0 2024-09-06T14:44:38.643 INFO:tasks.workunit.client.1.smithi165.stdout:2/828: mkdir d9/d25/dfd/d113 0 2024-09-06T14:44:38.644 INFO:tasks.workunit.client.0.smithi052.stdout:6/83: fsync d2/dd/f10 0 2024-09-06T14:44:38.645 INFO:tasks.workunit.client.0.smithi052.stdout:6/84: write d2/f12 [216790,129754] 0 2024-09-06T14:44:38.646 INFO:tasks.workunit.client.1.smithi165.stdout:3/889: mknod d1/d19/d92/de0/c127 0 2024-09-06T14:44:38.650 INFO:tasks.workunit.client.0.smithi052.stdout:5/78: unlink d2/c19 0 2024-09-06T14:44:38.653 INFO:tasks.workunit.client.0.smithi052.stdout:4/151: mkdir d9/d10/d17/d39/d3a 0 2024-09-06T14:44:38.654 INFO:tasks.workunit.client.1.smithi165.stdout:0/817: creat d15/d19/d28/d9e/da3/f10c x:0 0 0 2024-09-06T14:44:38.654 INFO:tasks.workunit.client.0.smithi052.stdout:4/152: fsync d9/f2e 0 2024-09-06T14:44:38.657 INFO:tasks.workunit.client.0.smithi052.stdout:5/79: dwrite d2/fd [0,4194304] 0 2024-09-06T14:44:38.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/161: symlink d11/d1c/l36 0 2024-09-06T14:44:38.665 INFO:tasks.workunit.client.0.smithi052.stdout:9/173: getdents d1/d4/d6/dd/d22 0 2024-09-06T14:44:38.666 INFO:tasks.workunit.client.0.smithi052.stdout:9/174: write d1/d4/d6/f16 [22371,4564] 0 2024-09-06T14:44:38.671 INFO:tasks.workunit.client.1.smithi165.stdout:6/925: unlink d29/d39/ca2 0 2024-09-06T14:44:38.672 INFO:tasks.workunit.client.0.smithi052.stdout:4/153: mknod d9/d2d/c3b 0 2024-09-06T14:44:38.673 INFO:tasks.workunit.client.0.smithi052.stdout:9/175: dwrite d1/d4/f9 [4194304,4194304] 0 2024-09-06T14:44:38.673 INFO:tasks.workunit.client.0.smithi052.stdout:5/80: chown d2/f12 7 1 2024-09-06T14:44:38.674 INFO:tasks.workunit.client.1.smithi165.stdout:5/959: unlink d6/d1c/d28/d4b/l96 0 2024-09-06T14:44:38.675 INFO:tasks.workunit.client.0.smithi052.stdout:5/81: stat d2/lc 0 2024-09-06T14:44:38.675 INFO:tasks.workunit.client.0.smithi052.stdout:9/176: readlink d1/d4/d6/dc/d10/l2d 0 2024-09-06T14:44:38.676 INFO:tasks.workunit.client.0.smithi052.stdout:9/177: fdatasync d1/d4/d6/f16 0 2024-09-06T14:44:38.677 INFO:tasks.workunit.client.0.smithi052.stdout:7/162: rename d11/f12 to d11/d1c/d24/f37 0 2024-09-06T14:44:38.679 INFO:tasks.workunit.client.0.smithi052.stdout:6/85: creat d2/dd/d18/f1a x:0 0 0 2024-09-06T14:44:38.680 INFO:tasks.workunit.client.1.smithi165.stdout:0/818: dread d15/d19/d28/d3a/f86 [0,4194304] 0 2024-09-06T14:44:38.683 INFO:tasks.workunit.client.1.smithi165.stdout:8/904: mkdir d0/d19/d36/d2d/d3f/d13f 0 2024-09-06T14:44:38.684 INFO:tasks.workunit.client.0.smithi052.stdout:4/154: creat d9/d10/d19/f3c x:0 0 0 2024-09-06T14:44:38.684 INFO:tasks.workunit.client.0.smithi052.stdout:0/227: sync 2024-09-06T14:44:38.684 INFO:tasks.workunit.client.0.smithi052.stdout:8/197: sync 2024-09-06T14:44:38.684 INFO:tasks.workunit.client.0.smithi052.stdout:2/203: sync 2024-09-06T14:44:38.684 INFO:tasks.workunit.client.0.smithi052.stdout:3/290: sync 2024-09-06T14:44:38.684 INFO:tasks.workunit.client.0.smithi052.stdout:1/277: sync 2024-09-06T14:44:38.688 INFO:tasks.workunit.client.0.smithi052.stdout:5/82: creat d2/d1a/f1c x:0 0 0 2024-09-06T14:44:38.688 INFO:tasks.workunit.client.1.smithi165.stdout:3/890: dread d1/d19/f59 [0,4194304] 0 2024-09-06T14:44:38.689 INFO:tasks.workunit.client.1.smithi165.stdout:2/829: truncate d9/d23/d29/d48/fc3 856133 0 2024-09-06T14:44:38.690 INFO:tasks.workunit.client.0.smithi052.stdout:0/228: write d0/d1a/d26/d3a/d14/d20/f2f [1354273,95193] 0 2024-09-06T14:44:38.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/229: write d0/d3d/f47 [946233,31205] 0 2024-09-06T14:44:38.692 INFO:tasks.workunit.client.1.smithi165.stdout:6/926: creat d29/d39/d5b/d68/db3/f128 x:0 0 0 2024-09-06T14:44:38.694 INFO:tasks.workunit.client.0.smithi052.stdout:4/155: dwrite d9/f35 [0,4194304] 0 2024-09-06T14:44:38.695 INFO:tasks.workunit.client.1.smithi165.stdout:1/842: write d0/d2a/d18/d24/d4b/d5f/d7c/f92 [187164,20461] 0 2024-09-06T14:44:38.696 INFO:tasks.workunit.client.1.smithi165.stdout:1/843: dread - d0/d2a/d18/d24/d4b/d93/d97/ff6 zero size 2024-09-06T14:44:38.698 INFO:tasks.workunit.client.1.smithi165.stdout:5/960: creat d6/d98/dd7/f15d x:0 0 0 2024-09-06T14:44:38.700 INFO:tasks.workunit.client.0.smithi052.stdout:9/178: unlink d1/d4/d6/dc/c25 0 2024-09-06T14:44:38.706 INFO:tasks.workunit.client.0.smithi052.stdout:2/204: creat da/db/f45 x:0 0 0 2024-09-06T14:44:38.707 INFO:tasks.workunit.client.0.smithi052.stdout:6/86: dwrite d2/fb [0,4194304] 0 2024-09-06T14:44:38.708 INFO:tasks.workunit.client.0.smithi052.stdout:2/205: readlink da/db/d18/l41 0 2024-09-06T14:44:38.710 INFO:tasks.workunit.client.0.smithi052.stdout:3/291: creat d0/d11/d15/f4e x:0 0 0 2024-09-06T14:44:38.711 INFO:tasks.workunit.client.1.smithi165.stdout:3/891: creat d1/da/dd/d8c/f128 x:0 0 0 2024-09-06T14:44:38.714 INFO:tasks.workunit.client.0.smithi052.stdout:3/292: fdatasync d0/d11/d12/f41 0 2024-09-06T14:44:38.715 INFO:tasks.workunit.client.1.smithi165.stdout:6/927: truncate d29/d39/d5b/fc5 745237 0 2024-09-06T14:44:38.716 INFO:tasks.workunit.client.0.smithi052.stdout:7/163: dwrite d11/d1c/f1f [4194304,4194304] 0 2024-09-06T14:44:38.718 INFO:tasks.workunit.client.0.smithi052.stdout:3/293: write d0/d11/d29/d35/f3a [423482,19542] 0 2024-09-06T14:44:38.718 INFO:tasks.workunit.client.0.smithi052.stdout:4/156: unlink d9/c14 0 2024-09-06T14:44:38.720 INFO:tasks.workunit.client.0.smithi052.stdout:4/157: chown c1 4920805 1 2024-09-06T14:44:38.724 INFO:tasks.workunit.client.0.smithi052.stdout:9/179: creat d1/d4/d6/dc/d10/d18/f33 x:0 0 0 2024-09-06T14:44:38.727 INFO:tasks.workunit.client.0.smithi052.stdout:2/206: mkdir da/db/d46 0 2024-09-06T14:44:38.728 INFO:tasks.workunit.client.1.smithi165.stdout:3/892: mknod d1/d4a/db4/c129 0 2024-09-06T14:44:38.728 INFO:tasks.workunit.client.0.smithi052.stdout:2/207: read da/f2f [480728,5456] 0 2024-09-06T14:44:38.729 INFO:tasks.workunit.client.1.smithi165.stdout:3/893: write d1/d7c/d7e/fc0 [297152,33207] 0 2024-09-06T14:44:38.729 INFO:tasks.workunit.client.0.smithi052.stdout:6/87: truncate d2/dd/f10 632510 0 2024-09-06T14:44:38.729 INFO:tasks.workunit.client.1.smithi165.stdout:2/830: mkdir d9/d23/d29/d48/d114 0 2024-09-06T14:44:38.730 INFO:tasks.workunit.client.1.smithi165.stdout:6/928: rmdir d29/d32/d7a 39 2024-09-06T14:44:38.732 INFO:tasks.workunit.client.0.smithi052.stdout:0/230: unlink d0/d18/c25 0 2024-09-06T14:44:38.733 INFO:tasks.workunit.client.1.smithi165.stdout:5/961: symlink d6/d1c/d28/d14a/l15e 0 2024-09-06T14:44:38.734 INFO:tasks.workunit.client.1.smithi165.stdout:0/819: link d15/d19/d28/d51/lab d15/d19/d28/d4f/da7/l10d 0 2024-09-06T14:44:38.734 INFO:tasks.workunit.client.1.smithi165.stdout:5/962: fsync d6/d1c/d28/d4b/d55/d8a/dda/f122 0 2024-09-06T14:44:38.739 INFO:tasks.workunit.client.0.smithi052.stdout:4/158: creat d9/d10/d17/f3d x:0 0 0 2024-09-06T14:44:38.739 INFO:tasks.workunit.client.1.smithi165.stdout:8/905: write d0/d19/d36/fe [89490,63465] 0 2024-09-06T14:44:38.745 INFO:tasks.workunit.client.1.smithi165.stdout:6/929: rename d29/d39/d5b/d62/d67/l82 to d29/d6a/d83/l129 0 2024-09-06T14:44:38.746 INFO:tasks.workunit.client.0.smithi052.stdout:5/83: truncate d2/fd 3667327 0 2024-09-06T14:44:38.746 INFO:tasks.workunit.client.1.smithi165.stdout:6/930: readlink d29/d39/d5b/d68/l11b 0 2024-09-06T14:44:38.747 INFO:tasks.workunit.client.0.smithi052.stdout:5/84: write d2/f6 [4229017,93109] 0 2024-09-06T14:44:38.748 INFO:tasks.workunit.client.1.smithi165.stdout:0/820: creat d15/d19/d28/d9e/da3/f10e x:0 0 0 2024-09-06T14:44:38.749 INFO:tasks.workunit.client.0.smithi052.stdout:5/85: write d2/f11 [282964,43488] 0 2024-09-06T14:44:38.749 INFO:tasks.workunit.client.1.smithi165.stdout:3/894: dread d1/d19/d92/fcd [0,4194304] 0 2024-09-06T14:44:38.750 INFO:tasks.workunit.client.0.smithi052.stdout:6/88: symlink d2/l1b 0 2024-09-06T14:44:38.750 INFO:tasks.workunit.client.0.smithi052.stdout:5/86: dread - d2/d1a/f1c zero size 2024-09-06T14:44:38.751 INFO:tasks.workunit.client.1.smithi165.stdout:9/963: sync 2024-09-06T14:44:38.751 INFO:tasks.workunit.client.1.smithi165.stdout:7/742: sync 2024-09-06T14:44:38.751 INFO:tasks.workunit.client.1.smithi165.stdout:4/922: sync 2024-09-06T14:44:38.752 INFO:tasks.workunit.client.1.smithi165.stdout:5/963: mkdir d6/d1c/d28/d2d/d61/dde/dff/d15f 0 2024-09-06T14:44:38.754 INFO:tasks.workunit.client.0.smithi052.stdout:7/164: rename d11/d1c/d24/f37 to d11/d1c/d24/f38 0 2024-09-06T14:44:38.754 INFO:tasks.workunit.client.0.smithi052.stdout:5/87: dread d2/f11 [0,4194304] 0 2024-09-06T14:44:38.754 INFO:tasks.workunit.client.0.smithi052.stdout:7/165: fsync d11/f2c 0 2024-09-06T14:44:38.755 INFO:tasks.workunit.client.1.smithi165.stdout:1/844: getdents d0 0 2024-09-06T14:44:38.756 INFO:tasks.workunit.client.1.smithi165.stdout:8/906: dread d0/d14/f1b [0,4194304] 0 2024-09-06T14:44:38.756 INFO:tasks.workunit.client.0.smithi052.stdout:8/198: getdents d6/d22/d36/d3e 0 2024-09-06T14:44:38.756 INFO:tasks.workunit.client.1.smithi165.stdout:2/831: dread d9/d25/f40 [0,4194304] 0 2024-09-06T14:44:38.758 INFO:tasks.workunit.client.1.smithi165.stdout:3/895: symlink d1/da/dd/d8c/l12a 0 2024-09-06T14:44:38.761 INFO:tasks.workunit.client.0.smithi052.stdout:6/89: unlink d2/c7 0 2024-09-06T14:44:38.762 INFO:tasks.workunit.client.1.smithi165.stdout:0/821: dread d15/f5a [0,4194304] 0 2024-09-06T14:44:38.765 INFO:tasks.workunit.client.1.smithi165.stdout:5/964: dread d6/d98/f101 [0,4194304] 0 2024-09-06T14:44:38.766 INFO:tasks.workunit.client.1.smithi165.stdout:5/965: chown d6/d1c/d28/d4b/d55/d8a/de1 0 1 2024-09-06T14:44:38.767 INFO:tasks.workunit.client.1.smithi165.stdout:5/966: chown d6/d1c/d28/d4b/d55/d8a/dda/de3/ff5 1253 1 2024-09-06T14:44:38.768 INFO:tasks.workunit.client.1.smithi165.stdout:7/743: rename d20/d3b/d69/d88/d30/cb6 to d20/d3b/cee 0 2024-09-06T14:44:38.768 INFO:tasks.workunit.client.1.smithi165.stdout:0/822: rename d15/d19/d2c/df1/d104 to d15/d19/d2c/df1/d104/d10f 22 2024-09-06T14:44:38.769 INFO:tasks.workunit.client.1.smithi165.stdout:0/823: stat d15/d19/d50/d53/d7c/dbb 0 2024-09-06T14:44:38.769 INFO:tasks.workunit.client.1.smithi165.stdout:6/931: creat d29/d39/d5b/d62/d67/d113/f12a x:0 0 0 2024-09-06T14:44:38.772 INFO:tasks.workunit.client.0.smithi052.stdout:5/88: rename d2/d1a/f1b to d2/f1d 0 2024-09-06T14:44:38.773 INFO:tasks.workunit.client.1.smithi165.stdout:8/907: rmdir d0/d19/d36/d2d/d33/d3a/d46 39 2024-09-06T14:44:38.773 INFO:tasks.workunit.client.0.smithi052.stdout:5/89: read d2/f6 [932070,116684] 0 2024-09-06T14:44:38.774 INFO:tasks.workunit.client.0.smithi052.stdout:5/90: dread - d2/f16 zero size 2024-09-06T14:44:38.774 INFO:tasks.workunit.client.0.smithi052.stdout:7/166: truncate d11/d1c/f1d 580517 0 2024-09-06T14:44:38.776 INFO:tasks.workunit.client.0.smithi052.stdout:8/199: creat d6/d9/df/f45 x:0 0 0 2024-09-06T14:44:38.777 INFO:tasks.workunit.client.1.smithi165.stdout:3/896: symlink d1/d7c/l12b 0 2024-09-06T14:44:38.778 INFO:tasks.workunit.client.0.smithi052.stdout:6/90: mknod d2/dd/c1c 0 2024-09-06T14:44:38.779 INFO:tasks.workunit.client.1.smithi165.stdout:9/964: fsync db/de/d16/f24 0 2024-09-06T14:44:38.782 INFO:tasks.workunit.client.0.smithi052.stdout:3/294: link d0/d11/d12/d17/c33 d0/d11/d12/d4c/c4f 0 2024-09-06T14:44:38.782 INFO:tasks.workunit.client.0.smithi052.stdout:8/200: dwrite d6/d9/d1f/d19/f2d [0,4194304] 0 2024-09-06T14:44:38.784 INFO:tasks.workunit.client.1.smithi165.stdout:5/967: unlink d6/d98/dd7/dd9/f10f 0 2024-09-06T14:44:38.787 INFO:tasks.workunit.client.1.smithi165.stdout:7/744: mkdir d20/d65/d82/def 0 2024-09-06T14:44:38.788 INFO:tasks.workunit.client.0.smithi052.stdout:3/295: dwrite d0/d11/d12/f47 [0,4194304] 0 2024-09-06T14:44:38.789 INFO:tasks.workunit.client.1.smithi165.stdout:0/824: read - d15/d19/d28/d3a/d5d/fb7 zero size 2024-09-06T14:44:38.791 INFO:tasks.workunit.client.1.smithi165.stdout:0/825: chown d15/d19/d28/d9e/da3/fb1 84826 1 2024-09-06T14:44:38.793 INFO:tasks.workunit.client.1.smithi165.stdout:6/932: fdatasync d29/d6a/d83/d89/fd7 0 2024-09-06T14:44:38.799 INFO:tasks.workunit.client.0.smithi052.stdout:2/208: link da/ld da/d19/l47 0 2024-09-06T14:44:38.800 INFO:tasks.workunit.client.0.smithi052.stdout:2/209: write f0 [3292539,93241] 0 2024-09-06T14:44:38.801 INFO:tasks.workunit.client.1.smithi165.stdout:2/832: creat d9/d88/db8/d101/f115 x:0 0 0 2024-09-06T14:44:38.801 INFO:tasks.workunit.client.0.smithi052.stdout:0/231: getdents d0/d1a/d26/d3a/d14/d20 0 2024-09-06T14:44:38.803 INFO:tasks.workunit.client.1.smithi165.stdout:3/897: write d1/d7c/fad [3489406,49008] 0 2024-09-06T14:44:38.809 INFO:tasks.workunit.client.1.smithi165.stdout:4/923: creat d5/d1b/d1c/d78/da9/f136 x:0 0 0 2024-09-06T14:44:38.810 INFO:tasks.workunit.client.1.smithi165.stdout:4/924: chown d5/d1b/d61/dd7/ddf/ddc 14 1 2024-09-06T14:44:38.810 INFO:tasks.workunit.client.0.smithi052.stdout:3/296: creat d0/d11/d15/f50 x:0 0 0 2024-09-06T14:44:38.810 INFO:tasks.workunit.client.0.smithi052.stdout:3/297: chown d0/fe 480558825 1 2024-09-06T14:44:38.811 INFO:tasks.workunit.client.1.smithi165.stdout:5/968: mkdir d6/d1c/d28/d160 0 2024-09-06T14:44:38.813 INFO:tasks.workunit.client.1.smithi165.stdout:7/745: mknod d20/d33/d6a/cf0 0 2024-09-06T14:44:38.814 INFO:tasks.workunit.client.0.smithi052.stdout:2/210: mknod da/db/c48 0 2024-09-06T14:44:38.815 INFO:tasks.workunit.client.1.smithi165.stdout:0/826: chown d15/d19/d28/d3a/d3f/c4a 26939 1 2024-09-06T14:44:38.817 INFO:tasks.workunit.client.0.smithi052.stdout:0/232: creat d0/d1a/d26/f4e x:0 0 0 2024-09-06T14:44:38.819 INFO:tasks.workunit.client.1.smithi165.stdout:6/933: creat d29/d39/d86/f12b x:0 0 0 2024-09-06T14:44:38.821 INFO:tasks.workunit.client.0.smithi052.stdout:8/201: dwrite d6/d9/d1f/d14/f29 [0,4194304] 0 2024-09-06T14:44:38.822 INFO:tasks.workunit.client.0.smithi052.stdout:5/91: truncate d2/fd 2552683 0 2024-09-06T14:44:38.823 INFO:tasks.workunit.client.0.smithi052.stdout:2/211: chown da/l25 56431032 1 2024-09-06T14:44:38.824 INFO:tasks.workunit.client.0.smithi052.stdout:2/212: chown da/db/c13 13748452 1 2024-09-06T14:44:38.826 INFO:tasks.workunit.client.0.smithi052.stdout:3/298: symlink d0/d11/d12/d4c/l51 0 2024-09-06T14:44:38.827 INFO:tasks.workunit.client.0.smithi052.stdout:3/299: dread - d0/d11/d15/f4e zero size 2024-09-06T14:44:38.828 INFO:tasks.workunit.client.0.smithi052.stdout:5/92: symlink d2/l1e 0 2024-09-06T14:44:38.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/233: mkdir d0/d4f 0 2024-09-06T14:44:38.833 INFO:tasks.workunit.client.0.smithi052.stdout:2/213: write da/db/d18/f33 [884267,19716] 0 2024-09-06T14:44:38.833 INFO:tasks.workunit.client.0.smithi052.stdout:3/300: dwrite d0/d11/d29/d35/f3a [0,4194304] 0 2024-09-06T14:44:38.834 INFO:tasks.workunit.client.0.smithi052.stdout:2/214: stat da/d19/f26 0 2024-09-06T14:44:38.838 INFO:tasks.workunit.client.1.smithi165.stdout:8/908: creat d0/d19/d24/db1/f140 x:0 0 0 2024-09-06T14:44:38.838 INFO:tasks.workunit.client.0.smithi052.stdout:5/93: mknod d2/c1f 0 2024-09-06T14:44:38.839 INFO:tasks.workunit.client.1.smithi165.stdout:1/845: getdents d0/d2a/d18/d24/d4b/d5f/d7c 0 2024-09-06T14:44:38.839 INFO:tasks.workunit.client.0.smithi052.stdout:5/94: write d2/f7 [3326661,108375] 0 2024-09-06T14:44:38.841 INFO:tasks.workunit.client.0.smithi052.stdout:0/234: creat d0/d18/f50 x:0 0 0 2024-09-06T14:44:38.843 INFO:tasks.workunit.client.1.smithi165.stdout:3/898: mkdir d1/da/dd/d4b/d112/d107/d12c 0 2024-09-06T14:44:38.844 INFO:tasks.workunit.client.0.smithi052.stdout:2/215: fsync da/db/f16 0 2024-09-06T14:44:38.845 INFO:tasks.workunit.client.0.smithi052.stdout:2/216: read f1 [1505273,94111] 0 2024-09-06T14:44:38.845 INFO:tasks.workunit.client.1.smithi165.stdout:8/909: dwrite d0/d19/d36/d28/d64/fdf [4194304,4194304] 0 2024-09-06T14:44:38.846 INFO:tasks.workunit.client.1.smithi165.stdout:8/910: stat d0/d14/d3e/dd8 0 2024-09-06T14:44:38.846 INFO:tasks.workunit.client.1.smithi165.stdout:8/911: chown d0/d5e/d65 1965 1 2024-09-06T14:44:38.847 INFO:tasks.workunit.client.1.smithi165.stdout:9/965: creat db/de/d15/d17/d18/d7d/f137 x:0 0 0 2024-09-06T14:44:38.849 INFO:tasks.workunit.client.0.smithi052.stdout:0/235: dwrite d0/fe [0,4194304] 0 2024-09-06T14:44:38.850 INFO:tasks.workunit.client.0.smithi052.stdout:5/95: mkdir d2/d20 0 2024-09-06T14:44:38.852 INFO:tasks.workunit.client.1.smithi165.stdout:5/969: symlink d6/d1c/d28/d88/d108/l161 0 2024-09-06T14:44:38.852 INFO:tasks.workunit.client.1.smithi165.stdout:8/912: dread d0/d14/fae [0,4194304] 0 2024-09-06T14:44:38.856 INFO:tasks.workunit.client.1.smithi165.stdout:6/934: symlink d29/d39/d5b/d62/d9f/l12c 0 2024-09-06T14:44:38.856 INFO:tasks.workunit.client.1.smithi165.stdout:6/935: stat d29/d39/d86 0 2024-09-06T14:44:38.857 INFO:tasks.workunit.client.1.smithi165.stdout:6/936: write d29/d39/d86/f12b [161188,5487] 0 2024-09-06T14:44:38.858 INFO:tasks.workunit.client.0.smithi052.stdout:2/217: creat da/d19/d3a/f49 x:0 0 0 2024-09-06T14:44:38.860 INFO:tasks.workunit.client.1.smithi165.stdout:1/846: mknod d0/d1c/dd5/c115 0 2024-09-06T14:44:38.864 INFO:tasks.workunit.client.0.smithi052.stdout:0/236: symlink d0/d1a/d26/d3a/d14/d20/d22/l51 0 2024-09-06T14:44:38.865 INFO:tasks.workunit.client.1.smithi165.stdout:9/966: fdatasync db/de/d15/d17/d18/d7d/d61/f11e 0 2024-09-06T14:44:38.866 INFO:tasks.workunit.client.1.smithi165.stdout:9/967: chown db/de/d15/d17/d18/l117 89106 1 2024-09-06T14:44:38.867 INFO:tasks.workunit.client.0.smithi052.stdout:5/96: symlink d2/l21 0 2024-09-06T14:44:38.869 INFO:tasks.workunit.client.0.smithi052.stdout:0/237: dread d0/d3d/f47 [0,4194304] 0 2024-09-06T14:44:38.870 INFO:tasks.workunit.client.0.smithi052.stdout:0/238: write d0/d1a/d26/f4e [7901,79587] 0 2024-09-06T14:44:38.872 INFO:tasks.workunit.client.1.smithi165.stdout:5/970: rename d6/d1c/d28/d2d/d49/de9/f120 to d6/d1c/d28/d4b/da7/dab/f162 0 2024-09-06T14:44:38.872 INFO:tasks.workunit.client.1.smithi165.stdout:5/971: read - d6/d98/dd7/f15d zero size 2024-09-06T14:44:38.874 INFO:tasks.workunit.client.0.smithi052.stdout:2/218: mkdir da/d2d/d34/d4a 0 2024-09-06T14:44:38.875 INFO:tasks.workunit.client.0.smithi052.stdout:3/301: truncate d0/d11/d29/f37 3538866 0 2024-09-06T14:44:38.875 INFO:tasks.workunit.client.0.smithi052.stdout:2/219: read - da/d19/f1a zero size 2024-09-06T14:44:38.877 INFO:tasks.workunit.client.0.smithi052.stdout:0/239: dwrite d0/d3d/f47 [0,4194304] 0 2024-09-06T14:44:38.878 INFO:tasks.workunit.client.0.smithi052.stdout:3/302: truncate d0/d11/d15/f43 711958 0 2024-09-06T14:44:38.879 INFO:tasks.workunit.client.1.smithi165.stdout:3/899: link d1/da/dd/d8c/dae/f114 d1/d4a/dc7/f12d 0 2024-09-06T14:44:38.879 INFO:tasks.workunit.client.0.smithi052.stdout:5/97: rmdir d2 39 2024-09-06T14:44:38.882 INFO:tasks.workunit.client.0.smithi052.stdout:2/220: mknod da/c4b 0 2024-09-06T14:44:38.883 INFO:tasks.workunit.client.1.smithi165.stdout:9/968: dread db/de/d15/d7f/d9b/d6c/f75 [0,4194304] 0 2024-09-06T14:44:38.886 INFO:tasks.workunit.client.1.smithi165.stdout:0/827: getdents d15/d19/d28/d3a 0 2024-09-06T14:44:38.886 INFO:tasks.workunit.client.0.smithi052.stdout:3/303: symlink d0/d11/d15/d1b/l52 0 2024-09-06T14:44:38.888 INFO:tasks.workunit.client.1.smithi165.stdout:3/900: dwrite d1/d19/d4d/fa5 [0,4194304] 0 2024-09-06T14:44:38.888 INFO:tasks.workunit.client.1.smithi165.stdout:0/828: chown d15/d19/l6b 1818 1 2024-09-06T14:44:38.890 INFO:tasks.workunit.client.1.smithi165.stdout:5/972: dread - d6/d1c/d28/d2d/dc0/ff9 zero size 2024-09-06T14:44:38.891 INFO:tasks.workunit.client.0.smithi052.stdout:2/221: mkdir da/db/d4c 0 2024-09-06T14:44:38.892 INFO:tasks.workunit.client.1.smithi165.stdout:9/969: dwrite db/de/d16/f127 [0,4194304] 0 2024-09-06T14:44:38.892 INFO:tasks.workunit.client.1.smithi165.stdout:8/913: truncate d0/d14/d3e/db4/f104 2030039 0 2024-09-06T14:44:38.893 INFO:tasks.workunit.client.0.smithi052.stdout:2/222: chown da/db/d18/f33 171 1 2024-09-06T14:44:38.895 INFO:tasks.workunit.client.0.smithi052.stdout:5/98: dread d2/f13 [0,4194304] 0 2024-09-06T14:44:38.896 INFO:tasks.workunit.client.0.smithi052.stdout:3/304: chown d0/d11/d29/d35/f22 209076 1 2024-09-06T14:44:38.901 INFO:tasks.workunit.client.1.smithi165.stdout:3/901: unlink d1/d7c/d98/fcf 0 2024-09-06T14:44:38.903 INFO:tasks.workunit.client.0.smithi052.stdout:5/99: mkdir d2/d1a/d22 0 2024-09-06T14:44:38.905 INFO:tasks.workunit.client.1.smithi165.stdout:0/829: mkdir d15/d19/d50/d53/d8d/d110 0 2024-09-06T14:44:38.905 INFO:tasks.workunit.client.0.smithi052.stdout:5/100: dread - d2/d1a/f1c zero size 2024-09-06T14:44:38.905 INFO:tasks.workunit.client.0.smithi052.stdout:0/240: dwrite d0/d1a/d26/d3a/d14/d20/f32 [0,4194304] 0 2024-09-06T14:44:38.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/305: truncate d0/d11/d15/d1b/f27 589196 0 2024-09-06T14:44:38.908 INFO:tasks.workunit.client.0.smithi052.stdout:2/223: dread f1 [0,4194304] 0 2024-09-06T14:44:38.908 INFO:tasks.workunit.client.0.smithi052.stdout:0/241: chown d0/d1a/d26/d3a/c17 12 1 2024-09-06T14:44:38.910 INFO:tasks.workunit.client.1.smithi165.stdout:9/970: unlink db/de/d15/d17/d18/l117 0 2024-09-06T14:44:38.913 INFO:tasks.workunit.client.1.smithi165.stdout:8/914: readlink d0/d19/d36/d2d/d33/d3a/d46/dcd/l109 0 2024-09-06T14:44:38.915 INFO:tasks.workunit.client.0.smithi052.stdout:0/242: dread d0/d1a/d26/d3a/d14/d20/f32 [0,4194304] 0 2024-09-06T14:44:38.916 INFO:tasks.workunit.client.0.smithi052.stdout:3/306: rename d0/d11/d29 to d0/d11/d12/d4c/d53 0 2024-09-06T14:44:38.920 INFO:tasks.workunit.client.0.smithi052.stdout:3/307: readlink d0/d11/d15/d1b/l39 0 2024-09-06T14:44:38.920 INFO:tasks.workunit.client.0.smithi052.stdout:5/101: dwrite d2/f13 [0,4194304] 0 2024-09-06T14:44:38.923 INFO:tasks.workunit.client.0.smithi052.stdout:5/102: write d2/d1a/f1c [827019,88567] 0 2024-09-06T14:44:38.926 INFO:tasks.workunit.client.1.smithi165.stdout:7/746: sync 2024-09-06T14:44:38.926 INFO:tasks.workunit.client.1.smithi165.stdout:2/833: sync 2024-09-06T14:44:38.926 INFO:tasks.workunit.client.0.smithi052.stdout:2/224: fsync da/d19/d3a/f3f 0 2024-09-06T14:44:38.928 INFO:tasks.workunit.client.1.smithi165.stdout:0/830: mknod d15/d55/c111 0 2024-09-06T14:44:38.929 INFO:tasks.workunit.client.1.smithi165.stdout:2/834: write d9/d23/d29/d48/fb6 [829802,44307] 0 2024-09-06T14:44:38.930 INFO:tasks.workunit.client.1.smithi165.stdout:9/971: rmdir db/de/d15/d17/d86 39 2024-09-06T14:44:38.931 INFO:tasks.workunit.client.1.smithi165.stdout:0/831: chown d15/d19/d28/d4f/d52/f63 0 1 2024-09-06T14:44:38.932 INFO:tasks.workunit.client.1.smithi165.stdout:8/915: mknod d0/d10a/d10e/c141 0 2024-09-06T14:44:38.933 INFO:tasks.workunit.client.1.smithi165.stdout:5/973: dwrite d6/d1c/d28/d4b/d55/d8a/de1/f78 [0,4194304] 0 2024-09-06T14:44:38.933 INFO:tasks.workunit.client.0.smithi052.stdout:0/243: dwrite d0/d1a/f40 [0,4194304] 0 2024-09-06T14:44:38.934 INFO:tasks.workunit.client.1.smithi165.stdout:8/916: stat d0/d19/d36/d2d 0 2024-09-06T14:44:38.934 INFO:tasks.workunit.client.1.smithi165.stdout:4/925: getdents d5/d1b/d61/d77 0 2024-09-06T14:44:38.935 INFO:tasks.workunit.client.0.smithi052.stdout:3/308: dwrite d0/d11/d12/f47 [0,4194304] 0 2024-09-06T14:44:38.938 INFO:tasks.workunit.client.0.smithi052.stdout:0/244: write d0/d1a/d26/f4e [810688,97870] 0 2024-09-06T14:44:38.941 INFO:tasks.workunit.client.1.smithi165.stdout:0/832: dwrite d15/d19/d38/fa2 [0,4194304] 0 2024-09-06T14:44:38.941 INFO:tasks.workunit.client.0.smithi052.stdout:2/225: write da/f2f [164551,125924] 0 2024-09-06T14:44:38.942 INFO:tasks.workunit.client.0.smithi052.stdout:2/226: readlink da/d19/d20/l30 0 2024-09-06T14:44:38.943 INFO:tasks.workunit.client.1.smithi165.stdout:5/974: dwrite d6/d1c/d28/d2d/d61/ddc/fe7 [4194304,4194304] 0 2024-09-06T14:44:38.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.947+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fecd4005dc0 con 0x7fece8102b70 2024-09-06T14:44:38.946 INFO:tasks.workunit.client.1.smithi165.stdout:3/902: mkdir d1/da/dc/d3b/dc6/d12e 0 2024-09-06T14:44:38.946 INFO:tasks.workunit.client.1.smithi165.stdout:2/835: symlink d9/d88/l116 0 2024-09-06T14:44:38.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.949+0000 7fece4ff9640 1 -- 172.21.15.52:0/1355117829 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fecdc07d510 con 0x7fece8102b70 2024-09-06T14:44:38.947 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:44:38.947 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:44:38.947 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:44:38.947 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 1, 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:44:38.948 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:44:38.949 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:44:38.949 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 13, 2024-09-06T14:44:38.949 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:44:38.949 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:44:38.949 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:44:38.949 INFO:tasks.workunit.client.0.smithi052.stdout:0/245: creat d0/d1a/f52 x:0 0 0 2024-09-06T14:44:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fecd0072b10 msgr2=0x7fecd0074fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fecd0072b10 0x7fecd0074fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fece81029d0 tx=0x7fecd8009110 comp rx=0 tx=0).stop 2024-09-06T14:44:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8102b70 msgr2=0x7fece819e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8102b70 0x7fece819e050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009230 tx=0x7fecdc032b20 comp rx=0 tx=0).stop 2024-09-06T14:44:38.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 shutdown_connections 2024-09-06T14:44:38.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fecd0072b10 0x7fecd0074fd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece8102b70 0x7fece819e050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 --2- 172.21.15.52:0/1355117829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fece8101970 0x7fece819db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:38.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.953+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 >> 172.21.15.52:0/1355117829 conn(0x7fece80fd140 msgr2=0x7fece8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:38.953 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:38 smithi052 ceph-mon[28627]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:38.953 INFO:tasks.workunit.client.1.smithi165.stdout:9/972: chown db/de/d15/d7f/d9b/f31 196886 1 2024-09-06T14:44:38.953 INFO:tasks.workunit.client.1.smithi165.stdout:0/833: dread d15/d19/d2c/f36 [4194304,4194304] 0 2024-09-06T14:44:38.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.954+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 shutdown_connections 2024-09-06T14:44:38.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:38.954+0000 7fecedeac640 1 -- 172.21.15.52:0/1355117829 wait complete. 2024-09-06T14:44:38.953 INFO:tasks.workunit.client.0.smithi052.stdout:5/103: link d2/f7 d2/d20/f23 0 2024-09-06T14:44:38.955 INFO:tasks.workunit.client.1.smithi165.stdout:0/834: write d15/d19/d66/df8/dfd/ffe [983368,74620] 0 2024-09-06T14:44:38.956 INFO:tasks.workunit.client.0.smithi052.stdout:0/246: mknod d0/d2e/c53 0 2024-09-06T14:44:38.958 INFO:tasks.workunit.client.1.smithi165.stdout:8/917: mkdir d0/d14/d3e/dcf/d142 0 2024-09-06T14:44:38.958 INFO:tasks.workunit.client.1.smithi165.stdout:4/926: mknod d5/d1b/d1c/d55/d7d/c137 0 2024-09-06T14:44:38.960 INFO:tasks.workunit.client.1.smithi165.stdout:7/747: mknod d20/d3b/d69/d88/d80/d81/de1/cf1 0 2024-09-06T14:44:38.960 INFO:tasks.workunit.client.1.smithi165.stdout:2/836: unlink d9/d88/db8/c107 0 2024-09-06T14:44:38.961 INFO:tasks.workunit.client.0.smithi052.stdout:0/247: write d0/d1a/d26/d3a/d14/d20/f32 [2245200,33889] 0 2024-09-06T14:44:38.961 INFO:tasks.workunit.client.1.smithi165.stdout:3/903: truncate d1/da/dc/f2e 2621613 0 2024-09-06T14:44:38.961 INFO:tasks.workunit.client.1.smithi165.stdout:9/973: dwrite db/de/d16/d2e/f3d [0,4194304] 0 2024-09-06T14:44:38.963 INFO:tasks.workunit.client.1.smithi165.stdout:0/835: creat d15/d19/d28/d4f/da7/f112 x:0 0 0 2024-09-06T14:44:38.964 INFO:tasks.workunit.client.1.smithi165.stdout:5/975: creat d6/d1c/d28/d4b/d55/d8a/dda/f163 x:0 0 0 2024-09-06T14:44:38.964 INFO:tasks.workunit.client.1.smithi165.stdout:2/837: truncate d9/d25/d46/fec 272515 0 2024-09-06T14:44:38.966 INFO:tasks.workunit.client.1.smithi165.stdout:5/976: chown d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/l125 249394 1 2024-09-06T14:44:38.970 INFO:tasks.workunit.client.1.smithi165.stdout:3/904: truncate d1/da/dc/d10/f1a 2011618 0 2024-09-06T14:44:38.971 INFO:tasks.workunit.client.0.smithi052.stdout:0/248: dwrite d0/d1a/d26/d3a/d14/d2d/f2b [0,4194304] 0 2024-09-06T14:44:38.972 INFO:tasks.workunit.client.0.smithi052.stdout:0/249: read d0/d1a/f40 [3461555,20665] 0 2024-09-06T14:44:38.974 INFO:tasks.workunit.client.1.smithi165.stdout:2/838: rename d9/d3b to d9/d25/d45/d75/d34/d117 0 2024-09-06T14:44:38.975 INFO:tasks.workunit.client.1.smithi165.stdout:5/977: mkdir d6/d1c/d28/d2d/d3c/d44/d90/ddf/d164 0 2024-09-06T14:44:38.978 INFO:tasks.workunit.client.1.smithi165.stdout:0/836: mknod d15/c113 0 2024-09-06T14:44:38.979 INFO:tasks.workunit.client.1.smithi165.stdout:3/905: truncate d1/da/d43/f96 8527237 0 2024-09-06T14:44:38.983 INFO:tasks.workunit.client.0.smithi052.stdout:0/250: dwrite d0/d1a/d26/d3a/d14/d20/d22/f4a [0,4194304] 0 2024-09-06T14:44:38.984 INFO:tasks.workunit.client.1.smithi165.stdout:2/839: mkdir d9/d23/d118 0 2024-09-06T14:44:38.987 INFO:tasks.workunit.client.0.smithi052.stdout:0/251: write d0/d1a/d26/d3a/d14/d20/f2f [1550815,89708] 0 2024-09-06T14:44:38.988 INFO:tasks.workunit.client.0.smithi052.stdout:0/252: rename d0/d1a to d0/d1a/d26/d54 22 2024-09-06T14:44:38.988 INFO:tasks.workunit.client.1.smithi165.stdout:0/837: link le d15/d19/d66/df8/dfd/l114 0 2024-09-06T14:44:38.994 INFO:tasks.workunit.client.1.smithi165.stdout:6/937: sync 2024-09-06T14:44:38.997 INFO:tasks.workunit.client.0.smithi052.stdout:5/104: dread d2/d20/f23 [0,4194304] 0 2024-09-06T14:44:38.998 INFO:tasks.workunit.client.0.smithi052.stdout:0/253: getdents d0/d1a/d26/d3a/d14/d20/d22/d41 0 2024-09-06T14:44:39.001 INFO:tasks.workunit.client.0.smithi052.stdout:5/105: creat d2/f24 x:0 0 0 2024-09-06T14:44:39.002 INFO:tasks.workunit.client.1.smithi165.stdout:6/938: symlink d29/l12d 0 2024-09-06T14:44:39.002 INFO:tasks.workunit.client.0.smithi052.stdout:0/254: dread d0/d1a/d26/d3a/d14/d20/f32 [0,4194304] 0 2024-09-06T14:44:39.003 INFO:tasks.workunit.client.0.smithi052.stdout:3/309: write d0/d11/d12/d4c/d53/f3e [2746001,55936] 0 2024-09-06T14:44:39.004 INFO:tasks.workunit.client.0.smithi052.stdout:0/255: dread - d0/d18/f50 zero size 2024-09-06T14:44:39.005 INFO:tasks.workunit.client.0.smithi052.stdout:5/106: creat d2/f25 x:0 0 0 2024-09-06T14:44:39.006 INFO:tasks.workunit.client.0.smithi052.stdout:5/107: dread - d2/f24 zero size 2024-09-06T14:44:39.007 INFO:tasks.workunit.client.0.smithi052.stdout:2/227: write da/f11 [218800,49464] 0 2024-09-06T14:44:39.008 INFO:tasks.workunit.client.0.smithi052.stdout:3/310: symlink d0/l54 0 2024-09-06T14:44:39.011 INFO:tasks.workunit.client.0.smithi052.stdout:0/256: mkdir d0/d1a/d26/d3a/d14/d20/d22/d55 0 2024-09-06T14:44:39.015 INFO:tasks.workunit.client.1.smithi165.stdout:6/939: dread d29/d6a/f70 [0,4194304] 0 2024-09-06T14:44:39.018 INFO:tasks.workunit.client.0.smithi052.stdout:2/228: creat da/db/d4c/f4d x:0 0 0 2024-09-06T14:44:39.021 INFO:tasks.workunit.client.1.smithi165.stdout:6/940: creat d29/d39/d5b/d62/d94/db7/dde/f12e x:0 0 0 2024-09-06T14:44:39.022 INFO:tasks.workunit.client.0.smithi052.stdout:0/257: dwrite d0/d1a/d26/d3a/d14/d20/f32 [4194304,4194304] 0 2024-09-06T14:44:39.023 INFO:tasks.workunit.client.0.smithi052.stdout:2/229: unlink f1 0 2024-09-06T14:44:39.027 INFO:tasks.workunit.client.0.smithi052.stdout:0/258: mkdir d0/d1a/d26/d3a/d14/d2d/d56 0 2024-09-06T14:44:39.031 INFO:tasks.workunit.client.0.smithi052.stdout:0/259: rename d0/d1a/d26/c44 to d0/d1a/d26/d3a/d14/d20/c57 0 2024-09-06T14:44:39.033 INFO:tasks.workunit.client.1.smithi165.stdout:1/847: sync 2024-09-06T14:44:39.034 INFO:tasks.workunit.client.1.smithi165.stdout:4/927: write d5/d1b/d1c/f6b [3045932,102163] 0 2024-09-06T14:44:39.035 INFO:tasks.workunit.client.0.smithi052.stdout:2/230: getdents da 0 2024-09-06T14:44:39.035 INFO:tasks.workunit.client.0.smithi052.stdout:0/260: unlink d0/d1a/d26/d3a/d14/c30 0 2024-09-06T14:44:39.036 INFO:tasks.workunit.client.1.smithi165.stdout:8/918: write d0/d14/f25 [874672,17838] 0 2024-09-06T14:44:39.036 INFO:tasks.workunit.client.1.smithi165.stdout:7/748: dwrite d20/d65/fd2 [0,4194304] 0 2024-09-06T14:44:39.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/261: stat d0/d4f 0 2024-09-06T14:44:39.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/262: chown d0/d18/f50 2995076 1 2024-09-06T14:44:39.039 INFO:tasks.workunit.client.0.smithi052.stdout:2/231: mknod da/c4e 0 2024-09-06T14:44:39.039 INFO:tasks.workunit.client.1.smithi165.stdout:7/749: fdatasync d20/d4d/ddd/fa9 0 2024-09-06T14:44:39.040 INFO:tasks.workunit.client.1.smithi165.stdout:9/974: dwrite db/de/fb1 [0,4194304] 0 2024-09-06T14:44:39.041 INFO:tasks.workunit.client.1.smithi165.stdout:7/750: chown d20/d4d/dd4/fe0 0 1 2024-09-06T14:44:39.043 INFO:tasks.workunit.client.1.smithi165.stdout:8/919: dread d0/d19/d36/fd2 [0,4194304] 0 2024-09-06T14:44:39.044 INFO:tasks.workunit.client.1.smithi165.stdout:8/920: dread - d0/d19/d36/d2d/fdd zero size 2024-09-06T14:44:39.045 INFO:tasks.workunit.client.1.smithi165.stdout:8/921: stat d0/d19/l32 0 2024-09-06T14:44:39.045 INFO:tasks.workunit.client.1.smithi165.stdout:1/848: rename d0/fef to d0/d1c/d40/f116 0 2024-09-06T14:44:39.046 INFO:tasks.workunit.client.1.smithi165.stdout:9/975: dread db/de/d15/d17/d18/d7d/fae [0,4194304] 0 2024-09-06T14:44:39.047 INFO:tasks.workunit.client.1.smithi165.stdout:8/922: fsync d0/d19/d24/db1/d5b/d125/f127 0 2024-09-06T14:44:39.047 INFO:tasks.workunit.client.1.smithi165.stdout:1/849: write d0/d1c/d41/f9f [5224872,4308] 0 2024-09-06T14:44:39.048 INFO:tasks.workunit.client.0.smithi052.stdout:2/232: mkdir da/d4f 0 2024-09-06T14:44:39.049 INFO:tasks.workunit.client.1.smithi165.stdout:8/923: write d0/d34/d6b/d94/d70/fc0 [4580598,31586] 0 2024-09-06T14:44:39.049 INFO:tasks.workunit.client.1.smithi165.stdout:5/978: write d6/f19 [3080253,12283] 0 2024-09-06T14:44:39.049 INFO:tasks.workunit.client.1.smithi165.stdout:8/924: dread - d0/d19/d36/d2d/fdd zero size 2024-09-06T14:44:39.050 INFO:tasks.workunit.client.1.smithi165.stdout:5/979: chown d6/d1c/d64/f150 3926810 1 2024-09-06T14:44:39.055 INFO:tasks.workunit.client.1.smithi165.stdout:3/906: write d1/d7c/d98/faf [630048,130452] 0 2024-09-06T14:44:39.056 INFO:tasks.workunit.client.0.smithi052.stdout:0/263: dread d0/d1a/d26/d3a/d14/d2d/f11 [0,4194304] 0 2024-09-06T14:44:39.056 INFO:tasks.workunit.client.1.smithi165.stdout:0/838: getdents d15/d19/d66/df8/dfd 0 2024-09-06T14:44:39.058 INFO:tasks.workunit.client.0.smithi052.stdout:2/233: mknod da/d2d/d34/d4a/c50 0 2024-09-06T14:44:39.061 INFO:tasks.workunit.client.1.smithi165.stdout:7/751: rename d20/d3b/d69/d88/ccb to d20/d3b/d69/dd1/dd6/cf2 0 2024-09-06T14:44:39.062 INFO:tasks.workunit.client.0.smithi052.stdout:0/264: write d0/d1a/f40 [1606999,98503] 0 2024-09-06T14:44:39.062 INFO:tasks.workunit.client.1.smithi165.stdout:2/840: dwrite d9/d23/d29/d48/dce/dfc/fd7 [0,4194304] 0 2024-09-06T14:44:39.063 INFO:tasks.workunit.client.1.smithi165.stdout:7/752: write d20/d4d/d54/fbe [82713,128027] 0 2024-09-06T14:44:39.064 INFO:tasks.workunit.client.1.smithi165.stdout:7/753: fdatasync d20/d4d/d54/f9c 0 2024-09-06T14:44:39.064 INFO:tasks.workunit.client.0.smithi052.stdout:2/234: mknod da/db/d18/c51 0 2024-09-06T14:44:39.066 INFO:tasks.workunit.client.1.smithi165.stdout:1/850: mkdir d0/d45/d117 0 2024-09-06T14:44:39.069 INFO:tasks.workunit.client.1.smithi165.stdout:8/925: dread - d0/d19/d36/d28/d64/fd1 zero size 2024-09-06T14:44:39.071 INFO:tasks.workunit.client.0.smithi052.stdout:0/265: dwrite d0/d1a/d26/d3a/d14/d20/f2f [4194304,4194304] 0 2024-09-06T14:44:39.072 INFO:tasks.workunit.client.1.smithi165.stdout:3/907: creat d1/da/dd/d8c/f12f x:0 0 0 2024-09-06T14:44:39.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:38 smithi165 ceph-mon[36229]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:39.073 INFO:tasks.workunit.client.0.smithi052.stdout:5/108: write d2/f12 [1177507,679] 0 2024-09-06T14:44:39.076 INFO:tasks.workunit.client.1.smithi165.stdout:8/926: dwrite d0/d19/d24/db1/d5b/d125/f127 [0,4194304] 0 2024-09-06T14:44:39.079 INFO:tasks.workunit.client.0.smithi052.stdout:0/266: symlink d0/d2e/l58 0 2024-09-06T14:44:39.082 INFO:tasks.workunit.client.1.smithi165.stdout:5/980: rename d6/d1c/d28/d2d/d3c/d44/d90 to d6/d1c/d28/d4b/d10b/d165 0 2024-09-06T14:44:39.082 INFO:tasks.workunit.client.1.smithi165.stdout:6/941: write d29/d39/d5b/d68/f6f [729878,55538] 0 2024-09-06T14:44:39.083 INFO:tasks.workunit.client.0.smithi052.stdout:0/267: dread d0/d1a/d26/d3a/d14/d20/f48 [0,4194304] 0 2024-09-06T14:44:39.084 INFO:tasks.workunit.client.1.smithi165.stdout:6/942: write d29/d6a/d83/fc4 [2276217,69495] 0 2024-09-06T14:44:39.084 INFO:tasks.workunit.client.1.smithi165.stdout:5/981: truncate d6/d98/dd7/f107 504600 0 2024-09-06T14:44:39.091 INFO:tasks.workunit.client.0.smithi052.stdout:3/311: creat d0/d11/d15/f55 x:0 0 0 2024-09-06T14:44:39.093 INFO:tasks.workunit.client.0.smithi052.stdout:3/312: fsync d0/d11/d12/d4c/d53/d35/f2a 0 2024-09-06T14:44:39.097 INFO:tasks.workunit.client.0.smithi052.stdout:0/268: rename d0/d3d/f47 to d0/d19/f59 0 2024-09-06T14:44:39.097 INFO:tasks.workunit.client.0.smithi052.stdout:0/269: dread - d0/d2e/f4b zero size 2024-09-06T14:44:39.098 INFO:tasks.workunit.client.1.smithi165.stdout:4/928: dwrite d5/f58 [0,4194304] 0 2024-09-06T14:44:39.099 INFO:tasks.workunit.client.1.smithi165.stdout:4/929: chown d5/d1b/d61/dd7/ddf/dd4/fe6 19663823 1 2024-09-06T14:44:39.100 INFO:tasks.workunit.client.0.smithi052.stdout:2/235: link da/d2d/d34/l39 da/d4f/l52 0 2024-09-06T14:44:39.102 INFO:tasks.workunit.client.0.smithi052.stdout:2/236: read - da/db/f45 zero size 2024-09-06T14:44:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.105+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/2915702414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 msgr2=0x7f5f641034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:39.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.105+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/2915702414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f641034c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5f60009880 tx=0x7f5f6002a540 comp rx=0 tx=0).stop 2024-09-06T14:44:39.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.105+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/2915702414 shutdown_connections 2024-09-06T14:44:39.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.105+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/2915702414 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f64103a00 0x7f5f64105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:39.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.105+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/2915702414 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f641034c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:39.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.105+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/2915702414 >> 172.21.15.52:0/2915702414 conn(0x7f5f640fb350 msgr2=0x7f5f640fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:39.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.106+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/2915702414 shutdown_connections 2024-09-06T14:44:39.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.106+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/2915702414 wait complete. 2024-09-06T14:44:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f6c1c5640 1 Processor -- start 2024-09-06T14:44:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f6c1c5640 1 -- start start 2024-09-06T14:44:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f6c1c5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f64100920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f6c1c5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f64103a00 0x7f5f6419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f6c1c5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5f641096e0 con 0x7f5f641010d0 2024-09-06T14:44:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f6c1c5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f64109560 con 0x7f5f64103a00 2024-09-06T14:44:39.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f69f61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f64100920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:39.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f69760640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f64103a00 0x7f5f6419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:39.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f69f61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f64100920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41180/0 (socket says 172.21.15.52:41180) 2024-09-06T14:44:39.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.107+0000 7f5f69f61640 1 -- 172.21.15.52:0/3053022168 learned_addr learned my addr 172.21.15.52:0/3053022168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:44:39.106 INFO:tasks.workunit.client.0.smithi052.stdout:3/313: creat d0/d11/d15/f56 x:0 0 0 2024-09-06T14:44:39.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.108+0000 7f5f69f61640 1 -- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f64103a00 msgr2=0x7f5f6419a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:39.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.108+0000 7f5f69f61640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f64103a00 0x7f5f6419a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:39.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.108+0000 7f5f69f61640 1 -- 172.21.15.52:0/3053022168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6419a600 con 0x7f5f641010d0 2024-09-06T14:44:39.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.108+0000 7f5f69f61640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f64100920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f60006010 tx=0x7f5f60004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:39.107 INFO:tasks.workunit.client.0.smithi052.stdout:0/270: dwrite d0/d2e/f4b [0,4194304] 0 2024-09-06T14:44:39.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.109+0000 7f5f5affd640 1 -- 172.21.15.52:0/3053022168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f6003f070 con 0x7f5f641010d0 2024-09-06T14:44:39.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.109+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6419a890 con 0x7f5f641010d0 2024-09-06T14:44:39.108 INFO:tasks.workunit.client.1.smithi165.stdout:7/754: dread d20/d3b/d69/d88/d30/f39 [0,4194304] 0 2024-09-06T14:44:39.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.109+0000 7f5f5affd640 1 -- 172.21.15.52:0/3053022168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f600049d0 con 0x7f5f641010d0 2024-09-06T14:44:39.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.110+0000 7f5f5affd640 1 -- 172.21.15.52:0/3053022168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f60049060 con 0x7f5f641010d0 2024-09-06T14:44:39.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.110+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6419adc0 con 0x7f5f641010d0 2024-09-06T14:44:39.109 INFO:tasks.workunit.client.1.smithi165.stdout:9/976: write db/de/d16/f43 [39854,110765] 0 2024-09-06T14:44:39.110 INFO:tasks.workunit.client.1.smithi165.stdout:0/839: rename d15/d19/d28/d9e/le3 to d15/d19/d28/d3a/d3f/l115 0 2024-09-06T14:44:39.112 INFO:tasks.workunit.client.1.smithi165.stdout:0/840: fdatasync d15/f37 0 2024-09-06T14:44:39.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.114+0000 7f5f5affd640 1 -- 172.21.15.52:0/3053022168 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7f5f60042070 con 0x7f5f641010d0 2024-09-06T14:44:39.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.114+0000 7f5f5affd640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5f50072950 0x7f5f50074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:44:39.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.114+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f641014b0 con 0x7f5f641010d0 2024-09-06T14:44:39.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.115+0000 7f5f5affd640 1 -- 172.21.15.52:0/3053022168 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f5f600b42c0 con 0x7f5f641010d0 2024-09-06T14:44:39.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.115+0000 7f5f69760640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5f50072950 0x7f5f50074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:44:39.113 INFO:tasks.workunit.client.0.smithi052.stdout:2/237: dwrite f9 [0,4194304] 0 2024-09-06T14:44:39.114 INFO:tasks.workunit.client.1.smithi165.stdout:6/943: mknod d29/d93/d87/df2/c12f 0 2024-09-06T14:44:39.114 INFO:tasks.workunit.client.1.smithi165.stdout:7/755: dwrite d20/d65/fd2 [0,4194304] 0 2024-09-06T14:44:39.114 INFO:tasks.workunit.client.1.smithi165.stdout:0/841: write d15/d19/d28/d9e/da3/de5/ff3 [865953,68154] 0 2024-09-06T14:44:39.114 INFO:tasks.workunit.client.0.smithi052.stdout:2/238: write da/f2f [1337287,7708] 0 2024-09-06T14:44:39.115 INFO:tasks.workunit.client.1.smithi165.stdout:7/756: dread d20/d4d/d54/fb7 [0,4194304] 0 2024-09-06T14:44:39.117 INFO:tasks.workunit.client.1.smithi165.stdout:5/982: unlink d6/d1c/d28/d4b/d55/d8a/da5/dd6/dea/d10a/c112 0 2024-09-06T14:44:39.117 INFO:tasks.workunit.client.0.smithi052.stdout:3/314: rmdir d0/d11/d12/d4c/d53/d35/d46 39 2024-09-06T14:44:39.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.120+0000 7f5f69760640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5f50072950 0x7f5f50074e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5f641006a0 tx=0x7f5f54005f90 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:44:39.118 INFO:tasks.workunit.client.1.smithi165.stdout:5/983: read - d6/d1c/d28/d4b/d55/d8a/dda/f110 zero size 2024-09-06T14:44:39.119 INFO:tasks.workunit.client.0.smithi052.stdout:0/271: write d0/d1a/d26/d3a/d14/d2d/f33 [1607242,30263] 0 2024-09-06T14:44:39.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.124+0000 7f5f5affd640 1 -- 172.21.15.52:0/3053022168 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f5f60081500 con 0x7f5f641010d0 2024-09-06T14:44:39.124 INFO:tasks.workunit.client.1.smithi165.stdout:2/841: creat d9/d23/d29/d48/db1/f119 x:0 0 0 2024-09-06T14:44:39.125 INFO:tasks.workunit.client.1.smithi165.stdout:2/842: fsync d9/d25/d46/d7e/d90/fb9 0 2024-09-06T14:44:39.126 INFO:tasks.workunit.client.1.smithi165.stdout:2/843: chown d9/d25/d45/cc7 244479 1 2024-09-06T14:44:39.127 INFO:tasks.workunit.client.0.smithi052.stdout:5/109: dwrite d2/f11 [0,4194304] 0 2024-09-06T14:44:39.131 INFO:tasks.workunit.client.1.smithi165.stdout:4/930: mkdir d5/d1b/d61/dd7/ddf/ddc/d138 0 2024-09-06T14:44:39.133 INFO:tasks.workunit.client.0.smithi052.stdout:2/239: mknod da/db/d46/c53 0 2024-09-06T14:44:39.134 INFO:tasks.workunit.client.1.smithi165.stdout:9/977: creat db/de/d15/d17/dc3/f138 x:0 0 0 2024-09-06T14:44:39.170 INFO:tasks.workunit.client.0.smithi052.stdout:3/315: unlink d0/c5 0 2024-09-06T14:44:39.172 INFO:tasks.workunit.client.1.smithi165.stdout:3/908: rename d1/da/dd/d8c/ld7 to d1/da/dc/d3b/dc6/df0/l130 0 2024-09-06T14:44:39.173 INFO:tasks.workunit.client.1.smithi165.stdout:3/909: stat d1/da/dc/d10/lb3 0 2024-09-06T14:44:39.173 INFO:tasks.workunit.client.0.smithi052.stdout:5/110: mkdir d2/d1a/d22/d26 0 2024-09-06T14:44:39.178 INFO:tasks.workunit.client.1.smithi165.stdout:6/944: dread d29/d6a/f8f [0,4194304] 0 2024-09-06T14:44:39.179 INFO:tasks.workunit.client.0.smithi052.stdout:2/240: readlink da/db/l40 0 2024-09-06T14:44:39.184 INFO:tasks.workunit.client.0.smithi052.stdout:2/241: mkdir da/d54 0 2024-09-06T14:44:39.186 INFO:tasks.workunit.client.0.smithi052.stdout:3/316: stat d0/c8 0 2024-09-06T14:44:39.189 INFO:tasks.workunit.client.1.smithi165.stdout:7/757: dread d20/d3b/f8b [0,4194304] 0 2024-09-06T14:44:39.190 INFO:tasks.workunit.client.0.smithi052.stdout:5/111: creat d2/d1a/d22/d26/f27 x:0 0 0 2024-09-06T14:44:39.191 INFO:tasks.workunit.client.1.smithi165.stdout:5/984: mknod d6/d1c/d28/d4b/d55/d8a/da5/c166 0 2024-09-06T14:44:39.194 INFO:tasks.workunit.client.1.smithi165.stdout:1/851: link d0/d2a/d18/l6d d0/d2a/d18/d24/d4b/d93/d68/d75/l118 0 2024-09-06T14:44:39.198 INFO:tasks.workunit.client.0.smithi052.stdout:5/112: unlink d2/f6 0 2024-09-06T14:44:39.198 INFO:tasks.workunit.client.0.smithi052.stdout:5/113: dread - d2/f1d zero size 2024-09-06T14:44:39.199 INFO:tasks.workunit.client.1.smithi165.stdout:8/927: creat d0/d19/d36/d2d/d33/f143 x:0 0 0 2024-09-06T14:44:39.200 INFO:tasks.workunit.client.1.smithi165.stdout:8/928: chown d0/d34/d6b/d94/d70/db8/d11c 206 1 2024-09-06T14:44:39.201 INFO:tasks.workunit.client.0.smithi052.stdout:2/242: truncate da/d19/f29 418065 0 2024-09-06T14:44:39.201 INFO:tasks.workunit.client.1.smithi165.stdout:8/929: dread d0/f22 [0,4194304] 0 2024-09-06T14:44:39.202 INFO:tasks.workunit.client.1.smithi165.stdout:9/978: mknod db/de/d15/d17/d18/c139 0 2024-09-06T14:44:39.203 INFO:tasks.workunit.client.0.smithi052.stdout:3/317: creat d0/d11/d12/d4c/f57 x:0 0 0 2024-09-06T14:44:39.204 INFO:tasks.workunit.client.1.smithi165.stdout:4/931: rename d5/d1b/d61/d77/d7c/dcd/c9c to d5/d1b/d61/d77/d93/c139 0 2024-09-06T14:44:39.205 INFO:tasks.workunit.client.0.smithi052.stdout:5/114: fsync d2/d20/f23 0 2024-09-06T14:44:39.205 INFO:tasks.workunit.client.1.smithi165.stdout:3/910: stat d1/da/dc/d3b/dc6/df0/l130 0 2024-09-06T14:44:39.206 INFO:tasks.workunit.client.1.smithi165.stdout:1/852: dread d0/d2a/d18/d24/d4b/d5f/db8/de4/f8d [0,4194304] 0 2024-09-06T14:44:39.207 INFO:tasks.workunit.client.0.smithi052.stdout:2/243: mkdir da/db/d46/d55 0 2024-09-06T14:44:39.207 INFO:tasks.workunit.client.1.smithi165.stdout:6/945: rmdir d29/d93/d87 39 2024-09-06T14:44:39.208 INFO:tasks.workunit.client.1.smithi165.stdout:1/853: read d0/d45/f6e [3216729,90583] 0 2024-09-06T14:44:39.209 INFO:tasks.workunit.client.1.smithi165.stdout:1/854: write d0/d1c/d1d/fb2 [703204,25032] 0 2024-09-06T14:44:39.210 INFO:tasks.workunit.client.0.smithi052.stdout:3/318: chown d0/d11/d15/d1b/l52 1421 1 2024-09-06T14:44:39.211 INFO:tasks.workunit.client.1.smithi165.stdout:0/842: creat d15/d19/d101/f116 x:0 0 0 2024-09-06T14:44:39.212 INFO:tasks.workunit.client.0.smithi052.stdout:3/319: read - d0/d11/d15/d19/f2c zero size 2024-09-06T14:44:39.212 INFO:tasks.workunit.client.0.smithi052.stdout:5/115: dwrite d2/f24 [0,4194304] 0 2024-09-06T14:44:39.214 INFO:tasks.workunit.client.0.smithi052.stdout:2/244: unlink da/db/d18/c51 0 2024-09-06T14:44:39.215 INFO:tasks.workunit.client.0.smithi052.stdout:3/320: read d0/d11/d12/d4c/d53/d35/f3a [2982739,74592] 0 2024-09-06T14:44:39.215 INFO:tasks.workunit.client.0.smithi052.stdout:3/321: readlink d0/l54 0 2024-09-06T14:44:39.216 INFO:tasks.workunit.client.1.smithi165.stdout:7/758: symlink d20/d65/d82/d97/lf3 0 2024-09-06T14:44:39.216 INFO:tasks.workunit.client.1.smithi165.stdout:7/759: stat d20/d33/d6a/d9a 0 2024-09-06T14:44:39.218 INFO:tasks.workunit.client.1.smithi165.stdout:2/844: mknod d9/d23/d29/d48/d114/c11a 0 2024-09-06T14:44:39.219 INFO:tasks.workunit.client.0.smithi052.stdout:5/116: unlink d2/d1a/f1c 0 2024-09-06T14:44:39.220 INFO:tasks.workunit.client.0.smithi052.stdout:5/117: chown d2/c1f 151701448 1 2024-09-06T14:44:39.221 INFO:tasks.workunit.client.0.smithi052.stdout:5/118: fdatasync d2/ff 0 2024-09-06T14:44:39.221 INFO:tasks.workunit.client.1.smithi165.stdout:9/979: dread - db/de/d15/d17/d86/ddd/d115/f12c zero size 2024-09-06T14:44:39.223 INFO:tasks.workunit.client.0.smithi052.stdout:2/245: truncate da/d19/d3a/f3f 3698967 0 2024-09-06T14:44:39.225 INFO:tasks.workunit.client.0.smithi052.stdout:2/246: write da/f11 [3269111,95822] 0 2024-09-06T14:44:39.226 INFO:tasks.workunit.client.0.smithi052.stdout:2/247: chown da 113950 1 2024-09-06T14:44:39.233 INFO:tasks.workunit.client.0.smithi052.stdout:3/322: dread d0/d11/d12/d4c/d53/f3e [0,4194304] 0 2024-09-06T14:44:39.233 INFO:tasks.workunit.client.1.smithi165.stdout:0/843: rmdir d15/d19/d28/d51/d60 39 2024-09-06T14:44:39.237 INFO:tasks.workunit.client.0.smithi052.stdout:5/119: creat d2/d20/f28 x:0 0 0 2024-09-06T14:44:39.237 INFO:tasks.workunit.client.0.smithi052.stdout:5/120: stat d2/ff 0 2024-09-06T14:44:39.240 INFO:tasks.workunit.client.1.smithi165.stdout:5/985: symlink d6/d1c/d28/d160/l167 0 2024-09-06T14:44:39.243 INFO:tasks.workunit.client.1.smithi165.stdout:1/855: write d0/d2a/d18/d24/d4b/d93/d2b/fad [1387821,57952] 0 2024-09-06T14:44:39.246 INFO:tasks.workunit.client.1.smithi165.stdout:8/930: symlink d0/d19/d36/d2d/d33/d3a/d46/l144 0 2024-09-06T14:44:39.247 INFO:tasks.workunit.client.1.smithi165.stdout:8/931: chown d0/d19/d36 936 1 2024-09-06T14:44:39.247 INFO:tasks.workunit.client.1.smithi165.stdout:0/844: dread d15/d19/d28/f67 [0,4194304] 0 2024-09-06T14:44:39.248 INFO:tasks.workunit.client.1.smithi165.stdout:0/845: chown d15/d19/d2c/df1/f108 99930820 1 2024-09-06T14:44:39.251 INFO:tasks.workunit.client.0.smithi052.stdout:2/248: getdents da/db/d18 0 2024-09-06T14:44:39.253 INFO:tasks.workunit.client.1.smithi165.stdout:6/946: rename d29/d93/d87/f112 to d29/d6a/d71/f130 0 2024-09-06T14:44:39.253 INFO:tasks.workunit.client.0.smithi052.stdout:3/323: dwrite d0/d11/d12/d4c/d53/d35/f22 [0,4194304] 0 2024-09-06T14:44:39.256 INFO:tasks.workunit.client.1.smithi165.stdout:6/947: dread d29/d32/f50 [0,4194304] 0 2024-09-06T14:44:39.256 INFO:tasks.workunit.client.0.smithi052.stdout:5/121: truncate d2/f24 3957023 0 2024-09-06T14:44:39.257 INFO:tasks.workunit.client.0.smithi052.stdout:5/122: dread - d2/f16 zero size 2024-09-06T14:44:39.259 INFO:tasks.workunit.client.1.smithi165.stdout:3/911: truncate d1/da/dd/f2c 2080194 0 2024-09-06T14:44:39.260 INFO:tasks.workunit.client.1.smithi165.stdout:7/760: mkdir d20/d33/d53/df4 0 2024-09-06T14:44:39.261 INFO:tasks.workunit.client.1.smithi165.stdout:7/761: chown d20/d3b/d69/lc2 1540123 1 2024-09-06T14:44:39.261 INFO:tasks.workunit.client.1.smithi165.stdout:7/762: fsync d20/d3b/d69/d88/d30/fbc 0 2024-09-06T14:44:39.262 INFO:tasks.workunit.client.1.smithi165.stdout:7/763: chown d20/d65/d82/d97/lc3 0 1 2024-09-06T14:44:39.265 INFO:tasks.workunit.client.1.smithi165.stdout:2/845: symlink d9/d23/d52/daa/l11b 0 2024-09-06T14:44:39.265 INFO:tasks.workunit.client.0.smithi052.stdout:5/123: creat d2/d20/f29 x:0 0 0 2024-09-06T14:44:39.266 INFO:tasks.workunit.client.1.smithi165.stdout:9/980: mknod db/de/d15/d17/c13a 0 2024-09-06T14:44:39.268 INFO:tasks.workunit.client.0.smithi052.stdout:3/324: mknod d0/d11/d12/c58 0 2024-09-06T14:44:39.270 INFO:tasks.workunit.client.0.smithi052.stdout:5/124: dread d2/f13 [0,4194304] 0 2024-09-06T14:44:39.271 INFO:tasks.workunit.client.1.smithi165.stdout:2/846: dwrite d9/d25/d46/fec [0,4194304] 0 2024-09-06T14:44:39.272 INFO:tasks.workunit.client.1.smithi165.stdout:1/856: symlink d0/l119 0 2024-09-06T14:44:39.272 INFO:tasks.workunit.client.1.smithi165.stdout:4/932: link c3 d5/d1b/d1c/d20/d75/d83/dae/c13a 0 2024-09-06T14:44:39.273 INFO:tasks.workunit.client.1.smithi165.stdout:2/847: truncate d9/d25/fa3 612771 0 2024-09-06T14:44:39.273 INFO:tasks.workunit.client.1.smithi165.stdout:4/933: truncate d5/d1b/f111 980501 0 2024-09-06T14:44:39.275 INFO:tasks.workunit.client.1.smithi165.stdout:8/932: symlink d0/d19/d36/d28/d64/l145 0 2024-09-06T14:44:39.277 INFO:tasks.workunit.client.1.smithi165.stdout:8/933: fdatasync d0/d19/d24/db1/d11a/f12c 0 2024-09-06T14:44:39.277 INFO:tasks.workunit.client.0.smithi052.stdout:2/249: dwrite f2 [0,4194304] 0 2024-09-06T14:44:39.278 INFO:tasks.workunit.client.0.smithi052.stdout:5/125: rename d2/c14 to d2/d1a/d22/d26/c2a 0 2024-09-06T14:44:39.281 INFO:tasks.workunit.client.1.smithi165.stdout:2/848: dwrite d9/d25/d45/d75/d67/d76/f104 [0,4194304] 0 2024-09-06T14:44:39.283 INFO:tasks.workunit.client.0.smithi052.stdout:5/126: rmdir d2/d20 39 2024-09-06T14:44:39.285 INFO:tasks.workunit.client.1.smithi165.stdout:8/934: dread d0/d19/d36/d28/f78 [0,4194304] 0 2024-09-06T14:44:39.286 INFO:tasks.workunit.client.1.smithi165.stdout:6/948: rename d29/d6a/d83/d89/f108 to d29/d39/d5b/d62/d94/db7/dcc/df0/f131 0 2024-09-06T14:44:39.287 INFO:tasks.workunit.client.0.smithi052.stdout:2/250: symlink da/d19/d3a/l56 0 2024-09-06T14:44:39.289 INFO:tasks.workunit.client.1.smithi165.stdout:3/912: creat d1/d41/f131 x:0 0 0 2024-09-06T14:44:39.296 INFO:tasks.workunit.client.0.smithi052.stdout:2/251: dwrite da/db/d18/f3c [0,4194304] 0 2024-09-06T14:44:39.298 INFO:tasks.workunit.client.1.smithi165.stdout:1/857: symlink d0/d45/l11a 0 2024-09-06T14:44:39.300 INFO:tasks.workunit.client.1.smithi165.stdout:1/858: dread d0/d1c/d1d/d57/fd0 [0,4194304] 0 2024-09-06T14:44:39.301 INFO:tasks.workunit.client.0.smithi052.stdout:2/252: creat da/f57 x:0 0 0 2024-09-06T14:44:39.302 INFO:tasks.workunit.client.1.smithi165.stdout:1/859: read - d0/d2a/d18/d24/d4b/d93/d68/dae/fc4 zero size 2024-09-06T14:44:39.303 INFO:tasks.workunit.client.1.smithi165.stdout:1/860: chown d0/d1c/fc3 1 1 2024-09-06T14:44:39.304 INFO:tasks.workunit.client.1.smithi165.stdout:0/846: write d15/d19/d28/fed [4225682,111650] 0 2024-09-06T14:44:39.304 INFO:tasks.workunit.client.1.smithi165.stdout:2/849: mkdir d9/d23/d29/d11c 0 2024-09-06T14:44:39.305 INFO:tasks.workunit.client.0.smithi052.stdout:2/253: creat da/d19/d3a/d31/f58 x:0 0 0 2024-09-06T14:44:39.306 INFO:tasks.workunit.client.1.smithi165.stdout:2/850: chown d9/d23/d29/d48/d8c/dee 2399 1 2024-09-06T14:44:39.306 INFO:tasks.workunit.client.1.smithi165.stdout:0/847: stat d15/d19/d28/d9e/da3/lbc 0 2024-09-06T14:44:39.308 INFO:tasks.workunit.client.0.smithi052.stdout:2/254: mknod da/db/d18/c59 0 2024-09-06T14:44:39.309 INFO:tasks.workunit.client.1.smithi165.stdout:3/913: mkdir d1/da/dd/d4b/d112/d132 0 2024-09-06T14:44:39.312 INFO:tasks.workunit.client.1.smithi165.stdout:5/986: mknod d6/d1c/d28/d2d/d3c/d109/c168 0 2024-09-06T14:44:39.312 INFO:tasks.workunit.client.1.smithi165.stdout:5/987: stat d6/d1c/d28/d88/f13c 0 2024-09-06T14:44:39.314 INFO:tasks.workunit.client.1.smithi165.stdout:9/981: symlink db/de/d100/l13b 0 2024-09-06T14:44:39.315 INFO:tasks.workunit.client.0.smithi052.stdout:2/255: mkdir da/d19/d5a 0 2024-09-06T14:44:39.321 INFO:tasks.workunit.client.0.smithi052.stdout:2/256: rename da/d19/d3a/f49 to da/d4f/f5b 0 2024-09-06T14:44:39.322 INFO:tasks.workunit.client.1.smithi165.stdout:1/861: unlink d0/d2a/d23/l62 0 2024-09-06T14:44:39.323 INFO:tasks.workunit.client.1.smithi165.stdout:6/949: mknod d29/d39/df4/c132 0 2024-09-06T14:44:39.325 INFO:tasks.workunit.client.1.smithi165.stdout:8/935: mknod d0/d19/d36/d2d/d33/d3a/d46/dcd/d113/c146 0 2024-09-06T14:44:39.327 INFO:tasks.workunit.client.0.smithi052.stdout:2/257: symlink da/db/l5c 0 2024-09-06T14:44:39.330 INFO:tasks.workunit.client.1.smithi165.stdout:8/936: dwrite d0/fd [0,4194304] 0 2024-09-06T14:44:39.330 INFO:tasks.workunit.client.0.smithi052.stdout:5/127: dwrite d2/d20/f23 [4194304,4194304] 0 2024-09-06T14:44:39.331 INFO:tasks.workunit.client.1.smithi165.stdout:7/764: link d20/d33/d53/l77 d20/d3b/d69/d88/d80/d81/lf5 0 2024-09-06T14:44:39.339 INFO:tasks.workunit.client.0.smithi052.stdout:2/258: mknod da/d19/c5d 0 2024-09-06T14:44:39.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/128: mkdir d2/d1a/d22/d26/d2b 0 2024-09-06T14:44:39.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/129: fdatasync f1 0 2024-09-06T14:44:39.349 INFO:tasks.workunit.client.1.smithi165.stdout:4/934: dwrite d5/d1b/d1c/d41/fb4 [0,4194304] 0 2024-09-06T14:44:39.352 INFO:tasks.workunit.client.1.smithi165.stdout:0/848: symlink d15/d19/d50/d53/d8d/d110/l117 0 2024-09-06T14:44:39.353 INFO:tasks.workunit.client.0.smithi052.stdout:5/130: dwrite d2/f18 [4194304,4194304] 0 2024-09-06T14:44:39.354 INFO:tasks.workunit.client.0.smithi052.stdout:5/131: stat d2/f16 0 2024-09-06T14:44:39.355 INFO:tasks.workunit.client.1.smithi165.stdout:0/849: write d15/d19/d28/d3a/d3f/ff7 [287511,119249] 0 2024-09-06T14:44:39.355 INFO:tasks.workunit.client.0.smithi052.stdout:5/132: truncate d2/ff 1141862 0 2024-09-06T14:44:39.356 INFO:tasks.workunit.client.0.smithi052.stdout:5/133: truncate d2/f1d 780973 0 2024-09-06T14:44:39.365 INFO:tasks.workunit.client.1.smithi165.stdout:5/988: mknod d6/c169 0 2024-09-06T14:44:39.365 INFO:tasks.workunit.client.0.smithi052.stdout:5/134: dwrite d2/f11 [0,4194304] 0 2024-09-06T14:44:39.365 INFO:tasks.workunit.client.0.smithi052.stdout:2/259: write da/db/fe [1554725,23303] 0 2024-09-06T14:44:39.366 INFO:tasks.workunit.client.1.smithi165.stdout:7/765: chown d20/d40/c5a 85420 1 2024-09-06T14:44:39.366 INFO:tasks.workunit.client.1.smithi165.stdout:4/935: dwrite d5/d1b/d1c/d78/da9/f136 [0,4194304] 0 2024-09-06T14:44:39.367 INFO:tasks.workunit.client.1.smithi165.stdout:7/766: stat d20/d65/f2d 0 2024-09-06T14:44:39.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/767: read - d20/d3b/d69/d88/dc6/fe3 zero size 2024-09-06T14:44:39.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/768: chown d20/d40/l89 14051 1 2024-09-06T14:44:39.369 INFO:tasks.workunit.client.1.smithi165.stdout:1/862: unlink d0/d2a/d18/d24/c2d 0 2024-09-06T14:44:39.370 INFO:tasks.workunit.client.1.smithi165.stdout:7/769: chown d20/d3b/d69/ccc 2 1 2024-09-06T14:44:39.371 INFO:tasks.workunit.client.1.smithi165.stdout:6/950: mkdir d29/d133 0 2024-09-06T14:44:39.375 INFO:tasks.workunit.client.1.smithi165.stdout:9/982: truncate db/de/d15/d17/d72/f76 983253 0 2024-09-06T14:44:39.380 INFO:tasks.workunit.client.0.smithi052.stdout:5/135: dwrite d2/d20/f28 [0,4194304] 0 2024-09-06T14:44:39.381 INFO:tasks.workunit.client.1.smithi165.stdout:3/914: creat d1/f133 x:0 0 0 2024-09-06T14:44:39.381 INFO:tasks.workunit.client.0.smithi052.stdout:2/260: dwrite da/d19/d3a/d31/f43 [0,4194304] 0 2024-09-06T14:44:39.393 INFO:tasks.workunit.client.0.smithi052.stdout:2/261: dwrite da/db/f16 [0,4194304] 0 2024-09-06T14:44:39.399 INFO:tasks.workunit.client.1.smithi165.stdout:9/983: dread db/de/d15/d7f/d9b/d6c/daf/de6/ff4 [0,4194304] 0 2024-09-06T14:44:39.402 INFO:tasks.workunit.client.0.smithi052.stdout:5/136: write d2/f13 [1280130,30491] 0 2024-09-06T14:44:39.406 INFO:tasks.workunit.client.0.smithi052.stdout:5/137: symlink d2/d20/l2c 0 2024-09-06T14:44:39.411 INFO:tasks.workunit.client.0.smithi052.stdout:5/138: getdents d2/d1a/d22/d26/d2b 0 2024-09-06T14:44:39.413 INFO:tasks.workunit.client.0.smithi052.stdout:5/139: creat d2/d1a/f2d x:0 0 0 2024-09-06T14:44:39.417 INFO:tasks.workunit.client.0.smithi052.stdout:5/140: rename d2/l10 to d2/d1a/d22/d26/d2b/l2e 0 2024-09-06T14:44:39.418 INFO:tasks.workunit.client.0.smithi052.stdout:2/262: write da/f1b [4342389,80014] 0 2024-09-06T14:44:39.419 INFO:tasks.workunit.client.0.smithi052.stdout:2/263: stat da/d19/f1a 0 2024-09-06T14:44:39.422 INFO:tasks.workunit.client.0.smithi052.stdout:2/264: creat da/d19/d3a/d31/f5e x:0 0 0 2024-09-06T14:44:39.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.426+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5f641043e0 con 0x7f5f50072950 2024-09-06T14:44:39.424 INFO:tasks.workunit.client.0.smithi052.stdout:5/141: link d2/f12 d2/d1a/d22/d26/d2b/f2f 0 2024-09-06T14:44:39.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.427+0000 7f5f5affd640 1 -- 172.21.15.52:0/3053022168 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f5f641043e0 con 0x7f5f50072950 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [], 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "1/2 daemons upgraded", 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:44:39.425 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:44:39.426 INFO:tasks.workunit.client.0.smithi052.stdout:5/142: symlink d2/d1a/l30 0 2024-09-06T14:44:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.429+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5f50072950 msgr2=0x7f5f50074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5f50072950 0x7f5f50074e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5f641006a0 tx=0x7f5f54005f90 comp rx=0 tx=0).stop 2024-09-06T14:44:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 msgr2=0x7f5f64100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:44:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f64100920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f60006010 tx=0x7f5f60004570 comp rx=0 tx=0).stop 2024-09-06T14:44:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 shutdown_connections 2024-09-06T14:44:39.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5f50072950 0x7f5f50074e10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f64103a00 0x7f5f6419a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 --2- 172.21.15.52:0/3053022168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f641010d0 0x7f5f64100920 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:44:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 >> 172.21.15.52:0/3053022168 conn(0x7f5f640fb350 msgr2=0x7f5f640fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:44:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 shutdown_connections 2024-09-06T14:44:39.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:44:39.430+0000 7f5f6c1c5640 1 -- 172.21.15.52:0/3053022168 wait complete. 2024-09-06T14:44:39.428 INFO:tasks.workunit.client.0.smithi052.stdout:5/143: creat d2/d20/f31 x:0 0 0 2024-09-06T14:44:39.430 INFO:tasks.workunit.client.0.smithi052.stdout:5/144: rmdir d2/d20 39 2024-09-06T14:44:39.432 INFO:tasks.workunit.client.0.smithi052.stdout:5/145: creat d2/d1a/f32 x:0 0 0 2024-09-06T14:44:39.435 INFO:tasks.workunit.client.0.smithi052.stdout:5/146: mknod d2/d1a/c33 0 2024-09-06T14:44:39.438 INFO:tasks.workunit.client.0.smithi052.stdout:5/147: write d2/d20/f31 [209993,82010] 0 2024-09-06T14:44:39.438 INFO:tasks.workunit.client.0.smithi052.stdout:5/148: readlink d2/d1a/l30 0 2024-09-06T14:44:39.441 INFO:tasks.workunit.client.0.smithi052.stdout:5/149: mkdir d2/d34 0 2024-09-06T14:44:39.442 INFO:tasks.workunit.client.1.smithi165.stdout:5/989: mknod d6/d1c/d28/d2d/d3c/c16a 0 2024-09-06T14:44:39.442 INFO:tasks.workunit.client.1.smithi165.stdout:4/936: mknod d5/d1b/d61/d77/d7c/dcd/dc9/c13b 0 2024-09-06T14:44:39.444 INFO:tasks.workunit.client.0.smithi052.stdout:5/150: symlink d2/l35 0 2024-09-06T14:44:39.444 INFO:tasks.workunit.client.0.smithi052.stdout:5/151: readlink d2/d20/l2c 0 2024-09-06T14:44:39.445 INFO:tasks.workunit.client.1.smithi165.stdout:2/851: getdents d9/d88/db8 0 2024-09-06T14:44:39.446 INFO:tasks.workunit.client.0.smithi052.stdout:5/152: write d2/f7 [158510,103410] 0 2024-09-06T14:44:39.446 INFO:tasks.workunit.client.1.smithi165.stdout:2/852: read - d9/d23/d29/d48/db1/f119 zero size 2024-09-06T14:44:39.446 INFO:tasks.workunit.client.1.smithi165.stdout:3/915: fsync d1/da/dd/f1c 0 2024-09-06T14:44:39.446 INFO:tasks.workunit.client.0.smithi052.stdout:5/153: fdatasync d2/ff 0 2024-09-06T14:44:39.447 INFO:tasks.workunit.client.1.smithi165.stdout:9/984: rmdir db/de/d15 39 2024-09-06T14:44:39.449 INFO:tasks.workunit.client.1.smithi165.stdout:8/937: creat d0/d19/d36/d2d/f147 x:0 0 0 2024-09-06T14:44:39.450 INFO:tasks.workunit.client.1.smithi165.stdout:0/850: mknod d15/d6e/dcc/c118 0 2024-09-06T14:44:39.451 INFO:tasks.workunit.client.1.smithi165.stdout:0/851: fsync d15/d19/d28/d4f/f9b 0 2024-09-06T14:44:39.453 INFO:tasks.workunit.client.1.smithi165.stdout:5/990: mkdir d6/d1c/d28/d4b/d55/d8a/da5/dd6/d16b 0 2024-09-06T14:44:39.455 INFO:tasks.workunit.client.1.smithi165.stdout:4/937: write d5/d1b/d1c/d41/ff3 [1025278,39265] 0 2024-09-06T14:44:39.457 INFO:tasks.workunit.client.0.smithi052.stdout:5/154: dread d2/f18 [0,4194304] 0 2024-09-06T14:44:39.458 INFO:tasks.workunit.client.1.smithi165.stdout:3/916: mknod d1/d7c/d7e/c134 0 2024-09-06T14:44:39.460 INFO:tasks.workunit.client.1.smithi165.stdout:8/938: unlink d0/d19/d36/d2d/d3f/c40 0 2024-09-06T14:44:39.461 INFO:tasks.workunit.client.1.smithi165.stdout:1/863: rmdir d0/d1c/dd5 39 2024-09-06T14:44:39.462 INFO:tasks.workunit.client.0.smithi052.stdout:5/155: dread d2/f24 [0,4194304] 0 2024-09-06T14:44:39.462 INFO:tasks.workunit.client.1.smithi165.stdout:0/852: creat d15/d19/d28/d3a/d5d/dd6/f119 x:0 0 0 2024-09-06T14:44:39.464 INFO:tasks.workunit.client.1.smithi165.stdout:7/770: link d20/d33/d6a/cf0 d20/d3b/d69/d88/d80/dd3/cf6 0 2024-09-06T14:44:39.466 INFO:tasks.workunit.client.1.smithi165.stdout:6/951: rename d29/f41 to d29/d39/d5b/d62/d94/f134 0 2024-09-06T14:44:39.467 INFO:tasks.workunit.client.1.smithi165.stdout:4/938: rmdir d5/d1b/d1c/d8c/d106/d11c/dfc 39 2024-09-06T14:44:39.468 INFO:tasks.workunit.client.1.smithi165.stdout:9/985: mknod db/c13c 0 2024-09-06T14:44:39.469 INFO:tasks.workunit.client.0.smithi052.stdout:5/156: dwrite d2/f12 [0,4194304] 0 2024-09-06T14:44:39.469 INFO:tasks.workunit.client.1.smithi165.stdout:3/917: mkdir d1/d19/df8/d135 0 2024-09-06T14:44:39.476 INFO:tasks.workunit.client.0.smithi052.stdout:5/157: dwrite d2/d20/f23 [0,4194304] 0 2024-09-06T14:44:39.544 INFO:tasks.workunit.client.1.smithi165.stdout:7/771: fdatasync d20/f21 0 2024-09-06T14:44:39.546 INFO:tasks.workunit.client.1.smithi165.stdout:2/853: rename d9/d23/d29 to d9/d25/d46/d7e/d11d 0 2024-09-06T14:44:39.550 INFO:tasks.workunit.client.1.smithi165.stdout:7/772: dwrite d20/d3b/d69/d88/f4e [4194304,4194304] 0 2024-09-06T14:44:39.550 INFO:tasks.workunit.client.0.smithi052.stdout:5/158: rmdir d2/d34 0 2024-09-06T14:44:39.552 INFO:tasks.workunit.client.1.smithi165.stdout:3/918: creat d1/d19/df8/f136 x:0 0 0 2024-09-06T14:44:39.552 INFO:tasks.workunit.client.1.smithi165.stdout:1/864: mkdir d0/d2a/d18/d24/d4b/d93/d97/d11b 0 2024-09-06T14:44:39.554 INFO:tasks.workunit.client.1.smithi165.stdout:5/991: creat d6/d1c/d28/d4b/d10b/d165/ddf/df6/f16c x:0 0 0 2024-09-06T14:44:39.554 INFO:tasks.workunit.client.1.smithi165.stdout:1/865: write d0/d2a/d18/d24/d4b/d95/ff9 [1024793,8270] 0 2024-09-06T14:44:39.557 INFO:tasks.workunit.client.0.smithi052.stdout:5/159: unlink d2/fd 0 2024-09-06T14:44:39.560 INFO:tasks.workunit.client.1.smithi165.stdout:5/992: dwrite d6/d1c/d28/d4b/da7/dab/f128 [0,4194304] 0 2024-09-06T14:44:39.562 INFO:tasks.workunit.client.1.smithi165.stdout:2/854: rmdir d9/d25/d46/d7e/d11d/d48/db1 39 2024-09-06T14:44:39.566 INFO:tasks.workunit.client.1.smithi165.stdout:2/855: read d9/f12 [3859369,98706] 0 2024-09-06T14:44:39.566 INFO:tasks.workunit.client.1.smithi165.stdout:7/773: symlink d20/d4d/dd4/lf7 0 2024-09-06T14:44:39.570 INFO:tasks.workunit.client.1.smithi165.stdout:3/919: mkdir d1/da/dc/d3b/d137 0 2024-09-06T14:44:39.570 INFO:tasks.workunit.client.1.smithi165.stdout:3/920: chown d1/d19/df8/ffe 824909 1 2024-09-06T14:44:39.571 INFO:tasks.workunit.client.1.smithi165.stdout:3/921: chown d1/d19/d92/cec 15417 1 2024-09-06T14:44:39.572 INFO:tasks.workunit.client.0.smithi052.stdout:5/160: getdents d2/d1a/d22/d26 0 2024-09-06T14:44:39.573 INFO:tasks.workunit.client.0.smithi052.stdout:5/161: write d2/d20/f31 [1142422,116326] 0 2024-09-06T14:44:39.574 INFO:tasks.workunit.client.1.smithi165.stdout:0/853: creat d15/d19/d28/d51/f11a x:0 0 0 2024-09-06T14:44:39.575 INFO:tasks.workunit.client.1.smithi165.stdout:1/866: symlink d0/d1c/d1d/d22/l11c 0 2024-09-06T14:44:39.578 INFO:tasks.workunit.client.1.smithi165.stdout:3/922: dwrite d1/da/dc/f5c [0,4194304] 0 2024-09-06T14:44:39.580 INFO:tasks.workunit.client.1.smithi165.stdout:7/774: creat d20/d33/d53/d66/ff8 x:0 0 0 2024-09-06T14:44:39.581 INFO:tasks.workunit.client.1.smithi165.stdout:2/856: creat d9/d25/d46/d7e/d11d/d48/dce/dfc/f11e x:0 0 0 2024-09-06T14:44:39.584 INFO:tasks.workunit.client.1.smithi165.stdout:5/993: dread d6/d1c/d28/fb8 [0,4194304] 0 2024-09-06T14:44:39.587 INFO:tasks.workunit.client.1.smithi165.stdout:8/939: rename d0/d19/d36/d28/d64/fdf to d0/d14/d3e/f148 0 2024-09-06T14:44:39.589 INFO:tasks.workunit.client.1.smithi165.stdout:9/986: link db/de/d15/d17/d72/d9e/fd6 db/de/d15/d17/d72/f13d 0 2024-09-06T14:44:39.592 INFO:tasks.workunit.client.0.smithi052.stdout:5/162: write d2/f12 [415632,55939] 0 2024-09-06T14:44:39.593 INFO:tasks.workunit.client.0.smithi052.stdout:5/163: dread - d2/d1a/d22/d26/f27 zero size 2024-09-06T14:44:39.597 INFO:tasks.workunit.client.0.smithi052.stdout:5/164: dread d2/d20/f23 [4194304,4194304] 0 2024-09-06T14:44:39.597 INFO:tasks.workunit.client.0.smithi052.stdout:5/165: chown d2 16366 1 2024-09-06T14:44:39.598 INFO:tasks.workunit.client.1.smithi165.stdout:9/987: write db/de/d15/d7f/d9b/d6c/daf/de6/ff4 [1341236,72335] 0 2024-09-06T14:44:39.600 INFO:tasks.workunit.client.1.smithi165.stdout:5/994: mkdir d6/d1c/d16d 0 2024-09-06T14:44:39.601 INFO:tasks.workunit.client.0.smithi052.stdout:5/166: symlink d2/d1a/d22/d26/l36 0 2024-09-06T14:44:39.602 INFO:tasks.workunit.client.1.smithi165.stdout:1/867: dread d0/fa4 [0,4194304] 0 2024-09-06T14:44:39.603 INFO:tasks.workunit.client.1.smithi165.stdout:0/854: getdents d15/d19/d38 0 2024-09-06T14:44:39.606 INFO:tasks.workunit.client.1.smithi165.stdout:4/939: dwrite d5/f50 [0,4194304] 0 2024-09-06T14:44:39.607 INFO:tasks.workunit.client.0.smithi052.stdout:5/167: dwrite d2/d20/f28 [0,4194304] 0 2024-09-06T14:44:39.607 INFO:tasks.workunit.client.1.smithi165.stdout:6/952: rename d29/d39/d5b/d62/d94/db7 to d29/d39/d5b/d62/d135 0 2024-09-06T14:44:39.610 INFO:tasks.workunit.client.1.smithi165.stdout:2/857: getdents d9/d25/d46/d7e/d11d/d48/d8c/dbf 0 2024-09-06T14:44:39.610 INFO:tasks.workunit.client.1.smithi165.stdout:4/940: truncate d5/d1b/d61/dd7/ddf/ddc/f100 491630 0 2024-09-06T14:44:39.611 INFO:tasks.workunit.client.1.smithi165.stdout:1/868: mkdir d0/d2a/d18/d24/d4b/d5f/d7c/d11d 0 2024-09-06T14:44:39.613 INFO:tasks.workunit.client.1.smithi165.stdout:0/855: creat d15/d19/d28/d9e/da3/de5/f11b x:0 0 0 2024-09-06T14:44:39.613 INFO:tasks.workunit.client.1.smithi165.stdout:1/869: read d0/d1c/d1d/fb2 [223980,15372] 0 2024-09-06T14:44:39.614 INFO:tasks.workunit.client.0.smithi052.stdout:5/168: dwrite d2/f13 [0,4194304] 0 2024-09-06T14:44:39.615 INFO:tasks.workunit.client.1.smithi165.stdout:2/858: write d9/d25/d46/d7e/d11d/d48/d8c/fff [464122,60660] 0 2024-09-06T14:44:39.616 INFO:tasks.workunit.client.0.smithi052.stdout:5/169: write d2/d20/f28 [2389706,126884] 0 2024-09-06T14:44:39.616 INFO:tasks.workunit.client.1.smithi165.stdout:4/941: write d5/d1b/d61/d77/d7c/fd2 [3780314,79816] 0 2024-09-06T14:44:39.617 INFO:tasks.workunit.client.1.smithi165.stdout:0/856: chown d15/d19/d2c/df1/d104 11 1 2024-09-06T14:44:39.617 INFO:tasks.workunit.client.0.smithi052.stdout:5/170: write d2/d1a/d22/d26/d2b/f2f [2708644,8478] 0 2024-09-06T14:44:39.618 INFO:tasks.workunit.client.1.smithi165.stdout:5/995: creat d6/d1c/d28/d4b/d55/d8a/da5/dd6/d16b/f16e x:0 0 0 2024-09-06T14:44:39.619 INFO:tasks.workunit.client.1.smithi165.stdout:7/775: rename d20/d3b/d69/dd1 to d20/d4d/d54/dc1/df9 0 2024-09-06T14:44:39.622 INFO:tasks.workunit.client.1.smithi165.stdout:0/857: read d15/d19/d50/d53/dbf/fe7 [43646,67204] 0 2024-09-06T14:44:39.623 INFO:tasks.workunit.client.0.smithi052.stdout:5/171: mkdir d2/d1a/d22/d26/d2b/d37 0 2024-09-06T14:44:39.626 INFO:tasks.workunit.client.1.smithi165.stdout:1/870: unlink d0/d1c/d40/f7a 0 2024-09-06T14:44:39.629 INFO:tasks.workunit.client.1.smithi165.stdout:2/859: mkdir d9/d25/d45/d75/d34/d11f 0 2024-09-06T14:44:39.631 INFO:tasks.workunit.client.1.smithi165.stdout:7/776: chown d20/d3b/d69/d88/d80/d81/lf5 21 1 2024-09-06T14:44:39.633 INFO:tasks.workunit.client.0.smithi052.stdout:5/172: creat d2/f38 x:0 0 0 2024-09-06T14:44:39.635 INFO:tasks.workunit.client.1.smithi165.stdout:5/996: chown d6/d1c/d28/d2d/d3c/d109/f152 18489854 1 2024-09-06T14:44:39.636 INFO:tasks.workunit.client.1.smithi165.stdout:2/860: rename d9/d25/d45/d75/d67 to d9/d25/d45/d120 0 2024-09-06T14:44:39.637 INFO:tasks.workunit.client.1.smithi165.stdout:8/940: fsync d0/d19/d36/d28/dda/f118 0 2024-09-06T14:44:39.637 INFO:tasks.workunit.client.1.smithi165.stdout:2/861: stat d9/d25/d45/d75/d34/d117 0 2024-09-06T14:44:39.638 INFO:tasks.workunit.client.0.smithi052.stdout:5/173: dwrite d2/f16 [0,4194304] 0 2024-09-06T14:44:39.639 INFO:tasks.workunit.client.1.smithi165.stdout:7/777: unlink d20/d65/d82/d97/lc3 0 2024-09-06T14:44:39.642 INFO:tasks.workunit.client.1.smithi165.stdout:5/997: creat d6/d1c/d28/d88/d105/f16f x:0 0 0 2024-09-06T14:44:39.645 INFO:tasks.workunit.client.1.smithi165.stdout:2/862: rename d9/d25/d46/d7e/d90/fcb to d9/d25/d45/d75/d34/d117/d78/f121 0 2024-09-06T14:44:39.646 INFO:tasks.workunit.client.0.smithi052.stdout:5/174: mknod d2/d1a/d22/d26/d2b/d37/c39 0 2024-09-06T14:44:39.646 INFO:tasks.workunit.client.0.smithi052.stdout:5/175: readlink d2/d1a/l30 0 2024-09-06T14:44:39.648 INFO:tasks.workunit.client.1.smithi165.stdout:6/953: dread f1e [0,4194304] 0 2024-09-06T14:44:39.651 INFO:tasks.workunit.client.1.smithi165.stdout:9/988: write db/de/d15/d17/d18/d7d/d61/ff7 [308306,21977] 0 2024-09-06T14:44:39.653 INFO:tasks.workunit.client.1.smithi165.stdout:5/998: dread d6/dc1/fcf [0,4194304] 0 2024-09-06T14:44:39.655 INFO:tasks.workunit.client.0.smithi052.stdout:5/176: fsync d2/f38 0 2024-09-06T14:44:39.656 INFO:tasks.workunit.client.1.smithi165.stdout:3/923: dwrite d1/da/dc/d3b/d71/fd9 [0,4194304] 0 2024-09-06T14:44:39.658 INFO:tasks.workunit.client.0.smithi052.stdout:5/177: rename d2/d1a/d22/d26/f27 to d2/d1a/f3a 0 2024-09-06T14:44:39.658 INFO:tasks.workunit.client.0.smithi052.stdout:5/178: readlink d2/l21 0 2024-09-06T14:44:39.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/179: chown d2/d1a/c33 228230 1 2024-09-06T14:44:39.659 INFO:tasks.workunit.client.1.smithi165.stdout:7/778: dwrite d20/d3b/d69/d88/fde [0,4194304] 0 2024-09-06T14:44:39.659 INFO:tasks.workunit.client.1.smithi165.stdout:4/942: dread d5/d1b/d1c/ff1 [0,4194304] 0 2024-09-06T14:44:39.660 INFO:tasks.workunit.client.0.smithi052.stdout:5/180: dread - d2/d1a/f32 zero size 2024-09-06T14:44:39.660 INFO:tasks.workunit.client.0.smithi052.stdout:5/181: chown d2/c1f 7 1 2024-09-06T14:44:39.661 INFO:tasks.workunit.client.1.smithi165.stdout:8/941: write d0/d14/d3e/f35 [886974,114970] 0 2024-09-06T14:44:39.663 INFO:tasks.workunit.client.1.smithi165.stdout:9/989: unlink db/de/d15/d17/d18/d7d/d61/fab 0 2024-09-06T14:44:39.665 INFO:tasks.workunit.client.1.smithi165.stdout:9/990: chown db/de/d15/d17/d18/fb3 268802 1 2024-09-06T14:44:39.667 INFO:tasks.workunit.client.1.smithi165.stdout:3/924: symlink d1/d41/da1/l138 0 2024-09-06T14:44:39.668 INFO:tasks.workunit.client.1.smithi165.stdout:1/871: link d0/d45/c10d d0/d2a/d18/d24/d4b/d93/d68/dae/c11e 0 2024-09-06T14:44:39.670 INFO:tasks.workunit.client.1.smithi165.stdout:0/858: dread f8 [4194304,4194304] 0 2024-09-06T14:44:39.671 INFO:tasks.workunit.client.0.smithi052.stdout:5/182: rename d2/l15 to d2/l3b 0 2024-09-06T14:44:39.672 INFO:tasks.workunit.client.1.smithi165.stdout:4/943: rmdir d5/d1b/d61/d77/d93 39 2024-09-06T14:44:39.674 INFO:tasks.workunit.client.1.smithi165.stdout:8/942: mknod d0/d19/d36/d28/de0/c149 0 2024-09-06T14:44:39.675 INFO:tasks.workunit.client.0.smithi052.stdout:5/183: mknod d2/d1a/d22/d26/c3c 0 2024-09-06T14:44:39.676 INFO:tasks.workunit.client.1.smithi165.stdout:2/863: dread d9/f13 [4194304,4194304] 0 2024-09-06T14:44:39.677 INFO:tasks.workunit.client.1.smithi165.stdout:9/991: creat db/de/d15/d17/d18/d59/d64/f13e x:0 0 0 2024-09-06T14:44:39.678 INFO:tasks.workunit.client.1.smithi165.stdout:3/925: creat d1/da/dc/d3b/d83/d86/f139 x:0 0 0 2024-09-06T14:44:39.678 INFO:tasks.workunit.client.1.smithi165.stdout:1/872: dwrite d0/d2a/d18/d24/d4b/d93/dbd/dd1/f109 [0,4194304] 0 2024-09-06T14:44:39.681 INFO:tasks.workunit.client.1.smithi165.stdout:3/926: chown d1/dbd/dfd/l10f 7 1 2024-09-06T14:44:39.681 INFO:tasks.workunit.client.1.smithi165.stdout:6/954: dread f22 [0,4194304] 0 2024-09-06T14:44:39.682 INFO:tasks.workunit.client.1.smithi165.stdout:6/955: readlink ld 0 2024-09-06T14:44:39.683 INFO:tasks.workunit.client.0.smithi052.stdout:5/184: link d2/d20/f29 d2/d1a/f3d 0 2024-09-06T14:44:39.683 INFO:tasks.workunit.client.1.smithi165.stdout:3/927: write d1/f133 [350048,121111] 0 2024-09-06T14:44:39.687 INFO:tasks.workunit.client.1.smithi165.stdout:8/943: mkdir d0/d34/d6b/d94/d70/de9/d14a 0 2024-09-06T14:44:39.687 INFO:tasks.workunit.client.1.smithi165.stdout:5/999: write d6/d1c/d28/d2d/d3c/d109/f152 [2380291,25628] 0 2024-09-06T14:44:39.688 INFO:tasks.workunit.client.1.smithi165.stdout:2/864: mknod d9/d25/d45/d75/d34/d117/d78/c122 0 2024-09-06T14:44:39.689 INFO:tasks.workunit.client.1.smithi165.stdout:1/873: truncate d0/d1c/d1d/d57/fd0 727675 0 2024-09-06T14:44:39.690 INFO:tasks.workunit.client.1.smithi165.stdout:2/865: dread - d9/d88/db8/d101/f115 zero size 2024-09-06T14:44:39.692 INFO:tasks.workunit.client.1.smithi165.stdout:9/992: mknod db/de/d15/d7f/d9b/d6c/c13f 0 2024-09-06T14:44:39.693 INFO:tasks.workunit.client.1.smithi165.stdout:8/944: readlink d0/d14/ld4 0 2024-09-06T14:44:39.695 INFO:tasks.workunit.client.1.smithi165.stdout:7/779: dwrite d20/d33/d53/f7f [0,4194304] 0 2024-09-06T14:44:39.697 INFO:tasks.workunit.client.1.smithi165.stdout:8/945: chown d0/d19/d24/db1/d5b/d125/d12b 6989512 1 2024-09-06T14:44:39.698 INFO:tasks.workunit.client.1.smithi165.stdout:0/859: write f8 [105521,38336] 0 2024-09-06T14:44:39.698 INFO:tasks.workunit.client.1.smithi165.stdout:2/866: symlink d9/d25/d46/d7e/d11d/d48/d8c/dbf/l123 0 2024-09-06T14:44:39.699 INFO:tasks.workunit.client.1.smithi165.stdout:9/993: mknod db/de/d15/d7f/d9b/d6c/daf/de6/c140 0 2024-09-06T14:44:39.702 INFO:tasks.workunit.client.1.smithi165.stdout:6/956: dwrite d29/d6a/f8f [0,4194304] 0 2024-09-06T14:44:39.702 INFO:tasks.workunit.client.1.smithi165.stdout:8/946: symlink d0/d5e/l14b 0 2024-09-06T14:44:39.706 INFO:tasks.workunit.client.1.smithi165.stdout:4/944: dread d5/d1b/d1c/f60 [0,4194304] 0 2024-09-06T14:44:39.707 INFO:tasks.workunit.client.1.smithi165.stdout:0/860: creat d15/d19/d50/d53/d7c/dbb/f11c x:0 0 0 2024-09-06T14:44:39.710 INFO:tasks.workunit.client.1.smithi165.stdout:2/867: mknod d9/d25/d46/d7e/d11d/d48/dce/dfc/c124 0 2024-09-06T14:44:39.710 INFO:tasks.workunit.client.1.smithi165.stdout:1/874: truncate d0/d1c/d1d/d57/fd0 104645 0 2024-09-06T14:44:39.712 INFO:tasks.workunit.client.1.smithi165.stdout:8/947: creat d0/d5e/f14c x:0 0 0 2024-09-06T14:44:39.712 INFO:tasks.workunit.client.1.smithi165.stdout:3/928: dwrite d1/d19/f49 [0,4194304] 0 2024-09-06T14:44:39.713 INFO:tasks.workunit.client.1.smithi165.stdout:9/994: dread - db/de/d15/d91/fb7 zero size 2024-09-06T14:44:39.715 INFO:tasks.workunit.client.1.smithi165.stdout:4/945: creat d5/d1b/d1c/d41/d9e/f13c x:0 0 0 2024-09-06T14:44:39.717 INFO:tasks.workunit.client.1.smithi165.stdout:0/861: getdents d15/d19/d66/df8/dfd 0 2024-09-06T14:44:39.719 INFO:tasks.workunit.client.1.smithi165.stdout:1/875: rename d0/d2a/d18/d24/d4b/d93/d2b/d3e/d98/f101 to d0/d2a/d18/d24/d4b/d5f/d7c/d11d/f11f 0 2024-09-06T14:44:39.719 INFO:tasks.workunit.client.1.smithi165.stdout:2/868: mkdir d9/d25/d46/d7e/d11d/d11c/d125 0 2024-09-06T14:44:39.720 INFO:tasks.workunit.client.1.smithi165.stdout:3/929: mkdir d1/d19/d92/d13a 0 2024-09-06T14:44:39.721 INFO:tasks.workunit.client.1.smithi165.stdout:4/946: mkdir d5/d1b/d1c/d55/d13d 0 2024-09-06T14:44:39.722 INFO:tasks.workunit.client.1.smithi165.stdout:4/947: readlink d5/d1b/d61/dd7/ddf/lec 0 2024-09-06T14:44:39.722 INFO:tasks.workunit.client.1.smithi165.stdout:1/876: dread - d0/d2a/d18/d24/d4b/d93/d68/dae/fc4 zero size 2024-09-06T14:44:39.723 INFO:tasks.workunit.client.1.smithi165.stdout:4/948: fsync d5/d1b/d1c/d78/f91 0 2024-09-06T14:44:39.726 INFO:tasks.workunit.client.1.smithi165.stdout:0/862: mkdir d15/d19/d50/d53/d8d/d10b/d11d 0 2024-09-06T14:44:39.727 INFO:tasks.workunit.client.1.smithi165.stdout:9/995: write db/d40/f88 [105046,30232] 0 2024-09-06T14:44:39.728 INFO:tasks.workunit.client.1.smithi165.stdout:0/863: read - d15/d19/d50/d53/d7c/dbb/f11c zero size 2024-09-06T14:44:39.728 INFO:tasks.workunit.client.1.smithi165.stdout:4/949: mkdir d5/d1b/d1c/d55/d13e 0 2024-09-06T14:44:39.729 INFO:tasks.workunit.client.1.smithi165.stdout:0/864: stat d15/d19/d28/d51/ceb 0 2024-09-06T14:44:39.730 INFO:tasks.workunit.client.1.smithi165.stdout:3/930: rename d1/d19/d92/lbb to d1/da/l13b 0 2024-09-06T14:44:39.730 INFO:tasks.workunit.client.1.smithi165.stdout:1/877: dread d0/d2a/d18/d24/d4b/d93/d2b/fad [0,4194304] 0 2024-09-06T14:44:39.732 INFO:tasks.workunit.client.1.smithi165.stdout:9/996: creat db/de/d15/d91/df5/f141 x:0 0 0 2024-09-06T14:44:39.733 INFO:tasks.workunit.client.1.smithi165.stdout:3/931: mkdir d1/d7c/d13c 0 2024-09-06T14:44:39.733 INFO:tasks.workunit.client.1.smithi165.stdout:4/950: mknod d5/d1b/d61/d77/d93/c13f 0 2024-09-06T14:44:39.737 INFO:tasks.workunit.client.1.smithi165.stdout:0/865: dwrite d15/d55/f84 [0,4194304] 0 2024-09-06T14:44:39.737 INFO:tasks.workunit.client.1.smithi165.stdout:3/932: mkdir d1/da/dc/d3b/dc6/d13d 0 2024-09-06T14:44:39.738 INFO:tasks.workunit.client.1.smithi165.stdout:0/866: write d15/d19/d50/fec [766741,50515] 0 2024-09-06T14:44:39.738 INFO:tasks.workunit.client.1.smithi165.stdout:3/933: readlink d1/da/dc/l94 0 2024-09-06T14:44:39.740 INFO:tasks.workunit.client.1.smithi165.stdout:2/869: rename d9/d25/d45/d75/d34/d117/d78/c10b to d9/d23/c126 0 2024-09-06T14:44:39.746 INFO:tasks.workunit.client.1.smithi165.stdout:9/997: rename db/de/d16/d2e/da7/cee to db/de/d15/d7f/dbc/d104/c142 0 2024-09-06T14:44:39.747 INFO:tasks.workunit.client.1.smithi165.stdout:9/998: write db/d40/f88 [976364,64292] 0 2024-09-06T14:44:39.748 INFO:tasks.workunit.client.1.smithi165.stdout:3/934: creat d1/da/dc/d3b/d137/f13e x:0 0 0 2024-09-06T14:44:39.749 INFO:tasks.workunit.client.1.smithi165.stdout:3/935: stat d1/dbd/fda 0 2024-09-06T14:44:39.750 INFO:tasks.workunit.client.1.smithi165.stdout:0/867: creat d15/d19/d50/d53/dbf/dc5/f11e x:0 0 0 2024-09-06T14:44:39.751 INFO:tasks.workunit.client.1.smithi165.stdout:4/951: link d5/d1b/d1c/d20/cbe d5/d1b/d61/dd7/ddf/ddc/c140 0 2024-09-06T14:44:39.752 INFO:tasks.workunit.client.1.smithi165.stdout:9/999: rename db/f1c to db/de/d15/d17/d18/d59/d64/f143 0 2024-09-06T14:44:39.754 INFO:tasks.workunit.client.1.smithi165.stdout:3/936: dread d1/da/dc/d3b/f82 [0,4194304] 0 2024-09-06T14:44:39.758 INFO:tasks.workunit.client.1.smithi165.stdout:3/937: creat d1/d19/f13f x:0 0 0 2024-09-06T14:44:39.758 INFO:tasks.workunit.client.1.smithi165.stdout:3/938: dread - d1/d4a/dc7/f12d zero size 2024-09-06T14:44:39.758 INFO:tasks.workunit.client.1.smithi165.stdout:2/870: write d9/fc [87460,32442] 0 2024-09-06T14:44:39.761 INFO:tasks.workunit.client.1.smithi165.stdout:3/939: mkdir d1/da/dd/d4b/d140 0 2024-09-06T14:44:39.762 INFO:tasks.workunit.client.1.smithi165.stdout:3/940: write d1/da/dc/d10/fd4 [677467,33092] 0 2024-09-06T14:44:39.765 INFO:tasks.workunit.client.1.smithi165.stdout:2/871: dread d9/d25/d45/d75/d34/f6c [0,4194304] 0 2024-09-06T14:44:39.766 INFO:tasks.workunit.client.1.smithi165.stdout:4/952: dread d5/d1b/d61/dd7/ddf/f38 [0,4194304] 0 2024-09-06T14:44:39.767 INFO:tasks.workunit.client.1.smithi165.stdout:2/872: creat d9/d25/d46/d7e/d11d/f127 x:0 0 0 2024-09-06T14:44:39.769 INFO:tasks.workunit.client.1.smithi165.stdout:4/953: chown d5/d1b/d1c/d41/l10c 9569819 1 2024-09-06T14:44:39.769 INFO:tasks.workunit.client.1.smithi165.stdout:3/941: dwrite d1/da/dc/d3b/d83/d86/f139 [0,4194304] 0 2024-09-06T14:44:39.771 INFO:tasks.workunit.client.1.smithi165.stdout:2/873: rmdir d9/d25/d46/d7e/d90/dd8/ddb 39 2024-09-06T14:44:39.773 INFO:tasks.workunit.client.1.smithi165.stdout:3/942: creat d1/d4a/dc7/f141 x:0 0 0 2024-09-06T14:44:39.774 INFO:tasks.workunit.client.1.smithi165.stdout:4/954: creat d5/d1b/d61/dd7/ddf/f141 x:0 0 0 2024-09-06T14:44:39.774 INFO:tasks.workunit.client.1.smithi165.stdout:3/943: write d1/d4a/dc7/fdf [1027262,19348] 0 2024-09-06T14:44:39.775 INFO:tasks.workunit.client.1.smithi165.stdout:2/874: creat d9/d25/d45/d120/dd1/de6/f128 x:0 0 0 2024-09-06T14:44:39.777 INFO:tasks.workunit.client.1.smithi165.stdout:3/944: creat d1/da/dc/d3b/d137/f142 x:0 0 0 2024-09-06T14:44:39.778 INFO:tasks.workunit.client.1.smithi165.stdout:3/945: fsync d1/f133 0 2024-09-06T14:44:39.779 INFO:tasks.workunit.client.1.smithi165.stdout:2/875: creat d9/d25/d46/d7e/d11d/d48/dce/f129 x:0 0 0 2024-09-06T14:44:39.779 INFO:tasks.workunit.client.1.smithi165.stdout:2/876: truncate d9/fc 4666031 0 2024-09-06T14:44:39.781 INFO:tasks.workunit.client.1.smithi165.stdout:2/877: fsync d9/d25/d46/d7e/d11d/f2b 0 2024-09-06T14:44:39.783 INFO:tasks.workunit.client.1.smithi165.stdout:4/955: link d5/d1b/d61/d77/d7c/dcd/dc9/d105/c121 d5/d1b/d1c/d20/c142 0 2024-09-06T14:44:39.785 INFO:tasks.workunit.client.1.smithi165.stdout:2/878: creat d9/d25/d46/d7e/d11d/d48/d8c/f12a x:0 0 0 2024-09-06T14:44:39.785 INFO:tasks.workunit.client.1.smithi165.stdout:3/946: dwrite d1/d19/f13f [0,4194304] 0 2024-09-06T14:44:39.785 INFO:tasks.workunit.client.1.smithi165.stdout:4/956: fsync d5/d1b/d1c/d8c/fe4 0 2024-09-06T14:44:39.786 INFO:tasks.workunit.client.1.smithi165.stdout:3/947: fdatasync d1/d19/df8/f136 0 2024-09-06T14:44:39.789 INFO:tasks.workunit.client.1.smithi165.stdout:4/957: chown d5/d1b/d1c/fa0 8016639 1 2024-09-06T14:44:39.790 INFO:tasks.workunit.client.1.smithi165.stdout:4/958: fsync d5/d1b/d1c/d20/d75/d83/fb1 0 2024-09-06T14:44:39.790 INFO:tasks.workunit.client.1.smithi165.stdout:2/879: symlink d9/d25/d46/d7e/d11d/d48/d8c/l12b 0 2024-09-06T14:44:39.792 INFO:tasks.workunit.client.1.smithi165.stdout:3/948: mkdir d1/da/dd/d4b/d143 0 2024-09-06T14:44:39.793 INFO:tasks.workunit.client.1.smithi165.stdout:4/959: rmdir d5/d1b/d1c/d20/d75/d83 39 2024-09-06T14:44:39.794 INFO:tasks.workunit.client.1.smithi165.stdout:3/949: chown d1/da/dc/d3b/d83/fb6 4072 1 2024-09-06T14:44:39.797 INFO:tasks.workunit.client.1.smithi165.stdout:4/960: creat d5/d1b/d1c/db0/f143 x:0 0 0 2024-09-06T14:44:39.800 INFO:tasks.workunit.client.1.smithi165.stdout:4/961: fsync d5/d1b/d61/d77/d93/f107 0 2024-09-06T14:44:39.800 INFO:tasks.workunit.client.1.smithi165.stdout:3/950: link d1/d4a/db4/c129 d1/d7c/ded/c144 0 2024-09-06T14:44:39.801 INFO:tasks.workunit.client.1.smithi165.stdout:2/880: dwrite d9/d25/d45/d120/f92 [8388608,4194304] 0 2024-09-06T14:44:39.804 INFO:tasks.workunit.client.1.smithi165.stdout:3/951: fsync d1/da/dd/fa0 0 2024-09-06T14:44:39.807 INFO:tasks.workunit.client.1.smithi165.stdout:2/881: dread d9/d23/d71/fb0 [0,4194304] 0 2024-09-06T14:44:39.807 INFO:tasks.workunit.client.1.smithi165.stdout:3/952: creat d1/da/dc/d10/f145 x:0 0 0 2024-09-06T14:44:39.808 INFO:tasks.workunit.client.1.smithi165.stdout:4/962: dwrite d5/f2b [0,4194304] 0 2024-09-06T14:44:39.809 INFO:tasks.workunit.client.1.smithi165.stdout:2/882: dread - d9/d25/d45/d120/dd1/fd5 zero size 2024-09-06T14:44:39.812 INFO:tasks.workunit.client.1.smithi165.stdout:2/883: dread - d9/d25/d46/d7e/d11d/d48/dce/dfc/fda zero size 2024-09-06T14:44:39.813 INFO:tasks.workunit.client.1.smithi165.stdout:3/953: rename d1/da/dc/d10/ff2 to d1/da/dc/d3b/d71/f146 0 2024-09-06T14:44:39.816 INFO:tasks.workunit.client.1.smithi165.stdout:4/963: dread d5/d1b/d1c/d20/d75/d83/f12c [0,4194304] 0 2024-09-06T14:44:39.819 INFO:tasks.workunit.client.1.smithi165.stdout:2/884: creat d9/d25/d46/d7e/d11d/d11c/d125/f12c x:0 0 0 2024-09-06T14:44:39.826 INFO:tasks.workunit.client.1.smithi165.stdout:4/964: link d5/d1b/d61/dd7/ddf/ddc/c140 d5/d1b/d1c/d8c/d106/c144 0 2024-09-06T14:44:39.826 INFO:tasks.workunit.client.1.smithi165.stdout:2/885: dwrite d9/d25/d45/d120/dd1/de6/f128 [0,4194304] 0 2024-09-06T14:44:39.827 INFO:tasks.workunit.client.1.smithi165.stdout:4/965: stat d5/d1b/c3f 0 2024-09-06T14:44:39.828 INFO:tasks.workunit.client.1.smithi165.stdout:2/886: dread - d9/d25/d45/d120/fe3 zero size 2024-09-06T14:44:39.830 INFO:tasks.workunit.client.1.smithi165.stdout:2/887: read d9/d25/fa3 [361732,108995] 0 2024-09-06T14:44:39.832 INFO:tasks.workunit.client.1.smithi165.stdout:2/888: truncate d9/d25/d45/d120/dd1/de6/f128 5087881 0 2024-09-06T14:44:39.832 INFO:tasks.workunit.client.1.smithi165.stdout:2/889: readlink l4 0 2024-09-06T14:44:39.834 INFO:tasks.workunit.client.1.smithi165.stdout:4/966: fsync d5/d1b/d1c/fa4 0 2024-09-06T14:44:39.834 INFO:tasks.workunit.client.1.smithi165.stdout:4/967: chown d5/cd 0 1 2024-09-06T14:44:39.836 INFO:tasks.workunit.client.1.smithi165.stdout:2/890: fdatasync d9/d25/d45/d75/d34/d117/d78/f121 0 2024-09-06T14:44:39.836 INFO:tasks.workunit.client.1.smithi165.stdout:3/954: dread d1/da/dd/d4b/f6e [0,4194304] 0 2024-09-06T14:44:39.840 INFO:tasks.workunit.client.1.smithi165.stdout:4/968: creat d5/d1b/d61/d77/f145 x:0 0 0 2024-09-06T14:44:39.843 INFO:tasks.workunit.client.1.smithi165.stdout:3/955: dwrite d1/d19/f13f [0,4194304] 0 2024-09-06T14:44:39.844 INFO:tasks.workunit.client.1.smithi165.stdout:3/956: chown d1/d19/d92/df1 78 1 2024-09-06T14:44:39.845 INFO:tasks.workunit.client.1.smithi165.stdout:3/957: dread - d1/d19/df8/f136 zero size 2024-09-06T14:44:39.845 INFO:tasks.workunit.client.1.smithi165.stdout:3/958: chown d1/d41/f131 5 1 2024-09-06T14:44:39.846 INFO:tasks.workunit.client.1.smithi165.stdout:4/969: write d5/d1b/d1c/d20/d75/d83/f87 [1132043,126500] 0 2024-09-06T14:44:39.848 INFO:tasks.workunit.client.1.smithi165.stdout:3/959: mknod d1/d4a/db4/c147 0 2024-09-06T14:44:39.852 INFO:tasks.workunit.client.1.smithi165.stdout:4/970: getdents d5/d1b/d61/dd7/ddf/dd4 0 2024-09-06T14:44:39.854 INFO:tasks.workunit.client.1.smithi165.stdout:3/960: dwrite d1/da/dc/d10/f35 [4194304,4194304] 0 2024-09-06T14:44:39.854 INFO:tasks.workunit.client.1.smithi165.stdout:4/971: mknod d5/d1b/d61/d77/d93/c146 0 2024-09-06T14:44:39.860 INFO:tasks.workunit.client.1.smithi165.stdout:4/972: unlink d5/d1b/d1c/d20/d75/d83/d9f/f118 0 2024-09-06T14:44:39.861 INFO:tasks.workunit.client.1.smithi165.stdout:2/891: dread d9/d25/d45/d120/d76/f3c [0,4194304] 0 2024-09-06T14:44:39.864 INFO:tasks.workunit.client.1.smithi165.stdout:4/973: chown d5/d1b/d1c/d20/d75/d83/fe5 1 1 2024-09-06T14:44:39.865 INFO:tasks.workunit.client.1.smithi165.stdout:4/974: write d5/d1b/d1c/db0/f143 [779893,28947] 0 2024-09-06T14:44:39.867 INFO:tasks.workunit.client.1.smithi165.stdout:4/975: creat d5/d1b/d61/d77/dd5/f147 x:0 0 0 2024-09-06T14:44:39.867 INFO:tasks.workunit.client.1.smithi165.stdout:4/976: dread - d5/d1b/d1c/d8c/fe4 zero size 2024-09-06T14:44:39.869 INFO:tasks.workunit.client.1.smithi165.stdout:4/977: fdatasync d5/d1b/d1c/d20/d75/d83/f4d 0 2024-09-06T14:44:39.882 INFO:tasks.workunit.client.1.smithi165.stdout:3/961: write d1/da/dc/d3b/d83/fde [354970,61421] 0 2024-09-06T14:44:39.882 INFO:tasks.workunit.client.1.smithi165.stdout:2/892: write d9/d25/d46/d7e/d90/fb4 [92043,60021] 0 2024-09-06T14:44:39.885 INFO:tasks.workunit.client.1.smithi165.stdout:2/893: read d9/f12 [4039664,52033] 0 2024-09-06T14:44:39.885 INFO:tasks.workunit.client.1.smithi165.stdout:3/962: write d1/da/dd/d4b/f5f [3302184,127073] 0 2024-09-06T14:44:39.889 INFO:tasks.workunit.client.1.smithi165.stdout:3/963: truncate d1/da/dd/d8c/f128 225683 0 2024-09-06T14:44:39.890 INFO:tasks.workunit.client.1.smithi165.stdout:4/978: dwrite d5/d1b/d1c/d55/fa7 [0,4194304] 0 2024-09-06T14:44:39.893 INFO:tasks.workunit.client.1.smithi165.stdout:4/979: chown d5/d1b/d1c/l1f 1043634 1 2024-09-06T14:44:39.894 INFO:tasks.workunit.client.1.smithi165.stdout:2/894: dwrite d9/f12 [4194304,4194304] 0 2024-09-06T14:44:39.897 INFO:tasks.workunit.client.0.smithi052.stdout:7/167: sync 2024-09-06T14:44:39.897 INFO:tasks.workunit.client.0.smithi052.stdout:3/325: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:0/272: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:2/265: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:9/180: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:1/278: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:5/185: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:4/159: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:6/91: sync 2024-09-06T14:44:39.898 INFO:tasks.workunit.client.0.smithi052.stdout:8/202: sync 2024-09-06T14:44:39.899 INFO:tasks.workunit.client.1.smithi165.stdout:2/895: mkdir d9/d25/d46/d12d 0 2024-09-06T14:44:39.901 INFO:tasks.workunit.client.0.smithi052.stdout:3/326: readlink d0/d11/d12/d4c/d53/d35/l36 0 2024-09-06T14:44:39.901 INFO:tasks.workunit.client.0.smithi052.stdout:6/92: chown d2/f19 181376591 1 2024-09-06T14:44:39.902 INFO:tasks.workunit.client.0.smithi052.stdout:1/279: mkdir d1/db/d18/d5c 0 2024-09-06T14:44:39.903 INFO:tasks.workunit.client.0.smithi052.stdout:8/203: creat d6/d22/f46 x:0 0 0 2024-09-06T14:44:39.903 INFO:tasks.workunit.client.0.smithi052.stdout:9/181: rmdir d1/d4/d6 39 2024-09-06T14:44:39.905 INFO:tasks.workunit.client.1.smithi165.stdout:3/964: dwrite d1/d7c/d7e/dc5/fd1 [0,4194304] 0 2024-09-06T14:44:39.906 INFO:tasks.workunit.client.1.smithi165.stdout:2/896: write d9/d25/d45/d75/d34/d117/d78/fb2 [554773,103821] 0 2024-09-06T14:44:39.906 INFO:tasks.workunit.client.0.smithi052.stdout:4/160: symlink d9/l3e 0 2024-09-06T14:44:39.906 INFO:tasks.workunit.client.0.smithi052.stdout:4/161: stat d9/d2d/d33 0 2024-09-06T14:44:39.908 INFO:tasks.workunit.client.1.smithi165.stdout:4/980: dwrite d5/d1b/d61/d77/d7c/daa/f129 [0,4194304] 0 2024-09-06T14:44:39.909 INFO:tasks.workunit.client.0.smithi052.stdout:2/266: read da/f11 [2272794,103355] 0 2024-09-06T14:44:39.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/267: truncate da/f11 4959735 0 2024-09-06T14:44:39.911 INFO:tasks.workunit.client.0.smithi052.stdout:6/93: rename d2/dd/d18/f1a to d2/f1d 0 2024-09-06T14:44:39.915 INFO:tasks.workunit.client.1.smithi165.stdout:3/965: rename d1/da/c7f to d1/da/dd/d4b/c148 0 2024-09-06T14:44:39.916 INFO:tasks.workunit.client.0.smithi052.stdout:8/204: truncate d6/d9/d1f/d14/f2b 242910 0 2024-09-06T14:44:39.917 INFO:tasks.workunit.client.1.smithi165.stdout:2/897: link d9/d25/d46/d7e/d11d/d48/d8c/f12a d9/d25/d45/d120/dd1/de6/f12e 0 2024-09-06T14:44:39.918 INFO:tasks.workunit.client.0.smithi052.stdout:8/205: write d6/d16/f1e [8480665,23958] 0 2024-09-06T14:44:39.919 INFO:tasks.workunit.client.0.smithi052.stdout:0/273: mkdir d0/d1a/d26/d3a/d14/d2d/d56/d5a 0 2024-09-06T14:44:39.921 INFO:tasks.workunit.client.0.smithi052.stdout:9/182: dwrite d1/d4/d6/f16 [0,4194304] 0 2024-09-06T14:44:39.922 INFO:tasks.workunit.client.0.smithi052.stdout:3/327: rename d0/d11/d12/d4c/d53/d35/d46/c49 to d0/d11/d12/d4c/d53/d35/d46/c59 0 2024-09-06T14:44:39.922 INFO:tasks.workunit.client.0.smithi052.stdout:0/274: readlink d0/d1a/d26/d3a/d14/d20/d22/d41/l45 0 2024-09-06T14:44:39.923 INFO:tasks.workunit.client.1.smithi165.stdout:3/966: symlink d1/d19/d92/d10a/l149 0 2024-09-06T14:44:39.925 INFO:tasks.workunit.client.1.smithi165.stdout:3/967: chown d1/da/dc/d10/fd4 11108 1 2024-09-06T14:44:39.925 INFO:tasks.workunit.client.1.smithi165.stdout:2/898: dwrite d9/d25/d46/d7e/d11d/d48/dce/dfc/fd7 [0,4194304] 0 2024-09-06T14:44:39.925 INFO:tasks.workunit.client.0.smithi052.stdout:4/162: rename f8 to d9/d2d/d33/f3f 0 2024-09-06T14:44:39.929 INFO:tasks.workunit.client.1.smithi165.stdout:4/981: rename d5/d1b/d61/dd7/ddf/dd4/fda to d5/d1b/d1c/d8c/d106/d11c/f148 0 2024-09-06T14:44:39.932 INFO:tasks.workunit.client.0.smithi052.stdout:6/94: symlink d2/dd/l1e 0 2024-09-06T14:44:39.939 INFO:tasks.workunit.client.1.smithi165.stdout:2/899: creat d9/d25/d46/d12d/f12f x:0 0 0 2024-09-06T14:44:39.941 INFO:tasks.workunit.client.1.smithi165.stdout:4/982: mkdir d5/d1b/d61/dd7/ddf/d112/d149 0 2024-09-06T14:44:39.942 INFO:tasks.workunit.client.1.smithi165.stdout:4/983: chown d5/d1b/d61/dd7/ddf/ddc 52656 1 2024-09-06T14:44:39.942 INFO:tasks.workunit.client.0.smithi052.stdout:5/186: dwrite d2/d20/f29 [0,4194304] 0 2024-09-06T14:44:39.944 INFO:tasks.workunit.client.1.smithi165.stdout:2/900: creat d9/d88/dac/d95/f130 x:0 0 0 2024-09-06T14:44:39.947 INFO:tasks.workunit.client.0.smithi052.stdout:3/328: rename d0/d11/d12/c1e to d0/d11/d15/d1b/c5a 0 2024-09-06T14:44:39.949 INFO:tasks.workunit.client.0.smithi052.stdout:2/268: mkdir da/d19/d5a/d5f 0 2024-09-06T14:44:39.949 INFO:tasks.workunit.client.0.smithi052.stdout:3/329: dread - d0/d11/d15/f42 zero size 2024-09-06T14:44:39.950 INFO:tasks.workunit.client.1.smithi165.stdout:2/901: dread - d9/d23/d52/f7f zero size 2024-09-06T14:44:39.951 INFO:tasks.workunit.client.0.smithi052.stdout:8/206: dread d6/d16/f2c [8388608,4194304] 0 2024-09-06T14:44:39.951 INFO:tasks.workunit.client.1.smithi165.stdout:2/902: chown d9/d88/dac/d95/l112 118 1 2024-09-06T14:44:39.952 INFO:tasks.workunit.client.0.smithi052.stdout:7/168: getdents d11/d1c/d26 0 2024-09-06T14:44:39.952 INFO:tasks.workunit.client.0.smithi052.stdout:3/330: write d0/d11/d15/d1b/f32 [667341,62743] 0 2024-09-06T14:44:39.953 INFO:tasks.workunit.client.0.smithi052.stdout:7/169: read ff [8386494,48545] 0 2024-09-06T14:44:39.953 INFO:tasks.workunit.client.0.smithi052.stdout:7/170: fsync d11/f2c 0 2024-09-06T14:44:39.954 INFO:tasks.workunit.client.0.smithi052.stdout:1/280: getdents d1/da/d3e/d47/d4a 0 2024-09-06T14:44:39.956 INFO:tasks.workunit.client.0.smithi052.stdout:0/275: getdents d0/d1a/d26/d3a/d14/d20/d22/d55 0 2024-09-06T14:44:39.956 INFO:tasks.workunit.client.1.smithi165.stdout:3/968: dread d1/d19/d4d/fd0 [0,4194304] 0 2024-09-06T14:44:39.956 INFO:tasks.workunit.client.0.smithi052.stdout:0/276: dread - d0/d18/f50 zero size 2024-09-06T14:44:39.957 INFO:tasks.workunit.client.1.smithi165.stdout:3/969: chown d1/da/dd/fe 18486681 1 2024-09-06T14:44:39.958 INFO:tasks.workunit.client.0.smithi052.stdout:5/187: creat d2/d1a/d22/f3e x:0 0 0 2024-09-06T14:44:39.959 INFO:tasks.workunit.client.1.smithi165.stdout:2/903: dwrite d9/d25/d46/d7e/d11d/d48/dce/f129 [0,4194304] 0 2024-09-06T14:44:39.961 INFO:tasks.workunit.client.1.smithi165.stdout:2/904: write d9/d25/d46/d7e/d11d/f2b [2825876,20379] 0 2024-09-06T14:44:39.962 INFO:tasks.workunit.client.0.smithi052.stdout:9/183: rename d1/d4/f9 to d1/d4/d6/dc/d10/f34 0 2024-09-06T14:44:39.963 INFO:tasks.workunit.client.1.smithi165.stdout:3/970: mknod d1/d7c/c14a 0 2024-09-06T14:44:39.969 INFO:tasks.workunit.client.1.smithi165.stdout:3/971: mkdir d1/da/dc/d3b/dc6/dbc/d14b 0 2024-09-06T14:44:39.970 INFO:tasks.workunit.client.0.smithi052.stdout:7/171: creat d11/f39 x:0 0 0 2024-09-06T14:44:39.970 INFO:tasks.workunit.client.1.smithi165.stdout:4/984: dread d5/fc [4194304,4194304] 0 2024-09-06T14:44:39.971 INFO:tasks.workunit.client.0.smithi052.stdout:1/281: creat d1/da/d36/f5d x:0 0 0 2024-09-06T14:44:39.973 INFO:tasks.workunit.client.0.smithi052.stdout:1/282: truncate d1/da/d36/f5d 473186 0 2024-09-06T14:44:39.973 INFO:tasks.workunit.client.0.smithi052.stdout:4/163: creat d9/f40 x:0 0 0 2024-09-06T14:44:39.973 INFO:tasks.workunit.client.0.smithi052.stdout:4/164: dread - d9/f38 zero size 2024-09-06T14:44:39.975 INFO:tasks.workunit.client.1.smithi165.stdout:3/972: dwrite d1/da/dd/d4b/f5f [0,4194304] 0 2024-09-06T14:44:39.977 INFO:tasks.workunit.client.0.smithi052.stdout:5/188: write d2/f7 [1774911,118590] 0 2024-09-06T14:44:39.977 INFO:tasks.workunit.client.1.smithi165.stdout:3/973: truncate d1/da/dc/d3b/d71/fd9 4298630 0 2024-09-06T14:44:39.981 INFO:tasks.workunit.client.0.smithi052.stdout:1/283: dwrite d1/da/d36/f3d [0,4194304] 0 2024-09-06T14:44:39.985 INFO:tasks.workunit.client.1.smithi165.stdout:4/985: creat d5/d1b/d1c/d8c/d106/d11c/f14a x:0 0 0 2024-09-06T14:44:39.986 INFO:tasks.workunit.client.0.smithi052.stdout:2/269: rename da/d19/d20 to da/db/d60 0 2024-09-06T14:44:39.986 INFO:tasks.workunit.client.1.smithi165.stdout:4/986: chown d5/d1b/d1c/fa0 34951003 1 2024-09-06T14:44:39.992 INFO:tasks.workunit.client.0.smithi052.stdout:5/189: dread d2/d1a/d22/d26/d2b/f2f [0,4194304] 0 2024-09-06T14:44:39.992 INFO:tasks.workunit.client.0.smithi052.stdout:7/172: mknod d11/c3a 0 2024-09-06T14:44:39.992 INFO:tasks.workunit.client.0.smithi052.stdout:4/165: write d9/d10/d19/f2c [135487,52776] 0 2024-09-06T14:44:39.993 INFO:tasks.workunit.client.1.smithi165.stdout:4/987: dwrite d5/d1b/d1c/d41/d9e/fd0 [0,4194304] 0 2024-09-06T14:44:39.993 INFO:tasks.workunit.client.0.smithi052.stdout:7/173: fsync d11/d1c/d24/f29 0 2024-09-06T14:44:39.996 INFO:tasks.workunit.client.0.smithi052.stdout:4/166: write f6 [4366866,110478] 0 2024-09-06T14:44:39.997 INFO:tasks.workunit.client.0.smithi052.stdout:8/207: rmdir d6/d22/d35 0 2024-09-06T14:44:39.997 INFO:tasks.workunit.client.1.smithi165.stdout:4/988: fsync d5/d1b/d61/f82 0 2024-09-06T14:44:39.998 INFO:tasks.workunit.client.1.smithi165.stdout:3/974: write d1/d41/fee [1022782,6443] 0 2024-09-06T14:44:39.999 INFO:tasks.workunit.client.1.smithi165.stdout:4/989: chown d5/d1b/d1c/d20/d75/d83 102617199 1 2024-09-06T14:44:40.003 INFO:tasks.workunit.client.0.smithi052.stdout:4/167: write d9/d10/d19/f28 [1035455,47713] 0 2024-09-06T14:44:40.003 INFO:tasks.workunit.client.0.smithi052.stdout:1/284: dwrite d1/db/de/f2b [0,4194304] 0 2024-09-06T14:44:40.005 INFO:tasks.workunit.client.0.smithi052.stdout:5/190: dwrite d2/f16 [0,4194304] 0 2024-09-06T14:44:40.005 INFO:tasks.workunit.client.1.smithi165.stdout:3/975: symlink d1/da/dd/d4b/d112/l14c 0 2024-09-06T14:44:40.006 INFO:tasks.workunit.client.1.smithi165.stdout:3/976: dread - d1/dbd/dfd/f124 zero size 2024-09-06T14:44:40.007 INFO:tasks.workunit.client.1.smithi165.stdout:3/977: chown d1/da/dc/l24 4260740 1 2024-09-06T14:44:40.008 INFO:tasks.workunit.client.0.smithi052.stdout:9/184: creat d1/d4/d6/f35 x:0 0 0 2024-09-06T14:44:40.008 INFO:tasks.workunit.client.0.smithi052.stdout:0/277: truncate d0/d1a/d26/d3a/d14/d20/d22/f4a 1170277 0 2024-09-06T14:44:40.010 INFO:tasks.workunit.client.0.smithi052.stdout:7/174: mkdir d11/d1c/d24/d3b 0 2024-09-06T14:44:40.014 INFO:tasks.workunit.client.0.smithi052.stdout:8/208: fsync d6/d16/f1e 0 2024-09-06T14:44:40.015 INFO:tasks.workunit.client.0.smithi052.stdout:1/285: unlink d1/c7 0 2024-09-06T14:44:40.017 INFO:tasks.workunit.client.1.smithi165.stdout:4/990: creat d5/d1b/d1c/d8c/d106/d11c/f14b x:0 0 0 2024-09-06T14:44:40.017 INFO:tasks.workunit.client.1.smithi165.stdout:3/978: dread d1/da/dc/d3b/d71/f7a [0,4194304] 0 2024-09-06T14:44:40.018 INFO:tasks.workunit.client.0.smithi052.stdout:5/191: dwrite d2/d20/f28 [4194304,4194304] 0 2024-09-06T14:44:40.019 INFO:tasks.workunit.client.0.smithi052.stdout:1/286: chown d1/db/de 72471 1 2024-09-06T14:44:40.022 INFO:tasks.workunit.client.1.smithi165.stdout:3/979: mknod d1/da/dc/d3b/d137/c14d 0 2024-09-06T14:44:40.024 INFO:tasks.workunit.client.1.smithi165.stdout:3/980: truncate d1/da/dd/fa0 1028816 0 2024-09-06T14:44:40.025 INFO:tasks.workunit.client.0.smithi052.stdout:1/287: fdatasync d1/da/d14/f1f 0 2024-09-06T14:44:40.026 INFO:tasks.workunit.client.1.smithi165.stdout:3/981: write d1/d4a/f55 [2959898,9663] 0 2024-09-06T14:44:40.027 INFO:tasks.workunit.client.0.smithi052.stdout:4/168: dread d9/d10/d19/f29 [0,4194304] 0 2024-09-06T14:44:40.029 INFO:tasks.workunit.client.1.smithi165.stdout:4/991: dwrite d5/d1b/d61/dd7/ddf/f4b [4194304,4194304] 0 2024-09-06T14:44:40.030 INFO:tasks.workunit.client.0.smithi052.stdout:5/192: mknod d2/d1a/d22/d26/d2b/d37/c3f 0 2024-09-06T14:44:40.030 INFO:tasks.workunit.client.0.smithi052.stdout:0/278: dwrite d0/d1a/d26/d3a/d14/d20/f48 [0,4194304] 0 2024-09-06T14:44:40.030 INFO:tasks.workunit.client.0.smithi052.stdout:9/185: dwrite d1/d4/df/f32 [0,4194304] 0 2024-09-06T14:44:40.031 INFO:tasks.workunit.client.1.smithi165.stdout:4/992: dread - d5/d1b/d61/d77/dd5/f147 zero size 2024-09-06T14:44:40.031 INFO:tasks.workunit.client.1.smithi165.stdout:3/982: mkdir d1/d19/d92/df1/d14e 0 2024-09-06T14:44:40.032 INFO:tasks.workunit.client.0.smithi052.stdout:5/193: write d2/d1a/f3d [2780401,26918] 0 2024-09-06T14:44:40.033 INFO:tasks.workunit.client.1.smithi165.stdout:3/983: chown d1/da/dc/d10/fcb 7925860 1 2024-09-06T14:44:40.033 INFO:tasks.workunit.client.0.smithi052.stdout:5/194: chown d2/l1e 393 1 2024-09-06T14:44:40.035 INFO:tasks.workunit.client.0.smithi052.stdout:4/169: mkdir d9/d10/d19/d41 0 2024-09-06T14:44:40.036 INFO:tasks.workunit.client.1.smithi165.stdout:4/993: read d5/d1b/d61/fd3 [3080140,92269] 0 2024-09-06T14:44:40.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/279: mkdir d0/d1a/d26/d3a/d14/d20/d22/d5b 0 2024-09-06T14:44:40.038 INFO:tasks.workunit.client.0.smithi052.stdout:5/195: symlink d2/d1a/d22/d26/d2b/l40 0 2024-09-06T14:44:40.039 INFO:tasks.workunit.client.0.smithi052.stdout:4/170: dread d9/d10/d19/f29 [0,4194304] 0 2024-09-06T14:44:40.041 INFO:tasks.workunit.client.0.smithi052.stdout:9/186: rename d1/d4/df/c1d to d1/d4/c36 0 2024-09-06T14:44:40.042 INFO:tasks.workunit.client.1.smithi165.stdout:3/984: dwrite d1/da/dc/f5c [0,4194304] 0 2024-09-06T14:44:40.043 INFO:tasks.workunit.client.0.smithi052.stdout:1/288: getdents d1/da/d36 0 2024-09-06T14:44:40.043 INFO:tasks.workunit.client.0.smithi052.stdout:9/187: write d1/d4/df/f32 [1074377,16668] 0 2024-09-06T14:44:40.043 INFO:tasks.workunit.client.0.smithi052.stdout:5/196: symlink d2/d1a/d22/l41 0 2024-09-06T14:44:40.044 INFO:tasks.workunit.client.0.smithi052.stdout:4/171: creat d9/d10/d17/f42 x:0 0 0 2024-09-06T14:44:40.045 INFO:tasks.workunit.client.0.smithi052.stdout:0/280: creat d0/d1a/d26/d3a/d14/d20/d22/d5b/f5c x:0 0 0 2024-09-06T14:44:40.045 INFO:tasks.workunit.client.0.smithi052.stdout:1/289: chown d1/da/d36/f5d 81461 1 2024-09-06T14:44:40.046 INFO:tasks.workunit.client.0.smithi052.stdout:5/197: truncate d2/d1a/f2d 714873 0 2024-09-06T14:44:40.046 INFO:tasks.workunit.client.1.smithi165.stdout:4/994: dwrite d5/d1b/d1c/d41/f44 [0,4194304] 0 2024-09-06T14:44:40.047 INFO:tasks.workunit.client.0.smithi052.stdout:1/290: read - d1/db/d50/f5b zero size 2024-09-06T14:44:40.051 INFO:tasks.workunit.client.0.smithi052.stdout:9/188: dread d1/d4/d6/dc/d10/f34 [4194304,4194304] 0 2024-09-06T14:44:40.051 INFO:tasks.workunit.client.0.smithi052.stdout:1/291: write d1/da/d12/f46 [605198,91017] 0 2024-09-06T14:44:40.054 INFO:tasks.workunit.client.1.smithi165.stdout:3/985: rename d1/da/d43/cf5 to d1/da/dc/d10/c14f 0 2024-09-06T14:44:40.054 INFO:tasks.workunit.client.1.smithi165.stdout:7/780: sync 2024-09-06T14:44:40.055 INFO:tasks.workunit.client.0.smithi052.stdout:0/281: mkdir d0/d1a/d26/d3a/d14/d2d/d56/d5d 0 2024-09-06T14:44:40.056 INFO:tasks.workunit.client.0.smithi052.stdout:0/282: chown d0/fe 11 1 2024-09-06T14:44:40.057 INFO:tasks.workunit.client.1.smithi165.stdout:3/986: truncate d1/d4a/db4/f119 448810 0 2024-09-06T14:44:40.059 INFO:tasks.workunit.client.1.smithi165.stdout:4/995: dwrite d5/d1b/d61/dd7/ddf/f141 [0,4194304] 0 2024-09-06T14:44:40.061 INFO:tasks.workunit.client.0.smithi052.stdout:1/292: creat d1/db/d50/f5e x:0 0 0 2024-09-06T14:44:40.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/293: read - d1/db/f3f zero size 2024-09-06T14:44:40.064 INFO:tasks.workunit.client.1.smithi165.stdout:4/996: mkdir d5/d1b/d61/dd7/d14c 0 2024-09-06T14:44:40.069 INFO:tasks.workunit.client.0.smithi052.stdout:7/175: dread d11/d1c/f1e [0,4194304] 0 2024-09-06T14:44:40.071 INFO:tasks.workunit.client.0.smithi052.stdout:5/198: getdents d2/d20 0 2024-09-06T14:44:40.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:39 smithi165 ceph-mon[36229]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:40.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:39 smithi165 ceph-mon[36229]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:40.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:39 smithi165 ceph-mon[36229]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 94 MiB/s rd, 297 MiB/s wr, 575 op/s 2024-09-06T14:44:40.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:39 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1355117829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:44:40.075 INFO:tasks.workunit.client.0.smithi052.stdout:0/283: rmdir d0/d1a/d26/d3a/d14/d2d/d56/d5a 0 2024-09-06T14:44:40.076 INFO:tasks.workunit.client.1.smithi165.stdout:3/987: getdents d1/d4a 0 2024-09-06T14:44:40.078 INFO:tasks.workunit.client.0.smithi052.stdout:9/189: getdents d1/d4/d6/dc/d10/d18 0 2024-09-06T14:44:40.079 INFO:tasks.workunit.client.0.smithi052.stdout:1/294: dread d1/da/d14/f25 [0,4194304] 0 2024-09-06T14:44:40.081 INFO:tasks.workunit.client.0.smithi052.stdout:7/176: symlink d11/d1c/d24/d3b/l3c 0 2024-09-06T14:44:40.083 INFO:tasks.workunit.client.1.smithi165.stdout:4/997: dread d5/d1b/d1c/d8c/f9a [0,4194304] 0 2024-09-06T14:44:40.083 INFO:tasks.workunit.client.0.smithi052.stdout:1/295: mkdir d1/d5f 0 2024-09-06T14:44:40.084 INFO:tasks.workunit.client.0.smithi052.stdout:5/199: dwrite d2/d20/f23 [4194304,4194304] 0 2024-09-06T14:44:40.085 INFO:tasks.workunit.client.1.smithi165.stdout:4/998: mknod d5/d1b/d1c/d20/d75/d83/d9f/c14d 0 2024-09-06T14:44:40.088 INFO:tasks.workunit.client.0.smithi052.stdout:8/209: dwrite d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:40.091 INFO:tasks.workunit.client.1.smithi165.stdout:0/868: sync 2024-09-06T14:44:40.091 INFO:tasks.workunit.client.1.smithi165.stdout:6/957: sync 2024-09-06T14:44:40.091 INFO:tasks.workunit.client.1.smithi165.stdout:8/948: sync 2024-09-06T14:44:40.092 INFO:tasks.workunit.client.1.smithi165.stdout:4/999: read d5/d1b/d1c/fa0 [1330910,128248] 0 2024-09-06T14:44:40.093 INFO:tasks.workunit.client.0.smithi052.stdout:1/296: unlink d1/db/f13 0 2024-09-06T14:44:40.093 INFO:tasks.workunit.client.1.smithi165.stdout:0/869: read - d15/d19/d28/d51/f11a zero size 2024-09-06T14:44:40.093 INFO:tasks.workunit.client.1.smithi165.stdout:6/958: readlink d29/d6a/d83/d89/l125 0 2024-09-06T14:44:40.093 INFO:tasks.workunit.client.1.smithi165.stdout:8/949: readlink d0/d5e/d65/lcc 0 2024-09-06T14:44:40.094 INFO:tasks.workunit.client.0.smithi052.stdout:0/284: dwrite d0/f1c [0,4194304] 0 2024-09-06T14:44:40.097 INFO:tasks.workunit.client.1.smithi165.stdout:0/870: creat d15/d19/d38/f11f x:0 0 0 2024-09-06T14:44:40.097 INFO:tasks.workunit.client.0.smithi052.stdout:9/190: dread d1/d4/df/f24 [0,4194304] 0 2024-09-06T14:44:40.100 INFO:tasks.workunit.client.0.smithi052.stdout:9/191: chown d1/d4/d6/dd 487711 1 2024-09-06T14:44:40.101 INFO:tasks.workunit.client.1.smithi165.stdout:8/950: rename d0/d19/d36/d2d/d33/d3a/d46/dcd/fde to d0/d19/d24/db1/d11a/f14d 0 2024-09-06T14:44:40.101 INFO:tasks.workunit.client.0.smithi052.stdout:8/210: dread d6/d9/df/d1b/f2f [0,4194304] 0 2024-09-06T14:44:40.101 INFO:tasks.workunit.client.0.smithi052.stdout:7/177: dwrite d11/d1c/d24/f29 [0,4194304] 0 2024-09-06T14:44:40.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/297: mknod d1/da/d12/c60 0 2024-09-06T14:44:40.105 INFO:tasks.workunit.client.1.smithi165.stdout:6/959: mkdir d29/d39/d5b/d62/d135/d136 0 2024-09-06T14:44:40.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/192: truncate d1/d4/f7 4445345 0 2024-09-06T14:44:40.106 INFO:tasks.workunit.client.1.smithi165.stdout:6/960: chown d29/d39/d5b/d62/d67/d113/f12a 238673472 1 2024-09-06T14:44:40.107 INFO:tasks.workunit.client.1.smithi165.stdout:0/871: creat d15/d19/d50/d53/d7c/dbb/f120 x:0 0 0 2024-09-06T14:44:40.108 INFO:tasks.workunit.client.0.smithi052.stdout:0/285: dwrite d0/d1a/f40 [0,4194304] 0 2024-09-06T14:44:40.110 INFO:tasks.workunit.client.0.smithi052.stdout:0/286: read - d0/d18/f50 zero size 2024-09-06T14:44:40.110 INFO:tasks.workunit.client.1.smithi165.stdout:8/951: dread - d0/d19/d24/db1/d8c/fd9 zero size 2024-09-06T14:44:40.114 INFO:tasks.workunit.client.1.smithi165.stdout:6/961: symlink d29/d6a/d83/l137 0 2024-09-06T14:44:40.116 INFO:tasks.workunit.client.1.smithi165.stdout:0/872: fsync d15/f5a 0 2024-09-06T14:44:40.119 INFO:tasks.workunit.client.0.smithi052.stdout:8/211: dwrite d6/d9/d21/f3f [0,4194304] 0 2024-09-06T14:44:40.121 INFO:tasks.workunit.client.0.smithi052.stdout:4/172: truncate f6 4016712 0 2024-09-06T14:44:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:39 smithi052 ceph-mon[28627]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:39 smithi052 ceph-mon[28627]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:39 smithi052 ceph-mon[28627]: pgmap v22: 65 pgs: 65 active+clean; 2.2 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 94 MiB/s rd, 297 MiB/s wr, 575 op/s 2024-09-06T14:44:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:39 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1355117829' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:44:40.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/287: dwrite d0/d1a/d26/d3a/f36 [0,4194304] 0 2024-09-06T14:44:40.130 INFO:tasks.workunit.client.1.smithi165.stdout:7/781: write d20/d65/f34 [1209281,65616] 0 2024-09-06T14:44:40.132 INFO:tasks.workunit.client.0.smithi052.stdout:8/212: mkdir d6/d22/d36/d3e/d47 0 2024-09-06T14:44:40.132 INFO:tasks.workunit.client.0.smithi052.stdout:0/288: dread d0/d1a/f40 [0,4194304] 0 2024-09-06T14:44:40.133 INFO:tasks.workunit.client.0.smithi052.stdout:1/298: dread d1/db/de/f24 [0,4194304] 0 2024-09-06T14:44:40.134 INFO:tasks.workunit.client.0.smithi052.stdout:0/289: read d0/fe [1553527,127889] 0 2024-09-06T14:44:40.134 INFO:tasks.workunit.client.1.smithi165.stdout:6/962: dread d29/f36 [4194304,4194304] 0 2024-09-06T14:44:40.136 INFO:tasks.workunit.client.1.smithi165.stdout:7/782: mknod d20/d4d/ddd/cfa 0 2024-09-06T14:44:40.137 INFO:tasks.workunit.client.0.smithi052.stdout:9/193: creat d1/f37 x:0 0 0 2024-09-06T14:44:40.139 INFO:tasks.workunit.client.0.smithi052.stdout:7/178: link d11/d1c/d24/c33 d11/c3d 0 2024-09-06T14:44:40.141 INFO:tasks.workunit.client.0.smithi052.stdout:8/213: symlink d6/d22/l48 0 2024-09-06T14:44:40.144 INFO:tasks.workunit.client.1.smithi165.stdout:7/783: rename d20/d3b/c5e to d20/d3b/cfb 0 2024-09-06T14:44:40.145 INFO:tasks.workunit.client.0.smithi052.stdout:9/194: dwrite d1/d4/d6/dc/d10/d18/f33 [0,4194304] 0 2024-09-06T14:44:40.145 INFO:tasks.workunit.client.1.smithi165.stdout:3/988: dwrite d1/d19/f29 [4194304,4194304] 0 2024-09-06T14:44:40.146 INFO:tasks.workunit.client.1.smithi165.stdout:7/784: chown d20/d3b/d69/d88/d30/f39 1011478396 1 2024-09-06T14:44:40.151 INFO:tasks.workunit.client.1.smithi165.stdout:3/989: creat d1/d19/df8/f150 x:0 0 0 2024-09-06T14:44:40.154 INFO:tasks.workunit.client.1.smithi165.stdout:7/785: creat d20/d33/d6a/d90/ffc x:0 0 0 2024-09-06T14:44:40.154 INFO:tasks.workunit.client.0.smithi052.stdout:9/195: dwrite d1/fa [4194304,4194304] 0 2024-09-06T14:44:40.157 INFO:tasks.workunit.client.1.smithi165.stdout:3/990: truncate d1/dbd/fc1 1108185 0 2024-09-06T14:44:40.157 INFO:tasks.workunit.client.1.smithi165.stdout:3/991: readlink d1/dbd/dfd/l10f 0 2024-09-06T14:44:40.158 INFO:tasks.workunit.client.0.smithi052.stdout:7/179: symlink d11/d1c/d26/l3e 0 2024-09-06T14:44:40.160 INFO:tasks.workunit.client.1.smithi165.stdout:7/786: creat d20/d3b/d69/d88/d30/d78/ffd x:0 0 0 2024-09-06T14:44:40.162 INFO:tasks.workunit.client.1.smithi165.stdout:3/992: mkdir d1/d7c/ded/d151 0 2024-09-06T14:44:40.164 INFO:tasks.workunit.client.1.smithi165.stdout:7/787: creat d20/d4d/dd4/ffe x:0 0 0 2024-09-06T14:44:40.165 INFO:tasks.workunit.client.1.smithi165.stdout:3/993: stat d1/da/c6c 0 2024-09-06T14:44:40.169 INFO:tasks.workunit.client.0.smithi052.stdout:4/173: link d9/d10/l2b d9/d10/l43 0 2024-09-06T14:44:40.172 INFO:tasks.workunit.client.0.smithi052.stdout:1/299: mknod d1/db/d18/d5c/c61 0 2024-09-06T14:44:40.172 INFO:tasks.workunit.client.1.smithi165.stdout:8/952: dwrite d0/d14/d3e/f4b [0,4194304] 0 2024-09-06T14:44:40.172 INFO:tasks.workunit.client.1.smithi165.stdout:6/963: dread d29/d6a/d83/d89/fd7 [0,4194304] 0 2024-09-06T14:44:40.173 INFO:tasks.workunit.client.1.smithi165.stdout:7/788: dread d20/d33/d53/fb0 [0,4194304] 0 2024-09-06T14:44:40.174 INFO:tasks.workunit.client.0.smithi052.stdout:0/290: symlink d0/l5e 0 2024-09-06T14:44:40.177 INFO:tasks.workunit.client.1.smithi165.stdout:6/964: creat d29/d6a/d83/f138 x:0 0 0 2024-09-06T14:44:40.178 INFO:tasks.workunit.client.0.smithi052.stdout:8/214: mkdir d6/d22/d36/d3e/d47/d49 0 2024-09-06T14:44:40.180 INFO:tasks.workunit.client.0.smithi052.stdout:9/196: dwrite d1/d4/df/f24 [0,4194304] 0 2024-09-06T14:44:40.181 INFO:tasks.workunit.client.0.smithi052.stdout:4/174: creat d9/d2d/d33/f44 x:0 0 0 2024-09-06T14:44:40.181 INFO:tasks.workunit.client.0.smithi052.stdout:9/197: chown d1/d26 83 1 2024-09-06T14:44:40.182 INFO:tasks.workunit.client.1.smithi165.stdout:3/994: dread d1/f2 [0,4194304] 0 2024-09-06T14:44:40.182 INFO:tasks.workunit.client.0.smithi052.stdout:9/198: chown d1/d4/d6/dc/d10/d18/c1f 2133985428 1 2024-09-06T14:44:40.184 INFO:tasks.workunit.client.0.smithi052.stdout:0/291: creat d0/d18/f5f x:0 0 0 2024-09-06T14:44:40.185 INFO:tasks.workunit.client.1.smithi165.stdout:6/965: truncate d29/d93/d87/db9/fd3 39907 0 2024-09-06T14:44:40.187 INFO:tasks.workunit.client.0.smithi052.stdout:7/180: mkdir d11/d1c/d3f 0 2024-09-06T14:44:40.189 INFO:tasks.workunit.client.0.smithi052.stdout:8/215: rmdir d6/d9/d1f 39 2024-09-06T14:44:40.190 INFO:tasks.workunit.client.1.smithi165.stdout:8/953: truncate d0/d19/d36/d2d/d33/d3a/d46/f52 179620 0 2024-09-06T14:44:40.193 INFO:tasks.workunit.client.0.smithi052.stdout:1/300: symlink d1/da/l62 0 2024-09-06T14:44:40.194 INFO:tasks.workunit.client.1.smithi165.stdout:7/789: truncate d20/d3b/d69/d88/d30/fbc 868008 0 2024-09-06T14:44:40.195 INFO:tasks.workunit.client.0.smithi052.stdout:9/199: mkdir d1/d4/d6/dc/d38 0 2024-09-06T14:44:40.196 INFO:tasks.workunit.client.1.smithi165.stdout:8/954: dwrite d0/d19/d36/d2d/f147 [0,4194304] 0 2024-09-06T14:44:40.197 INFO:tasks.workunit.client.1.smithi165.stdout:1/878: sync 2024-09-06T14:44:40.198 INFO:tasks.workunit.client.1.smithi165.stdout:2/905: sync 2024-09-06T14:44:40.199 INFO:tasks.workunit.client.1.smithi165.stdout:1/879: dread - d0/d2a/d18/d24/d4b/d93/dbd/dd1/ffc zero size 2024-09-06T14:44:40.206 INFO:tasks.workunit.client.1.smithi165.stdout:7/790: rmdir d20/d33 39 2024-09-06T14:44:40.209 INFO:tasks.workunit.client.1.smithi165.stdout:3/995: creat d1/da/dc/d3b/dc6/d108/f152 x:0 0 0 2024-09-06T14:44:40.210 INFO:tasks.workunit.client.0.smithi052.stdout:9/200: mknod d1/d4/d6/dd/d2b/c39 0 2024-09-06T14:44:40.211 INFO:tasks.workunit.client.0.smithi052.stdout:0/292: mkdir d0/d1a/d26/d3a/d14/d2d/d56/d5d/d60 0 2024-09-06T14:44:40.212 INFO:tasks.workunit.client.1.smithi165.stdout:7/791: dwrite d20/d3b/d69/d88/fde [0,4194304] 0 2024-09-06T14:44:40.214 INFO:tasks.workunit.client.1.smithi165.stdout:8/955: creat d0/d34/d6b/d94/d70/db8/f14e x:0 0 0 2024-09-06T14:44:40.216 INFO:tasks.workunit.client.1.smithi165.stdout:3/996: dwrite d1/d19/d4d/fa5 [0,4194304] 0 2024-09-06T14:44:40.217 INFO:tasks.workunit.client.0.smithi052.stdout:9/201: dwrite d1/d4/df/f32 [0,4194304] 0 2024-09-06T14:44:40.217 INFO:tasks.workunit.client.0.smithi052.stdout:7/181: link d11/d1c/d26/f28 d11/d1c/d26/f40 0 2024-09-06T14:44:40.219 INFO:tasks.workunit.client.1.smithi165.stdout:2/906: creat d9/d25/d46/d7e/d11d/d48/d114/f131 x:0 0 0 2024-09-06T14:44:40.220 INFO:tasks.workunit.client.1.smithi165.stdout:0/873: sync 2024-09-06T14:44:40.221 INFO:tasks.workunit.client.1.smithi165.stdout:0/874: fdatasync d15/d19/d38/f11f 0 2024-09-06T14:44:40.225 INFO:tasks.workunit.client.0.smithi052.stdout:1/301: fdatasync d1/da/d3e/f44 0 2024-09-06T14:44:40.230 INFO:tasks.workunit.client.0.smithi052.stdout:0/293: creat d0/d1a/d26/d3a/d14/d20/f61 x:0 0 0 2024-09-06T14:44:40.232 INFO:tasks.workunit.client.0.smithi052.stdout:7/182: creat d11/d1c/d24/f41 x:0 0 0 2024-09-06T14:44:40.232 INFO:tasks.workunit.client.0.smithi052.stdout:7/183: read - d11/f39 zero size 2024-09-06T14:44:40.233 INFO:tasks.workunit.client.0.smithi052.stdout:7/184: chown d11/d1c/f1e 0 1 2024-09-06T14:44:40.234 INFO:tasks.workunit.client.0.smithi052.stdout:9/202: symlink d1/d4/d6/dd/d22/l3a 0 2024-09-06T14:44:40.237 INFO:tasks.workunit.client.1.smithi165.stdout:8/956: mkdir d0/d34/d6b/d94/d70/de9/d14f 0 2024-09-06T14:44:40.240 INFO:tasks.workunit.client.0.smithi052.stdout:8/216: dwrite d6/d22/d31/f34 [0,4194304] 0 2024-09-06T14:44:40.240 INFO:tasks.workunit.client.0.smithi052.stdout:1/302: creat d1/da/d12/f63 x:0 0 0 2024-09-06T14:44:40.242 INFO:tasks.workunit.client.0.smithi052.stdout:0/294: creat d0/d1a/d26/d3a/d14/d20/d22/d5b/f62 x:0 0 0 2024-09-06T14:44:40.242 INFO:tasks.workunit.client.0.smithi052.stdout:1/303: truncate d1/da/d12/f46 965722 0 2024-09-06T14:44:40.242 INFO:tasks.workunit.client.1.smithi165.stdout:1/880: mkdir d0/d2a/d18/d24/d120 0 2024-09-06T14:44:40.244 INFO:tasks.workunit.client.0.smithi052.stdout:7/185: mknod d11/d1c/d24/c42 0 2024-09-06T14:44:40.245 INFO:tasks.workunit.client.0.smithi052.stdout:0/295: dread - d0/d1a/d26/d3a/d14/f3e zero size 2024-09-06T14:44:40.245 INFO:tasks.workunit.client.0.smithi052.stdout:9/203: chown c0 721831507 1 2024-09-06T14:44:40.247 INFO:tasks.workunit.client.0.smithi052.stdout:8/217: mkdir d6/d9/d21/d4a 0 2024-09-06T14:44:40.248 INFO:tasks.workunit.client.1.smithi165.stdout:6/966: getdents d29/d39/d5b/d62/d67 0 2024-09-06T14:44:40.249 INFO:tasks.workunit.client.0.smithi052.stdout:1/304: fdatasync d1/da/f32 0 2024-09-06T14:44:40.249 INFO:tasks.workunit.client.0.smithi052.stdout:8/218: write d6/d9/f2e [3454200,20355] 0 2024-09-06T14:44:40.251 INFO:tasks.workunit.client.0.smithi052.stdout:0/296: dread d0/d2e/f4b [0,4194304] 0 2024-09-06T14:44:40.252 INFO:tasks.workunit.client.0.smithi052.stdout:4/175: link d9/d10/l13 d9/d10/d19/l45 0 2024-09-06T14:44:40.252 INFO:tasks.workunit.client.0.smithi052.stdout:8/219: rename d6 to d6/d9/d21/d4b 22 2024-09-06T14:44:40.253 INFO:tasks.workunit.client.1.smithi165.stdout:3/997: fsync d1/da/dd/f2c 0 2024-09-06T14:44:40.255 INFO:tasks.workunit.client.1.smithi165.stdout:2/907: fsync d9/d25/d45/f63 0 2024-09-06T14:44:40.255 INFO:tasks.workunit.client.0.smithi052.stdout:8/220: write d6/d9/d21/f3f [2706973,39827] 0 2024-09-06T14:44:40.256 INFO:tasks.workunit.client.0.smithi052.stdout:9/204: dwrite d1/d4/d6/dc/d10/d18/f33 [0,4194304] 0 2024-09-06T14:44:40.257 INFO:tasks.workunit.client.1.smithi165.stdout:6/967: dwrite d29/d39/d5b/d62/d135/dcc/fff [0,4194304] 0 2024-09-06T14:44:40.257 INFO:tasks.workunit.client.0.smithi052.stdout:0/297: write d0/d1a/d26/d3a/d14/d2d/f33 [3109327,7618] 0 2024-09-06T14:44:40.258 INFO:tasks.workunit.client.1.smithi165.stdout:6/968: stat d29/d6a/f70 0 2024-09-06T14:44:40.262 INFO:tasks.workunit.client.1.smithi165.stdout:7/792: creat d20/d3b/d69/d88/fff x:0 0 0 2024-09-06T14:44:40.264 INFO:tasks.workunit.client.0.smithi052.stdout:7/186: truncate d11/f14 630377 0 2024-09-06T14:44:40.271 INFO:tasks.workunit.client.0.smithi052.stdout:8/221: rmdir d6/d22/d31 39 2024-09-06T14:44:40.273 INFO:tasks.workunit.client.0.smithi052.stdout:9/205: rename d1/d4/df/l1e to d1/d4/d6/dc/l3b 0 2024-09-06T14:44:40.275 INFO:tasks.workunit.client.0.smithi052.stdout:7/187: write ff [6329540,66354] 0 2024-09-06T14:44:40.277 INFO:tasks.workunit.client.0.smithi052.stdout:4/176: creat d9/d10/d17/d39/f46 x:0 0 0 2024-09-06T14:44:40.279 INFO:tasks.workunit.client.1.smithi165.stdout:1/881: truncate d0/fba 14480 0 2024-09-06T14:44:40.279 INFO:tasks.workunit.client.0.smithi052.stdout:8/222: stat d6/d22/d36/c44 0 2024-09-06T14:44:40.280 INFO:tasks.workunit.client.1.smithi165.stdout:6/969: unlink d29/d39/d5b/d62/d67/la7 0 2024-09-06T14:44:40.281 INFO:tasks.workunit.client.0.smithi052.stdout:9/206: creat d1/d4/d6/dc/d10/d18/f3c x:0 0 0 2024-09-06T14:44:40.283 INFO:tasks.workunit.client.1.smithi165.stdout:7/793: write f8 [2721294,116694] 0 2024-09-06T14:44:40.283 INFO:tasks.workunit.client.1.smithi165.stdout:0/875: truncate d15/d19/d66/df8/dfd/f10a 2254649 0 2024-09-06T14:44:40.284 INFO:tasks.workunit.client.0.smithi052.stdout:9/207: truncate d1/d4/d6/dc/d10/d18/f3c 332547 0 2024-09-06T14:44:40.285 INFO:tasks.workunit.client.0.smithi052.stdout:7/188: creat d11/f43 x:0 0 0 2024-09-06T14:44:40.286 INFO:tasks.workunit.client.0.smithi052.stdout:7/189: read - d11/f43 zero size 2024-09-06T14:44:40.286 INFO:tasks.workunit.client.0.smithi052.stdout:9/208: write d1/d4/d6/f16 [4865439,73890] 0 2024-09-06T14:44:40.287 INFO:tasks.workunit.client.1.smithi165.stdout:8/957: rmdir d0/d34/d6b/d94/d70/de9/d14f 0 2024-09-06T14:44:40.289 INFO:tasks.workunit.client.1.smithi165.stdout:3/998: symlink d1/da/dc/d3b/dc6/l153 0 2024-09-06T14:44:40.290 INFO:tasks.workunit.client.0.smithi052.stdout:8/223: mkdir d6/d4c 0 2024-09-06T14:44:40.292 INFO:tasks.workunit.client.0.smithi052.stdout:9/209: rmdir d1/d4 39 2024-09-06T14:44:40.293 INFO:tasks.workunit.client.0.smithi052.stdout:9/210: write d1/f23 [168024,76167] 0 2024-09-06T14:44:40.295 INFO:tasks.workunit.client.0.smithi052.stdout:7/190: creat d11/d1c/d24/f44 x:0 0 0 2024-09-06T14:44:40.298 INFO:tasks.workunit.client.1.smithi165.stdout:7/794: chown d20/d33/f52 0 1 2024-09-06T14:44:40.299 INFO:tasks.workunit.client.1.smithi165.stdout:2/908: dwrite d9/d25/d45/d75/d34/f9d [0,4194304] 0 2024-09-06T14:44:40.303 INFO:tasks.workunit.client.1.smithi165.stdout:0/876: dread ff [0,4194304] 0 2024-09-06T14:44:40.304 INFO:tasks.workunit.client.1.smithi165.stdout:8/958: rmdir d0/d19/d36/d28/de0 39 2024-09-06T14:44:40.305 INFO:tasks.workunit.client.1.smithi165.stdout:8/959: fsync d0/d14/f25 0 2024-09-06T14:44:40.306 INFO:tasks.workunit.client.1.smithi165.stdout:3/999: fdatasync d1/d7c/f9e 0 2024-09-06T14:44:40.311 INFO:tasks.workunit.client.0.smithi052.stdout:8/224: mkdir d6/d9/d1f/d19/d4d 0 2024-09-06T14:44:40.312 INFO:tasks.workunit.client.0.smithi052.stdout:4/177: write f6 [1565796,36078] 0 2024-09-06T14:44:40.317 INFO:tasks.workunit.client.0.smithi052.stdout:4/178: dwrite f6 [0,4194304] 0 2024-09-06T14:44:40.327 INFO:tasks.workunit.client.0.smithi052.stdout:6/95: sync 2024-09-06T14:44:40.327 INFO:tasks.workunit.client.0.smithi052.stdout:6/96: readlink d2/dd/l16 0 2024-09-06T14:44:40.327 INFO:tasks.workunit.client.0.smithi052.stdout:6/97: write d2/f19 [714394,91850] 0 2024-09-06T14:44:40.328 INFO:tasks.workunit.client.0.smithi052.stdout:6/98: chown d2/f1d 60923 1 2024-09-06T14:44:40.333 INFO:tasks.workunit.client.0.smithi052.stdout:9/211: mkdir d1/d26/d3d 0 2024-09-06T14:44:40.338 INFO:tasks.workunit.client.1.smithi165.stdout:8/960: unlink d0/d14/f25 0 2024-09-06T14:44:40.339 INFO:tasks.workunit.client.0.smithi052.stdout:4/179: mknod d9/d10/d17/c47 0 2024-09-06T14:44:40.339 INFO:tasks.workunit.client.0.smithi052.stdout:6/99: dread d2/f12 [0,4194304] 0 2024-09-06T14:44:40.340 INFO:tasks.workunit.client.0.smithi052.stdout:6/100: truncate d2/fb 4337525 0 2024-09-06T14:44:40.341 INFO:tasks.workunit.client.0.smithi052.stdout:9/212: chown d1/d4/d6/dd/d22/l3a 29802439 1 2024-09-06T14:44:40.342 INFO:tasks.workunit.client.0.smithi052.stdout:9/213: fdatasync d1/d4/d6/f16 0 2024-09-06T14:44:40.342 INFO:tasks.workunit.client.0.smithi052.stdout:7/191: rename d11/d1c/d26/l3e to d11/d1c/l45 0 2024-09-06T14:44:40.342 INFO:tasks.workunit.client.0.smithi052.stdout:9/214: chown d1/d4/f5 4 1 2024-09-06T14:44:40.343 INFO:tasks.workunit.client.0.smithi052.stdout:7/192: truncate d11/d1c/f32 288530 0 2024-09-06T14:44:40.345 INFO:tasks.workunit.client.0.smithi052.stdout:4/180: creat d9/d10/d19/f48 x:0 0 0 2024-09-06T14:44:40.345 INFO:tasks.workunit.client.0.smithi052.stdout:7/193: truncate d11/d1c/d24/f25 5173238 0 2024-09-06T14:44:40.346 INFO:tasks.workunit.client.0.smithi052.stdout:6/101: mkdir d2/d1f 0 2024-09-06T14:44:40.347 INFO:tasks.workunit.client.1.smithi165.stdout:0/877: fsync d15/f4b 0 2024-09-06T14:44:40.348 INFO:tasks.workunit.client.1.smithi165.stdout:0/878: chown d15/d19/d28/d4f/da7/ce8 59593247 1 2024-09-06T14:44:40.349 INFO:tasks.workunit.client.1.smithi165.stdout:0/879: write d15/d19/f46 [3143704,69098] 0 2024-09-06T14:44:40.350 INFO:tasks.workunit.client.1.smithi165.stdout:8/961: creat d0/d19/d36/d28/d64/f150 x:0 0 0 2024-09-06T14:44:40.352 INFO:tasks.workunit.client.0.smithi052.stdout:6/102: creat d2/dd/f20 x:0 0 0 2024-09-06T14:44:40.353 INFO:tasks.workunit.client.0.smithi052.stdout:7/194: dread d11/d1c/f1e [0,4194304] 0 2024-09-06T14:44:40.354 INFO:tasks.workunit.client.0.smithi052.stdout:4/181: dwrite d9/f40 [0,4194304] 0 2024-09-06T14:44:40.354 INFO:tasks.workunit.client.0.smithi052.stdout:8/225: getdents d6/d9 0 2024-09-06T14:44:40.354 INFO:tasks.workunit.client.1.smithi165.stdout:1/882: getdents d0/d1c/d41/de3 0 2024-09-06T14:44:40.354 INFO:tasks.workunit.client.0.smithi052.stdout:7/195: readlink d11/d1c/l2f 0 2024-09-06T14:44:40.356 INFO:tasks.workunit.client.1.smithi165.stdout:6/970: getdents d29/d6a/d83/d89/ddb 0 2024-09-06T14:44:40.361 INFO:tasks.workunit.client.1.smithi165.stdout:7/795: rename d20/d3b/d69/d88/fff to d20/f100 0 2024-09-06T14:44:40.361 INFO:tasks.workunit.client.1.smithi165.stdout:7/796: chown d20/d65/l8e 1 1 2024-09-06T14:44:40.362 INFO:tasks.workunit.client.1.smithi165.stdout:7/797: dread - d20/d3b/d69/fe8 zero size 2024-09-06T14:44:40.364 INFO:tasks.workunit.client.0.smithi052.stdout:8/226: creat d6/d9/df/f4e x:0 0 0 2024-09-06T14:44:40.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/798: readlink d20/d33/d53/lce 0 2024-09-06T14:44:40.369 INFO:tasks.workunit.client.0.smithi052.stdout:4/182: mknod d9/c49 0 2024-09-06T14:44:40.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/799: chown d20/d3b/d69/d88/d30/fe4 21571588 1 2024-09-06T14:44:40.370 INFO:tasks.workunit.client.0.smithi052.stdout:9/215: dread d1/f17 [4194304,4194304] 0 2024-09-06T14:44:40.370 INFO:tasks.workunit.client.1.smithi165.stdout:0/880: readlink d15/d19/d50/d53/d57/le2 0 2024-09-06T14:44:40.372 INFO:tasks.workunit.client.0.smithi052.stdout:8/227: dwrite d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:40.375 INFO:tasks.workunit.client.0.smithi052.stdout:9/216: dread d1/d4/d6/dc/d10/f34 [4194304,4194304] 0 2024-09-06T14:44:40.379 INFO:tasks.workunit.client.0.smithi052.stdout:6/103: dwrite d2/f12 [0,4194304] 0 2024-09-06T14:44:40.382 INFO:tasks.workunit.client.1.smithi165.stdout:6/971: dwrite d29/d32/dee/f104 [0,4194304] 0 2024-09-06T14:44:40.383 INFO:tasks.workunit.client.1.smithi165.stdout:6/972: fsync d29/d6a/f123 0 2024-09-06T14:44:40.384 INFO:tasks.workunit.client.1.smithi165.stdout:8/962: rename d0/d9e/lbd to d0/d19/d36/d28/d64/l151 0 2024-09-06T14:44:40.385 INFO:tasks.workunit.client.1.smithi165.stdout:8/963: chown d0/d19/d36/d2d 202 1 2024-09-06T14:44:40.387 INFO:tasks.workunit.client.1.smithi165.stdout:2/909: getdents d9/d25/d46 0 2024-09-06T14:44:40.388 INFO:tasks.workunit.client.0.smithi052.stdout:4/183: chown d9/d10/l43 174 1 2024-09-06T14:44:40.392 INFO:tasks.workunit.client.0.smithi052.stdout:9/217: mknod d1/d4/d6/dd/d2b/c3e 0 2024-09-06T14:44:40.393 INFO:tasks.workunit.client.0.smithi052.stdout:7/196: truncate d11/d1c/f27 670518 0 2024-09-06T14:44:40.396 INFO:tasks.workunit.client.0.smithi052.stdout:4/184: creat d9/d2d/f4a x:0 0 0 2024-09-06T14:44:40.397 INFO:tasks.workunit.client.0.smithi052.stdout:8/228: mknod d6/d9/df/d41/c4f 0 2024-09-06T14:44:40.397 INFO:tasks.workunit.client.0.smithi052.stdout:4/185: fdatasync d9/d10/d17/f42 0 2024-09-06T14:44:40.398 INFO:tasks.workunit.client.0.smithi052.stdout:4/186: dread - d9/d10/d17/d39/f46 zero size 2024-09-06T14:44:40.400 INFO:tasks.workunit.client.0.smithi052.stdout:9/218: mknod d1/d4/df/c3f 0 2024-09-06T14:44:40.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/229: write d6/d9/df/d1b/f30 [872035,127968] 0 2024-09-06T14:44:40.401 INFO:tasks.workunit.client.0.smithi052.stdout:7/197: creat d11/d1c/d26/f46 x:0 0 0 2024-09-06T14:44:40.401 INFO:tasks.workunit.client.0.smithi052.stdout:9/219: dread - d1/d4/d6/f35 zero size 2024-09-06T14:44:40.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/230: fdatasync d6/d9/d1f/d19/f2d 0 2024-09-06T14:44:40.402 INFO:tasks.workunit.client.0.smithi052.stdout:8/231: write d6/d16/f1e [5248664,103963] 0 2024-09-06T14:44:40.403 INFO:tasks.workunit.client.0.smithi052.stdout:9/220: fdatasync d1/d4/d6/dc/d10/d18/f33 0 2024-09-06T14:44:40.403 INFO:tasks.workunit.client.0.smithi052.stdout:7/198: truncate d11/d1c/d24/f44 949947 0 2024-09-06T14:44:40.405 INFO:tasks.workunit.client.0.smithi052.stdout:7/199: dread - d11/f2c zero size 2024-09-06T14:44:40.411 INFO:tasks.workunit.client.0.smithi052.stdout:6/104: getdents d2 0 2024-09-06T14:44:40.412 INFO:tasks.workunit.client.0.smithi052.stdout:6/105: write d2/dd/f20 [857858,49025] 0 2024-09-06T14:44:40.413 INFO:tasks.workunit.client.0.smithi052.stdout:6/106: fsync d2/f12 0 2024-09-06T14:44:40.413 INFO:tasks.workunit.client.0.smithi052.stdout:8/232: symlink d6/d9/d1f/d19/l50 0 2024-09-06T14:44:40.414 INFO:tasks.workunit.client.0.smithi052.stdout:6/107: readlink d2/dd/l16 0 2024-09-06T14:44:40.416 INFO:tasks.workunit.client.0.smithi052.stdout:6/108: dread d2/f17 [0,4194304] 0 2024-09-06T14:44:40.417 INFO:tasks.workunit.client.0.smithi052.stdout:9/221: creat d1/d4/d6/dd/d22/f40 x:0 0 0 2024-09-06T14:44:40.427 INFO:tasks.workunit.client.0.smithi052.stdout:9/222: mkdir d1/d26/d41 0 2024-09-06T14:44:40.430 INFO:tasks.workunit.client.0.smithi052.stdout:8/233: mkdir d6/d4c/d51 0 2024-09-06T14:44:40.434 INFO:tasks.workunit.client.0.smithi052.stdout:4/187: dwrite d9/d2d/d33/f3f [0,4194304] 0 2024-09-06T14:44:40.436 INFO:tasks.workunit.client.0.smithi052.stdout:9/223: dwrite d1/f30 [0,4194304] 0 2024-09-06T14:44:40.437 INFO:tasks.workunit.client.0.smithi052.stdout:7/200: write d11/d1c/d26/f28 [22461,63055] 0 2024-09-06T14:44:40.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/188: rmdir d9 39 2024-09-06T14:44:40.446 INFO:tasks.workunit.client.0.smithi052.stdout:8/234: mknod d6/d22/c52 0 2024-09-06T14:44:40.450 INFO:tasks.workunit.client.0.smithi052.stdout:9/224: rmdir d1/d4/d6 39 2024-09-06T14:44:40.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/109: link d2/dd/f10 d2/dd/f21 0 2024-09-06T14:44:40.454 INFO:tasks.workunit.client.0.smithi052.stdout:4/189: dread - d9/f38 zero size 2024-09-06T14:44:40.455 INFO:tasks.workunit.client.0.smithi052.stdout:4/190: fdatasync f6 0 2024-09-06T14:44:40.456 INFO:tasks.workunit.client.0.smithi052.stdout:8/235: read d6/d9/df/d1b/f37 [37530,123170] 0 2024-09-06T14:44:40.457 INFO:tasks.workunit.client.0.smithi052.stdout:8/236: write d6/d16/f1e [1309994,30816] 0 2024-09-06T14:44:40.462 INFO:tasks.workunit.client.0.smithi052.stdout:4/191: creat d9/d2d/d33/f4b x:0 0 0 2024-09-06T14:44:40.463 INFO:tasks.workunit.client.1.smithi165.stdout:7/800: creat d20/d33/d53/d66/f101 x:0 0 0 2024-09-06T14:44:40.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/237: unlink d6/d9/d1f/c1a 0 2024-09-06T14:44:40.469 INFO:tasks.workunit.client.0.smithi052.stdout:9/225: symlink d1/l42 0 2024-09-06T14:44:40.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/238: dwrite f1 [4194304,4194304] 0 2024-09-06T14:44:40.475 INFO:tasks.workunit.client.1.smithi165.stdout:7/801: symlink d20/d65/d82/l102 0 2024-09-06T14:44:40.478 INFO:tasks.workunit.client.0.smithi052.stdout:6/110: link d2/dd/f21 d2/dd/d18/f22 0 2024-09-06T14:44:40.478 INFO:tasks.workunit.client.1.smithi165.stdout:1/883: fdatasync d0/dc8/fd6 0 2024-09-06T14:44:40.480 INFO:tasks.workunit.client.0.smithi052.stdout:7/201: dwrite d11/d1c/f1d [0,4194304] 0 2024-09-06T14:44:40.482 INFO:tasks.workunit.client.1.smithi165.stdout:6/973: symlink d29/d6a/l139 0 2024-09-06T14:44:40.483 INFO:tasks.workunit.client.1.smithi165.stdout:0/881: write fb [849141,59283] 0 2024-09-06T14:44:40.485 INFO:tasks.workunit.client.1.smithi165.stdout:8/964: creat d0/d19/d36/d2d/d110/f152 x:0 0 0 2024-09-06T14:44:40.485 INFO:tasks.workunit.client.0.smithi052.stdout:9/226: dwrite d1/d4/d6/f16 [4194304,4194304] 0 2024-09-06T14:44:40.491 INFO:tasks.workunit.client.1.smithi165.stdout:7/802: rename d20/d4d/d54/fbe to d20/d4d/d54/dc1/f103 0 2024-09-06T14:44:40.493 INFO:tasks.workunit.client.0.smithi052.stdout:4/192: link f7 d9/d10/d19/d41/f4c 0 2024-09-06T14:44:40.494 INFO:tasks.workunit.client.1.smithi165.stdout:8/965: dwrite d0/fd [4194304,4194304] 0 2024-09-06T14:44:40.494 INFO:tasks.workunit.client.1.smithi165.stdout:7/803: write d20/d3b/d69/d88/fde [3100471,94547] 0 2024-09-06T14:44:40.505 INFO:tasks.workunit.client.1.smithi165.stdout:1/884: link d0/d2a/d18/f43 d0/d2a/d18/d24/d4b/d93/f121 0 2024-09-06T14:44:40.506 INFO:tasks.workunit.client.0.smithi052.stdout:4/193: mkdir d9/d2d/d33/d4d 0 2024-09-06T14:44:40.507 INFO:tasks.workunit.client.1.smithi165.stdout:2/910: dwrite d9/d25/d46/d7e/d11d/d48/fc3 [0,4194304] 0 2024-09-06T14:44:40.508 INFO:tasks.workunit.client.1.smithi165.stdout:6/974: rename d29/d39/d5b/d62/d135 to d29/d39/d5b/d62/d9f/dce/d13a 0 2024-09-06T14:44:40.509 INFO:tasks.workunit.client.0.smithi052.stdout:8/239: dwrite d6/d9/df/d1b/f2f [0,4194304] 0 2024-09-06T14:44:40.510 INFO:tasks.workunit.client.0.smithi052.stdout:8/240: chown d6/d9/d1f 78672632 1 2024-09-06T14:44:40.510 INFO:tasks.workunit.client.1.smithi165.stdout:0/882: creat d15/d19/d50/d53/d7c/de4/f121 x:0 0 0 2024-09-06T14:44:40.511 INFO:tasks.workunit.client.0.smithi052.stdout:8/241: read d6/d9/df/d1b/f2f [1812767,55365] 0 2024-09-06T14:44:40.512 INFO:tasks.workunit.client.1.smithi165.stdout:0/883: truncate d15/d19/d50/d53/d7c/dbb/f11c 321082 0 2024-09-06T14:44:40.514 INFO:tasks.workunit.client.1.smithi165.stdout:8/966: creat d0/f153 x:0 0 0 2024-09-06T14:44:40.515 INFO:tasks.workunit.client.1.smithi165.stdout:8/967: write d0/d14/d3e/f35 [1698339,13450] 0 2024-09-06T14:44:40.516 INFO:tasks.workunit.client.0.smithi052.stdout:6/111: write d2/dd/d18/f22 [1400913,97114] 0 2024-09-06T14:44:40.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/227: creat d1/d4/f43 x:0 0 0 2024-09-06T14:44:40.524 INFO:tasks.workunit.client.0.smithi052.stdout:7/202: dwrite d11/d1c/d24/f38 [0,4194304] 0 2024-09-06T14:44:40.526 INFO:tasks.workunit.client.0.smithi052.stdout:7/203: dread - d11/d1c/d24/f35 zero size 2024-09-06T14:44:40.526 INFO:tasks.workunit.client.1.smithi165.stdout:6/975: rename d29/ce3 to d29/d93/d87/df2/c13b 0 2024-09-06T14:44:40.527 INFO:tasks.workunit.client.0.smithi052.stdout:7/204: write d11/f23 [335716,850] 0 2024-09-06T14:44:40.527 INFO:tasks.workunit.client.0.smithi052.stdout:8/242: chown d6/d9/d1f/d14/c15 59076140 1 2024-09-06T14:44:40.533 INFO:tasks.workunit.client.1.smithi165.stdout:6/976: dread d29/d39/d5b/d68/f6f [0,4194304] 0 2024-09-06T14:44:40.535 INFO:tasks.workunit.client.1.smithi165.stdout:8/968: dread - d0/d14/d3e/db4/fdb zero size 2024-09-06T14:44:40.538 INFO:tasks.workunit.client.1.smithi165.stdout:0/884: rename d15/d19/d50/fd9 to d15/d6e/dcc/f122 0 2024-09-06T14:44:40.538 INFO:tasks.workunit.client.1.smithi165.stdout:1/885: dwrite d0/d1c/d1d/fb2 [0,4194304] 0 2024-09-06T14:44:40.539 INFO:tasks.workunit.client.0.smithi052.stdout:7/205: mknod d11/c47 0 2024-09-06T14:44:40.543 INFO:tasks.workunit.client.0.smithi052.stdout:4/194: write d9/d10/d17/f2a [242,49763] 0 2024-09-06T14:44:40.545 INFO:tasks.workunit.client.0.smithi052.stdout:9/228: symlink d1/d4/d6/dc/d38/l44 0 2024-09-06T14:44:40.548 INFO:tasks.workunit.client.0.smithi052.stdout:7/206: creat d11/d1c/d26/f48 x:0 0 0 2024-09-06T14:44:40.550 INFO:tasks.workunit.client.0.smithi052.stdout:7/207: write d11/d1c/f34 [1180361,18409] 0 2024-09-06T14:44:40.550 INFO:tasks.workunit.client.0.smithi052.stdout:6/112: rmdir d2/d1f 0 2024-09-06T14:44:40.552 INFO:tasks.workunit.client.0.smithi052.stdout:4/195: mknod d9/d10/d17/d39/c4e 0 2024-09-06T14:44:40.555 INFO:tasks.workunit.client.0.smithi052.stdout:9/229: chown d1/d4/d6/dc/l3b 1 1 2024-09-06T14:44:40.556 INFO:tasks.workunit.client.0.smithi052.stdout:9/230: chown d1/d4/d6/dc/d10/d18 14 1 2024-09-06T14:44:40.556 INFO:tasks.workunit.client.1.smithi165.stdout:8/969: dread d0/d9e/fc8 [0,4194304] 0 2024-09-06T14:44:40.558 INFO:tasks.workunit.client.1.smithi165.stdout:0/885: mknod d15/d19/d50/d53/d7c/dbb/c123 0 2024-09-06T14:44:40.559 INFO:tasks.workunit.client.0.smithi052.stdout:7/208: creat d11/f49 x:0 0 0 2024-09-06T14:44:40.560 INFO:tasks.workunit.client.1.smithi165.stdout:1/886: creat d0/d2a/d18/d24/d4b/d5f/f122 x:0 0 0 2024-09-06T14:44:40.561 INFO:tasks.workunit.client.0.smithi052.stdout:6/113: mknod d2/dd/d18/c23 0 2024-09-06T14:44:40.562 INFO:tasks.workunit.client.1.smithi165.stdout:7/804: link f15 d20/d33/d6a/d9a/f104 0 2024-09-06T14:44:40.563 INFO:tasks.workunit.client.0.smithi052.stdout:9/231: mkdir d1/d4/d6/dc/d45 0 2024-09-06T14:44:40.564 INFO:tasks.workunit.client.1.smithi165.stdout:6/977: dwrite d29/f49 [4194304,4194304] 0 2024-09-06T14:44:40.567 INFO:tasks.workunit.client.0.smithi052.stdout:7/209: dwrite d11/d1c/d26/f40 [0,4194304] 0 2024-09-06T14:44:40.567 INFO:tasks.workunit.client.1.smithi165.stdout:8/970: rmdir d0/d19/d36/d28 39 2024-09-06T14:44:40.568 INFO:tasks.workunit.client.0.smithi052.stdout:7/210: dread - d11/d1c/d26/f46 zero size 2024-09-06T14:44:40.568 INFO:tasks.workunit.client.1.smithi165.stdout:8/971: dread - d0/d19/d36/d2d/d33/d3a/d46/f123 zero size 2024-09-06T14:44:40.569 INFO:tasks.workunit.client.0.smithi052.stdout:6/114: rename d2/f12 to d2/dd/f24 0 2024-09-06T14:44:40.570 INFO:tasks.workunit.client.1.smithi165.stdout:8/972: write d0/d34/d6b/d94/d70/db8/f14e [70926,38860] 0 2024-09-06T14:44:40.571 INFO:tasks.workunit.client.0.smithi052.stdout:6/115: write d2/f19 [1783998,20284] 0 2024-09-06T14:44:40.573 INFO:tasks.workunit.client.1.smithi165.stdout:0/886: truncate d15/d19/d38/f4c 9135269 0 2024-09-06T14:44:40.573 INFO:tasks.workunit.client.0.smithi052.stdout:9/232: symlink d1/d26/l46 0 2024-09-06T14:44:40.573 INFO:tasks.workunit.client.1.smithi165.stdout:1/887: rmdir d0/d2a/d18/d24/d4b/d95 39 2024-09-06T14:44:40.574 INFO:tasks.workunit.client.1.smithi165.stdout:1/888: chown d0/d2a/d18/d24/d4b/d93/ca9 396303255 1 2024-09-06T14:44:40.575 INFO:tasks.workunit.client.0.smithi052.stdout:4/196: creat d9/d10/f4f x:0 0 0 2024-09-06T14:44:40.576 INFO:tasks.workunit.client.1.smithi165.stdout:2/911: getdents d9/d25/d46/d7e/d11d/d48/dce/dfc 0 2024-09-06T14:44:40.578 INFO:tasks.workunit.client.1.smithi165.stdout:1/889: chown d0/d2a/d18/d24/d4b/d93/d68/d75/cd4 28 1 2024-09-06T14:44:40.581 INFO:tasks.workunit.client.1.smithi165.stdout:6/978: getdents d29/d133 0 2024-09-06T14:44:40.583 INFO:tasks.workunit.client.1.smithi165.stdout:2/912: creat d9/d25/d46/d7e/d11d/d48/d8c/dbf/f132 x:0 0 0 2024-09-06T14:44:40.584 INFO:tasks.workunit.client.1.smithi165.stdout:7/805: truncate d20/d3b/d69/d88/d30/fad 2933198 0 2024-09-06T14:44:40.586 INFO:tasks.workunit.client.0.smithi052.stdout:7/211: unlink d11/d1c/f27 0 2024-09-06T14:44:40.587 INFO:tasks.workunit.client.0.smithi052.stdout:9/233: symlink d1/d26/d3d/l47 0 2024-09-06T14:44:40.587 INFO:tasks.workunit.client.0.smithi052.stdout:6/116: dwrite d2/dd/f24 [4194304,4194304] 0 2024-09-06T14:44:40.589 INFO:tasks.workunit.client.1.smithi165.stdout:1/890: mknod d0/d2a/d18/d24/d4b/d93/d68/d75/c123 0 2024-09-06T14:44:40.589 INFO:tasks.workunit.client.1.smithi165.stdout:6/979: dwrite d29/d39/d5b/d62/d94/fbc [0,4194304] 0 2024-09-06T14:44:40.591 INFO:tasks.workunit.client.0.smithi052.stdout:7/212: symlink d11/d1c/d24/d3b/l4a 0 2024-09-06T14:44:40.592 INFO:tasks.workunit.client.0.smithi052.stdout:7/213: chown d11/d1c/c22 89867 1 2024-09-06T14:44:40.593 INFO:tasks.workunit.client.0.smithi052.stdout:7/214: dread - d11/d1c/d24/f2d zero size 2024-09-06T14:44:40.593 INFO:tasks.workunit.client.1.smithi165.stdout:7/806: truncate d20/d33/d53/f57 3172630 0 2024-09-06T14:44:40.594 INFO:tasks.workunit.client.0.smithi052.stdout:9/234: creat d1/d4/d6/dd/f48 x:0 0 0 2024-09-06T14:44:40.595 INFO:tasks.workunit.client.1.smithi165.stdout:2/913: dwrite d9/d25/d46/d7e/d11d/d48/d8c/dbf/f132 [0,4194304] 0 2024-09-06T14:44:40.596 INFO:tasks.workunit.client.1.smithi165.stdout:8/973: rename d0/d34/d6b/d94/d70/db8/f133 to d0/d19/d24/db1/f154 0 2024-09-06T14:44:40.596 INFO:tasks.workunit.client.0.smithi052.stdout:6/117: read d2/f17 [373838,84805] 0 2024-09-06T14:44:40.598 INFO:tasks.workunit.client.1.smithi165.stdout:8/974: chown d0/f153 711228731 1 2024-09-06T14:44:40.598 INFO:tasks.workunit.client.0.smithi052.stdout:9/235: truncate d1/d4/f5 5740080 0 2024-09-06T14:44:40.604 INFO:tasks.workunit.client.1.smithi165.stdout:6/980: creat d29/d39/d5b/d62/d9f/dce/d13a/dcc/df0/f13c x:0 0 0 2024-09-06T14:44:40.604 INFO:tasks.workunit.client.1.smithi165.stdout:1/891: dwrite d0/d2a/d18/d24/d4b/d93/f3a [0,4194304] 0 2024-09-06T14:44:40.605 INFO:tasks.workunit.client.0.smithi052.stdout:6/118: mkdir d2/dd/d18/d25 0 2024-09-06T14:44:40.607 INFO:tasks.workunit.client.1.smithi165.stdout:7/807: write d20/d4d/d54/dc1/f103 [195120,77317] 0 2024-09-06T14:44:40.608 INFO:tasks.workunit.client.0.smithi052.stdout:9/236: dwrite d1/d4/d6/f16 [4194304,4194304] 0 2024-09-06T14:44:40.609 INFO:tasks.workunit.client.1.smithi165.stdout:2/914: creat d9/d25/d45/d75/d34/d117/f133 x:0 0 0 2024-09-06T14:44:40.612 INFO:tasks.workunit.client.0.smithi052.stdout:9/237: rmdir d1/d26 39 2024-09-06T14:44:40.616 INFO:tasks.workunit.client.0.smithi052.stdout:6/119: creat d2/dd/d18/d25/f26 x:0 0 0 2024-09-06T14:44:40.617 INFO:tasks.workunit.client.1.smithi165.stdout:7/808: symlink d20/d4d/d54/l105 0 2024-09-06T14:44:40.621 INFO:tasks.workunit.client.1.smithi165.stdout:2/915: symlink d9/d25/d46/d7e/d11d/d48/db1/l134 0 2024-09-06T14:44:40.622 INFO:tasks.workunit.client.0.smithi052.stdout:6/120: dread d2/dd/d18/f22 [0,4194304] 0 2024-09-06T14:44:40.623 INFO:tasks.workunit.client.0.smithi052.stdout:6/121: chown d2/dd 353 1 2024-09-06T14:44:40.624 INFO:tasks.workunit.client.1.smithi165.stdout:2/916: chown d9/d25/d46/d7e/d11d/d48/dce/lde 23703 1 2024-09-06T14:44:40.626 INFO:tasks.workunit.client.1.smithi165.stdout:2/917: read d9/f84 [2040890,92820] 0 2024-09-06T14:44:40.626 INFO:tasks.workunit.client.1.smithi165.stdout:7/809: link d20/d4d/dd4/lf7 d20/d4d/d54/dc1/l106 0 2024-09-06T14:44:40.627 INFO:tasks.workunit.client.1.smithi165.stdout:7/810: stat d20/d65/d82/lec 0 2024-09-06T14:44:40.628 INFO:tasks.workunit.client.0.smithi052.stdout:4/197: write d9/fe [3860350,49897] 0 2024-09-06T14:44:40.629 INFO:tasks.workunit.client.0.smithi052.stdout:4/198: read d9/f40 [4173589,65141] 0 2024-09-06T14:44:40.630 INFO:tasks.workunit.client.1.smithi165.stdout:1/892: fdatasync d0/d2a/d18/d24/d4b/d5f/d7c/f92 0 2024-09-06T14:44:40.634 INFO:tasks.workunit.client.1.smithi165.stdout:2/918: creat d9/d25/d46/d7e/d11d/d48/d8c/dbf/dd3/f135 x:0 0 0 2024-09-06T14:44:40.635 INFO:tasks.workunit.client.0.smithi052.stdout:4/199: rmdir d9/d10/d19/d41 39 2024-09-06T14:44:40.640 INFO:tasks.workunit.client.1.smithi165.stdout:2/919: dwrite d9/f1e [0,4194304] 0 2024-09-06T14:44:40.643 INFO:tasks.workunit.client.0.smithi052.stdout:4/200: rename d9/d10/d17/c47 to d9/d10/d17/d39/d3a/c50 0 2024-09-06T14:44:40.643 INFO:tasks.workunit.client.1.smithi165.stdout:7/811: dread d20/f2b [0,4194304] 0 2024-09-06T14:44:40.644 INFO:tasks.workunit.client.1.smithi165.stdout:1/893: link d0/d2a/d18/d24/d4b/d5f/db8/ld8 d0/d2a/d18/dde/l124 0 2024-09-06T14:44:40.647 INFO:tasks.workunit.client.1.smithi165.stdout:2/920: link d9/d25/d45/d120/d76/f6a d9/d25/d45/d75/d34/f136 0 2024-09-06T14:44:40.648 INFO:tasks.workunit.client.1.smithi165.stdout:6/981: write d29/f36 [4513240,104984] 0 2024-09-06T14:44:40.649 INFO:tasks.workunit.client.1.smithi165.stdout:7/812: mkdir d20/d3b/d69/d88/d80/d81/de1/d107 0 2024-09-06T14:44:40.651 INFO:tasks.workunit.client.1.smithi165.stdout:1/894: rename d0/d2a/d18/d24/d4b/d93/d6a/cb1 to d0/d2a/d18/d24/d4b/d5f/d7c/c125 0 2024-09-06T14:44:40.651 INFO:tasks.workunit.client.0.smithi052.stdout:6/122: getdents d2/dd/d18/d25 0 2024-09-06T14:44:40.652 INFO:tasks.workunit.client.0.smithi052.stdout:6/123: chown d2/dd/d18/d25 1383750 1 2024-09-06T14:44:40.653 INFO:tasks.workunit.client.1.smithi165.stdout:8/975: dwrite d0/d5e/d65/f9f [0,4194304] 0 2024-09-06T14:44:40.653 INFO:tasks.workunit.client.0.smithi052.stdout:6/124: chown d2/dd/f20 92400839 1 2024-09-06T14:44:40.657 INFO:tasks.workunit.client.0.smithi052.stdout:4/201: getdents d9 0 2024-09-06T14:44:40.657 INFO:tasks.workunit.client.0.smithi052.stdout:4/202: fsync d9/d10/d17/f1c 0 2024-09-06T14:44:40.658 INFO:tasks.workunit.client.1.smithi165.stdout:7/813: symlink d20/d3b/l108 0 2024-09-06T14:44:40.660 INFO:tasks.workunit.client.0.smithi052.stdout:6/125: unlink d2/f17 0 2024-09-06T14:44:40.661 INFO:tasks.workunit.client.0.smithi052.stdout:6/126: write d2/f19 [2416605,53075] 0 2024-09-06T14:44:40.665 INFO:tasks.workunit.client.0.smithi052.stdout:4/203: creat d9/d10/d17/f51 x:0 0 0 2024-09-06T14:44:40.666 INFO:tasks.workunit.client.0.smithi052.stdout:4/204: write d9/d2d/d33/f3f [4611741,130373] 0 2024-09-06T14:44:40.666 INFO:tasks.workunit.client.1.smithi165.stdout:6/982: mknod d29/d32/c13d 0 2024-09-06T14:44:40.668 INFO:tasks.workunit.client.0.smithi052.stdout:6/127: fsync d2/fc 0 2024-09-06T14:44:40.669 INFO:tasks.workunit.client.1.smithi165.stdout:2/921: dread d9/d25/d45/d75/fc0 [0,4194304] 0 2024-09-06T14:44:40.670 INFO:tasks.workunit.client.1.smithi165.stdout:7/814: mknod d20/d4d/d54/dc1/df9/dd6/c109 0 2024-09-06T14:44:40.672 INFO:tasks.workunit.client.0.smithi052.stdout:4/205: rename f6 to d9/d10/d17/d39/d3a/f52 0 2024-09-06T14:44:40.673 INFO:tasks.workunit.client.0.smithi052.stdout:4/206: truncate d9/d2d/f4a 210711 0 2024-09-06T14:44:40.674 INFO:tasks.workunit.client.1.smithi165.stdout:6/983: dwrite d29/d39/d5b/d62/d9f/dce/d13a/fe1 [0,4194304] 0 2024-09-06T14:44:40.676 INFO:tasks.workunit.client.0.smithi052.stdout:6/128: symlink d2/dd/d18/l27 0 2024-09-06T14:44:40.676 INFO:tasks.workunit.client.0.smithi052.stdout:6/129: stat d2/dd 0 2024-09-06T14:44:40.682 INFO:tasks.workunit.client.0.smithi052.stdout:4/207: chown d9/d10/l2b 0 1 2024-09-06T14:44:40.685 INFO:tasks.workunit.client.0.smithi052.stdout:4/208: symlink d9/l53 0 2024-09-06T14:44:40.687 INFO:tasks.workunit.client.1.smithi165.stdout:8/976: rename d0/d19/d36/d2d/d33/d3a/d46/db3/ccb to d0/d19/d36/d2d/d3f/c155 0 2024-09-06T14:44:40.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/130: write d2/fc [1236462,67320] 0 2024-09-06T14:44:40.688 INFO:tasks.workunit.client.1.smithi165.stdout:8/977: readlink d0/d19/d36/d2d/d3f/l41 0 2024-09-06T14:44:40.692 INFO:tasks.workunit.client.0.smithi052.stdout:6/131: rename d2/dd/d18/c23 to d2/c28 0 2024-09-06T14:44:40.693 INFO:tasks.workunit.client.1.smithi165.stdout:1/895: link d0/d2a/c9a d0/d2a/d18/d24/d4b/d93/d2b/d3e/c126 0 2024-09-06T14:44:40.694 INFO:tasks.workunit.client.1.smithi165.stdout:1/896: write d0/d2a/d18/d24/d4b/d5f/ff1 [276755,21968] 0 2024-09-06T14:44:40.695 INFO:tasks.workunit.client.0.smithi052.stdout:6/132: symlink d2/dd/l29 0 2024-09-06T14:44:40.695 INFO:tasks.workunit.client.1.smithi165.stdout:1/897: chown d0/d2a/fb 12022118 1 2024-09-06T14:44:40.696 INFO:tasks.workunit.client.1.smithi165.stdout:2/922: creat d9/d25/d45/d75/f137 x:0 0 0 2024-09-06T14:44:40.698 INFO:tasks.workunit.client.1.smithi165.stdout:8/978: fsync d0/d14/fae 0 2024-09-06T14:44:40.699 INFO:tasks.workunit.client.0.smithi052.stdout:6/133: mknod d2/dd/d18/c2a 0 2024-09-06T14:44:40.699 INFO:tasks.workunit.client.1.smithi165.stdout:6/984: write f17 [4237432,83230] 0 2024-09-06T14:44:40.700 INFO:tasks.workunit.client.1.smithi165.stdout:7/815: link d20/d3b/d69/d88/c37 d20/d4d/d54/dc1/df9/c10a 0 2024-09-06T14:44:40.703 INFO:tasks.workunit.client.0.smithi052.stdout:6/134: unlink d2/dd/l29 0 2024-09-06T14:44:40.705 INFO:tasks.workunit.client.1.smithi165.stdout:6/985: dread d29/d6a/d83/d89/fd7 [4194304,4194304] 0 2024-09-06T14:44:40.706 INFO:tasks.workunit.client.1.smithi165.stdout:7/816: dwrite d20/d3b/d69/d88/d30/d78/ffd [0,4194304] 0 2024-09-06T14:44:40.706 INFO:tasks.workunit.client.1.smithi165.stdout:6/986: write d29/d39/d5b/d62/d67/fe5 [932247,10407] 0 2024-09-06T14:44:40.708 INFO:tasks.workunit.client.1.smithi165.stdout:6/987: write d29/d32/fc1 [5171755,61685] 0 2024-09-06T14:44:40.708 INFO:tasks.workunit.client.0.smithi052.stdout:6/135: rename d2/f1d to d2/dd/d18/f2b 0 2024-09-06T14:44:40.709 INFO:tasks.workunit.client.0.smithi052.stdout:6/136: chown d2/dd/f10 106373 1 2024-09-06T14:44:40.710 INFO:tasks.workunit.client.0.smithi052.stdout:6/137: stat d2/dd/f20 0 2024-09-06T14:44:40.710 INFO:tasks.workunit.client.1.smithi165.stdout:8/979: symlink d0/d19/d36/d2d/d33/d3a/d46/dcd/l156 0 2024-09-06T14:44:40.713 INFO:tasks.workunit.client.1.smithi165.stdout:0/887: sync 2024-09-06T14:44:40.714 INFO:tasks.workunit.client.1.smithi165.stdout:0/888: truncate d15/f5a 5169142 0 2024-09-06T14:44:40.714 INFO:tasks.workunit.client.0.smithi052.stdout:4/209: creat d9/d10/f54 x:0 0 0 2024-09-06T14:44:40.716 INFO:tasks.workunit.client.0.smithi052.stdout:6/138: rename d2/dd/f24 to d2/dd/d18/d25/f2c 0 2024-09-06T14:44:40.716 INFO:tasks.workunit.client.0.smithi052.stdout:4/210: read d9/d10/d17/f1c [3886494,7734] 0 2024-09-06T14:44:40.717 INFO:tasks.workunit.client.1.smithi165.stdout:6/988: rmdir d29/d6a/d83/d89 39 2024-09-06T14:44:40.717 INFO:tasks.workunit.client.0.smithi052.stdout:6/139: truncate d2/dd/f20 1135079 0 2024-09-06T14:44:40.718 INFO:tasks.workunit.client.1.smithi165.stdout:0/889: truncate d15/d19/d2c/f36 9271897 0 2024-09-06T14:44:40.719 INFO:tasks.workunit.client.1.smithi165.stdout:7/817: creat d20/d65/d82/def/f10b x:0 0 0 2024-09-06T14:44:40.720 INFO:tasks.workunit.client.1.smithi165.stdout:7/818: read d20/d3b/f8b [412490,54488] 0 2024-09-06T14:44:40.720 INFO:tasks.workunit.client.1.smithi165.stdout:7/819: chown d20/d4d/d54/dc1/f103 100187 1 2024-09-06T14:44:40.721 INFO:tasks.workunit.client.0.smithi052.stdout:4/211: mknod d9/d10/d17/d39/d3a/c55 0 2024-09-06T14:44:40.725 INFO:tasks.workunit.client.0.smithi052.stdout:6/140: dwrite d2/dd/d18/f22 [0,4194304] 0 2024-09-06T14:44:40.725 INFO:tasks.workunit.client.0.smithi052.stdout:4/212: mknod d9/d10/d17/c56 0 2024-09-06T14:44:40.727 INFO:tasks.workunit.client.1.smithi165.stdout:7/820: creat d20/d3b/d69/d88/dc6/f10c x:0 0 0 2024-09-06T14:44:40.728 INFO:tasks.workunit.client.1.smithi165.stdout:2/923: truncate d9/f1e 1508409 0 2024-09-06T14:44:40.729 INFO:tasks.workunit.client.1.smithi165.stdout:7/821: chown d20/d40/c7a 99030 1 2024-09-06T14:44:40.730 INFO:tasks.workunit.client.1.smithi165.stdout:2/924: fsync d9/d25/d45/d120/d76/f104 0 2024-09-06T14:44:40.731 INFO:tasks.workunit.client.0.smithi052.stdout:4/213: truncate d9/d10/f22 4484870 0 2024-09-06T14:44:40.732 INFO:tasks.workunit.client.1.smithi165.stdout:1/898: dwrite d0/f10 [0,4194304] 0 2024-09-06T14:44:40.734 INFO:tasks.workunit.client.1.smithi165.stdout:8/980: getdents d0/d34/d6b/d94/d70 0 2024-09-06T14:44:40.735 INFO:tasks.workunit.client.0.smithi052.stdout:4/214: mknod d9/d10/d17/d39/d3a/c57 0 2024-09-06T14:44:40.736 INFO:tasks.workunit.client.0.smithi052.stdout:4/215: readlink d9/d10/l43 0 2024-09-06T14:44:40.737 INFO:tasks.workunit.client.0.smithi052.stdout:4/216: write d9/d10/d19/f3c [745094,106732] 0 2024-09-06T14:44:40.738 INFO:tasks.workunit.client.1.smithi165.stdout:1/899: write d0/d2a/d18/fe5 [445808,106602] 0 2024-09-06T14:44:40.739 INFO:tasks.workunit.client.1.smithi165.stdout:8/981: mkdir d0/d34/d6b/d94/d70/d157 0 2024-09-06T14:44:40.739 INFO:tasks.workunit.client.1.smithi165.stdout:0/890: write d15/d6e/faf [165786,104805] 0 2024-09-06T14:44:40.740 INFO:tasks.workunit.client.0.smithi052.stdout:4/217: creat d9/d10/d17/d39/f58 x:0 0 0 2024-09-06T14:44:40.741 INFO:tasks.workunit.client.1.smithi165.stdout:6/989: dread d29/d6a/d83/f95 [0,4194304] 0 2024-09-06T14:44:40.743 INFO:tasks.workunit.client.1.smithi165.stdout:1/900: chown d0/d2a/d18/d24/d4b/d93/d2b/f50 155518574 1 2024-09-06T14:44:40.743 INFO:tasks.workunit.client.1.smithi165.stdout:2/925: getdents d9/d25/d45/d120/d76 0 2024-09-06T14:44:40.745 INFO:tasks.workunit.client.1.smithi165.stdout:8/982: creat d0/d34/d6b/d94/d70/de9/f158 x:0 0 0 2024-09-06T14:44:40.746 INFO:tasks.workunit.client.1.smithi165.stdout:6/990: fsync f1e 0 2024-09-06T14:44:40.747 INFO:tasks.workunit.client.0.smithi052.stdout:4/218: getdents d9/d10 0 2024-09-06T14:44:40.748 INFO:tasks.workunit.client.1.smithi165.stdout:1/901: creat d0/d2a/d18/d24/d4b/d93/d2b/f127 x:0 0 0 2024-09-06T14:44:40.749 INFO:tasks.workunit.client.0.smithi052.stdout:4/219: chown d9/d10/d17/d39/d3a/c57 2503 1 2024-09-06T14:44:40.749 INFO:tasks.workunit.client.1.smithi165.stdout:0/891: creat d15/d19/d28/f124 x:0 0 0 2024-09-06T14:44:40.749 INFO:tasks.workunit.client.1.smithi165.stdout:2/926: creat d9/d25/d46/d7e/d90/dd8/ddb/f138 x:0 0 0 2024-09-06T14:44:40.750 INFO:tasks.workunit.client.1.smithi165.stdout:6/991: chown d29/d6a/d83/d89/f100 1063719667 1 2024-09-06T14:44:40.751 INFO:tasks.workunit.client.1.smithi165.stdout:1/902: creat d0/d2a/d18/d24/d4b/d93/d97/f128 x:0 0 0 2024-09-06T14:44:40.752 INFO:tasks.workunit.client.0.smithi052.stdout:4/220: mknod d9/c59 0 2024-09-06T14:44:40.752 INFO:tasks.workunit.client.1.smithi165.stdout:0/892: rmdir d15/d19/d28 39 2024-09-06T14:44:40.752 INFO:tasks.workunit.client.1.smithi165.stdout:7/822: dread d20/d65/f2d [0,4194304] 0 2024-09-06T14:44:40.754 INFO:tasks.workunit.client.1.smithi165.stdout:8/983: rename d0/d19/d36/d2d/f38 to d0/d19/d36/d28/dda/f159 0 2024-09-06T14:44:40.755 INFO:tasks.workunit.client.1.smithi165.stdout:7/823: write d20/d33/d53/d66/f101 [925009,12748] 0 2024-09-06T14:44:40.755 INFO:tasks.workunit.client.1.smithi165.stdout:2/927: creat d9/d25/d46/d7e/d11d/d11c/d125/f139 x:0 0 0 2024-09-06T14:44:40.756 INFO:tasks.workunit.client.1.smithi165.stdout:1/903: mkdir d0/d1c/d1d/d22/d129 0 2024-09-06T14:44:40.756 INFO:tasks.workunit.client.1.smithi165.stdout:7/824: stat d20/d3b/d69/d88/d80/d81/l96 0 2024-09-06T14:44:40.757 INFO:tasks.workunit.client.1.smithi165.stdout:2/928: dread - d9/d25/d46/d7e/d11d/f127 zero size 2024-09-06T14:44:40.757 INFO:tasks.workunit.client.1.smithi165.stdout:0/893: unlink d15/d19/d50/d53/d7c/fdb 0 2024-09-06T14:44:40.758 INFO:tasks.workunit.client.1.smithi165.stdout:7/825: stat d20/d33/d53/d66/laf 0 2024-09-06T14:44:40.759 INFO:tasks.workunit.client.1.smithi165.stdout:7/826: chown d20/d33/d6a/d9a/la1 3 1 2024-09-06T14:44:40.759 INFO:tasks.workunit.client.1.smithi165.stdout:2/929: write d9/d25/d46/d7e/d11d/d48/dce/dfc/fda [180277,121716] 0 2024-09-06T14:44:40.760 INFO:tasks.workunit.client.0.smithi052.stdout:4/221: dwrite d9/d10/f54 [0,4194304] 0 2024-09-06T14:44:40.764 INFO:tasks.workunit.client.1.smithi165.stdout:1/904: unlink d0/d2a/d18/d24/d4b/d93/d2b/d3e/lc7 0 2024-09-06T14:44:40.767 INFO:tasks.workunit.client.1.smithi165.stdout:2/930: dwrite d9/d25/f57 [0,4194304] 0 2024-09-06T14:44:40.767 INFO:tasks.workunit.client.1.smithi165.stdout:6/992: link d29/d6a/d83/fc4 d29/d39/d5b/d62/d94/df3/f13e 0 2024-09-06T14:44:40.768 INFO:tasks.workunit.client.1.smithi165.stdout:0/894: mknod d15/d19/d50/d53/dbf/dc5/c125 0 2024-09-06T14:44:40.769 INFO:tasks.workunit.client.1.smithi165.stdout:2/931: fsync d9/d25/d46/d7e/d11d/d48/dce/dfc/f10f 0 2024-09-06T14:44:40.772 INFO:tasks.workunit.client.1.smithi165.stdout:7/827: creat d20/d4d/d54/f10d x:0 0 0 2024-09-06T14:44:40.777 INFO:tasks.workunit.client.1.smithi165.stdout:7/828: dwrite d20/d65/f34 [0,4194304] 0 2024-09-06T14:44:40.778 INFO:tasks.workunit.client.0.smithi052.stdout:4/222: link d9/d10/d17/d39/d3a/c55 d9/d2d/c5a 0 2024-09-06T14:44:40.778 INFO:tasks.workunit.client.0.smithi052.stdout:4/223: chown d9/d10/d17/f1c 10 1 2024-09-06T14:44:40.779 INFO:tasks.workunit.client.1.smithi165.stdout:7/829: chown d20/d3b/d69/d88/d30/l9f 283535 1 2024-09-06T14:44:40.782 INFO:tasks.workunit.client.1.smithi165.stdout:2/932: creat d9/d23/d71/f13a x:0 0 0 2024-09-06T14:44:40.783 INFO:tasks.workunit.client.0.smithi052.stdout:4/224: creat d9/d10/d17/d39/d3a/f5b x:0 0 0 2024-09-06T14:44:40.784 INFO:tasks.workunit.client.0.smithi052.stdout:4/225: readlink d9/d2d/l32 0 2024-09-06T14:44:40.785 INFO:tasks.workunit.client.1.smithi165.stdout:2/933: fsync d9/d25/d46/d7e/d11d/d48/d8c/dbf/f132 0 2024-09-06T14:44:40.785 INFO:tasks.workunit.client.0.smithi052.stdout:4/226: chown d9/d10/d17/f51 313431851 1 2024-09-06T14:44:40.787 INFO:tasks.workunit.client.1.smithi165.stdout:8/984: dwrite d0/d19/d36/d28/d64/f106 [4194304,4194304] 0 2024-09-06T14:44:40.789 INFO:tasks.workunit.client.0.smithi052.stdout:4/227: chown d9/c49 2 1 2024-09-06T14:44:40.794 INFO:tasks.workunit.client.1.smithi165.stdout:6/993: getdents d29/d39/d5b/d68 0 2024-09-06T14:44:40.797 INFO:tasks.workunit.client.1.smithi165.stdout:8/985: mknod d0/d14/d3e/dd8/c15a 0 2024-09-06T14:44:40.797 INFO:tasks.workunit.client.0.smithi052.stdout:4/228: dread d9/d10/d19/f28 [0,4194304] 0 2024-09-06T14:44:40.798 INFO:tasks.workunit.client.1.smithi165.stdout:0/895: dwrite d15/d19/d28/d3a/d5d/dd6/ff4 [0,4194304] 0 2024-09-06T14:44:40.799 INFO:tasks.workunit.client.1.smithi165.stdout:0/896: read - d15/d19/d50/d53/dbf/dc5/f11e zero size 2024-09-06T14:44:40.800 INFO:tasks.workunit.client.1.smithi165.stdout:2/934: dread d9/d25/d46/d7e/d11d/d48/fb6 [0,4194304] 0 2024-09-06T14:44:40.801 INFO:tasks.workunit.client.0.smithi052.stdout:4/229: mkdir d9/d10/d17/d39/d3a/d5c 0 2024-09-06T14:44:40.802 INFO:tasks.workunit.client.0.smithi052.stdout:4/230: fdatasync d9/d2d/d33/f37 0 2024-09-06T14:44:40.802 INFO:tasks.workunit.client.1.smithi165.stdout:2/935: readlink d9/d88/dac/d95/ldc 0 2024-09-06T14:44:40.804 INFO:tasks.workunit.client.1.smithi165.stdout:0/897: mknod d15/d19/d50/d53/d57/c126 0 2024-09-06T14:44:40.805 INFO:tasks.workunit.client.1.smithi165.stdout:1/905: dread d0/d2a/d18/d24/d4b/f51 [0,4194304] 0 2024-09-06T14:44:40.806 INFO:tasks.workunit.client.0.smithi052.stdout:4/231: mkdir d9/d2d/d33/d5d 0 2024-09-06T14:44:40.807 INFO:tasks.workunit.client.1.smithi165.stdout:6/994: dwrite d29/d39/ff1 [0,4194304] 0 2024-09-06T14:44:40.808 INFO:tasks.workunit.client.0.smithi052.stdout:4/232: rmdir d9/d10/d17/d39 39 2024-09-06T14:44:40.809 INFO:tasks.workunit.client.0.smithi052.stdout:4/233: rmdir d9 39 2024-09-06T14:44:40.813 INFO:tasks.workunit.client.1.smithi165.stdout:8/986: write d0/d19/d24/fab [899044,46718] 0 2024-09-06T14:44:40.814 INFO:tasks.workunit.client.0.smithi052.stdout:4/234: stat d9/c21 0 2024-09-06T14:44:40.814 INFO:tasks.workunit.client.0.smithi052.stdout:4/235: fsync d9/d10/d19/f2c 0 2024-09-06T14:44:40.815 INFO:tasks.workunit.client.0.smithi052.stdout:4/236: chown d9/d10/d19/f28 1 1 2024-09-06T14:44:40.817 INFO:tasks.workunit.client.1.smithi165.stdout:1/906: mknod d0/d1c/dd5/c12a 0 2024-09-06T14:44:40.818 INFO:tasks.workunit.client.0.smithi052.stdout:4/237: readlink d9/l3e 0 2024-09-06T14:44:40.818 INFO:tasks.workunit.client.1.smithi165.stdout:2/936: link d9/d25/d46/d7e/d11d/d48/d8c/fff d9/d25/d46/d7e/d11d/d48/dce/dfc/de8/f13b 0 2024-09-06T14:44:40.819 INFO:tasks.workunit.client.1.smithi165.stdout:8/987: truncate d0/d19/d36/d2d/d33/d84/f120 4890064 0 2024-09-06T14:44:40.822 INFO:tasks.workunit.client.1.smithi165.stdout:2/937: mkdir d9/d25/dfd/d13c 0 2024-09-06T14:44:40.822 INFO:tasks.workunit.client.1.smithi165.stdout:6/995: dread d29/f47 [0,4194304] 0 2024-09-06T14:44:40.822 INFO:tasks.workunit.client.1.smithi165.stdout:0/898: dwrite d15/d19/d28/d9e/da3/de5/f11b [0,4194304] 0 2024-09-06T14:44:40.823 INFO:tasks.workunit.client.1.smithi165.stdout:7/830: dread d20/d3b/f86 [0,4194304] 0 2024-09-06T14:44:40.825 INFO:tasks.workunit.client.1.smithi165.stdout:6/996: mkdir d29/d32/d13f 0 2024-09-06T14:44:40.825 INFO:tasks.workunit.client.1.smithi165.stdout:2/938: mkdir d9/d25/d45/d120/dd1/d13d 0 2024-09-06T14:44:40.826 INFO:tasks.workunit.client.1.smithi165.stdout:0/899: mkdir d15/d19/d28/d4f/d52/d127 0 2024-09-06T14:44:40.828 INFO:tasks.workunit.client.1.smithi165.stdout:2/939: dread - d9/d23/d52/f7f zero size 2024-09-06T14:44:40.830 INFO:tasks.workunit.client.1.smithi165.stdout:6/997: read d29/d93/fb0 [7031570,99578] 0 2024-09-06T14:44:40.832 INFO:tasks.workunit.client.1.smithi165.stdout:2/940: creat d9/d23/f13e x:0 0 0 2024-09-06T14:44:40.833 INFO:tasks.workunit.client.1.smithi165.stdout:6/998: symlink d29/d39/d5b/d62/d94/l140 0 2024-09-06T14:44:40.834 INFO:tasks.workunit.client.1.smithi165.stdout:2/941: chown d9/d25/d45/d75/f137 10419779 1 2024-09-06T14:44:40.834 INFO:tasks.workunit.client.1.smithi165.stdout:0/900: dwrite d15/f5a [4194304,4194304] 0 2024-09-06T14:44:40.836 INFO:tasks.workunit.client.1.smithi165.stdout:6/999: unlink d29/d39/d5b/d62/d67/c10b 0 2024-09-06T14:44:40.836 INFO:tasks.workunit.client.1.smithi165.stdout:0/901: write d15/d19/d28/d9e/da3/de5/ff3 [1804150,95680] 0 2024-09-06T14:44:40.837 INFO:tasks.workunit.client.1.smithi165.stdout:2/942: mknod d9/d25/d45/d75/d34/d11f/c13f 0 2024-09-06T14:44:40.839 INFO:tasks.workunit.client.1.smithi165.stdout:2/943: chown d9/d25/d46/d7e/d11d/d48/f4d 163362464 1 2024-09-06T14:44:40.843 INFO:tasks.workunit.client.1.smithi165.stdout:2/944: rename d9/cf2 to d9/d25/d46/d7e/d11d/d48/d8c/dee/c140 0 2024-09-06T14:44:40.844 INFO:tasks.workunit.client.1.smithi165.stdout:1/907: dread d0/d2a/fd [0,4194304] 0 2024-09-06T14:44:40.845 INFO:tasks.workunit.client.1.smithi165.stdout:2/945: read d9/d25/d46/d7e/d11d/d48/dce/f129 [3279227,80965] 0 2024-09-06T14:44:40.848 INFO:tasks.workunit.client.1.smithi165.stdout:1/908: creat d0/d2a/d18/d24/d4b/d5f/d7c/f12b x:0 0 0 2024-09-06T14:44:40.849 INFO:tasks.workunit.client.1.smithi165.stdout:2/946: rmdir d9/d25/d45/d75/d34/d11f 39 2024-09-06T14:44:40.850 INFO:tasks.workunit.client.1.smithi165.stdout:1/909: stat d0/d1c/d1d/d57/cc9 0 2024-09-06T14:44:40.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/238: dwrite d9/f40 [4194304,4194304] 0 2024-09-06T14:44:40.850 INFO:tasks.workunit.client.1.smithi165.stdout:2/947: fsync d9/d25/d45/d75/fc0 0 2024-09-06T14:44:40.853 INFO:tasks.workunit.client.1.smithi165.stdout:7/831: truncate d20/d4d/d54/dc1/fcf 3146521 0 2024-09-06T14:44:40.854 INFO:tasks.workunit.client.1.smithi165.stdout:7/832: write d20/d65/d82/d97/fdf [947969,113181] 0 2024-09-06T14:44:40.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/239: chown d9/c11 120381647 1 2024-09-06T14:44:40.855 INFO:tasks.workunit.client.0.smithi052.stdout:4/240: write d9/d10/f4f [773939,120140] 0 2024-09-06T14:44:40.856 INFO:tasks.workunit.client.1.smithi165.stdout:7/833: write d20/d4d/d54/f10d [358878,128090] 0 2024-09-06T14:44:40.858 INFO:tasks.workunit.client.1.smithi165.stdout:2/948: unlink d9/d25/d45/d75/d34/cf9 0 2024-09-06T14:44:40.860 INFO:tasks.workunit.client.1.smithi165.stdout:7/834: creat d20/d65/d82/def/f10e x:0 0 0 2024-09-06T14:44:40.860 INFO:tasks.workunit.client.1.smithi165.stdout:2/949: chown d9/d25/d45/d120/d76/l36 3537054 1 2024-09-06T14:44:40.861 INFO:tasks.workunit.client.1.smithi165.stdout:0/902: write d15/d19/f21 [774930,17214] 0 2024-09-06T14:44:40.862 INFO:tasks.workunit.client.1.smithi165.stdout:0/903: chown d15/d19/fc0 2 1 2024-09-06T14:44:40.863 INFO:tasks.workunit.client.1.smithi165.stdout:7/835: unlink d20/d3b/d69/lc2 0 2024-09-06T14:44:40.864 INFO:tasks.workunit.client.0.smithi052.stdout:4/241: link d9/d10/d17/c56 d9/d10/d17/d39/d3a/c5e 0 2024-09-06T14:44:40.866 INFO:tasks.workunit.client.1.smithi165.stdout:0/904: mkdir d15/d19/d50/d53/d8d/d10b/d128 0 2024-09-06T14:44:40.867 INFO:tasks.workunit.client.1.smithi165.stdout:2/950: dwrite d9/d25/d45/d120/d76/f104 [4194304,4194304] 0 2024-09-06T14:44:40.868 INFO:tasks.workunit.client.1.smithi165.stdout:0/905: dread - d15/d19/d2c/df1/f108 zero size 2024-09-06T14:44:40.870 INFO:tasks.workunit.client.0.smithi052.stdout:4/242: creat d9/f5f x:0 0 0 2024-09-06T14:44:40.871 INFO:tasks.workunit.client.1.smithi165.stdout:2/951: truncate d9/d23/f111 471545 0 2024-09-06T14:44:40.872 INFO:tasks.workunit.client.1.smithi165.stdout:0/906: readlink d15/d19/d50/d53/d7c/dbb/lca 0 2024-09-06T14:44:40.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:40 smithi052 ceph-mon[28627]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:40.873 INFO:tasks.workunit.client.1.smithi165.stdout:0/907: dread - d15/d19/d2c/df1/f108 zero size 2024-09-06T14:44:40.874 INFO:tasks.workunit.client.0.smithi052.stdout:4/243: getdents d9/d10 0 2024-09-06T14:44:40.875 INFO:tasks.workunit.client.1.smithi165.stdout:1/910: dwrite d0/d1c/d1d/d22/f39 [4194304,4194304] 0 2024-09-06T14:44:40.876 INFO:tasks.workunit.client.1.smithi165.stdout:2/952: creat d9/d25/d46/d7e/d11d/d48/db1/f141 x:0 0 0 2024-09-06T14:44:40.880 INFO:tasks.workunit.client.0.smithi052.stdout:4/244: unlink d9/d10/d17/d39/d3a/f52 0 2024-09-06T14:44:40.881 INFO:tasks.workunit.client.1.smithi165.stdout:0/908: fdatasync d15/d19/d50/d53/d8d/fda 0 2024-09-06T14:44:40.882 INFO:tasks.workunit.client.0.smithi052.stdout:4/245: truncate d9/d2d/d33/f44 802676 0 2024-09-06T14:44:40.887 INFO:tasks.workunit.client.1.smithi165.stdout:1/911: symlink d0/d1c/d1d/d22/d129/l12c 0 2024-09-06T14:44:40.888 INFO:tasks.workunit.client.0.smithi052.stdout:4/246: dwrite d9/d10/f54 [0,4194304] 0 2024-09-06T14:44:40.888 INFO:tasks.workunit.client.1.smithi165.stdout:0/909: mkdir d15/d19/d50/d53/d129 0 2024-09-06T14:44:40.891 INFO:tasks.workunit.client.1.smithi165.stdout:0/910: creat d15/d19/d2c/f12a x:0 0 0 2024-09-06T14:44:40.895 INFO:tasks.workunit.client.0.smithi052.stdout:4/247: dwrite d9/d2d/d33/f3f [4194304,4194304] 0 2024-09-06T14:44:40.896 INFO:tasks.workunit.client.1.smithi165.stdout:2/953: link d9/d25/d45/d75/d34/d11f/c13f d9/d25/d45/d75/c142 0 2024-09-06T14:44:40.896 INFO:tasks.workunit.client.1.smithi165.stdout:0/911: getdents d15/d19/d66 0 2024-09-06T14:44:40.898 INFO:tasks.workunit.client.0.smithi052.stdout:4/248: dread d9/d2d/d33/f44 [0,4194304] 0 2024-09-06T14:44:40.899 INFO:tasks.workunit.client.1.smithi165.stdout:2/954: fdatasync d9/d23/d71/fed 0 2024-09-06T14:44:40.900 INFO:tasks.workunit.client.1.smithi165.stdout:2/955: read - d9/d25/d45/d120/fe3 zero size 2024-09-06T14:44:40.900 INFO:tasks.workunit.client.1.smithi165.stdout:0/912: rmdir d15/d19/d50/d53/d57 39 2024-09-06T14:44:40.902 INFO:tasks.workunit.client.0.smithi052.stdout:4/249: mknod d9/d10/c60 0 2024-09-06T14:44:40.903 INFO:tasks.workunit.client.0.smithi052.stdout:4/250: write d9/d10/f4f [944260,91996] 0 2024-09-06T14:44:40.904 INFO:tasks.workunit.client.1.smithi165.stdout:2/956: rmdir d9/d25/d46/d7e/d11d/d48/d8c/dbf/dd3 39 2024-09-06T14:44:40.904 INFO:tasks.workunit.client.1.smithi165.stdout:1/912: write d0/d2a/d18/d24/d4b/d93/d2b/f4a [157636,58087] 0 2024-09-06T14:44:40.907 INFO:tasks.workunit.client.1.smithi165.stdout:0/913: link d15/d19/d50/d53/d7c/de4/f121 d15/d19/d66/f12b 0 2024-09-06T14:44:40.908 INFO:tasks.workunit.client.1.smithi165.stdout:2/957: mkdir d9/d25/d46/d7e/d11d/d48/d143 0 2024-09-06T14:44:40.909 INFO:tasks.workunit.client.1.smithi165.stdout:2/958: dread - d9/d25/d46/d7e/d11d/d48/db1/f119 zero size 2024-09-06T14:44:40.910 INFO:tasks.workunit.client.1.smithi165.stdout:1/913: mkdir d0/d2a/d18/d24/d4b/d12d 0 2024-09-06T14:44:40.911 INFO:tasks.workunit.client.0.smithi052.stdout:4/251: link d9/l53 d9/l61 0 2024-09-06T14:44:40.911 INFO:tasks.workunit.client.1.smithi165.stdout:1/914: chown d0/d45/f6e 4495 1 2024-09-06T14:44:40.911 INFO:tasks.workunit.client.0.smithi052.stdout:4/252: chown d9/d10/d17/f51 2029204 1 2024-09-06T14:44:40.912 INFO:tasks.workunit.client.1.smithi165.stdout:2/959: symlink d9/d25/d46/d7e/l144 0 2024-09-06T14:44:40.913 INFO:tasks.workunit.client.1.smithi165.stdout:1/915: creat d0/d1c/d41/f12e x:0 0 0 2024-09-06T14:44:40.914 INFO:tasks.workunit.client.1.smithi165.stdout:2/960: mkdir d9/d25/dfd/d13c/d145 0 2024-09-06T14:44:40.915 INFO:tasks.workunit.client.1.smithi165.stdout:2/961: truncate d9/d25/d46/ddd/ff7 655766 0 2024-09-06T14:44:40.918 INFO:tasks.workunit.client.1.smithi165.stdout:2/962: creat d9/d25/d45/d75/d34/d117/d78/f146 x:0 0 0 2024-09-06T14:44:40.919 INFO:tasks.workunit.client.1.smithi165.stdout:2/963: stat d9/d25/d45/d75/d34/f105 0 2024-09-06T14:44:40.921 INFO:tasks.workunit.client.1.smithi165.stdout:2/964: rename d9/d4f to d9/d23/d52/daa/d147 0 2024-09-06T14:44:40.922 INFO:tasks.workunit.client.1.smithi165.stdout:1/916: write d0/d2a/f8e [345376,96211] 0 2024-09-06T14:44:40.923 INFO:tasks.workunit.client.1.smithi165.stdout:2/965: mkdir d9/d25/d45/d120/dd1/d13d/d148 0 2024-09-06T14:44:40.924 INFO:tasks.workunit.client.1.smithi165.stdout:0/914: dread d15/d19/d38/fa0 [0,4194304] 0 2024-09-06T14:44:40.925 INFO:tasks.workunit.client.1.smithi165.stdout:1/917: symlink d0/d2a/d18/d24/l12f 0 2024-09-06T14:44:40.925 INFO:tasks.workunit.client.1.smithi165.stdout:0/915: chown ff 4 1 2024-09-06T14:44:40.926 INFO:tasks.workunit.client.1.smithi165.stdout:2/966: mknod d9/d25/d46/d7e/d11d/d48/d8c/dbf/c149 0 2024-09-06T14:44:40.926 INFO:tasks.workunit.client.1.smithi165.stdout:0/916: write d15/d6e/f85 [1878909,91241] 0 2024-09-06T14:44:40.927 INFO:tasks.workunit.client.1.smithi165.stdout:1/918: mkdir d0/d45/d130 0 2024-09-06T14:44:40.929 INFO:tasks.workunit.client.1.smithi165.stdout:1/919: write d0/d2a/d18/d24/d4b/d5f/f63 [924305,44707] 0 2024-09-06T14:44:40.933 INFO:tasks.workunit.client.1.smithi165.stdout:2/967: link d9/d25/d45/d120/dd1/de6/c110 d9/d25/d46/d12d/c14a 0 2024-09-06T14:44:40.934 INFO:tasks.workunit.client.1.smithi165.stdout:1/920: getdents d0/d2a/d18/d24/d4b/d12d 0 2024-09-06T14:44:40.935 INFO:tasks.workunit.client.1.smithi165.stdout:2/968: symlink d9/d25/d45/d120/dd1/de6/d10e/l14b 0 2024-09-06T14:44:40.937 INFO:tasks.workunit.client.1.smithi165.stdout:1/921: symlink d0/d2a/d23/l131 0 2024-09-06T14:44:40.937 INFO:tasks.workunit.client.1.smithi165.stdout:2/969: read d9/d25/d45/d120/f9a [2019935,2831] 0 2024-09-06T14:44:40.938 INFO:tasks.workunit.client.1.smithi165.stdout:0/917: write d15/d19/d50/d53/f7e [33699,66857] 0 2024-09-06T14:44:40.939 INFO:tasks.workunit.client.1.smithi165.stdout:1/922: fsync d0/d2a/f12 0 2024-09-06T14:44:40.941 INFO:tasks.workunit.client.1.smithi165.stdout:1/923: mknod d0/d1c/d40/c132 0 2024-09-06T14:44:40.942 INFO:tasks.workunit.client.1.smithi165.stdout:0/918: mknod d15/d19/d50/d53/dbf/dc5/c12c 0 2024-09-06T14:44:40.942 INFO:tasks.workunit.client.1.smithi165.stdout:0/919: chown d15/d19/d2c/l6c 827 1 2024-09-06T14:44:40.943 INFO:tasks.workunit.client.1.smithi165.stdout:1/924: mknod d0/d1c/d1d/d22/c133 0 2024-09-06T14:44:40.944 INFO:tasks.workunit.client.1.smithi165.stdout:0/920: truncate d15/f23 3857423 0 2024-09-06T14:44:40.944 INFO:tasks.workunit.client.1.smithi165.stdout:1/925: dread - d0/d2a/d18/d24/d4b/d93/d2b/d3e/fd3 zero size 2024-09-06T14:44:40.948 INFO:tasks.workunit.client.1.smithi165.stdout:0/921: unlink d15/d19/d28/f71 0 2024-09-06T14:44:40.949 INFO:tasks.workunit.client.1.smithi165.stdout:2/970: truncate d9/d25/d46/d7e/d11d/d48/dce/dfc/fd7 295009 0 2024-09-06T14:44:40.950 INFO:tasks.workunit.client.1.smithi165.stdout:2/971: write d9/d23/d71/f13a [310798,120372] 0 2024-09-06T14:44:40.950 INFO:tasks.workunit.client.1.smithi165.stdout:0/922: dread d15/d19/d50/d53/d7c/dbb/ffb [0,4194304] 0 2024-09-06T14:44:40.951 INFO:tasks.workunit.client.1.smithi165.stdout:1/926: rmdir d0/d45/d117 0 2024-09-06T14:44:40.952 INFO:tasks.workunit.client.1.smithi165.stdout:1/927: stat d0/d1c/d40/f10a 0 2024-09-06T14:44:40.954 INFO:tasks.workunit.client.1.smithi165.stdout:1/928: mkdir d0/d45/d134 0 2024-09-06T14:44:40.963 INFO:tasks.workunit.client.1.smithi165.stdout:2/972: dwrite d9/d25/d46/d7e/d11d/d48/d8c/fff [0,4194304] 0 2024-09-06T14:44:40.964 INFO:tasks.workunit.client.1.smithi165.stdout:2/973: chown d9/d23/d71 47 1 2024-09-06T14:44:40.964 INFO:tasks.workunit.client.1.smithi165.stdout:0/923: dread fb [0,4194304] 0 2024-09-06T14:44:40.967 INFO:tasks.workunit.client.1.smithi165.stdout:0/924: symlink d15/d19/d28/d3a/l12d 0 2024-09-06T14:44:40.967 INFO:tasks.workunit.client.1.smithi165.stdout:2/974: rename d9/d25/d45/ccd to d9/d25/d46/d7e/d11d/d48/db1/c14c 0 2024-09-06T14:44:40.969 INFO:tasks.workunit.client.1.smithi165.stdout:2/975: read - d9/d25/d45/d75/f137 zero size 2024-09-06T14:44:40.971 INFO:tasks.workunit.client.1.smithi165.stdout:1/929: dread d0/d2a/fb [0,4194304] 0 2024-09-06T14:44:40.973 INFO:tasks.workunit.client.1.smithi165.stdout:1/930: readlink d0/d2a/d23/l10f 0 2024-09-06T14:44:40.973 INFO:tasks.workunit.client.1.smithi165.stdout:2/976: mkdir d9/d25/d46/d7e/d11d/d48/dce/dfc/d14d 0 2024-09-06T14:44:40.975 INFO:tasks.workunit.client.1.smithi165.stdout:0/925: dwrite d15/d19/d28/d51/d60/f74 [4194304,4194304] 0 2024-09-06T14:44:40.975 INFO:tasks.workunit.client.1.smithi165.stdout:2/977: chown d9/d88/cbc 3 1 2024-09-06T14:44:40.978 INFO:tasks.workunit.client.1.smithi165.stdout:1/931: rename d0/d1c/d40/f10a to d0/d2a/d18/dde/f135 0 2024-09-06T14:44:40.978 INFO:tasks.workunit.client.1.smithi165.stdout:2/978: fdatasync d9/d25/d46/d12d/f12f 0 2024-09-06T14:44:40.979 INFO:tasks.workunit.client.1.smithi165.stdout:8/988: sync 2024-09-06T14:44:40.982 INFO:tasks.workunit.client.1.smithi165.stdout:1/932: write d0/d2a/d18/d24/d4b/d93/d68/dae/fc4 [290594,9589] 0 2024-09-06T14:44:40.986 INFO:tasks.workunit.client.1.smithi165.stdout:0/926: dwrite d15/d19/f46 [0,4194304] 0 2024-09-06T14:44:40.986 INFO:tasks.workunit.client.1.smithi165.stdout:2/979: rename d9/d25/d46/d7e/d11d/d48/d114/c11a to d9/d25/d45/d75/d34/c14e 0 2024-09-06T14:44:40.986 INFO:tasks.workunit.client.1.smithi165.stdout:1/933: write d0/d2a/d18/d24/d4b/d93/dbd/dd1/f109 [4777238,35121] 0 2024-09-06T14:44:40.987 INFO:tasks.workunit.client.1.smithi165.stdout:2/980: chown d9/d23/d118 1738109269 1 2024-09-06T14:44:40.990 INFO:tasks.workunit.client.1.smithi165.stdout:1/934: creat d0/d2a/d18/d24/d4b/d5f/f136 x:0 0 0 2024-09-06T14:44:41.002 INFO:tasks.workunit.client.1.smithi165.stdout:8/989: write d0/d19/d36/d28/f6a [863267,59975] 0 2024-09-06T14:44:41.003 INFO:tasks.workunit.client.1.smithi165.stdout:2/981: write d9/d25/d46/d7e/d11d/d48/dce/dfc/fd7 [1159040,82726] 0 2024-09-06T14:44:41.004 INFO:tasks.workunit.client.1.smithi165.stdout:1/935: truncate d0/d2a/d18/d24/d4b/d93/dbd/fa6 3817555 0 2024-09-06T14:44:41.004 INFO:tasks.workunit.client.1.smithi165.stdout:8/990: truncate d0/d19/d36/d2d/fdd 1023641 0 2024-09-06T14:44:41.004 INFO:tasks.workunit.client.1.smithi165.stdout:2/982: fdatasync d9/d88/dac/d95/f130 0 2024-09-06T14:44:41.005 INFO:tasks.workunit.client.1.smithi165.stdout:1/936: stat d0/d2a/d18/d24/d4b/d93/ce8 0 2024-09-06T14:44:41.005 INFO:tasks.workunit.client.1.smithi165.stdout:8/991: rmdir d0/d19/d24/db1/d5b 39 2024-09-06T14:44:41.006 INFO:tasks.workunit.client.1.smithi165.stdout:2/983: mkdir d9/d25/d45/d14f 0 2024-09-06T14:44:41.007 INFO:tasks.workunit.client.1.smithi165.stdout:8/992: fdatasync d0/d19/d36/d28/d64/f136 0 2024-09-06T14:44:41.008 INFO:tasks.workunit.client.1.smithi165.stdout:2/984: chown d9/d25/d46/d7e/d90/fb4 170391962 1 2024-09-06T14:44:41.013 INFO:tasks.workunit.client.1.smithi165.stdout:1/937: rename d0/d2a/d18/d24/d4b/d93/dbd/dd1 to d0/d2a/d18/d24/d4b/d93/d97/d137 0 2024-09-06T14:44:41.013 INFO:tasks.workunit.client.1.smithi165.stdout:0/927: dread d15/f5a [0,4194304] 0 2024-09-06T14:44:41.014 INFO:tasks.workunit.client.1.smithi165.stdout:2/985: symlink d9/d25/d45/d75/l150 0 2024-09-06T14:44:41.015 INFO:tasks.workunit.client.1.smithi165.stdout:2/986: write d9/d23/d71/f13a [30644,128100] 0 2024-09-06T14:44:41.015 INFO:tasks.workunit.client.1.smithi165.stdout:1/938: truncate d0/d1c/d40/f4d 2296966 0 2024-09-06T14:44:41.016 INFO:tasks.workunit.client.1.smithi165.stdout:1/939: dread - d0/d2a/d18/d24/d4b/d93/dbd/f103 zero size 2024-09-06T14:44:41.016 INFO:tasks.workunit.client.1.smithi165.stdout:0/928: creat d15/d19/d28/d9e/f12e x:0 0 0 2024-09-06T14:44:41.017 INFO:tasks.workunit.client.1.smithi165.stdout:8/993: write d0/d14/d3e/db4/fdb [504435,41562] 0 2024-09-06T14:44:41.019 INFO:tasks.workunit.client.1.smithi165.stdout:1/940: rmdir d0/d2a/d18/d24/d4b/d5f/d7c/d11d 39 2024-09-06T14:44:41.021 INFO:tasks.workunit.client.1.smithi165.stdout:2/987: link d9/d88/fd4 d9/d25/d45/d120/dd1/de6/f151 0 2024-09-06T14:44:41.022 INFO:tasks.workunit.client.1.smithi165.stdout:1/941: mknod d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/c138 0 2024-09-06T14:44:41.024 INFO:tasks.workunit.client.1.smithi165.stdout:2/988: creat d9/d25/dfd/d13c/f152 x:0 0 0 2024-09-06T14:44:41.027 INFO:tasks.workunit.client.1.smithi165.stdout:8/994: dread d0/d34/d6b/d94/f5f [0,4194304] 0 2024-09-06T14:44:41.027 INFO:tasks.workunit.client.1.smithi165.stdout:2/989: mknod d9/d23/d52/daa/d147/c153 0 2024-09-06T14:44:41.027 INFO:tasks.workunit.client.1.smithi165.stdout:0/929: write d15/f23 [1944974,65831] 0 2024-09-06T14:44:41.028 INFO:tasks.workunit.client.1.smithi165.stdout:8/995: rmdir d0/d19 39 2024-09-06T14:44:41.028 INFO:tasks.workunit.client.1.smithi165.stdout:2/990: stat d9/d88/dc5/fea 0 2024-09-06T14:44:41.029 INFO:tasks.workunit.client.1.smithi165.stdout:8/996: write d0/d14/d3e/fad [290791,56208] 0 2024-09-06T14:44:41.032 INFO:tasks.workunit.client.1.smithi165.stdout:8/997: readlink d0/d19/d36/d2d/d33/d3a/d46/l144 0 2024-09-06T14:44:41.033 INFO:tasks.workunit.client.1.smithi165.stdout:2/991: creat d9/d25/d45/d75/f154 x:0 0 0 2024-09-06T14:44:41.034 INFO:tasks.workunit.client.1.smithi165.stdout:8/998: mkdir d0/d10a/d15b 0 2024-09-06T14:44:41.035 INFO:tasks.workunit.client.1.smithi165.stdout:2/992: creat d9/d25/d46/d7e/d11d/d11c/f155 x:0 0 0 2024-09-06T14:44:41.037 INFO:tasks.workunit.client.1.smithi165.stdout:2/993: dread - d9/d25/d45/d75/f137 zero size 2024-09-06T14:44:41.040 INFO:tasks.workunit.client.1.smithi165.stdout:8/999: dwrite d0/d19/d24/f130 [0,4194304] 0 2024-09-06T14:44:41.040 INFO:tasks.workunit.client.1.smithi165.stdout:2/994: mknod d9/d25/d46/d7e/d11d/d11c/c156 0 2024-09-06T14:44:41.041 INFO:tasks.workunit.client.1.smithi165.stdout:2/995: truncate d9/d25/d45/d75/d34/d117/fbd 195354 0 2024-09-06T14:44:41.042 INFO:tasks.workunit.client.1.smithi165.stdout:2/996: stat d9/d25/d46/d12d 0 2024-09-06T14:44:41.046 INFO:tasks.workunit.client.1.smithi165.stdout:0/930: write d15/f4b [7306314,49034] 0 2024-09-06T14:44:41.049 INFO:tasks.workunit.client.1.smithi165.stdout:2/997: dwrite d9/d25/d46/fec [4194304,4194304] 0 2024-09-06T14:44:41.051 INFO:tasks.workunit.client.1.smithi165.stdout:2/998: write d9/d25/f57 [1681189,72884] 0 2024-09-06T14:44:41.051 INFO:tasks.workunit.client.1.smithi165.stdout:0/931: fdatasync d15/d19/d50/d53/d7c/de4/f121 0 2024-09-06T14:44:41.053 INFO:tasks.workunit.client.1.smithi165.stdout:2/999: read - d9/d25/d46/d7e/d11d/d48/d114/f131 zero size 2024-09-06T14:44:41.054 INFO:tasks.workunit.client.1.smithi165.stdout:0/932: mkdir d15/d19/d50/d53/dbf/d12f 0 2024-09-06T14:44:41.058 INFO:tasks.workunit.client.1.smithi165.stdout:0/933: symlink d15/d19/d28/d51/l130 0 2024-09-06T14:44:41.064 INFO:tasks.workunit.client.1.smithi165.stdout:0/934: link d15/d19/f46 d15/d6e/dcc/f131 0 2024-09-06T14:44:41.065 INFO:tasks.workunit.client.1.smithi165.stdout:0/935: chown d15/d19/d28/d3a/d3f/f48 44 1 2024-09-06T14:44:41.068 INFO:tasks.workunit.client.1.smithi165.stdout:0/936: getdents d15/d19/d50/d53 0 2024-09-06T14:44:41.069 INFO:tasks.workunit.client.1.smithi165.stdout:0/937: mkdir d15/d19/d2c/df1/d132 0 2024-09-06T14:44:41.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:40 smithi165 ceph-mon[36229]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:44:41.073 INFO:tasks.workunit.client.1.smithi165.stdout:0/938: rmdir d15/d19/d2c/df1/d104 0 2024-09-06T14:44:41.074 INFO:tasks.workunit.client.1.smithi165.stdout:0/939: symlink d15/d19/d66/df8/l133 0 2024-09-06T14:44:41.075 INFO:tasks.workunit.client.1.smithi165.stdout:0/940: rmdir d15/d19/d50/d53/dbf/dc5 39 2024-09-06T14:44:41.086 INFO:tasks.workunit.client.1.smithi165.stdout:0/941: dread d15/d19/d28/d4f/f9b [0,4194304] 0 2024-09-06T14:44:41.089 INFO:tasks.workunit.client.1.smithi165.stdout:0/942: rename d15/d19/d50/d53/d7c/cfc to d15/d19/d28/d4f/da7/c134 0 2024-09-06T14:44:41.092 INFO:tasks.workunit.client.1.smithi165.stdout:0/943: dread d15/d6e/dcc/f131 [0,4194304] 0 2024-09-06T14:44:41.093 INFO:tasks.workunit.client.1.smithi165.stdout:0/944: mknod d15/d19/d66/df8/dfd/c135 0 2024-09-06T14:44:41.094 INFO:tasks.workunit.client.1.smithi165.stdout:0/945: read d15/d19/d38/fa0 [4143925,125320] 0 2024-09-06T14:44:41.096 INFO:tasks.workunit.client.1.smithi165.stdout:0/946: rename d15/d19/d38/f5e to d15/d19/d101/f136 0 2024-09-06T14:44:41.097 INFO:tasks.workunit.client.1.smithi165.stdout:0/947: chown d15/d19/d50/d53/d7c/d9a/ld3 290993 1 2024-09-06T14:44:41.099 INFO:tasks.workunit.client.1.smithi165.stdout:0/948: creat d15/d19/d50/f137 x:0 0 0 2024-09-06T14:44:41.099 INFO:tasks.workunit.client.1.smithi165.stdout:0/949: write d15/d19/d50/d53/d57/f7d [1837134,32722] 0 2024-09-06T14:44:41.102 INFO:tasks.workunit.client.1.smithi165.stdout:0/950: mknod d15/d19/d50/d53/d8d/dff/c138 0 2024-09-06T14:44:41.103 INFO:tasks.workunit.client.1.smithi165.stdout:0/951: dread - d15/d19/d50/d53/d7c/dbb/f120 zero size 2024-09-06T14:44:41.104 INFO:tasks.workunit.client.1.smithi165.stdout:0/952: symlink d15/d19/d50/d53/d7c/dbb/l139 0 2024-09-06T14:44:41.106 INFO:tasks.workunit.client.1.smithi165.stdout:0/953: mkdir d15/d19/d28/d4f/d13a 0 2024-09-06T14:44:41.107 INFO:tasks.workunit.client.1.smithi165.stdout:0/954: truncate d15/d19/d28/d3a/d5d/dd6/ff4 4381938 0 2024-09-06T14:44:41.108 INFO:tasks.workunit.client.1.smithi165.stdout:0/955: creat d15/d19/d28/d3a/d5d/dd6/f13b x:0 0 0 2024-09-06T14:44:41.120 INFO:tasks.workunit.client.1.smithi165.stdout:7/836: sync 2024-09-06T14:44:41.120 INFO:tasks.workunit.client.1.smithi165.stdout:0/956: write d15/d19/d50/d53/d8d/fda [1545281,76878] 0 2024-09-06T14:44:41.124 INFO:tasks.workunit.client.1.smithi165.stdout:0/957: getdents d15/d55 0 2024-09-06T14:44:41.125 INFO:tasks.workunit.client.1.smithi165.stdout:0/958: rmdir d15/d19/d50/d53/d8d/d110 39 2024-09-06T14:44:41.127 INFO:tasks.workunit.client.1.smithi165.stdout:7/837: dwrite d20/d4d/d54/fa4 [0,4194304] 0 2024-09-06T14:44:41.128 INFO:tasks.workunit.client.1.smithi165.stdout:0/959: mkdir d15/d19/d28/d4f/d52/d13c 0 2024-09-06T14:44:41.130 INFO:tasks.workunit.client.1.smithi165.stdout:0/960: unlink d15/d19/d2c/l39 0 2024-09-06T14:44:41.133 INFO:tasks.workunit.client.1.smithi165.stdout:0/961: rename d15/c30 to d15/d19/d66/df8/c13d 0 2024-09-06T14:44:41.134 INFO:tasks.workunit.client.1.smithi165.stdout:7/838: getdents d20/d33/d6a/d9a 0 2024-09-06T14:44:41.135 INFO:tasks.workunit.client.1.smithi165.stdout:0/962: dread - d15/d19/d28/fa9 zero size 2024-09-06T14:44:41.135 INFO:tasks.workunit.client.1.smithi165.stdout:0/963: read d15/d19/f46 [1936416,3108] 0 2024-09-06T14:44:41.136 INFO:tasks.workunit.client.1.smithi165.stdout:7/839: symlink d20/d4d/d54/ded/l10f 0 2024-09-06T14:44:41.139 INFO:tasks.workunit.client.1.smithi165.stdout:7/840: symlink d20/d3b/d8c/l110 0 2024-09-06T14:44:41.141 INFO:tasks.workunit.client.1.smithi165.stdout:7/841: fdatasync d20/d4d/fb8 0 2024-09-06T14:44:41.144 INFO:tasks.workunit.client.1.smithi165.stdout:0/964: dwrite d15/d19/d50/d53/d8d/fde [0,4194304] 0 2024-09-06T14:44:41.144 INFO:tasks.workunit.client.1.smithi165.stdout:7/842: truncate d20/d4d/d54/fd0 214619 0 2024-09-06T14:44:41.146 INFO:tasks.workunit.client.1.smithi165.stdout:0/965: mkdir d15/d19/d50/d53/d13e 0 2024-09-06T14:44:41.148 INFO:tasks.workunit.client.1.smithi165.stdout:7/843: creat d20/d3b/d69/d88/d80/f111 x:0 0 0 2024-09-06T14:44:41.152 INFO:tasks.workunit.client.1.smithi165.stdout:0/966: symlink d15/d19/d2c/df1/d132/l13f 0 2024-09-06T14:44:41.152 INFO:tasks.workunit.client.1.smithi165.stdout:7/844: mkdir d20/d4d/d112 0 2024-09-06T14:44:41.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/942: sync 2024-09-06T14:44:41.154 INFO:tasks.workunit.client.1.smithi165.stdout:0/967: dread d15/d19/d38/fa2 [0,4194304] 0 2024-09-06T14:44:41.154 INFO:tasks.workunit.client.1.smithi165.stdout:1/943: fsync d0/d1c/d1d/d22/f2e 0 2024-09-06T14:44:41.156 INFO:tasks.workunit.client.1.smithi165.stdout:7/845: rename d20/d3b/d69/d88/c37 to d20/d4d/dd4/c113 0 2024-09-06T14:44:41.156 INFO:tasks.workunit.client.1.smithi165.stdout:0/968: write d15/d6e/faf [807236,8712] 0 2024-09-06T14:44:41.157 INFO:tasks.workunit.client.1.smithi165.stdout:1/944: dread - d0/d2a/d18/d24/d4b/d93/d97/d137/ffc zero size 2024-09-06T14:44:41.158 INFO:tasks.workunit.client.1.smithi165.stdout:1/945: dread - d0/d1c/d41/f12e zero size 2024-09-06T14:44:41.162 INFO:tasks.workunit.client.1.smithi165.stdout:1/946: dread d0/d2a/d18/d24/d4b/d5f/d7c/f92 [0,4194304] 0 2024-09-06T14:44:41.163 INFO:tasks.workunit.client.1.smithi165.stdout:0/969: mknod d15/d19/d50/d53/dbf/c140 0 2024-09-06T14:44:41.164 INFO:tasks.workunit.client.1.smithi165.stdout:0/970: truncate d15/d19/d28/f124 974115 0 2024-09-06T14:44:41.168 INFO:tasks.workunit.client.1.smithi165.stdout:7/846: dwrite d20/d3b/d69/d88/d30/f83 [0,4194304] 0 2024-09-06T14:44:41.168 INFO:tasks.workunit.client.1.smithi165.stdout:1/947: dread d0/d1c/d1d/fa1 [0,4194304] 0 2024-09-06T14:44:41.171 INFO:tasks.workunit.client.1.smithi165.stdout:7/847: rename d20/d4d/fb8 to d20/d4d/d112/f114 0 2024-09-06T14:44:41.172 INFO:tasks.workunit.client.1.smithi165.stdout:7/848: write d20/d3b/d69/d88/dc6/fe3 [246306,8709] 0 2024-09-06T14:44:41.176 INFO:tasks.workunit.client.1.smithi165.stdout:7/849: truncate d20/d33/d6a/d9a/f104 950602 0 2024-09-06T14:44:41.177 INFO:tasks.workunit.client.1.smithi165.stdout:1/948: write d0/d2a/d18/d24/d4b/d93/d68/fa3 [1210081,76513] 0 2024-09-06T14:44:41.177 INFO:tasks.workunit.client.1.smithi165.stdout:7/850: chown d20/d4d/d54/ded 6252 1 2024-09-06T14:44:41.180 INFO:tasks.workunit.client.1.smithi165.stdout:7/851: creat d20/d3b/d8c/f115 x:0 0 0 2024-09-06T14:44:41.182 INFO:tasks.workunit.client.1.smithi165.stdout:1/949: rename d0/d2a/d18/d24/d4b/d93/d6a/le1 to d0/d2a/d18/d24/d4b/d93/d2b/d3e/l139 0 2024-09-06T14:44:41.183 INFO:tasks.workunit.client.1.smithi165.stdout:7/852: creat d20/d4d/d54/ded/f116 x:0 0 0 2024-09-06T14:44:41.184 INFO:tasks.workunit.client.1.smithi165.stdout:0/971: dread d15/d19/d50/d53/d8d/fda [0,4194304] 0 2024-09-06T14:44:41.186 INFO:tasks.workunit.client.1.smithi165.stdout:1/950: creat d0/d2a/d18/d24/d4b/f13a x:0 0 0 2024-09-06T14:44:41.188 INFO:tasks.workunit.client.1.smithi165.stdout:7/853: write d20/d4d/fc4 [656852,105198] 0 2024-09-06T14:44:41.189 INFO:tasks.workunit.client.1.smithi165.stdout:7/854: stat d20/d40/c7a 0 2024-09-06T14:44:41.190 INFO:tasks.workunit.client.1.smithi165.stdout:7/855: symlink d20/d40/l117 0 2024-09-06T14:44:41.191 INFO:tasks.workunit.client.1.smithi165.stdout:7/856: write d20/d3b/d69/fe8 [269211,73296] 0 2024-09-06T14:44:41.193 INFO:tasks.workunit.client.1.smithi165.stdout:7/857: creat d20/d4d/d112/f118 x:0 0 0 2024-09-06T14:44:41.280 INFO:tasks.workunit.client.1.smithi165.stdout:7/858: sync 2024-09-06T14:44:41.280 INFO:tasks.workunit.client.1.smithi165.stdout:0/972: sync 2024-09-06T14:44:41.280 INFO:tasks.workunit.client.1.smithi165.stdout:1/951: sync 2024-09-06T14:44:41.282 INFO:tasks.workunit.client.1.smithi165.stdout:1/952: chown d0/d2a/d18/dde/l124 5442762 1 2024-09-06T14:44:41.285 INFO:tasks.workunit.client.1.smithi165.stdout:1/953: mknod d0/d2a/d18/d24/d4b/d93/d68/d75/c13b 0 2024-09-06T14:44:41.286 INFO:tasks.workunit.client.1.smithi165.stdout:7/859: dwrite d20/d3b/d69/d88/f58 [0,4194304] 0 2024-09-06T14:44:41.289 INFO:tasks.workunit.client.1.smithi165.stdout:1/954: creat d0/d2a/d18/d24/f13c x:0 0 0 2024-09-06T14:44:41.290 INFO:tasks.workunit.client.1.smithi165.stdout:7/860: unlink d20/d33/l9e 0 2024-09-06T14:44:41.291 INFO:tasks.workunit.client.1.smithi165.stdout:7/861: fdatasync d20/d3b/d8c/fe5 0 2024-09-06T14:44:41.291 INFO:tasks.workunit.client.1.smithi165.stdout:0/973: dwrite d15/d19/d66/df8/dfd/f10a [0,4194304] 0 2024-09-06T14:44:41.292 INFO:tasks.workunit.client.1.smithi165.stdout:1/955: read d0/d2a/d18/d24/d4b/d93/d2b/f4a [165305,31642] 0 2024-09-06T14:44:41.293 INFO:tasks.workunit.client.1.smithi165.stdout:7/862: write d20/d3b/f7e [2573696,119782] 0 2024-09-06T14:44:41.293 INFO:tasks.workunit.client.1.smithi165.stdout:1/956: chown d0/d1c/lcc 9485 1 2024-09-06T14:44:41.295 INFO:tasks.workunit.client.0.smithi052.stdout:2/270: sync 2024-09-06T14:44:41.295 INFO:tasks.workunit.client.0.smithi052.stdout:3/331: sync 2024-09-06T14:44:41.298 INFO:tasks.workunit.client.1.smithi165.stdout:0/974: creat d15/d19/d28/d9e/da3/de5/f141 x:0 0 0 2024-09-06T14:44:41.298 INFO:tasks.workunit.client.1.smithi165.stdout:1/957: creat d0/d2a/d18/d24/d4b/d93/d97/d137/f13d x:0 0 0 2024-09-06T14:44:41.299 INFO:tasks.workunit.client.1.smithi165.stdout:0/975: chown d15/d19/d2c/df1/d132/l13f 2 1 2024-09-06T14:44:41.300 INFO:tasks.workunit.client.0.smithi052.stdout:2/271: mkdir da/d19/d3a/d61 0 2024-09-06T14:44:41.301 INFO:tasks.workunit.client.0.smithi052.stdout:3/332: mkdir d0/d11/d12/d4c/d53/d35/d46/d5b 0 2024-09-06T14:44:41.304 INFO:tasks.workunit.client.0.smithi052.stdout:3/333: symlink d0/d11/d12/d4c/d53/l5c 0 2024-09-06T14:44:41.305 INFO:tasks.workunit.client.1.smithi165.stdout:0/976: rename d15/d19/d50/fec to d15/d19/d28/d3a/f142 0 2024-09-06T14:44:41.309 INFO:tasks.workunit.client.1.smithi165.stdout:1/958: creat d0/d2a/d18/d24/d4b/d5f/d7c/d11d/f13e x:0 0 0 2024-09-06T14:44:41.310 INFO:tasks.workunit.client.0.smithi052.stdout:2/272: dread da/d19/d3a/f3f [0,4194304] 0 2024-09-06T14:44:41.313 INFO:tasks.workunit.client.1.smithi165.stdout:0/977: rename d15/d19/d28/d4f/d13a to d15/d19/d66/d143 0 2024-09-06T14:44:41.315 INFO:tasks.workunit.client.1.smithi165.stdout:1/959: dwrite d0/d2a/d18/d24/d4b/d93/dbd/f103 [0,4194304] 0 2024-09-06T14:44:41.316 INFO:tasks.workunit.client.0.smithi052.stdout:2/273: mkdir da/d2d/d34/d62 0 2024-09-06T14:44:41.317 INFO:tasks.workunit.client.0.smithi052.stdout:2/274: chown da/db/d18/l41 109898199 1 2024-09-06T14:44:41.319 INFO:tasks.workunit.client.0.smithi052.stdout:2/275: creat da/d19/d3a/f63 x:0 0 0 2024-09-06T14:44:41.319 INFO:tasks.workunit.client.1.smithi165.stdout:1/960: getdents d0/d45/d134 0 2024-09-06T14:44:41.320 INFO:tasks.workunit.client.1.smithi165.stdout:0/978: mknod d15/d19/d50/d53/d7c/de4/c144 0 2024-09-06T14:44:41.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/276: mkdir da/d64 0 2024-09-06T14:44:41.322 INFO:tasks.workunit.client.1.smithi165.stdout:1/961: write d0/d2a/d18/d24/d4b/d93/d68/dae/fc4 [1300265,95308] 0 2024-09-06T14:44:41.323 INFO:tasks.workunit.client.1.smithi165.stdout:7/863: dwrite d20/d33/f8a [0,4194304] 0 2024-09-06T14:44:41.324 INFO:tasks.workunit.client.1.smithi165.stdout:0/979: chown d15/d19/d50/d53/d57/l73 59152 1 2024-09-06T14:44:41.325 INFO:tasks.workunit.client.0.smithi052.stdout:2/277: symlink da/db/d60/l65 0 2024-09-06T14:44:41.326 INFO:tasks.workunit.client.1.smithi165.stdout:0/980: chown d15/d19/d28/d4f/d52/f63 587821068 1 2024-09-06T14:44:41.327 INFO:tasks.workunit.client.0.smithi052.stdout:3/334: truncate d0/d11/d15/d1b/f32 505055 0 2024-09-06T14:44:41.327 INFO:tasks.workunit.client.0.smithi052.stdout:2/278: read - da/d19/d3a/d31/f58 zero size 2024-09-06T14:44:41.330 INFO:tasks.workunit.client.0.smithi052.stdout:2/279: mkdir da/d2d/d34/d66 0 2024-09-06T14:44:41.331 INFO:tasks.workunit.client.1.smithi165.stdout:1/962: dwrite d0/d2a/d18/d24/d4b/d93/d97/ff6 [0,4194304] 0 2024-09-06T14:44:41.332 INFO:tasks.workunit.client.0.smithi052.stdout:3/335: symlink d0/d11/d12/d17/l5d 0 2024-09-06T14:44:41.332 INFO:tasks.workunit.client.1.smithi165.stdout:1/963: readlink d0/d1c/d1d/lc5 0 2024-09-06T14:44:41.338 INFO:tasks.workunit.client.1.smithi165.stdout:1/964: creat d0/d1c/dd5/f13f x:0 0 0 2024-09-06T14:44:41.339 INFO:tasks.workunit.client.1.smithi165.stdout:7/864: creat d20/d3b/d69/d88/d80/f119 x:0 0 0 2024-09-06T14:44:41.340 INFO:tasks.workunit.client.1.smithi165.stdout:7/865: write d20/d33/f8a [2976743,18216] 0 2024-09-06T14:44:41.341 INFO:tasks.workunit.client.1.smithi165.stdout:7/866: chown d20/d65/d82/d97/lf3 8 1 2024-09-06T14:44:41.342 INFO:tasks.workunit.client.0.smithi052.stdout:7/215: sync 2024-09-06T14:44:41.342 INFO:tasks.workunit.client.0.smithi052.stdout:9/238: sync 2024-09-06T14:44:41.342 INFO:tasks.workunit.client.0.smithi052.stdout:8/243: sync 2024-09-06T14:44:41.342 INFO:tasks.workunit.client.0.smithi052.stdout:1/305: sync 2024-09-06T14:44:41.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/200: sync 2024-09-06T14:44:41.342 INFO:tasks.workunit.client.0.smithi052.stdout:0/298: sync 2024-09-06T14:44:41.342 INFO:tasks.workunit.client.0.smithi052.stdout:4/253: sync 2024-09-06T14:44:41.343 INFO:tasks.workunit.client.0.smithi052.stdout:6/141: sync 2024-09-06T14:44:41.346 INFO:tasks.workunit.client.0.smithi052.stdout:7/216: write d11/f43 [939141,105299] 0 2024-09-06T14:44:41.346 INFO:tasks.workunit.client.0.smithi052.stdout:4/254: stat d9/d10/d17/f1c 0 2024-09-06T14:44:41.346 INFO:tasks.workunit.client.1.smithi165.stdout:0/981: creat d15/d19/d50/d53/dbf/f145 x:0 0 0 2024-09-06T14:44:41.348 INFO:tasks.workunit.client.0.smithi052.stdout:0/299: chown d0/d1a/d26/d3a/d14/d2d/d56/d5d/d60 33087044 1 2024-09-06T14:44:41.348 INFO:tasks.workunit.client.0.smithi052.stdout:7/217: readlink d11/d1c/d26/l30 0 2024-09-06T14:44:41.351 INFO:tasks.workunit.client.1.smithi165.stdout:1/965: dwrite d0/d45/f6e [0,4194304] 0 2024-09-06T14:44:41.352 INFO:tasks.workunit.client.0.smithi052.stdout:6/142: write d2/dd/d18/f2b [696434,45538] 0 2024-09-06T14:44:41.354 INFO:tasks.workunit.client.1.smithi165.stdout:0/982: chown d15/d19/d50/d53/c90 587479 1 2024-09-06T14:44:41.354 INFO:tasks.workunit.client.0.smithi052.stdout:8/244: creat d6/d9/d1f/d14/f53 x:0 0 0 2024-09-06T14:44:41.354 INFO:tasks.workunit.client.1.smithi165.stdout:0/983: stat d15/d19/d66/d143 0 2024-09-06T14:44:41.356 INFO:tasks.workunit.client.0.smithi052.stdout:9/239: dwrite d1/d4/d6/f16 [0,4194304] 0 2024-09-06T14:44:41.358 INFO:tasks.workunit.client.0.smithi052.stdout:5/201: mkdir d2/d20/d42 0 2024-09-06T14:44:41.360 INFO:tasks.workunit.client.1.smithi165.stdout:7/867: rename d20/d4d/d54/dc1/df9/dd6/cf2 to d20/d33/d53/df4/c11a 0 2024-09-06T14:44:41.361 INFO:tasks.workunit.client.0.smithi052.stdout:5/202: truncate d2/f25 238776 0 2024-09-06T14:44:41.364 INFO:tasks.workunit.client.0.smithi052.stdout:2/280: dread f0 [0,4194304] 0 2024-09-06T14:44:41.365 INFO:tasks.workunit.client.1.smithi165.stdout:0/984: dread - d15/d19/fc0 zero size 2024-09-06T14:44:41.365 INFO:tasks.workunit.client.0.smithi052.stdout:3/336: dwrite d0/d11/d12/f30 [4194304,4194304] 0 2024-09-06T14:44:41.367 INFO:tasks.workunit.client.0.smithi052.stdout:1/306: rename d1/db/d18/l37 to d1/db/l64 0 2024-09-06T14:44:41.368 INFO:tasks.workunit.client.0.smithi052.stdout:7/218: mkdir d11/d1c/d24/d4b 0 2024-09-06T14:44:41.368 INFO:tasks.workunit.client.1.smithi165.stdout:0/985: dread fb [0,4194304] 0 2024-09-06T14:44:41.369 INFO:tasks.workunit.client.0.smithi052.stdout:7/219: fdatasync ff 0 2024-09-06T14:44:41.369 INFO:tasks.workunit.client.0.smithi052.stdout:0/300: mkdir d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63 0 2024-09-06T14:44:41.370 INFO:tasks.workunit.client.0.smithi052.stdout:7/220: fsync d11/d1c/d26/f48 0 2024-09-06T14:44:41.371 INFO:tasks.workunit.client.0.smithi052.stdout:0/301: read - d0/d18/f50 zero size 2024-09-06T14:44:41.372 INFO:tasks.workunit.client.0.smithi052.stdout:6/143: unlink d2/dd/d18/l27 0 2024-09-06T14:44:41.372 INFO:tasks.workunit.client.0.smithi052.stdout:7/221: truncate f5 4276089 0 2024-09-06T14:44:41.374 INFO:tasks.workunit.client.0.smithi052.stdout:7/222: chown d11/d1c/d24/d3b/l3c 1417655 1 2024-09-06T14:44:41.376 INFO:tasks.workunit.client.1.smithi165.stdout:7/868: mknod d20/d4d/d54/dc1/df9/c11b 0 2024-09-06T14:44:41.383 INFO:tasks.workunit.client.0.smithi052.stdout:3/337: rmdir d0/d11/d12/d17 39 2024-09-06T14:44:41.383 INFO:tasks.workunit.client.0.smithi052.stdout:1/307: dread d1/f1d [0,4194304] 0 2024-09-06T14:44:41.385 INFO:tasks.workunit.client.0.smithi052.stdout:3/338: truncate d0/d11/d15/f4e 840373 0 2024-09-06T14:44:41.399 INFO:tasks.workunit.client.0.smithi052.stdout:3/339: chown d0/ff 11 1 2024-09-06T14:44:41.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/340: dread - d0/d11/d15/f55 zero size 2024-09-06T14:44:41.401 INFO:tasks.workunit.client.1.smithi165.stdout:0/986: dread d15/d19/d66/f95 [0,4194304] 0 2024-09-06T14:44:41.402 INFO:tasks.workunit.client.1.smithi165.stdout:0/987: write d15/d19/d28/d51/f11a [168063,8910] 0 2024-09-06T14:44:41.402 INFO:tasks.workunit.client.0.smithi052.stdout:3/341: stat d0/d11/d12/d4c/d53/d35/l36 0 2024-09-06T14:44:41.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/281: dread da/db/f12 [4194304,4194304] 0 2024-09-06T14:44:41.404 INFO:tasks.workunit.client.1.smithi165.stdout:1/966: sync 2024-09-06T14:44:41.404 INFO:tasks.workunit.client.0.smithi052.stdout:3/342: fsync d0/d11/d15/d19/f2c 0 2024-09-06T14:44:41.405 INFO:tasks.workunit.client.0.smithi052.stdout:3/343: write d0/d11/d12/f47 [1079979,16207] 0 2024-09-06T14:44:41.408 INFO:tasks.workunit.client.0.smithi052.stdout:5/203: write d2/f12 [552739,35315] 0 2024-09-06T14:44:41.414 INFO:tasks.workunit.client.0.smithi052.stdout:4/255: dwrite d9/d10/d19/d41/f4c [0,4194304] 0 2024-09-06T14:44:41.424 INFO:tasks.workunit.client.0.smithi052.stdout:0/302: dwrite d0/d1a/d26/d3a/d14/d20/d22/d41/f4c [4194304,4194304] 0 2024-09-06T14:44:41.424 INFO:tasks.workunit.client.0.smithi052.stdout:9/240: truncate d1/d4/d6/dc/d10/d18/f3c 250763 0 2024-09-06T14:44:41.426 INFO:tasks.workunit.client.0.smithi052.stdout:1/308: write d1/da/d3e/f44 [188215,55005] 0 2024-09-06T14:44:41.426 INFO:tasks.workunit.client.0.smithi052.stdout:1/309: stat d1/da/d3e/d47/d4a/l53 0 2024-09-06T14:44:41.432 INFO:tasks.workunit.client.0.smithi052.stdout:5/204: symlink d2/d1a/d22/l43 0 2024-09-06T14:44:41.433 INFO:tasks.workunit.client.0.smithi052.stdout:8/245: link d6/d9/df/d1b/c32 d6/d9/d1f/d14/c54 0 2024-09-06T14:44:41.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/223: truncate d11/d1c/d26/f28 919794 0 2024-09-06T14:44:41.434 INFO:tasks.workunit.client.0.smithi052.stdout:8/246: read d6/d16/f2c [5606528,25924] 0 2024-09-06T14:44:41.435 INFO:tasks.workunit.client.0.smithi052.stdout:3/344: fsync d0/d11/d12/d4c/d53/d35/f28 0 2024-09-06T14:44:41.436 INFO:tasks.workunit.client.0.smithi052.stdout:7/224: stat d11/d1c/d26/f48 0 2024-09-06T14:44:41.439 INFO:tasks.workunit.client.0.smithi052.stdout:8/247: write d6/d16/f1e [11944676,43923] 0 2024-09-06T14:44:41.441 INFO:tasks.workunit.client.0.smithi052.stdout:6/144: getdents d2/dd/d18 0 2024-09-06T14:44:41.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/205: dwrite d2/f12 [4194304,4194304] 0 2024-09-06T14:44:41.445 INFO:tasks.workunit.client.0.smithi052.stdout:5/206: stat d2/d1a/d22/l43 0 2024-09-06T14:44:41.448 INFO:tasks.workunit.client.0.smithi052.stdout:0/303: creat d0/d1a/d26/d3a/d14/d20/d22/d41/f64 x:0 0 0 2024-09-06T14:44:41.448 INFO:tasks.workunit.client.0.smithi052.stdout:8/248: dread d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:41.452 INFO:tasks.workunit.client.0.smithi052.stdout:6/145: dread d2/f19 [0,4194304] 0 2024-09-06T14:44:41.460 INFO:tasks.workunit.client.0.smithi052.stdout:4/256: rename d9/cd to d9/d10/d19/d41/c62 0 2024-09-06T14:44:41.461 INFO:tasks.workunit.client.0.smithi052.stdout:4/257: truncate d9/d10/d17/d39/f46 682780 0 2024-09-06T14:44:41.465 INFO:tasks.workunit.client.1.smithi165.stdout:7/869: creat d20/d4d/d54/f11c x:0 0 0 2024-09-06T14:44:41.469 INFO:tasks.workunit.client.0.smithi052.stdout:3/345: creat d0/d11/d12/d4c/d53/d35/d46/f5e x:0 0 0 2024-09-06T14:44:41.470 INFO:tasks.workunit.client.1.smithi165.stdout:1/967: stat d0/d2a/d18/d24/d4b/d93/d68/f87 0 2024-09-06T14:44:41.475 INFO:tasks.workunit.client.0.smithi052.stdout:1/310: creat d1/d5f/f65 x:0 0 0 2024-09-06T14:44:41.476 INFO:tasks.workunit.client.1.smithi165.stdout:1/968: creat d0/d1c/d40/f140 x:0 0 0 2024-09-06T14:44:41.478 INFO:tasks.workunit.client.0.smithi052.stdout:6/146: mkdir d2/dd/d18/d2d 0 2024-09-06T14:44:41.480 INFO:tasks.workunit.client.1.smithi165.stdout:1/969: write d0/d2a/d18/d24/d4b/d95/ff9 [1295123,92898] 0 2024-09-06T14:44:41.482 INFO:tasks.workunit.client.0.smithi052.stdout:5/207: rename d2/f24 to d2/d1a/d22/d26/d2b/d37/f44 0 2024-09-06T14:44:41.483 INFO:tasks.workunit.client.0.smithi052.stdout:5/208: chown d2/lc 3 1 2024-09-06T14:44:41.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/225: creat d11/d1c/d24/d4b/f4c x:0 0 0 2024-09-06T14:44:41.486 INFO:tasks.workunit.client.1.smithi165.stdout:1/970: creat d0/d1c/dd5/f141 x:0 0 0 2024-09-06T14:44:41.486 INFO:tasks.workunit.client.1.smithi165.stdout:7/870: write d20/d33/d53/fb0 [1502069,99687] 0 2024-09-06T14:44:41.487 INFO:tasks.workunit.client.0.smithi052.stdout:4/258: unlink d9/d10/d17/f1c 0 2024-09-06T14:44:41.488 INFO:tasks.workunit.client.1.smithi165.stdout:0/988: dwrite d15/d19/f1e [0,4194304] 0 2024-09-06T14:44:41.489 INFO:tasks.workunit.client.1.smithi165.stdout:1/971: chown d0/d2a/d18/d24/d4b/d93/d97/f128 29013654 1 2024-09-06T14:44:41.492 INFO:tasks.workunit.client.0.smithi052.stdout:2/282: getdents da/d2d 0 2024-09-06T14:44:41.493 INFO:tasks.workunit.client.1.smithi165.stdout:1/972: creat d0/d1c/dd5/f142 x:0 0 0 2024-09-06T14:44:41.497 INFO:tasks.workunit.client.0.smithi052.stdout:0/304: rename d0/d2e/c53 to d0/d19/c65 0 2024-09-06T14:44:41.501 INFO:tasks.workunit.client.0.smithi052.stdout:7/226: creat d11/d1c/d26/f4d x:0 0 0 2024-09-06T14:44:41.502 INFO:tasks.workunit.client.0.smithi052.stdout:6/147: dread d2/fb [0,4194304] 0 2024-09-06T14:44:41.502 INFO:tasks.workunit.client.0.smithi052.stdout:7/227: stat d11/d1c/c22 0 2024-09-06T14:44:41.503 INFO:tasks.workunit.client.0.smithi052.stdout:6/148: chown d2/dd/f20 536 1 2024-09-06T14:44:41.504 INFO:tasks.workunit.client.1.smithi165.stdout:1/973: fsync d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69/f6b 0 2024-09-06T14:44:41.506 INFO:tasks.workunit.client.0.smithi052.stdout:7/228: truncate d11/d1c/d24/f2d 974828 0 2024-09-06T14:44:41.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/229: write d11/f23 [587576,72979] 0 2024-09-06T14:44:41.507 INFO:tasks.workunit.client.1.smithi165.stdout:0/989: dread d15/d19/d28/d3a/f96 [0,4194304] 0 2024-09-06T14:44:41.509 INFO:tasks.workunit.client.1.smithi165.stdout:0/990: readlink d15/d19/d66/df8/l133 0 2024-09-06T14:44:41.510 INFO:tasks.workunit.client.1.smithi165.stdout:7/871: dread d20/d4d/ddd/fb4 [0,4194304] 0 2024-09-06T14:44:41.510 INFO:tasks.workunit.client.1.smithi165.stdout:0/991: chown d15/d19/d28/d3a/d3f/c4a 13 1 2024-09-06T14:44:41.511 INFO:tasks.workunit.client.1.smithi165.stdout:0/992: chown d15/d19/d50/d53 557627 1 2024-09-06T14:44:41.511 INFO:tasks.workunit.client.1.smithi165.stdout:1/974: mkdir d0/d2a/d18/d24/d4b/d95/d143 0 2024-09-06T14:44:41.512 INFO:tasks.workunit.client.1.smithi165.stdout:0/993: dread d15/d19/d2c/f45 [0,4194304] 0 2024-09-06T14:44:41.514 INFO:tasks.workunit.client.0.smithi052.stdout:1/311: link d1/db/d50/f5e d1/db/d18/f66 0 2024-09-06T14:44:41.515 INFO:tasks.workunit.client.0.smithi052.stdout:9/241: dwrite d1/d4/d6/dc/d10/d18/f3c [0,4194304] 0 2024-09-06T14:44:41.515 INFO:tasks.workunit.client.0.smithi052.stdout:8/249: rmdir d6/d4c/d51 0 2024-09-06T14:44:41.517 INFO:tasks.workunit.client.0.smithi052.stdout:5/209: dread d2/d20/f29 [0,4194304] 0 2024-09-06T14:44:41.518 INFO:tasks.workunit.client.1.smithi165.stdout:1/975: creat d0/d1c/d1d/d22/d129/f144 x:0 0 0 2024-09-06T14:44:41.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/242: write d1/d4/d6/dc/d10/d18/f33 [4677309,107497] 0 2024-09-06T14:44:41.520 INFO:tasks.workunit.client.1.smithi165.stdout:0/994: creat d15/d19/d66/d143/f146 x:0 0 0 2024-09-06T14:44:41.521 INFO:tasks.workunit.client.1.smithi165.stdout:0/995: write d15/d19/d38/f11f [1008591,129530] 0 2024-09-06T14:44:41.522 INFO:tasks.workunit.client.0.smithi052.stdout:0/305: symlink d0/d1a/d26/d3a/d14/l66 0 2024-09-06T14:44:41.523 INFO:tasks.workunit.client.0.smithi052.stdout:0/306: fsync d0/d1a/d26/d3a/d14/d20/f32 0 2024-09-06T14:44:41.523 INFO:tasks.workunit.client.0.smithi052.stdout:3/346: write d0/fe [3094868,50468] 0 2024-09-06T14:44:41.525 INFO:tasks.workunit.client.0.smithi052.stdout:0/307: stat d0/d1a/d26/d3a/d14/d20/d22/d55 0 2024-09-06T14:44:41.528 INFO:tasks.workunit.client.1.smithi165.stdout:0/996: rename d15/d19/d50/d53/d7c/de4 to d15/d19/d28/d51/d60/d147 0 2024-09-06T14:44:41.530 INFO:tasks.workunit.client.1.smithi165.stdout:1/976: fdatasync d0/fba 0 2024-09-06T14:44:41.530 INFO:tasks.workunit.client.0.smithi052.stdout:2/283: creat da/d19/d5a/d5f/f67 x:0 0 0 2024-09-06T14:44:41.531 INFO:tasks.workunit.client.0.smithi052.stdout:2/284: dread - da/db/f45 zero size 2024-09-06T14:44:41.533 INFO:tasks.workunit.client.1.smithi165.stdout:0/997: mkdir d15/d19/d50/d53/d13e/d148 0 2024-09-06T14:44:41.534 INFO:tasks.workunit.client.0.smithi052.stdout:1/312: rename d1/db/de/c2a to d1/db/de/c67 0 2024-09-06T14:44:41.535 INFO:tasks.workunit.client.1.smithi165.stdout:1/977: rmdir d0/d2a/d18/d24/d4b/d93/d2b/d3e/d69 39 2024-09-06T14:44:41.537 INFO:tasks.workunit.client.1.smithi165.stdout:0/998: symlink d15/d19/d66/l149 0 2024-09-06T14:44:41.539 INFO:tasks.workunit.client.0.smithi052.stdout:5/210: rename d2/d1a/f32 to d2/d1a/d22/f45 0 2024-09-06T14:44:41.539 INFO:tasks.workunit.client.0.smithi052.stdout:5/211: chown d2/f16 2588 1 2024-09-06T14:44:41.542 INFO:tasks.workunit.client.0.smithi052.stdout:9/243: creat d1/d4/d6/dd/d2b/f49 x:0 0 0 2024-09-06T14:44:41.543 INFO:tasks.workunit.client.0.smithi052.stdout:9/244: readlink d1/d4/df/l2a 0 2024-09-06T14:44:41.545 INFO:tasks.workunit.client.0.smithi052.stdout:6/149: rename d2/c28 to d2/c2e 0 2024-09-06T14:44:41.547 INFO:tasks.workunit.client.0.smithi052.stdout:5/212: dwrite d2/f38 [0,4194304] 0 2024-09-06T14:44:41.548 INFO:tasks.workunit.client.1.smithi165.stdout:7/872: dwrite d20/d3b/f72 [0,4194304] 0 2024-09-06T14:44:41.548 INFO:tasks.workunit.client.0.smithi052.stdout:6/150: read d2/f19 [1838882,124676] 0 2024-09-06T14:44:41.550 INFO:tasks.workunit.client.0.smithi052.stdout:3/347: creat d0/d11/d15/d1b/f5f x:0 0 0 2024-09-06T14:44:41.552 INFO:tasks.workunit.client.0.smithi052.stdout:7/230: getdents d11/d1c/d3f 0 2024-09-06T14:44:41.553 INFO:tasks.workunit.client.1.smithi165.stdout:7/873: creat d20/d4d/d54/dc1/df9/f11d x:0 0 0 2024-09-06T14:44:41.553 INFO:tasks.workunit.client.0.smithi052.stdout:1/313: mkdir d1/db/de/d68 0 2024-09-06T14:44:41.556 INFO:tasks.workunit.client.0.smithi052.stdout:9/245: dwrite d1/f37 [0,4194304] 0 2024-09-06T14:44:41.564 INFO:tasks.workunit.client.0.smithi052.stdout:0/308: symlink d0/l67 0 2024-09-06T14:44:41.566 INFO:tasks.workunit.client.1.smithi165.stdout:1/978: write d0/d2a/d18/d24/d4b/d93/d2b/d3e/fb7 [963106,124129] 0 2024-09-06T14:44:41.568 INFO:tasks.workunit.client.0.smithi052.stdout:9/246: dwrite d1/d4/f43 [0,4194304] 0 2024-09-06T14:44:41.570 INFO:tasks.workunit.client.0.smithi052.stdout:7/231: creat d11/d1c/d24/d4b/f4e x:0 0 0 2024-09-06T14:44:41.571 INFO:tasks.workunit.client.0.smithi052.stdout:1/314: creat d1/da/d14/d2e/f69 x:0 0 0 2024-09-06T14:44:41.572 INFO:tasks.workunit.client.0.smithi052.stdout:7/232: readlink d11/d1c/d24/d3b/l3c 0 2024-09-06T14:44:41.573 INFO:tasks.workunit.client.0.smithi052.stdout:7/233: chown d11/d1c/d24/f25 427548 1 2024-09-06T14:44:41.575 INFO:tasks.workunit.client.0.smithi052.stdout:7/234: write d11/d1c/d24/d4b/f4c [118991,126723] 0 2024-09-06T14:44:41.577 INFO:tasks.workunit.client.0.smithi052.stdout:0/309: unlink d0/d2e/l58 0 2024-09-06T14:44:41.582 INFO:tasks.workunit.client.0.smithi052.stdout:7/235: symlink d11/d1c/d24/d3b/l4f 0 2024-09-06T14:44:41.583 INFO:tasks.workunit.client.0.smithi052.stdout:0/310: creat d0/d1a/d26/d3a/d14/d20/d22/d41/f68 x:0 0 0 2024-09-06T14:44:41.583 INFO:tasks.workunit.client.0.smithi052.stdout:6/151: link d2/fb d2/dd/f2f 0 2024-09-06T14:44:41.584 INFO:tasks.workunit.client.0.smithi052.stdout:7/236: readlink d11/d1c/d26/l30 0 2024-09-06T14:44:41.586 INFO:tasks.workunit.client.0.smithi052.stdout:9/247: rename d1/d4/d6/f16 to d1/d26/d3d/f4a 0 2024-09-06T14:44:41.586 INFO:tasks.workunit.client.0.smithi052.stdout:0/311: chown d0/d1a/d26/d3a/d14/f3e 90768626 1 2024-09-06T14:44:41.588 INFO:tasks.workunit.client.0.smithi052.stdout:6/152: chown d2/c2e 12230 1 2024-09-06T14:44:41.588 INFO:tasks.workunit.client.0.smithi052.stdout:8/250: dwrite d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:41.591 INFO:tasks.workunit.client.0.smithi052.stdout:6/153: rmdir d2/dd 39 2024-09-06T14:44:41.595 INFO:tasks.workunit.client.0.smithi052.stdout:9/248: mkdir d1/d4/d4b 0 2024-09-06T14:44:41.596 INFO:tasks.workunit.client.0.smithi052.stdout:0/312: symlink d0/d1a/d26/d3a/d14/d20/d22/d41/l69 0 2024-09-06T14:44:41.599 INFO:tasks.workunit.client.1.smithi165.stdout:1/979: write d0/d2a/d18/d24/d4b/d93/d2b/fb4 [422781,111627] 0 2024-09-06T14:44:41.602 INFO:tasks.workunit.client.0.smithi052.stdout:6/154: unlink d2/dd/l1e 0 2024-09-06T14:44:41.604 INFO:tasks.workunit.client.0.smithi052.stdout:0/313: creat d0/d1a/d26/d3a/d14/d20/d22/f6a x:0 0 0 2024-09-06T14:44:41.606 INFO:tasks.workunit.client.0.smithi052.stdout:6/155: dread d2/dd/f21 [0,4194304] 0 2024-09-06T14:44:41.607 INFO:tasks.workunit.client.0.smithi052.stdout:8/251: link f1 d6/d22/d31/f55 0 2024-09-06T14:44:41.609 INFO:tasks.workunit.client.0.smithi052.stdout:7/237: dread d11/d1c/d24/f25 [0,4194304] 0 2024-09-06T14:44:41.610 INFO:tasks.workunit.client.0.smithi052.stdout:7/238: stat d11/c1b 0 2024-09-06T14:44:41.612 INFO:tasks.workunit.client.0.smithi052.stdout:5/213: dwrite d2/d1a/d22/d26/d2b/d37/f44 [0,4194304] 0 2024-09-06T14:44:41.612 INFO:tasks.workunit.client.0.smithi052.stdout:7/239: read - d11/d1c/d24/d4b/f4e zero size 2024-09-06T14:44:41.615 INFO:tasks.workunit.client.0.smithi052.stdout:8/252: mkdir d6/d22/d36/d3e/d47/d56 0 2024-09-06T14:44:41.617 INFO:tasks.workunit.client.1.smithi165.stdout:1/980: getdents d0/d2a/d18 0 2024-09-06T14:44:41.620 INFO:tasks.workunit.client.0.smithi052.stdout:5/214: symlink d2/d1a/d22/d26/l46 0 2024-09-06T14:44:41.620 INFO:tasks.workunit.client.1.smithi165.stdout:0/999: sync 2024-09-06T14:44:41.622 INFO:tasks.workunit.client.0.smithi052.stdout:9/249: truncate d1/d4/d6/dc/d10/f34 5108542 0 2024-09-06T14:44:41.623 INFO:tasks.workunit.client.0.smithi052.stdout:9/250: chown d1/d26/l46 183762472 1 2024-09-06T14:44:41.624 INFO:tasks.workunit.client.1.smithi165.stdout:1/981: truncate d0/d2a/d18/d24/d4b/d93/d2b/f4a 365571 0 2024-09-06T14:44:41.628 INFO:tasks.workunit.client.0.smithi052.stdout:8/253: write d6/d9/df/d1b/f2f [1053875,90715] 0 2024-09-06T14:44:41.630 INFO:tasks.workunit.client.0.smithi052.stdout:8/254: dread f1 [4194304,4194304] 0 2024-09-06T14:44:41.631 INFO:tasks.workunit.client.0.smithi052.stdout:8/255: write d6/d9/d1f/d19/f2d [1152113,111769] 0 2024-09-06T14:44:41.646 INFO:tasks.workunit.client.1.smithi165.stdout:7/874: sync 2024-09-06T14:44:41.659 INFO:tasks.workunit.client.1.smithi165.stdout:1/982: creat d0/d1c/d1d/d22/d129/f145 x:0 0 0 2024-09-06T14:44:41.659 INFO:tasks.workunit.client.0.smithi052.stdout:5/215: rename d2/d1a/c33 to d2/d1a/c47 0 2024-09-06T14:44:41.670 INFO:tasks.workunit.client.1.smithi165.stdout:1/983: dread d0/d2a/f9d [0,4194304] 0 2024-09-06T14:44:41.702 INFO:tasks.workunit.client.0.smithi052.stdout:6/156: truncate d2/dd/d18/f2b 126310 0 2024-09-06T14:44:41.710 INFO:tasks.workunit.client.0.smithi052.stdout:0/314: link d0/d1a/d26/c39 d0/d1a/d26/d3a/d14/d20/d22/c6b 0 2024-09-06T14:44:41.711 INFO:tasks.workunit.client.1.smithi165.stdout:7/875: rename d20/d3b/d69/d88/d30/fbc to d20/d33/d53/f11e 0 2024-09-06T14:44:41.711 INFO:tasks.workunit.client.1.smithi165.stdout:7/876: write d20/d4d/d112/f118 [65414,49629] 0 2024-09-06T14:44:41.712 INFO:tasks.workunit.client.0.smithi052.stdout:9/251: link d1/d4/d6/dc/d10/d18/f3c d1/d26/f4c 0 2024-09-06T14:44:41.713 INFO:tasks.workunit.client.0.smithi052.stdout:9/252: write d1/fa [3126682,84915] 0 2024-09-06T14:44:41.716 INFO:tasks.workunit.client.0.smithi052.stdout:7/240: getdents d11/d1c 0 2024-09-06T14:44:41.718 INFO:tasks.workunit.client.0.smithi052.stdout:7/241: write f5 [1765664,39052] 0 2024-09-06T14:44:41.719 INFO:tasks.workunit.client.1.smithi165.stdout:1/984: rename d0/d2a/d18/d24/d4b/d93/d2b/d3e/c126 to d0/d2a/d18/d24/d4b/d5f/d7c/d11d/c146 0 2024-09-06T14:44:41.719 INFO:tasks.workunit.client.1.smithi165.stdout:1/985: chown d0/d2a/d23 432 1 2024-09-06T14:44:41.719 INFO:tasks.workunit.client.0.smithi052.stdout:0/315: dwrite d0/d1a/d26/d3a/d14/d20/f32 [0,4194304] 0 2024-09-06T14:44:41.723 INFO:tasks.workunit.client.0.smithi052.stdout:8/256: dwrite d6/d9/df/d1b/f37 [0,4194304] 0 2024-09-06T14:44:41.727 INFO:tasks.workunit.client.0.smithi052.stdout:7/242: mkdir d11/d1c/d24/d3b/d50 0 2024-09-06T14:44:41.728 INFO:tasks.workunit.client.1.smithi165.stdout:1/986: dwrite d0/d2a/d18/d24/d4b/d93/dbd/f100 [4194304,4194304] 0 2024-09-06T14:44:41.728 INFO:tasks.workunit.client.1.smithi165.stdout:7/877: dread f15 [0,4194304] 0 2024-09-06T14:44:41.731 INFO:tasks.workunit.client.1.smithi165.stdout:1/987: truncate d0/d2a/d18/d24/d4b/d93/d97/d137/ffc 224862 0 2024-09-06T14:44:41.732 INFO:tasks.workunit.client.0.smithi052.stdout:8/257: creat d6/d9/df/f57 x:0 0 0 2024-09-06T14:44:41.737 INFO:tasks.workunit.client.0.smithi052.stdout:7/243: dwrite d11/d1c/d24/d4b/f4e [0,4194304] 0 2024-09-06T14:44:41.738 INFO:tasks.workunit.client.0.smithi052.stdout:7/244: readlink d11/d1c/l2f 0 2024-09-06T14:44:41.744 INFO:tasks.workunit.client.0.smithi052.stdout:5/216: truncate d2/d20/f28 8242043 0 2024-09-06T14:44:41.749 INFO:tasks.workunit.client.1.smithi165.stdout:1/988: dread d0/d2a/d18/d24/d4b/d95/f96 [0,4194304] 0 2024-09-06T14:44:41.750 INFO:tasks.workunit.client.0.smithi052.stdout:9/253: fsync d1/d4/d6/dc/d10/f34 0 2024-09-06T14:44:41.752 INFO:tasks.workunit.client.1.smithi165.stdout:7/878: rmdir d20/d3b/d69/d88/d80/d81/de1/d107 0 2024-09-06T14:44:41.753 INFO:tasks.workunit.client.0.smithi052.stdout:5/217: mkdir d2/d1a/d22/d26/d2b/d48 0 2024-09-06T14:44:41.754 INFO:tasks.workunit.client.0.smithi052.stdout:0/316: truncate d0/d1a/d26/d3a/d14/d2d/f2b 1593214 0 2024-09-06T14:44:41.755 INFO:tasks.workunit.client.0.smithi052.stdout:9/254: dread d1/d4/d6/dc/d10/d18/f33 [0,4194304] 0 2024-09-06T14:44:41.762 INFO:tasks.workunit.client.0.smithi052.stdout:7/245: link d11/c47 d11/d1c/d26/c51 0 2024-09-06T14:44:41.762 INFO:tasks.workunit.client.0.smithi052.stdout:0/317: dwrite d0/d1a/d26/d3a/d14/d20/f32 [4194304,4194304] 0 2024-09-06T14:44:41.767 INFO:tasks.workunit.client.0.smithi052.stdout:8/258: dwrite d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:41.769 INFO:tasks.workunit.client.1.smithi165.stdout:1/989: dread d0/f7 [0,4194304] 0 2024-09-06T14:44:41.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/259: write d6/d9/df/d1b/f2f [4277979,75846] 0 2024-09-06T14:44:41.770 INFO:tasks.workunit.client.0.smithi052.stdout:5/218: creat d2/d20/d42/f49 x:0 0 0 2024-09-06T14:44:41.772 INFO:tasks.workunit.client.0.smithi052.stdout:7/246: rename d11/d1c/d24/d3b/l3c to d11/d1c/d24/d3b/l52 0 2024-09-06T14:44:41.772 INFO:tasks.workunit.client.0.smithi052.stdout:9/255: truncate d1/d4/d6/dc/d10/f34 5188599 0 2024-09-06T14:44:41.775 INFO:tasks.workunit.client.0.smithi052.stdout:7/247: truncate d11/d1c/d26/f4d 169825 0 2024-09-06T14:44:41.775 INFO:tasks.workunit.client.1.smithi165.stdout:1/990: mkdir d0/d1c/d41/d147 0 2024-09-06T14:44:41.776 INFO:tasks.workunit.client.1.smithi165.stdout:7/879: write f12 [1108811,99718] 0 2024-09-06T14:44:41.777 INFO:tasks.workunit.client.1.smithi165.stdout:7/880: dread - d20/f100 zero size 2024-09-06T14:44:41.777 INFO:tasks.workunit.client.1.smithi165.stdout:7/881: chown d20/d65/d82/d97/lf3 3 1 2024-09-06T14:44:41.778 INFO:tasks.workunit.client.0.smithi052.stdout:5/219: unlink d2/c8 0 2024-09-06T14:44:41.780 INFO:tasks.workunit.client.0.smithi052.stdout:8/260: dwrite d6/d9/d21/f3f [4194304,4194304] 0 2024-09-06T14:44:41.835 INFO:tasks.workunit.client.0.smithi052.stdout:7/248: symlink d11/d1c/d24/d4b/l53 0 2024-09-06T14:44:41.838 INFO:tasks.workunit.client.0.smithi052.stdout:8/261: symlink d6/d22/d36/l58 0 2024-09-06T14:44:41.843 INFO:tasks.workunit.client.0.smithi052.stdout:5/220: rename d2/d1a/c47 to d2/d1a/d22/d26/c4a 0 2024-09-06T14:44:41.845 INFO:tasks.workunit.client.0.smithi052.stdout:8/262: dwrite d6/d22/d31/f34 [0,4194304] 0 2024-09-06T14:44:41.847 INFO:tasks.workunit.client.0.smithi052.stdout:7/249: creat d11/d1c/d3f/f54 x:0 0 0 2024-09-06T14:44:41.847 INFO:tasks.workunit.client.0.smithi052.stdout:7/250: chown c8 601062550 1 2024-09-06T14:44:41.849 INFO:tasks.workunit.client.0.smithi052.stdout:7/251: dread - d11/f49 zero size 2024-09-06T14:44:41.849 INFO:tasks.workunit.client.0.smithi052.stdout:7/252: chown d11/d1c/d3f 308 1 2024-09-06T14:44:41.850 INFO:tasks.workunit.client.0.smithi052.stdout:5/221: creat d2/d1a/d22/d26/d2b/d48/f4b x:0 0 0 2024-09-06T14:44:41.852 INFO:tasks.workunit.client.0.smithi052.stdout:5/222: chown d2/d1a/d22/d26/d2b 10364 1 2024-09-06T14:44:41.855 INFO:tasks.workunit.client.0.smithi052.stdout:7/253: dwrite f5 [0,4194304] 0 2024-09-06T14:44:41.855 INFO:tasks.workunit.client.0.smithi052.stdout:5/223: mkdir d2/d1a/d22/d26/d2b/d37/d4c 0 2024-09-06T14:44:41.856 INFO:tasks.workunit.client.0.smithi052.stdout:7/254: fdatasync d11/d1c/d24/f38 0 2024-09-06T14:44:41.919 INFO:tasks.workunit.client.1.smithi165.stdout:7/882: dwrite d20/d33/d53/f57 [0,4194304] 0 2024-09-06T14:44:41.922 INFO:tasks.workunit.client.1.smithi165.stdout:7/883: unlink d20/d4d/d54/l64 0 2024-09-06T14:44:41.926 INFO:tasks.workunit.client.1.smithi165.stdout:7/884: dread d20/d65/f2d [0,4194304] 0 2024-09-06T14:44:41.929 INFO:tasks.workunit.client.1.smithi165.stdout:7/885: mkdir d20/d33/d6a/d90/d11f 0 2024-09-06T14:44:41.934 INFO:tasks.workunit.client.1.smithi165.stdout:1/991: creat d0/d2a/d18/d24/d4b/d93/f148 x:0 0 0 2024-09-06T14:44:41.936 INFO:tasks.workunit.client.1.smithi165.stdout:1/992: creat d0/d2a/d18/d24/d4b/d93/d68/dae/f149 x:0 0 0 2024-09-06T14:44:41.947 INFO:tasks.workunit.client.0.smithi052.stdout:8/263: creat d6/f59 x:0 0 0 2024-09-06T14:44:41.953 INFO:tasks.workunit.client.0.smithi052.stdout:7/255: rename cd to d11/d1c/d24/d3b/d50/c55 0 2024-09-06T14:44:41.953 INFO:tasks.workunit.client.0.smithi052.stdout:8/264: dwrite d6/d22/f46 [0,4194304] 0 2024-09-06T14:44:41.955 INFO:tasks.workunit.client.0.smithi052.stdout:8/265: dread - d6/d9/df/f45 zero size 2024-09-06T14:44:41.956 INFO:tasks.workunit.client.0.smithi052.stdout:7/256: creat d11/d1c/d24/d3b/f56 x:0 0 0 2024-09-06T14:44:41.960 INFO:tasks.workunit.client.0.smithi052.stdout:8/266: getdents d6/d22/d36/d3e 0 2024-09-06T14:44:41.963 INFO:tasks.workunit.client.0.smithi052.stdout:8/267: unlink d6/d9/d1f/d14/l38 0 2024-09-06T14:44:41.963 INFO:tasks.workunit.client.0.smithi052.stdout:9/256: rmdir d1/d4/d6 39 2024-09-06T14:44:41.966 INFO:tasks.workunit.client.0.smithi052.stdout:8/268: unlink d6/d9/d1f/d14/l27 0 2024-09-06T14:44:41.967 INFO:tasks.workunit.client.0.smithi052.stdout:9/257: stat d1/d4/d6/dc/l3b 0 2024-09-06T14:44:41.969 INFO:tasks.workunit.client.0.smithi052.stdout:9/258: mknod d1/d26/d3d/c4d 0 2024-09-06T14:44:41.976 INFO:tasks.workunit.client.0.smithi052.stdout:9/259: dwrite d1/d4/d6/dd/f48 [0,4194304] 0 2024-09-06T14:44:41.978 INFO:tasks.workunit.client.1.smithi165.stdout:1/993: write d0/d2a/d18/d24/d4b/d93/d68/d75/f99 [4621242,41557] 0 2024-09-06T14:44:41.994 INFO:tasks.workunit.client.0.smithi052.stdout:8/269: dread d6/d9/d1f/d19/f2d [0,4194304] 0 2024-09-06T14:44:41.999 INFO:tasks.workunit.client.1.smithi165.stdout:1/994: dread d0/d2a/d18/d24/d4b/d93/d97/d137/f109 [0,4194304] 0 2024-09-06T14:44:42.007 INFO:tasks.workunit.client.1.smithi165.stdout:1/995: dwrite d0/d2a/fd [0,4194304] 0 2024-09-06T14:44:42.009 INFO:tasks.workunit.client.1.smithi165.stdout:1/996: creat d0/d2a/d18/d24/d4b/d93/d97/f14a x:0 0 0 2024-09-06T14:44:42.017 INFO:tasks.workunit.client.0.smithi052.stdout:8/270: dread d6/d9/d1f/d14/f29 [0,4194304] 0 2024-09-06T14:44:42.018 INFO:tasks.workunit.client.0.smithi052.stdout:8/271: chown d6/d9/d1f/d14/c25 224 1 2024-09-06T14:44:42.018 INFO:tasks.workunit.client.1.smithi165.stdout:1/997: write d0/fba [1019588,31710] 0 2024-09-06T14:44:42.019 INFO:tasks.workunit.client.1.smithi165.stdout:1/998: write d0/d1c/d1d/d57/fea [771908,90709] 0 2024-09-06T14:44:42.022 INFO:tasks.workunit.client.0.smithi052.stdout:8/272: rmdir d6/d22/d36/d3e/d47/d49 0 2024-09-06T14:44:42.024 INFO:tasks.workunit.client.1.smithi165.stdout:1/999: read d0/f14 [499697,29751] 0 2024-09-06T14:44:42.024 INFO:tasks.workunit.client.0.smithi052.stdout:8/273: rmdir d6/d9/d21/d4a 0 2024-09-06T14:44:42.027 INFO:tasks.workunit.client.0.smithi052.stdout:8/274: dread d6/d9/d1f/d19/f2d [0,4194304] 0 2024-09-06T14:44:42.029 INFO:tasks.workunit.client.0.smithi052.stdout:8/275: mknod d6/c5a 0 2024-09-06T14:44:42.029 INFO:tasks.workunit.client.0.smithi052.stdout:8/276: dread - d6/d9/df/f45 zero size 2024-09-06T14:44:42.031 INFO:tasks.workunit.client.0.smithi052.stdout:8/277: unlink d6/d9/df/f45 0 2024-09-06T14:44:42.032 INFO:tasks.workunit.client.0.smithi052.stdout:8/278: fdatasync d6/d9/d1f/d14/f29 0 2024-09-06T14:44:42.033 INFO:tasks.workunit.client.0.smithi052.stdout:8/279: write d6/d9/df/d1b/f30 [42627,84375] 0 2024-09-06T14:44:42.037 INFO:tasks.workunit.client.0.smithi052.stdout:8/280: unlink d6/d22/d31/f34 0 2024-09-06T14:44:42.041 INFO:tasks.workunit.client.0.smithi052.stdout:8/281: write d6/d9/f18 [871136,58023] 0 2024-09-06T14:44:42.047 INFO:tasks.workunit.client.0.smithi052.stdout:8/282: dwrite d6/d9/d1f/d19/f2d [0,4194304] 0 2024-09-06T14:44:42.049 INFO:tasks.workunit.client.0.smithi052.stdout:8/283: mkdir d6/d22/d31/d5b 0 2024-09-06T14:44:42.050 INFO:tasks.workunit.client.0.smithi052.stdout:8/284: mkdir d6/d22/d5c 0 2024-09-06T14:44:42.052 INFO:tasks.workunit.client.0.smithi052.stdout:8/285: write d6/d9/df/d1b/f2f [5335898,83056] 0 2024-09-06T14:44:42.055 INFO:tasks.workunit.client.0.smithi052.stdout:8/286: rename d6/d9/df/d1b/f37 to d6/d9/df/f5d 0 2024-09-06T14:44:42.056 INFO:tasks.workunit.client.0.smithi052.stdout:8/287: chown d6/d9 2011850721 1 2024-09-06T14:44:42.064 INFO:tasks.workunit.client.0.smithi052.stdout:8/288: truncate d6/d9/d1f/d19/f2d 881370 0 2024-09-06T14:44:42.064 INFO:tasks.workunit.client.0.smithi052.stdout:8/289: dread - d6/d9/df/f4e zero size 2024-09-06T14:44:42.066 INFO:tasks.workunit.client.0.smithi052.stdout:8/290: symlink d6/d22/d36/d3e/d47/d56/l5e 0 2024-09-06T14:44:42.067 INFO:tasks.workunit.client.0.smithi052.stdout:8/291: creat d6/f5f x:0 0 0 2024-09-06T14:44:42.068 INFO:tasks.workunit.client.0.smithi052.stdout:8/292: write d6/f5f [49633,121470] 0 2024-09-06T14:44:42.070 INFO:tasks.workunit.client.0.smithi052.stdout:8/293: creat d6/d9/df/d1b/f60 x:0 0 0 2024-09-06T14:44:42.072 INFO:tasks.workunit.client.0.smithi052.stdout:8/294: mknod d6/d22/c61 0 2024-09-06T14:44:42.072 INFO:tasks.workunit.client.0.smithi052.stdout:8/295: fsync d6/f59 0 2024-09-06T14:44:42.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:41 smithi165 ceph-mon[36229]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 202 MiB/s wr, 394 op/s 2024-09-06T14:44:42.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/296: mknod d6/d22/c62 0 2024-09-06T14:44:42.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/259: sync 2024-09-06T14:44:42.082 INFO:tasks.workunit.client.0.smithi052.stdout:8/297: dwrite d6/d16/f2c [8388608,4194304] 0 2024-09-06T14:44:42.083 INFO:tasks.workunit.client.0.smithi052.stdout:4/260: fdatasync d9/d10/d19/f3c 0 2024-09-06T14:44:42.084 INFO:tasks.workunit.client.0.smithi052.stdout:4/261: chown d9/c21 959089 1 2024-09-06T14:44:42.090 INFO:tasks.workunit.client.0.smithi052.stdout:8/298: dwrite d6/d9/df/d1b/f30 [0,4194304] 0 2024-09-06T14:44:42.092 INFO:tasks.workunit.client.0.smithi052.stdout:4/262: dwrite d9/f40 [8388608,4194304] 0 2024-09-06T14:44:42.094 INFO:tasks.workunit.client.0.smithi052.stdout:4/263: creat d9/d2d/f63 x:0 0 0 2024-09-06T14:44:42.096 INFO:tasks.workunit.client.0.smithi052.stdout:8/299: rmdir d6/d22/d36/d3e/d40 0 2024-09-06T14:44:42.098 INFO:tasks.workunit.client.0.smithi052.stdout:4/264: getdents d9 0 2024-09-06T14:44:42.120 INFO:tasks.workunit.client.1.smithi165.stdout:7/886: sync 2024-09-06T14:44:42.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:41 smithi052 ceph-mon[28627]: pgmap v23: 65 pgs: 65 active+clean; 2.2 GiB data, 6.2 GiB used, 530 GiB / 536 GiB avail; 73 MiB/s rd, 202 MiB/s wr, 394 op/s 2024-09-06T14:44:42.215 INFO:tasks.workunit.client.0.smithi052.stdout:8/300: creat d6/d4c/f63 x:0 0 0 2024-09-06T14:44:42.215 INFO:tasks.workunit.client.0.smithi052.stdout:4/265: mkdir d9/d10/d17/d39/d3a/d64 0 2024-09-06T14:44:42.216 INFO:tasks.workunit.client.0.smithi052.stdout:4/266: readlink d9/l3e 0 2024-09-06T14:44:42.216 INFO:tasks.workunit.client.0.smithi052.stdout:8/301: read d6/d9/df/d1b/f30 [2620834,85220] 0 2024-09-06T14:44:42.218 INFO:tasks.workunit.client.0.smithi052.stdout:4/267: creat d9/f65 x:0 0 0 2024-09-06T14:44:42.219 INFO:tasks.workunit.client.1.smithi165.stdout:7/887: mknod d20/d3b/d69/d88/d80/d81/c120 0 2024-09-06T14:44:42.222 INFO:tasks.workunit.client.0.smithi052.stdout:8/302: link d6/d9/d21/c43 d6/d9/d21/c64 0 2024-09-06T14:44:42.224 INFO:tasks.workunit.client.1.smithi165.stdout:7/888: unlink d20/d3b/cee 0 2024-09-06T14:44:42.224 INFO:tasks.workunit.client.1.smithi165.stdout:7/889: truncate d20/d3b/d69/fe8 1370884 0 2024-09-06T14:44:42.225 INFO:tasks.workunit.client.0.smithi052.stdout:8/303: unlink d6/c26 0 2024-09-06T14:44:42.225 INFO:tasks.workunit.client.0.smithi052.stdout:8/304: dread - d6/d4c/f63 zero size 2024-09-06T14:44:42.225 INFO:tasks.workunit.client.1.smithi165.stdout:7/890: stat f1f 0 2024-09-06T14:44:42.227 INFO:tasks.workunit.client.0.smithi052.stdout:8/305: unlink d6/c5a 0 2024-09-06T14:44:42.228 INFO:tasks.workunit.client.0.smithi052.stdout:8/306: truncate d6/f5f 429513 0 2024-09-06T14:44:42.228 INFO:tasks.workunit.client.0.smithi052.stdout:8/307: fdatasync d6/f5f 0 2024-09-06T14:44:42.229 INFO:tasks.workunit.client.0.smithi052.stdout:8/308: write d6/d22/f3a [91772,111385] 0 2024-09-06T14:44:42.230 INFO:tasks.workunit.client.0.smithi052.stdout:8/309: chown d6/d16 426589900 1 2024-09-06T14:44:42.231 INFO:tasks.workunit.client.1.smithi165.stdout:7/891: mkdir d20/d65/d82/def/d121 0 2024-09-06T14:44:42.233 INFO:tasks.workunit.client.0.smithi052.stdout:8/310: creat d6/d4c/f65 x:0 0 0 2024-09-06T14:44:42.234 INFO:tasks.workunit.client.0.smithi052.stdout:4/268: dwrite d9/fe [0,4194304] 0 2024-09-06T14:44:42.238 INFO:tasks.workunit.client.0.smithi052.stdout:4/269: dread d9/d10/d17/d39/f46 [0,4194304] 0 2024-09-06T14:44:42.240 INFO:tasks.workunit.client.0.smithi052.stdout:8/311: rmdir d6/d9/d1f/d19/d4d 0 2024-09-06T14:44:42.240 INFO:tasks.workunit.client.0.smithi052.stdout:8/312: chown d6/d22/f46 360 1 2024-09-06T14:44:42.244 INFO:tasks.workunit.client.0.smithi052.stdout:8/313: creat d6/d4c/f66 x:0 0 0 2024-09-06T14:44:42.247 INFO:tasks.workunit.client.1.smithi165.stdout:7/892: write d20/d3b/d69/d88/d30/fad [711792,47605] 0 2024-09-06T14:44:42.249 INFO:tasks.workunit.client.1.smithi165.stdout:7/893: creat d20/d3b/d69/d88/f122 x:0 0 0 2024-09-06T14:44:42.251 INFO:tasks.workunit.client.1.smithi165.stdout:7/894: fsync d20/d3b/d69/d88/fb1 0 2024-09-06T14:44:42.258 INFO:tasks.workunit.client.0.smithi052.stdout:8/314: creat d6/d22/d36/d3e/d47/f67 x:0 0 0 2024-09-06T14:44:42.261 INFO:tasks.workunit.client.0.smithi052.stdout:8/315: rename d6/d9/d21 to d6/d22/d36/d3e/d47/d56/d68 0 2024-09-06T14:44:42.262 INFO:tasks.workunit.client.0.smithi052.stdout:8/316: write d6/d4c/f66 [652933,20128] 0 2024-09-06T14:44:42.263 INFO:tasks.workunit.client.0.smithi052.stdout:4/270: dread d9/f35 [0,4194304] 0 2024-09-06T14:44:42.267 INFO:tasks.workunit.client.0.smithi052.stdout:4/271: getdents d9/d2d/d33/d4d 0 2024-09-06T14:44:42.267 INFO:tasks.workunit.client.0.smithi052.stdout:8/317: stat d6/d9/df/d1b/c32 0 2024-09-06T14:44:42.268 INFO:tasks.workunit.client.0.smithi052.stdout:8/318: write d6/d9/df/d1b/f2f [2565641,7761] 0 2024-09-06T14:44:42.270 INFO:tasks.workunit.client.0.smithi052.stdout:8/319: mkdir d6/d22/d36/d3e/d47/d56/d68/d69 0 2024-09-06T14:44:42.276 INFO:tasks.workunit.client.0.smithi052.stdout:8/320: dwrite d6/d9/d1f/d14/f29 [0,4194304] 0 2024-09-06T14:44:42.280 INFO:tasks.workunit.client.0.smithi052.stdout:8/321: dread d6/d22/d36/d3e/d47/d56/d68/f3f [4194304,4194304] 0 2024-09-06T14:44:42.280 INFO:tasks.workunit.client.0.smithi052.stdout:8/322: fdatasync d6/d4c/f66 0 2024-09-06T14:44:42.315 INFO:tasks.workunit.client.0.smithi052.stdout:2/285: sync 2024-09-06T14:44:42.316 INFO:tasks.workunit.client.0.smithi052.stdout:2/286: fdatasync da/db/d18/f38 0 2024-09-06T14:44:42.325 INFO:tasks.workunit.client.0.smithi052.stdout:8/323: chown d6/d9/le 2216 1 2024-09-06T14:44:42.327 INFO:tasks.workunit.client.0.smithi052.stdout:8/324: symlink d6/l6a 0 2024-09-06T14:44:42.329 INFO:tasks.workunit.client.0.smithi052.stdout:8/325: creat d6/d16/f6b x:0 0 0 2024-09-06T14:44:42.330 INFO:tasks.workunit.client.0.smithi052.stdout:2/287: getdents da/d2d/d34 0 2024-09-06T14:44:42.331 INFO:tasks.workunit.client.1.smithi165.stdout:7/895: sync 2024-09-06T14:44:42.333 INFO:tasks.workunit.client.0.smithi052.stdout:2/288: creat da/db/d46/d55/f68 x:0 0 0 2024-09-06T14:44:42.335 INFO:tasks.workunit.client.0.smithi052.stdout:2/289: symlink da/db/d18/l69 0 2024-09-06T14:44:42.337 INFO:tasks.workunit.client.0.smithi052.stdout:8/326: dwrite d6/d9/df/d1b/f60 [0,4194304] 0 2024-09-06T14:44:42.338 INFO:tasks.workunit.client.0.smithi052.stdout:8/327: readlink d6/d9/d1f/d19/l50 0 2024-09-06T14:44:42.341 INFO:tasks.workunit.client.1.smithi165.stdout:7/896: dread d20/d65/f6c [0,4194304] 0 2024-09-06T14:44:42.343 INFO:tasks.workunit.client.0.smithi052.stdout:8/328: creat d6/d22/d36/d3e/d47/d56/d68/f6c x:0 0 0 2024-09-06T14:44:42.344 INFO:tasks.workunit.client.0.smithi052.stdout:2/290: dwrite da/d19/f26 [0,4194304] 0 2024-09-06T14:44:42.346 INFO:tasks.workunit.client.1.smithi165.stdout:7/897: getdents d20/d65 0 2024-09-06T14:44:42.347 INFO:tasks.workunit.client.0.smithi052.stdout:2/291: mkdir da/db/d4c/d6a 0 2024-09-06T14:44:42.349 INFO:tasks.workunit.client.0.smithi052.stdout:8/329: mkdir d6/d9/d6d 0 2024-09-06T14:44:42.350 INFO:tasks.workunit.client.0.smithi052.stdout:2/292: mkdir da/db/d46/d6b 0 2024-09-06T14:44:42.351 INFO:tasks.workunit.client.1.smithi165.stdout:7/898: symlink d20/l123 0 2024-09-06T14:44:42.352 INFO:tasks.workunit.client.0.smithi052.stdout:2/293: unlink c4 0 2024-09-06T14:44:42.356 INFO:tasks.workunit.client.1.smithi165.stdout:7/899: rename d20/d3b/d69/d88/d30/f39 to d20/d33/d53/df4/f124 0 2024-09-06T14:44:42.358 INFO:tasks.workunit.client.0.smithi052.stdout:8/330: link d6/d9/d1f/c1c d6/d9/df/d41/c6e 0 2024-09-06T14:44:42.361 INFO:tasks.workunit.client.0.smithi052.stdout:8/331: mkdir d6/d9/d1f/d19/d6f 0 2024-09-06T14:44:42.364 INFO:tasks.workunit.client.0.smithi052.stdout:8/332: dread d6/d4c/f66 [0,4194304] 0 2024-09-06T14:44:42.367 INFO:tasks.workunit.client.0.smithi052.stdout:8/333: rename d6/d9/df/d41/c42 to d6/d9/d1f/d19/c70 0 2024-09-06T14:44:42.368 INFO:tasks.workunit.client.1.smithi165.stdout:7/900: dwrite f1f [4194304,4194304] 0 2024-09-06T14:44:42.369 INFO:tasks.workunit.client.1.smithi165.stdout:7/901: read - d20/d3b/d69/d88/dc6/f10c zero size 2024-09-06T14:44:42.369 INFO:tasks.workunit.client.0.smithi052.stdout:8/334: mkdir d6/d9/df/d41/d71 0 2024-09-06T14:44:42.370 INFO:tasks.workunit.client.1.smithi165.stdout:7/902: write d20/d33/feb [28208,81065] 0 2024-09-06T14:44:42.370 INFO:tasks.workunit.client.0.smithi052.stdout:8/335: write d6/d9/df/d1b/f60 [4691470,75874] 0 2024-09-06T14:44:42.371 INFO:tasks.workunit.client.0.smithi052.stdout:8/336: write d6/f59 [798011,5675] 0 2024-09-06T14:44:42.373 INFO:tasks.workunit.client.1.smithi165.stdout:7/903: mknod d20/d33/d6a/d90/c125 0 2024-09-06T14:44:42.373 INFO:tasks.workunit.client.0.smithi052.stdout:8/337: readlink d6/d9/l23 0 2024-09-06T14:44:42.376 INFO:tasks.workunit.client.0.smithi052.stdout:8/338: mkdir d6/d9/d1f/d19/d6f/d72 0 2024-09-06T14:44:42.377 INFO:tasks.workunit.client.0.smithi052.stdout:8/339: write d6/d9/df/f57 [138599,7530] 0 2024-09-06T14:44:42.379 INFO:tasks.workunit.client.0.smithi052.stdout:8/340: truncate d6/d4c/f63 510837 0 2024-09-06T14:44:42.379 INFO:tasks.workunit.client.0.smithi052.stdout:2/294: dread da/db/f16 [0,4194304] 0 2024-09-06T14:44:42.379 INFO:tasks.workunit.client.1.smithi165.stdout:7/904: symlink d20/d4d/ddd/l126 0 2024-09-06T14:44:42.386 INFO:tasks.workunit.client.0.smithi052.stdout:8/341: write f1 [6084582,91746] 0 2024-09-06T14:44:42.387 INFO:tasks.workunit.client.0.smithi052.stdout:8/342: readlink d6/d9/d1f/d19/l50 0 2024-09-06T14:44:42.388 INFO:tasks.workunit.client.0.smithi052.stdout:2/295: truncate da/db/d18/f38 4126758 0 2024-09-06T14:44:42.390 INFO:tasks.workunit.client.0.smithi052.stdout:2/296: write da/d19/d3a/d31/f5e [68317,63805] 0 2024-09-06T14:44:42.394 INFO:tasks.workunit.client.0.smithi052.stdout:8/343: dwrite d6/d9/df/f4e [0,4194304] 0 2024-09-06T14:44:42.395 INFO:tasks.workunit.client.0.smithi052.stdout:2/297: mkdir da/d19/d5a/d6c 0 2024-09-06T14:44:42.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/298: creat da/d19/f6d x:0 0 0 2024-09-06T14:44:42.412 INFO:tasks.workunit.client.0.smithi052.stdout:2/299: dwrite f2 [0,4194304] 0 2024-09-06T14:44:42.422 INFO:tasks.workunit.client.0.smithi052.stdout:2/300: getdents da/d19/d5a 0 2024-09-06T14:44:42.422 INFO:tasks.workunit.client.0.smithi052.stdout:2/301: stat da/d19/d5a/d5f/f67 0 2024-09-06T14:44:42.423 INFO:tasks.workunit.client.0.smithi052.stdout:2/302: write da/d19/f1a [898049,54366] 0 2024-09-06T14:44:42.494 INFO:tasks.workunit.client.0.smithi052.stdout:3/348: sync 2024-09-06T14:44:42.495 INFO:tasks.workunit.client.0.smithi052.stdout:1/315: sync 2024-09-06T14:44:42.495 INFO:tasks.workunit.client.0.smithi052.stdout:1/316: readlink d1/l11 0 2024-09-06T14:44:42.507 INFO:tasks.workunit.client.0.smithi052.stdout:3/349: creat d0/d11/d15/d1b/f60 x:0 0 0 2024-09-06T14:44:42.511 INFO:tasks.workunit.client.0.smithi052.stdout:2/303: symlink da/db/d4c/d6a/l6e 0 2024-09-06T14:44:42.513 INFO:tasks.workunit.client.0.smithi052.stdout:3/350: rename d0/d11/d12/d4c/d53/f2d to d0/d11/d15/d19/f61 0 2024-09-06T14:44:42.515 INFO:tasks.workunit.client.0.smithi052.stdout:1/317: creat d1/db/de/d68/f6a x:0 0 0 2024-09-06T14:44:42.516 INFO:tasks.workunit.client.0.smithi052.stdout:2/304: dwrite da/db/f12 [4194304,4194304] 0 2024-09-06T14:44:42.517 INFO:tasks.workunit.client.0.smithi052.stdout:3/351: chown d0/d11/d12/d4c/d53/d35/d46/c59 30 1 2024-09-06T14:44:42.518 INFO:tasks.workunit.client.0.smithi052.stdout:2/305: write da/db/d4c/f4d [487331,47550] 0 2024-09-06T14:44:42.519 INFO:tasks.workunit.client.0.smithi052.stdout:1/318: mkdir d1/db/d18/d6b 0 2024-09-06T14:44:42.522 INFO:tasks.workunit.client.0.smithi052.stdout:2/306: rename da/l35 to da/db/d4c/l6f 0 2024-09-06T14:44:42.524 INFO:tasks.workunit.client.1.smithi165.stdout:7/905: creat d20/d33/d53/df4/f127 x:0 0 0 2024-09-06T14:44:42.525 INFO:tasks.workunit.client.1.smithi165.stdout:7/906: write d20/d65/d82/def/f10b [899624,45551] 0 2024-09-06T14:44:42.525 INFO:tasks.workunit.client.0.smithi052.stdout:3/352: mkdir d0/d11/d12/d62 0 2024-09-06T14:44:42.527 INFO:tasks.workunit.client.0.smithi052.stdout:2/307: unlink da/d19/d3a/d31/f58 0 2024-09-06T14:44:42.528 INFO:tasks.workunit.client.0.smithi052.stdout:2/308: write da/db/d18/f33 [1795481,31019] 0 2024-09-06T14:44:42.529 INFO:tasks.workunit.client.1.smithi165.stdout:7/907: dread d20/d3b/d69/d88/dc6/fe3 [0,4194304] 0 2024-09-06T14:44:42.529 INFO:tasks.workunit.client.0.smithi052.stdout:1/319: mkdir d1/d6c 0 2024-09-06T14:44:42.532 INFO:tasks.workunit.client.0.smithi052.stdout:3/353: creat d0/d11/d12/d4c/f63 x:0 0 0 2024-09-06T14:44:42.536 INFO:tasks.workunit.client.0.smithi052.stdout:2/309: dwrite da/d19/d3a/f63 [0,4194304] 0 2024-09-06T14:44:42.537 INFO:tasks.workunit.client.0.smithi052.stdout:3/354: mkdir d0/d11/d12/d4c/d53/d64 0 2024-09-06T14:44:42.540 INFO:tasks.workunit.client.0.smithi052.stdout:3/355: mknod d0/d11/d12/d4c/d53/c65 0 2024-09-06T14:44:42.541 INFO:tasks.workunit.client.0.smithi052.stdout:2/310: getdents da/d2d 0 2024-09-06T14:44:42.543 INFO:tasks.workunit.client.0.smithi052.stdout:2/311: chown da/db/l5c 1867 1 2024-09-06T14:44:42.545 INFO:tasks.workunit.client.0.smithi052.stdout:3/356: rename d0/d11/d12/d4c/d53/c65 to d0/d11/d15/d1b/c66 0 2024-09-06T14:44:42.546 INFO:tasks.workunit.client.0.smithi052.stdout:2/312: mkdir da/d19/d5a/d5f/d70 0 2024-09-06T14:44:42.547 INFO:tasks.workunit.client.0.smithi052.stdout:2/313: readlink da/db/l27 0 2024-09-06T14:44:42.548 INFO:tasks.workunit.client.0.smithi052.stdout:3/357: mkdir d0/d11/d12/d4c/d53/d35/d46/d67 0 2024-09-06T14:44:42.550 INFO:tasks.workunit.client.0.smithi052.stdout:2/314: fsync da/db/fe 0 2024-09-06T14:44:42.553 INFO:tasks.workunit.client.0.smithi052.stdout:3/358: rename d0/d11/c13 to d0/d11/d15/d19/c68 0 2024-09-06T14:44:42.558 INFO:tasks.workunit.client.0.smithi052.stdout:2/315: rename c8 to da/db/d46/d6b/c71 0 2024-09-06T14:44:42.559 INFO:tasks.workunit.client.0.smithi052.stdout:2/316: dread - da/db/d46/d55/f68 zero size 2024-09-06T14:44:42.561 INFO:tasks.workunit.client.0.smithi052.stdout:2/317: read da/d19/d3a/d31/f43 [1663770,34083] 0 2024-09-06T14:44:42.562 INFO:tasks.workunit.client.0.smithi052.stdout:2/318: stat da/d19/f1a 0 2024-09-06T14:44:42.563 INFO:tasks.workunit.client.0.smithi052.stdout:2/319: write da/d19/d3a/d31/f37 [218592,513] 0 2024-09-06T14:44:42.571 INFO:tasks.workunit.client.0.smithi052.stdout:2/320: dwrite da/d4f/f5b [0,4194304] 0 2024-09-06T14:44:42.572 INFO:tasks.workunit.client.1.smithi165.stdout:7/908: write d20/d3b/d69/d88/d80/d81/f95 [998395,39458] 0 2024-09-06T14:44:42.573 INFO:tasks.workunit.client.1.smithi165.stdout:7/909: dread - d20/d4d/d54/f11c zero size 2024-09-06T14:44:42.573 INFO:tasks.workunit.client.1.smithi165.stdout:7/910: readlink d20/d33/d53/l77 0 2024-09-06T14:44:42.577 INFO:tasks.workunit.client.0.smithi052.stdout:1/320: dwrite d1/db/fd [0,4194304] 0 2024-09-06T14:44:42.585 INFO:tasks.workunit.client.0.smithi052.stdout:7/257: sync 2024-09-06T14:44:42.585 INFO:tasks.workunit.client.0.smithi052.stdout:6/157: sync 2024-09-06T14:44:42.585 INFO:tasks.workunit.client.0.smithi052.stdout:5/224: sync 2024-09-06T14:44:42.585 INFO:tasks.workunit.client.0.smithi052.stdout:0/318: sync 2024-09-06T14:44:42.594 INFO:tasks.workunit.client.0.smithi052.stdout:7/258: write d11/d1c/f1e [2577149,82507] 0 2024-09-06T14:44:42.595 INFO:tasks.workunit.client.1.smithi165.stdout:7/911: write d20/d3b/d69/d88/dc6/fe3 [635044,106041] 0 2024-09-06T14:44:42.597 INFO:tasks.workunit.client.0.smithi052.stdout:6/158: rename d2/f19 to d2/f30 0 2024-09-06T14:44:42.598 INFO:tasks.workunit.client.1.smithi165.stdout:7/912: mkdir d20/d65/d128 0 2024-09-06T14:44:42.598 INFO:tasks.workunit.client.1.smithi165.stdout:7/913: readlink d20/d33/d53/d66/l73 0 2024-09-06T14:44:42.601 INFO:tasks.workunit.client.0.smithi052.stdout:3/359: dwrite d0/d11/d12/d4c/d53/d35/f28 [0,4194304] 0 2024-09-06T14:44:42.603 INFO:tasks.workunit.client.0.smithi052.stdout:5/225: dwrite d2/f12 [4194304,4194304] 0 2024-09-06T14:44:42.607 INFO:tasks.workunit.client.1.smithi165.stdout:7/914: rmdir d20/d65 39 2024-09-06T14:44:42.608 INFO:tasks.workunit.client.0.smithi052.stdout:6/159: fdatasync d2/fb 0 2024-09-06T14:44:42.608 INFO:tasks.workunit.client.0.smithi052.stdout:5/226: rmdir d2/d1a 39 2024-09-06T14:44:42.612 INFO:tasks.workunit.client.0.smithi052.stdout:0/319: dwrite d0/d1a/d26/d3a/d14/d20/d22/d41/f64 [0,4194304] 0 2024-09-06T14:44:42.613 INFO:tasks.workunit.client.0.smithi052.stdout:3/360: stat d0/d11/d12/l1f 0 2024-09-06T14:44:42.615 INFO:tasks.workunit.client.1.smithi165.stdout:7/915: creat d20/f129 x:0 0 0 2024-09-06T14:44:42.620 INFO:tasks.workunit.client.0.smithi052.stdout:3/361: truncate d0/ff 4748372 0 2024-09-06T14:44:42.621 INFO:tasks.workunit.client.0.smithi052.stdout:1/321: dwrite d1/da/ff [0,4194304] 0 2024-09-06T14:44:42.623 INFO:tasks.workunit.client.0.smithi052.stdout:6/160: creat d2/dd/d18/f31 x:0 0 0 2024-09-06T14:44:42.624 INFO:tasks.workunit.client.0.smithi052.stdout:5/227: write d2/f1d [1226940,55560] 0 2024-09-06T14:44:42.626 INFO:tasks.workunit.client.1.smithi165.stdout:7/916: dread d20/d3b/d69/d88/fb1 [0,4194304] 0 2024-09-06T14:44:42.627 INFO:tasks.workunit.client.0.smithi052.stdout:9/260: sync 2024-09-06T14:44:42.627 INFO:tasks.workunit.client.0.smithi052.stdout:4/272: sync 2024-09-06T14:44:42.627 INFO:tasks.workunit.client.0.smithi052.stdout:8/344: sync 2024-09-06T14:44:42.627 INFO:tasks.workunit.client.0.smithi052.stdout:2/321: dread da/db/d18/f38 [0,4194304] 0 2024-09-06T14:44:42.627 INFO:tasks.workunit.client.0.smithi052.stdout:7/259: dwrite d11/d1c/d24/d4b/f4c [0,4194304] 0 2024-09-06T14:44:42.628 INFO:tasks.workunit.client.0.smithi052.stdout:6/161: chown d2/dd/f20 1744062 1 2024-09-06T14:44:42.629 INFO:tasks.workunit.client.0.smithi052.stdout:1/322: symlink d1/da/l6d 0 2024-09-06T14:44:42.630 INFO:tasks.workunit.client.0.smithi052.stdout:7/260: fsync d11/d1c/f34 0 2024-09-06T14:44:42.630 INFO:tasks.workunit.client.0.smithi052.stdout:6/162: write d2/fc [1257459,19368] 0 2024-09-06T14:44:42.631 INFO:tasks.workunit.client.0.smithi052.stdout:0/320: chown d0/d1a/d26/d3a/d14/d20/d22/f4a 327 1 2024-09-06T14:44:42.632 INFO:tasks.workunit.client.1.smithi165.stdout:7/917: rmdir d20/d3b/d69/d88/dc6 39 2024-09-06T14:44:42.633 INFO:tasks.workunit.client.1.smithi165.stdout:7/918: dread d20/d3b/d69/d88/fb1 [0,4194304] 0 2024-09-06T14:44:42.636 INFO:tasks.workunit.client.1.smithi165.stdout:7/919: dread d20/d4d/d112/f118 [0,4194304] 0 2024-09-06T14:44:42.637 INFO:tasks.workunit.client.0.smithi052.stdout:8/345: write d6/f59 [319745,127084] 0 2024-09-06T14:44:42.638 INFO:tasks.workunit.client.0.smithi052.stdout:2/322: creat da/f72 x:0 0 0 2024-09-06T14:44:42.640 INFO:tasks.workunit.client.1.smithi165.stdout:7/920: mknod d20/d33/d53/df4/c12a 0 2024-09-06T14:44:42.641 INFO:tasks.workunit.client.0.smithi052.stdout:1/323: creat d1/da/d3e/d47/f6e x:0 0 0 2024-09-06T14:44:42.644 INFO:tasks.workunit.client.0.smithi052.stdout:3/362: dread d0/d11/d12/d17/f48 [0,4194304] 0 2024-09-06T14:44:42.644 INFO:tasks.workunit.client.0.smithi052.stdout:0/321: creat d0/d1a/d26/d3a/d14/d2d/d56/d5d/f6c x:0 0 0 2024-09-06T14:44:42.647 INFO:tasks.workunit.client.0.smithi052.stdout:5/228: symlink d2/d1a/d22/l4d 0 2024-09-06T14:44:42.648 INFO:tasks.workunit.client.1.smithi165.stdout:7/921: dwrite d20/d3b/d69/d88/d30/d78/ffd [0,4194304] 0 2024-09-06T14:44:42.649 INFO:tasks.workunit.client.0.smithi052.stdout:6/163: mkdir d2/dd/d18/d2d/d32 0 2024-09-06T14:44:42.649 INFO:tasks.workunit.client.1.smithi165.stdout:7/922: write d20/d3b/d69/d88/f58 [2278138,104610] 0 2024-09-06T14:44:42.649 INFO:tasks.workunit.client.0.smithi052.stdout:1/324: unlink d1/db/d18/c2c 0 2024-09-06T14:44:42.651 INFO:tasks.workunit.client.0.smithi052.stdout:7/261: dwrite d11/d1c/d3f/f54 [0,4194304] 0 2024-09-06T14:44:42.653 INFO:tasks.workunit.client.0.smithi052.stdout:0/322: dread - d0/d1a/d26/d3a/d14/f3e zero size 2024-09-06T14:44:42.657 INFO:tasks.workunit.client.0.smithi052.stdout:1/325: fdatasync d1/db/f3f 0 2024-09-06T14:44:42.658 INFO:tasks.workunit.client.1.smithi165.stdout:7/923: dread d20/d65/fd2 [0,4194304] 0 2024-09-06T14:44:42.658 INFO:tasks.workunit.client.0.smithi052.stdout:0/323: chown d0/f1c 170 1 2024-09-06T14:44:42.658 INFO:tasks.workunit.client.0.smithi052.stdout:9/261: dwrite d1/d4/d6/dd/f13 [0,4194304] 0 2024-09-06T14:44:42.661 INFO:tasks.workunit.client.0.smithi052.stdout:4/273: getdents d9/d10/d17/d39/d3a 0 2024-09-06T14:44:42.661 INFO:tasks.workunit.client.0.smithi052.stdout:8/346: dwrite d6/d9/f18 [0,4194304] 0 2024-09-06T14:44:42.664 INFO:tasks.workunit.client.0.smithi052.stdout:8/347: stat d6/d9/d1f/d19/f2d 0 2024-09-06T14:44:42.665 INFO:tasks.workunit.client.0.smithi052.stdout:1/326: chown d1/da/d3e/d47/d4a/c55 5 1 2024-09-06T14:44:42.666 INFO:tasks.workunit.client.0.smithi052.stdout:2/323: link da/db/c13 da/d19/d5a/d5f/d70/c73 0 2024-09-06T14:44:42.667 INFO:tasks.workunit.client.1.smithi165.stdout:7/924: creat d20/d65/f12b x:0 0 0 2024-09-06T14:44:42.668 INFO:tasks.workunit.client.0.smithi052.stdout:0/324: chown d0/d1a/d26/d3a/d14/d20/d22/d41/f4c 4 1 2024-09-06T14:44:42.670 INFO:tasks.workunit.client.0.smithi052.stdout:7/262: mkdir d11/d1c/d57 0 2024-09-06T14:44:42.670 INFO:tasks.workunit.client.0.smithi052.stdout:5/229: rename d2/d1a/d22/l43 to d2/d1a/d22/d26/d2b/d48/l4e 0 2024-09-06T14:44:42.672 INFO:tasks.workunit.client.0.smithi052.stdout:6/164: write d2/dd/f2f [1243811,118427] 0 2024-09-06T14:44:42.674 INFO:tasks.workunit.client.1.smithi165.stdout:7/925: dwrite f8 [0,4194304] 0 2024-09-06T14:44:42.675 INFO:tasks.workunit.client.0.smithi052.stdout:4/274: write d9/f35 [4058790,111741] 0 2024-09-06T14:44:42.675 INFO:tasks.workunit.client.0.smithi052.stdout:1/327: truncate d1/db/f52 198303 0 2024-09-06T14:44:42.676 INFO:tasks.workunit.client.0.smithi052.stdout:0/325: symlink d0/d1a/d26/d3a/d14/d2d/d56/d5d/l6d 0 2024-09-06T14:44:42.679 INFO:tasks.workunit.client.0.smithi052.stdout:3/363: symlink d0/d11/d12/d4c/d53/d64/l69 0 2024-09-06T14:44:42.680 INFO:tasks.workunit.client.0.smithi052.stdout:2/324: chown da/db/d46/d6b/c71 26287742 1 2024-09-06T14:44:42.684 INFO:tasks.workunit.client.0.smithi052.stdout:8/348: symlink d6/d22/l73 0 2024-09-06T14:44:42.685 INFO:tasks.workunit.client.0.smithi052.stdout:5/230: dwrite d2/d20/d42/f49 [0,4194304] 0 2024-09-06T14:44:42.686 INFO:tasks.workunit.client.0.smithi052.stdout:6/165: write d2/f30 [1747944,28443] 0 2024-09-06T14:44:42.688 INFO:tasks.workunit.client.0.smithi052.stdout:6/166: chown d2/dd/d18/d25 32485 1 2024-09-06T14:44:42.690 INFO:tasks.workunit.client.1.smithi165.stdout:7/926: link d20/d65/d82/d97/ld9 d20/d4d/dd4/l12c 0 2024-09-06T14:44:42.691 INFO:tasks.workunit.client.0.smithi052.stdout:6/167: stat d2/dd/l16 0 2024-09-06T14:44:42.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/275: stat d9/d10/d17/d39/d3a/c55 0 2024-09-06T14:44:42.691 INFO:tasks.workunit.client.0.smithi052.stdout:1/328: readlink d1/db/l4d 0 2024-09-06T14:44:42.693 INFO:tasks.workunit.client.0.smithi052.stdout:9/262: write d1/d4/d6/dd/d22/f28 [143354,43091] 0 2024-09-06T14:44:42.695 INFO:tasks.workunit.client.0.smithi052.stdout:4/276: chown d9/d10/d17/d39/d3a/c55 24 1 2024-09-06T14:44:42.697 INFO:tasks.workunit.client.0.smithi052.stdout:3/364: write d0/d11/d12/d4c/d53/f37 [670351,64841] 0 2024-09-06T14:44:42.699 INFO:tasks.workunit.client.1.smithi165.stdout:7/927: getdents d20/d33/d53/d66 0 2024-09-06T14:44:42.700 INFO:tasks.workunit.client.0.smithi052.stdout:6/168: mkdir d2/dd/d18/d33 0 2024-09-06T14:44:42.701 INFO:tasks.workunit.client.0.smithi052.stdout:4/277: chown d9/d2d/d33/f37 23 1 2024-09-06T14:44:42.701 INFO:tasks.workunit.client.0.smithi052.stdout:5/231: creat d2/d1a/d22/f4f x:0 0 0 2024-09-06T14:44:42.701 INFO:tasks.workunit.client.0.smithi052.stdout:8/349: dwrite d6/f5f [0,4194304] 0 2024-09-06T14:44:42.701 INFO:tasks.workunit.client.1.smithi165.stdout:7/928: mknod d20/d3b/c12d 0 2024-09-06T14:44:42.702 INFO:tasks.workunit.client.1.smithi165.stdout:7/929: truncate d20/d4d/d54/f9c 796960 0 2024-09-06T14:44:42.702 INFO:tasks.workunit.client.0.smithi052.stdout:0/326: symlink d0/d4f/l6e 0 2024-09-06T14:44:42.707 INFO:tasks.workunit.client.0.smithi052.stdout:8/350: dread d6/d4c/f63 [0,4194304] 0 2024-09-06T14:44:42.707 INFO:tasks.workunit.client.0.smithi052.stdout:1/329: creat d1/da/d3e/d47/f6f x:0 0 0 2024-09-06T14:44:42.707 INFO:tasks.workunit.client.0.smithi052.stdout:3/365: readlink d0/d11/d12/d4c/d53/d35/l3d 0 2024-09-06T14:44:42.709 INFO:tasks.workunit.client.0.smithi052.stdout:4/278: dread - d9/d10/d17/d39/d3a/f5b zero size 2024-09-06T14:44:42.710 INFO:tasks.workunit.client.0.smithi052.stdout:7/263: creat d11/d1c/d24/d3b/d50/f58 x:0 0 0 2024-09-06T14:44:42.710 INFO:tasks.workunit.client.0.smithi052.stdout:1/330: stat d1/db/d18/c57 0 2024-09-06T14:44:42.711 INFO:tasks.workunit.client.0.smithi052.stdout:0/327: read d0/d1a/d26/d3a/d14/d20/d22/d41/f64 [2735397,125701] 0 2024-09-06T14:44:42.711 INFO:tasks.workunit.client.0.smithi052.stdout:5/232: symlink d2/d1a/d22/d26/d2b/d37/l50 0 2024-09-06T14:44:42.711 INFO:tasks.workunit.client.1.smithi165.stdout:7/930: truncate d20/d4d/d54/dc1/fcf 3187082 0 2024-09-06T14:44:42.712 INFO:tasks.workunit.client.0.smithi052.stdout:8/351: write d6/d4c/f66 [899046,95063] 0 2024-09-06T14:44:42.715 INFO:tasks.workunit.client.0.smithi052.stdout:8/352: fsync f1 0 2024-09-06T14:44:42.716 INFO:tasks.workunit.client.0.smithi052.stdout:7/264: write d11/f2c [915814,121375] 0 2024-09-06T14:44:42.716 INFO:tasks.workunit.client.1.smithi165.stdout:7/931: creat d20/d3b/d69/d88/d30/f12e x:0 0 0 2024-09-06T14:44:42.718 INFO:tasks.workunit.client.0.smithi052.stdout:6/169: symlink d2/dd/d18/d33/l34 0 2024-09-06T14:44:42.721 INFO:tasks.workunit.client.1.smithi165.stdout:7/932: symlink d20/d65/d82/def/l12f 0 2024-09-06T14:44:42.721 INFO:tasks.workunit.client.0.smithi052.stdout:7/265: write d11/f49 [298836,81836] 0 2024-09-06T14:44:42.723 INFO:tasks.workunit.client.0.smithi052.stdout:8/353: chown d6/d22/d36/d3e/d47/d56/d68/f6c 120681 1 2024-09-06T14:44:42.725 INFO:tasks.workunit.client.1.smithi165.stdout:7/933: fsync d20/d3b/f8b 0 2024-09-06T14:44:42.726 INFO:tasks.workunit.client.0.smithi052.stdout:9/263: dread d1/f30 [0,4194304] 0 2024-09-06T14:44:42.727 INFO:tasks.workunit.client.0.smithi052.stdout:1/331: dwrite d1/da/d12/f46 [0,4194304] 0 2024-09-06T14:44:42.729 INFO:tasks.workunit.client.0.smithi052.stdout:2/325: dread da/f1b [0,4194304] 0 2024-09-06T14:44:42.729 INFO:tasks.workunit.client.0.smithi052.stdout:1/332: stat d1/l11 0 2024-09-06T14:44:42.730 INFO:tasks.workunit.client.0.smithi052.stdout:5/233: dread d2/d1a/d22/d26/d2b/d37/f44 [0,4194304] 0 2024-09-06T14:44:42.734 INFO:tasks.workunit.client.0.smithi052.stdout:9/264: write d1/d4/d6/dd/d22/f28 [453839,16446] 0 2024-09-06T14:44:42.734 INFO:tasks.workunit.client.1.smithi165.stdout:7/934: symlink d20/d65/d82/d97/l130 0 2024-09-06T14:44:42.735 INFO:tasks.workunit.client.0.smithi052.stdout:4/279: mknod d9/d10/d17/c66 0 2024-09-06T14:44:42.738 INFO:tasks.workunit.client.1.smithi165.stdout:7/935: mkdir d20/d33/d6a/d9a/d131 0 2024-09-06T14:44:42.739 INFO:tasks.workunit.client.0.smithi052.stdout:3/366: link d0/l54 d0/d11/d15/l6a 0 2024-09-06T14:44:42.740 INFO:tasks.workunit.client.0.smithi052.stdout:7/266: chown d11/d1c/l36 108 1 2024-09-06T14:44:42.744 INFO:tasks.workunit.client.0.smithi052.stdout:1/333: rename d1/da/d14/d2e/f69 to d1/da/d12/f70 0 2024-09-06T14:44:42.745 INFO:tasks.workunit.client.0.smithi052.stdout:4/280: creat d9/d2d/f67 x:0 0 0 2024-09-06T14:44:42.746 INFO:tasks.workunit.client.0.smithi052.stdout:5/234: fdatasync d2/d20/f28 0 2024-09-06T14:44:42.746 INFO:tasks.workunit.client.0.smithi052.stdout:0/328: dwrite d0/d1a/d26/d3a/d14/d2d/f11 [4194304,4194304] 0 2024-09-06T14:44:42.747 INFO:tasks.workunit.client.0.smithi052.stdout:9/265: unlink d1/d4/d6/dd/f2c 0 2024-09-06T14:44:42.748 INFO:tasks.workunit.client.0.smithi052.stdout:2/326: truncate da/d19/d3a/f3f 3480141 0 2024-09-06T14:44:42.748 INFO:tasks.workunit.client.0.smithi052.stdout:6/170: dread d2/dd/f10 [0,4194304] 0 2024-09-06T14:44:42.750 INFO:tasks.workunit.client.0.smithi052.stdout:8/354: dwrite d6/d22/d36/d3e/d47/d56/d68/f6c [0,4194304] 0 2024-09-06T14:44:42.751 INFO:tasks.workunit.client.0.smithi052.stdout:3/367: creat d0/d11/d15/d1b/f6b x:0 0 0 2024-09-06T14:44:42.755 INFO:tasks.workunit.client.0.smithi052.stdout:3/368: fsync d0/d11/d12/f47 0 2024-09-06T14:44:42.758 INFO:tasks.workunit.client.0.smithi052.stdout:7/267: symlink d11/d1c/d57/l59 0 2024-09-06T14:44:42.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/235: mknod d2/d20/c51 0 2024-09-06T14:44:42.759 INFO:tasks.workunit.client.1.smithi165.stdout:7/936: dwrite d20/d4d/fc9 [0,4194304] 0 2024-09-06T14:44:42.762 INFO:tasks.workunit.client.0.smithi052.stdout:9/266: dread d1/f23 [0,4194304] 0 2024-09-06T14:44:42.765 INFO:tasks.workunit.client.0.smithi052.stdout:2/327: dwrite da/f72 [0,4194304] 0 2024-09-06T14:44:42.767 INFO:tasks.workunit.client.0.smithi052.stdout:6/171: dread d2/dd/d18/f2b [0,4194304] 0 2024-09-06T14:44:42.767 INFO:tasks.workunit.client.1.smithi165.stdout:7/937: rename d20/d33/f8a to d20/d33/d6a/d90/f132 0 2024-09-06T14:44:42.769 INFO:tasks.workunit.client.0.smithi052.stdout:2/328: write da/f57 [618811,34914] 0 2024-09-06T14:44:42.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/172: chown d2/dd/l16 441464130 1 2024-09-06T14:44:42.776 INFO:tasks.workunit.client.0.smithi052.stdout:3/369: mknod d0/d11/d12/d17/c6c 0 2024-09-06T14:44:42.778 INFO:tasks.workunit.client.0.smithi052.stdout:4/281: rename d9/cf to d9/d10/c68 0 2024-09-06T14:44:42.779 INFO:tasks.workunit.client.0.smithi052.stdout:2/329: fdatasync da/d19/d3a/d31/f43 0 2024-09-06T14:44:42.780 INFO:tasks.workunit.client.0.smithi052.stdout:1/334: dwrite d1/da/f49 [0,4194304] 0 2024-09-06T14:44:42.785 INFO:tasks.workunit.client.0.smithi052.stdout:8/355: rename d6/d22/f46 to d6/d22/d36/d3e/d47/d56/d68/d69/f74 0 2024-09-06T14:44:42.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/268: dwrite d11/d1c/d26/f46 [0,4194304] 0 2024-09-06T14:44:42.789 INFO:tasks.workunit.client.0.smithi052.stdout:6/173: creat d2/dd/d18/d2d/d32/f35 x:0 0 0 2024-09-06T14:44:42.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/174: chown d2/dd/f20 198435452 1 2024-09-06T14:44:42.791 INFO:tasks.workunit.client.0.smithi052.stdout:3/370: symlink d0/d11/d12/l6d 0 2024-09-06T14:44:42.794 INFO:tasks.workunit.client.0.smithi052.stdout:1/335: mknod d1/db/de/d68/c71 0 2024-09-06T14:44:42.796 INFO:tasks.workunit.client.1.smithi165.stdout:7/938: write f15 [336815,103581] 0 2024-09-06T14:44:42.797 INFO:tasks.workunit.client.0.smithi052.stdout:1/336: stat d1/da/l62 0 2024-09-06T14:44:42.798 INFO:tasks.workunit.client.0.smithi052.stdout:0/329: rename d0/d1a/d26/d3a/d14/d20/d22/c2a to d0/d1a/d26/d3a/d14/d20/d22/d41/c6f 0 2024-09-06T14:44:42.800 INFO:tasks.workunit.client.0.smithi052.stdout:1/337: chown d1/da/l2d 56 1 2024-09-06T14:44:42.800 INFO:tasks.workunit.client.0.smithi052.stdout:0/330: stat d0/d1a/f52 0 2024-09-06T14:44:42.801 INFO:tasks.workunit.client.1.smithi165.stdout:7/939: symlink d20/d3b/l133 0 2024-09-06T14:44:42.801 INFO:tasks.workunit.client.0.smithi052.stdout:5/236: dread d2/f18 [4194304,4194304] 0 2024-09-06T14:44:42.802 INFO:tasks.workunit.client.0.smithi052.stdout:6/175: dwrite d2/f30 [0,4194304] 0 2024-09-06T14:44:42.803 INFO:tasks.workunit.client.0.smithi052.stdout:0/331: chown d0/d1a/d26/c39 5008 1 2024-09-06T14:44:42.804 INFO:tasks.workunit.client.0.smithi052.stdout:5/237: chown d2/lc 59820 1 2024-09-06T14:44:42.804 INFO:tasks.workunit.client.0.smithi052.stdout:3/371: mknod d0/d11/d12/d4c/d53/d64/c6e 0 2024-09-06T14:44:42.807 INFO:tasks.workunit.client.0.smithi052.stdout:8/356: dread d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:42.808 INFO:tasks.workunit.client.0.smithi052.stdout:2/330: rename da/d2d/d34/c3d to da/db/d4c/c74 0 2024-09-06T14:44:42.812 INFO:tasks.workunit.client.0.smithi052.stdout:0/332: dwrite d0/d1a/d26/d3a/d14/d2d/f33 [0,4194304] 0 2024-09-06T14:44:42.812 INFO:tasks.workunit.client.0.smithi052.stdout:1/338: unlink d1/db/de/f2b 0 2024-09-06T14:44:42.814 INFO:tasks.workunit.client.0.smithi052.stdout:6/176: mknod d2/dd/d18/c36 0 2024-09-06T14:44:42.818 INFO:tasks.workunit.client.0.smithi052.stdout:3/372: creat d0/d11/d12/d4c/d53/d64/f6f x:0 0 0 2024-09-06T14:44:42.818 INFO:tasks.workunit.client.0.smithi052.stdout:5/238: rename d2/d1a/d22/f4f to d2/d20/d42/f52 0 2024-09-06T14:44:42.820 INFO:tasks.workunit.client.0.smithi052.stdout:2/331: creat da/d19/d5a/d5f/f75 x:0 0 0 2024-09-06T14:44:42.822 INFO:tasks.workunit.client.0.smithi052.stdout:0/333: creat d0/d2e/f70 x:0 0 0 2024-09-06T14:44:42.822 INFO:tasks.workunit.client.0.smithi052.stdout:5/239: write d2/d20/f23 [2852936,103525] 0 2024-09-06T14:44:42.824 INFO:tasks.workunit.client.0.smithi052.stdout:1/339: mkdir d1/db/d72 0 2024-09-06T14:44:42.826 INFO:tasks.workunit.client.0.smithi052.stdout:4/282: creat d9/f69 x:0 0 0 2024-09-06T14:44:42.829 INFO:tasks.workunit.client.0.smithi052.stdout:7/269: dread d11/d1c/d24/f38 [0,4194304] 0 2024-09-06T14:44:42.829 INFO:tasks.workunit.client.0.smithi052.stdout:1/340: chown d1/db/d18/d5c/c61 140517 1 2024-09-06T14:44:42.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/373: dwrite d0/d11/d12/d17/f48 [0,4194304] 0 2024-09-06T14:44:42.833 INFO:tasks.workunit.client.0.smithi052.stdout:6/177: dread d2/fc [0,4194304] 0 2024-09-06T14:44:42.834 INFO:tasks.workunit.client.0.smithi052.stdout:4/283: write d9/d2d/f63 [440665,40932] 0 2024-09-06T14:44:42.834 INFO:tasks.workunit.client.0.smithi052.stdout:1/341: truncate d1/d5f/f65 298839 0 2024-09-06T14:44:42.835 INFO:tasks.workunit.client.1.smithi165.stdout:7/940: dwrite d20/d33/fd5 [0,4194304] 0 2024-09-06T14:44:42.835 INFO:tasks.workunit.client.0.smithi052.stdout:8/357: rename d6/d22/d36/l58 to d6/d9/d6d/l75 0 2024-09-06T14:44:42.836 INFO:tasks.workunit.client.0.smithi052.stdout:0/334: mknod d0/c71 0 2024-09-06T14:44:42.836 INFO:tasks.workunit.client.1.smithi165.stdout:7/941: write d20/d3b/d8c/f115 [810069,28983] 0 2024-09-06T14:44:42.840 INFO:tasks.workunit.client.0.smithi052.stdout:7/270: mkdir d11/d1c/d24/d5a 0 2024-09-06T14:44:42.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/374: dread d0/d11/d12/d17/f48 [0,4194304] 0 2024-09-06T14:44:42.843 INFO:tasks.workunit.client.1.smithi165.stdout:7/942: dread - d20/d3b/d69/d88/d80/d81/fa6 zero size 2024-09-06T14:44:42.848 INFO:tasks.workunit.client.0.smithi052.stdout:4/284: chown d9/d10/d19/f29 1 1 2024-09-06T14:44:42.849 INFO:tasks.workunit.client.0.smithi052.stdout:2/332: truncate da/d19/d3a/f3f 3389846 0 2024-09-06T14:44:42.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/285: write d9/f65 [81940,21072] 0 2024-09-06T14:44:42.850 INFO:tasks.workunit.client.1.smithi165.stdout:7/943: mknod d20/d33/d6a/d9a/d131/c134 0 2024-09-06T14:44:42.851 INFO:tasks.workunit.client.0.smithi052.stdout:3/375: dwrite d0/d11/f40 [0,4194304] 0 2024-09-06T14:44:42.851 INFO:tasks.workunit.client.0.smithi052.stdout:2/333: fsync da/d19/d3a/f63 0 2024-09-06T14:44:42.851 INFO:tasks.workunit.client.0.smithi052.stdout:8/358: mkdir d6/d4c/d76 0 2024-09-06T14:44:42.853 INFO:tasks.workunit.client.0.smithi052.stdout:5/240: truncate d2/d1a/f3d 4031929 0 2024-09-06T14:44:42.856 INFO:tasks.workunit.client.0.smithi052.stdout:3/376: write d0/d11/d12/d4c/d53/d35/d46/f5e [775082,39370] 0 2024-09-06T14:44:42.856 INFO:tasks.workunit.client.0.smithi052.stdout:6/178: write d2/dd/d18/d25/f2c [1280597,93202] 0 2024-09-06T14:44:42.859 INFO:tasks.workunit.client.1.smithi165.stdout:7/944: unlink d20/d33/d53/df4/c11a 0 2024-09-06T14:44:42.860 INFO:tasks.workunit.client.0.smithi052.stdout:0/335: creat d0/d19/f72 x:0 0 0 2024-09-06T14:44:42.865 INFO:tasks.workunit.client.0.smithi052.stdout:8/359: dwrite d6/d4c/f66 [0,4194304] 0 2024-09-06T14:44:42.865 INFO:tasks.workunit.client.1.smithi165.stdout:7/945: mkdir d20/d33/d53/d66/d135 0 2024-09-06T14:44:42.866 INFO:tasks.workunit.client.0.smithi052.stdout:4/286: rmdir d9 39 2024-09-06T14:44:42.866 INFO:tasks.workunit.client.0.smithi052.stdout:0/336: write d0/d1a/d26/d3a/d14/d2d/f33 [3136490,24618] 0 2024-09-06T14:44:42.870 INFO:tasks.workunit.client.0.smithi052.stdout:2/334: rename da/db/d4c to da/d19/d3a/d31/d76 0 2024-09-06T14:44:42.872 INFO:tasks.workunit.client.1.smithi165.stdout:7/946: rename d20/d65/d82/def/d121 to d20/d3b/d69/d136 0 2024-09-06T14:44:42.873 INFO:tasks.workunit.client.0.smithi052.stdout:5/241: dread d2/d20/f31 [0,4194304] 0 2024-09-06T14:44:42.873 INFO:tasks.workunit.client.1.smithi165.stdout:7/947: dread - d20/d33/d53/d66/ff8 zero size 2024-09-06T14:44:42.878 INFO:tasks.workunit.client.1.smithi165.stdout:7/948: fsync d20/d65/f2d 0 2024-09-06T14:44:42.878 INFO:tasks.workunit.client.0.smithi052.stdout:6/179: dread d2/dd/d18/d25/f2c [4194304,4194304] 0 2024-09-06T14:44:42.879 INFO:tasks.workunit.client.1.smithi165.stdout:7/949: write d20/d4d/ddd/fa9 [84084,23107] 0 2024-09-06T14:44:42.879 INFO:tasks.workunit.client.0.smithi052.stdout:1/342: creat d1/da/f73 x:0 0 0 2024-09-06T14:44:42.881 INFO:tasks.workunit.client.0.smithi052.stdout:8/360: creat d6/d9/d6d/f77 x:0 0 0 2024-09-06T14:44:42.882 INFO:tasks.workunit.client.1.smithi165.stdout:7/950: symlink d20/d4d/ddd/l137 0 2024-09-06T14:44:42.883 INFO:tasks.workunit.client.0.smithi052.stdout:0/337: creat d0/d1a/d26/d3a/d14/d2d/d56/f73 x:0 0 0 2024-09-06T14:44:42.884 INFO:tasks.workunit.client.0.smithi052.stdout:2/335: rename da/f72 to da/d2d/d34/d66/f77 0 2024-09-06T14:44:42.887 INFO:tasks.workunit.client.1.smithi165.stdout:7/951: unlink d20/d4d/d54/dc1/l106 0 2024-09-06T14:44:42.887 INFO:tasks.workunit.client.1.smithi165.stdout:7/952: write d20/d33/fd5 [48794,126896] 0 2024-09-06T14:44:42.891 INFO:tasks.workunit.client.1.smithi165.stdout:7/953: fsync d20/d4d/d112/f118 0 2024-09-06T14:44:42.892 INFO:tasks.workunit.client.0.smithi052.stdout:5/242: dwrite d2/d1a/f3a [0,4194304] 0 2024-09-06T14:44:42.894 INFO:tasks.workunit.client.0.smithi052.stdout:6/180: creat d2/dd/d18/d33/f37 x:0 0 0 2024-09-06T14:44:42.895 INFO:tasks.workunit.client.0.smithi052.stdout:6/181: fsync d2/dd/d18/d2d/d32/f35 0 2024-09-06T14:44:42.898 INFO:tasks.workunit.client.0.smithi052.stdout:4/287: unlink d9/d2d/d33/f4b 0 2024-09-06T14:44:42.902 INFO:tasks.workunit.client.1.smithi165.stdout:7/954: symlink d20/l138 0 2024-09-06T14:44:42.904 INFO:tasks.workunit.client.0.smithi052.stdout:1/343: rename d1/da to d1/db/de/d74 0 2024-09-06T14:44:42.906 INFO:tasks.workunit.client.0.smithi052.stdout:4/288: dwrite d9/d10/d17/f51 [0,4194304] 0 2024-09-06T14:44:42.908 INFO:tasks.workunit.client.0.smithi052.stdout:8/361: dwrite d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:42.911 INFO:tasks.workunit.client.0.smithi052.stdout:8/362: dread d6/d9/d1f/d19/f2d [0,4194304] 0 2024-09-06T14:44:42.911 INFO:tasks.workunit.client.0.smithi052.stdout:7/271: link d11/c3d d11/d1c/d24/c5b 0 2024-09-06T14:44:42.912 INFO:tasks.workunit.client.0.smithi052.stdout:5/243: mkdir d2/d20/d42/d53 0 2024-09-06T14:44:42.913 INFO:tasks.workunit.client.0.smithi052.stdout:7/272: rename d11/d1c/d57 to d11/d1c/d57/d5c 22 2024-09-06T14:44:42.917 INFO:tasks.workunit.client.1.smithi165.stdout:7/955: rename d20/f21 to d20/d65/f139 0 2024-09-06T14:44:42.918 INFO:tasks.workunit.client.0.smithi052.stdout:3/377: dwrite d0/d11/d15/d19/f2f [0,4194304] 0 2024-09-06T14:44:42.919 INFO:tasks.workunit.client.0.smithi052.stdout:2/336: mknod da/d64/c78 0 2024-09-06T14:44:42.922 INFO:tasks.workunit.client.0.smithi052.stdout:1/344: write d1/db/de/d74/d12/f34 [3256657,107106] 0 2024-09-06T14:44:42.925 INFO:tasks.workunit.client.0.smithi052.stdout:8/363: dwrite d6/d9/df/f57 [0,4194304] 0 2024-09-06T14:44:42.933 INFO:tasks.workunit.client.0.smithi052.stdout:3/378: rmdir d0 39 2024-09-06T14:44:42.934 INFO:tasks.workunit.client.1.smithi165.stdout:7/956: link d20/d65/d82/lae d20/d40/l13a 0 2024-09-06T14:44:42.935 INFO:tasks.workunit.client.0.smithi052.stdout:4/289: link d9/d10/d17/d39/d3a/f5b d9/d2d/d33/f6a 0 2024-09-06T14:44:42.936 INFO:tasks.workunit.client.0.smithi052.stdout:1/345: symlink d1/db/de/d74/d14/d2e/l75 0 2024-09-06T14:44:42.939 INFO:tasks.workunit.client.1.smithi165.stdout:7/957: rename d20/d33/d6a/l91 to d20/d3b/d69/d136/l13b 0 2024-09-06T14:44:42.939 INFO:tasks.workunit.client.0.smithi052.stdout:6/182: link d2/dd/d18/f2b d2/dd/d18/d2d/f38 0 2024-09-06T14:44:42.940 INFO:tasks.workunit.client.0.smithi052.stdout:7/273: mkdir d11/d1c/d3f/d5d 0 2024-09-06T14:44:42.942 INFO:tasks.workunit.client.1.smithi165.stdout:7/958: creat d20/d4d/dd4/f13c x:0 0 0 2024-09-06T14:44:42.943 INFO:tasks.workunit.client.1.smithi165.stdout:7/959: truncate d20/d33/feb 404478 0 2024-09-06T14:44:42.943 INFO:tasks.workunit.client.0.smithi052.stdout:4/290: creat d9/d10/f6b x:0 0 0 2024-09-06T14:44:42.944 INFO:tasks.workunit.client.0.smithi052.stdout:1/346: mkdir d1/db/d76 0 2024-09-06T14:44:42.944 INFO:tasks.workunit.client.0.smithi052.stdout:8/364: dwrite d6/d9/d1f/d19/f2d [0,4194304] 0 2024-09-06T14:44:42.945 INFO:tasks.workunit.client.0.smithi052.stdout:7/274: creat d11/d1c/d24/d3b/f5e x:0 0 0 2024-09-06T14:44:42.947 INFO:tasks.workunit.client.0.smithi052.stdout:3/379: unlink d0/d11/d12/d4c/d53/f37 0 2024-09-06T14:44:42.948 INFO:tasks.workunit.client.0.smithi052.stdout:8/365: write d6/d16/f6b [669515,102285] 0 2024-09-06T14:44:42.948 INFO:tasks.workunit.client.0.smithi052.stdout:7/275: write d11/f2c [739309,24181] 0 2024-09-06T14:44:42.948 INFO:tasks.workunit.client.0.smithi052.stdout:1/347: chown d1/db/de/d74/d3e/d47/d4a/c55 12 1 2024-09-06T14:44:42.951 INFO:tasks.workunit.client.0.smithi052.stdout:4/291: mknod d9/c6c 0 2024-09-06T14:44:42.951 INFO:tasks.workunit.client.0.smithi052.stdout:6/183: dread d2/dd/d18/d25/f2c [4194304,4194304] 0 2024-09-06T14:44:42.954 INFO:tasks.workunit.client.0.smithi052.stdout:7/276: creat d11/d1c/d3f/f5f x:0 0 0 2024-09-06T14:44:42.956 INFO:tasks.workunit.client.0.smithi052.stdout:8/366: symlink d6/d9/d1f/l78 0 2024-09-06T14:44:42.957 INFO:tasks.workunit.client.0.smithi052.stdout:4/292: rmdir d9/d2d/d33 39 2024-09-06T14:44:42.959 INFO:tasks.workunit.client.0.smithi052.stdout:8/367: write d6/d22/d31/f55 [7276763,129881] 0 2024-09-06T14:44:42.960 INFO:tasks.workunit.client.0.smithi052.stdout:7/277: creat d11/d1c/d26/f60 x:0 0 0 2024-09-06T14:44:42.962 INFO:tasks.workunit.client.0.smithi052.stdout:5/244: dread d2/d20/f28 [4194304,4194304] 0 2024-09-06T14:44:42.962 INFO:tasks.workunit.client.0.smithi052.stdout:3/380: rename d0/d11/d15/d1b/f5f to d0/d11/d12/d4c/d53/d35/f70 0 2024-09-06T14:44:42.965 INFO:tasks.workunit.client.0.smithi052.stdout:5/245: fsync d2/f11 0 2024-09-06T14:44:42.965 INFO:tasks.workunit.client.0.smithi052.stdout:2/337: dwrite da/d19/f2c [0,4194304] 0 2024-09-06T14:44:42.968 INFO:tasks.workunit.client.0.smithi052.stdout:3/381: chown d0/d11/d12/d4c/d53/f3e 124 1 2024-09-06T14:44:42.968 INFO:tasks.workunit.client.0.smithi052.stdout:7/278: truncate d11/d1c/d3f/f5f 774630 0 2024-09-06T14:44:42.971 INFO:tasks.workunit.client.0.smithi052.stdout:2/338: chown da/d19/d3a/d31/d76/d6a/l6e 20600 1 2024-09-06T14:44:42.971 INFO:tasks.workunit.client.0.smithi052.stdout:1/348: dwrite d1/db/de/d74/d12/f70 [0,4194304] 0 2024-09-06T14:44:42.975 INFO:tasks.workunit.client.0.smithi052.stdout:3/382: mkdir d0/d11/d71 0 2024-09-06T14:44:42.978 INFO:tasks.workunit.client.0.smithi052.stdout:7/279: mknod d11/d1c/d24/d4b/c61 0 2024-09-06T14:44:42.981 INFO:tasks.workunit.client.0.smithi052.stdout:5/246: dwrite d2/f18 [4194304,4194304] 0 2024-09-06T14:44:42.983 INFO:tasks.workunit.client.0.smithi052.stdout:6/184: rename d2/dd/d18/d33/f37 to d2/f39 0 2024-09-06T14:44:42.985 INFO:tasks.workunit.client.0.smithi052.stdout:4/293: rename d9/d2d to d9/d2d/d33/d4d/d6d 22 2024-09-06T14:44:42.986 INFO:tasks.workunit.client.0.smithi052.stdout:8/368: mkdir d6/d22/d36/d3e/d79 0 2024-09-06T14:44:42.986 INFO:tasks.workunit.client.0.smithi052.stdout:5/247: read d2/d1a/f3a [1207650,101777] 0 2024-09-06T14:44:42.990 INFO:tasks.workunit.client.0.smithi052.stdout:3/383: dwrite d0/d11/d12/d4c/d53/d64/f6f [0,4194304] 0 2024-09-06T14:44:42.993 INFO:tasks.workunit.client.0.smithi052.stdout:1/349: dread d1/db/de/d74/d12/f34 [0,4194304] 0 2024-09-06T14:44:42.994 INFO:tasks.workunit.client.0.smithi052.stdout:2/339: unlink f0 0 2024-09-06T14:44:42.996 INFO:tasks.workunit.client.0.smithi052.stdout:2/340: write da/d19/d3a/d31/d76/f4d [1301634,4223] 0 2024-09-06T14:44:43.001 INFO:tasks.workunit.client.0.smithi052.stdout:7/280: rename c8 to d11/d1c/d3f/c62 0 2024-09-06T14:44:43.002 INFO:tasks.workunit.client.0.smithi052.stdout:7/281: chown d11/d1c/d24/d3b 351484 1 2024-09-06T14:44:43.003 INFO:tasks.workunit.client.0.smithi052.stdout:7/282: truncate d11/d1c/d24/f41 343436 0 2024-09-06T14:44:43.004 INFO:tasks.workunit.client.0.smithi052.stdout:4/294: unlink d9/d10/c60 0 2024-09-06T14:44:43.008 INFO:tasks.workunit.client.0.smithi052.stdout:3/384: creat d0/d11/d12/d17/f72 x:0 0 0 2024-09-06T14:44:43.009 INFO:tasks.workunit.client.0.smithi052.stdout:1/350: creat d1/db/de/d74/d3e/d47/d4a/f77 x:0 0 0 2024-09-06T14:44:43.011 INFO:tasks.workunit.client.0.smithi052.stdout:5/248: mknod d2/c54 0 2024-09-06T14:44:43.012 INFO:tasks.workunit.client.0.smithi052.stdout:3/385: write d0/d11/d12/d4c/f57 [321139,128262] 0 2024-09-06T14:44:43.013 INFO:tasks.workunit.client.0.smithi052.stdout:8/369: link d6/d22/d36/d3e/d47/d56/d68/f6c d6/d9/d6d/f7a 0 2024-09-06T14:44:43.013 INFO:tasks.workunit.client.0.smithi052.stdout:4/295: dwrite d9/d2d/f67 [0,4194304] 0 2024-09-06T14:44:43.017 INFO:tasks.workunit.client.0.smithi052.stdout:3/386: stat d0/d11/d15/d19/l3c 0 2024-09-06T14:44:43.018 INFO:tasks.workunit.client.0.smithi052.stdout:6/185: dwrite d2/dd/d18/f22 [0,4194304] 0 2024-09-06T14:44:43.018 INFO:tasks.workunit.client.0.smithi052.stdout:2/341: creat da/d2d/d34/d62/f79 x:0 0 0 2024-09-06T14:44:43.019 INFO:tasks.workunit.client.0.smithi052.stdout:4/296: readlink d9/l53 0 2024-09-06T14:44:43.021 INFO:tasks.workunit.client.0.smithi052.stdout:5/249: dread d2/d20/f31 [0,4194304] 0 2024-09-06T14:44:43.021 INFO:tasks.workunit.client.0.smithi052.stdout:8/370: symlink d6/d22/d36/l7b 0 2024-09-06T14:44:43.022 INFO:tasks.workunit.client.0.smithi052.stdout:7/283: getdents d11/d1c/d24/d3b 0 2024-09-06T14:44:43.022 INFO:tasks.workunit.client.0.smithi052.stdout:6/186: truncate d2/dd/d18/d25/f26 970441 0 2024-09-06T14:44:43.023 INFO:tasks.workunit.client.0.smithi052.stdout:3/387: mkdir d0/d11/d12/d73 0 2024-09-06T14:44:43.048 INFO:tasks.workunit.client.0.smithi052.stdout:4/297: unlink d9/d2d/c3b 0 2024-09-06T14:44:43.048 INFO:tasks.workunit.client.0.smithi052.stdout:4/298: write f7 [3303672,14034] 0 2024-09-06T14:44:43.049 INFO:tasks.workunit.client.0.smithi052.stdout:1/351: creat d1/db/de/d74/f78 x:0 0 0 2024-09-06T14:44:43.050 INFO:tasks.workunit.client.0.smithi052.stdout:1/352: stat d1/db/de/d74/d12 0 2024-09-06T14:44:43.051 INFO:tasks.workunit.client.0.smithi052.stdout:1/353: chown d1/db/de/d74/d36 616827 1 2024-09-06T14:44:43.051 INFO:tasks.workunit.client.0.smithi052.stdout:2/342: mkdir da/d19/d3a/d31/d7a 0 2024-09-06T14:44:43.055 INFO:tasks.workunit.client.0.smithi052.stdout:5/250: rename f1 to d2/d20/d42/d53/f55 0 2024-09-06T14:44:43.055 INFO:tasks.workunit.client.0.smithi052.stdout:2/343: dread da/f2f [0,4194304] 0 2024-09-06T14:44:43.056 INFO:tasks.workunit.client.0.smithi052.stdout:2/344: chown da/d19/f26 968 1 2024-09-06T14:44:43.058 INFO:tasks.workunit.client.0.smithi052.stdout:7/284: creat d11/d1c/d24/d4b/f63 x:0 0 0 2024-09-06T14:44:43.065 INFO:tasks.workunit.client.0.smithi052.stdout:4/299: creat d9/d10/f6e x:0 0 0 2024-09-06T14:44:43.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/285: write d11/d1c/d24/d3b/f5e [671428,41222] 0 2024-09-06T14:44:43.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/251: dwrite d2/d1a/d22/f3e [0,4194304] 0 2024-09-06T14:44:43.069 INFO:tasks.workunit.client.0.smithi052.stdout:4/300: write d9/d10/d19/f48 [814811,49306] 0 2024-09-06T14:44:43.074 INFO:tasks.workunit.client.1.smithi165.stdout:7/960: sync 2024-09-06T14:44:43.075 INFO:tasks.workunit.client.1.smithi165.stdout:7/961: fsync d20/d4d/d54/ded/f116 0 2024-09-06T14:44:43.078 INFO:tasks.workunit.client.0.smithi052.stdout:8/371: truncate d6/d4c/f66 3037626 0 2024-09-06T14:44:43.080 INFO:tasks.workunit.client.0.smithi052.stdout:2/345: mkdir da/d19/d3a/d61/d7b 0 2024-09-06T14:44:43.081 INFO:tasks.workunit.client.0.smithi052.stdout:5/252: fdatasync d2/d20/d42/f52 0 2024-09-06T14:44:43.081 INFO:tasks.workunit.client.0.smithi052.stdout:6/187: dwrite d2/dd/d18/f2b [0,4194304] 0 2024-09-06T14:44:43.082 INFO:tasks.workunit.client.0.smithi052.stdout:2/346: chown da/d19/f26 0 1 2024-09-06T14:44:43.082 INFO:tasks.workunit.client.0.smithi052.stdout:6/188: dread - d2/f39 zero size 2024-09-06T14:44:43.083 INFO:tasks.workunit.client.0.smithi052.stdout:3/388: rename d0/d11/d12/d4c/d53/d35/l36 to d0/d11/l74 0 2024-09-06T14:44:43.085 INFO:tasks.workunit.client.0.smithi052.stdout:1/354: link d1/db/de/c56 d1/db/d76/c79 0 2024-09-06T14:44:43.087 INFO:tasks.workunit.client.0.smithi052.stdout:7/286: unlink d11/c3d 0 2024-09-06T14:44:43.088 INFO:tasks.workunit.client.0.smithi052.stdout:7/287: fsync d11/f14 0 2024-09-06T14:44:43.088 INFO:tasks.workunit.client.0.smithi052.stdout:1/355: truncate d1/db/de/d74/f73 390242 0 2024-09-06T14:44:43.088 INFO:tasks.workunit.client.0.smithi052.stdout:6/189: symlink d2/dd/d18/d2d/l3a 0 2024-09-06T14:44:43.090 INFO:tasks.workunit.client.0.smithi052.stdout:3/389: dread d0/d11/d12/d4c/d53/d64/f6f [0,4194304] 0 2024-09-06T14:44:43.090 INFO:tasks.workunit.client.0.smithi052.stdout:2/347: creat da/d19/d3a/d31/d76/d6a/f7c x:0 0 0 2024-09-06T14:44:43.091 INFO:tasks.workunit.client.0.smithi052.stdout:3/390: dread - d0/d11/d15/d1b/f6b zero size 2024-09-06T14:44:43.093 INFO:tasks.workunit.client.0.smithi052.stdout:7/288: rmdir d11/d1c/d57 39 2024-09-06T14:44:43.099 INFO:tasks.workunit.client.0.smithi052.stdout:3/391: dwrite d0/d11/d15/f55 [0,4194304] 0 2024-09-06T14:44:43.101 INFO:tasks.workunit.client.0.smithi052.stdout:4/301: write d9/d10/d17/f23 [261357,39373] 0 2024-09-06T14:44:43.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/356: mkdir d1/db/d18/d6b/d7a 0 2024-09-06T14:44:43.103 INFO:tasks.workunit.client.1.smithi165.stdout:7/962: dread d20/d4d/d54/dc1/fcf [0,4194304] 0 2024-09-06T14:44:43.104 INFO:tasks.workunit.client.0.smithi052.stdout:4/302: write d9/d10/d17/d39/f58 [740709,51196] 0 2024-09-06T14:44:43.105 INFO:tasks.workunit.client.0.smithi052.stdout:8/372: getdents d6/d9/d1f 0 2024-09-06T14:44:43.107 INFO:tasks.workunit.client.0.smithi052.stdout:4/303: fdatasync d9/d10/f6e 0 2024-09-06T14:44:43.108 INFO:tasks.workunit.client.1.smithi165.stdout:7/963: fsync d20/d3b/f74 0 2024-09-06T14:44:43.108 INFO:tasks.workunit.client.0.smithi052.stdout:4/304: fsync d9/d10/d17/f51 0 2024-09-06T14:44:43.109 INFO:tasks.workunit.client.0.smithi052.stdout:4/305: chown f7 1690784888 1 2024-09-06T14:44:43.110 INFO:tasks.workunit.client.0.smithi052.stdout:6/190: creat d2/f3b x:0 0 0 2024-09-06T14:44:43.112 INFO:tasks.workunit.client.1.smithi165.stdout:7/964: rmdir d20/d4d/d54/ded 39 2024-09-06T14:44:43.113 INFO:tasks.workunit.client.0.smithi052.stdout:5/253: dread d2/f11 [0,4194304] 0 2024-09-06T14:44:43.113 INFO:tasks.workunit.client.0.smithi052.stdout:7/289: write d11/d1c/d24/d4b/f4c [1169917,10512] 0 2024-09-06T14:44:43.113 INFO:tasks.workunit.client.0.smithi052.stdout:2/348: write da/db/d18/f38 [1950108,123763] 0 2024-09-06T14:44:43.113 INFO:tasks.workunit.client.0.smithi052.stdout:3/392: mknod d0/d11/d12/d4c/c75 0 2024-09-06T14:44:43.115 INFO:tasks.workunit.client.1.smithi165.stdout:7/965: dread d20/d4d/d54/fa4 [0,4194304] 0 2024-09-06T14:44:43.116 INFO:tasks.workunit.client.0.smithi052.stdout:8/373: unlink d6/d9/df/d41/c4f 0 2024-09-06T14:44:43.116 INFO:tasks.workunit.client.0.smithi052.stdout:7/290: write d11/d1c/d24/d4b/f4e [164668,93562] 0 2024-09-06T14:44:43.118 INFO:tasks.workunit.client.0.smithi052.stdout:6/191: dread d2/fc [0,4194304] 0 2024-09-06T14:44:43.121 INFO:tasks.workunit.client.0.smithi052.stdout:4/306: mknod d9/d10/c6f 0 2024-09-06T14:44:43.122 INFO:tasks.workunit.client.0.smithi052.stdout:6/192: chown d2/dd/d18/d2d/d32/f35 11 1 2024-09-06T14:44:43.128 INFO:tasks.workunit.client.0.smithi052.stdout:2/349: rename da/db/c48 to da/d2d/d34/c7d 0 2024-09-06T14:44:43.128 INFO:tasks.workunit.client.0.smithi052.stdout:5/254: dwrite d2/d1a/d22/d26/d2b/d48/f4b [0,4194304] 0 2024-09-06T14:44:43.131 INFO:tasks.workunit.client.0.smithi052.stdout:6/193: write d2/fc [110779,62456] 0 2024-09-06T14:44:43.133 INFO:tasks.workunit.client.0.smithi052.stdout:7/291: dwrite d11/d1c/d24/f35 [0,4194304] 0 2024-09-06T14:44:43.135 INFO:tasks.workunit.client.0.smithi052.stdout:7/292: chown d11/d1c/d24/d4b 2461 1 2024-09-06T14:44:43.136 INFO:tasks.workunit.client.0.smithi052.stdout:2/350: creat da/d2d/f7e x:0 0 0 2024-09-06T14:44:43.136 INFO:tasks.workunit.client.0.smithi052.stdout:1/357: truncate d1/db/de/d74/d12/f70 2460241 0 2024-09-06T14:44:43.142 INFO:tasks.workunit.client.0.smithi052.stdout:3/393: write d0/d11/d15/d1b/f32 [1345428,8834] 0 2024-09-06T14:44:43.144 INFO:tasks.workunit.client.0.smithi052.stdout:1/358: creat d1/db/de/d74/d36/f7b x:0 0 0 2024-09-06T14:44:43.144 INFO:tasks.workunit.client.0.smithi052.stdout:3/394: fdatasync d0/d11/d15/f55 0 2024-09-06T14:44:43.145 INFO:tasks.workunit.client.0.smithi052.stdout:7/293: mkdir d11/d1c/d24/d64 0 2024-09-06T14:44:43.147 INFO:tasks.workunit.client.0.smithi052.stdout:8/374: link d6/d22/d36/d3e/d47/d56/d68/c43 d6/d9/df/d41/c7c 0 2024-09-06T14:44:43.149 INFO:tasks.workunit.client.0.smithi052.stdout:5/255: getdents d2/d1a 0 2024-09-06T14:44:43.158 INFO:tasks.workunit.client.0.smithi052.stdout:2/351: dread f9 [0,4194304] 0 2024-09-06T14:44:43.159 INFO:tasks.workunit.client.0.smithi052.stdout:2/352: readlink da/db/d18/l69 0 2024-09-06T14:44:43.161 INFO:tasks.workunit.client.0.smithi052.stdout:7/294: rename d11/d1c/d24/d3b/f5e to d11/d1c/d3f/f65 0 2024-09-06T14:44:43.163 INFO:tasks.workunit.client.0.smithi052.stdout:8/375: link d6/d22/f3a d6/d9/d1f/d14/f7d 0 2024-09-06T14:44:43.165 INFO:tasks.workunit.client.0.smithi052.stdout:6/194: dread d2/fb [0,4194304] 0 2024-09-06T14:44:43.166 INFO:tasks.workunit.client.0.smithi052.stdout:3/395: getdents d0/d11/d12/d17 0 2024-09-06T14:44:43.167 INFO:tasks.workunit.client.0.smithi052.stdout:7/295: dread - d11/d1c/d26/f60 zero size 2024-09-06T14:44:43.168 INFO:tasks.workunit.client.0.smithi052.stdout:8/376: mknod d6/d4c/d76/c7e 0 2024-09-06T14:44:43.172 INFO:tasks.workunit.client.0.smithi052.stdout:1/359: dread d1/db/de/d74/d36/f3c [0,4194304] 0 2024-09-06T14:44:43.172 INFO:tasks.workunit.client.0.smithi052.stdout:8/377: fsync d6/d9/d1f/d14/f29 0 2024-09-06T14:44:43.173 INFO:tasks.workunit.client.0.smithi052.stdout:6/195: mknod d2/dd/d18/d25/c3c 0 2024-09-06T14:44:43.174 INFO:tasks.workunit.client.0.smithi052.stdout:5/256: dwrite d2/d20/f31 [0,4194304] 0 2024-09-06T14:44:43.176 INFO:tasks.workunit.client.0.smithi052.stdout:7/296: symlink d11/d1c/d24/d64/l66 0 2024-09-06T14:44:43.176 INFO:tasks.workunit.client.0.smithi052.stdout:6/196: fdatasync d2/f39 0 2024-09-06T14:44:43.178 INFO:tasks.workunit.client.0.smithi052.stdout:1/360: mkdir d1/db/de/d74/d36/d7c 0 2024-09-06T14:44:43.178 INFO:tasks.workunit.client.0.smithi052.stdout:5/257: mkdir d2/d20/d56 0 2024-09-06T14:44:43.179 INFO:tasks.workunit.client.0.smithi052.stdout:8/378: truncate d6/d9/df/d1b/f30 5078135 0 2024-09-06T14:44:43.179 INFO:tasks.workunit.client.0.smithi052.stdout:1/361: write d1/db/de/d74/d12/f46 [1274371,44617] 0 2024-09-06T14:44:43.181 INFO:tasks.workunit.client.0.smithi052.stdout:5/258: read d2/f13 [1485434,98766] 0 2024-09-06T14:44:43.183 INFO:tasks.workunit.client.1.smithi165.stdout:7/966: sync 2024-09-06T14:44:43.186 INFO:tasks.workunit.client.1.smithi165.stdout:7/967: creat d20/d4d/dd4/f13d x:0 0 0 2024-09-06T14:44:43.187 INFO:tasks.workunit.client.0.smithi052.stdout:3/396: dwrite d0/f3 [0,4194304] 0 2024-09-06T14:44:43.188 INFO:tasks.workunit.client.0.smithi052.stdout:1/362: dread d1/db/f52 [0,4194304] 0 2024-09-06T14:44:43.190 INFO:tasks.workunit.client.0.smithi052.stdout:7/297: link d11/f2c d11/d1c/d26/f67 0 2024-09-06T14:44:43.191 INFO:tasks.workunit.client.0.smithi052.stdout:7/298: stat d11/f14 0 2024-09-06T14:44:43.191 INFO:tasks.workunit.client.1.smithi165.stdout:7/968: symlink d20/d4d/d54/dc1/df9/l13e 0 2024-09-06T14:44:43.192 INFO:tasks.workunit.client.0.smithi052.stdout:7/299: stat d11/f14 0 2024-09-06T14:44:43.194 INFO:tasks.workunit.client.0.smithi052.stdout:8/379: symlink d6/d22/d36/l7f 0 2024-09-06T14:44:43.194 INFO:tasks.workunit.client.1.smithi165.stdout:7/969: mknod d20/d65/d82/d97/c13f 0 2024-09-06T14:44:43.195 INFO:tasks.workunit.client.0.smithi052.stdout:1/363: rmdir d1/db/d76 39 2024-09-06T14:44:43.197 INFO:tasks.workunit.client.0.smithi052.stdout:5/259: symlink d2/l57 0 2024-09-06T14:44:43.197 INFO:tasks.workunit.client.0.smithi052.stdout:7/300: read d11/d1c/d26/f2b [4468630,129203] 0 2024-09-06T14:44:43.197 INFO:tasks.workunit.client.0.smithi052.stdout:8/380: write d6/d16/f2c [3866992,43842] 0 2024-09-06T14:44:43.198 INFO:tasks.workunit.client.0.smithi052.stdout:3/397: dwrite d0/d11/d12/f47 [4194304,4194304] 0 2024-09-06T14:44:43.201 INFO:tasks.workunit.client.0.smithi052.stdout:5/260: write d2/f1d [511511,93992] 0 2024-09-06T14:44:43.202 INFO:tasks.workunit.client.0.smithi052.stdout:6/197: getdents d2/dd/d18/d2d/d32 0 2024-09-06T14:44:43.205 INFO:tasks.workunit.client.0.smithi052.stdout:3/398: write d0/d11/d15/f4e [316504,10402] 0 2024-09-06T14:44:43.207 INFO:tasks.workunit.client.0.smithi052.stdout:7/301: read d11/d1c/d26/f40 [67744,21575] 0 2024-09-06T14:44:43.210 INFO:tasks.workunit.client.0.smithi052.stdout:6/198: creat d2/f3d x:0 0 0 2024-09-06T14:44:43.210 INFO:tasks.workunit.client.0.smithi052.stdout:8/381: dread d6/d9/d6d/f7a [0,4194304] 0 2024-09-06T14:44:43.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/364: dwrite d1/db/f3f [0,4194304] 0 2024-09-06T14:44:43.214 INFO:tasks.workunit.client.0.smithi052.stdout:1/365: readlink d1/db/de/d74/d3e/d47/d4a/l53 0 2024-09-06T14:44:43.215 INFO:tasks.workunit.client.0.smithi052.stdout:3/399: creat d0/d11/d15/d1b/f76 x:0 0 0 2024-09-06T14:44:43.218 INFO:tasks.workunit.client.0.smithi052.stdout:6/199: creat d2/dd/d18/d25/f3e x:0 0 0 2024-09-06T14:44:43.219 INFO:tasks.workunit.client.1.smithi165.stdout:7/970: truncate d20/d33/d6a/d90/f132 3920768 0 2024-09-06T14:44:43.219 INFO:tasks.workunit.client.0.smithi052.stdout:6/200: chown d2/dd/d18 1805 1 2024-09-06T14:44:43.219 INFO:tasks.workunit.client.0.smithi052.stdout:6/201: stat d2/dd/l16 0 2024-09-06T14:44:43.220 INFO:tasks.workunit.client.0.smithi052.stdout:8/382: creat d6/d4c/f80 x:0 0 0 2024-09-06T14:44:43.221 INFO:tasks.workunit.client.0.smithi052.stdout:5/261: link d2/l9 d2/d1a/d22/d26/d2b/l58 0 2024-09-06T14:44:43.222 INFO:tasks.workunit.client.0.smithi052.stdout:1/366: creat d1/d5f/f7d x:0 0 0 2024-09-06T14:44:43.222 INFO:tasks.workunit.client.0.smithi052.stdout:5/262: rename d2/d20/d42 to d2/d20/d42/d53/d59 22 2024-09-06T14:44:43.225 INFO:tasks.workunit.client.0.smithi052.stdout:8/383: dread d6/d22/d36/d3e/d47/d56/d68/f6c [0,4194304] 0 2024-09-06T14:44:43.227 INFO:tasks.workunit.client.0.smithi052.stdout:5/263: dread d2/d1a/d22/f3e [0,4194304] 0 2024-09-06T14:44:43.227 INFO:tasks.workunit.client.0.smithi052.stdout:1/367: dread d1/db/de/d74/d12/f46 [0,4194304] 0 2024-09-06T14:44:43.231 INFO:tasks.workunit.client.0.smithi052.stdout:5/264: dwrite d2/ff [0,4194304] 0 2024-09-06T14:44:43.244 INFO:tasks.workunit.client.0.smithi052.stdout:7/302: creat d11/d1c/d3f/d5d/f68 x:0 0 0 2024-09-06T14:44:43.251 INFO:tasks.workunit.client.0.smithi052.stdout:1/368: rename d1/db/de/d74/d36/f5d to d1/db/de/d74/d36/f7e 0 2024-09-06T14:44:43.252 INFO:tasks.workunit.client.0.smithi052.stdout:1/369: write d1/db/de/d68/f6a [17150,3100] 0 2024-09-06T14:44:43.253 INFO:tasks.workunit.client.0.smithi052.stdout:5/265: mknod d2/d1a/d22/d26/d2b/d48/c5a 0 2024-09-06T14:44:43.253 INFO:tasks.workunit.client.0.smithi052.stdout:1/370: dread - d1/db/de/d74/d3e/d47/f6e zero size 2024-09-06T14:44:43.254 INFO:tasks.workunit.client.0.smithi052.stdout:3/400: symlink d0/d11/d12/l77 0 2024-09-06T14:44:43.254 INFO:tasks.workunit.client.0.smithi052.stdout:1/371: chown d1/db/l20 537594121 1 2024-09-06T14:44:43.257 INFO:tasks.workunit.client.0.smithi052.stdout:7/303: fsync d11/d1c/d26/f67 0 2024-09-06T14:44:43.257 INFO:tasks.workunit.client.1.smithi165.stdout:7/971: dwrite d20/d33/d6a/d90/fc8 [0,4194304] 0 2024-09-06T14:44:43.261 INFO:tasks.workunit.client.0.smithi052.stdout:7/304: truncate d11/d1c/d26/f60 695154 0 2024-09-06T14:44:43.262 INFO:tasks.workunit.client.0.smithi052.stdout:5/266: dwrite d2/d20/d42/f52 [0,4194304] 0 2024-09-06T14:44:43.262 INFO:tasks.workunit.client.0.smithi052.stdout:8/384: creat d6/d9/df/d41/d71/f81 x:0 0 0 2024-09-06T14:44:43.264 INFO:tasks.workunit.client.0.smithi052.stdout:8/385: write d6/d9/d1f/d14/f53 [563472,114502] 0 2024-09-06T14:44:43.267 INFO:tasks.workunit.client.0.smithi052.stdout:3/401: chown d0/d11/d12/d4c/d53/d35/f22 87945993 1 2024-09-06T14:44:43.269 INFO:tasks.workunit.client.0.smithi052.stdout:6/202: truncate d2/dd/f2f 33241 0 2024-09-06T14:44:43.269 INFO:tasks.workunit.client.0.smithi052.stdout:1/372: symlink d1/db/d76/l7f 0 2024-09-06T14:44:43.271 INFO:tasks.workunit.client.0.smithi052.stdout:6/203: readlink d2/la 0 2024-09-06T14:44:43.273 INFO:tasks.workunit.client.1.smithi165.stdout:7/972: write d20/d40/f87 [1114998,127540] 0 2024-09-06T14:44:43.276 INFO:tasks.workunit.client.0.smithi052.stdout:1/373: creat d1/db/de/d74/d14/d2e/f80 x:0 0 0 2024-09-06T14:44:43.278 INFO:tasks.workunit.client.0.smithi052.stdout:6/204: dwrite d2/dd/d18/f2b [0,4194304] 0 2024-09-06T14:44:43.282 INFO:tasks.workunit.client.0.smithi052.stdout:7/305: unlink d11/d1c/l2f 0 2024-09-06T14:44:43.284 INFO:tasks.workunit.client.0.smithi052.stdout:8/386: mknod d6/d22/d31/d5b/c82 0 2024-09-06T14:44:43.285 INFO:tasks.workunit.client.0.smithi052.stdout:6/205: creat d2/dd/d18/d2d/d32/f3f x:0 0 0 2024-09-06T14:44:43.287 INFO:tasks.workunit.client.1.smithi165.stdout:7/973: getdents d20/d3b/d69/d88/d80/d81/de1 0 2024-09-06T14:44:43.288 INFO:tasks.workunit.client.0.smithi052.stdout:1/374: truncate d1/db/de/d74/f32 1813878 0 2024-09-06T14:44:43.289 INFO:tasks.workunit.client.0.smithi052.stdout:5/267: rmdir d2/d1a/d22/d26/d2b/d37/d4c 0 2024-09-06T14:44:43.291 INFO:tasks.workunit.client.0.smithi052.stdout:7/306: creat d11/d1c/d3f/d5d/f69 x:0 0 0 2024-09-06T14:44:43.292 INFO:tasks.workunit.client.0.smithi052.stdout:8/387: dwrite d6/d9/d1f/d14/f53 [0,4194304] 0 2024-09-06T14:44:43.292 INFO:tasks.workunit.client.1.smithi165.stdout:7/974: dread d20/d3b/d69/d88/d80/d81/f95 [0,4194304] 0 2024-09-06T14:44:43.294 INFO:tasks.workunit.client.0.smithi052.stdout:6/206: creat d2/dd/d18/d2d/d32/f40 x:0 0 0 2024-09-06T14:44:43.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/388: truncate d6/d9/d1f/d14/f7d 1066131 0 2024-09-06T14:44:43.295 INFO:tasks.workunit.client.0.smithi052.stdout:5/268: truncate d2/d20/f28 2527728 0 2024-09-06T14:44:43.298 INFO:tasks.workunit.client.0.smithi052.stdout:8/389: write d6/d9/d6d/f77 [644185,98645] 0 2024-09-06T14:44:43.298 INFO:tasks.workunit.client.0.smithi052.stdout:5/269: write d2/d1a/f2d [704285,122602] 0 2024-09-06T14:44:43.299 INFO:tasks.workunit.client.0.smithi052.stdout:6/207: symlink d2/dd/d18/d25/l41 0 2024-09-06T14:44:43.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/390: dread - d6/d4c/f65 zero size 2024-09-06T14:44:43.299 INFO:tasks.workunit.client.0.smithi052.stdout:5/270: chown d2/l1e 3 1 2024-09-06T14:44:43.300 INFO:tasks.workunit.client.0.smithi052.stdout:7/307: rename d11/d1c/f34 to d11/d1c/d24/d4b/f6a 0 2024-09-06T14:44:43.301 INFO:tasks.workunit.client.0.smithi052.stdout:5/271: chown d2/d20/d42 11 1 2024-09-06T14:44:43.301 INFO:tasks.workunit.client.0.smithi052.stdout:6/208: dread - d2/f3b zero size 2024-09-06T14:44:43.303 INFO:tasks.workunit.client.0.smithi052.stdout:8/391: creat d6/d3c/f83 x:0 0 0 2024-09-06T14:44:43.303 INFO:tasks.workunit.client.0.smithi052.stdout:7/308: rmdir d11/d1c 39 2024-09-06T14:44:43.304 INFO:tasks.workunit.client.0.smithi052.stdout:6/209: symlink d2/dd/d18/l42 0 2024-09-06T14:44:43.306 INFO:tasks.workunit.client.0.smithi052.stdout:6/210: write d2/dd/f21 [4519227,128530] 0 2024-09-06T14:44:43.308 INFO:tasks.workunit.client.0.smithi052.stdout:6/211: write d2/fc [2841805,54697] 0 2024-09-06T14:44:43.312 INFO:tasks.workunit.client.1.smithi165.stdout:7/975: dread d20/f2b [0,4194304] 0 2024-09-06T14:44:43.315 INFO:tasks.workunit.client.0.smithi052.stdout:7/309: dwrite d11/d1c/d24/d4b/f4c [0,4194304] 0 2024-09-06T14:44:43.316 INFO:tasks.workunit.client.0.smithi052.stdout:6/212: rename d2/dd/d18/d2d/l3a to d2/dd/d18/l43 0 2024-09-06T14:44:43.321 INFO:tasks.workunit.client.0.smithi052.stdout:6/213: mkdir d2/dd/d18/d33/d44 0 2024-09-06T14:44:43.322 INFO:tasks.workunit.client.0.smithi052.stdout:7/310: symlink d11/d1c/d57/l6b 0 2024-09-06T14:44:43.325 INFO:tasks.workunit.client.0.smithi052.stdout:5/272: truncate d2/d1a/f3a 3521921 0 2024-09-06T14:44:43.329 INFO:tasks.workunit.client.0.smithi052.stdout:7/311: link d11/c1b d11/d1c/d57/c6c 0 2024-09-06T14:44:43.332 INFO:tasks.workunit.client.0.smithi052.stdout:6/214: dwrite d2/dd/d18/d25/f3e [0,4194304] 0 2024-09-06T14:44:43.337 INFO:tasks.workunit.client.0.smithi052.stdout:1/375: dwrite d1/db/de/d74/f32 [0,4194304] 0 2024-09-06T14:44:43.338 INFO:tasks.workunit.client.0.smithi052.stdout:6/215: fdatasync d2/dd/d18/d25/f2c 0 2024-09-06T14:44:43.339 INFO:tasks.workunit.client.0.smithi052.stdout:8/392: dwrite d6/d4c/f66 [0,4194304] 0 2024-09-06T14:44:43.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/273: rename d2/d1a/d22/d26/d2b/d37/c3f to d2/c5b 0 2024-09-06T14:44:43.344 INFO:tasks.workunit.client.0.smithi052.stdout:1/376: mkdir d1/db/d72/d81 0 2024-09-06T14:44:43.344 INFO:tasks.workunit.client.0.smithi052.stdout:1/377: chown d1/db 19111 1 2024-09-06T14:44:43.347 INFO:tasks.workunit.client.0.smithi052.stdout:6/216: getdents d2/dd/d18/d33/d44 0 2024-09-06T14:44:43.347 INFO:tasks.workunit.client.0.smithi052.stdout:5/274: write d2/d1a/d22/d26/d2b/d37/f44 [4026564,105108] 0 2024-09-06T14:44:43.348 INFO:tasks.workunit.client.0.smithi052.stdout:1/378: creat d1/db/d18/f82 x:0 0 0 2024-09-06T14:44:43.349 INFO:tasks.workunit.client.0.smithi052.stdout:6/217: chown d2/dd/d18/d33/d44 3208 1 2024-09-06T14:44:43.352 INFO:tasks.workunit.client.0.smithi052.stdout:5/275: unlink d2/d1a/d22/d26/d2b/d37/c39 0 2024-09-06T14:44:43.383 INFO:tasks.workunit.client.1.smithi165.stdout:7/976: sync 2024-09-06T14:44:43.411 INFO:tasks.workunit.client.1.smithi165.stdout:7/977: link d20/d33/d6a/d90/ce9 d20/d33/d53/df4/c140 0 2024-09-06T14:44:43.413 INFO:tasks.workunit.client.0.smithi052.stdout:1/379: read d1/db/de/d74/d12/f1e [134771,59951] 0 2024-09-06T14:44:43.416 INFO:tasks.workunit.client.0.smithi052.stdout:6/218: dwrite d2/f3d [0,4194304] 0 2024-09-06T14:44:43.416 INFO:tasks.workunit.client.0.smithi052.stdout:8/393: dread d6/d16/f2c [0,4194304] 0 2024-09-06T14:44:43.417 INFO:tasks.workunit.client.0.smithi052.stdout:8/394: chown d6/d22/c62 16 1 2024-09-06T14:44:43.417 INFO:tasks.workunit.client.0.smithi052.stdout:5/276: dread d2/ff [0,4194304] 0 2024-09-06T14:44:43.429 INFO:tasks.workunit.client.0.smithi052.stdout:8/395: mknod d6/d22/d36/d3e/d47/d56/c84 0 2024-09-06T14:44:43.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/380: dwrite d1/db/de/d74/d12/f63 [0,4194304] 0 2024-09-06T14:44:43.431 INFO:tasks.workunit.client.0.smithi052.stdout:5/277: mknod d2/d1a/d22/d26/d2b/d37/c5c 0 2024-09-06T14:44:43.433 INFO:tasks.workunit.client.0.smithi052.stdout:6/219: dwrite d2/f30 [0,4194304] 0 2024-09-06T14:44:43.433 INFO:tasks.workunit.client.0.smithi052.stdout:8/396: symlink d6/d22/d36/d3e/l85 0 2024-09-06T14:44:43.435 INFO:tasks.workunit.client.0.smithi052.stdout:8/397: readlink d6/d9/d1f/l78 0 2024-09-06T14:44:43.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/278: dwrite d2/d1a/d22/f3e [0,4194304] 0 2024-09-06T14:44:43.447 INFO:tasks.workunit.client.0.smithi052.stdout:8/398: rename d6/d9/d1f/d14/f7d to d6/d9/d1f/d19/d6f/d72/f86 0 2024-09-06T14:44:43.447 INFO:tasks.workunit.client.0.smithi052.stdout:1/381: link d1/db/d18/l54 d1/db/de/d68/l83 0 2024-09-06T14:44:43.449 INFO:tasks.workunit.client.0.smithi052.stdout:5/279: mknod d2/d1a/d22/d26/c5d 0 2024-09-06T14:44:43.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/382: rmdir d1/db/d18/d6b/d7a 0 2024-09-06T14:44:43.456 INFO:tasks.workunit.client.0.smithi052.stdout:8/399: dread d6/f59 [0,4194304] 0 2024-09-06T14:44:43.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/400: write d6/d9/df/d41/d71/f81 [976497,7633] 0 2024-09-06T14:44:43.459 INFO:tasks.workunit.client.0.smithi052.stdout:1/383: link d1/db/de/d74/d36/f7b d1/db/de/d74/d14/d2e/f84 0 2024-09-06T14:44:43.463 INFO:tasks.workunit.client.0.smithi052.stdout:1/384: symlink d1/db/l85 0 2024-09-06T14:44:43.464 INFO:tasks.workunit.client.0.smithi052.stdout:8/401: dwrite d6/f5f [0,4194304] 0 2024-09-06T14:44:43.464 INFO:tasks.workunit.client.0.smithi052.stdout:1/385: chown d1/db/de/d74/l2d 3538795 1 2024-09-06T14:44:43.465 INFO:tasks.workunit.client.0.smithi052.stdout:1/386: chown d1/db/de/d74/l6d 541 1 2024-09-06T14:44:43.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/402: mkdir d6/d9/df/d1b/d87 0 2024-09-06T14:44:43.469 INFO:tasks.workunit.client.1.smithi165.stdout:7/978: dwrite d20/d3b/f86 [4194304,4194304] 0 2024-09-06T14:44:43.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/403: chown d6/d22/d36/c44 31361083 1 2024-09-06T14:44:43.470 INFO:tasks.workunit.client.0.smithi052.stdout:1/387: mknod d1/db/d72/d81/c86 0 2024-09-06T14:44:43.470 INFO:tasks.workunit.client.0.smithi052.stdout:8/404: dread - d6/d4c/f80 zero size 2024-09-06T14:44:43.471 INFO:tasks.workunit.client.0.smithi052.stdout:1/388: read - d1/d5f/f7d zero size 2024-09-06T14:44:43.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/405: mknod d6/d4c/d76/c88 0 2024-09-06T14:44:43.477 INFO:tasks.workunit.client.0.smithi052.stdout:6/220: truncate d2/dd/d18/d25/f3e 417206 0 2024-09-06T14:44:43.477 INFO:tasks.workunit.client.1.smithi165.stdout:7/979: read d20/d3b/d69/d88/fde [1241639,40650] 0 2024-09-06T14:44:43.479 INFO:tasks.workunit.client.0.smithi052.stdout:8/406: write d6/f59 [1535890,7933] 0 2024-09-06T14:44:43.481 INFO:tasks.workunit.client.1.smithi165.stdout:7/980: stat d20/d33/d6a/cf0 0 2024-09-06T14:44:43.482 INFO:tasks.workunit.client.0.smithi052.stdout:8/407: rmdir d6 39 2024-09-06T14:44:43.483 INFO:tasks.workunit.client.1.smithi165.stdout:7/981: write d20/d33/d53/f57 [4335450,14993] 0 2024-09-06T14:44:43.483 INFO:tasks.workunit.client.0.smithi052.stdout:6/221: mknod d2/c45 0 2024-09-06T14:44:43.487 INFO:tasks.workunit.client.0.smithi052.stdout:8/408: write d6/d9/d1f/d14/f53 [403426,105643] 0 2024-09-06T14:44:43.487 INFO:tasks.workunit.client.1.smithi165.stdout:7/982: dread d20/d3b/d8c/fe5 [0,4194304] 0 2024-09-06T14:44:43.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/280: dread d2/f38 [0,4194304] 0 2024-09-06T14:44:43.490 INFO:tasks.workunit.client.0.smithi052.stdout:5/281: creat d2/d20/f5e x:0 0 0 2024-09-06T14:44:43.491 INFO:tasks.workunit.client.1.smithi165.stdout:7/983: mkdir d20/d3b/d69/d88/d30/d78/d141 0 2024-09-06T14:44:43.492 INFO:tasks.workunit.client.0.smithi052.stdout:8/409: symlink d6/d22/d36/d3e/d47/d56/l89 0 2024-09-06T14:44:43.492 INFO:tasks.workunit.client.1.smithi165.stdout:7/984: chown d20/d65/d82/d97/fb3 14042 1 2024-09-06T14:44:43.494 INFO:tasks.workunit.client.0.smithi052.stdout:6/222: getdents d2/dd 0 2024-09-06T14:44:43.499 INFO:tasks.workunit.client.0.smithi052.stdout:1/389: dwrite d1/f1d [0,4194304] 0 2024-09-06T14:44:43.499 INFO:tasks.workunit.client.0.smithi052.stdout:8/410: read d6/d9/df/d1b/f30 [3647077,11307] 0 2024-09-06T14:44:43.504 INFO:tasks.workunit.client.0.smithi052.stdout:6/223: rename d2/dd/f21 to d2/dd/d18/d2d/f46 0 2024-09-06T14:44:43.505 INFO:tasks.workunit.client.0.smithi052.stdout:5/282: write d2/f13 [366585,90583] 0 2024-09-06T14:44:43.506 INFO:tasks.workunit.client.0.smithi052.stdout:6/224: write d2/f30 [3354339,60183] 0 2024-09-06T14:44:43.506 INFO:tasks.workunit.client.1.smithi165.stdout:7/985: getdents d20/d3b/d69/d88/d80 0 2024-09-06T14:44:43.507 INFO:tasks.workunit.client.0.smithi052.stdout:8/411: mknod d6/d22/d31/d5b/c8a 0 2024-09-06T14:44:43.507 INFO:tasks.workunit.client.1.smithi165.stdout:7/986: readlink d20/d65/d82/l102 0 2024-09-06T14:44:43.508 INFO:tasks.workunit.client.1.smithi165.stdout:7/987: chown d20/d3b/l108 23241960 1 2024-09-06T14:44:43.509 INFO:tasks.workunit.client.1.smithi165.stdout:7/988: write d20/d3b/d69/d88/d80/f119 [675267,22064] 0 2024-09-06T14:44:43.510 INFO:tasks.workunit.client.0.smithi052.stdout:5/283: creat d2/d20/d42/f5f x:0 0 0 2024-09-06T14:44:43.512 INFO:tasks.workunit.client.0.smithi052.stdout:6/225: unlink d2/fc 0 2024-09-06T14:44:43.513 INFO:tasks.workunit.client.1.smithi165.stdout:7/989: chown d20/d3b/d69/d88/d30/c44 50117716 1 2024-09-06T14:44:43.514 INFO:tasks.workunit.client.1.smithi165.stdout:7/990: chown d20/d33/d6a/d90 10 1 2024-09-06T14:44:43.515 INFO:tasks.workunit.client.0.smithi052.stdout:1/390: write d1/db/de/d74/d36/f7b [726699,66156] 0 2024-09-06T14:44:43.516 INFO:tasks.workunit.client.0.smithi052.stdout:5/284: readlink d2/l9 0 2024-09-06T14:44:43.517 INFO:tasks.workunit.client.1.smithi165.stdout:7/991: mkdir d20/d4d/d54/dc1/df9/d142 0 2024-09-06T14:44:43.517 INFO:tasks.workunit.client.0.smithi052.stdout:5/285: read d2/f11 [1791409,108718] 0 2024-09-06T14:44:43.518 INFO:tasks.workunit.client.0.smithi052.stdout:6/226: unlink d2/dd/d18/d25/l41 0 2024-09-06T14:44:43.519 INFO:tasks.workunit.client.0.smithi052.stdout:5/286: chown d2/d1a/f2d 12 1 2024-09-06T14:44:43.519 INFO:tasks.workunit.client.0.smithi052.stdout:8/412: rename d6/d9/df/d41/c7c to d6/d9/d1f/d33/c8b 0 2024-09-06T14:44:43.521 INFO:tasks.workunit.client.1.smithi165.stdout:7/992: symlink d20/d3b/d69/d88/dc6/l143 0 2024-09-06T14:44:43.521 INFO:tasks.workunit.client.0.smithi052.stdout:6/227: write d2/dd/d18/d2d/d32/f3f [486278,29836] 0 2024-09-06T14:44:43.522 INFO:tasks.workunit.client.0.smithi052.stdout:5/287: mknod d2/d20/d42/c60 0 2024-09-06T14:44:43.525 INFO:tasks.workunit.client.0.smithi052.stdout:1/391: dwrite d1/db/de/d74/d3e/d47/f6e [0,4194304] 0 2024-09-06T14:44:43.525 INFO:tasks.workunit.client.0.smithi052.stdout:8/413: rmdir d6/d22/d36/d3e/d47/d56/d68 39 2024-09-06T14:44:43.528 INFO:tasks.workunit.client.0.smithi052.stdout:5/288: mknod d2/d1a/d22/d26/d2b/c61 0 2024-09-06T14:44:43.530 INFO:tasks.workunit.client.0.smithi052.stdout:8/414: unlink d6/d9/d1f/l78 0 2024-09-06T14:44:43.532 INFO:tasks.workunit.client.0.smithi052.stdout:6/228: mkdir d2/dd/d18/d33/d44/d47 0 2024-09-06T14:44:43.533 INFO:tasks.workunit.client.0.smithi052.stdout:1/392: truncate d1/f9 1636168 0 2024-09-06T14:44:43.537 INFO:tasks.workunit.client.0.smithi052.stdout:8/415: rename d6/d9/d1f/d19/f2d to d6/d16/f8c 0 2024-09-06T14:44:43.538 INFO:tasks.workunit.client.0.smithi052.stdout:6/229: symlink d2/dd/d18/d25/l48 0 2024-09-06T14:44:43.542 INFO:tasks.workunit.client.0.smithi052.stdout:8/416: mknod d6/d16/c8d 0 2024-09-06T14:44:43.543 INFO:tasks.workunit.client.0.smithi052.stdout:6/230: write d2/dd/d18/d2d/f46 [1557338,66051] 0 2024-09-06T14:44:43.546 INFO:tasks.workunit.client.1.smithi165.stdout:7/993: dwrite d20/d4d/d54/fb7 [0,4194304] 0 2024-09-06T14:44:43.550 INFO:tasks.workunit.client.0.smithi052.stdout:6/231: dwrite d2/dd/d18/d25/f2c [0,4194304] 0 2024-09-06T14:44:43.554 INFO:tasks.workunit.client.0.smithi052.stdout:5/289: truncate d2/f13 3343642 0 2024-09-06T14:44:43.554 INFO:tasks.workunit.client.0.smithi052.stdout:8/417: link d6/d22/d36/d3e/d47/d56/l5e d6/d22/d36/d3e/d47/l8e 0 2024-09-06T14:44:43.555 INFO:tasks.workunit.client.0.smithi052.stdout:8/418: stat d6/d9/d1f/d19 0 2024-09-06T14:44:43.556 INFO:tasks.workunit.client.0.smithi052.stdout:8/419: stat d6/d22/d36/d3e/d47/d56 0 2024-09-06T14:44:43.557 INFO:tasks.workunit.client.1.smithi165.stdout:7/994: link d20/d4d/ddd/fa9 d20/d65/d128/f144 0 2024-09-06T14:44:43.559 INFO:tasks.workunit.client.0.smithi052.stdout:5/290: mkdir d2/d1a/d22/d26/d62 0 2024-09-06T14:44:43.560 INFO:tasks.workunit.client.0.smithi052.stdout:8/420: mknod d6/d9/d1f/d14/c8f 0 2024-09-06T14:44:43.562 INFO:tasks.workunit.client.0.smithi052.stdout:6/232: link d2/f30 d2/dd/d18/d2d/d32/f49 0 2024-09-06T14:44:43.570 INFO:tasks.workunit.client.0.smithi052.stdout:6/233: dwrite d2/dd/d18/d2d/d32/f3f [0,4194304] 0 2024-09-06T14:44:43.570 INFO:tasks.workunit.client.0.smithi052.stdout:8/421: unlink d6/d22/d36/d3e/d47/l8e 0 2024-09-06T14:44:43.572 INFO:tasks.workunit.client.0.smithi052.stdout:8/422: mknod d6/d22/d31/c90 0 2024-09-06T14:44:43.573 INFO:tasks.workunit.client.0.smithi052.stdout:8/423: readlink d6/d22/d36/d3e/d47/d56/l89 0 2024-09-06T14:44:43.575 INFO:tasks.workunit.client.0.smithi052.stdout:8/424: read d6/d9/d1f/d14/f53 [251613,33742] 0 2024-09-06T14:44:43.577 INFO:tasks.workunit.client.1.smithi165.stdout:7/995: write d20/d33/d53/df4/f124 [314068,115612] 0 2024-09-06T14:44:43.580 INFO:tasks.workunit.client.0.smithi052.stdout:8/425: rename d6/d4c/d76/c88 to d6/d9/d1f/d19/c91 0 2024-09-06T14:44:43.581 INFO:tasks.workunit.client.1.smithi165.stdout:7/996: unlink d20/d3b/d69/d88/d80/ca2 0 2024-09-06T14:44:43.582 INFO:tasks.workunit.client.0.smithi052.stdout:5/291: truncate d2/f12 2622267 0 2024-09-06T14:44:43.585 INFO:tasks.workunit.client.0.smithi052.stdout:8/426: symlink d6/d9/l92 0 2024-09-06T14:44:43.586 INFO:tasks.workunit.client.0.smithi052.stdout:5/292: mknod d2/d20/d42/d53/c63 0 2024-09-06T14:44:43.589 INFO:tasks.workunit.client.0.smithi052.stdout:8/427: fdatasync d6/d16/f1e 0 2024-09-06T14:44:43.590 INFO:tasks.workunit.client.0.smithi052.stdout:5/293: mkdir d2/d1a/d22/d26/d2b/d48/d64 0 2024-09-06T14:44:43.591 INFO:tasks.workunit.client.0.smithi052.stdout:8/428: creat d6/d9/d1f/d19/f93 x:0 0 0 2024-09-06T14:44:43.598 INFO:tasks.workunit.client.0.smithi052.stdout:6/234: dwrite d2/dd/d18/d2d/d32/f3f [4194304,4194304] 0 2024-09-06T14:44:43.599 INFO:tasks.workunit.client.0.smithi052.stdout:5/294: rename d2/d20/d42/d53 to d2/d20/d42/d65 0 2024-09-06T14:44:43.600 INFO:tasks.workunit.client.1.smithi165.stdout:7/997: truncate f1f 3535849 0 2024-09-06T14:44:43.601 INFO:tasks.workunit.client.0.smithi052.stdout:8/429: dwrite d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:43.605 INFO:tasks.workunit.client.1.smithi165.stdout:7/998: creat d20/d4d/d54/dc1/df9/dd6/f145 x:0 0 0 2024-09-06T14:44:43.606 INFO:tasks.workunit.client.0.smithi052.stdout:6/235: mkdir d2/d4a 0 2024-09-06T14:44:43.607 INFO:tasks.workunit.client.0.smithi052.stdout:6/236: stat d2/c45 0 2024-09-06T14:44:43.613 INFO:tasks.workunit.client.0.smithi052.stdout:6/237: mkdir d2/dd/d18/d4b 0 2024-09-06T14:44:43.616 INFO:tasks.workunit.client.1.smithi165.stdout:7/999: rename d20/d3b/d69/d88/c2c to d20/d3b/d69/d88/d80/d81/de1/c146 0 2024-09-06T14:44:43.617 INFO:tasks.workunit.client.0.smithi052.stdout:6/238: mkdir d2/dd/d18/d25/d4c 0 2024-09-06T14:44:43.618 INFO:tasks.workunit.client.0.smithi052.stdout:5/295: getdents d2/d1a/d22/d26/d2b/d37 0 2024-09-06T14:44:43.619 INFO:tasks.workunit.client.0.smithi052.stdout:5/296: fsync d2/d20/f23 0 2024-09-06T14:44:43.619 INFO:tasks.workunit.client.1.smithi165.stderr:+ rm -rf -- ./tmp.3WERSMCe1f 2024-09-06T14:44:43.620 INFO:tasks.workunit.client.0.smithi052.stdout:6/239: creat d2/dd/d18/d33/f4d x:0 0 0 2024-09-06T14:44:43.620 INFO:tasks.workunit.client.0.smithi052.stdout:6/240: chown d2/dd/d18/c2a 24 1 2024-09-06T14:44:43.625 INFO:tasks.workunit.client.0.smithi052.stdout:5/297: dwrite d2/f1d [0,4194304] 0 2024-09-06T14:44:43.626 INFO:tasks.workunit.client.0.smithi052.stdout:5/298: write d2/f16 [4785329,108575] 0 2024-09-06T14:44:43.627 INFO:tasks.workunit.client.0.smithi052.stdout:5/299: dread - d2/d1a/d22/f45 zero size 2024-09-06T14:44:43.628 INFO:tasks.workunit.client.0.smithi052.stdout:6/241: link d2/dd/d18/l43 d2/l4e 0 2024-09-06T14:44:43.628 INFO:tasks.workunit.client.0.smithi052.stdout:6/242: readlink d2/l1b 0 2024-09-06T14:44:43.629 INFO:tasks.workunit.client.0.smithi052.stdout:5/300: chown d2/c5b 3 1 2024-09-06T14:44:43.636 INFO:tasks.workunit.client.0.smithi052.stdout:5/301: dwrite d2/d20/d42/f5f [0,4194304] 0 2024-09-06T14:44:43.636 INFO:tasks.workunit.client.0.smithi052.stdout:5/302: readlink d2/lc 0 2024-09-06T14:44:43.639 INFO:tasks.workunit.client.0.smithi052.stdout:5/303: creat d2/d1a/d22/d26/d62/f66 x:0 0 0 2024-09-06T14:44:43.641 INFO:tasks.workunit.client.0.smithi052.stdout:5/304: rename d2/l1e to d2/d1a/d22/d26/l67 0 2024-09-06T14:44:43.643 INFO:tasks.workunit.client.0.smithi052.stdout:5/305: mkdir d2/d1a/d22/d26/d2b/d37/d68 0 2024-09-06T14:44:43.650 INFO:tasks.workunit.client.0.smithi052.stdout:5/306: dwrite d2/d1a/d22/f45 [0,4194304] 0 2024-09-06T14:44:43.701 INFO:tasks.workunit.client.0.smithi052.stdout:8/430: truncate d6/d9/df/f57 2815808 0 2024-09-06T14:44:43.703 INFO:tasks.workunit.client.0.smithi052.stdout:8/431: read d6/d9/df/f5d [148340,120291] 0 2024-09-06T14:44:43.706 INFO:tasks.workunit.client.0.smithi052.stdout:8/432: write d6/d9/df/f5d [3963058,122267] 0 2024-09-06T14:44:43.707 INFO:tasks.workunit.client.0.smithi052.stdout:8/433: chown d6/d9/df/d1b/f2f 0 1 2024-09-06T14:44:43.713 INFO:tasks.workunit.client.0.smithi052.stdout:6/243: dwrite d2/dd/d18/d25/f3e [0,4194304] 0 2024-09-06T14:44:43.715 INFO:tasks.workunit.client.0.smithi052.stdout:5/307: truncate d2/d20/d42/f52 1895815 0 2024-09-06T14:44:43.783 INFO:tasks.workunit.client.0.smithi052.stdout:8/434: symlink d6/d22/d36/d3e/d47/d56/d68/d69/l94 0 2024-09-06T14:44:43.783 INFO:tasks.workunit.client.0.smithi052.stdout:5/308: creat d2/d1a/d22/d26/d2b/f69 x:0 0 0 2024-09-06T14:44:43.783 INFO:tasks.workunit.client.0.smithi052.stdout:8/435: rmdir d6/d9/d1f/d19/d6f 39 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:8/436: dread - d6/d9/d1f/d19/f93 zero size 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:5/309: mkdir d2/d1a/d22/d26/d2b/d37/d6a 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:8/437: dwrite d6/d9/df/d41/d71/f81 [0,4194304] 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:5/310: fdatasync d2/d20/f29 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:6/244: truncate d2/dd/d18/d2d/d32/f3f 3342789 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:6/245: write d2/f39 [894580,36861] 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:8/438: creat d6/d9/f95 x:0 0 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:5/311: write d2/d1a/f3d [1757137,99819] 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:8/439: creat d6/d22/d31/d5b/f96 x:0 0 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:6/246: write d2/f30 [4995699,122638] 0 2024-09-06T14:44:43.784 INFO:tasks.workunit.client.0.smithi052.stdout:8/440: rmdir d6/d9/d6d 39 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:6/247: creat d2/dd/d18/f4f x:0 0 0 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:6/248: stat d2/f39 0 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:8/441: chown d6/d9/d6d/l75 302 1 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:8/442: read d6/d9/df/d1b/f2f [5145349,79724] 0 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:5/312: dwrite d2/f13 [0,4194304] 0 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:6/249: getdents d2/dd/d18/d33/d44/d47 0 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:8/443: mknod d6/d22/d36/d3e/c97 0 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:5/313: mknod d2/d20/d42/d65/c6b 0 2024-09-06T14:44:43.785 INFO:tasks.workunit.client.0.smithi052.stdout:6/250: creat d2/dd/d18/d33/f50 x:0 0 0 2024-09-06T14:44:43.787 INFO:tasks.workunit.client.0.smithi052.stdout:6/251: creat d2/dd/d18/f51 x:0 0 0 2024-09-06T14:44:43.788 INFO:tasks.workunit.client.0.smithi052.stdout:5/314: truncate d2/d20/d42/d65/f55 3502235 0 2024-09-06T14:44:43.790 INFO:tasks.workunit.client.0.smithi052.stdout:5/315: chown d2/d1a/d22/d26/c4a 1 1 2024-09-06T14:44:43.791 INFO:tasks.workunit.client.0.smithi052.stdout:6/252: dread d2/f30 [4194304,4194304] 0 2024-09-06T14:44:43.796 INFO:tasks.workunit.client.0.smithi052.stdout:6/253: creat d2/dd/d18/d2d/f52 x:0 0 0 2024-09-06T14:44:43.798 INFO:tasks.workunit.client.0.smithi052.stdout:5/316: dwrite d2/d20/f5e [0,4194304] 0 2024-09-06T14:44:43.800 INFO:tasks.workunit.client.0.smithi052.stdout:6/254: rename d2/dd/d18/f4f to d2/dd/d18/d4b/f53 0 2024-09-06T14:44:43.801 INFO:tasks.workunit.client.0.smithi052.stdout:5/317: rmdir d2 39 2024-09-06T14:44:43.801 INFO:tasks.workunit.client.0.smithi052.stdout:6/255: stat d2/dd/d18/d33/f50 0 2024-09-06T14:44:43.809 INFO:tasks.workunit.client.0.smithi052.stdout:6/256: unlink d2/dd/f10 0 2024-09-06T14:44:43.810 INFO:tasks.workunit.client.0.smithi052.stdout:8/444: dwrite d6/d9/d6d/f7a [4194304,4194304] 0 2024-09-06T14:44:43.811 INFO:tasks.workunit.client.0.smithi052.stdout:6/257: write d2/dd/d18/f51 [123122,28622] 0 2024-09-06T14:44:43.815 INFO:tasks.workunit.client.0.smithi052.stdout:8/445: creat d6/f98 x:0 0 0 2024-09-06T14:44:43.822 INFO:tasks.workunit.client.0.smithi052.stdout:8/446: dwrite d6/d9/f18 [0,4194304] 0 2024-09-06T14:44:43.824 INFO:tasks.workunit.client.0.smithi052.stdout:6/258: mknod d2/c54 0 2024-09-06T14:44:43.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/318: truncate d2/d1a/f2d 296608 0 2024-09-06T14:44:43.830 INFO:tasks.workunit.client.0.smithi052.stdout:5/319: chown d2/d20/f31 576741513 1 2024-09-06T14:44:43.836 INFO:tasks.workunit.client.0.smithi052.stdout:5/320: mkdir d2/d1a/d22/d26/d2b/d37/d68/d6c 0 2024-09-06T14:44:43.840 INFO:tasks.workunit.client.0.smithi052.stdout:8/447: write d6/d22/f3a [1780407,106642] 0 2024-09-06T14:44:43.840 INFO:tasks.workunit.client.0.smithi052.stdout:5/321: rmdir d2/d1a/d22/d26/d2b/d37 39 2024-09-06T14:44:43.841 INFO:tasks.workunit.client.0.smithi052.stdout:5/322: fdatasync d2/d20/d42/f5f 0 2024-09-06T14:44:43.842 INFO:tasks.workunit.client.0.smithi052.stdout:6/259: creat d2/dd/d18/d2d/d32/f55 x:0 0 0 2024-09-06T14:44:43.843 INFO:tasks.workunit.client.0.smithi052.stdout:8/448: unlink d6/d4c/d76/c7e 0 2024-09-06T14:44:43.845 INFO:tasks.workunit.client.0.smithi052.stdout:5/323: creat d2/d1a/d22/d26/d62/f6d x:0 0 0 2024-09-06T14:44:43.849 INFO:tasks.workunit.client.0.smithi052.stdout:6/260: rename d2/dd/ce to d2/dd/d18/d33/d44/c56 0 2024-09-06T14:44:43.850 INFO:tasks.workunit.client.0.smithi052.stdout:8/449: symlink d6/d9/df/d1b/d87/l99 0 2024-09-06T14:44:43.852 INFO:tasks.workunit.client.0.smithi052.stdout:5/324: creat d2/d1a/d22/d26/d2b/d37/d68/f6e x:0 0 0 2024-09-06T14:44:43.855 INFO:tasks.workunit.client.0.smithi052.stdout:6/261: chown d2/dd/d18/d25/f2c 469803397 1 2024-09-06T14:44:43.856 INFO:tasks.workunit.client.0.smithi052.stdout:8/450: symlink d6/d9/df/l9a 0 2024-09-06T14:44:43.858 INFO:tasks.workunit.client.0.smithi052.stdout:5/325: symlink d2/d1a/d22/d26/d2b/d48/l6f 0 2024-09-06T14:44:43.859 INFO:tasks.workunit.client.0.smithi052.stdout:8/451: mkdir d6/d22/d36/d3e/d47/d9b 0 2024-09-06T14:44:43.860 INFO:tasks.workunit.client.0.smithi052.stdout:6/262: symlink d2/dd/d18/d25/d4c/l57 0 2024-09-06T14:44:43.863 INFO:tasks.workunit.client.0.smithi052.stdout:8/452: truncate d6/d9/df/f57 909382 0 2024-09-06T14:44:43.865 INFO:tasks.workunit.client.0.smithi052.stdout:5/326: dwrite d2/f38 [0,4194304] 0 2024-09-06T14:44:43.867 INFO:tasks.workunit.client.0.smithi052.stdout:8/453: fdatasync d6/d9/d1f/d14/f53 0 2024-09-06T14:44:43.868 INFO:tasks.workunit.client.0.smithi052.stdout:6/263: link d2/dd/d18/d4b/f53 d2/dd/d18/d4b/f58 0 2024-09-06T14:44:43.869 INFO:tasks.workunit.client.0.smithi052.stdout:8/454: read d6/d9/d1f/d14/f53 [2023857,87761] 0 2024-09-06T14:44:43.872 INFO:tasks.workunit.client.0.smithi052.stdout:5/327: symlink d2/d20/d56/l70 0 2024-09-06T14:44:43.873 INFO:tasks.workunit.client.0.smithi052.stdout:5/328: dread - d2/d1a/d22/d26/d62/f66 zero size 2024-09-06T14:44:43.874 INFO:tasks.workunit.client.0.smithi052.stdout:9/267: sync 2024-09-06T14:44:43.876 INFO:tasks.workunit.client.0.smithi052.stdout:8/455: mknod d6/d9/df/d1b/d87/c9c 0 2024-09-06T14:44:43.876 INFO:tasks.workunit.client.0.smithi052.stdout:6/264: dwrite d2/f3b [0,4194304] 0 2024-09-06T14:44:43.884 INFO:tasks.workunit.client.0.smithi052.stdout:9/268: creat d1/d4/d6/dc/d10/d18/f4e x:0 0 0 2024-09-06T14:44:43.885 INFO:tasks.workunit.client.0.smithi052.stdout:9/269: write d1/d4/d6/dd/d2b/f49 [111078,29206] 0 2024-09-06T14:44:43.888 INFO:tasks.workunit.client.0.smithi052.stdout:6/265: symlink d2/dd/d18/d25/d4c/l59 0 2024-09-06T14:44:43.891 INFO:tasks.workunit.client.0.smithi052.stdout:5/329: truncate d2/f7 8151992 0 2024-09-06T14:44:43.897 INFO:tasks.workunit.client.0.smithi052.stdout:6/266: symlink d2/dd/d18/d4b/l5a 0 2024-09-06T14:44:43.908 INFO:tasks.workunit.client.0.smithi052.stdout:6/267: fsync d2/dd/d18/d4b/f53 0 2024-09-06T14:44:43.919 INFO:tasks.workunit.client.0.smithi052.stdout:8/456: dwrite d6/d9/df/f57 [0,4194304] 0 2024-09-06T14:44:43.926 INFO:tasks.workunit.client.0.smithi052.stdout:9/270: truncate d1/d4/f7 3773812 0 2024-09-06T14:44:43.927 INFO:tasks.workunit.client.0.smithi052.stdout:8/457: dwrite d6/d9/df/f4e [0,4194304] 0 2024-09-06T14:44:43.928 INFO:tasks.workunit.client.0.smithi052.stdout:6/268: write d2/dd/d18/d4b/f58 [498328,45883] 0 2024-09-06T14:44:43.931 INFO:tasks.workunit.client.0.smithi052.stdout:5/330: write d2/d20/d42/f52 [2147603,22424] 0 2024-09-06T14:44:43.936 INFO:tasks.workunit.client.0.smithi052.stdout:6/269: fsync d2/dd/d18/d4b/f53 0 2024-09-06T14:44:43.938 INFO:tasks.workunit.client.0.smithi052.stdout:9/271: dwrite d1/d4/d6/f35 [0,4194304] 0 2024-09-06T14:44:43.940 INFO:tasks.workunit.client.0.smithi052.stdout:8/458: truncate d6/d22/d36/d3e/d47/d56/d68/f3f 2870709 0 2024-09-06T14:44:43.941 INFO:tasks.workunit.client.0.smithi052.stdout:9/272: write d1/fa [432440,66250] 0 2024-09-06T14:44:43.944 INFO:tasks.workunit.client.0.smithi052.stdout:5/331: dwrite d2/f1d [0,4194304] 0 2024-09-06T14:44:43.947 INFO:tasks.workunit.client.0.smithi052.stdout:8/459: creat d6/d9/f9d x:0 0 0 2024-09-06T14:44:43.948 INFO:tasks.workunit.client.0.smithi052.stdout:9/273: unlink d1/d4/d6/dd/f21 0 2024-09-06T14:44:43.949 INFO:tasks.workunit.client.0.smithi052.stdout:5/332: creat d2/d1a/d22/d26/d2b/d37/d68/f71 x:0 0 0 2024-09-06T14:44:43.951 INFO:tasks.workunit.client.0.smithi052.stdout:8/460: truncate d6/d16/f1e 4765622 0 2024-09-06T14:44:43.953 INFO:tasks.workunit.client.0.smithi052.stdout:5/333: creat d2/d1a/d22/d26/d62/f72 x:0 0 0 2024-09-06T14:44:43.955 INFO:tasks.workunit.client.0.smithi052.stdout:8/461: read d6/d9/d1f/d14/f29 [799905,97539] 0 2024-09-06T14:44:43.956 INFO:tasks.workunit.client.0.smithi052.stdout:8/462: fdatasync d6/d9/d1f/d19/f93 0 2024-09-06T14:44:43.961 INFO:tasks.workunit.client.0.smithi052.stdout:5/334: dwrite d2/d1a/d22/d26/d62/f6d [0,4194304] 0 2024-09-06T14:44:43.961 INFO:tasks.workunit.client.0.smithi052.stdout:8/463: rename d6/d16/c8d to d6/d9/df/d1b/d87/c9e 0 2024-09-06T14:44:43.963 INFO:tasks.workunit.client.0.smithi052.stdout:8/464: fsync d6/f59 0 2024-09-06T14:44:43.970 INFO:tasks.workunit.client.0.smithi052.stdout:8/465: truncate d6/d9/d1f/d19/d6f/d72/f86 2450298 0 2024-09-06T14:44:43.975 INFO:tasks.workunit.client.0.smithi052.stdout:8/466: dread d6/d4c/f66 [0,4194304] 0 2024-09-06T14:44:43.977 INFO:tasks.workunit.client.0.smithi052.stdout:6/270: truncate d2/dd/d18/d25/f3e 853726 0 2024-09-06T14:44:43.980 INFO:tasks.workunit.client.0.smithi052.stdout:8/467: truncate d6/d9/df/d1b/f2f 2926565 0 2024-09-06T14:44:43.981 INFO:tasks.workunit.client.0.smithi052.stdout:6/271: chown d2/dd/d18/l43 14 1 2024-09-06T14:44:43.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/468: getdents d6/d22/d5c 0 2024-09-06T14:44:43.990 INFO:tasks.workunit.client.0.smithi052.stdout:8/469: chown d6/d9/df/d1b/f30 58 1 2024-09-06T14:44:43.990 INFO:tasks.workunit.client.0.smithi052.stdout:5/335: dread d2/d20/f23 [0,4194304] 0 2024-09-06T14:44:43.990 INFO:tasks.workunit.client.0.smithi052.stdout:8/470: readlink d6/d9/d6d/l75 0 2024-09-06T14:44:43.995 INFO:tasks.workunit.client.0.smithi052.stdout:5/336: creat d2/d1a/d22/d26/f73 x:0 0 0 2024-09-06T14:44:43.996 INFO:tasks.workunit.client.0.smithi052.stdout:5/337: read d2/ff [3891622,36811] 0 2024-09-06T14:44:43.996 INFO:tasks.workunit.client.0.smithi052.stdout:8/471: mknod d6/d22/d36/d3e/d47/c9f 0 2024-09-06T14:44:44.003 INFO:tasks.workunit.client.0.smithi052.stdout:8/472: mkdir d6/d9/d1f/d14/da0 0 2024-09-06T14:44:44.004 INFO:tasks.workunit.client.0.smithi052.stdout:5/338: truncate d2/f12 1556130 0 2024-09-06T14:44:44.005 INFO:tasks.workunit.client.0.smithi052.stdout:6/272: truncate d2/dd/d18/d25/f26 525231 0 2024-09-06T14:44:44.006 INFO:tasks.workunit.client.0.smithi052.stdout:6/273: dread - d2/dd/d18/d33/f50 zero size 2024-09-06T14:44:44.011 INFO:tasks.workunit.client.0.smithi052.stdout:5/339: fdatasync d2/d1a/d22/d26/d2b/f2f 0 2024-09-06T14:44:44.012 INFO:tasks.workunit.client.0.smithi052.stdout:5/340: chown d2/f13 2367430 1 2024-09-06T14:44:44.017 INFO:tasks.workunit.client.0.smithi052.stdout:6/274: dwrite d2/f30 [4194304,4194304] 0 2024-09-06T14:44:44.019 INFO:tasks.workunit.client.0.smithi052.stdout:8/473: getdents d6/d4c 0 2024-09-06T14:44:44.022 INFO:tasks.workunit.client.0.smithi052.stdout:5/341: dwrite d2/f1d [4194304,4194304] 0 2024-09-06T14:44:44.023 INFO:tasks.workunit.client.0.smithi052.stdout:8/474: rename d6/d22 to d6/d22/d36/d3e/d79/da1 22 2024-09-06T14:44:44.024 INFO:tasks.workunit.client.0.smithi052.stdout:8/475: stat d6/d9/df/d1b/d87 0 2024-09-06T14:44:44.025 INFO:tasks.workunit.client.0.smithi052.stdout:8/476: dread - d6/d3c/f83 zero size 2024-09-06T14:44:44.027 INFO:tasks.workunit.client.0.smithi052.stdout:8/477: readlink d6/d22/d36/d3e/d47/d56/d68/d69/l94 0 2024-09-06T14:44:44.028 INFO:tasks.workunit.client.0.smithi052.stdout:8/478: chown d6/d9/f2e 6572404 1 2024-09-06T14:44:44.032 INFO:tasks.workunit.client.0.smithi052.stdout:5/342: getdents d2/d1a/d22/d26 0 2024-09-06T14:44:44.034 INFO:tasks.workunit.client.0.smithi052.stdout:5/343: rmdir d2/d1a/d22/d26/d2b/d37/d68 39 2024-09-06T14:44:44.035 INFO:tasks.workunit.client.0.smithi052.stdout:5/344: chown d2/d1a/d22/d26/d2b/d37/f44 247 1 2024-09-06T14:44:44.036 INFO:tasks.workunit.client.0.smithi052.stdout:5/345: symlink d2/d20/d56/l74 0 2024-09-06T14:44:44.038 INFO:tasks.workunit.client.0.smithi052.stdout:5/346: creat d2/d1a/d22/d26/d62/f75 x:0 0 0 2024-09-06T14:44:44.040 INFO:tasks.workunit.client.0.smithi052.stdout:5/347: write d2/d1a/d22/d26/d62/f75 [178097,107315] 0 2024-09-06T14:44:44.041 INFO:tasks.workunit.client.0.smithi052.stdout:6/275: truncate d2/dd/d18/d2d/d32/f49 7134911 0 2024-09-06T14:44:44.042 INFO:tasks.workunit.client.0.smithi052.stdout:5/348: creat d2/d1a/f76 x:0 0 0 2024-09-06T14:44:44.046 INFO:tasks.workunit.client.0.smithi052.stdout:5/349: rename d2/d20/f31 to d2/d1a/f77 0 2024-09-06T14:44:44.048 INFO:tasks.workunit.client.0.smithi052.stdout:6/276: dwrite d2/f39 [0,4194304] 0 2024-09-06T14:44:44.049 INFO:tasks.workunit.client.0.smithi052.stdout:6/277: chown d2/f39 11 1 2024-09-06T14:44:44.051 INFO:tasks.workunit.client.0.smithi052.stdout:5/350: creat d2/d20/d42/d65/f78 x:0 0 0 2024-09-06T14:44:44.053 INFO:tasks.workunit.client.0.smithi052.stdout:5/351: creat d2/d20/d42/d65/f79 x:0 0 0 2024-09-06T14:44:44.056 INFO:tasks.workunit.client.0.smithi052.stdout:8/479: dread d6/d16/f8c [0,4194304] 0 2024-09-06T14:44:44.060 INFO:tasks.workunit.client.0.smithi052.stdout:5/352: dread d2/d1a/d22/f45 [0,4194304] 0 2024-09-06T14:44:44.063 INFO:tasks.workunit.client.0.smithi052.stdout:8/480: dread d6/f5f [0,4194304] 0 2024-09-06T14:44:44.069 INFO:tasks.workunit.client.0.smithi052.stdout:5/353: creat d2/d1a/d22/f7a x:0 0 0 2024-09-06T14:44:44.072 INFO:tasks.workunit.client.0.smithi052.stdout:6/278: write d2/dd/d18/d2d/d32/f3f [279488,34102] 0 2024-09-06T14:44:44.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:43 smithi165 ceph-mon[36229]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 107 MiB/s rd, 297 MiB/s wr, 595 op/s 2024-09-06T14:44:44.073 INFO:tasks.workunit.client.0.smithi052.stdout:8/481: symlink d6/d22/d36/d3e/la2 0 2024-09-06T14:44:44.082 INFO:tasks.workunit.client.0.smithi052.stdout:5/354: chown d2/d1a/d22/d26/d2b/d37/d68/d6c 0 1 2024-09-06T14:44:44.084 INFO:tasks.workunit.client.0.smithi052.stdout:6/279: rename d2/f39 to d2/d4a/f5b 0 2024-09-06T14:44:44.084 INFO:tasks.workunit.client.0.smithi052.stdout:5/355: truncate d2/d1a/d22/f7a 116076 0 2024-09-06T14:44:44.086 INFO:tasks.workunit.client.0.smithi052.stdout:6/280: truncate d2/dd/d18/d4b/f58 929134 0 2024-09-06T14:44:44.089 INFO:tasks.workunit.client.0.smithi052.stdout:8/482: mknod d6/d22/d36/ca3 0 2024-09-06T14:44:44.091 INFO:tasks.workunit.client.0.smithi052.stdout:5/356: symlink d2/d1a/d22/d26/d2b/d37/l7b 0 2024-09-06T14:44:44.092 INFO:tasks.workunit.client.0.smithi052.stdout:8/483: write d6/d22/d36/d3e/d47/d56/d68/f6c [4942151,70592] 0 2024-09-06T14:44:44.095 INFO:tasks.workunit.client.0.smithi052.stdout:6/281: dwrite d2/dd/d18/d2d/d32/f55 [0,4194304] 0 2024-09-06T14:44:44.095 INFO:tasks.workunit.client.0.smithi052.stdout:5/357: dread - d2/d1a/d22/d26/d2b/d37/d68/f6e zero size 2024-09-06T14:44:44.096 INFO:tasks.workunit.client.0.smithi052.stdout:5/358: chown d2/d20/d56/l74 0 1 2024-09-06T14:44:44.097 INFO:tasks.workunit.client.0.smithi052.stdout:6/282: write d2/dd/d18/d2d/d32/f40 [1024401,9754] 0 2024-09-06T14:44:44.098 INFO:tasks.workunit.client.0.smithi052.stdout:5/359: write d2/d20/d42/d65/f55 [2565546,59056] 0 2024-09-06T14:44:44.099 INFO:tasks.workunit.client.0.smithi052.stdout:5/360: fdatasync d2/f38 0 2024-09-06T14:44:44.100 INFO:tasks.workunit.client.0.smithi052.stdout:6/283: symlink d2/dd/d18/d2d/l5c 0 2024-09-06T14:44:44.101 INFO:tasks.workunit.client.0.smithi052.stdout:5/361: write d2/d1a/d22/f3e [4766918,44910] 0 2024-09-06T14:44:44.109 INFO:tasks.workunit.client.0.smithi052.stdout:6/284: symlink d2/dd/d18/d4b/l5d 0 2024-09-06T14:44:44.111 INFO:tasks.workunit.client.0.smithi052.stdout:6/285: mkdir d2/dd/d5e 0 2024-09-06T14:44:44.112 INFO:tasks.workunit.client.0.smithi052.stdout:5/362: getdents d2/d20/d56 0 2024-09-06T14:44:44.113 INFO:tasks.workunit.client.0.smithi052.stdout:5/363: write d2/f18 [1466167,100325] 0 2024-09-06T14:44:44.115 INFO:tasks.workunit.client.0.smithi052.stdout:6/286: mknod d2/dd/d18/d2d/d32/c5f 0 2024-09-06T14:44:44.117 INFO:tasks.workunit.client.0.smithi052.stdout:5/364: symlink d2/d20/l7c 0 2024-09-06T14:44:44.119 INFO:tasks.workunit.client.0.smithi052.stdout:6/287: rename d2/dd/d18/d25/l48 to d2/dd/d18/d25/l60 0 2024-09-06T14:44:44.121 INFO:tasks.workunit.client.0.smithi052.stdout:5/365: mknod d2/d1a/d22/d26/d2b/d48/c7d 0 2024-09-06T14:44:44.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:43 smithi052 ceph-mon[28627]: pgmap v24: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 107 MiB/s rd, 297 MiB/s wr, 595 op/s 2024-09-06T14:44:44.131 INFO:tasks.workunit.client.0.smithi052.stdout:5/366: link d2/d1a/f2d d2/d1a/d22/f7e 0 2024-09-06T14:44:44.132 INFO:tasks.workunit.client.0.smithi052.stdout:5/367: dread d2/f25 [0,4194304] 0 2024-09-06T14:44:44.133 INFO:tasks.workunit.client.0.smithi052.stdout:5/368: write d2/d20/d42/f52 [419868,5868] 0 2024-09-06T14:44:44.135 INFO:tasks.workunit.client.0.smithi052.stdout:5/369: rename d2/d20/d42 to d2/d20/d42/d65/d7f 22 2024-09-06T14:44:44.136 INFO:tasks.workunit.client.0.smithi052.stdout:6/288: truncate d2/dd/f20 179984 0 2024-09-06T14:44:44.136 INFO:tasks.workunit.client.0.smithi052.stdout:6/289: chown d2/dd/d18/d2d/d32/c5f 84 1 2024-09-06T14:44:44.138 INFO:tasks.workunit.client.0.smithi052.stdout:5/370: symlink d2/d20/d42/l80 0 2024-09-06T14:44:44.140 INFO:tasks.workunit.client.0.smithi052.stdout:5/371: write d2/d1a/d22/d26/d62/f72 [543557,56361] 0 2024-09-06T14:44:44.141 INFO:tasks.workunit.client.0.smithi052.stdout:5/372: fsync d2/d1a/f76 0 2024-09-06T14:44:44.142 INFO:tasks.workunit.client.0.smithi052.stdout:5/373: write d2/d1a/d22/d26/f73 [150260,22146] 0 2024-09-06T14:44:44.147 INFO:tasks.workunit.client.0.smithi052.stdout:5/374: symlink d2/d1a/d22/d26/d2b/l81 0 2024-09-06T14:44:44.148 INFO:tasks.workunit.client.0.smithi052.stdout:5/375: write d2/d1a/d22/d26/d2b/d48/f4b [989077,1215] 0 2024-09-06T14:44:44.170 INFO:tasks.workunit.client.0.smithi052.stdout:0/338: sync 2024-09-06T14:44:44.174 INFO:tasks.workunit.client.0.smithi052.stdout:6/290: dwrite d2/dd/d18/d25/f26 [0,4194304] 0 2024-09-06T14:44:44.182 INFO:tasks.workunit.client.0.smithi052.stdout:5/376: dwrite d2/d1a/d22/d26/d62/f6d [0,4194304] 0 2024-09-06T14:44:44.184 INFO:tasks.workunit.client.0.smithi052.stdout:6/291: mkdir d2/dd/d18/d25/d4c/d61 0 2024-09-06T14:44:44.186 INFO:tasks.workunit.client.0.smithi052.stdout:5/377: truncate d2/d20/f5e 4599590 0 2024-09-06T14:44:44.187 INFO:tasks.workunit.client.0.smithi052.stdout:0/339: dwrite d0/d18/f50 [0,4194304] 0 2024-09-06T14:44:44.190 INFO:tasks.workunit.client.0.smithi052.stdout:6/292: truncate d2/dd/d18/f31 521328 0 2024-09-06T14:44:44.192 INFO:tasks.workunit.client.0.smithi052.stdout:0/340: creat d0/d1a/d26/d3a/d14/d20/d22/d5b/f74 x:0 0 0 2024-09-06T14:44:44.194 INFO:tasks.workunit.client.0.smithi052.stdout:0/341: fdatasync d0/d1a/d26/d3a/d14/d20/d22/d5b/f5c 0 2024-09-06T14:44:44.196 INFO:tasks.workunit.client.0.smithi052.stdout:6/293: creat d2/dd/d18/d25/d4c/d61/f62 x:0 0 0 2024-09-06T14:44:44.197 INFO:tasks.workunit.client.0.smithi052.stdout:6/294: chown d2/c2e 1 1 2024-09-06T14:44:44.199 INFO:tasks.workunit.client.0.smithi052.stdout:0/342: mknod d0/d19/c75 0 2024-09-06T14:44:44.203 INFO:tasks.workunit.client.0.smithi052.stdout:0/343: creat d0/d1a/d26/d3a/d14/d20/d22/d5b/f76 x:0 0 0 2024-09-06T14:44:44.209 INFO:tasks.workunit.client.0.smithi052.stdout:0/344: dwrite d0/d18/f5f [0,4194304] 0 2024-09-06T14:44:44.212 INFO:tasks.workunit.client.0.smithi052.stdout:6/295: write d2/dd/d18/d2d/f46 [326032,118839] 0 2024-09-06T14:44:44.214 INFO:tasks.workunit.client.0.smithi052.stdout:6/296: unlink d2/dd/d18/d2d/f52 0 2024-09-06T14:44:44.217 INFO:tasks.workunit.client.0.smithi052.stdout:6/297: rename d2/c5 to d2/dd/d5e/c63 0 2024-09-06T14:44:44.218 INFO:tasks.workunit.client.0.smithi052.stdout:6/298: stat d2/d4a/f5b 0 2024-09-06T14:44:44.220 INFO:tasks.workunit.client.0.smithi052.stdout:6/299: write d2/dd/d18/f51 [1184721,67645] 0 2024-09-06T14:44:44.223 INFO:tasks.workunit.client.0.smithi052.stdout:6/300: unlink d2/dd/f20 0 2024-09-06T14:44:44.224 INFO:tasks.workunit.client.0.smithi052.stdout:6/301: chown d2/dd/d18/d25/c3c 6398 1 2024-09-06T14:44:44.226 INFO:tasks.workunit.client.0.smithi052.stdout:6/302: symlink d2/dd/d5e/l64 0 2024-09-06T14:44:44.231 INFO:tasks.workunit.client.0.smithi052.stdout:0/345: dread d0/d19/f59 [0,4194304] 0 2024-09-06T14:44:44.235 INFO:tasks.workunit.client.0.smithi052.stdout:0/346: symlink d0/d1a/d26/d3a/d14/d2d/d56/d5d/d60/l77 0 2024-09-06T14:44:44.238 INFO:tasks.workunit.client.0.smithi052.stdout:0/347: dread d0/d19/f59 [0,4194304] 0 2024-09-06T14:44:44.241 INFO:tasks.workunit.client.0.smithi052.stdout:0/348: mknod d0/d1a/d26/c78 0 2024-09-06T14:44:44.241 INFO:tasks.workunit.client.0.smithi052.stdout:0/349: chown d0/l67 474988 1 2024-09-06T14:44:44.242 INFO:tasks.workunit.client.0.smithi052.stdout:6/303: truncate d2/dd/d18/d2d/f38 3022533 0 2024-09-06T14:44:44.242 INFO:tasks.workunit.client.0.smithi052.stdout:6/304: chown d2/dd/d18/d33/f50 19840479 1 2024-09-06T14:44:44.244 INFO:tasks.workunit.client.0.smithi052.stdout:6/305: write d2/dd/d18/f31 [581456,6106] 0 2024-09-06T14:44:44.246 INFO:tasks.workunit.client.0.smithi052.stdout:6/306: write d2/dd/d18/d2d/d32/f40 [1669446,103782] 0 2024-09-06T14:44:44.249 INFO:tasks.workunit.client.0.smithi052.stdout:6/307: write d2/dd/d18/f31 [1603545,67925] 0 2024-09-06T14:44:44.249 INFO:tasks.workunit.client.0.smithi052.stdout:0/350: dwrite d0/d1a/d26/d3a/d14/d2d/d56/d5d/f6c [0,4194304] 0 2024-09-06T14:44:44.252 INFO:tasks.workunit.client.0.smithi052.stdout:0/351: write d0/d1a/d26/d3a/d14/d20/d22/d5b/f74 [284721,57967] 0 2024-09-06T14:44:44.258 INFO:tasks.workunit.client.0.smithi052.stdout:0/352: write d0/d1a/f40 [3100647,54290] 0 2024-09-06T14:44:44.262 INFO:tasks.workunit.client.0.smithi052.stdout:6/308: dwrite d2/dd/d18/d2d/d32/f55 [4194304,4194304] 0 2024-09-06T14:44:44.262 INFO:tasks.workunit.client.0.smithi052.stdout:0/353: mknod d0/d1a/d26/d3a/d14/d2d/c79 0 2024-09-06T14:44:44.263 INFO:tasks.workunit.client.0.smithi052.stdout:6/309: write d2/dd/d18/d4b/f58 [229619,44501] 0 2024-09-06T14:44:44.267 INFO:tasks.workunit.client.0.smithi052.stdout:0/354: truncate d0/d1a/d26/d3a/d14/d20/f2f 4077197 0 2024-09-06T14:44:44.268 INFO:tasks.workunit.client.0.smithi052.stdout:6/310: read d2/dd/d18/f31 [53086,125862] 0 2024-09-06T14:44:44.273 INFO:tasks.workunit.client.0.smithi052.stdout:6/311: symlink d2/dd/d18/d25/d4c/l65 0 2024-09-06T14:44:44.277 INFO:tasks.workunit.client.0.smithi052.stdout:6/312: mknod d2/c66 0 2024-09-06T14:44:44.279 INFO:tasks.workunit.client.0.smithi052.stdout:6/313: symlink d2/dd/d18/d2d/d32/l67 0 2024-09-06T14:44:44.282 INFO:tasks.workunit.client.0.smithi052.stdout:0/355: truncate d0/fe 4832859 0 2024-09-06T14:44:44.283 INFO:tasks.workunit.client.0.smithi052.stdout:0/356: readlink d0/d1a/d26/d3a/d14/d20/d22/d41/l45 0 2024-09-06T14:44:44.284 INFO:tasks.workunit.client.0.smithi052.stdout:0/357: dread - d0/d1a/d26/d3a/d14/d20/d22/d5b/f62 zero size 2024-09-06T14:44:44.287 INFO:tasks.workunit.client.0.smithi052.stdout:0/358: mkdir d0/d1a/d26/d3a/d7a 0 2024-09-06T14:44:44.288 INFO:tasks.workunit.client.0.smithi052.stdout:6/314: link d2/dd/d18/d2d/d32/c5f d2/dd/d18/d25/c68 0 2024-09-06T14:44:44.292 INFO:tasks.workunit.client.0.smithi052.stdout:6/315: creat d2/dd/d18/d33/f69 x:0 0 0 2024-09-06T14:44:44.294 INFO:tasks.workunit.client.0.smithi052.stdout:0/359: dwrite d0/d19/f72 [0,4194304] 0 2024-09-06T14:44:44.298 INFO:tasks.workunit.client.0.smithi052.stdout:6/316: mkdir d2/dd/d18/d25/d6a 0 2024-09-06T14:44:44.303 INFO:tasks.workunit.client.0.smithi052.stdout:0/360: creat d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63/f7b x:0 0 0 2024-09-06T14:44:44.304 INFO:tasks.workunit.client.0.smithi052.stdout:0/361: chown d0/d1a/d26/d3a/d14/d20 9044032 1 2024-09-06T14:44:44.305 INFO:tasks.workunit.client.0.smithi052.stdout:6/317: rename d2/c2e to d2/dd/d18/c6b 0 2024-09-06T14:44:44.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/318: truncate d2/dd/d18/d33/f69 212602 0 2024-09-06T14:44:44.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/319: stat d2/dd 0 2024-09-06T14:44:44.310 INFO:tasks.workunit.client.0.smithi052.stdout:6/320: chown d2/l6 1 1 2024-09-06T14:44:44.312 INFO:tasks.workunit.client.0.smithi052.stdout:0/362: dwrite d0/d19/f59 [0,4194304] 0 2024-09-06T14:44:44.322 INFO:tasks.workunit.client.0.smithi052.stdout:6/321: link d2/dd/d18/d2d/d32/c5f d2/dd/d18/d25/c6c 0 2024-09-06T14:44:44.324 INFO:tasks.workunit.client.0.smithi052.stdout:6/322: write d2/d4a/f5b [4421281,58124] 0 2024-09-06T14:44:44.331 INFO:tasks.workunit.client.0.smithi052.stdout:6/323: dwrite d2/f3d [0,4194304] 0 2024-09-06T14:44:44.335 INFO:tasks.workunit.client.0.smithi052.stdout:0/363: truncate d0/d1a/d26/d3a/d14/d2d/f11 3337220 0 2024-09-06T14:44:44.339 INFO:tasks.workunit.client.0.smithi052.stdout:0/364: symlink d0/d1a/d26/l7c 0 2024-09-06T14:44:44.340 INFO:tasks.workunit.client.0.smithi052.stdout:6/324: creat d2/dd/d18/f6d x:0 0 0 2024-09-06T14:44:44.340 INFO:tasks.workunit.client.0.smithi052.stdout:0/365: chown d0/d1a/d26/d3a/d14 39187413 1 2024-09-06T14:44:44.342 INFO:tasks.workunit.client.0.smithi052.stdout:6/325: mkdir d2/d4a/d6e 0 2024-09-06T14:44:44.346 INFO:tasks.workunit.client.0.smithi052.stdout:0/366: rename d0/d1a/d26/d3a/d14/d20/d22/d5b to d0/d4f/d7d 0 2024-09-06T14:44:44.346 INFO:tasks.workunit.client.0.smithi052.stdout:6/326: chown d2/dd/d18/d2d/f38 1675729 1 2024-09-06T14:44:44.347 INFO:tasks.workunit.client.0.smithi052.stdout:0/367: truncate d0/d4f/d7d/f74 1000238 0 2024-09-06T14:44:44.348 INFO:tasks.workunit.client.0.smithi052.stdout:0/368: chown d0/d2e/l3b 26519305 1 2024-09-06T14:44:44.348 INFO:tasks.workunit.client.0.smithi052.stdout:6/327: symlink d2/d4a/l6f 0 2024-09-06T14:44:44.349 INFO:tasks.workunit.client.0.smithi052.stdout:6/328: write d2/f3d [1249478,27479] 0 2024-09-06T14:44:44.352 INFO:tasks.workunit.client.0.smithi052.stdout:0/369: mkdir d0/d7e 0 2024-09-06T14:44:44.356 INFO:tasks.workunit.client.0.smithi052.stdout:0/370: mkdir d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63/d7f 0 2024-09-06T14:44:44.363 INFO:tasks.workunit.client.0.smithi052.stdout:0/371: link d0/fe d0/d19/f80 0 2024-09-06T14:44:44.366 INFO:tasks.workunit.client.0.smithi052.stdout:0/372: unlink d0/d4f/d7d/f74 0 2024-09-06T14:44:44.367 INFO:tasks.workunit.client.0.smithi052.stdout:6/329: dwrite d2/fb [0,4194304] 0 2024-09-06T14:44:44.372 INFO:tasks.workunit.client.0.smithi052.stdout:0/373: rename d0/d1a/d26/c39 to d0/d1a/d26/d3a/d14/d2d/d56/d5d/d60/c81 0 2024-09-06T14:44:44.376 INFO:tasks.workunit.client.0.smithi052.stdout:0/374: symlink d0/d1a/d26/d3a/d14/d2d/d56/d5d/l82 0 2024-09-06T14:44:44.377 INFO:tasks.workunit.client.0.smithi052.stdout:0/375: readlink d0/d1a/d26/d3a/d14/d2d/d56/d5d/d60/l77 0 2024-09-06T14:44:44.378 INFO:tasks.workunit.client.0.smithi052.stdout:6/330: link d2/c45 d2/dd/c70 0 2024-09-06T14:44:44.380 INFO:tasks.workunit.client.0.smithi052.stdout:0/376: creat d0/d1a/d26/d3a/d14/d2d/f83 x:0 0 0 2024-09-06T14:44:44.381 INFO:tasks.workunit.client.0.smithi052.stdout:6/331: rmdir d2/dd/d18/d4b 39 2024-09-06T14:44:44.382 INFO:tasks.workunit.client.0.smithi052.stdout:0/377: creat d0/d1a/d26/f84 x:0 0 0 2024-09-06T14:44:44.392 INFO:tasks.workunit.client.0.smithi052.stdout:6/332: write d2/dd/d18/d2d/f38 [817265,81965] 0 2024-09-06T14:44:44.395 INFO:tasks.workunit.client.0.smithi052.stdout:6/333: mkdir d2/dd/d18/d2d/d71 0 2024-09-06T14:44:44.399 INFO:tasks.workunit.client.0.smithi052.stdout:0/378: dwrite d0/d1a/d26/d3a/d14/d20/d22/d41/f64 [4194304,4194304] 0 2024-09-06T14:44:44.404 INFO:tasks.workunit.client.0.smithi052.stdout:0/379: symlink d0/d1a/d26/d3a/d14/d2d/d56/l85 0 2024-09-06T14:44:44.409 INFO:tasks.workunit.client.0.smithi052.stdout:0/380: fdatasync d0/d1a/d26/d3a/d14/d20/f2f 0 2024-09-06T14:44:44.414 INFO:tasks.workunit.client.0.smithi052.stdout:0/381: creat d0/d4f/d7d/f86 x:0 0 0 2024-09-06T14:44:44.417 INFO:tasks.workunit.client.0.smithi052.stdout:0/382: creat d0/d1a/d26/f87 x:0 0 0 2024-09-06T14:44:44.418 INFO:tasks.workunit.client.0.smithi052.stdout:0/383: chown d0/d1a/d26/d3a/d14 254 1 2024-09-06T14:44:44.421 INFO:tasks.workunit.client.0.smithi052.stdout:0/384: dread d0/d18/f50 [0,4194304] 0 2024-09-06T14:44:44.433 INFO:tasks.workunit.client.0.smithi052.stdout:0/385: getdents d0/d4f 0 2024-09-06T14:44:44.434 INFO:tasks.workunit.client.0.smithi052.stdout:0/386: chown d0/d1a/d26/d3a/d14/f3e 3091770 1 2024-09-06T14:44:44.435 INFO:tasks.workunit.client.0.smithi052.stdout:0/387: readlink d0/d1a/d26/d3a/d14/d2d/l1b 0 2024-09-06T14:44:44.438 INFO:tasks.workunit.client.0.smithi052.stdout:0/388: creat d0/d1a/d26/d3a/f88 x:0 0 0 2024-09-06T14:44:44.440 INFO:tasks.workunit.client.0.smithi052.stdout:0/389: symlink d0/d19/l89 0 2024-09-06T14:44:44.442 INFO:tasks.workunit.client.0.smithi052.stdout:0/390: mkdir d0/d1a/d26/d3a/d14/d20/d22/d41/d8a 0 2024-09-06T14:44:44.454 INFO:tasks.workunit.client.0.smithi052.stdout:0/391: dread d0/d1a/d26/d3a/d14/d20/d22/d41/f4c [4194304,4194304] 0 2024-09-06T14:44:44.456 INFO:tasks.workunit.client.0.smithi052.stdout:0/392: mkdir d0/d1a/d26/d3a/d14/d20/d22/d8b 0 2024-09-06T14:44:44.457 INFO:tasks.workunit.client.0.smithi052.stdout:0/393: write d0/d1a/d26/d3a/d14/d2d/d56/f73 [1003154,110649] 0 2024-09-06T14:44:44.472 INFO:tasks.workunit.client.0.smithi052.stdout:0/394: write d0/d1a/d26/f27 [3952418,111648] 0 2024-09-06T14:44:44.476 INFO:tasks.workunit.client.0.smithi052.stdout:0/395: mkdir d0/d1a/d26/d3a/d14/d20/d22/d55/d8c 0 2024-09-06T14:44:44.482 INFO:tasks.workunit.client.0.smithi052.stdout:4/307: sync 2024-09-06T14:44:44.483 INFO:tasks.workunit.client.0.smithi052.stdout:0/396: dwrite d0/d1a/d26/d3a/d14/d20/d22/f6a [0,4194304] 0 2024-09-06T14:44:44.485 INFO:tasks.workunit.client.0.smithi052.stdout:0/397: chown d0/d1a/d26/d3a/d14/d2d/f33 48 1 2024-09-06T14:44:44.487 INFO:tasks.workunit.client.0.smithi052.stdout:0/398: write d0/d1a/d26/d3a/d14/d2d/d56/f73 [898334,30595] 0 2024-09-06T14:44:44.490 INFO:tasks.workunit.client.0.smithi052.stdout:4/308: dwrite d9/d10/d17/f51 [0,4194304] 0 2024-09-06T14:44:44.495 INFO:tasks.workunit.client.0.smithi052.stdout:0/399: creat d0/f8d x:0 0 0 2024-09-06T14:44:44.500 INFO:tasks.workunit.client.0.smithi052.stdout:0/400: rename d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63/d7f to d0/d1a/d8e 0 2024-09-06T14:44:44.502 INFO:tasks.workunit.client.0.smithi052.stdout:0/401: read d0/d18/f50 [637077,8047] 0 2024-09-06T14:44:44.509 INFO:tasks.workunit.client.0.smithi052.stdout:0/402: dwrite d0/d1a/f40 [4194304,4194304] 0 2024-09-06T14:44:44.510 INFO:tasks.workunit.client.0.smithi052.stdout:4/309: dread d9/d10/f22 [0,4194304] 0 2024-09-06T14:44:44.511 INFO:tasks.workunit.client.0.smithi052.stdout:0/403: symlink d0/d1a/l8f 0 2024-09-06T14:44:44.514 INFO:tasks.workunit.client.0.smithi052.stdout:4/310: symlink d9/l70 0 2024-09-06T14:44:44.515 INFO:tasks.workunit.client.0.smithi052.stdout:0/404: mknod d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63/c90 0 2024-09-06T14:44:44.519 INFO:tasks.workunit.client.0.smithi052.stdout:4/311: mkdir d9/d10/d17/d39/d3a/d5c/d71 0 2024-09-06T14:44:44.519 INFO:tasks.workunit.client.0.smithi052.stdout:4/312: stat d9/d10/d17/f42 0 2024-09-06T14:44:44.519 INFO:tasks.workunit.client.0.smithi052.stdout:0/405: creat d0/d19/d29/f91 x:0 0 0 2024-09-06T14:44:44.521 INFO:tasks.workunit.client.0.smithi052.stdout:0/406: mkdir d0/d1a/d26/d3a/d14/d2d/d92 0 2024-09-06T14:44:44.525 INFO:tasks.workunit.client.0.smithi052.stdout:0/407: rename d0/d18/c4d to d0/d1a/d26/d3a/d14/d20/d22/d55/c93 0 2024-09-06T14:44:44.525 INFO:tasks.workunit.client.0.smithi052.stdout:4/313: getdents d9/d10/d17/d39/d3a 0 2024-09-06T14:44:44.526 INFO:tasks.workunit.client.0.smithi052.stdout:0/408: mkdir d0/d1a/d26/d3a/d14/d2d/d94 0 2024-09-06T14:44:44.528 INFO:tasks.workunit.client.0.smithi052.stdout:0/409: creat d0/d4f/f95 x:0 0 0 2024-09-06T14:44:44.529 INFO:tasks.workunit.client.0.smithi052.stdout:4/314: rmdir d9/d10/d17/d39/d3a/d5c/d71 0 2024-09-06T14:44:44.531 INFO:tasks.workunit.client.0.smithi052.stdout:0/410: rmdir d0/d1a/d26/d3a/d14/d20/d22/d55 39 2024-09-06T14:44:44.534 INFO:tasks.workunit.client.0.smithi052.stdout:4/315: write d9/f5f [477035,7830] 0 2024-09-06T14:44:44.535 INFO:tasks.workunit.client.0.smithi052.stdout:0/411: rename d0/d1a/d26/d3a/d14/d2d/d56/d5d/l82 to d0/d18/l96 0 2024-09-06T14:44:44.536 INFO:tasks.workunit.client.0.smithi052.stdout:0/412: write d0/d4f/d7d/f76 [469527,84366] 0 2024-09-06T14:44:44.538 INFO:tasks.workunit.client.0.smithi052.stdout:0/413: read - d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63/f7b zero size 2024-09-06T14:44:44.538 INFO:tasks.workunit.client.0.smithi052.stdout:4/316: mkdir d9/d72 0 2024-09-06T14:44:44.543 INFO:tasks.workunit.client.0.smithi052.stdout:4/317: mknod d9/d2d/d33/d5d/c73 0 2024-09-06T14:44:44.547 INFO:tasks.workunit.client.0.smithi052.stdout:4/318: rmdir d9/d10/d19/d41 39 2024-09-06T14:44:44.550 INFO:tasks.workunit.client.0.smithi052.stdout:4/319: creat d9/d10/f74 x:0 0 0 2024-09-06T14:44:44.556 INFO:tasks.workunit.client.0.smithi052.stdout:0/414: dread d0/d1a/d26/d3a/d14/d20/d22/d41/f4c [0,4194304] 0 2024-09-06T14:44:44.556 INFO:tasks.workunit.client.0.smithi052.stdout:4/320: dwrite d9/f65 [0,4194304] 0 2024-09-06T14:44:44.558 INFO:tasks.workunit.client.0.smithi052.stdout:0/415: readlink d0/d1a/l3f 0 2024-09-06T14:44:44.564 INFO:tasks.workunit.client.0.smithi052.stdout:4/321: dwrite d9/d10/d17/d39/f58 [0,4194304] 0 2024-09-06T14:44:44.564 INFO:tasks.workunit.client.0.smithi052.stdout:0/416: dwrite d0/d18/f5f [0,4194304] 0 2024-09-06T14:44:44.566 INFO:tasks.workunit.client.0.smithi052.stdout:4/322: dread d9/d2d/f4a [0,4194304] 0 2024-09-06T14:44:44.566 INFO:tasks.workunit.client.0.smithi052.stdout:0/417: chown d0/d1a/d26/d3a/d14/d20/d22/l3c 4883943 1 2024-09-06T14:44:44.568 INFO:tasks.workunit.client.0.smithi052.stdout:0/418: write d0/d1a/d26/f87 [257831,72964] 0 2024-09-06T14:44:44.570 INFO:tasks.workunit.client.0.smithi052.stdout:0/419: write d0/d1a/d26/d3a/d14/d20/d22/f6a [252031,119857] 0 2024-09-06T14:44:44.596 INFO:tasks.workunit.client.0.smithi052.stdout:0/420: mknod d0/d4f/c97 0 2024-09-06T14:44:44.597 INFO:tasks.workunit.client.0.smithi052.stdout:0/421: write d0/d4f/d7d/f5c [870544,68627] 0 2024-09-06T14:44:44.600 INFO:tasks.workunit.client.0.smithi052.stdout:4/323: creat d9/d10/d19/d41/f75 x:0 0 0 2024-09-06T14:44:44.602 INFO:tasks.workunit.client.0.smithi052.stdout:4/324: chown d9/d10/d17/c56 45 1 2024-09-06T14:44:44.604 INFO:tasks.workunit.client.0.smithi052.stdout:0/422: link d0/c71 d0/d1a/c98 0 2024-09-06T14:44:44.606 INFO:tasks.workunit.client.0.smithi052.stdout:0/423: creat d0/d3d/f99 x:0 0 0 2024-09-06T14:44:44.607 INFO:tasks.workunit.client.0.smithi052.stdout:4/325: dread d9/d10/f4f [0,4194304] 0 2024-09-06T14:44:44.608 INFO:tasks.workunit.client.0.smithi052.stdout:0/424: unlink d0/d2e/l3b 0 2024-09-06T14:44:44.609 INFO:tasks.workunit.client.0.smithi052.stdout:0/425: chown d0/d1a/d26/d3a/d14/d20/d22/d41/d8a 450342 1 2024-09-06T14:44:44.610 INFO:tasks.workunit.client.0.smithi052.stdout:4/326: creat d9/d2d/d33/d4d/f76 x:0 0 0 2024-09-06T14:44:44.612 INFO:tasks.workunit.client.0.smithi052.stdout:4/327: mknod d9/d10/d17/d39/c77 0 2024-09-06T14:44:44.618 INFO:tasks.workunit.client.0.smithi052.stdout:0/426: mkdir d0/d1a/d26/d3a/d14/d20/d22/d55/d8c/d9a 0 2024-09-06T14:44:44.619 INFO:tasks.workunit.client.0.smithi052.stdout:4/328: mknod d9/c78 0 2024-09-06T14:44:44.621 INFO:tasks.workunit.client.0.smithi052.stdout:4/329: symlink d9/d72/l79 0 2024-09-06T14:44:44.623 INFO:tasks.workunit.client.0.smithi052.stdout:4/330: chown d9/d2d/d33/d5d/c73 25530 1 2024-09-06T14:44:44.624 INFO:tasks.workunit.client.0.smithi052.stdout:0/427: dwrite d0/f8d [0,4194304] 0 2024-09-06T14:44:44.625 INFO:tasks.workunit.client.0.smithi052.stdout:4/331: dread - d9/d2d/d33/d4d/f76 zero size 2024-09-06T14:44:44.626 INFO:tasks.workunit.client.0.smithi052.stdout:4/332: chown d9/d10/d19/f48 50140102 1 2024-09-06T14:44:44.627 INFO:tasks.workunit.client.0.smithi052.stdout:0/428: chown d0/d2e/c49 64 1 2024-09-06T14:44:44.629 INFO:tasks.workunit.client.0.smithi052.stdout:4/333: truncate d9/f38 360767 0 2024-09-06T14:44:44.633 INFO:tasks.workunit.client.0.smithi052.stdout:4/334: dread d9/d2d/d33/f44 [0,4194304] 0 2024-09-06T14:44:44.633 INFO:tasks.workunit.client.0.smithi052.stdout:0/429: mknod d0/d1a/d26/d3a/d14/d20/d22/d41/d8a/c9b 0 2024-09-06T14:44:44.634 INFO:tasks.workunit.client.0.smithi052.stdout:0/430: readlink d0/d1a/d26/d3a/d14/l66 0 2024-09-06T14:44:44.638 INFO:tasks.workunit.client.0.smithi052.stdout:0/431: getdents d0/d1a/d26/d3a/d14/d20/d22/d55/d8c/d9a 0 2024-09-06T14:44:44.762 INFO:tasks.workunit.client.0.smithi052.stdout:4/335: rename d9/d10/d17/d39/c77 to d9/d10/d17/c7a 0 2024-09-06T14:44:44.814 INFO:tasks.workunit.client.0.smithi052.stdout:2/353: sync 2024-09-06T14:44:44.817 INFO:tasks.workunit.client.0.smithi052.stdout:4/336: mkdir d9/d10/d17/d39/d7b 0 2024-09-06T14:44:44.821 INFO:tasks.workunit.client.0.smithi052.stdout:0/432: link d0/d1a/d26/f27 d0/d2e/f9c 0 2024-09-06T14:44:44.827 INFO:tasks.workunit.client.0.smithi052.stdout:2/354: mkdir da/db/d18/d7f 0 2024-09-06T14:44:44.827 INFO:tasks.workunit.client.0.smithi052.stdout:4/337: stat d9/c11 0 2024-09-06T14:44:44.829 INFO:tasks.workunit.client.0.smithi052.stdout:0/433: rename d0/d1a/d26/d3a/d14/d20/d22/d55/d8c to d0/d1a/d26/d3a/d14/d2d/d56/d9d 0 2024-09-06T14:44:44.833 INFO:tasks.workunit.client.0.smithi052.stdout:2/355: write da/f11 [5218626,56142] 0 2024-09-06T14:44:44.835 INFO:tasks.workunit.client.0.smithi052.stdout:4/338: mknod d9/d2d/d33/c7c 0 2024-09-06T14:44:44.835 INFO:tasks.workunit.client.0.smithi052.stdout:2/356: write da/d2d/d34/d62/f79 [477525,5866] 0 2024-09-06T14:44:44.837 INFO:tasks.workunit.client.0.smithi052.stdout:4/339: write d9/d10/d19/d41/f75 [75227,64562] 0 2024-09-06T14:44:44.840 INFO:tasks.workunit.client.0.smithi052.stdout:2/357: creat da/db/d60/f80 x:0 0 0 2024-09-06T14:44:44.842 INFO:tasks.workunit.client.0.smithi052.stdout:0/434: link d0/d1a/d26/d3a/l2c d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63/l9e 0 2024-09-06T14:44:44.843 INFO:tasks.workunit.client.0.smithi052.stdout:4/340: rename d9/c21 to d9/d10/d17/d39/d3a/c7d 0 2024-09-06T14:44:44.845 INFO:tasks.workunit.client.0.smithi052.stdout:0/435: symlink d0/d1a/d26/d3a/d14/d2d/d56/d5d/l9f 0 2024-09-06T14:44:44.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/341: link d9/d2d/d33/d5d/c73 d9/d10/d17/d39/d3a/d5c/c7e 0 2024-09-06T14:44:44.851 INFO:tasks.workunit.client.0.smithi052.stdout:4/342: truncate d9/d2d/f63 1106906 0 2024-09-06T14:44:44.852 INFO:tasks.workunit.client.0.smithi052.stdout:4/343: chown d9/d10/d19/d41 0 1 2024-09-06T14:44:44.853 INFO:tasks.workunit.client.0.smithi052.stdout:4/344: write d9/d10/f6e [194046,79973] 0 2024-09-06T14:44:44.855 INFO:tasks.workunit.client.0.smithi052.stdout:4/345: read d9/d2d/d33/f3f [233818,86699] 0 2024-09-06T14:44:44.856 INFO:tasks.workunit.client.0.smithi052.stdout:2/358: dread da/db/d18/f3c [0,4194304] 0 2024-09-06T14:44:44.856 INFO:tasks.workunit.client.0.smithi052.stdout:4/346: readlink d9/d10/d17/l26 0 2024-09-06T14:44:44.857 INFO:tasks.workunit.client.0.smithi052.stdout:4/347: chown d9/d2d/f30 7276835 1 2024-09-06T14:44:44.857 INFO:tasks.workunit.client.0.smithi052.stdout:2/359: chown da/d2d/d34/d62/f79 0 1 2024-09-06T14:44:44.858 INFO:tasks.workunit.client.0.smithi052.stdout:2/360: chown da/db/l5c 3402 1 2024-09-06T14:44:44.858 INFO:tasks.workunit.client.0.smithi052.stdout:2/361: readlink da/ld 0 2024-09-06T14:44:44.859 INFO:tasks.workunit.client.0.smithi052.stdout:4/348: readlink d9/d10/d19/l45 0 2024-09-06T14:44:44.859 INFO:tasks.workunit.client.0.smithi052.stdout:4/349: chown d9/d10/d17/d39/c4e 1036 1 2024-09-06T14:44:44.861 INFO:tasks.workunit.client.0.smithi052.stdout:2/362: mknod da/d2d/d34/c81 0 2024-09-06T14:44:44.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/363: dread - da/d19/d3a/d31/d76/d6a/f7c zero size 2024-09-06T14:44:44.863 INFO:tasks.workunit.client.0.smithi052.stdout:4/350: dread d9/d10/d17/f51 [0,4194304] 0 2024-09-06T14:44:44.865 INFO:tasks.workunit.client.0.smithi052.stdout:4/351: truncate d9/d10/d17/f42 934547 0 2024-09-06T14:44:44.867 INFO:tasks.workunit.client.0.smithi052.stdout:4/352: creat d9/d10/d17/d39/d3a/d5c/f7f x:0 0 0 2024-09-06T14:44:44.880 INFO:tasks.workunit.client.0.smithi052.stdout:4/353: dread d9/d2d/d33/f37 [0,4194304] 0 2024-09-06T14:44:44.882 INFO:tasks.workunit.client.0.smithi052.stdout:4/354: rename d9/d10/d19/l45 to d9/d2d/d33/d5d/l80 0 2024-09-06T14:44:44.885 INFO:tasks.workunit.client.0.smithi052.stdout:4/355: dread d9/d10/d19/f29 [0,4194304] 0 2024-09-06T14:44:44.887 INFO:tasks.workunit.client.0.smithi052.stdout:4/356: read d9/d10/d19/f48 [452898,30312] 0 2024-09-06T14:44:44.889 INFO:tasks.workunit.client.0.smithi052.stdout:4/357: mkdir d9/d2d/d33/d4d/d81 0 2024-09-06T14:44:44.894 INFO:tasks.workunit.client.0.smithi052.stdout:4/358: link d9/l16 d9/d10/d17/d39/d3a/d5c/l82 0 2024-09-06T14:44:44.896 INFO:tasks.workunit.client.0.smithi052.stdout:4/359: mkdir d9/d10/d19/d41/d83 0 2024-09-06T14:44:44.903 INFO:tasks.workunit.client.0.smithi052.stdout:4/360: truncate d9/d10/d19/f48 109983 0 2024-09-06T14:44:44.904 INFO:tasks.workunit.client.0.smithi052.stdout:4/361: read d9/d10/d17/f23 [79991,43141] 0 2024-09-06T14:44:44.905 INFO:tasks.workunit.client.0.smithi052.stdout:4/362: chown d9/d2d 14979 1 2024-09-06T14:44:44.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/363: mkdir d9/d2d/d84 0 2024-09-06T14:44:44.913 INFO:tasks.workunit.client.0.smithi052.stdout:4/364: rename d9/d10/d17/d39/d3a/c50 to d9/d2d/d33/c85 0 2024-09-06T14:44:44.915 INFO:tasks.workunit.client.0.smithi052.stdout:4/365: unlink d9/d10/d17/f51 0 2024-09-06T14:44:44.917 INFO:tasks.workunit.client.0.smithi052.stdout:4/366: mknod d9/d2d/d84/c86 0 2024-09-06T14:44:44.931 INFO:tasks.workunit.client.0.smithi052.stdout:4/367: dwrite d9/d2d/f4a [0,4194304] 0 2024-09-06T14:44:44.937 INFO:tasks.workunit.client.0.smithi052.stdout:4/368: dwrite d9/d10/f1f [0,4194304] 0 2024-09-06T14:44:44.938 INFO:tasks.workunit.client.0.smithi052.stdout:4/369: write d9/d10/f74 [7414,717] 0 2024-09-06T14:44:44.939 INFO:tasks.workunit.client.0.smithi052.stdout:4/370: fdatasync f7 0 2024-09-06T14:44:44.941 INFO:tasks.workunit.client.0.smithi052.stdout:4/371: readlink d9/d10/d17/d39/d3a/d5c/l82 0 2024-09-06T14:44:45.122 INFO:tasks.workunit.client.0.smithi052.stdout:3/402: sync 2024-09-06T14:44:45.125 INFO:tasks.workunit.client.0.smithi052.stdout:3/403: rename d0/d11/d12/f30 to d0/d11/d12/d73/f78 0 2024-09-06T14:44:45.126 INFO:tasks.workunit.client.0.smithi052.stdout:3/404: creat d0/d11/f79 x:0 0 0 2024-09-06T14:44:45.128 INFO:tasks.workunit.client.0.smithi052.stdout:3/405: creat d0/d11/d12/d4c/d53/f7a x:0 0 0 2024-09-06T14:44:45.130 INFO:tasks.workunit.client.0.smithi052.stdout:3/406: mkdir d0/d11/d12/d17/d7b 0 2024-09-06T14:44:45.131 INFO:tasks.workunit.client.0.smithi052.stdout:3/407: write d0/fe [4134029,75333] 0 2024-09-06T14:44:45.135 INFO:tasks.workunit.client.0.smithi052.stdout:3/408: getdents d0/d11/d12/d4c/d53/d35/d46 0 2024-09-06T14:44:45.157 INFO:tasks.workunit.client.0.smithi052.stdout:9/274: sync 2024-09-06T14:44:45.157 INFO:tasks.workunit.client.0.smithi052.stdout:1/393: sync 2024-09-06T14:44:45.157 INFO:tasks.workunit.client.0.smithi052.stdout:7/312: sync 2024-09-06T14:44:45.158 INFO:tasks.workunit.client.0.smithi052.stdout:7/313: write d11/f14 [4997290,100292] 0 2024-09-06T14:44:45.160 INFO:tasks.workunit.client.0.smithi052.stdout:9/275: mknod d1/d26/d41/c4f 0 2024-09-06T14:44:45.161 INFO:tasks.workunit.client.0.smithi052.stdout:7/314: rmdir d11/d1c/d3f/d5d 39 2024-09-06T14:44:45.161 INFO:tasks.workunit.client.0.smithi052.stdout:9/276: fsync d1/d4/f43 0 2024-09-06T14:44:45.162 INFO:tasks.workunit.client.0.smithi052.stdout:1/394: truncate d1/db/de/d74/d14/d2e/f42 640551 0 2024-09-06T14:44:45.166 INFO:tasks.workunit.client.0.smithi052.stdout:7/315: read d11/d1c/f32 [169913,118229] 0 2024-09-06T14:44:45.167 INFO:tasks.workunit.client.0.smithi052.stdout:7/316: write d11/d1c/d3f/f54 [751300,14363] 0 2024-09-06T14:44:45.168 INFO:tasks.workunit.client.0.smithi052.stdout:9/277: dwrite d1/d4/d6/dd/d2b/f49 [0,4194304] 0 2024-09-06T14:44:45.168 INFO:tasks.workunit.client.0.smithi052.stdout:7/317: fdatasync d11/d1c/d24/f35 0 2024-09-06T14:44:45.171 INFO:tasks.workunit.client.0.smithi052.stdout:1/395: rename d1/db/de/d74/f73 to d1/db/de/d74/d14/d2e/f87 0 2024-09-06T14:44:45.178 INFO:tasks.workunit.client.0.smithi052.stdout:7/318: dwrite d11/d1c/d3f/f54 [4194304,4194304] 0 2024-09-06T14:44:45.181 INFO:tasks.workunit.client.0.smithi052.stdout:1/396: rename d1/db/de/d74/l6d to d1/db/d50/l88 0 2024-09-06T14:44:45.182 INFO:tasks.workunit.client.0.smithi052.stdout:1/397: chown d1/db/d18/f82 171246488 1 2024-09-06T14:44:45.184 INFO:tasks.workunit.client.0.smithi052.stdout:7/319: rename d11/d1c/d24/d4b/f6a to d11/d1c/d24/d3b/d50/f6d 0 2024-09-06T14:44:45.188 INFO:tasks.workunit.client.0.smithi052.stdout:1/398: mknod d1/c89 0 2024-09-06T14:44:45.191 INFO:tasks.workunit.client.0.smithi052.stdout:1/399: chown d1/db/de/d68/c71 69901 1 2024-09-06T14:44:45.193 INFO:tasks.workunit.client.0.smithi052.stdout:9/278: dread d1/d4/f43 [0,4194304] 0 2024-09-06T14:44:45.194 INFO:tasks.workunit.client.0.smithi052.stdout:7/320: dwrite d11/d1c/f1e [4194304,4194304] 0 2024-09-06T14:44:45.196 INFO:tasks.workunit.client.0.smithi052.stdout:1/400: read d1/db/de/d74/d12/f34 [1171452,109020] 0 2024-09-06T14:44:45.196 INFO:tasks.workunit.client.0.smithi052.stdout:7/321: write d11/d1c/d24/f41 [915025,130342] 0 2024-09-06T14:44:45.202 INFO:tasks.workunit.client.0.smithi052.stdout:7/322: rename ff to d11/d1c/d24/d3b/d50/f6e 0 2024-09-06T14:44:45.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/323: dread d11/d1c/f1e [4194304,4194304] 0 2024-09-06T14:44:45.206 INFO:tasks.workunit.client.0.smithi052.stdout:7/324: readlink d11/d1c/d57/l6b 0 2024-09-06T14:44:45.206 INFO:tasks.workunit.client.0.smithi052.stdout:7/325: readlink d11/l15 0 2024-09-06T14:44:45.209 INFO:tasks.workunit.client.0.smithi052.stdout:9/279: truncate d1/d4/d6/f35 2387179 0 2024-09-06T14:44:45.211 INFO:tasks.workunit.client.0.smithi052.stdout:9/280: write d1/d4/d6/dd/f48 [3621740,73974] 0 2024-09-06T14:44:45.212 INFO:tasks.workunit.client.0.smithi052.stdout:7/326: getdents d11 0 2024-09-06T14:44:45.216 INFO:tasks.workunit.client.0.smithi052.stdout:9/281: mkdir d1/d4/d6/dd/d50 0 2024-09-06T14:44:45.217 INFO:tasks.workunit.client.0.smithi052.stdout:1/401: dwrite d1/db/de/d74/d14/f1f [0,4194304] 0 2024-09-06T14:44:45.219 INFO:tasks.workunit.client.0.smithi052.stdout:9/282: chown d1/d4/d6/dd/f13 115066 1 2024-09-06T14:44:45.221 INFO:tasks.workunit.client.0.smithi052.stdout:7/327: dwrite d11/f39 [0,4194304] 0 2024-09-06T14:44:45.223 INFO:tasks.workunit.client.0.smithi052.stdout:1/402: creat d1/db/de/d74/d12/f8a x:0 0 0 2024-09-06T14:44:45.230 INFO:tasks.workunit.client.0.smithi052.stdout:7/328: rmdir d11/d1c/d3f 39 2024-09-06T14:44:45.233 INFO:tasks.workunit.client.0.smithi052.stdout:1/403: symlink d1/db/d72/d81/l8b 0 2024-09-06T14:44:45.234 INFO:tasks.workunit.client.0.smithi052.stdout:9/283: truncate d1/d4/f7 3657189 0 2024-09-06T14:44:45.235 INFO:tasks.workunit.client.0.smithi052.stdout:9/284: chown d1/d4/d6/dc/d10/d18 955671 1 2024-09-06T14:44:45.239 INFO:tasks.workunit.client.0.smithi052.stdout:1/404: creat d1/db/de/d74/d3e/f8c x:0 0 0 2024-09-06T14:44:45.239 INFO:tasks.workunit.client.0.smithi052.stdout:1/405: readlink d1/l11 0 2024-09-06T14:44:45.246 INFO:tasks.workunit.client.0.smithi052.stdout:1/406: mknod d1/db/de/d74/d3e/c8d 0 2024-09-06T14:44:45.249 INFO:tasks.workunit.client.0.smithi052.stdout:1/407: unlink d1/db/de/d74/d36/f3c 0 2024-09-06T14:44:45.249 INFO:tasks.workunit.client.0.smithi052.stdout:9/285: link c0 d1/d4/d6/dc/d45/c51 0 2024-09-06T14:44:45.250 INFO:tasks.workunit.client.0.smithi052.stdout:7/329: link d11/c20 d11/d1c/d24/c6f 0 2024-09-06T14:44:45.250 INFO:tasks.workunit.client.0.smithi052.stdout:9/286: fsync d1/f37 0 2024-09-06T14:44:45.251 INFO:tasks.workunit.client.0.smithi052.stdout:1/408: symlink d1/db/de/d68/l8e 0 2024-09-06T14:44:45.256 INFO:tasks.workunit.client.0.smithi052.stdout:1/409: dread d1/db/de/d74/d3e/f44 [0,4194304] 0 2024-09-06T14:44:45.259 INFO:tasks.workunit.client.0.smithi052.stdout:7/330: dwrite d11/d1c/d3f/f54 [0,4194304] 0 2024-09-06T14:44:45.260 INFO:tasks.workunit.client.0.smithi052.stdout:7/331: chown d11/d1c/f32 501624570 1 2024-09-06T14:44:45.268 INFO:tasks.workunit.client.0.smithi052.stdout:9/287: rmdir d1/d4/d6/dd/d50 0 2024-09-06T14:44:45.274 INFO:tasks.workunit.client.0.smithi052.stdout:1/410: dread d1/db/de/d74/d3e/d47/f6e [0,4194304] 0 2024-09-06T14:44:45.276 INFO:tasks.workunit.client.0.smithi052.stdout:1/411: mknod d1/db/de/d74/d12/c8f 0 2024-09-06T14:44:45.277 INFO:tasks.workunit.client.0.smithi052.stdout:7/332: link cb d11/d1c/d26/c70 0 2024-09-06T14:44:45.280 INFO:tasks.workunit.client.0.smithi052.stdout:7/333: mkdir d11/d1c/d24/d71 0 2024-09-06T14:44:45.281 INFO:tasks.workunit.client.0.smithi052.stdout:7/334: chown d11/d1c/f1f 58 1 2024-09-06T14:44:45.282 INFO:tasks.workunit.client.0.smithi052.stdout:9/288: write d1/d4/d6/dd/d2b/f2e [2594286,52328] 0 2024-09-06T14:44:45.283 INFO:tasks.workunit.client.0.smithi052.stdout:7/335: truncate d11/d1c/d24/d4b/f63 810606 0 2024-09-06T14:44:45.287 INFO:tasks.workunit.client.0.smithi052.stdout:9/289: dread d1/d4/d6/dd/d2b/f49 [0,4194304] 0 2024-09-06T14:44:45.288 INFO:tasks.workunit.client.0.smithi052.stdout:7/336: dread d11/f23 [0,4194304] 0 2024-09-06T14:44:45.293 INFO:tasks.workunit.client.0.smithi052.stdout:7/337: creat d11/d1c/d3f/f72 x:0 0 0 2024-09-06T14:44:45.293 INFO:tasks.workunit.client.0.smithi052.stdout:9/290: dwrite d1/d26/d3d/f4a [0,4194304] 0 2024-09-06T14:44:45.301 INFO:tasks.workunit.client.0.smithi052.stdout:7/338: rmdir d11/d1c/d24/d71 0 2024-09-06T14:44:45.301 INFO:tasks.workunit.client.0.smithi052.stdout:9/291: link d1/d4/d6/dc/l3b d1/d4/d6/dc/d10/d18/l52 0 2024-09-06T14:44:45.302 INFO:tasks.workunit.client.0.smithi052.stdout:9/292: write d1/d4/d6/dd/f48 [4819815,3783] 0 2024-09-06T14:44:45.306 INFO:tasks.workunit.client.0.smithi052.stdout:9/293: truncate d1/d4/f7 2943090 0 2024-09-06T14:44:45.314 INFO:tasks.workunit.client.0.smithi052.stdout:9/294: getdents d1/d26/d41 0 2024-09-06T14:44:45.315 INFO:tasks.workunit.client.0.smithi052.stdout:7/339: truncate d11/d1c/f1d 2713467 0 2024-09-06T14:44:45.316 INFO:tasks.workunit.client.0.smithi052.stdout:7/340: chown d11/d1c/d3f/f72 3 1 2024-09-06T14:44:45.316 INFO:tasks.workunit.client.0.smithi052.stdout:9/295: fsync d1/f23 0 2024-09-06T14:44:45.318 INFO:tasks.workunit.client.0.smithi052.stdout:7/341: mkdir d11/d1c/d3f/d73 0 2024-09-06T14:44:45.321 INFO:tasks.workunit.client.0.smithi052.stdout:7/342: mkdir d11/d1c/d57/d74 0 2024-09-06T14:44:45.324 INFO:tasks.workunit.client.0.smithi052.stdout:9/296: mknod d1/c53 0 2024-09-06T14:44:45.329 INFO:tasks.workunit.client.0.smithi052.stdout:9/297: dwrite d1/d4/d6/dd/f48 [0,4194304] 0 2024-09-06T14:44:45.336 INFO:tasks.workunit.client.0.smithi052.stdout:8/484: sync 2024-09-06T14:44:45.337 INFO:tasks.workunit.client.0.smithi052.stdout:7/343: dread d11/d1c/d24/d4b/f4e [0,4194304] 0 2024-09-06T14:44:45.339 INFO:tasks.workunit.client.0.smithi052.stdout:9/298: write d1/d4/d6/dc/d10/d18/f33 [3860863,35323] 0 2024-09-06T14:44:45.343 INFO:tasks.workunit.client.0.smithi052.stdout:8/485: symlink d6/d9/d1f/d19/la4 0 2024-09-06T14:44:45.344 INFO:tasks.workunit.client.0.smithi052.stdout:8/486: fdatasync d6/d16/f6b 0 2024-09-06T14:44:45.345 INFO:tasks.workunit.client.0.smithi052.stdout:7/344: unlink d11/d1c/d3f/c62 0 2024-09-06T14:44:45.346 INFO:tasks.workunit.client.0.smithi052.stdout:8/487: read d6/d9/df/d41/d71/f81 [296601,126418] 0 2024-09-06T14:44:45.346 INFO:tasks.workunit.client.0.smithi052.stdout:9/299: mknod d1/c54 0 2024-09-06T14:44:45.347 INFO:tasks.workunit.client.0.smithi052.stdout:9/300: readlink d1/l42 0 2024-09-06T14:44:45.350 INFO:tasks.workunit.client.0.smithi052.stdout:7/345: chown d11/d1c/d26/c51 3 1 2024-09-06T14:44:45.358 INFO:tasks.workunit.client.0.smithi052.stdout:8/488: dread d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:45.359 INFO:tasks.workunit.client.0.smithi052.stdout:8/489: dread - d6/d9/f9d zero size 2024-09-06T14:44:45.364 INFO:tasks.workunit.client.0.smithi052.stdout:8/490: mknod d6/d9/ca5 0 2024-09-06T14:44:45.364 INFO:tasks.workunit.client.0.smithi052.stdout:9/301: dwrite d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:45.367 INFO:tasks.workunit.client.0.smithi052.stdout:7/346: link d11/d1c/d24/c6f d11/d1c/d24/c75 0 2024-09-06T14:44:45.369 INFO:tasks.workunit.client.0.smithi052.stdout:9/302: mknod d1/d4/df/c55 0 2024-09-06T14:44:45.371 INFO:tasks.workunit.client.0.smithi052.stdout:9/303: fdatasync d1/d4/d6/dc/d10/d18/f33 0 2024-09-06T14:44:45.372 INFO:tasks.workunit.client.0.smithi052.stdout:8/491: dwrite d6/d22/f3a [0,4194304] 0 2024-09-06T14:44:45.378 INFO:tasks.workunit.client.0.smithi052.stdout:7/347: link d11/f21 d11/d1c/d57/f76 0 2024-09-06T14:44:45.386 INFO:tasks.workunit.client.0.smithi052.stdout:7/348: unlink ce 0 2024-09-06T14:44:45.388 INFO:tasks.workunit.client.0.smithi052.stdout:8/492: mknod d6/d22/ca6 0 2024-09-06T14:44:45.389 INFO:tasks.workunit.client.0.smithi052.stdout:8/493: chown d6/d22/d31/d5b/c82 8450660 1 2024-09-06T14:44:45.389 INFO:tasks.workunit.client.0.smithi052.stdout:8/494: read - d6/d4c/f80 zero size 2024-09-06T14:44:45.390 INFO:tasks.workunit.client.0.smithi052.stdout:9/304: truncate d1/d4/d6/dc/d10/f34 4429788 0 2024-09-06T14:44:45.390 INFO:tasks.workunit.client.0.smithi052.stdout:7/349: rmdir d11/d1c/d24/d3b 39 2024-09-06T14:44:45.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/495: truncate d6/f59 1308762 0 2024-09-06T14:44:45.409 INFO:tasks.workunit.client.0.smithi052.stdout:8/496: mkdir d6/d22/d36/d3e/d47/da7 0 2024-09-06T14:44:45.412 INFO:tasks.workunit.client.0.smithi052.stdout:7/350: rmdir d11/d1c/d24/d5a 0 2024-09-06T14:44:45.413 INFO:tasks.workunit.client.0.smithi052.stdout:7/351: write d11/d1c/d24/f35 [2802923,80832] 0 2024-09-06T14:44:45.414 INFO:tasks.workunit.client.0.smithi052.stdout:8/497: chown d6/d9/cd 3327 1 2024-09-06T14:44:45.415 INFO:tasks.workunit.client.0.smithi052.stdout:8/498: dread - d6/d9/f95 zero size 2024-09-06T14:44:45.421 INFO:tasks.workunit.client.0.smithi052.stdout:8/499: rename d6/d9/df to d6/d9/d1f/d33/da8 0 2024-09-06T14:44:45.422 INFO:tasks.workunit.client.0.smithi052.stdout:7/352: symlink d11/d1c/d24/d3b/l77 0 2024-09-06T14:44:45.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/353: rmdir d11/d1c 39 2024-09-06T14:44:45.425 INFO:tasks.workunit.client.0.smithi052.stdout:8/500: getdents d6/d22/d36/d3e/d47/da7 0 2024-09-06T14:44:45.427 INFO:tasks.workunit.client.0.smithi052.stdout:8/501: mkdir d6/d9/d1f/d33/da8/d41/d71/da9 0 2024-09-06T14:44:45.431 INFO:tasks.workunit.client.0.smithi052.stdout:7/354: dwrite d11/d1c/d26/f48 [0,4194304] 0 2024-09-06T14:44:45.432 INFO:tasks.workunit.client.0.smithi052.stdout:7/355: chown d11/d1c/f1e 87 1 2024-09-06T14:44:45.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/356: write d11/f39 [1090525,100063] 0 2024-09-06T14:44:45.440 INFO:tasks.workunit.client.0.smithi052.stdout:7/357: mkdir d11/d1c/d78 0 2024-09-06T14:44:45.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/358: chown d11/d1c/d24/c75 755604433 1 2024-09-06T14:44:45.447 INFO:tasks.workunit.client.0.smithi052.stdout:7/359: dread d11/d1c/d24/f41 [0,4194304] 0 2024-09-06T14:44:45.451 INFO:tasks.workunit.client.0.smithi052.stdout:7/360: chown d11/d1c/d57/c6c 15754 1 2024-09-06T14:44:45.454 INFO:tasks.workunit.client.0.smithi052.stdout:9/305: dread d1/d4/d6/dc/d10/f34 [0,4194304] 0 2024-09-06T14:44:45.455 INFO:tasks.workunit.client.0.smithi052.stdout:7/361: creat d11/d1c/d78/f79 x:0 0 0 2024-09-06T14:44:45.456 INFO:tasks.workunit.client.0.smithi052.stdout:8/502: write d6/d9/d1f/d33/da8/d1b/f2f [3216936,16923] 0 2024-09-06T14:44:45.457 INFO:tasks.workunit.client.0.smithi052.stdout:9/306: mkdir d1/d4/df/d56 0 2024-09-06T14:44:45.461 INFO:tasks.workunit.client.0.smithi052.stdout:9/307: rename d1 to d1/d57 22 2024-09-06T14:44:45.462 INFO:tasks.workunit.client.0.smithi052.stdout:9/308: stat d1/d4/df/f32 0 2024-09-06T14:44:45.462 INFO:tasks.workunit.client.0.smithi052.stdout:9/309: stat d1/f17 0 2024-09-06T14:44:45.463 INFO:tasks.workunit.client.0.smithi052.stdout:7/362: creat d11/d1c/d57/d74/f7a x:0 0 0 2024-09-06T14:44:45.467 INFO:tasks.workunit.client.0.smithi052.stdout:5/378: sync 2024-09-06T14:44:45.467 INFO:tasks.workunit.client.0.smithi052.stdout:6/334: sync 2024-09-06T14:44:45.474 INFO:tasks.workunit.client.0.smithi052.stdout:5/379: dread d2/d1a/f2d [0,4194304] 0 2024-09-06T14:44:45.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/503: dread d6/d22/d31/f55 [0,4194304] 0 2024-09-06T14:44:45.479 INFO:tasks.workunit.client.0.smithi052.stdout:6/335: dwrite d2/dd/d18/f2b [0,4194304] 0 2024-09-06T14:44:45.480 INFO:tasks.workunit.client.0.smithi052.stdout:5/380: creat d2/d1a/f82 x:0 0 0 2024-09-06T14:44:45.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/363: rename c10 to d11/d1c/d3f/c7b 0 2024-09-06T14:44:45.488 INFO:tasks.workunit.client.0.smithi052.stdout:5/381: rmdir d2/d1a/d22/d26/d2b 39 2024-09-06T14:44:45.491 INFO:tasks.workunit.client.0.smithi052.stdout:8/504: mknod d6/d9/d1f/d19/caa 0 2024-09-06T14:44:45.492 INFO:tasks.workunit.client.0.smithi052.stdout:8/505: readlink d6/d22/d36/d3e/d47/d56/l89 0 2024-09-06T14:44:45.493 INFO:tasks.workunit.client.0.smithi052.stdout:6/336: mknod d2/dd/d18/d25/d6a/c72 0 2024-09-06T14:44:45.495 INFO:tasks.workunit.client.0.smithi052.stdout:5/382: mknod d2/d1a/c83 0 2024-09-06T14:44:45.497 INFO:tasks.workunit.client.0.smithi052.stdout:9/310: write d1/f23 [557267,43350] 0 2024-09-06T14:44:45.498 INFO:tasks.workunit.client.0.smithi052.stdout:6/337: creat d2/d4a/f73 x:0 0 0 2024-09-06T14:44:45.501 INFO:tasks.workunit.client.0.smithi052.stdout:6/338: dread d2/dd/f2f [0,4194304] 0 2024-09-06T14:44:45.502 INFO:tasks.workunit.client.0.smithi052.stdout:7/364: rename d11/d1c/d26/f2e to d11/d1c/f7c 0 2024-09-06T14:44:45.509 INFO:tasks.workunit.client.0.smithi052.stdout:7/365: rmdir d11/d1c/d24/d3b 39 2024-09-06T14:44:45.510 INFO:tasks.workunit.client.0.smithi052.stdout:9/311: dread d1/d4/d6/f35 [0,4194304] 0 2024-09-06T14:44:45.510 INFO:tasks.workunit.client.0.smithi052.stdout:7/366: dread d11/d1c/d26/f4d [0,4194304] 0 2024-09-06T14:44:45.511 INFO:tasks.workunit.client.0.smithi052.stdout:6/339: creat d2/dd/d18/d25/d4c/f74 x:0 0 0 2024-09-06T14:44:45.512 INFO:tasks.workunit.client.0.smithi052.stdout:7/367: dread d11/d1c/d24/f44 [0,4194304] 0 2024-09-06T14:44:45.515 INFO:tasks.workunit.client.0.smithi052.stdout:5/383: mkdir d2/d1a/d22/d26/d2b/d37/d84 0 2024-09-06T14:44:45.515 INFO:tasks.workunit.client.0.smithi052.stdout:5/384: write d2/f16 [4370717,116480] 0 2024-09-06T14:44:45.517 INFO:tasks.workunit.client.0.smithi052.stdout:3/409: sync 2024-09-06T14:44:45.517 INFO:tasks.workunit.client.0.smithi052.stdout:4/372: sync 2024-09-06T14:44:45.517 INFO:tasks.workunit.client.0.smithi052.stdout:0/436: sync 2024-09-06T14:44:45.517 INFO:tasks.workunit.client.0.smithi052.stdout:1/412: sync 2024-09-06T14:44:45.517 INFO:tasks.workunit.client.0.smithi052.stdout:2/364: sync 2024-09-06T14:44:45.519 INFO:tasks.workunit.client.0.smithi052.stdout:1/413: chown d1/db/de/d74/f49 7395 1 2024-09-06T14:44:45.522 INFO:tasks.workunit.client.0.smithi052.stdout:2/365: read da/db/d18/f33 [1248675,47562] 0 2024-09-06T14:44:45.523 INFO:tasks.workunit.client.0.smithi052.stdout:1/414: truncate d1/db/de/d74/d14/d2e/f80 197952 0 2024-09-06T14:44:45.524 INFO:tasks.workunit.client.0.smithi052.stdout:6/340: rename d2/dd/l16 to d2/dd/d5e/l75 0 2024-09-06T14:44:45.525 INFO:tasks.workunit.client.0.smithi052.stdout:1/415: chown d1/db/d72/d81 6 1 2024-09-06T14:44:45.526 INFO:tasks.workunit.client.0.smithi052.stdout:5/385: dread d2/d20/d42/f52 [0,4194304] 0 2024-09-06T14:44:45.530 INFO:tasks.workunit.client.0.smithi052.stdout:1/416: truncate d1/db/de/d74/d14/d2e/f84 1507846 0 2024-09-06T14:44:45.531 INFO:tasks.workunit.client.0.smithi052.stdout:5/386: dread d2/d1a/d22/d26/f73 [0,4194304] 0 2024-09-06T14:44:45.533 INFO:tasks.workunit.client.0.smithi052.stdout:6/341: dwrite d2/dd/d18/d2d/d32/f3f [0,4194304] 0 2024-09-06T14:44:45.533 INFO:tasks.workunit.client.0.smithi052.stdout:0/437: truncate d0/d1a/d26/d3a/d14/d20/f48 4298574 0 2024-09-06T14:44:45.534 INFO:tasks.workunit.client.0.smithi052.stdout:5/387: chown d2/d1a/d22/d26/c5d 9 1 2024-09-06T14:44:45.535 INFO:tasks.workunit.client.0.smithi052.stdout:6/342: chown d2/c9 412487256 1 2024-09-06T14:44:45.535 INFO:tasks.workunit.client.0.smithi052.stdout:0/438: read d0/d18/f50 [3042258,14032] 0 2024-09-06T14:44:45.535 INFO:tasks.workunit.client.0.smithi052.stdout:2/366: write da/d2d/d34/d66/f77 [3742068,96494] 0 2024-09-06T14:44:45.537 INFO:tasks.workunit.client.0.smithi052.stdout:6/343: fsync d2/dd/d18/d25/d4c/d61/f62 0 2024-09-06T14:44:45.538 INFO:tasks.workunit.client.0.smithi052.stdout:0/439: read d0/d4f/d7d/f76 [122472,31225] 0 2024-09-06T14:44:45.538 INFO:tasks.workunit.client.0.smithi052.stdout:4/373: rename d9/c11 to d9/d10/d19/d41/c87 0 2024-09-06T14:44:45.539 INFO:tasks.workunit.client.0.smithi052.stdout:6/344: truncate d2/f3b 5005543 0 2024-09-06T14:44:45.540 INFO:tasks.workunit.client.0.smithi052.stdout:7/368: fsync d11/d1c/d24/d3b/d50/f6e 0 2024-09-06T14:44:45.545 INFO:tasks.workunit.client.0.smithi052.stdout:1/417: mkdir d1/db/de/d74/d14/d90 0 2024-09-06T14:44:45.546 INFO:tasks.workunit.client.0.smithi052.stdout:8/506: truncate d6/d9/d1f/d33/da8/d1b/f60 3839581 0 2024-09-06T14:44:45.549 INFO:tasks.workunit.client.0.smithi052.stdout:4/374: chown d9/l3e 0 1 2024-09-06T14:44:45.551 INFO:tasks.workunit.client.0.smithi052.stdout:6/345: fdatasync d2/dd/d18/d4b/f58 0 2024-09-06T14:44:45.553 INFO:tasks.workunit.client.0.smithi052.stdout:9/312: getdents d1/d4/d6/dc/d38 0 2024-09-06T14:44:45.553 INFO:tasks.workunit.client.0.smithi052.stdout:8/507: dwrite d6/d9/d1f/d33/da8/f57 [0,4194304] 0 2024-09-06T14:44:45.554 INFO:tasks.workunit.client.0.smithi052.stdout:1/418: symlink d1/db/de/d74/d3e/d47/d4a/l91 0 2024-09-06T14:44:45.565 INFO:tasks.workunit.client.0.smithi052.stdout:7/369: symlink d11/l7d 0 2024-09-06T14:44:45.574 INFO:tasks.workunit.client.0.smithi052.stdout:1/419: creat d1/db/d18/f92 x:0 0 0 2024-09-06T14:44:45.575 INFO:tasks.workunit.client.0.smithi052.stdout:3/410: link d0/d11/d15/d1b/c5a d0/d11/d12/d4c/d53/c7c 0 2024-09-06T14:44:45.575 INFO:tasks.workunit.client.0.smithi052.stdout:4/375: dread d9/f2e [0,4194304] 0 2024-09-06T14:44:45.578 INFO:tasks.workunit.client.0.smithi052.stdout:5/388: rename d2/d1a/d22/d26/d2b/f2f to d2/d1a/d22/d26/f85 0 2024-09-06T14:44:45.580 INFO:tasks.workunit.client.0.smithi052.stdout:5/389: stat d2/d20/f29 0 2024-09-06T14:44:45.583 INFO:tasks.workunit.client.0.smithi052.stdout:4/376: dwrite d9/d10/f1f [0,4194304] 0 2024-09-06T14:44:45.589 INFO:tasks.workunit.client.0.smithi052.stdout:5/390: dwrite d2/d20/d42/f49 [0,4194304] 0 2024-09-06T14:44:45.593 INFO:tasks.workunit.client.0.smithi052.stdout:7/370: mkdir d11/d1c/d24/d7e 0 2024-09-06T14:44:45.597 INFO:tasks.workunit.client.0.smithi052.stdout:2/367: rename da/d2d/d34/d4a to da/d19/d5a/d5f/d70/d82 0 2024-09-06T14:44:45.598 INFO:tasks.workunit.client.0.smithi052.stdout:6/346: write d2/dd/f2f [1837115,126216] 0 2024-09-06T14:44:45.599 INFO:tasks.workunit.client.0.smithi052.stdout:2/368: read da/d4f/f5b [557266,8709] 0 2024-09-06T14:44:45.599 INFO:tasks.workunit.client.0.smithi052.stdout:8/508: rmdir d6/d9/d1f/d33/da8/d41/d71/da9 0 2024-09-06T14:44:45.601 INFO:tasks.workunit.client.0.smithi052.stdout:8/509: fdatasync d6/d9/d1f/d33/da8/f5d 0 2024-09-06T14:44:45.601 INFO:tasks.workunit.client.0.smithi052.stdout:2/369: chown da/d19/d3a/d31/d76/d6a/l6e 0 1 2024-09-06T14:44:45.602 INFO:tasks.workunit.client.0.smithi052.stdout:1/420: rename d1/db/d18/l54 to d1/db/d18/l93 0 2024-09-06T14:44:45.603 INFO:tasks.workunit.client.0.smithi052.stdout:9/313: write d1/d4/d6/f35 [188989,19383] 0 2024-09-06T14:44:45.604 INFO:tasks.workunit.client.0.smithi052.stdout:9/314: stat d1/c11 0 2024-09-06T14:44:45.605 INFO:tasks.workunit.client.0.smithi052.stdout:5/391: mknod d2/d1a/c86 0 2024-09-06T14:44:45.605 INFO:tasks.workunit.client.0.smithi052.stdout:7/371: fdatasync d11/d1c/f1e 0 2024-09-06T14:44:45.608 INFO:tasks.workunit.client.0.smithi052.stdout:5/392: write d2/d1a/d22/d26/d62/f66 [976114,1808] 0 2024-09-06T14:44:45.612 INFO:tasks.workunit.client.0.smithi052.stdout:1/421: dwrite d1/db/de/d68/f6a [0,4194304] 0 2024-09-06T14:44:45.612 INFO:tasks.workunit.client.0.smithi052.stdout:0/440: rename d0/d1a/d26/d3a/d14/d2d/d56/d5d/d63 to d0/d1a/d26/d3a/d14/d20/d22/d55/da0 0 2024-09-06T14:44:45.619 INFO:tasks.workunit.client.0.smithi052.stdout:3/411: rmdir d0/d11/d12/d62 0 2024-09-06T14:44:45.621 INFO:tasks.workunit.client.0.smithi052.stdout:9/315: rmdir d1/d4/d6/dd/d2b 39 2024-09-06T14:44:45.624 INFO:tasks.workunit.client.0.smithi052.stdout:4/377: creat d9/d10/d17/f88 x:0 0 0 2024-09-06T14:44:45.625 INFO:tasks.workunit.client.0.smithi052.stdout:5/393: write d2/d1a/f77 [75573,50565] 0 2024-09-06T14:44:45.627 INFO:tasks.workunit.client.0.smithi052.stdout:5/394: write d2/d1a/d22/d26/d2b/d37/d68/f6e [527083,39954] 0 2024-09-06T14:44:45.627 INFO:tasks.workunit.client.0.smithi052.stdout:1/422: creat d1/db/de/d74/d3e/f94 x:0 0 0 2024-09-06T14:44:45.629 INFO:tasks.workunit.client.0.smithi052.stdout:6/347: mkdir d2/d4a/d6e/d76 0 2024-09-06T14:44:45.630 INFO:tasks.workunit.client.0.smithi052.stdout:0/441: creat d0/d1a/d26/d3a/d14/d2d/d56/d9d/fa1 x:0 0 0 2024-09-06T14:44:45.631 INFO:tasks.workunit.client.0.smithi052.stdout:6/348: fdatasync d2/dd/d18/d4b/f58 0 2024-09-06T14:44:45.635 INFO:tasks.workunit.client.0.smithi052.stdout:5/395: dwrite d2/d1a/f77 [0,4194304] 0 2024-09-06T14:44:45.639 INFO:tasks.workunit.client.0.smithi052.stdout:9/316: rmdir d1/d4/d6/dc/d45 39 2024-09-06T14:44:45.640 INFO:tasks.workunit.client.0.smithi052.stdout:4/378: creat d9/d2d/d33/d5d/f89 x:0 0 0 2024-09-06T14:44:45.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/423: creat d1/db/de/d74/d3e/d47/d4a/f95 x:0 0 0 2024-09-06T14:44:45.646 INFO:tasks.workunit.client.0.smithi052.stdout:8/510: creat d6/d22/fab x:0 0 0 2024-09-06T14:44:45.647 INFO:tasks.workunit.client.0.smithi052.stdout:1/424: fsync d1/db/de/d74/ff 0 2024-09-06T14:44:45.648 INFO:tasks.workunit.client.0.smithi052.stdout:4/379: dwrite d9/d10/f1f [4194304,4194304] 0 2024-09-06T14:44:45.648 INFO:tasks.workunit.client.0.smithi052.stdout:0/442: fsync d0/d1a/d26/d3a/d14/d20/d22/d41/f4c 0 2024-09-06T14:44:45.651 INFO:tasks.workunit.client.0.smithi052.stdout:1/425: truncate d1/db/de/d74/d14/d2e/f87 747895 0 2024-09-06T14:44:45.653 INFO:tasks.workunit.client.0.smithi052.stdout:2/370: truncate f9 405646 0 2024-09-06T14:44:45.657 INFO:tasks.workunit.client.0.smithi052.stdout:9/317: mknod d1/d26/c58 0 2024-09-06T14:44:45.658 INFO:tasks.workunit.client.0.smithi052.stdout:7/372: rename d11/d1c/d57/f76 to d11/d1c/d3f/f7f 0 2024-09-06T14:44:45.661 INFO:tasks.workunit.client.0.smithi052.stdout:8/511: creat d6/d9/d1f/d33/da8/d41/fac x:0 0 0 2024-09-06T14:44:45.662 INFO:tasks.workunit.client.0.smithi052.stdout:4/380: creat d9/d2d/d33/d5d/f8a x:0 0 0 2024-09-06T14:44:45.663 INFO:tasks.workunit.client.0.smithi052.stdout:6/349: link d2/dd/d18/d4b/f58 d2/dd/d18/d33/f77 0 2024-09-06T14:44:45.665 INFO:tasks.workunit.client.0.smithi052.stdout:4/381: dread d9/d10/f1f [0,4194304] 0 2024-09-06T14:44:45.669 INFO:tasks.workunit.client.0.smithi052.stdout:1/426: mknod d1/db/de/d74/d12/c96 0 2024-09-06T14:44:45.670 INFO:tasks.workunit.client.0.smithi052.stdout:1/427: readlink d1/db/l20 0 2024-09-06T14:44:45.671 INFO:tasks.workunit.client.0.smithi052.stdout:2/371: fdatasync da/d19/d3a/d31/f43 0 2024-09-06T14:44:45.672 INFO:tasks.workunit.client.0.smithi052.stdout:1/428: write d1/db/d18/f92 [387057,55575] 0 2024-09-06T14:44:45.674 INFO:tasks.workunit.client.0.smithi052.stdout:7/373: dread d11/d1c/d24/f29 [0,4194304] 0 2024-09-06T14:44:45.674 INFO:tasks.workunit.client.0.smithi052.stdout:1/429: write d1/db/fd [2982864,28402] 0 2024-09-06T14:44:45.674 INFO:tasks.workunit.client.0.smithi052.stdout:8/512: chown d6/d9/lb 2077956018 1 2024-09-06T14:44:45.675 INFO:tasks.workunit.client.0.smithi052.stdout:1/430: dread - d1/d5f/f7d zero size 2024-09-06T14:44:45.678 INFO:tasks.workunit.client.0.smithi052.stdout:6/350: symlink d2/dd/d5e/l78 0 2024-09-06T14:44:45.682 INFO:tasks.workunit.client.0.smithi052.stdout:8/513: dwrite d6/d9/f9d [0,4194304] 0 2024-09-06T14:44:45.685 INFO:tasks.workunit.client.0.smithi052.stdout:4/382: unlink d9/d10/d19/d41/f4c 0 2024-09-06T14:44:45.685 INFO:tasks.workunit.client.0.smithi052.stdout:8/514: write d6/d9/d1f/d33/da8/f4e [2779208,18037] 0 2024-09-06T14:44:45.695 INFO:tasks.workunit.client.0.smithi052.stdout:3/412: getdents d0/d11/d15 0 2024-09-06T14:44:45.701 INFO:tasks.workunit.client.0.smithi052.stdout:1/431: creat d1/db/d72/f97 x:0 0 0 2024-09-06T14:44:45.705 INFO:tasks.workunit.client.0.smithi052.stdout:6/351: mkdir d2/dd/d18/d33/d44/d79 0 2024-09-06T14:44:45.707 INFO:tasks.workunit.client.0.smithi052.stdout:1/432: dwrite d1/db/fd [4194304,4194304] 0 2024-09-06T14:44:45.708 INFO:tasks.workunit.client.0.smithi052.stdout:1/433: dread - d1/db/de/d74/d3e/d47/f6f zero size 2024-09-06T14:44:45.709 INFO:tasks.workunit.client.0.smithi052.stdout:1/434: chown d1/db/d18/c57 19193 1 2024-09-06T14:44:45.711 INFO:tasks.workunit.client.0.smithi052.stdout:8/515: dread d6/d16/f8c [0,4194304] 0 2024-09-06T14:44:45.712 INFO:tasks.workunit.client.0.smithi052.stdout:0/443: link d0/l67 d0/d1a/d8e/la2 0 2024-09-06T14:44:45.713 INFO:tasks.workunit.client.0.smithi052.stdout:0/444: dread - d0/d1a/d26/f84 zero size 2024-09-06T14:44:45.716 INFO:tasks.workunit.client.0.smithi052.stdout:0/445: fsync d0/d2e/f70 0 2024-09-06T14:44:45.716 INFO:tasks.workunit.client.0.smithi052.stdout:5/396: getdents d2/d20 0 2024-09-06T14:44:45.719 INFO:tasks.workunit.client.0.smithi052.stdout:7/374: mknod d11/d1c/c80 0 2024-09-06T14:44:45.720 INFO:tasks.workunit.client.0.smithi052.stdout:0/446: chown d0/d1a/d26/d3a/d14/d20/f2f 1418 1 2024-09-06T14:44:45.722 INFO:tasks.workunit.client.0.smithi052.stdout:1/435: truncate d1/db/d50/f5b 794179 0 2024-09-06T14:44:45.723 INFO:tasks.workunit.client.0.smithi052.stdout:8/516: dwrite d6/d22/d31/d5b/f96 [0,4194304] 0 2024-09-06T14:44:45.725 INFO:tasks.workunit.client.0.smithi052.stdout:0/447: chown d0/d1a/d26/d3a/d14/f3e 154 1 2024-09-06T14:44:45.725 INFO:tasks.workunit.client.0.smithi052.stdout:4/383: rename d9/c15 to d9/d2d/d33/c8b 0 2024-09-06T14:44:45.730 INFO:tasks.workunit.client.0.smithi052.stdout:5/397: dwrite d2/d1a/d22/d26/d2b/d37/d68/f6e [0,4194304] 0 2024-09-06T14:44:45.732 INFO:tasks.workunit.client.0.smithi052.stdout:5/398: write d2/f16 [5009511,122285] 0 2024-09-06T14:44:45.732 INFO:tasks.workunit.client.0.smithi052.stdout:1/436: unlink d1/db/d18/f82 0 2024-09-06T14:44:45.733 INFO:tasks.workunit.client.0.smithi052.stdout:8/517: mknod d6/d9/d1f/d33/da8/d1b/cad 0 2024-09-06T14:44:45.738 INFO:tasks.workunit.client.0.smithi052.stdout:4/384: mknod d9/d10/d17/d39/d3a/c8c 0 2024-09-06T14:44:45.740 INFO:tasks.workunit.client.0.smithi052.stdout:0/448: mkdir d0/d1a/d26/d3a/d14/d2d/d56/da3 0 2024-09-06T14:44:45.742 INFO:tasks.workunit.client.0.smithi052.stdout:7/375: mknod d11/d1c/c81 0 2024-09-06T14:44:45.744 INFO:tasks.workunit.client.0.smithi052.stdout:7/376: truncate d11/d1c/d24/d3b/d50/f6d 2151582 0 2024-09-06T14:44:45.745 INFO:tasks.workunit.client.0.smithi052.stdout:7/377: readlink d11/d1c/d24/d3b/l52 0 2024-09-06T14:44:45.745 INFO:tasks.workunit.client.0.smithi052.stdout:2/372: stat f9 0 2024-09-06T14:44:45.749 INFO:tasks.workunit.client.0.smithi052.stdout:8/518: rmdir d6/d9/d1f/d33/da8/d41 39 2024-09-06T14:44:45.750 INFO:tasks.workunit.client.0.smithi052.stdout:8/519: dread - d6/d9/d1f/d19/f93 zero size 2024-09-06T14:44:45.751 INFO:tasks.workunit.client.0.smithi052.stdout:8/520: write d6/d9/f9d [5104746,42453] 0 2024-09-06T14:44:45.752 INFO:tasks.workunit.client.0.smithi052.stdout:4/385: fdatasync d9/f35 0 2024-09-06T14:44:45.753 INFO:tasks.workunit.client.0.smithi052.stdout:0/449: rmdir d0/d18 39 2024-09-06T14:44:45.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/386: write d9/d10/d17/f2a [216960,1694] 0 2024-09-06T14:44:45.757 INFO:tasks.workunit.client.0.smithi052.stdout:5/399: write d2/f7 [7949743,117171] 0 2024-09-06T14:44:45.759 INFO:tasks.workunit.client.0.smithi052.stdout:8/521: chown d6/d9/ca 365 1 2024-09-06T14:44:45.762 INFO:tasks.workunit.client.0.smithi052.stdout:1/437: truncate d1/db/de/d68/f6a 2409432 0 2024-09-06T14:44:45.764 INFO:tasks.workunit.client.0.smithi052.stdout:2/373: truncate da/d19/f29 1178600 0 2024-09-06T14:44:45.771 INFO:tasks.workunit.client.0.smithi052.stdout:2/374: dwrite da/d19/d3a/f63 [0,4194304] 0 2024-09-06T14:44:45.776 INFO:tasks.workunit.client.0.smithi052.stdout:5/400: write d2/d1a/d22/d26/d2b/d37/d68/f6e [5046384,1729] 0 2024-09-06T14:44:45.777 INFO:tasks.workunit.client.0.smithi052.stdout:8/522: dwrite d6/d9/d1f/d14/f2b [4194304,4194304] 0 2024-09-06T14:44:45.779 INFO:tasks.workunit.client.0.smithi052.stdout:1/438: mkdir d1/d6c/d98 0 2024-09-06T14:44:45.779 INFO:tasks.workunit.client.0.smithi052.stdout:4/387: creat d9/d2d/f8d x:0 0 0 2024-09-06T14:44:45.785 INFO:tasks.workunit.client.0.smithi052.stdout:5/401: creat d2/d20/d42/d65/f87 x:0 0 0 2024-09-06T14:44:45.787 INFO:tasks.workunit.client.0.smithi052.stdout:0/450: write d0/d1a/d26/d3a/d14/d2d/f11 [772833,36556] 0 2024-09-06T14:44:45.789 INFO:tasks.workunit.client.0.smithi052.stdout:0/451: chown d0/d2e/f70 3488 1 2024-09-06T14:44:45.791 INFO:tasks.workunit.client.0.smithi052.stdout:4/388: mknod d9/d10/d17/d39/c8e 0 2024-09-06T14:44:45.794 INFO:tasks.workunit.client.0.smithi052.stdout:1/439: mknod d1/db/c99 0 2024-09-06T14:44:45.794 INFO:tasks.workunit.client.0.smithi052.stdout:1/440: readlink d1/db/l21 0 2024-09-06T14:44:45.795 INFO:tasks.workunit.client.0.smithi052.stdout:0/452: creat d0/d1a/d26/d3a/fa4 x:0 0 0 2024-09-06T14:44:45.795 INFO:tasks.workunit.client.0.smithi052.stdout:4/389: mknod d9/d10/d19/d41/c8f 0 2024-09-06T14:44:45.797 INFO:tasks.workunit.client.0.smithi052.stdout:0/453: fdatasync d0/d1a/d26/d3a/d14/f3e 0 2024-09-06T14:44:45.797 INFO:tasks.workunit.client.0.smithi052.stdout:4/390: chown d9/d2d/d33/d5d/f89 154950988 1 2024-09-06T14:44:45.798 INFO:tasks.workunit.client.0.smithi052.stdout:0/454: read - d0/d1a/f52 zero size 2024-09-06T14:44:45.800 INFO:tasks.workunit.client.0.smithi052.stdout:0/455: mknod d0/d4f/ca5 0 2024-09-06T14:44:45.802 INFO:tasks.workunit.client.0.smithi052.stdout:1/441: dwrite d1/db/de/d74/d14/f1f [0,4194304] 0 2024-09-06T14:44:45.811 INFO:tasks.workunit.client.0.smithi052.stdout:2/375: truncate da/f11 5177972 0 2024-09-06T14:44:45.815 INFO:tasks.workunit.client.0.smithi052.stdout:1/442: dread d1/db/de/d74/d12/f34 [0,4194304] 0 2024-09-06T14:44:45.816 INFO:tasks.workunit.client.0.smithi052.stdout:1/443: read d1/db/de/d74/d14/d2e/f87 [305652,97010] 0 2024-09-06T14:44:45.817 INFO:tasks.workunit.client.0.smithi052.stdout:2/376: rename da/d19/l47 to da/d19/d3a/d61/d7b/l83 0 2024-09-06T14:44:45.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/444: fsync d1/d5f/f7d 0 2024-09-06T14:44:45.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/377: stat da/d19/d5a/d5f/d70 0 2024-09-06T14:44:45.822 INFO:tasks.workunit.client.0.smithi052.stdout:8/523: dwrite d6/d16/f2c [0,4194304] 0 2024-09-06T14:44:45.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/402: dread d2/d1a/f3d [0,4194304] 0 2024-09-06T14:44:45.827 INFO:tasks.workunit.client.0.smithi052.stdout:2/378: chown da/d2d/d34/c7d 1022330 1 2024-09-06T14:44:45.828 INFO:tasks.workunit.client.0.smithi052.stdout:0/456: write d0/d1a/d26/d3a/d14/d20/f48 [5149265,52944] 0 2024-09-06T14:44:45.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/457: read d0/d2e/f9c [618387,47313] 0 2024-09-06T14:44:45.830 INFO:tasks.workunit.client.0.smithi052.stdout:8/524: symlink d6/d22/d31/lae 0 2024-09-06T14:44:45.832 INFO:tasks.workunit.client.0.smithi052.stdout:5/403: creat d2/d20/d56/f88 x:0 0 0 2024-09-06T14:44:45.838 INFO:tasks.workunit.client.0.smithi052.stdout:1/445: rename d1/db/de/d68/f6a to d1/db/d18/d5c/f9a 0 2024-09-06T14:44:45.838 INFO:tasks.workunit.client.0.smithi052.stdout:8/525: dwrite d6/d9/d1f/d19/d6f/d72/f86 [0,4194304] 0 2024-09-06T14:44:45.847 INFO:tasks.workunit.client.0.smithi052.stdout:1/446: mkdir d1/db/de/d74/d36/d9b 0 2024-09-06T14:44:45.855 INFO:tasks.workunit.client.0.smithi052.stdout:8/526: mknod d6/d22/d36/d3e/d79/caf 0 2024-09-06T14:44:45.856 INFO:tasks.workunit.client.0.smithi052.stdout:2/379: link da/d19/d3a/d31/d76/l6f da/d19/d3a/d61/d7b/l84 0 2024-09-06T14:44:45.857 INFO:tasks.workunit.client.0.smithi052.stdout:2/380: write da/db/d46/d55/f68 [172813,50166] 0 2024-09-06T14:44:45.858 INFO:tasks.workunit.client.0.smithi052.stdout:5/404: rename d2/d1a/c83 to d2/d1a/d22/d26/c89 0 2024-09-06T14:44:45.860 INFO:tasks.workunit.client.0.smithi052.stdout:5/405: write d2/d20/d42/d65/f79 [548128,125649] 0 2024-09-06T14:44:45.864 INFO:tasks.workunit.client.0.smithi052.stdout:2/381: creat da/d19/d5a/d5f/d70/f85 x:0 0 0 2024-09-06T14:44:45.866 INFO:tasks.workunit.client.0.smithi052.stdout:1/447: link d1/db/d18/l93 d1/db/de/d68/l9c 0 2024-09-06T14:44:45.869 INFO:tasks.workunit.client.0.smithi052.stdout:2/382: rmdir da/d2d/d34/d66 39 2024-09-06T14:44:45.869 INFO:tasks.workunit.client.0.smithi052.stdout:5/406: dwrite d2/f16 [4194304,4194304] 0 2024-09-06T14:44:45.871 INFO:tasks.workunit.client.0.smithi052.stdout:1/448: write d1/db/de/d74/d12/f63 [5130729,5782] 0 2024-09-06T14:44:45.872 INFO:tasks.workunit.client.0.smithi052.stdout:2/383: fsync da/d19/f2c 0 2024-09-06T14:44:45.872 INFO:tasks.workunit.client.0.smithi052.stdout:8/527: dread d6/d4c/f66 [0,4194304] 0 2024-09-06T14:44:45.873 INFO:tasks.workunit.client.0.smithi052.stdout:2/384: fsync da/f57 0 2024-09-06T14:44:45.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:45 smithi052 ceph-mon[28627]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 216 MiB/s wr, 418 op/s 2024-09-06T14:44:45.874 INFO:tasks.workunit.client.0.smithi052.stdout:5/407: creat d2/d1a/d22/d26/d62/f8a x:0 0 0 2024-09-06T14:44:45.880 INFO:tasks.workunit.client.0.smithi052.stdout:5/408: dread d2/d20/d42/f49 [0,4194304] 0 2024-09-06T14:44:45.881 INFO:tasks.workunit.client.0.smithi052.stdout:1/449: fdatasync d1/db/de/d74/d12/f63 0 2024-09-06T14:44:45.883 INFO:tasks.workunit.client.0.smithi052.stdout:8/528: mknod d6/d9/d1f/d33/da8/cb0 0 2024-09-06T14:44:45.885 INFO:tasks.workunit.client.0.smithi052.stdout:5/409: mkdir d2/d20/d42/d8b 0 2024-09-06T14:44:45.889 INFO:tasks.workunit.client.0.smithi052.stdout:5/410: symlink d2/d20/d42/d65/l8c 0 2024-09-06T14:44:45.890 INFO:tasks.workunit.client.0.smithi052.stdout:1/450: creat d1/db/de/d74/f9d x:0 0 0 2024-09-06T14:44:45.894 INFO:tasks.workunit.client.0.smithi052.stdout:1/451: creat d1/d6c/d98/f9e x:0 0 0 2024-09-06T14:44:45.896 INFO:tasks.workunit.client.0.smithi052.stdout:1/452: mkdir d1/db/de/d74/d14/d9f 0 2024-09-06T14:44:45.902 INFO:tasks.workunit.client.0.smithi052.stdout:8/529: dread d6/d9/d1f/d14/f29 [0,4194304] 0 2024-09-06T14:44:45.902 INFO:tasks.workunit.client.0.smithi052.stdout:2/385: dwrite da/f2f [0,4194304] 0 2024-09-06T14:44:46.014 INFO:tasks.workunit.client.0.smithi052.stdout:2/386: link da/d19/d5a/d5f/f75 da/d19/d3a/d31/d76/d6a/f86 0 2024-09-06T14:44:46.016 INFO:tasks.workunit.client.0.smithi052.stdout:2/387: symlink da/d2d/l87 0 2024-09-06T14:44:46.018 INFO:tasks.workunit.client.0.smithi052.stdout:2/388: mknod da/d19/d5a/d5f/c88 0 2024-09-06T14:44:46.020 INFO:tasks.workunit.client.0.smithi052.stdout:2/389: unlink da/db/d18/f38 0 2024-09-06T14:44:46.020 INFO:tasks.workunit.client.0.smithi052.stdout:2/390: stat da/d64 0 2024-09-06T14:44:46.022 INFO:tasks.workunit.client.0.smithi052.stdout:2/391: mknod da/d19/d5a/d5f/c89 0 2024-09-06T14:44:46.027 INFO:tasks.workunit.client.0.smithi052.stdout:2/392: rename da/db/d18/f33 to da/d2d/d34/f8a 0 2024-09-06T14:44:46.027 INFO:tasks.workunit.client.0.smithi052.stdout:2/393: chown da/d2d 340207997 1 2024-09-06T14:44:46.029 INFO:tasks.workunit.client.0.smithi052.stdout:2/394: mknod da/c8b 0 2024-09-06T14:44:46.030 INFO:tasks.workunit.client.0.smithi052.stdout:2/395: rmdir da/d19/d3a 39 2024-09-06T14:44:46.032 INFO:tasks.workunit.client.0.smithi052.stdout:2/396: mknod da/db/d18/d7f/c8c 0 2024-09-06T14:44:46.047 INFO:tasks.workunit.client.0.smithi052.stdout:2/397: dwrite da/f1b [0,4194304] 0 2024-09-06T14:44:46.049 INFO:tasks.workunit.client.0.smithi052.stdout:2/398: chown da/d19/d3a/d31/d76/d6a/f7c 1417 1 2024-09-06T14:44:46.052 INFO:tasks.workunit.client.0.smithi052.stdout:2/399: symlink da/d19/d5a/l8d 0 2024-09-06T14:44:46.055 INFO:tasks.workunit.client.0.smithi052.stdout:2/400: rename da/d19/d5a/l8d to da/db/d46/l8e 0 2024-09-06T14:44:46.055 INFO:tasks.workunit.client.0.smithi052.stdout:2/401: chown da/db/d18/c1e 1 1 2024-09-06T14:44:46.057 INFO:tasks.workunit.client.0.smithi052.stdout:2/402: creat da/d64/f8f x:0 0 0 2024-09-06T14:44:46.061 INFO:tasks.workunit.client.0.smithi052.stdout:2/403: link da/d19/d5a/d5f/c88 da/d19/d3a/c90 0 2024-09-06T14:44:46.062 INFO:tasks.workunit.client.0.smithi052.stdout:2/404: dread - da/db/d60/f80 zero size 2024-09-06T14:44:46.063 INFO:tasks.workunit.client.0.smithi052.stdout:2/405: fsync da/f1b 0 2024-09-06T14:44:46.064 INFO:tasks.workunit.client.0.smithi052.stdout:2/406: readlink da/d19/d3a/d61/d7b/l84 0 2024-09-06T14:44:46.068 INFO:tasks.workunit.client.0.smithi052.stdout:2/407: fdatasync da/d19/f29 0 2024-09-06T14:44:46.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:45 smithi165 ceph-mon[36229]: pgmap v25: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 216 MiB/s wr, 418 op/s 2024-09-06T14:44:46.081 INFO:tasks.workunit.client.0.smithi052.stdout:2/408: write da/d19/d3a/d31/d76/d6a/f86 [38436,111915] 0 2024-09-06T14:44:46.082 INFO:tasks.workunit.client.0.smithi052.stdout:2/409: fsync da/db/d60/f80 0 2024-09-06T14:44:46.082 INFO:tasks.workunit.client.0.smithi052.stdout:2/410: stat da/d2d/d34/c81 0 2024-09-06T14:44:46.083 INFO:tasks.workunit.client.0.smithi052.stdout:2/411: dread - da/d64/f8f zero size 2024-09-06T14:44:46.094 INFO:tasks.workunit.client.0.smithi052.stdout:2/412: truncate da/db/d18/f3c 1281575 0 2024-09-06T14:44:46.095 INFO:tasks.workunit.client.0.smithi052.stdout:2/413: unlink f9 0 2024-09-06T14:44:46.096 INFO:tasks.workunit.client.0.smithi052.stdout:2/414: chown da/db/d18/c1e 1449139 1 2024-09-06T14:44:46.096 INFO:tasks.workunit.client.0.smithi052.stdout:2/415: chown da/d19/d5a/d5f/f75 929633 1 2024-09-06T14:44:46.099 INFO:tasks.workunit.client.0.smithi052.stdout:2/416: truncate da/d19/f29 1851728 0 2024-09-06T14:44:46.103 INFO:tasks.workunit.client.0.smithi052.stdout:2/417: link da/d19/d3a/d31/d76/l6f da/db/d18/d7f/l91 0 2024-09-06T14:44:46.108 INFO:tasks.workunit.client.0.smithi052.stdout:2/418: dwrite da/d19/d3a/d31/f5e [0,4194304] 0 2024-09-06T14:44:46.112 INFO:tasks.workunit.client.0.smithi052.stdout:2/419: creat da/f92 x:0 0 0 2024-09-06T14:44:46.114 INFO:tasks.workunit.client.0.smithi052.stdout:2/420: write da/d19/d5a/d5f/f75 [742843,44210] 0 2024-09-06T14:44:46.116 INFO:tasks.workunit.client.0.smithi052.stdout:2/421: chown da/d2d/d34/l39 16569 1 2024-09-06T14:44:46.119 INFO:tasks.workunit.client.0.smithi052.stdout:2/422: creat da/d19/d5a/d5f/d70/f93 x:0 0 0 2024-09-06T14:44:46.128 INFO:tasks.workunit.client.0.smithi052.stdout:2/423: dread da/f23 [0,4194304] 0 2024-09-06T14:44:46.128 INFO:tasks.workunit.client.0.smithi052.stdout:2/424: chown da/f2f 13639 1 2024-09-06T14:44:46.131 INFO:tasks.workunit.client.0.smithi052.stdout:2/425: mknod da/db/c94 0 2024-09-06T14:44:46.134 INFO:tasks.workunit.client.0.smithi052.stdout:2/426: link da/d19/d3a/f63 da/d19/d3a/d61/f95 0 2024-09-06T14:44:46.137 INFO:tasks.workunit.client.0.smithi052.stdout:2/427: symlink da/d19/l96 0 2024-09-06T14:44:46.143 INFO:tasks.workunit.client.0.smithi052.stdout:2/428: link da/db/d60/l30 da/d19/l97 0 2024-09-06T14:44:46.148 INFO:tasks.workunit.client.0.smithi052.stdout:2/429: dwrite da/db/f12 [0,4194304] 0 2024-09-06T14:44:46.150 INFO:tasks.workunit.client.0.smithi052.stdout:2/430: truncate da/d19/d3a/d31/f37 411722 0 2024-09-06T14:44:46.153 INFO:tasks.workunit.client.0.smithi052.stdout:2/431: creat da/db/d46/d6b/f98 x:0 0 0 2024-09-06T14:44:46.154 INFO:tasks.workunit.client.0.smithi052.stdout:2/432: write da/db/f16 [4689557,63639] 0 2024-09-06T14:44:46.156 INFO:tasks.workunit.client.0.smithi052.stdout:2/433: creat da/d19/d5a/d5f/d70/f99 x:0 0 0 2024-09-06T14:44:46.157 INFO:tasks.workunit.client.0.smithi052.stdout:2/434: write da/d19/f1a [140624,34119] 0 2024-09-06T14:44:46.524 INFO:tasks.workunit.client.0.smithi052.stdout:9/318: sync 2024-09-06T14:44:46.628 INFO:tasks.workunit.client.0.smithi052.stdout:3/413: sync 2024-09-06T14:44:46.628 INFO:tasks.workunit.client.0.smithi052.stdout:3/414: stat d0/d11/d15/d1b 0 2024-09-06T14:44:46.630 INFO:tasks.workunit.client.0.smithi052.stdout:3/415: chown d0/c3f 1735 1 2024-09-06T14:44:46.633 INFO:tasks.workunit.client.0.smithi052.stdout:3/416: mknod d0/d11/d12/d4c/d53/c7d 0 2024-09-06T14:44:46.640 INFO:tasks.workunit.client.0.smithi052.stdout:3/417: link d0/d11/d12/d4c/d53/d35/f3a d0/d11/d12/d4c/d53/d35/d46/d5b/f7e 0 2024-09-06T14:44:46.642 INFO:tasks.workunit.client.0.smithi052.stdout:3/418: write d0/fe [3839456,36995] 0 2024-09-06T14:44:46.705 INFO:tasks.workunit.client.0.smithi052.stdout:7/378: sync 2024-09-06T14:44:46.705 INFO:tasks.workunit.client.0.smithi052.stdout:6/352: sync 2024-09-06T14:44:46.705 INFO:tasks.workunit.client.0.smithi052.stdout:4/391: sync 2024-09-06T14:44:46.706 INFO:tasks.workunit.client.0.smithi052.stdout:7/379: read - d11/d1c/d57/d74/f7a zero size 2024-09-06T14:44:46.711 INFO:tasks.workunit.client.0.smithi052.stdout:4/392: creat d9/d10/d17/d39/d3a/d5c/f90 x:0 0 0 2024-09-06T14:44:46.712 INFO:tasks.workunit.client.0.smithi052.stdout:7/380: write d11/d1c/d24/d3b/d50/f6d [128528,123105] 0 2024-09-06T14:44:46.713 INFO:tasks.workunit.client.0.smithi052.stdout:6/353: dread d2/dd/d18/d2d/d32/f40 [0,4194304] 0 2024-09-06T14:44:46.714 INFO:tasks.workunit.client.0.smithi052.stdout:4/393: truncate d9/d2d/d33/f44 160789 0 2024-09-06T14:44:46.714 INFO:tasks.workunit.client.0.smithi052.stdout:4/394: dread - d9/d10/d17/f88 zero size 2024-09-06T14:44:46.716 INFO:tasks.workunit.client.0.smithi052.stdout:6/354: unlink d2/dd/c1c 0 2024-09-06T14:44:46.718 INFO:tasks.workunit.client.0.smithi052.stdout:7/381: symlink d11/d1c/d24/l82 0 2024-09-06T14:44:46.718 INFO:tasks.workunit.client.0.smithi052.stdout:7/382: chown d11/l7d 6 1 2024-09-06T14:44:46.739 INFO:tasks.workunit.client.0.smithi052.stdout:3/419: dwrite d0/f1a [4194304,4194304] 0 2024-09-06T14:44:46.746 INFO:tasks.workunit.client.0.smithi052.stdout:3/420: fsync d0/d11/d15/d19/f61 0 2024-09-06T14:44:46.749 INFO:tasks.workunit.client.0.smithi052.stdout:3/421: chown d0/c38 1376812 1 2024-09-06T14:44:46.750 INFO:tasks.workunit.client.0.smithi052.stdout:3/422: fdatasync d0/d11/d12/f47 0 2024-09-06T14:44:46.756 INFO:tasks.workunit.client.0.smithi052.stdout:3/423: dwrite d0/d11/d12/d73/f78 [0,4194304] 0 2024-09-06T14:44:46.760 INFO:tasks.workunit.client.0.smithi052.stdout:3/424: read - d0/d11/d12/f41 zero size 2024-09-06T14:44:46.760 INFO:tasks.workunit.client.0.smithi052.stdout:3/425: write d0/d11/d15/d1b/f32 [1339657,25963] 0 2024-09-06T14:44:46.763 INFO:tasks.workunit.client.0.smithi052.stdout:3/426: creat d0/d11/d15/d19/f7f x:0 0 0 2024-09-06T14:44:46.777 INFO:tasks.workunit.client.0.smithi052.stdout:3/427: dread d0/d11/d12/d4c/d53/d35/f22 [0,4194304] 0 2024-09-06T14:44:46.818 INFO:tasks.workunit.client.0.smithi052.stdout:5/411: sync 2024-09-06T14:44:46.818 INFO:tasks.workunit.client.0.smithi052.stdout:0/458: sync 2024-09-06T14:44:46.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/453: sync 2024-09-06T14:44:46.824 INFO:tasks.workunit.client.0.smithi052.stdout:5/412: dwrite d2/d1a/d22/d26/d62/f6d [0,4194304] 0 2024-09-06T14:44:46.826 INFO:tasks.workunit.client.0.smithi052.stdout:5/413: write d2/d1a/d22/f3e [2822129,26550] 0 2024-09-06T14:44:46.828 INFO:tasks.workunit.client.0.smithi052.stdout:5/414: write d2/d1a/d22/f3e [605952,18606] 0 2024-09-06T14:44:46.829 INFO:tasks.workunit.client.0.smithi052.stdout:3/428: rename d0/fe to d0/d11/d12/d4c/d53/f80 0 2024-09-06T14:44:46.830 INFO:tasks.workunit.client.0.smithi052.stdout:5/415: truncate d2/d20/d42/d65/f87 1010743 0 2024-09-06T14:44:46.831 INFO:tasks.workunit.client.0.smithi052.stdout:1/454: creat d1/db/de/fa0 x:0 0 0 2024-09-06T14:44:46.844 INFO:tasks.workunit.client.0.smithi052.stdout:3/429: fsync d0/d11/d12/d4c/d53/d64/f6f 0 2024-09-06T14:44:46.846 INFO:tasks.workunit.client.0.smithi052.stdout:3/430: truncate d0/d11/d15/d1b/f60 507359 0 2024-09-06T14:44:46.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/431: stat d0/d11/d12/d4c/c75 0 2024-09-06T14:44:46.848 INFO:tasks.workunit.client.0.smithi052.stdout:5/416: creat d2/d1a/d22/d26/d2b/d48/f8d x:0 0 0 2024-09-06T14:44:46.849 INFO:tasks.workunit.client.0.smithi052.stdout:5/417: write d2/f13 [1036827,53669] 0 2024-09-06T14:44:46.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/395: dread d9/d2d/d33/f44 [0,4194304] 0 2024-09-06T14:44:46.851 INFO:tasks.workunit.client.0.smithi052.stdout:5/418: write d2/f18 [9297032,20930] 0 2024-09-06T14:44:46.854 INFO:tasks.workunit.client.0.smithi052.stdout:6/355: write d2/dd/d18/d33/f77 [355343,37065] 0 2024-09-06T14:44:46.856 INFO:tasks.workunit.client.0.smithi052.stdout:7/383: write d11/d1c/d3f/f7f [1924917,110926] 0 2024-09-06T14:44:46.856 INFO:tasks.workunit.client.0.smithi052.stdout:6/356: fsync d2/dd/d18/d25/f26 0 2024-09-06T14:44:46.857 INFO:tasks.workunit.client.0.smithi052.stdout:7/384: stat d11/d1c/d3f/f72 0 2024-09-06T14:44:46.857 INFO:tasks.workunit.client.0.smithi052.stdout:6/357: readlink d2/la 0 2024-09-06T14:44:46.858 INFO:tasks.workunit.client.0.smithi052.stdout:7/385: readlink d11/d1c/d24/l82 0 2024-09-06T14:44:46.860 INFO:tasks.workunit.client.0.smithi052.stdout:5/419: truncate d2/d20/f28 1861543 0 2024-09-06T14:44:46.861 INFO:tasks.workunit.client.0.smithi052.stdout:5/420: read - d2/d20/d56/f88 zero size 2024-09-06T14:44:46.867 INFO:tasks.workunit.client.0.smithi052.stdout:5/421: dwrite d2/d20/f5e [0,4194304] 0 2024-09-06T14:44:46.870 INFO:tasks.workunit.client.0.smithi052.stdout:4/396: mkdir d9/d10/d17/d39/d7b/d91 0 2024-09-06T14:44:46.874 INFO:tasks.workunit.client.0.smithi052.stdout:7/386: dwrite d11/d1c/d24/f29 [0,4194304] 0 2024-09-06T14:44:46.877 INFO:tasks.workunit.client.0.smithi052.stdout:4/397: link d9/d10/d19/d41/f75 d9/d10/d17/d39/d3a/f92 0 2024-09-06T14:44:46.881 INFO:tasks.workunit.client.0.smithi052.stdout:5/422: dread d2/f18 [8388608,4194304] 0 2024-09-06T14:44:46.882 INFO:tasks.workunit.client.0.smithi052.stdout:5/423: read d2/d1a/d22/f7e [98625,42699] 0 2024-09-06T14:44:46.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/387: symlink d11/d1c/d3f/d5d/l83 0 2024-09-06T14:44:46.883 INFO:tasks.workunit.client.0.smithi052.stdout:4/398: dread d9/d2d/f63 [0,4194304] 0 2024-09-06T14:44:46.889 INFO:tasks.workunit.client.0.smithi052.stdout:2/435: sync 2024-09-06T14:44:46.889 INFO:tasks.workunit.client.0.smithi052.stdout:8/530: sync 2024-09-06T14:44:46.889 INFO:tasks.workunit.client.0.smithi052.stdout:9/319: sync 2024-09-06T14:44:46.890 INFO:tasks.workunit.client.0.smithi052.stdout:8/531: chown d6 174002674 1 2024-09-06T14:44:46.890 INFO:tasks.workunit.client.0.smithi052.stdout:8/532: truncate d6/f98 66455 0 2024-09-06T14:44:46.891 INFO:tasks.workunit.client.0.smithi052.stdout:2/436: truncate da/db/d46/d55/f68 388884 0 2024-09-06T14:44:46.894 INFO:tasks.workunit.client.0.smithi052.stdout:5/424: creat d2/d1a/d22/d26/d2b/d37/d6a/f8e x:0 0 0 2024-09-06T14:44:46.894 INFO:tasks.workunit.client.0.smithi052.stdout:9/320: stat d1/d4/c36 0 2024-09-06T14:44:46.899 INFO:tasks.workunit.client.0.smithi052.stdout:2/437: fdatasync da/f23 0 2024-09-06T14:44:46.900 INFO:tasks.workunit.client.0.smithi052.stdout:8/533: dwrite d6/d9/d1f/d33/da8/d1b/f2f [0,4194304] 0 2024-09-06T14:44:46.901 INFO:tasks.workunit.client.0.smithi052.stdout:2/438: fdatasync da/d19/d3a/d31/d76/d6a/f7c 0 2024-09-06T14:44:46.902 INFO:tasks.workunit.client.0.smithi052.stdout:8/534: chown d6/d4c/f65 19396020 1 2024-09-06T14:44:46.903 INFO:tasks.workunit.client.0.smithi052.stdout:9/321: creat d1/d4/df/f59 x:0 0 0 2024-09-06T14:44:46.907 INFO:tasks.workunit.client.0.smithi052.stdout:5/425: link d2/d1a/d22/d26/d62/f6d d2/d1a/d22/d26/d2b/d48/d64/f8f 0 2024-09-06T14:44:46.909 INFO:tasks.workunit.client.0.smithi052.stdout:8/535: write d6/d22/d31/f55 [5358057,75097] 0 2024-09-06T14:44:46.911 INFO:tasks.workunit.client.0.smithi052.stdout:2/439: creat da/d19/d5a/d5f/f9a x:0 0 0 2024-09-06T14:44:46.917 INFO:tasks.workunit.client.0.smithi052.stdout:2/440: symlink da/d19/d5a/d6c/l9b 0 2024-09-06T14:44:46.919 INFO:tasks.workunit.client.0.smithi052.stdout:5/426: getdents d2/d1a/d22/d26/d2b/d37 0 2024-09-06T14:44:46.925 INFO:tasks.workunit.client.0.smithi052.stdout:2/441: dwrite da/d19/d5a/d5f/d70/f85 [0,4194304] 0 2024-09-06T14:44:46.929 INFO:tasks.workunit.client.0.smithi052.stdout:9/322: dread d1/d4/df/f24 [0,4194304] 0 2024-09-06T14:44:46.930 INFO:tasks.workunit.client.0.smithi052.stdout:9/323: write d1/d4/f5 [5124381,68718] 0 2024-09-06T14:44:46.934 INFO:tasks.workunit.client.0.smithi052.stdout:9/324: chown d1/d4/d6/dd/d2b/f2e 235 1 2024-09-06T14:44:46.938 INFO:tasks.workunit.client.0.smithi052.stdout:9/325: mkdir d1/d4/d6/dc/d38/d5a 0 2024-09-06T14:44:46.940 INFO:tasks.workunit.client.0.smithi052.stdout:9/326: readlink d1/d4/d6/dc/l3b 0 2024-09-06T14:44:46.944 INFO:tasks.workunit.client.0.smithi052.stdout:9/327: creat d1/d4/d6/dc/d10/d18/f5b x:0 0 0 2024-09-06T14:44:46.947 INFO:tasks.workunit.client.0.smithi052.stdout:9/328: creat d1/d4/d6/dc/d10/d18/f5c x:0 0 0 2024-09-06T14:44:46.949 INFO:tasks.workunit.client.0.smithi052.stdout:9/329: creat d1/d4/d6/dc/d10/d18/f5d x:0 0 0 2024-09-06T14:44:46.973 INFO:tasks.workunit.client.0.smithi052.stdout:1/455: write d1/db/f52 [1139301,15726] 0 2024-09-06T14:44:46.974 INFO:tasks.workunit.client.0.smithi052.stdout:1/456: dread - d1/db/d72/f97 zero size 2024-09-06T14:44:46.981 INFO:tasks.workunit.client.0.smithi052.stdout:1/457: dwrite d1/db/de/d74/ff [4194304,4194304] 0 2024-09-06T14:44:46.986 INFO:tasks.workunit.client.0.smithi052.stdout:1/458: dread d1/db/d18/f92 [0,4194304] 0 2024-09-06T14:44:46.987 INFO:tasks.workunit.client.0.smithi052.stdout:1/459: truncate d1/db/de/d74/f78 665085 0 2024-09-06T14:44:46.994 INFO:tasks.workunit.client.0.smithi052.stdout:7/388: dwrite d11/d1c/f1d [0,4194304] 0 2024-09-06T14:44:47.001 INFO:tasks.workunit.client.0.smithi052.stdout:7/389: dwrite d11/d1c/d24/d4b/f4c [0,4194304] 0 2024-09-06T14:44:47.011 INFO:tasks.workunit.client.0.smithi052.stdout:7/390: link d11/d1c/d3f/d5d/f68 d11/d1c/d24/f84 0 2024-09-06T14:44:47.015 INFO:tasks.workunit.client.0.smithi052.stdout:0/459: rename d0/c7 to d0/d1a/d26/d3a/d14/ca6 0 2024-09-06T14:44:47.018 INFO:tasks.workunit.client.0.smithi052.stdout:3/432: rename d0/l54 to d0/d11/d12/d4c/d53/l81 0 2024-09-06T14:44:47.022 INFO:tasks.workunit.client.0.smithi052.stdout:0/460: symlink d0/d1a/d26/d3a/d14/d2d/d94/la7 0 2024-09-06T14:44:47.022 INFO:tasks.workunit.client.0.smithi052.stdout:0/461: dread - d0/d2e/f70 zero size 2024-09-06T14:44:47.026 INFO:tasks.workunit.client.0.smithi052.stdout:3/433: link d0/d11/l74 d0/d11/d15/d1b/l82 0 2024-09-06T14:44:47.031 INFO:tasks.workunit.client.0.smithi052.stdout:2/442: dwrite f2 [0,4194304] 0 2024-09-06T14:44:47.036 INFO:tasks.workunit.client.0.smithi052.stdout:4/399: rename d9/d2d/d33/f44 to d9/d10/d17/d39/f93 0 2024-09-06T14:44:47.037 INFO:tasks.workunit.client.0.smithi052.stdout:6/358: creat d2/dd/f7a x:0 0 0 2024-09-06T14:44:47.039 INFO:tasks.workunit.client.0.smithi052.stdout:8/536: rename d6/d9/d1f/d33/da8/l12 to d6/d9/d1f/d33/da8/d41/d71/lb1 0 2024-09-06T14:44:47.039 INFO:tasks.workunit.client.0.smithi052.stdout:2/443: dwrite da/d19/d3a/d31/d76/d6a/f86 [0,4194304] 0 2024-09-06T14:44:47.041 INFO:tasks.workunit.client.0.smithi052.stdout:2/444: write da/d19/d5a/d5f/d70/f85 [1717607,87855] 0 2024-09-06T14:44:47.043 INFO:tasks.workunit.client.0.smithi052.stdout:6/359: chown d2/dd/d5e/c63 908 1 2024-09-06T14:44:47.118 INFO:tasks.workunit.client.0.smithi052.stdout:5/427: rename d2/d20/f29 to d2/d1a/d22/d26/d2b/d48/f90 0 2024-09-06T14:44:47.121 INFO:tasks.workunit.client.0.smithi052.stdout:2/445: dread da/db/d46/d55/f68 [0,4194304] 0 2024-09-06T14:44:47.123 INFO:tasks.workunit.client.0.smithi052.stdout:4/400: dwrite d9/d2d/d33/f3f [4194304,4194304] 0 2024-09-06T14:44:47.123 INFO:tasks.workunit.client.0.smithi052.stdout:2/446: fdatasync da/d19/f2c 0 2024-09-06T14:44:47.125 INFO:tasks.workunit.client.0.smithi052.stdout:1/460: dwrite d1/db/d18/d5c/f9a [0,4194304] 0 2024-09-06T14:44:47.134 INFO:tasks.workunit.client.0.smithi052.stdout:1/461: dwrite d1/db/de/d74/d12/f8a [0,4194304] 0 2024-09-06T14:44:47.137 INFO:tasks.workunit.client.0.smithi052.stdout:0/462: write d0/d19/f80 [3569119,33677] 0 2024-09-06T14:44:47.142 INFO:tasks.workunit.client.0.smithi052.stdout:0/463: dread d0/d1a/d26/f87 [0,4194304] 0 2024-09-06T14:44:47.149 INFO:tasks.workunit.client.0.smithi052.stdout:5/428: mkdir d2/d20/d91 0 2024-09-06T14:44:47.150 INFO:tasks.workunit.client.0.smithi052.stdout:5/429: write d2/d20/f5e [4662098,21313] 0 2024-09-06T14:44:47.153 INFO:tasks.workunit.client.0.smithi052.stdout:1/462: mknod d1/d6c/ca1 0 2024-09-06T14:44:47.154 INFO:tasks.workunit.client.0.smithi052.stdout:1/463: chown d1/db/de/d74/d12/c8f 1760 1 2024-09-06T14:44:47.159 INFO:tasks.workunit.client.0.smithi052.stdout:1/464: dread d1/db/de/d74/d14/d2e/f84 [0,4194304] 0 2024-09-06T14:44:47.163 INFO:tasks.workunit.client.0.smithi052.stdout:5/430: symlink d2/d20/d42/d65/l92 0 2024-09-06T14:44:47.164 INFO:tasks.workunit.client.0.smithi052.stdout:5/431: chown d2/d1a/d22/d26/d2b/d48/c5a 293879653 1 2024-09-06T14:44:47.168 INFO:tasks.workunit.client.0.smithi052.stdout:4/401: dread f2 [0,4194304] 0 2024-09-06T14:44:47.169 INFO:tasks.workunit.client.0.smithi052.stdout:4/402: chown f2 30 1 2024-09-06T14:44:47.177 INFO:tasks.workunit.client.0.smithi052.stdout:1/465: fsync d1/db/de/d74/d12/f46 0 2024-09-06T14:44:47.177 INFO:tasks.workunit.client.0.smithi052.stdout:1/466: read - d1/db/d72/f97 zero size 2024-09-06T14:44:47.178 INFO:tasks.workunit.client.0.smithi052.stdout:9/330: rename d1/d4/df/f32 to d1/d4/f5e 0 2024-09-06T14:44:47.178 INFO:tasks.workunit.client.0.smithi052.stdout:6/360: write d2/dd/d18/d25/f3e [1382071,28414] 0 2024-09-06T14:44:47.178 INFO:tasks.workunit.client.0.smithi052.stdout:7/391: rename d11/d1c/d24 to d11/d1c/d24/d64/d85 22 2024-09-06T14:44:47.181 INFO:tasks.workunit.client.0.smithi052.stdout:6/361: write d2/dd/d18/f6d [491300,6913] 0 2024-09-06T14:44:47.181 INFO:tasks.workunit.client.0.smithi052.stdout:6/362: stat d2/d4a/d6e/d76 0 2024-09-06T14:44:47.183 INFO:tasks.workunit.client.0.smithi052.stdout:0/464: truncate d0/d19/f72 514732 0 2024-09-06T14:44:47.186 INFO:tasks.workunit.client.0.smithi052.stdout:2/447: truncate da/d2d/d34/d66/f77 2249112 0 2024-09-06T14:44:47.188 INFO:tasks.workunit.client.0.smithi052.stdout:1/467: creat d1/db/de/d74/d3e/d47/d4a/fa2 x:0 0 0 2024-09-06T14:44:47.189 INFO:tasks.workunit.client.0.smithi052.stdout:1/468: chown d1/db 0 1 2024-09-06T14:44:47.189 INFO:tasks.workunit.client.0.smithi052.stdout:1/469: read d1/db/d18/f92 [394747,4682] 0 2024-09-06T14:44:47.190 INFO:tasks.workunit.client.0.smithi052.stdout:1/470: dread - d1/db/d50/f5e zero size 2024-09-06T14:44:47.190 INFO:tasks.workunit.client.0.smithi052.stdout:1/471: readlink d1/db/l20 0 2024-09-06T14:44:47.191 INFO:tasks.workunit.client.0.smithi052.stdout:5/432: mkdir d2/d20/d91/d93 0 2024-09-06T14:44:47.193 INFO:tasks.workunit.client.0.smithi052.stdout:6/363: rmdir d2/dd/d18/d25/d4c 39 2024-09-06T14:44:47.195 INFO:tasks.workunit.client.0.smithi052.stdout:2/448: creat da/d19/d3a/d31/d76/d6a/f9c x:0 0 0 2024-09-06T14:44:47.197 INFO:tasks.workunit.client.0.smithi052.stdout:2/449: stat da/d19/d3a/d31/f43 0 2024-09-06T14:44:47.198 INFO:tasks.workunit.client.0.smithi052.stdout:5/433: dwrite d2/d20/d42/f5f [4194304,4194304] 0 2024-09-06T14:44:47.198 INFO:tasks.workunit.client.0.smithi052.stdout:2/450: chown da/d19/d3a/f63 25458 1 2024-09-06T14:44:47.206 INFO:tasks.workunit.client.0.smithi052.stdout:2/451: dwrite da/d19/f26 [4194304,4194304] 0 2024-09-06T14:44:47.207 INFO:tasks.workunit.client.0.smithi052.stdout:0/465: link d0/d1a/d26/d3a/d14/d20/f2f d0/d19/fa8 0 2024-09-06T14:44:47.208 INFO:tasks.workunit.client.0.smithi052.stdout:0/466: truncate d0/d2e/f70 701260 0 2024-09-06T14:44:47.457 INFO:tasks.workunit.client.0.smithi052.stdout:8/537: rename f1 to d6/d9/fb2 0 2024-09-06T14:44:47.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/538: write d6/d9/d6d/f7a [8204236,63689] 0 2024-09-06T14:44:47.459 INFO:tasks.workunit.client.0.smithi052.stdout:8/539: chown d6/d22/d36/d3e/d47/d56 9 1 2024-09-06T14:44:47.459 INFO:tasks.workunit.client.0.smithi052.stdout:8/540: chown d6/d9/ca5 36061115 1 2024-09-06T14:44:47.462 INFO:tasks.workunit.client.0.smithi052.stdout:9/331: creat d1/d4/d6/dd/f5f x:0 0 0 2024-09-06T14:44:47.463 INFO:tasks.workunit.client.0.smithi052.stdout:9/332: readlink d1/d4/df/l2a 0 2024-09-06T14:44:47.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/541: dread d6/d16/f6b [0,4194304] 0 2024-09-06T14:44:47.468 INFO:tasks.workunit.client.0.smithi052.stdout:7/392: truncate d11/d1c/d24/f29 3270206 0 2024-09-06T14:44:47.471 INFO:tasks.workunit.client.0.smithi052.stdout:2/452: mkdir da/db/d9d 0 2024-09-06T14:44:47.474 INFO:tasks.workunit.client.0.smithi052.stdout:0/467: creat d0/d1a/d26/d3a/d14/d2d/fa9 x:0 0 0 2024-09-06T14:44:47.477 INFO:tasks.workunit.client.0.smithi052.stdout:6/364: mknod d2/dd/d18/d25/d4c/c7b 0 2024-09-06T14:44:47.479 INFO:tasks.workunit.client.0.smithi052.stdout:4/403: rename d9/d2d/f30 to d9/d2d/d33/d5d/f94 0 2024-09-06T14:44:47.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/404: fdatasync d9/d10/f6e 0 2024-09-06T14:44:47.485 INFO:tasks.workunit.client.0.smithi052.stdout:1/472: link d1/db/de/d74/d14/d2e/f84 d1/db/de/d74/d14/d90/fa3 0 2024-09-06T14:44:47.486 INFO:tasks.workunit.client.0.smithi052.stdout:1/473: dread d1/db/de/d74/d36/f7e [0,4194304] 0 2024-09-06T14:44:47.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/474: write d1/db/de/d74/ff [412305,9550] 0 2024-09-06T14:44:47.488 INFO:tasks.workunit.client.0.smithi052.stdout:0/468: mkdir d0/d1a/daa 0 2024-09-06T14:44:47.490 INFO:tasks.workunit.client.0.smithi052.stdout:1/475: chown d1/db/de/d74/d3e/d47/d4a/f4e 34231503 1 2024-09-06T14:44:47.499 INFO:tasks.workunit.client.0.smithi052.stdout:4/405: dread d9/d2d/d33/f37 [0,4194304] 0 2024-09-06T14:44:47.499 INFO:tasks.workunit.client.0.smithi052.stdout:5/434: creat d2/d1a/d22/d26/d2b/f94 x:0 0 0 2024-09-06T14:44:47.501 INFO:tasks.workunit.client.0.smithi052.stdout:5/435: write d2/d20/f23 [4841336,19551] 0 2024-09-06T14:44:47.502 INFO:tasks.workunit.client.0.smithi052.stdout:8/542: symlink d6/d9/d1f/d19/lb3 0 2024-09-06T14:44:47.503 INFO:tasks.workunit.client.0.smithi052.stdout:5/436: write d2/d1a/d22/f7a [933330,54120] 0 2024-09-06T14:44:47.504 INFO:tasks.workunit.client.0.smithi052.stdout:8/543: chown d6/d22/d36/d3e/d47/c9f 40 1 2024-09-06T14:44:47.505 INFO:tasks.workunit.client.0.smithi052.stdout:5/437: write d2/d1a/d22/d26/d62/f8a [727832,104076] 0 2024-09-06T14:44:47.508 INFO:tasks.workunit.client.0.smithi052.stdout:7/393: write d11/d1c/d26/f40 [1093214,25045] 0 2024-09-06T14:44:47.511 INFO:tasks.workunit.client.0.smithi052.stdout:1/476: mkdir d1/db/d50/da4 0 2024-09-06T14:44:47.514 INFO:tasks.workunit.client.0.smithi052.stdout:4/406: dread d9/d10/d17/d39/f58 [0,4194304] 0 2024-09-06T14:44:47.515 INFO:tasks.workunit.client.0.smithi052.stdout:2/453: rename da/d19/d5a/d5f/c88 to da/d19/d3a/d31/d76/c9e 0 2024-09-06T14:44:47.516 INFO:tasks.workunit.client.0.smithi052.stdout:9/333: link d1/d4/d6/dc/d10/d18/c27 d1/d4/d4b/c60 0 2024-09-06T14:44:47.517 INFO:tasks.workunit.client.0.smithi052.stdout:7/394: dwrite d11/d1c/f1f [0,4194304] 0 2024-09-06T14:44:47.519 INFO:tasks.workunit.client.0.smithi052.stdout:8/544: dread d6/d9/d1f/d33/da8/f4e [0,4194304] 0 2024-09-06T14:44:47.520 INFO:tasks.workunit.client.0.smithi052.stdout:8/545: stat d6/c7 0 2024-09-06T14:44:47.525 INFO:tasks.workunit.client.0.smithi052.stdout:5/438: creat d2/d20/d56/f95 x:0 0 0 2024-09-06T14:44:47.527 INFO:tasks.workunit.client.0.smithi052.stdout:0/469: unlink d0/d1a/d26/d3a/d14/d20/c57 0 2024-09-06T14:44:47.535 INFO:tasks.workunit.client.0.smithi052.stdout:9/334: rmdir d1/d4/d6/dd/d22 39 2024-09-06T14:44:47.540 INFO:tasks.workunit.client.0.smithi052.stdout:5/439: creat d2/d1a/d22/d26/d2b/d37/d6a/f96 x:0 0 0 2024-09-06T14:44:47.542 INFO:tasks.workunit.client.0.smithi052.stdout:5/440: write d2/d20/d42/d65/f78 [976510,18725] 0 2024-09-06T14:44:47.543 INFO:tasks.workunit.client.0.smithi052.stdout:5/441: chown d2/d20/l7c 32311537 1 2024-09-06T14:44:47.543 INFO:tasks.workunit.client.0.smithi052.stdout:6/365: link d2/c45 d2/dd/c7c 0 2024-09-06T14:44:47.544 INFO:tasks.workunit.client.0.smithi052.stdout:1/477: getdents d1/db/de/d74/d36/d7c 0 2024-09-06T14:44:47.548 INFO:tasks.workunit.client.0.smithi052.stdout:4/407: write d9/d10/d17/f23 [38848,44152] 0 2024-09-06T14:44:47.548 INFO:tasks.workunit.client.0.smithi052.stdout:7/395: dread f5 [0,4194304] 0 2024-09-06T14:44:47.549 INFO:tasks.workunit.client.0.smithi052.stdout:7/396: fsync d11/f21 0 2024-09-06T14:44:47.549 INFO:tasks.workunit.client.0.smithi052.stdout:9/335: fdatasync d1/d4/df/f24 0 2024-09-06T14:44:47.551 INFO:tasks.workunit.client.0.smithi052.stdout:8/546: symlink d6/d22/lb4 0 2024-09-06T14:44:47.552 INFO:tasks.workunit.client.0.smithi052.stdout:6/366: mkdir d2/dd/d7d 0 2024-09-06T14:44:47.554 INFO:tasks.workunit.client.0.smithi052.stdout:2/454: link da/d19/d3a/f3f da/d2d/f9f 0 2024-09-06T14:44:47.557 INFO:tasks.workunit.client.0.smithi052.stdout:5/442: mkdir d2/d1a/d22/d26/d2b/d37/d84/d97 0 2024-09-06T14:44:47.558 INFO:tasks.workunit.client.0.smithi052.stdout:4/408: dread d9/d10/d17/d39/f46 [0,4194304] 0 2024-09-06T14:44:47.558 INFO:tasks.workunit.client.0.smithi052.stdout:6/367: mknod d2/dd/d18/d25/d4c/c7e 0 2024-09-06T14:44:47.559 INFO:tasks.workunit.client.0.smithi052.stdout:1/478: mknod d1/db/de/d74/ca5 0 2024-09-06T14:44:47.560 INFO:tasks.workunit.client.0.smithi052.stdout:9/336: dwrite d1/d4/d6/dc/d10/d18/f5c [0,4194304] 0 2024-09-06T14:44:47.560 INFO:tasks.workunit.client.0.smithi052.stdout:5/443: stat d2/d20/d56/l70 0 2024-09-06T14:44:47.562 INFO:tasks.workunit.client.0.smithi052.stdout:0/470: dread d0/d1a/d26/d3a/f36 [0,4194304] 0 2024-09-06T14:44:47.565 INFO:tasks.workunit.client.0.smithi052.stdout:8/547: creat d6/d9/fb5 x:0 0 0 2024-09-06T14:44:47.567 INFO:tasks.workunit.client.0.smithi052.stdout:6/368: truncate d2/dd/d18/d4b/f53 1108741 0 2024-09-06T14:44:47.567 INFO:tasks.workunit.client.0.smithi052.stdout:1/479: creat d1/db/d50/fa6 x:0 0 0 2024-09-06T14:44:47.567 INFO:tasks.workunit.client.0.smithi052.stdout:5/444: fdatasync d2/d1a/d22/d26/d2b/d48/f8d 0 2024-09-06T14:44:47.568 INFO:tasks.workunit.client.0.smithi052.stdout:8/548: chown d6/d9/f95 134 1 2024-09-06T14:44:47.570 INFO:tasks.workunit.client.0.smithi052.stdout:2/455: dwrite da/d19/d5a/d5f/f9a [0,4194304] 0 2024-09-06T14:44:47.573 INFO:tasks.workunit.client.0.smithi052.stdout:2/456: truncate da/f57 1574616 0 2024-09-06T14:44:47.581 INFO:tasks.workunit.client.0.smithi052.stdout:9/337: unlink d1/d4/df/l2a 0 2024-09-06T14:44:47.581 INFO:tasks.workunit.client.0.smithi052.stdout:9/338: stat d1/c54 0 2024-09-06T14:44:47.581 INFO:tasks.workunit.client.0.smithi052.stdout:9/339: fsync d1/d4/df/f59 0 2024-09-06T14:44:47.583 INFO:tasks.workunit.client.0.smithi052.stdout:4/409: rename d9/d10/l43 to d9/d10/d17/d39/d7b/l95 0 2024-09-06T14:44:47.583 INFO:tasks.workunit.client.0.smithi052.stdout:9/340: write d1/d4/d6/dc/d10/d18/f33 [2129344,13566] 0 2024-09-06T14:44:47.589 INFO:tasks.workunit.client.0.smithi052.stdout:6/369: symlink d2/dd/d18/d4b/l7f 0 2024-09-06T14:44:47.589 INFO:tasks.workunit.client.0.smithi052.stdout:6/370: write d2/dd/d18/d25/f2c [3539995,28878] 0 2024-09-06T14:44:47.589 INFO:tasks.workunit.client.0.smithi052.stdout:2/457: mkdir da/d2d/d34/d66/da0 0 2024-09-06T14:44:47.589 INFO:tasks.workunit.client.0.smithi052.stdout:6/371: readlink d2/dd/d18/d4b/l7f 0 2024-09-06T14:44:47.589 INFO:tasks.workunit.client.0.smithi052.stdout:8/549: symlink d6/d9/lb6 0 2024-09-06T14:44:47.591 INFO:tasks.workunit.client.0.smithi052.stdout:0/471: rename d0/d1a/d26/d3a/d14/d20/f61 to d0/d1a/d8e/fab 0 2024-09-06T14:44:47.596 INFO:tasks.workunit.client.0.smithi052.stdout:2/458: mknod da/d64/ca1 0 2024-09-06T14:44:47.603 INFO:tasks.workunit.client.0.smithi052.stdout:5/445: link d2/d20/d42/d65/l92 d2/d20/l98 0 2024-09-06T14:44:47.603 INFO:tasks.workunit.client.0.smithi052.stdout:2/459: dwrite da/d19/d3a/d31/d76/d6a/f9c [0,4194304] 0 2024-09-06T14:44:47.605 INFO:tasks.workunit.client.0.smithi052.stdout:1/480: write d1/db/d50/f5e [864766,68548] 0 2024-09-06T14:44:47.607 INFO:tasks.workunit.client.0.smithi052.stdout:6/372: creat d2/dd/d18/d33/d44/d47/f80 x:0 0 0 2024-09-06T14:44:47.607 INFO:tasks.workunit.client.0.smithi052.stdout:1/481: truncate d1/f1d 4826448 0 2024-09-06T14:44:47.608 INFO:tasks.workunit.client.0.smithi052.stdout:1/482: chown d1/db/de/c27 151918763 1 2024-09-06T14:44:47.609 INFO:tasks.workunit.client.0.smithi052.stdout:4/410: rename d9/d10/l13 to d9/d10/d17/d39/d3a/d5c/l96 0 2024-09-06T14:44:47.614 INFO:tasks.workunit.client.0.smithi052.stdout:9/341: creat d1/d4/d6/dc/f61 x:0 0 0 2024-09-06T14:44:47.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/373: dwrite d2/dd/d18/d2d/d32/f55 [0,4194304] 0 2024-09-06T14:44:47.616 INFO:tasks.workunit.client.0.smithi052.stdout:6/374: write d2/dd/d18/d33/d44/d47/f80 [799588,78172] 0 2024-09-06T14:44:47.617 INFO:tasks.workunit.client.0.smithi052.stdout:6/375: dread - d2/dd/f7a zero size 2024-09-06T14:44:47.618 INFO:tasks.workunit.client.0.smithi052.stdout:5/446: unlink d2/d1a/f77 0 2024-09-06T14:44:47.619 INFO:tasks.workunit.client.0.smithi052.stdout:2/460: creat da/db/fa2 x:0 0 0 2024-09-06T14:44:47.623 INFO:tasks.workunit.client.0.smithi052.stdout:4/411: chown d9/c59 180008319 1 2024-09-06T14:44:47.625 INFO:tasks.workunit.client.0.smithi052.stdout:8/550: rename d6/f5f to d6/d9/d1f/d14/da0/fb7 0 2024-09-06T14:44:47.628 INFO:tasks.workunit.client.0.smithi052.stdout:1/483: mknod d1/db/de/d74/d3e/d47/ca7 0 2024-09-06T14:44:47.635 INFO:tasks.workunit.client.0.smithi052.stdout:1/484: dwrite d1/db/de/d74/d3e/d47/d4a/f77 [0,4194304] 0 2024-09-06T14:44:47.636 INFO:tasks.workunit.client.0.smithi052.stdout:2/461: unlink da/d19/d3a/d31/f5e 0 2024-09-06T14:44:47.641 INFO:tasks.workunit.client.0.smithi052.stdout:8/551: rename d6/d22/d5c to d6/d9/d1f/d33/da8/d41/db8 0 2024-09-06T14:44:47.642 INFO:tasks.workunit.client.0.smithi052.stdout:0/472: write d0/d19/f80 [3258976,125009] 0 2024-09-06T14:44:47.642 INFO:tasks.workunit.client.0.smithi052.stdout:8/552: chown d6/d22/c62 126 1 2024-09-06T14:44:47.643 INFO:tasks.workunit.client.0.smithi052.stdout:9/342: creat d1/d4/d4b/f62 x:0 0 0 2024-09-06T14:44:47.644 INFO:tasks.workunit.client.0.smithi052.stdout:8/553: readlink d6/d9/d6d/l75 0 2024-09-06T14:44:47.648 INFO:tasks.workunit.client.0.smithi052.stdout:2/462: creat da/db/d18/d7f/fa3 x:0 0 0 2024-09-06T14:44:47.649 INFO:tasks.workunit.client.0.smithi052.stdout:2/463: write da/d19/d5a/d5f/d70/f93 [786846,129036] 0 2024-09-06T14:44:47.650 INFO:tasks.workunit.client.0.smithi052.stdout:0/473: rmdir d0/d1a/d26/d3a/d14/d20/d22 39 2024-09-06T14:44:47.652 INFO:tasks.workunit.client.0.smithi052.stdout:8/554: symlink d6/d22/d36/d3e/d47/d56/d68/d69/lb9 0 2024-09-06T14:44:47.654 INFO:tasks.workunit.client.0.smithi052.stdout:2/464: symlink da/d4f/la4 0 2024-09-06T14:44:47.655 INFO:tasks.workunit.client.0.smithi052.stdout:2/465: stat da/c4b 0 2024-09-06T14:44:47.656 INFO:tasks.workunit.client.0.smithi052.stdout:5/447: getdents d2/d1a/d22/d26/d2b/d37/d84 0 2024-09-06T14:44:47.657 INFO:tasks.workunit.client.0.smithi052.stdout:1/485: link d1/db/de/c27 d1/db/de/d74/d14/d9f/ca8 0 2024-09-06T14:44:47.658 INFO:tasks.workunit.client.0.smithi052.stdout:5/448: readlink d2/d1a/d22/d26/l67 0 2024-09-06T14:44:47.660 INFO:tasks.workunit.client.0.smithi052.stdout:8/555: dwrite d6/d9/f18 [0,4194304] 0 2024-09-06T14:44:47.660 INFO:tasks.workunit.client.0.smithi052.stdout:1/486: rmdir d1/d6c/d98 39 2024-09-06T14:44:47.662 INFO:tasks.workunit.client.0.smithi052.stdout:8/556: stat d6/d9/l23 0 2024-09-06T14:44:47.663 INFO:tasks.workunit.client.0.smithi052.stdout:8/557: dread - d6/d4c/f65 zero size 2024-09-06T14:44:47.668 INFO:tasks.workunit.client.0.smithi052.stdout:2/466: dread da/d19/f1c [4194304,4194304] 0 2024-09-06T14:44:47.670 INFO:tasks.workunit.client.0.smithi052.stdout:5/449: dread d2/d1a/d22/d26/f85 [0,4194304] 0 2024-09-06T14:44:47.672 INFO:tasks.workunit.client.0.smithi052.stdout:5/450: read d2/d1a/d22/d26/f85 [136636,105889] 0 2024-09-06T14:44:47.673 INFO:tasks.workunit.client.0.smithi052.stdout:8/558: dwrite d6/d4c/f66 [0,4194304] 0 2024-09-06T14:44:47.675 INFO:tasks.workunit.client.0.smithi052.stdout:5/451: rmdir d2/d1a/d22/d26 39 2024-09-06T14:44:47.678 INFO:tasks.workunit.client.0.smithi052.stdout:2/467: dwrite da/db/d18/d7f/fa3 [0,4194304] 0 2024-09-06T14:44:47.680 INFO:tasks.workunit.client.0.smithi052.stdout:8/559: creat d6/d9/d1f/d33/da8/d1b/d87/fba x:0 0 0 2024-09-06T14:44:47.686 INFO:tasks.workunit.client.0.smithi052.stdout:2/468: creat da/d19/d3a/d31/d76/d6a/fa5 x:0 0 0 2024-09-06T14:44:47.691 INFO:tasks.workunit.client.0.smithi052.stdout:4/412: dwrite d9/d10/d19/f29 [0,4194304] 0 2024-09-06T14:44:47.694 INFO:tasks.workunit.client.0.smithi052.stdout:2/469: creat da/d19/d5a/d5f/d70/fa6 x:0 0 0 2024-09-06T14:44:47.698 INFO:tasks.workunit.client.0.smithi052.stdout:4/413: dread d9/d10/d17/d39/f93 [0,4194304] 0 2024-09-06T14:44:47.702 INFO:tasks.workunit.client.0.smithi052.stdout:4/414: chown d9/d2d/d33/d5d/f8a 14 1 2024-09-06T14:44:47.704 INFO:tasks.workunit.client.0.smithi052.stdout:2/470: dwrite da/d19/d5a/d5f/d70/f99 [0,4194304] 0 2024-09-06T14:44:47.705 INFO:tasks.workunit.client.0.smithi052.stdout:5/452: dread d2/d20/f23 [0,4194304] 0 2024-09-06T14:44:47.707 INFO:tasks.workunit.client.0.smithi052.stdout:4/415: mknod d9/d2d/d33/c97 0 2024-09-06T14:44:47.709 INFO:tasks.workunit.client.0.smithi052.stdout:4/416: truncate d9/d10/f6e 1214117 0 2024-09-06T14:44:47.712 INFO:tasks.workunit.client.0.smithi052.stdout:5/453: readlink d2/d1a/d22/d26/l36 0 2024-09-06T14:44:47.712 INFO:tasks.workunit.client.0.smithi052.stdout:4/417: truncate d9/d2d/d33/d5d/f89 644355 0 2024-09-06T14:44:47.713 INFO:tasks.workunit.client.0.smithi052.stdout:4/418: write d9/d10/d17/f23 [994295,29396] 0 2024-09-06T14:44:47.718 INFO:tasks.workunit.client.0.smithi052.stdout:5/454: link d2/d1a/d22/l4d d2/d20/d91/d93/l99 0 2024-09-06T14:44:47.719 INFO:tasks.workunit.client.0.smithi052.stdout:0/474: write d0/d18/f50 [148974,109196] 0 2024-09-06T14:44:47.720 INFO:tasks.workunit.client.0.smithi052.stdout:5/455: write d2/d20/d42/d65/f87 [602249,54416] 0 2024-09-06T14:44:47.720 INFO:tasks.workunit.client.0.smithi052.stdout:4/419: dread d9/d10/d19/f2c [0,4194304] 0 2024-09-06T14:44:47.722 INFO:tasks.workunit.client.0.smithi052.stdout:4/420: fsync d9/d10/d17/d39/d3a/d5c/f7f 0 2024-09-06T14:44:47.728 INFO:tasks.workunit.client.0.smithi052.stdout:5/456: rename d2/d1a/d22/d26/d2b/d48/c5a to d2/d1a/d22/d26/d62/c9a 0 2024-09-06T14:44:47.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/421: fdatasync d9/d10/f4f 0 2024-09-06T14:44:47.733 INFO:tasks.workunit.client.0.smithi052.stdout:4/422: creat d9/d10/d17/d39/d3a/d5c/f98 x:0 0 0 2024-09-06T14:44:47.739 INFO:tasks.workunit.client.0.smithi052.stdout:4/423: dread - d9/d2d/d33/d5d/f94 zero size 2024-09-06T14:44:47.742 INFO:tasks.workunit.client.0.smithi052.stdout:4/424: write d9/f5f [1070801,43012] 0 2024-09-06T14:44:47.744 INFO:tasks.workunit.client.0.smithi052.stdout:8/560: dwrite d6/d4c/f63 [0,4194304] 0 2024-09-06T14:44:47.772 INFO:tasks.workunit.client.0.smithi052.stdout:3/434: sync 2024-09-06T14:44:47.775 INFO:tasks.workunit.client.0.smithi052.stdout:8/561: creat d6/d22/d36/d3e/fbb x:0 0 0 2024-09-06T14:44:47.781 INFO:tasks.workunit.client.0.smithi052.stdout:8/562: creat d6/d16/fbc x:0 0 0 2024-09-06T14:44:47.782 INFO:tasks.workunit.client.0.smithi052.stdout:8/563: write d6/d9/f95 [80762,5040] 0 2024-09-06T14:44:47.788 INFO:tasks.workunit.client.0.smithi052.stdout:3/435: creat d0/d11/d12/f83 x:0 0 0 2024-09-06T14:44:47.793 INFO:tasks.workunit.client.0.smithi052.stdout:2/471: write da/db/fe [1149989,14318] 0 2024-09-06T14:44:47.801 INFO:tasks.workunit.client.0.smithi052.stdout:2/472: rename da/d19/d5a/d5f/d70/d82 to da/d19/d5a/da7 0 2024-09-06T14:44:47.804 INFO:tasks.workunit.client.0.smithi052.stdout:3/436: link d0/d11/d12/d17/c6c d0/d11/d15/d19/c84 0 2024-09-06T14:44:47.806 INFO:tasks.workunit.client.0.smithi052.stdout:2/473: truncate da/db/f45 554996 0 2024-09-06T14:44:47.816 INFO:tasks.workunit.client.0.smithi052.stdout:5/457: truncate d2/d1a/f3d 1567496 0 2024-09-06T14:44:47.816 INFO:tasks.workunit.client.0.smithi052.stdout:5/458: readlink d2/l9 0 2024-09-06T14:44:47.821 INFO:tasks.workunit.client.0.smithi052.stdout:5/459: creat d2/d1a/d22/d26/d2b/d37/d84/f9b x:0 0 0 2024-09-06T14:44:47.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/460: fsync d2/d20/d42/f5f 0 2024-09-06T14:44:47.824 INFO:tasks.workunit.client.0.smithi052.stdout:4/425: dwrite d9/d2d/d33/f6a [0,4194304] 0 2024-09-06T14:44:47.827 INFO:tasks.workunit.client.0.smithi052.stdout:8/564: write d6/d9/d1f/d33/da8/d41/d71/f81 [2698377,60881] 0 2024-09-06T14:44:47.830 INFO:tasks.workunit.client.0.smithi052.stdout:4/426: dread d9/d10/f1f [4194304,4194304] 0 2024-09-06T14:44:47.832 INFO:tasks.workunit.client.0.smithi052.stdout:5/461: symlink d2/d1a/d22/d26/d2b/d37/d68/d6c/l9c 0 2024-09-06T14:44:47.834 INFO:tasks.workunit.client.0.smithi052.stdout:5/462: write d2/d1a/d22/d26/d2b/d37/d6a/f8e [793564,58146] 0 2024-09-06T14:44:47.836 INFO:tasks.workunit.client.0.smithi052.stdout:8/565: symlink d6/d22/d36/d3e/d47/da7/lbd 0 2024-09-06T14:44:47.841 INFO:tasks.workunit.client.0.smithi052.stdout:4/427: link d9/d2d/f8d d9/d2d/d33/d5d/f99 0 2024-09-06T14:44:47.850 INFO:tasks.workunit.client.0.smithi052.stdout:3/437: dwrite d0/d11/d12/d4c/d53/f3e [0,4194304] 0 2024-09-06T14:44:47.851 INFO:tasks.workunit.client.0.smithi052.stdout:4/428: rename d9/c6c to d9/d2d/d33/d4d/d81/c9a 0 2024-09-06T14:44:47.859 INFO:tasks.workunit.client.0.smithi052.stdout:3/438: dwrite d0/d11/d12/d73/f78 [0,4194304] 0 2024-09-06T14:44:47.860 INFO:tasks.workunit.client.0.smithi052.stdout:3/439: write d0/d11/d12/f47 [9053754,49458] 0 2024-09-06T14:44:47.861 INFO:tasks.workunit.client.0.smithi052.stdout:8/566: rmdir d6/d22/d36/d3e/d47/d9b 0 2024-09-06T14:44:47.863 INFO:tasks.workunit.client.0.smithi052.stdout:5/463: getdents d2/d20/d42 0 2024-09-06T14:44:47.868 INFO:tasks.workunit.client.0.smithi052.stdout:3/440: dread d0/d11/d15/f4e [0,4194304] 0 2024-09-06T14:44:47.868 INFO:tasks.workunit.client.0.smithi052.stdout:8/567: mknod d6/d9/d1f/d33/da8/d41/d71/cbe 0 2024-09-06T14:44:47.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/568: readlink d6/d9/d1f/d33/da8/l9a 0 2024-09-06T14:44:47.871 INFO:tasks.workunit.client.0.smithi052.stdout:2/474: dwrite da/db/f45 [0,4194304] 0 2024-09-06T14:44:47.873 INFO:tasks.workunit.client.0.smithi052.stdout:4/429: write d9/d10/d19/f3c [83543,62253] 0 2024-09-06T14:44:47.876 INFO:tasks.workunit.client.0.smithi052.stdout:3/441: mkdir d0/d11/d15/d1b/d85 0 2024-09-06T14:44:47.878 INFO:tasks.workunit.client.0.smithi052.stdout:2/475: mknod da/d19/d3a/d31/d76/d6a/ca8 0 2024-09-06T14:44:47.881 INFO:tasks.workunit.client.0.smithi052.stdout:8/569: getdents d6/d9/d1f/d33/da8/d1b 0 2024-09-06T14:44:47.883 INFO:tasks.workunit.client.0.smithi052.stdout:2/476: rename da/db/l5c to da/db/d46/d55/la9 0 2024-09-06T14:44:47.885 INFO:tasks.workunit.client.0.smithi052.stdout:8/570: mkdir d6/d16/dbf 0 2024-09-06T14:44:47.887 INFO:tasks.workunit.client.0.smithi052.stdout:2/477: mkdir da/db/d60/daa 0 2024-09-06T14:44:47.892 INFO:tasks.workunit.client.0.smithi052.stdout:5/464: dread d2/f13 [0,4194304] 0 2024-09-06T14:44:47.895 INFO:tasks.workunit.client.0.smithi052.stdout:2/478: link da/d64/ca1 da/db/d18/cab 0 2024-09-06T14:44:47.898 INFO:tasks.workunit.client.0.smithi052.stdout:8/571: dread d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:47.900 INFO:tasks.workunit.client.0.smithi052.stdout:5/465: dwrite d2/d1a/d22/d26/d2b/f94 [0,4194304] 0 2024-09-06T14:44:47.900 INFO:tasks.workunit.client.0.smithi052.stdout:2/479: creat da/db/d60/daa/fac x:0 0 0 2024-09-06T14:44:47.910 INFO:tasks.workunit.client.0.smithi052.stdout:2/480: dwrite da/d19/d3a/f3f [0,4194304] 0 2024-09-06T14:44:47.916 INFO:tasks.workunit.client.0.smithi052.stdout:2/481: dwrite da/db/fe [0,4194304] 0 2024-09-06T14:44:47.921 INFO:tasks.workunit.client.0.smithi052.stdout:2/482: dread f2 [0,4194304] 0 2024-09-06T14:44:47.928 INFO:tasks.workunit.client.0.smithi052.stdout:2/483: dwrite da/d2d/f7e [0,4194304] 0 2024-09-06T14:44:47.954 INFO:tasks.workunit.client.0.smithi052.stdout:2/484: dread da/db/f12 [4194304,4194304] 0 2024-09-06T14:44:47.966 INFO:tasks.workunit.client.0.smithi052.stdout:7/397: sync 2024-09-06T14:44:47.996 INFO:tasks.workunit.client.0.smithi052.stdout:8/572: mkdir d6/d9/d1f/d33/dc0 0 2024-09-06T14:44:47.997 INFO:tasks.workunit.client.0.smithi052.stdout:8/573: write d6/d9/d6d/f77 [1455636,43574] 0 2024-09-06T14:44:47.997 INFO:tasks.workunit.client.0.smithi052.stdout:5/466: rmdir d2/d20/d42 39 2024-09-06T14:44:47.998 INFO:tasks.workunit.client.0.smithi052.stdout:5/467: chown d2/d1a/d22/d26/d2b/d48/d64 67 1 2024-09-06T14:44:47.999 INFO:tasks.workunit.client.0.smithi052.stdout:5/468: dread - d2/d1a/d22/d26/d2b/f69 zero size 2024-09-06T14:44:48.013 INFO:tasks.workunit.client.0.smithi052.stdout:8/574: rename d6/d9/d1f/d14/c25 to d6/d4c/d76/cc1 0 2024-09-06T14:44:48.015 INFO:tasks.workunit.client.0.smithi052.stdout:8/575: read d6/d9/f9d [2593741,96273] 0 2024-09-06T14:44:48.018 INFO:tasks.workunit.client.0.smithi052.stdout:2/485: mknod da/db/d9d/cad 0 2024-09-06T14:44:48.025 INFO:tasks.workunit.client.0.smithi052.stdout:5/469: rename d2/f18 to d2/d20/d42/f9d 0 2024-09-06T14:44:48.028 INFO:tasks.workunit.client.0.smithi052.stdout:2/486: mknod da/db/cae 0 2024-09-06T14:44:48.036 INFO:tasks.workunit.client.0.smithi052.stdout:7/398: truncate d11/d1c/d24/d3b/d50/f6e 4915992 0 2024-09-06T14:44:48.037 INFO:tasks.workunit.client.0.smithi052.stdout:2/487: creat da/db/d60/faf x:0 0 0 2024-09-06T14:44:48.045 INFO:tasks.workunit.client.0.smithi052.stdout:5/470: getdents d2/d20/d91/d93 0 2024-09-06T14:44:48.045 INFO:tasks.workunit.client.0.smithi052.stdout:5/471: chown d2/d20/l7c 121745 1 2024-09-06T14:44:48.049 INFO:tasks.workunit.client.0.smithi052.stdout:5/472: mkdir d2/d1a/d22/d26/d2b/d37/d68/d9e 0 2024-09-06T14:44:48.049 INFO:tasks.workunit.client.0.smithi052.stdout:8/576: truncate d6/d9/d1f/d14/da0/fb7 3806631 0 2024-09-06T14:44:48.053 INFO:tasks.workunit.client.0.smithi052.stdout:7/399: getdents d11/d1c 0 2024-09-06T14:44:48.058 INFO:tasks.workunit.client.0.smithi052.stdout:7/400: creat d11/d1c/d24/d3b/d50/f86 x:0 0 0 2024-09-06T14:44:48.063 INFO:tasks.workunit.client.0.smithi052.stdout:5/473: dwrite d2/d1a/d22/d26/d2b/d48/f8d [0,4194304] 0 2024-09-06T14:44:48.063 INFO:tasks.workunit.client.0.smithi052.stdout:8/577: dwrite d6/d9/f95 [0,4194304] 0 2024-09-06T14:44:48.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/401: mkdir d11/d1c/d87 0 2024-09-06T14:44:48.069 INFO:tasks.workunit.client.0.smithi052.stdout:2/488: dwrite da/f11 [0,4194304] 0 2024-09-06T14:44:48.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:47 smithi165 ceph-mon[36229]: pgmap v26: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 216 MiB/s wr, 418 op/s 2024-09-06T14:44:48.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:47 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:48.075 INFO:tasks.workunit.client.0.smithi052.stdout:5/474: dwrite d2/d20/d56/f88 [0,4194304] 0 2024-09-06T14:44:48.080 INFO:tasks.workunit.client.0.smithi052.stdout:8/578: dwrite d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:48.080 INFO:tasks.workunit.client.0.smithi052.stdout:8/579: chown d6/d22 146 1 2024-09-06T14:44:48.081 INFO:tasks.workunit.client.0.smithi052.stdout:8/580: chown d6/d22/d36/l7f 391377869 1 2024-09-06T14:44:48.085 INFO:tasks.workunit.client.0.smithi052.stdout:5/475: creat d2/d1a/d22/f9f x:0 0 0 2024-09-06T14:44:48.093 INFO:tasks.workunit.client.0.smithi052.stdout:7/402: fsync d11/d1c/d26/f4d 0 2024-09-06T14:44:48.094 INFO:tasks.workunit.client.0.smithi052.stdout:7/403: chown d11/f2c 154399787 1 2024-09-06T14:44:48.096 INFO:tasks.workunit.client.0.smithi052.stdout:5/476: truncate d2/d20/d42/f49 1326066 0 2024-09-06T14:44:48.101 INFO:tasks.workunit.client.0.smithi052.stdout:7/404: mkdir d11/d1c/d3f/d5d/d88 0 2024-09-06T14:44:48.104 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:47 smithi052 ceph-mon[28627]: pgmap v26: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 75 MiB/s rd, 216 MiB/s wr, 418 op/s 2024-09-06T14:44:48.104 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:47 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:44:48.104 INFO:tasks.workunit.client.0.smithi052.stdout:7/405: fsync d11/d1c/d26/f4d 0 2024-09-06T14:44:48.110 INFO:tasks.workunit.client.0.smithi052.stdout:8/581: link d6/d22/d36/d3e/d47/d56/d68/c64 d6/d22/d36/cc2 0 2024-09-06T14:44:48.111 INFO:tasks.workunit.client.0.smithi052.stdout:5/477: getdents d2/d20/d91 0 2024-09-06T14:44:48.113 INFO:tasks.workunit.client.0.smithi052.stdout:5/478: fdatasync d2/d1a/d22/f7e 0 2024-09-06T14:44:48.122 INFO:tasks.workunit.client.0.smithi052.stdout:8/582: dwrite d6/d9/d1f/d14/f2b [4194304,4194304] 0 2024-09-06T14:44:48.124 INFO:tasks.workunit.client.0.smithi052.stdout:2/489: dread da/d19/f2c [0,4194304] 0 2024-09-06T14:44:48.125 INFO:tasks.workunit.client.0.smithi052.stdout:8/583: truncate d6/d4c/f65 147021 0 2024-09-06T14:44:48.126 INFO:tasks.workunit.client.0.smithi052.stdout:5/479: dread d2/d1a/d22/d26/d2b/f94 [0,4194304] 0 2024-09-06T14:44:48.140 INFO:tasks.workunit.client.0.smithi052.stdout:7/406: dwrite d11/f43 [0,4194304] 0 2024-09-06T14:44:48.151 INFO:tasks.workunit.client.0.smithi052.stdout:2/490: mknod da/db/d46/cb0 0 2024-09-06T14:44:48.152 INFO:tasks.workunit.client.0.smithi052.stdout:5/480: symlink d2/d1a/d22/d26/d2b/d37/d68/d6c/la0 0 2024-09-06T14:44:48.153 INFO:tasks.workunit.client.0.smithi052.stdout:5/481: readlink d2/d1a/d22/d26/l67 0 2024-09-06T14:44:48.156 INFO:tasks.workunit.client.0.smithi052.stdout:8/584: creat d6/d9/d1f/d33/dc0/fc3 x:0 0 0 2024-09-06T14:44:48.157 INFO:tasks.workunit.client.0.smithi052.stdout:7/407: fsync d11/f43 0 2024-09-06T14:44:48.160 INFO:tasks.workunit.client.0.smithi052.stdout:2/491: rename da/d19/d5a/d5f to da/db/d60/db1 0 2024-09-06T14:44:48.160 INFO:tasks.workunit.client.0.smithi052.stdout:2/492: stat da/db/d60 0 2024-09-06T14:44:48.161 INFO:tasks.workunit.client.0.smithi052.stdout:5/482: creat d2/d20/d91/fa1 x:0 0 0 2024-09-06T14:44:48.169 INFO:tasks.workunit.client.0.smithi052.stdout:8/585: mkdir d6/d9/d1f/d19/dc4 0 2024-09-06T14:44:48.170 INFO:tasks.workunit.client.0.smithi052.stdout:7/408: mkdir d11/d1c/d57/d89 0 2024-09-06T14:44:48.174 INFO:tasks.workunit.client.0.smithi052.stdout:2/493: truncate da/d19/f2c 1914272 0 2024-09-06T14:44:48.175 INFO:tasks.workunit.client.0.smithi052.stdout:5/483: mknod d2/d20/d42/d8b/ca2 0 2024-09-06T14:44:48.177 INFO:tasks.workunit.client.0.smithi052.stdout:8/586: symlink d6/d9/d1f/d33/da8/d41/db8/lc5 0 2024-09-06T14:44:48.185 INFO:tasks.workunit.client.0.smithi052.stdout:2/494: rename da/d19/d5a/d6c/l9b to da/d2d/lb2 0 2024-09-06T14:44:48.186 INFO:tasks.workunit.client.0.smithi052.stdout:5/484: mknod d2/d20/d42/d8b/ca3 0 2024-09-06T14:44:48.192 INFO:tasks.workunit.client.0.smithi052.stdout:2/495: creat da/d4f/fb3 x:0 0 0 2024-09-06T14:44:48.194 INFO:tasks.workunit.client.0.smithi052.stdout:7/409: mknod d11/d1c/d24/c8a 0 2024-09-06T14:44:48.200 INFO:tasks.workunit.client.0.smithi052.stdout:2/496: dwrite da/f23 [4194304,4194304] 0 2024-09-06T14:44:48.201 INFO:tasks.workunit.client.0.smithi052.stdout:8/587: getdents d6/d3c 0 2024-09-06T14:44:48.202 INFO:tasks.workunit.client.0.smithi052.stdout:5/485: write d2/d1a/d22/f7e [630091,130194] 0 2024-09-06T14:44:48.204 INFO:tasks.workunit.client.0.smithi052.stdout:7/410: link d11/d1c/d24/d3b/d50/f86 d11/d1c/d57/d89/f8b 0 2024-09-06T14:44:48.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/411: write d11/d1c/d3f/f72 [117370,18587] 0 2024-09-06T14:44:48.205 INFO:tasks.workunit.client.0.smithi052.stdout:2/497: link da/db/d60/f80 da/d19/d3a/d31/fb4 0 2024-09-06T14:44:48.206 INFO:tasks.workunit.client.0.smithi052.stdout:5/486: mknod d2/d1a/d22/d26/d2b/d37/d84/ca4 0 2024-09-06T14:44:48.209 INFO:tasks.workunit.client.0.smithi052.stdout:8/588: rename d6/d22/d36/d3e/d47/d56/d68/d69/l94 to d6/d3c/lc6 0 2024-09-06T14:44:48.210 INFO:tasks.workunit.client.0.smithi052.stdout:8/589: stat d6/d9/d1f/d33/da8/cb0 0 2024-09-06T14:44:48.211 INFO:tasks.workunit.client.0.smithi052.stdout:2/498: symlink da/db/d60/lb5 0 2024-09-06T14:44:48.212 INFO:tasks.workunit.client.0.smithi052.stdout:5/487: creat d2/d20/d42/d65/fa5 x:0 0 0 2024-09-06T14:44:48.217 INFO:tasks.workunit.client.0.smithi052.stdout:5/488: rmdir d2/d1a/d22/d26/d2b/d48/d64 39 2024-09-06T14:44:48.218 INFO:tasks.workunit.client.0.smithi052.stdout:5/489: fdatasync d2/d1a/d22/d26/d62/f66 0 2024-09-06T14:44:48.219 INFO:tasks.workunit.client.0.smithi052.stdout:7/412: link d11/d1c/f7c d11/d1c/d24/d3b/d50/f8c 0 2024-09-06T14:44:48.220 INFO:tasks.workunit.client.0.smithi052.stdout:8/590: link d6/d3c/c3d d6/d9/d1f/d33/cc7 0 2024-09-06T14:44:48.222 INFO:tasks.workunit.client.0.smithi052.stdout:7/413: dread d11/d1c/d24/d4b/f63 [0,4194304] 0 2024-09-06T14:44:48.223 INFO:tasks.workunit.client.0.smithi052.stdout:7/414: chown d11/d1c/d26/f48 10260083 1 2024-09-06T14:44:48.224 INFO:tasks.workunit.client.0.smithi052.stdout:5/490: dwrite d2/d1a/d22/d26/d2b/d37/f44 [0,4194304] 0 2024-09-06T14:44:48.228 INFO:tasks.workunit.client.0.smithi052.stdout:2/499: write da/d19/d3a/f63 [1407599,103074] 0 2024-09-06T14:44:48.229 INFO:tasks.workunit.client.0.smithi052.stdout:2/500: fdatasync da/f57 0 2024-09-06T14:44:48.234 INFO:tasks.workunit.client.0.smithi052.stdout:2/501: dread da/d2d/f7e [0,4194304] 0 2024-09-06T14:44:48.237 INFO:tasks.workunit.client.0.smithi052.stdout:2/502: creat da/db/d18/d7f/fb6 x:0 0 0 2024-09-06T14:44:48.240 INFO:tasks.workunit.client.0.smithi052.stdout:2/503: mknod da/db/d46/d6b/cb7 0 2024-09-06T14:44:48.240 INFO:tasks.workunit.client.0.smithi052.stdout:2/504: readlink da/d4f/l52 0 2024-09-06T14:44:48.241 INFO:tasks.workunit.client.0.smithi052.stdout:2/505: read f2 [984654,24343] 0 2024-09-06T14:44:48.249 INFO:tasks.workunit.client.0.smithi052.stdout:8/591: truncate d6/d22/f3a 2137244 0 2024-09-06T14:44:48.251 INFO:tasks.workunit.client.0.smithi052.stdout:7/415: truncate d11/d1c/d24/d4b/f4e 936291 0 2024-09-06T14:44:48.252 INFO:tasks.workunit.client.0.smithi052.stdout:8/592: unlink d6/d9/le 0 2024-09-06T14:44:48.254 INFO:tasks.workunit.client.0.smithi052.stdout:7/416: mknod d11/c8d 0 2024-09-06T14:44:48.255 INFO:tasks.workunit.client.0.smithi052.stdout:8/593: creat d6/d4c/fc8 x:0 0 0 2024-09-06T14:44:48.268 INFO:tasks.workunit.client.0.smithi052.stdout:8/594: dread d6/d22/d31/d5b/f96 [0,4194304] 0 2024-09-06T14:44:48.276 INFO:tasks.workunit.client.0.smithi052.stdout:8/595: creat d6/d9/fc9 x:0 0 0 2024-09-06T14:44:48.279 INFO:tasks.workunit.client.0.smithi052.stdout:8/596: mkdir d6/d22/d36/d3e/dca 0 2024-09-06T14:44:48.282 INFO:tasks.workunit.client.0.smithi052.stdout:8/597: rename d6/d9/ca5 to d6/d9/d1f/d33/da8/d1b/d87/ccb 0 2024-09-06T14:44:48.303 INFO:tasks.workunit.client.0.smithi052.stdout:8/598: dwrite d6/d9/d1f/d33/da8/f4e [0,4194304] 0 2024-09-06T14:44:48.305 INFO:tasks.workunit.client.0.smithi052.stdout:8/599: creat d6/d9/d1f/d33/fcc x:0 0 0 2024-09-06T14:44:48.310 INFO:tasks.workunit.client.0.smithi052.stdout:8/600: creat d6/d16/fcd x:0 0 0 2024-09-06T14:44:48.315 INFO:tasks.workunit.client.0.smithi052.stdout:8/601: rename d6/d9/d1f/d33/da8/d1b/d87/c9e to d6/d22/d36/d3e/d47/d56/d68/d69/cce 0 2024-09-06T14:44:48.331 INFO:tasks.workunit.client.0.smithi052.stdout:8/602: dwrite d6/d9/f9d [4194304,4194304] 0 2024-09-06T14:44:48.332 INFO:tasks.workunit.client.0.smithi052.stdout:8/603: chown d6/d9/d1f/d33/da8/d1b/f60 8 1 2024-09-06T14:44:48.335 INFO:tasks.workunit.client.0.smithi052.stdout:8/604: rename d6/d4c/d76 to d6/d9/d1f/dcf 0 2024-09-06T14:44:48.337 INFO:tasks.workunit.client.0.smithi052.stdout:8/605: mknod d6/d22/d36/d3e/d47/d56/d68/d69/cd0 0 2024-09-06T14:44:48.356 INFO:tasks.workunit.client.0.smithi052.stdout:8/606: dwrite d6/d22/f3a [0,4194304] 0 2024-09-06T14:44:48.358 INFO:tasks.workunit.client.0.smithi052.stdout:8/607: write d6/d4c/f65 [605947,108944] 0 2024-09-06T14:44:48.359 INFO:tasks.workunit.client.0.smithi052.stdout:8/608: chown d6/d9/d1f/d14/c15 11212 1 2024-09-06T14:44:48.362 INFO:tasks.workunit.client.0.smithi052.stdout:8/609: mkdir d6/d22/dd1 0 2024-09-06T14:44:48.363 INFO:tasks.workunit.client.0.smithi052.stdout:8/610: fsync d6/d16/fbc 0 2024-09-06T14:44:48.366 INFO:tasks.workunit.client.0.smithi052.stdout:8/611: creat d6/d9/d1f/dcf/fd2 x:0 0 0 2024-09-06T14:44:48.368 INFO:tasks.workunit.client.0.smithi052.stdout:8/612: mkdir d6/d22/d31/d5b/dd3 0 2024-09-06T14:44:48.371 INFO:tasks.workunit.client.0.smithi052.stdout:8/613: creat d6/d9/d1f/d19/d6f/d72/fd4 x:0 0 0 2024-09-06T14:44:48.372 INFO:tasks.workunit.client.0.smithi052.stdout:8/614: fdatasync d6/d22/fab 0 2024-09-06T14:44:48.373 INFO:tasks.workunit.client.0.smithi052.stdout:8/615: write d6/d4c/f65 [1490071,65607] 0 2024-09-06T14:44:48.375 INFO:tasks.workunit.client.0.smithi052.stdout:8/616: chown d6/f59 4063 1 2024-09-06T14:44:48.375 INFO:tasks.workunit.client.0.smithi052.stdout:8/617: dread d6/f98 [0,4194304] 0 2024-09-06T14:44:48.378 INFO:tasks.workunit.client.0.smithi052.stdout:8/618: creat d6/d16/fd5 x:0 0 0 2024-09-06T14:44:48.380 INFO:tasks.workunit.client.0.smithi052.stdout:8/619: rmdir d6/d9/d1f/d14 39 2024-09-06T14:44:48.380 INFO:tasks.workunit.client.0.smithi052.stdout:8/620: chown d6/d4c/f66 59281 1 2024-09-06T14:44:48.383 INFO:tasks.workunit.client.0.smithi052.stdout:8/621: symlink d6/d9/d1f/d19/d6f/ld6 0 2024-09-06T14:44:48.388 INFO:tasks.workunit.client.0.smithi052.stdout:8/622: dwrite d6/d9/f9d [0,4194304] 0 2024-09-06T14:44:48.393 INFO:tasks.workunit.client.0.smithi052.stdout:8/623: creat d6/d9/d6d/fd7 x:0 0 0 2024-09-06T14:44:48.394 INFO:tasks.workunit.client.0.smithi052.stdout:8/624: write d6/d9/d1f/d19/f93 [358132,95871] 0 2024-09-06T14:44:48.399 INFO:tasks.workunit.client.0.smithi052.stdout:8/625: creat d6/d22/d36/d3e/dca/fd8 x:0 0 0 2024-09-06T14:44:48.408 INFO:tasks.workunit.client.0.smithi052.stdout:8/626: rename d6/d9/d6d/fd7 to d6/d22/fd9 0 2024-09-06T14:44:48.408 INFO:tasks.workunit.client.0.smithi052.stdout:8/627: write d6/d4c/fc8 [521243,125350] 0 2024-09-06T14:44:48.409 INFO:tasks.workunit.client.0.smithi052.stdout:0/475: sync 2024-09-06T14:44:48.409 INFO:tasks.workunit.client.0.smithi052.stdout:9/343: sync 2024-09-06T14:44:48.409 INFO:tasks.workunit.client.0.smithi052.stdout:1/487: sync 2024-09-06T14:44:48.409 INFO:tasks.workunit.client.0.smithi052.stdout:6/376: sync 2024-09-06T14:44:48.410 INFO:tasks.workunit.client.0.smithi052.stdout:4/430: sync 2024-09-06T14:44:48.410 INFO:tasks.workunit.client.0.smithi052.stdout:0/476: readlink d0/d1a/d26/l7c 0 2024-09-06T14:44:48.411 INFO:tasks.workunit.client.0.smithi052.stdout:4/431: chown f2 11343 1 2024-09-06T14:44:48.412 INFO:tasks.workunit.client.0.smithi052.stdout:1/488: read - d1/db/d72/f97 zero size 2024-09-06T14:44:48.413 INFO:tasks.workunit.client.0.smithi052.stdout:6/377: mkdir d2/dd/d81 0 2024-09-06T14:44:48.416 INFO:tasks.workunit.client.0.smithi052.stdout:9/344: mknod d1/d4/df/d56/c63 0 2024-09-06T14:44:48.417 INFO:tasks.workunit.client.0.smithi052.stdout:4/432: chown d9/d2d/d33/c85 418 1 2024-09-06T14:44:48.417 INFO:tasks.workunit.client.0.smithi052.stdout:8/628: dwrite d6/d9/d1f/d33/da8/d41/fac [0,4194304] 0 2024-09-06T14:44:48.423 INFO:tasks.workunit.client.0.smithi052.stdout:4/433: dread d9/d2d/d33/f37 [0,4194304] 0 2024-09-06T14:44:48.424 INFO:tasks.workunit.client.0.smithi052.stdout:9/345: dread d1/d4/d6/dc/d10/d18/f5c [0,4194304] 0 2024-09-06T14:44:48.424 INFO:tasks.workunit.client.0.smithi052.stdout:4/434: stat d9/d72/l79 0 2024-09-06T14:44:48.427 INFO:tasks.workunit.client.0.smithi052.stdout:1/489: creat d1/db/de/d74/d36/d9b/fa9 x:0 0 0 2024-09-06T14:44:48.428 INFO:tasks.workunit.client.0.smithi052.stdout:1/490: chown d1/db/de/d74/c1a 16 1 2024-09-06T14:44:48.435 INFO:tasks.workunit.client.0.smithi052.stdout:4/435: symlink d9/d10/d17/d39/d3a/d5c/l9b 0 2024-09-06T14:44:48.438 INFO:tasks.workunit.client.0.smithi052.stdout:1/491: mkdir d1/db/de/d74/d36/daa 0 2024-09-06T14:44:48.439 INFO:tasks.workunit.client.0.smithi052.stdout:8/629: write d6/f98 [1048214,34014] 0 2024-09-06T14:44:48.441 INFO:tasks.workunit.client.0.smithi052.stdout:6/378: link d2/c54 d2/dd/d18/d33/d44/d79/c82 0 2024-09-06T14:44:48.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/346: link d1/d4/d6/dc/f61 d1/d4/d6/dd/d2b/f64 0 2024-09-06T14:44:48.443 INFO:tasks.workunit.client.0.smithi052.stdout:4/436: dread - d9/d10/d17/f3d zero size 2024-09-06T14:44:48.448 INFO:tasks.workunit.client.0.smithi052.stdout:1/492: creat d1/db/de/d74/d14/d90/fab x:0 0 0 2024-09-06T14:44:48.450 INFO:tasks.workunit.client.0.smithi052.stdout:8/630: mkdir d6/d9/d1f/d14/da0/dda 0 2024-09-06T14:44:48.454 INFO:tasks.workunit.client.0.smithi052.stdout:1/493: truncate d1/db/de/d74/d12/f46 3412962 0 2024-09-06T14:44:48.456 INFO:tasks.workunit.client.0.smithi052.stdout:1/494: write d1/db/de/d74/f9d [853925,60173] 0 2024-09-06T14:44:48.459 INFO:tasks.workunit.client.0.smithi052.stdout:8/631: mknod d6/d22/d36/cdb 0 2024-09-06T14:44:48.460 INFO:tasks.workunit.client.0.smithi052.stdout:6/379: write d2/dd/d18/d2d/d32/f35 [973861,82035] 0 2024-09-06T14:44:48.463 INFO:tasks.workunit.client.0.smithi052.stdout:8/632: write d6/d9/d1f/d33/fcc [444467,47384] 0 2024-09-06T14:44:48.463 INFO:tasks.workunit.client.0.smithi052.stdout:4/437: dread d9/fe [0,4194304] 0 2024-09-06T14:44:48.463 INFO:tasks.workunit.client.0.smithi052.stdout:1/495: mknod d1/d6c/cac 0 2024-09-06T14:44:48.464 INFO:tasks.workunit.client.0.smithi052.stdout:9/347: write d1/d4/d6/dd/d22/f28 [148804,109710] 0 2024-09-06T14:44:48.465 INFO:tasks.workunit.client.0.smithi052.stdout:1/496: write d1/f1d [5187067,65963] 0 2024-09-06T14:44:48.466 INFO:tasks.workunit.client.0.smithi052.stdout:4/438: chown d9/d2d/c5a 50 1 2024-09-06T14:44:48.468 INFO:tasks.workunit.client.0.smithi052.stdout:6/380: creat d2/dd/d18/d25/d6a/f83 x:0 0 0 2024-09-06T14:44:48.475 INFO:tasks.workunit.client.0.smithi052.stdout:8/633: dwrite d6/f98 [0,4194304] 0 2024-09-06T14:44:48.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/439: dread d9/f5f [0,4194304] 0 2024-09-06T14:44:48.482 INFO:tasks.workunit.client.0.smithi052.stdout:4/440: chown d9/d10/d17/d39/d3a/d5c/f7f 4 1 2024-09-06T14:44:48.484 INFO:tasks.workunit.client.0.smithi052.stdout:8/634: dread d6/d9/d1f/d19/d6f/d72/f86 [0,4194304] 0 2024-09-06T14:44:48.486 INFO:tasks.workunit.client.0.smithi052.stdout:9/348: dread d1/d4/d6/dc/d10/f34 [0,4194304] 0 2024-09-06T14:44:48.486 INFO:tasks.workunit.client.0.smithi052.stdout:4/441: unlink d9/l70 0 2024-09-06T14:44:48.487 INFO:tasks.workunit.client.0.smithi052.stdout:4/442: dread - d9/d2d/f8d zero size 2024-09-06T14:44:48.489 INFO:tasks.workunit.client.0.smithi052.stdout:6/381: truncate d2/dd/d18/f2b 2764631 0 2024-09-06T14:44:48.496 INFO:tasks.workunit.client.0.smithi052.stdout:6/382: dwrite d2/dd/d18/d33/f77 [0,4194304] 0 2024-09-06T14:44:48.498 INFO:tasks.workunit.client.0.smithi052.stdout:6/383: fsync d2/dd/d18/d33/f4d 0 2024-09-06T14:44:48.499 INFO:tasks.workunit.client.0.smithi052.stdout:4/443: mkdir d9/d2d/d33/d4d/d81/d9c 0 2024-09-06T14:44:48.502 INFO:tasks.workunit.client.0.smithi052.stdout:8/635: creat d6/d9/d1f/d19/dc4/fdc x:0 0 0 2024-09-06T14:44:48.507 INFO:tasks.workunit.client.0.smithi052.stdout:6/384: mknod d2/dd/d18/d25/d4c/d61/c84 0 2024-09-06T14:44:48.508 INFO:tasks.workunit.client.0.smithi052.stdout:4/444: fdatasync d9/d10/d19/f2c 0 2024-09-06T14:44:48.508 INFO:tasks.workunit.client.0.smithi052.stdout:6/385: dread - d2/dd/d18/d25/d4c/d61/f62 zero size 2024-09-06T14:44:48.510 INFO:tasks.workunit.client.0.smithi052.stdout:8/636: creat d6/fdd x:0 0 0 2024-09-06T14:44:48.510 INFO:tasks.workunit.client.0.smithi052.stdout:4/445: write d9/d10/d17/f88 [369827,69267] 0 2024-09-06T14:44:48.511 INFO:tasks.workunit.client.0.smithi052.stdout:9/349: rename d1/d4/d6/dd/d22/l31 to d1/l65 0 2024-09-06T14:44:48.516 INFO:tasks.workunit.client.0.smithi052.stdout:8/637: dread d6/f59 [0,4194304] 0 2024-09-06T14:44:48.518 INFO:tasks.workunit.client.0.smithi052.stdout:6/386: creat d2/dd/d81/f85 x:0 0 0 2024-09-06T14:44:48.519 INFO:tasks.workunit.client.0.smithi052.stdout:8/638: mknod d6/d22/d31/d5b/cde 0 2024-09-06T14:44:48.521 INFO:tasks.workunit.client.0.smithi052.stdout:8/639: creat d6/d4c/fdf x:0 0 0 2024-09-06T14:44:48.524 INFO:tasks.workunit.client.0.smithi052.stdout:6/387: rename d2/dd/d18/d33/f77 to d2/dd/d18/d25/d4c/f86 0 2024-09-06T14:44:48.525 INFO:tasks.workunit.client.0.smithi052.stdout:8/640: creat d6/d9/d1f/d14/fe0 x:0 0 0 2024-09-06T14:44:48.526 INFO:tasks.workunit.client.0.smithi052.stdout:9/350: write d1/d4/d6/dd/d2b/f64 [343976,81884] 0 2024-09-06T14:44:48.529 INFO:tasks.workunit.client.0.smithi052.stdout:6/388: write d2/dd/d18/f22 [5490898,5549] 0 2024-09-06T14:44:48.531 INFO:tasks.workunit.client.0.smithi052.stdout:6/389: write d2/dd/d18/d25/f3e [61339,81276] 0 2024-09-06T14:44:48.532 INFO:tasks.workunit.client.0.smithi052.stdout:8/641: write d6/d22/d36/d3e/d47/d56/d68/d69/f74 [1809424,56204] 0 2024-09-06T14:44:48.532 INFO:tasks.workunit.client.0.smithi052.stdout:9/351: symlink d1/d4/d6/dc/d38/l66 0 2024-09-06T14:44:48.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/352: chown d1/c3 591346493 1 2024-09-06T14:44:48.538 INFO:tasks.workunit.client.0.smithi052.stdout:9/353: dread d1/d4/d6/dd/d2b/f64 [0,4194304] 0 2024-09-06T14:44:48.540 INFO:tasks.workunit.client.0.smithi052.stdout:6/390: dwrite d2/dd/d18/d25/d4c/f74 [0,4194304] 0 2024-09-06T14:44:48.548 INFO:tasks.workunit.client.0.smithi052.stdout:6/391: dread d2/dd/d18/f22 [4194304,4194304] 0 2024-09-06T14:44:48.548 INFO:tasks.workunit.client.0.smithi052.stdout:9/354: dwrite d1/d4/d6/dc/d10/d18/f5d [0,4194304] 0 2024-09-06T14:44:48.558 INFO:tasks.workunit.client.0.smithi052.stdout:8/642: rename d6/c7 to d6/d22/ce1 0 2024-09-06T14:44:48.562 INFO:tasks.workunit.client.0.smithi052.stdout:8/643: unlink d6/d9/l23 0 2024-09-06T14:44:48.570 INFO:tasks.workunit.client.0.smithi052.stdout:6/392: dread d2/dd/d18/d2d/f38 [0,4194304] 0 2024-09-06T14:44:48.571 INFO:tasks.workunit.client.0.smithi052.stdout:9/355: truncate d1/d4/d6/dc/d10/d18/f5c 33485 0 2024-09-06T14:44:48.573 INFO:tasks.workunit.client.0.smithi052.stdout:8/644: truncate d6/d4c/f66 3684148 0 2024-09-06T14:44:48.576 INFO:tasks.workunit.client.0.smithi052.stdout:8/645: truncate d6/d9/d1f/d19/dc4/fdc 734318 0 2024-09-06T14:44:48.578 INFO:tasks.workunit.client.0.smithi052.stdout:9/356: dwrite d1/d4/d4b/f62 [0,4194304] 0 2024-09-06T14:44:48.585 INFO:tasks.workunit.client.0.smithi052.stdout:8/646: creat d6/fe2 x:0 0 0 2024-09-06T14:44:48.590 INFO:tasks.workunit.client.0.smithi052.stdout:8/647: dread d6/d9/d1f/d33/fcc [0,4194304] 0 2024-09-06T14:44:48.592 INFO:tasks.workunit.client.0.smithi052.stdout:9/357: truncate d1/d26/f4c 3267156 0 2024-09-06T14:44:48.599 INFO:tasks.workunit.client.0.smithi052.stdout:9/358: creat d1/d26/d41/f67 x:0 0 0 2024-09-06T14:44:48.600 INFO:tasks.workunit.client.0.smithi052.stdout:8/648: mkdir d6/d9/d1f/d19/de3 0 2024-09-06T14:44:48.601 INFO:tasks.workunit.client.0.smithi052.stdout:8/649: stat d6/d9/d1f/d33/da8/d41/db8 0 2024-09-06T14:44:48.609 INFO:tasks.workunit.client.0.smithi052.stdout:8/650: creat d6/d22/d36/fe4 x:0 0 0 2024-09-06T14:44:48.610 INFO:tasks.workunit.client.0.smithi052.stdout:8/651: write d6/d22/fab [6294,105870] 0 2024-09-06T14:44:48.612 INFO:tasks.workunit.client.0.smithi052.stdout:9/359: dread d1/f37 [0,4194304] 0 2024-09-06T14:44:48.616 INFO:tasks.workunit.client.0.smithi052.stdout:8/652: symlink d6/d22/dd1/le5 0 2024-09-06T14:44:48.617 INFO:tasks.workunit.client.0.smithi052.stdout:9/360: mknod d1/d4/d6/c68 0 2024-09-06T14:44:48.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/653: rename d6/d9/d1f/d33/dc0 to d6/d9/d1f/dcf/de6 0 2024-09-06T14:44:48.631 INFO:tasks.workunit.client.0.smithi052.stdout:8/654: dread d6/d9/d1f/d33/da8/d1b/f60 [0,4194304] 0 2024-09-06T14:44:48.660 INFO:tasks.workunit.client.0.smithi052.stdout:3/442: sync 2024-09-06T14:44:48.664 INFO:tasks.workunit.client.0.smithi052.stdout:3/443: read d0/d11/d15/d19/f2f [2877149,30306] 0 2024-09-06T14:44:48.665 INFO:tasks.workunit.client.0.smithi052.stdout:3/444: readlink d0/d11/l74 0 2024-09-06T14:44:48.667 INFO:tasks.workunit.client.0.smithi052.stdout:3/445: chown d0/d11/d15/c1c 28513683 1 2024-09-06T14:44:48.674 INFO:tasks.workunit.client.0.smithi052.stdout:9/361: write d1/d4/f5e [3291433,84126] 0 2024-09-06T14:44:48.677 INFO:tasks.workunit.client.0.smithi052.stdout:9/362: mknod d1/d4/c69 0 2024-09-06T14:44:48.677 INFO:tasks.workunit.client.0.smithi052.stdout:8/655: truncate d6/d22/d36/d3e/d47/d56/d68/f6c 4661732 0 2024-09-06T14:44:48.679 INFO:tasks.workunit.client.0.smithi052.stdout:9/363: mkdir d1/d4/d6/dd/d22/d6a 0 2024-09-06T14:44:48.681 INFO:tasks.workunit.client.0.smithi052.stdout:9/364: rmdir d1/d26/d41 39 2024-09-06T14:44:48.682 INFO:tasks.workunit.client.0.smithi052.stdout:3/446: truncate d0/d11/d12/f47 6069558 0 2024-09-06T14:44:48.684 INFO:tasks.workunit.client.0.smithi052.stdout:8/656: dwrite d6/d4c/f65 [0,4194304] 0 2024-09-06T14:44:48.684 INFO:tasks.workunit.client.0.smithi052.stdout:9/365: fdatasync d1/d4/d6/dd/f13 0 2024-09-06T14:44:48.690 INFO:tasks.workunit.client.0.smithi052.stdout:8/657: creat d6/d9/d1f/d33/da8/d1b/d87/fe7 x:0 0 0 2024-09-06T14:44:48.691 INFO:tasks.workunit.client.0.smithi052.stdout:9/366: mknod d1/d4/d6/dd/c6b 0 2024-09-06T14:44:48.695 INFO:tasks.workunit.client.0.smithi052.stdout:8/658: symlink d6/d9/d1f/d14/le8 0 2024-09-06T14:44:48.698 INFO:tasks.workunit.client.0.smithi052.stdout:8/659: creat d6/d9/d1f/d19/de3/fe9 x:0 0 0 2024-09-06T14:44:48.701 INFO:tasks.workunit.client.0.smithi052.stdout:3/447: dread d0/d11/d12/d4c/d53/d64/f6f [0,4194304] 0 2024-09-06T14:44:48.701 INFO:tasks.workunit.client.0.smithi052.stdout:3/448: chown d0/d11/d12 28932 1 2024-09-06T14:44:48.703 INFO:tasks.workunit.client.0.smithi052.stdout:8/660: mknod d6/d9/d1f/cea 0 2024-09-06T14:44:48.703 INFO:tasks.workunit.client.0.smithi052.stdout:3/449: dread d0/d11/d15/d1b/f60 [0,4194304] 0 2024-09-06T14:44:48.706 INFO:tasks.workunit.client.0.smithi052.stdout:3/450: mknod d0/d11/d12/d4c/d53/d35/d46/d67/c86 0 2024-09-06T14:44:48.707 INFO:tasks.workunit.client.0.smithi052.stdout:8/661: creat d6/d22/feb x:0 0 0 2024-09-06T14:44:48.709 INFO:tasks.workunit.client.0.smithi052.stdout:8/662: write d6/d22/feb [215034,125121] 0 2024-09-06T14:44:48.711 INFO:tasks.workunit.client.0.smithi052.stdout:3/451: rename d0/d11/d12/d4c/d53/d35/f22 to d0/d11/d15/d19/f87 0 2024-09-06T14:44:48.715 INFO:tasks.workunit.client.0.smithi052.stdout:8/663: unlink d6/d9/d1f/d33/da8/d1b/cad 0 2024-09-06T14:44:48.716 INFO:tasks.workunit.client.0.smithi052.stdout:3/452: rename d0/d11/d15/f42 to d0/d11/d12/d4c/d53/f88 0 2024-09-06T14:44:48.719 INFO:tasks.workunit.client.0.smithi052.stdout:5/491: sync 2024-09-06T14:44:48.729 INFO:tasks.workunit.client.0.smithi052.stdout:3/453: truncate d0/d11/d15/d1b/f27 487672 0 2024-09-06T14:44:48.730 INFO:tasks.workunit.client.0.smithi052.stdout:5/492: mknod d2/d1a/d22/d26/d2b/ca6 0 2024-09-06T14:44:48.731 INFO:tasks.workunit.client.0.smithi052.stdout:5/493: readlink d2/d1a/d22/d26/d2b/d37/l7b 0 2024-09-06T14:44:48.734 INFO:tasks.workunit.client.0.smithi052.stdout:5/494: fsync d2/d1a/d22/d26/d62/f6d 0 2024-09-06T14:44:48.737 INFO:tasks.workunit.client.0.smithi052.stdout:3/454: mkdir d0/d89 0 2024-09-06T14:44:48.742 INFO:tasks.workunit.client.0.smithi052.stdout:8/664: dwrite d6/d9/d1f/d33/da8/d1b/f60 [4194304,4194304] 0 2024-09-06T14:44:48.742 INFO:tasks.workunit.client.0.smithi052.stdout:5/495: mkdir d2/d1a/d22/d26/d2b/d37/d84/da7 0 2024-09-06T14:44:48.744 INFO:tasks.workunit.client.0.smithi052.stdout:8/665: fsync d6/d16/f6b 0 2024-09-06T14:44:48.745 INFO:tasks.workunit.client.0.smithi052.stdout:8/666: write d6/d9/fc9 [689104,10320] 0 2024-09-06T14:44:48.750 INFO:tasks.workunit.client.0.smithi052.stdout:5/496: creat d2/d1a/d22/d26/d2b/d37/d68/d9e/fa8 x:0 0 0 2024-09-06T14:44:48.753 INFO:tasks.workunit.client.0.smithi052.stdout:8/667: mkdir d6/d22/d36/dec 0 2024-09-06T14:44:48.756 INFO:tasks.workunit.client.0.smithi052.stdout:8/668: mknod d6/d9/d1f/d33/da8/d41/ced 0 2024-09-06T14:44:48.758 INFO:tasks.workunit.client.0.smithi052.stdout:5/497: creat d2/d1a/d22/d26/d2b/fa9 x:0 0 0 2024-09-06T14:44:48.761 INFO:tasks.workunit.client.0.smithi052.stdout:5/498: creat d2/d20/d42/d8b/faa x:0 0 0 2024-09-06T14:44:48.761 INFO:tasks.workunit.client.0.smithi052.stdout:3/455: dwrite d0/d11/d15/d19/f87 [0,4194304] 0 2024-09-06T14:44:48.762 INFO:tasks.workunit.client.0.smithi052.stdout:3/456: dread - d0/d11/f79 zero size 2024-09-06T14:44:48.763 INFO:tasks.workunit.client.0.smithi052.stdout:8/669: getdents d6/d9/d1f/d19/de3 0 2024-09-06T14:44:48.765 INFO:tasks.workunit.client.0.smithi052.stdout:5/499: creat d2/d20/d42/d8b/fab x:0 0 0 2024-09-06T14:44:48.767 INFO:tasks.workunit.client.0.smithi052.stdout:8/670: creat d6/d9/d1f/dcf/fee x:0 0 0 2024-09-06T14:44:48.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/671: stat d6/d9/d1f/d33/da8/l9a 0 2024-09-06T14:44:48.770 INFO:tasks.workunit.client.0.smithi052.stdout:3/457: unlink d0/d11/d15/d19/c45 0 2024-09-06T14:44:48.773 INFO:tasks.workunit.client.0.smithi052.stdout:8/672: creat d6/d9/d1f/d33/da8/d41/fef x:0 0 0 2024-09-06T14:44:48.774 INFO:tasks.workunit.client.0.smithi052.stdout:5/500: creat d2/d20/fac x:0 0 0 2024-09-06T14:44:48.776 INFO:tasks.workunit.client.0.smithi052.stdout:3/458: rename d0/d11/d12/d17/l4d to d0/d11/d71/l8a 0 2024-09-06T14:44:48.778 INFO:tasks.workunit.client.0.smithi052.stdout:5/501: creat d2/d1a/d22/d26/d2b/d37/d68/d6c/fad x:0 0 0 2024-09-06T14:44:48.780 INFO:tasks.workunit.client.0.smithi052.stdout:3/459: write d0/d11/f2e [5704939,55165] 0 2024-09-06T14:44:48.785 INFO:tasks.workunit.client.0.smithi052.stdout:5/502: dwrite d2/d20/d56/f88 [0,4194304] 0 2024-09-06T14:44:48.786 INFO:tasks.workunit.client.0.smithi052.stdout:5/503: dread - d2/d20/d91/fa1 zero size 2024-09-06T14:44:48.794 INFO:tasks.workunit.client.0.smithi052.stdout:8/673: write d6/d9/d6d/f7a [1697049,90780] 0 2024-09-06T14:44:48.798 INFO:tasks.workunit.client.0.smithi052.stdout:8/674: mknod d6/d22/d31/d5b/cf0 0 2024-09-06T14:44:48.800 INFO:tasks.workunit.client.0.smithi052.stdout:5/504: dread d2/d20/f5e [0,4194304] 0 2024-09-06T14:44:48.801 INFO:tasks.workunit.client.0.smithi052.stdout:3/460: dwrite d0/ff [4194304,4194304] 0 2024-09-06T14:44:48.804 INFO:tasks.workunit.client.0.smithi052.stdout:3/461: symlink d0/d11/d15/d1b/l8b 0 2024-09-06T14:44:48.806 INFO:tasks.workunit.client.0.smithi052.stdout:8/675: rename d6/d9/d1f/d19/c91 to d6/d9/d1f/dcf/cf1 0 2024-09-06T14:44:48.815 INFO:tasks.workunit.client.0.smithi052.stdout:8/676: getdents d6/d9/d1f/d14 0 2024-09-06T14:44:48.815 INFO:tasks.workunit.client.0.smithi052.stdout:8/677: chown d6/d9/d1f/d33/da8/f5d 4715 1 2024-09-06T14:44:48.822 INFO:tasks.workunit.client.0.smithi052.stdout:3/462: dwrite d0/d11/d12/d4c/f57 [0,4194304] 0 2024-09-06T14:44:48.823 INFO:tasks.workunit.client.0.smithi052.stdout:8/678: write d6/d9/d1f/d33/da8/d1b/f30 [5277970,44983] 0 2024-09-06T14:44:48.824 INFO:tasks.workunit.client.0.smithi052.stdout:8/679: read d6/d22/f3a [1825066,27375] 0 2024-09-06T14:44:48.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/505: dread d2/d1a/d22/f45 [0,4194304] 0 2024-09-06T14:44:48.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/506: fdatasync d2/d20/d42/f5f 0 2024-09-06T14:44:48.868 INFO:tasks.workunit.client.0.smithi052.stdout:5/507: rename d2/d20/d91 to d2/d1a/d22/d26/d2b/d37/d68/d9e/dae 0 2024-09-06T14:44:48.869 INFO:tasks.workunit.client.0.smithi052.stdout:3/463: dwrite d0/d11/d15/d19/f2c [0,4194304] 0 2024-09-06T14:44:48.869 INFO:tasks.workunit.client.0.smithi052.stdout:8/680: creat d6/d22/ff2 x:0 0 0 2024-09-06T14:44:48.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/681: read d6/d9/d1f/d33/da8/f4e [967592,2344] 0 2024-09-06T14:44:48.872 INFO:tasks.workunit.client.0.smithi052.stdout:8/682: truncate d6/d9/fb5 198381 0 2024-09-06T14:44:48.873 INFO:tasks.workunit.client.0.smithi052.stdout:5/508: creat d2/d1a/d22/d26/d2b/d37/faf x:0 0 0 2024-09-06T14:44:48.881 INFO:tasks.workunit.client.0.smithi052.stdout:8/683: creat d6/d9/d1f/d33/da8/d1b/ff3 x:0 0 0 2024-09-06T14:44:48.894 INFO:tasks.workunit.client.0.smithi052.stdout:8/684: dwrite d6/d22/d36/d3e/fbb [0,4194304] 0 2024-09-06T14:44:48.894 INFO:tasks.workunit.client.0.smithi052.stdout:5/509: dwrite d2/d20/d42/d65/f55 [0,4194304] 0 2024-09-06T14:44:48.894 INFO:tasks.workunit.client.0.smithi052.stdout:3/464: dwrite d0/d11/d15/d1b/f60 [0,4194304] 0 2024-09-06T14:44:48.907 INFO:tasks.workunit.client.0.smithi052.stdout:8/685: dwrite d6/d3c/f83 [0,4194304] 0 2024-09-06T14:44:48.908 INFO:tasks.workunit.client.0.smithi052.stdout:8/686: write d6/d4c/fc8 [1404868,72488] 0 2024-09-06T14:44:48.909 INFO:tasks.workunit.client.0.smithi052.stdout:8/687: readlink d6/d22/l73 0 2024-09-06T14:44:48.913 INFO:tasks.workunit.client.0.smithi052.stdout:3/465: link d0/ff d0/d11/d12/d4c/d53/d35/f8c 0 2024-09-06T14:44:48.916 INFO:tasks.workunit.client.0.smithi052.stdout:5/510: truncate d2/f7 7143903 0 2024-09-06T14:44:48.922 INFO:tasks.workunit.client.0.smithi052.stdout:8/688: rmdir d6/d9/d1f/d14/da0/dda 0 2024-09-06T14:44:48.924 INFO:tasks.workunit.client.0.smithi052.stdout:5/511: mkdir d2/d1a/d22/db0 0 2024-09-06T14:44:48.925 INFO:tasks.workunit.client.0.smithi052.stdout:5/512: stat d2/d20/d56/l74 0 2024-09-06T14:44:48.926 INFO:tasks.workunit.client.0.smithi052.stdout:8/689: mkdir d6/df4 0 2024-09-06T14:44:48.928 INFO:tasks.workunit.client.0.smithi052.stdout:5/513: rename d2 to d2/d1a/d22/d26/d2b/db1 22 2024-09-06T14:44:48.932 INFO:tasks.workunit.client.0.smithi052.stdout:5/514: write d2/d20/d42/d8b/fab [1012955,103762] 0 2024-09-06T14:44:48.935 INFO:tasks.workunit.client.0.smithi052.stdout:8/690: dwrite d6/d9/d1f/d14/fe0 [0,4194304] 0 2024-09-06T14:44:48.937 INFO:tasks.workunit.client.0.smithi052.stdout:3/466: dwrite d0/d11/d15/f50 [0,4194304] 0 2024-09-06T14:44:48.943 INFO:tasks.workunit.client.0.smithi052.stdout:8/691: mknod d6/d22/d36/d3e/d47/d56/d68/cf5 0 2024-09-06T14:44:48.944 INFO:tasks.workunit.client.0.smithi052.stdout:5/515: truncate d2/d1a/d22/d26/f85 1065375 0 2024-09-06T14:44:48.946 INFO:tasks.workunit.client.0.smithi052.stdout:3/467: mkdir d0/d8d 0 2024-09-06T14:44:48.949 INFO:tasks.workunit.client.0.smithi052.stdout:8/692: rename d6/d22/d36/d3e/d79 to d6/d22/d36/d3e/df6 0 2024-09-06T14:44:48.950 INFO:tasks.workunit.client.0.smithi052.stdout:8/693: chown d6/d4c/fc8 19621777 1 2024-09-06T14:44:48.950 INFO:tasks.workunit.client.0.smithi052.stdout:5/516: creat d2/d1a/d22/d26/d62/fb2 x:0 0 0 2024-09-06T14:44:48.951 INFO:tasks.workunit.client.0.smithi052.stdout:8/694: write d6/d16/f1e [3871856,80540] 0 2024-09-06T14:44:48.952 INFO:tasks.workunit.client.0.smithi052.stdout:8/695: chown d6/l6a 746311 1 2024-09-06T14:44:48.953 INFO:tasks.workunit.client.0.smithi052.stdout:3/468: rename d0/d11/d15/c1c to d0/d11/d15/d19/c8e 0 2024-09-06T14:44:48.956 INFO:tasks.workunit.client.0.smithi052.stdout:5/517: creat d2/d1a/d22/d26/d62/fb3 x:0 0 0 2024-09-06T14:44:48.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/469: creat d0/d11/d12/d4c/d53/d64/f8f x:0 0 0 2024-09-06T14:44:48.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/470: stat d0/d11/f2e 0 2024-09-06T14:44:48.960 INFO:tasks.workunit.client.0.smithi052.stdout:5/518: rmdir d2/d1a/d22/d26/d2b 39 2024-09-06T14:44:48.962 INFO:tasks.workunit.client.0.smithi052.stdout:5/519: symlink d2/d20/d42/lb4 0 2024-09-06T14:44:48.963 INFO:tasks.workunit.client.0.smithi052.stdout:8/696: getdents d6/d9/d6d 0 2024-09-06T14:44:48.964 INFO:tasks.workunit.client.0.smithi052.stdout:5/520: write d2/d1a/f82 [555060,69559] 0 2024-09-06T14:44:48.965 INFO:tasks.workunit.client.0.smithi052.stdout:3/471: mknod d0/d11/d12/c90 0 2024-09-06T14:44:48.969 INFO:tasks.workunit.client.0.smithi052.stdout:5/521: write d2/f13 [4789092,104618] 0 2024-09-06T14:44:48.974 INFO:tasks.workunit.client.0.smithi052.stdout:3/472: rename d0/d11/d15/d19/c84 to d0/d11/d15/d1b/c91 0 2024-09-06T14:44:48.975 INFO:tasks.workunit.client.0.smithi052.stdout:5/522: dread d2/d1a/d22/d26/d2b/d37/f44 [0,4194304] 0 2024-09-06T14:44:48.977 INFO:tasks.workunit.client.0.smithi052.stdout:5/523: truncate d2/d1a/d22/d26/d62/f75 1167313 0 2024-09-06T14:44:48.979 INFO:tasks.workunit.client.0.smithi052.stdout:5/524: truncate d2/d1a/d22/d26/d2b/d37/d68/d9e/dae/fa1 615905 0 2024-09-06T14:44:48.980 INFO:tasks.workunit.client.0.smithi052.stdout:3/473: creat d0/d11/d12/d4c/d53/d35/f92 x:0 0 0 2024-09-06T14:44:48.981 INFO:tasks.workunit.client.0.smithi052.stdout:5/525: readlink d2/d1a/d22/d26/d2b/d48/l4e 0 2024-09-06T14:44:48.985 INFO:tasks.workunit.client.0.smithi052.stdout:5/526: creat d2/d1a/d22/d26/d2b/d37/d68/d9e/fb5 x:0 0 0 2024-09-06T14:44:48.987 INFO:tasks.workunit.client.0.smithi052.stdout:8/697: write d6/d9/d1f/d33/fcc [397552,389] 0 2024-09-06T14:44:48.990 INFO:tasks.workunit.client.0.smithi052.stdout:8/698: dread d6/d9/fc9 [0,4194304] 0 2024-09-06T14:44:48.992 INFO:tasks.workunit.client.0.smithi052.stdout:3/474: rename d0/d11/d12/d4c/d53 to d0/d11/d12/d4c/d93 0 2024-09-06T14:44:48.994 INFO:tasks.workunit.client.0.smithi052.stdout:5/527: creat d2/d1a/d22/d26/fb6 x:0 0 0 2024-09-06T14:44:48.996 INFO:tasks.workunit.client.0.smithi052.stdout:8/699: dwrite d6/d9/d1f/d14/f2b [4194304,4194304] 0 2024-09-06T14:44:48.996 INFO:tasks.workunit.client.0.smithi052.stdout:3/475: creat d0/d11/d12/d4c/d93/d35/d46/d67/f94 x:0 0 0 2024-09-06T14:44:48.998 INFO:tasks.workunit.client.0.smithi052.stdout:5/528: rmdir d2/d1a/d22/d26/d2b/d37/d84 39 2024-09-06T14:44:49.006 INFO:tasks.workunit.client.0.smithi052.stdout:5/529: dwrite d2/d1a/d22/d26/d2b/fa9 [0,4194304] 0 2024-09-06T14:44:49.011 INFO:tasks.workunit.client.0.smithi052.stdout:5/530: unlink d2/d1a/d22/d26/d2b/d48/l6f 0 2024-09-06T14:44:49.013 INFO:tasks.workunit.client.0.smithi052.stdout:5/531: truncate d2/d1a/d22/d26/d2b/d37/faf 735649 0 2024-09-06T14:44:49.016 INFO:tasks.workunit.client.0.smithi052.stdout:3/476: write d0/d11/d12/f41 [921920,117153] 0 2024-09-06T14:44:49.019 INFO:tasks.workunit.client.0.smithi052.stdout:5/532: mknod d2/d1a/d22/cb7 0 2024-09-06T14:44:49.020 INFO:tasks.workunit.client.0.smithi052.stdout:3/477: fsync d0/d11/d15/d1b/f6b 0 2024-09-06T14:44:49.021 INFO:tasks.workunit.client.0.smithi052.stdout:8/700: truncate d6/d9/d1f/d33/da8/f57 3536902 0 2024-09-06T14:44:49.026 INFO:tasks.workunit.client.0.smithi052.stdout:3/478: symlink d0/d11/d12/d4c/d93/d35/d46/d5b/l95 0 2024-09-06T14:44:49.026 INFO:tasks.workunit.client.0.smithi052.stdout:3/479: write d0/d11/d15/d1b/f76 [577037,83120] 0 2024-09-06T14:44:49.031 INFO:tasks.workunit.client.0.smithi052.stdout:5/533: rename d2/d20/d42/d65/f87 to d2/fb8 0 2024-09-06T14:44:49.032 INFO:tasks.workunit.client.0.smithi052.stdout:5/534: stat d2/d1a/d22/d26/d62/f6d 0 2024-09-06T14:44:49.033 INFO:tasks.workunit.client.0.smithi052.stdout:5/535: readlink d2/d1a/d22/d26/l36 0 2024-09-06T14:44:49.036 INFO:tasks.workunit.client.0.smithi052.stdout:3/480: rename d0/d11/d15/d1b/f32 to d0/d11/d15/d1b/f96 0 2024-09-06T14:44:49.039 INFO:tasks.workunit.client.0.smithi052.stdout:5/536: dwrite d2/d1a/d22/d26/d62/f66 [0,4194304] 0 2024-09-06T14:44:49.042 INFO:tasks.workunit.client.0.smithi052.stdout:5/537: truncate d2/d1a/d22/d26/d2b/f69 16485 0 2024-09-06T14:44:49.043 INFO:tasks.workunit.client.0.smithi052.stdout:5/538: fdatasync d2/d1a/f76 0 2024-09-06T14:44:49.044 INFO:tasks.workunit.client.0.smithi052.stdout:5/539: fdatasync d2/d1a/d22/f7e 0 2024-09-06T14:44:49.173 INFO:tasks.workunit.client.0.smithi052.stdout:3/481: truncate d0/d11/f2e 2352418 0 2024-09-06T14:44:49.173 INFO:tasks.workunit.client.0.smithi052.stdout:5/540: fdatasync d2/d1a/d22/d26/d2b/d37/d68/f6e 0 2024-09-06T14:44:49.174 INFO:tasks.workunit.client.0.smithi052.stdout:8/701: dwrite d6/d9/d1f/d14/da0/fb7 [4194304,4194304] 0 2024-09-06T14:44:49.175 INFO:tasks.workunit.client.0.smithi052.stdout:5/541: read - d2/d1a/d22/d26/d2b/d37/d68/d9e/fa8 zero size 2024-09-06T14:44:49.176 INFO:tasks.workunit.client.0.smithi052.stdout:3/482: truncate d0/d11/d15/d19/f7f 795957 0 2024-09-06T14:44:49.176 INFO:tasks.workunit.client.0.smithi052.stdout:5/542: write d2/f13 [1293,79146] 0 2024-09-06T14:44:49.177 INFO:tasks.workunit.client.0.smithi052.stdout:5/543: chown d2/d1a/d22/d26/fb6 0 1 2024-09-06T14:44:49.189 INFO:tasks.workunit.client.0.smithi052.stdout:5/544: creat d2/d1a/d22/d26/d2b/d37/d68/d9e/dae/d93/fb9 x:0 0 0 2024-09-06T14:44:49.190 INFO:tasks.workunit.client.0.smithi052.stdout:5/545: chown d2/d1a/d22/d26/d2b/c61 95 1 2024-09-06T14:44:49.193 INFO:tasks.workunit.client.0.smithi052.stdout:8/702: creat d6/d9/d1f/d19/ff7 x:0 0 0 2024-09-06T14:44:49.193 INFO:tasks.workunit.client.0.smithi052.stdout:5/546: rmdir d2/d1a/d22/d26 39 2024-09-06T14:44:49.197 INFO:tasks.workunit.client.0.smithi052.stdout:3/483: creat d0/f97 x:0 0 0 2024-09-06T14:44:49.204 INFO:tasks.workunit.client.0.smithi052.stdout:8/703: dread d6/d9/f18 [0,4194304] 0 2024-09-06T14:44:49.206 INFO:tasks.workunit.client.0.smithi052.stdout:5/547: rmdir d2/d1a/d22/d26/d2b/d37/d6a 39 2024-09-06T14:44:49.208 INFO:tasks.workunit.client.0.smithi052.stdout:5/548: creat d2/d1a/fba x:0 0 0 2024-09-06T14:44:49.212 INFO:tasks.workunit.client.0.smithi052.stdout:3/484: dread d0/d11/d12/d4c/d93/f3e [0,4194304] 0 2024-09-06T14:44:49.213 INFO:tasks.workunit.client.0.smithi052.stdout:5/549: read d2/d1a/d22/d26/d2b/d48/f90 [237291,51659] 0 2024-09-06T14:44:49.217 INFO:tasks.workunit.client.0.smithi052.stdout:3/485: fsync d0/d11/d12/f47 0 2024-09-06T14:44:49.222 INFO:tasks.workunit.client.0.smithi052.stdout:3/486: dwrite d0/d11/d12/d4c/d93/d35/d46/d67/f94 [0,4194304] 0 2024-09-06T14:44:49.224 INFO:tasks.workunit.client.0.smithi052.stdout:5/550: mknod d2/d1a/d22/d26/d2b/d37/d84/da7/cbb 0 2024-09-06T14:44:49.226 INFO:tasks.workunit.client.0.smithi052.stdout:8/704: truncate d6/f98 3253554 0 2024-09-06T14:44:49.229 INFO:tasks.workunit.client.0.smithi052.stdout:3/487: rename d0/d11/d15 to d0/d11/d71/d98 0 2024-09-06T14:44:49.235 INFO:tasks.workunit.client.0.smithi052.stdout:3/488: creat d0/d11/d12/d73/f99 x:0 0 0 2024-09-06T14:44:49.236 INFO:tasks.workunit.client.0.smithi052.stdout:5/551: creat d2/d1a/d22/d26/d2b/d37/d6a/fbc x:0 0 0 2024-09-06T14:44:49.239 INFO:tasks.workunit.client.0.smithi052.stdout:3/489: dread d0/d11/d12/d4c/d93/f3e [0,4194304] 0 2024-09-06T14:44:49.241 INFO:tasks.workunit.client.0.smithi052.stdout:8/705: dread d6/d9/d1f/d33/da8/d1b/f2f [0,4194304] 0 2024-09-06T14:44:49.241 INFO:tasks.workunit.client.0.smithi052.stdout:5/552: creat d2/d20/d56/fbd x:0 0 0 2024-09-06T14:44:49.242 INFO:tasks.workunit.client.0.smithi052.stdout:8/706: write d6/fe2 [960738,50153] 0 2024-09-06T14:44:49.243 INFO:tasks.workunit.client.0.smithi052.stdout:5/553: dread - d2/d20/d42/d65/fa5 zero size 2024-09-06T14:44:49.244 INFO:tasks.workunit.client.0.smithi052.stdout:8/707: dread - d6/d9/d1f/d19/d6f/d72/fd4 zero size 2024-09-06T14:44:49.244 INFO:tasks.workunit.client.0.smithi052.stdout:8/708: chown d6/d9/d6d 313471324 1 2024-09-06T14:44:49.245 INFO:tasks.workunit.client.0.smithi052.stdout:5/554: truncate d2/d20/d42/d65/f78 1704310 0 2024-09-06T14:44:49.252 INFO:tasks.workunit.client.0.smithi052.stdout:3/490: dwrite d0/d11/d12/d4c/d93/f3e [0,4194304] 0 2024-09-06T14:44:49.252 INFO:tasks.workunit.client.0.smithi052.stdout:5/555: creat d2/d1a/fbe x:0 0 0 2024-09-06T14:44:49.254 INFO:tasks.workunit.client.0.smithi052.stdout:5/556: write d2/f13 [5036266,81383] 0 2024-09-06T14:44:49.254 INFO:tasks.workunit.client.0.smithi052.stdout:8/709: dwrite d6/d9/d1f/d33/da8/d1b/f2f [0,4194304] 0 2024-09-06T14:44:49.256 INFO:tasks.workunit.client.0.smithi052.stdout:2/506: sync 2024-09-06T14:44:49.264 INFO:tasks.workunit.client.0.smithi052.stdout:8/710: creat d6/d9/d1f/d33/da8/d41/db8/ff8 x:0 0 0 2024-09-06T14:44:49.265 INFO:tasks.workunit.client.0.smithi052.stdout:2/507: symlink da/db/d46/d55/lb8 0 2024-09-06T14:44:49.266 INFO:tasks.workunit.client.0.smithi052.stdout:5/557: rename d2/d1a/d22/d26/d2b/d37/d68 to d2/d1a/d22/d26/d2b/d48/d64/dbf 0 2024-09-06T14:44:49.269 INFO:tasks.workunit.client.0.smithi052.stdout:2/508: mkdir da/db9 0 2024-09-06T14:44:49.271 INFO:tasks.workunit.client.0.smithi052.stdout:8/711: rename d6/d22/d31/d5b/c82 to d6/d16/dbf/cf9 0 2024-09-06T14:44:49.273 INFO:tasks.workunit.client.0.smithi052.stdout:5/558: creat d2/d20/d56/fc0 x:0 0 0 2024-09-06T14:44:49.273 INFO:tasks.workunit.client.0.smithi052.stdout:3/491: dwrite d0/f3 [4194304,4194304] 0 2024-09-06T14:44:49.276 INFO:tasks.workunit.client.0.smithi052.stdout:3/492: write d0/d11/d12/d73/f78 [7437662,108429] 0 2024-09-06T14:44:49.278 INFO:tasks.workunit.client.0.smithi052.stdout:8/712: creat d6/d9/d1f/d33/ffa x:0 0 0 2024-09-06T14:44:49.281 INFO:tasks.workunit.client.0.smithi052.stdout:8/713: mknod d6/d22/d36/d3e/d47/d56/d68/d69/cfb 0 2024-09-06T14:44:49.285 INFO:tasks.workunit.client.0.smithi052.stdout:8/714: mkdir d6/d22/d31/d5b/dfc 0 2024-09-06T14:44:49.286 INFO:tasks.workunit.client.0.smithi052.stdout:8/715: write d6/d9/d1f/d33/da8/f5d [4135898,55158] 0 2024-09-06T14:44:49.286 INFO:tasks.workunit.client.0.smithi052.stdout:3/493: creat d0/f9a x:0 0 0 2024-09-06T14:44:49.287 INFO:tasks.workunit.client.0.smithi052.stdout:3/494: readlink d0/d11/d71/d98/d1b/l39 0 2024-09-06T14:44:49.288 INFO:tasks.workunit.client.0.smithi052.stdout:2/509: dread da/db/d18/f3c [0,4194304] 0 2024-09-06T14:44:49.289 INFO:tasks.workunit.client.0.smithi052.stdout:2/510: dread - da/db/d60/faf zero size 2024-09-06T14:44:49.291 INFO:tasks.workunit.client.0.smithi052.stdout:2/511: write da/d19/d3a/f3f [3276607,64948] 0 2024-09-06T14:44:49.293 INFO:tasks.workunit.client.0.smithi052.stdout:3/495: read d0/d11/d12/f47 [2223086,62589] 0 2024-09-06T14:44:49.295 INFO:tasks.workunit.client.0.smithi052.stdout:8/716: dwrite d6/d22/d36/d3e/d47/d56/d68/d69/f74 [4194304,4194304] 0 2024-09-06T14:44:49.299 INFO:tasks.workunit.client.0.smithi052.stdout:0/477: sync 2024-09-06T14:44:49.299 INFO:tasks.workunit.client.0.smithi052.stdout:7/417: sync 2024-09-06T14:44:49.299 INFO:tasks.workunit.client.0.smithi052.stdout:8/717: mknod d6/d22/dd1/cfd 0 2024-09-06T14:44:49.301 INFO:tasks.workunit.client.0.smithi052.stdout:3/496: creat d0/d11/d12/d4c/d93/d35/d46/d67/f9b x:0 0 0 2024-09-06T14:44:49.301 INFO:tasks.workunit.client.0.smithi052.stdout:8/718: chown d6/d16/dbf 13 1 2024-09-06T14:44:49.302 INFO:tasks.workunit.client.0.smithi052.stdout:2/512: dwrite da/d19/d3a/d31/d76/d6a/fa5 [0,4194304] 0 2024-09-06T14:44:49.302 INFO:tasks.workunit.client.0.smithi052.stdout:5/559: dread d2/d1a/d22/d26/d62/f6d [0,4194304] 0 2024-09-06T14:44:49.305 INFO:tasks.workunit.client.0.smithi052.stdout:0/478: write d0/d1a/d26/d3a/d14/d2d/d56/d5d/f6c [3187674,69091] 0 2024-09-06T14:44:49.315 INFO:tasks.workunit.client.0.smithi052.stdout:2/513: dwrite da/f2f [4194304,4194304] 0 2024-09-06T14:44:49.315 INFO:tasks.workunit.client.0.smithi052.stdout:7/418: dread d11/f2c [0,4194304] 0 2024-09-06T14:44:49.315 INFO:tasks.workunit.client.0.smithi052.stdout:7/419: chown d11 354864 1 2024-09-06T14:44:49.315 INFO:tasks.workunit.client.0.smithi052.stdout:2/514: readlink da/d2d/l87 0 2024-09-06T14:44:49.322 INFO:tasks.workunit.client.0.smithi052.stdout:2/515: mknod da/d19/d3a/d31/d76/d6a/cba 0 2024-09-06T14:44:49.323 INFO:tasks.workunit.client.0.smithi052.stdout:2/516: dread - da/d64/f8f zero size 2024-09-06T14:44:49.324 INFO:tasks.workunit.client.0.smithi052.stdout:2/517: write da/db/d60/db1/f75 [1054607,43644] 0 2024-09-06T14:44:49.327 INFO:tasks.workunit.client.0.smithi052.stdout:0/479: write d0/d1a/d26/f87 [619964,105116] 0 2024-09-06T14:44:49.330 INFO:tasks.workunit.client.0.smithi052.stdout:5/560: dread d2/f11 [0,4194304] 0 2024-09-06T14:44:49.332 INFO:tasks.workunit.client.0.smithi052.stdout:8/719: truncate d6/d4c/fc8 351127 0 2024-09-06T14:44:49.334 INFO:tasks.workunit.client.0.smithi052.stdout:2/518: creat da/d19/d5a/fbb x:0 0 0 2024-09-06T14:44:49.335 INFO:tasks.workunit.client.0.smithi052.stdout:0/480: truncate d0/d4f/d7d/f76 1443609 0 2024-09-06T14:44:49.335 INFO:tasks.workunit.client.0.smithi052.stdout:3/497: dwrite d0/d11/f2e [0,4194304] 0 2024-09-06T14:44:49.338 INFO:tasks.workunit.client.0.smithi052.stdout:0/481: write d0/d1a/d26/d3a/d14/d2d/fa9 [261185,61900] 0 2024-09-06T14:44:49.338 INFO:tasks.workunit.client.0.smithi052.stdout:5/561: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fc1 x:0 0 0 2024-09-06T14:44:49.339 INFO:tasks.workunit.client.0.smithi052.stdout:7/420: getdents d11/d1c/d57 0 2024-09-06T14:44:49.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/562: fsync d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fa8 0 2024-09-06T14:44:49.343 INFO:tasks.workunit.client.0.smithi052.stdout:3/498: rename d0/c38 to d0/d11/d71/c9c 0 2024-09-06T14:44:49.346 INFO:tasks.workunit.client.0.smithi052.stdout:8/720: link d6/d9/d1f/d14/f29 d6/d22/d31/ffe 0 2024-09-06T14:44:49.349 INFO:tasks.workunit.client.0.smithi052.stdout:3/499: mkdir d0/d11/d71/d98/d9d 0 2024-09-06T14:44:49.351 INFO:tasks.workunit.client.0.smithi052.stdout:0/482: dwrite d0/d4f/d7d/f62 [0,4194304] 0 2024-09-06T14:44:49.353 INFO:tasks.workunit.client.0.smithi052.stdout:3/500: write d0/f97 [913367,464] 0 2024-09-06T14:44:49.353 INFO:tasks.workunit.client.0.smithi052.stdout:2/519: dread da/db/fe [0,4194304] 0 2024-09-06T14:44:49.353 INFO:tasks.workunit.client.0.smithi052.stdout:8/721: mknod d6/d22/d36/d3e/df6/cff 0 2024-09-06T14:44:49.356 INFO:tasks.workunit.client.0.smithi052.stdout:7/421: getdents d11/d1c/d57/d74 0 2024-09-06T14:44:49.357 INFO:tasks.workunit.client.0.smithi052.stdout:7/422: chown f5 550051940 1 2024-09-06T14:44:49.364 INFO:tasks.workunit.client.0.smithi052.stdout:2/520: dwrite da/db/d46/d6b/f98 [0,4194304] 0 2024-09-06T14:44:49.366 INFO:tasks.workunit.client.0.smithi052.stdout:7/423: symlink d11/d1c/d57/l8e 0 2024-09-06T14:44:49.368 INFO:tasks.workunit.client.0.smithi052.stdout:3/501: creat d0/d8d/f9e x:0 0 0 2024-09-06T14:44:49.374 INFO:tasks.workunit.client.0.smithi052.stdout:5/563: dwrite d2/f38 [0,4194304] 0 2024-09-06T14:44:49.374 INFO:tasks.workunit.client.0.smithi052.stdout:8/722: rename d6/d22/fd9 to d6/d9/d1f/d19/f100 0 2024-09-06T14:44:49.380 INFO:tasks.workunit.client.0.smithi052.stdout:2/521: dread da/db/d46/d55/f68 [0,4194304] 0 2024-09-06T14:44:49.380 INFO:tasks.workunit.client.0.smithi052.stdout:4/446: sync 2024-09-06T14:44:49.380 INFO:tasks.workunit.client.0.smithi052.stdout:9/367: sync 2024-09-06T14:44:49.380 INFO:tasks.workunit.client.0.smithi052.stdout:6/393: sync 2024-09-06T14:44:49.380 INFO:tasks.workunit.client.0.smithi052.stdout:1/497: sync 2024-09-06T14:44:49.380 INFO:tasks.workunit.client.0.smithi052.stdout:7/424: mknod d11/d1c/d24/d4b/c8f 0 2024-09-06T14:44:49.383 INFO:tasks.workunit.client.0.smithi052.stdout:9/368: chown d1/d4/d6/dd/c6b 69 1 2024-09-06T14:44:49.383 INFO:tasks.workunit.client.0.smithi052.stdout:5/564: creat d2/d20/d56/fc2 x:0 0 0 2024-09-06T14:44:49.385 INFO:tasks.workunit.client.0.smithi052.stdout:5/565: write d2/d20/fac [336352,84608] 0 2024-09-06T14:44:49.386 INFO:tasks.workunit.client.0.smithi052.stdout:0/483: dread d0/d19/f80 [0,4194304] 0 2024-09-06T14:44:49.387 INFO:tasks.workunit.client.0.smithi052.stdout:5/566: chown d2/d1a/d22/d26/d2b/d37 18236393 1 2024-09-06T14:44:49.393 INFO:tasks.workunit.client.0.smithi052.stdout:4/447: creat d9/d10/d17/d39/d3a/d5c/f9d x:0 0 0 2024-09-06T14:44:49.403 INFO:tasks.workunit.client.0.smithi052.stdout:1/498: symlink d1/db/d50/da4/lad 0 2024-09-06T14:44:49.404 INFO:tasks.workunit.client.0.smithi052.stdout:1/499: write d1/db/de/d74/d3e/d47/d4a/f95 [417418,37532] 0 2024-09-06T14:44:49.404 INFO:tasks.workunit.client.0.smithi052.stdout:7/425: getdents d11/d1c/d3f/d5d/d88 0 2024-09-06T14:44:49.409 INFO:tasks.workunit.client.0.smithi052.stdout:0/484: write d0/d1a/d26/f27 [4408890,53414] 0 2024-09-06T14:44:49.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/502: getdents d0/d11/d12/d4c 0 2024-09-06T14:44:49.412 INFO:tasks.workunit.client.0.smithi052.stdout:2/522: dwrite da/d19/f29 [0,4194304] 0 2024-09-06T14:44:49.414 INFO:tasks.workunit.client.0.smithi052.stdout:9/369: rename d1/d4/d6/dd/d22/f28 to d1/d4/d6/f6c 0 2024-09-06T14:44:49.415 INFO:tasks.workunit.client.0.smithi052.stdout:8/723: link d6/d9/d1f/d33/da8/d41/ced d6/d9/d1f/d19/c101 0 2024-09-06T14:44:49.420 INFO:tasks.workunit.client.0.smithi052.stdout:0/485: truncate d0/d1a/d26/d3a/d14/d20/d22/f6a 5055741 0 2024-09-06T14:44:49.426 INFO:tasks.workunit.client.0.smithi052.stdout:3/503: unlink d0/f97 0 2024-09-06T14:44:49.427 INFO:tasks.workunit.client.0.smithi052.stdout:4/448: truncate d9/d2d/d33/f3f 2250202 0 2024-09-06T14:44:49.429 INFO:tasks.workunit.client.0.smithi052.stdout:2/523: creat da/db/d60/daa/fbc x:0 0 0 2024-09-06T14:44:49.431 INFO:tasks.workunit.client.0.smithi052.stdout:7/426: write d11/d1c/d24/d3b/d50/f6e [4716239,127384] 0 2024-09-06T14:44:49.431 INFO:tasks.workunit.client.0.smithi052.stdout:2/524: truncate da/db/d60/db1/d70/f93 1028300 0 2024-09-06T14:44:49.431 INFO:tasks.workunit.client.0.smithi052.stdout:9/370: truncate d1/d4/d6/dc/d10/f34 4998422 0 2024-09-06T14:44:49.432 INFO:tasks.workunit.client.0.smithi052.stdout:2/525: chown da/d2d 1 1 2024-09-06T14:44:49.437 INFO:tasks.workunit.client.0.smithi052.stdout:0/486: rmdir d0/d1a/d26/d3a/d14/d2d/d56 39 2024-09-06T14:44:49.438 INFO:tasks.workunit.client.0.smithi052.stdout:3/504: read - d0/d11/d12/d4c/d93/d35/f70 zero size 2024-09-06T14:44:49.441 INFO:tasks.workunit.client.0.smithi052.stdout:1/500: getdents d1/db/d18 0 2024-09-06T14:44:49.441 INFO:tasks.workunit.client.0.smithi052.stdout:7/427: rmdir d11/d1c/d3f 39 2024-09-06T14:44:49.446 INFO:tasks.workunit.client.0.smithi052.stdout:0/487: creat d0/d2e/fac x:0 0 0 2024-09-06T14:44:49.448 INFO:tasks.workunit.client.0.smithi052.stdout:4/449: mkdir d9/d10/d17/d39/d7b/d91/d9e 0 2024-09-06T14:44:49.448 INFO:tasks.workunit.client.0.smithi052.stdout:4/450: chown d9/d10/c6f 18616 1 2024-09-06T14:44:49.449 INFO:tasks.workunit.client.0.smithi052.stdout:4/451: read d9/d10/d17/d39/f46 [50416,34996] 0 2024-09-06T14:44:49.450 INFO:tasks.workunit.client.0.smithi052.stdout:5/567: rename d2/d20/l2c to d2/lc3 0 2024-09-06T14:44:49.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/452: read d9/d2d/d33/f6a [2633387,74566] 0 2024-09-06T14:44:49.454 INFO:tasks.workunit.client.0.smithi052.stdout:2/526: truncate da/d19/f2c 1554222 0 2024-09-06T14:44:49.454 INFO:tasks.workunit.client.0.smithi052.stdout:5/568: truncate d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fad 381741 0 2024-09-06T14:44:49.456 INFO:tasks.workunit.client.0.smithi052.stdout:5/569: write d2/d20/d42/f5f [1329033,40363] 0 2024-09-06T14:44:49.457 INFO:tasks.workunit.client.0.smithi052.stdout:0/488: fsync d0/d19/f80 0 2024-09-06T14:44:49.457 INFO:tasks.workunit.client.0.smithi052.stdout:3/505: truncate d0/d11/d12/d4c/d93/d35/f2a 543481 0 2024-09-06T14:44:49.458 INFO:tasks.workunit.client.0.smithi052.stdout:5/570: chown d2/d1a/d22/d26/d2b/d37/d6a/fbc 37563809 1 2024-09-06T14:44:49.460 INFO:tasks.workunit.client.0.smithi052.stdout:3/506: chown d0/d11/d12/l6d 22717 1 2024-09-06T14:44:49.461 INFO:tasks.workunit.client.0.smithi052.stdout:5/571: chown d2/d20/d42/d8b 73084476 1 2024-09-06T14:44:49.461 INFO:tasks.workunit.client.0.smithi052.stdout:4/453: unlink d9/d10/d19/c25 0 2024-09-06T14:44:49.462 INFO:tasks.workunit.client.0.smithi052.stdout:4/454: fsync d9/f35 0 2024-09-06T14:44:49.465 INFO:tasks.workunit.client.0.smithi052.stdout:1/501: dread d1/db/f3f [0,4194304] 0 2024-09-06T14:44:49.465 INFO:tasks.workunit.client.0.smithi052.stdout:8/724: getdents d6/d16/dbf 0 2024-09-06T14:44:49.467 INFO:tasks.workunit.client.0.smithi052.stdout:0/489: dwrite d0/d1a/d26/f27 [0,4194304] 0 2024-09-06T14:44:49.468 INFO:tasks.workunit.client.0.smithi052.stdout:4/455: chown d9/d10/d17/d39/d3a/d5c/f9d 3957 1 2024-09-06T14:44:49.471 INFO:tasks.workunit.client.0.smithi052.stdout:9/371: getdents d1 0 2024-09-06T14:44:49.472 INFO:tasks.workunit.client.0.smithi052.stdout:7/428: symlink d11/d1c/d24/d4b/l90 0 2024-09-06T14:44:49.473 INFO:tasks.workunit.client.0.smithi052.stdout:2/527: mkdir da/d19/d3a/d31/d7a/dbd 0 2024-09-06T14:44:49.476 INFO:tasks.workunit.client.0.smithi052.stdout:5/572: dwrite d2/d1a/d22/f3e [4194304,4194304] 0 2024-09-06T14:44:49.477 INFO:tasks.workunit.client.0.smithi052.stdout:3/507: fsync d0/d11/d71/d98/d1b/f96 0 2024-09-06T14:44:49.480 INFO:tasks.workunit.client.0.smithi052.stdout:8/725: dread d6/d9/d1f/d19/d6f/d72/f86 [0,4194304] 0 2024-09-06T14:44:49.480 INFO:tasks.workunit.client.0.smithi052.stdout:5/573: write d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/fa1 [860522,72029] 0 2024-09-06T14:44:49.483 INFO:tasks.workunit.client.0.smithi052.stdout:1/502: mknod d1/db/d18/cae 0 2024-09-06T14:44:49.488 INFO:tasks.workunit.client.0.smithi052.stdout:3/508: dwrite d0/d11/d71/d98/d1b/f96 [0,4194304] 0 2024-09-06T14:44:49.494 INFO:tasks.workunit.client.0.smithi052.stdout:8/726: unlink d6/d9/d6d/f7a 0 2024-09-06T14:44:49.499 INFO:tasks.workunit.client.0.smithi052.stdout:5/574: rename d2/lc to d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/lc4 0 2024-09-06T14:44:49.500 INFO:tasks.workunit.client.0.smithi052.stdout:5/575: fdatasync d2/d1a/d22/d26/d62/fb3 0 2024-09-06T14:44:49.503 INFO:tasks.workunit.client.0.smithi052.stdout:5/576: write d2/d1a/f82 [69654,6588] 0 2024-09-06T14:44:49.503 INFO:tasks.workunit.client.0.smithi052.stdout:4/456: dwrite d9/f69 [0,4194304] 0 2024-09-06T14:44:49.504 INFO:tasks.workunit.client.0.smithi052.stdout:1/503: dread d1/db/d50/f5b [0,4194304] 0 2024-09-06T14:44:49.506 INFO:tasks.workunit.client.0.smithi052.stdout:7/429: fsync d11/d1c/d24/d4b/f4e 0 2024-09-06T14:44:49.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/430: stat d11/c20 0 2024-09-06T14:44:49.509 INFO:tasks.workunit.client.0.smithi052.stdout:2/528: unlink da/db/d46/d55/la9 0 2024-09-06T14:44:49.516 INFO:tasks.workunit.client.0.smithi052.stdout:8/727: creat d6/d9/d1f/d33/da8/d1b/d87/f102 x:0 0 0 2024-09-06T14:44:49.519 INFO:tasks.workunit.client.0.smithi052.stdout:0/490: rename d0/d1a/d26/d3a/d14/d2d/d56/d5d to d0/d1a/d26/d3a/d14/d2d/d56/da3/dad 0 2024-09-06T14:44:49.520 INFO:tasks.workunit.client.0.smithi052.stdout:0/491: write d0/d2e/f9c [4730372,54159] 0 2024-09-06T14:44:49.524 INFO:tasks.workunit.client.0.smithi052.stdout:4/457: write d9/f69 [870852,37318] 0 2024-09-06T14:44:49.524 INFO:tasks.workunit.client.0.smithi052.stdout:0/492: read d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/f6c [3426027,92750] 0 2024-09-06T14:44:49.528 INFO:tasks.workunit.client.0.smithi052.stdout:5/577: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fc5 x:0 0 0 2024-09-06T14:44:49.530 INFO:tasks.workunit.client.0.smithi052.stdout:4/458: dread d9/d10/f6e [0,4194304] 0 2024-09-06T14:44:49.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/431: write d11/d1c/d26/f28 [213497,59777] 0 2024-09-06T14:44:49.532 INFO:tasks.workunit.client.0.smithi052.stdout:2/529: unlink da/db/d60/daa/fac 0 2024-09-06T14:44:49.532 INFO:tasks.workunit.client.0.smithi052.stdout:3/509: mkdir d0/d11/d71/d98/d1b/d85/d9f 0 2024-09-06T14:44:49.534 INFO:tasks.workunit.client.0.smithi052.stdout:8/728: symlink d6/d22/d36/d3e/dca/l103 0 2024-09-06T14:44:49.534 INFO:tasks.workunit.client.0.smithi052.stdout:2/530: read da/f1b [3253613,69994] 0 2024-09-06T14:44:49.538 INFO:tasks.workunit.client.0.smithi052.stdout:1/504: fsync d1/db/de/d74/d14/d2e/f42 0 2024-09-06T14:44:49.539 INFO:tasks.workunit.client.0.smithi052.stdout:0/493: symlink d0/d19/lae 0 2024-09-06T14:44:49.544 INFO:tasks.workunit.client.0.smithi052.stdout:0/494: dwrite d0/d19/f59 [0,4194304] 0 2024-09-06T14:44:49.545 INFO:tasks.workunit.client.0.smithi052.stdout:0/495: write d0/d1a/d26/d3a/d14/d20/f48 [3134728,121100] 0 2024-09-06T14:44:49.551 INFO:tasks.workunit.client.0.smithi052.stdout:4/459: chown d9/d10/d19/f48 7215 1 2024-09-06T14:44:49.552 INFO:tasks.workunit.client.0.smithi052.stdout:4/460: write d9/d2d/d33/d4d/f76 [557505,66095] 0 2024-09-06T14:44:49.555 INFO:tasks.workunit.client.0.smithi052.stdout:2/531: rmdir da/d19/d5a/da7 39 2024-09-06T14:44:49.561 INFO:tasks.workunit.client.0.smithi052.stdout:1/505: rename d1/db/de/d74/f9d to d1/db/d72/faf 0 2024-09-06T14:44:49.566 INFO:tasks.workunit.client.0.smithi052.stdout:5/578: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/f71 [0,4194304] 0 2024-09-06T14:44:49.568 INFO:tasks.workunit.client.0.smithi052.stdout:8/729: truncate d6/d9/d1f/d14/f29 3630487 0 2024-09-06T14:44:49.569 INFO:tasks.workunit.client.0.smithi052.stdout:3/510: dwrite d0/d11/d71/d98/f56 [0,4194304] 0 2024-09-06T14:44:49.569 INFO:tasks.workunit.client.0.smithi052.stdout:5/579: dread - d2/d1a/d22/d26/fb6 zero size 2024-09-06T14:44:49.578 INFO:tasks.workunit.client.0.smithi052.stdout:0/496: creat d0/d1a/d26/d3a/d14/d20/d22/d8b/faf x:0 0 0 2024-09-06T14:44:49.578 INFO:tasks.workunit.client.0.smithi052.stdout:7/432: truncate d11/d1c/d24/d3b/d50/f6d 1746445 0 2024-09-06T14:44:49.579 INFO:tasks.workunit.client.0.smithi052.stdout:7/433: dread - d11/d1c/d24/f84 zero size 2024-09-06T14:44:49.582 INFO:tasks.workunit.client.0.smithi052.stdout:2/532: write da/db/d60/f80 [77894,105584] 0 2024-09-06T14:44:49.585 INFO:tasks.workunit.client.0.smithi052.stdout:1/506: rename d1/db/de/d74/d3e/c8d to d1/db/de/d74/d36/daa/cb0 0 2024-09-06T14:44:49.587 INFO:tasks.workunit.client.0.smithi052.stdout:0/497: dwrite d0/d3d/f99 [0,4194304] 0 2024-09-06T14:44:49.594 INFO:tasks.workunit.client.0.smithi052.stdout:5/580: read d2/d1a/d22/d26/d62/f72 [98666,97582] 0 2024-09-06T14:44:49.595 INFO:tasks.workunit.client.0.smithi052.stdout:3/511: mkdir d0/d11/d12/d4c/d93/d35/d46/d5b/da0 0 2024-09-06T14:44:49.599 INFO:tasks.workunit.client.0.smithi052.stdout:7/434: fdatasync d11/d1c/d24/f44 0 2024-09-06T14:44:49.602 INFO:tasks.workunit.client.0.smithi052.stdout:1/507: mkdir d1/db/d72/db1 0 2024-09-06T14:44:49.603 INFO:tasks.workunit.client.0.smithi052.stdout:0/498: mknod d0/d1a/d26/d3a/cb0 0 2024-09-06T14:44:49.604 INFO:tasks.workunit.client.0.smithi052.stdout:8/730: truncate d6/f98 3583132 0 2024-09-06T14:44:49.605 INFO:tasks.workunit.client.0.smithi052.stdout:3/512: symlink d0/d11/d71/d98/d1b/la1 0 2024-09-06T14:44:49.605 INFO:tasks.workunit.client.0.smithi052.stdout:8/731: read d6/d22/feb [295962,118977] 0 2024-09-06T14:44:49.606 INFO:tasks.workunit.client.0.smithi052.stdout:5/581: truncate d2/d1a/d22/d26/d2b/d48/d64/f8f 4665871 0 2024-09-06T14:44:49.606 INFO:tasks.workunit.client.0.smithi052.stdout:8/732: readlink d6/d22/l73 0 2024-09-06T14:44:49.607 INFO:tasks.workunit.client.0.smithi052.stdout:5/582: stat d2/d20/d42/f9d 0 2024-09-06T14:44:49.610 INFO:tasks.workunit.client.0.smithi052.stdout:2/533: unlink da/d19/d5a/da7/c50 0 2024-09-06T14:44:49.611 INFO:tasks.workunit.client.0.smithi052.stdout:2/534: readlink da/db/d18/l3e 0 2024-09-06T14:44:49.612 INFO:tasks.workunit.client.0.smithi052.stdout:4/461: getdents d9/d10/d19 0 2024-09-06T14:44:49.615 INFO:tasks.workunit.client.0.smithi052.stdout:0/499: creat d0/d2e/fb1 x:0 0 0 2024-09-06T14:44:49.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/733: mknod d6/d9/d6d/c104 0 2024-09-06T14:44:49.619 INFO:tasks.workunit.client.0.smithi052.stdout:8/734: readlink d6/d9/d6d/l75 0 2024-09-06T14:44:49.622 INFO:tasks.workunit.client.0.smithi052.stdout:5/583: rename d2/d1a/d22/db0 to d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6 0 2024-09-06T14:44:49.624 INFO:tasks.workunit.client.0.smithi052.stdout:2/535: symlink da/db/d9d/lbe 0 2024-09-06T14:44:49.625 INFO:tasks.workunit.client.0.smithi052.stdout:2/536: truncate da/d4f/fb3 790468 0 2024-09-06T14:44:49.625 INFO:tasks.workunit.client.0.smithi052.stdout:4/462: fsync d9/d10/f1f 0 2024-09-06T14:44:49.629 INFO:tasks.workunit.client.0.smithi052.stdout:5/584: dwrite d2/d1a/d22/d26/d2b/d37/d6a/fbc [0,4194304] 0 2024-09-06T14:44:49.631 INFO:tasks.workunit.client.0.smithi052.stdout:0/500: creat d0/d1a/d26/d3a/d14/d20/d22/d41/d8a/fb2 x:0 0 0 2024-09-06T14:44:49.631 INFO:tasks.workunit.client.0.smithi052.stdout:2/537: dread da/d19/f29 [0,4194304] 0 2024-09-06T14:44:49.632 INFO:tasks.workunit.client.0.smithi052.stdout:0/501: read - d0/d4f/d7d/f86 zero size 2024-09-06T14:44:49.633 INFO:tasks.workunit.client.0.smithi052.stdout:2/538: truncate da/d19/f1a 1632611 0 2024-09-06T14:44:49.635 INFO:tasks.workunit.client.0.smithi052.stdout:2/539: chown da/d4f/l52 168021 1 2024-09-06T14:44:49.635 INFO:tasks.workunit.client.0.smithi052.stdout:0/502: fdatasync d0/d1a/d26/d3a/d14/d20/d22/f6a 0 2024-09-06T14:44:49.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/435: dwrite d11/d1c/d26/f2b [4194304,4194304] 0 2024-09-06T14:44:49.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/508: dwrite d1/db/de/d74/d14/d2e/f42 [0,4194304] 0 2024-09-06T14:44:49.676 INFO:tasks.workunit.client.0.smithi052.stdout:4/463: read d9/f40 [6396527,93345] 0 2024-09-06T14:44:49.679 INFO:tasks.workunit.client.0.smithi052.stdout:3/513: dwrite d0/d11/d12/d4c/d93/f88 [0,4194304] 0 2024-09-06T14:44:49.680 INFO:tasks.workunit.client.0.smithi052.stdout:8/735: creat d6/d22/d36/dec/f105 x:0 0 0 2024-09-06T14:44:49.707 INFO:tasks.workunit.client.0.smithi052.stdout:8/736: dwrite d6/d9/d1f/d19/ff7 [0,4194304] 0 2024-09-06T14:44:49.707 INFO:tasks.workunit.client.0.smithi052.stdout:4/464: creat d9/d10/f9f x:0 0 0 2024-09-06T14:44:49.709 INFO:tasks.workunit.client.0.smithi052.stdout:0/503: fdatasync d0/d4f/d7d/f76 0 2024-09-06T14:44:49.711 INFO:tasks.workunit.client.0.smithi052.stdout:3/514: rename d0/d11/d12/d4c/f63 to d0/d11/d71/d98/fa2 0 2024-09-06T14:44:49.713 INFO:tasks.workunit.client.0.smithi052.stdout:3/515: fdatasync d0/d11/d71/d98/f50 0 2024-09-06T14:44:49.718 INFO:tasks.workunit.client.0.smithi052.stdout:1/509: dwrite d1/d5f/f65 [0,4194304] 0 2024-09-06T14:44:49.721 INFO:tasks.workunit.client.0.smithi052.stdout:5/585: creat d2/d1a/d22/d26/fc7 x:0 0 0 2024-09-06T14:44:49.721 INFO:tasks.workunit.client.0.smithi052.stdout:1/510: readlink d1/db/de/d74/d3e/d47/d4a/l53 0 2024-09-06T14:44:49.722 INFO:tasks.workunit.client.0.smithi052.stdout:4/465: truncate d9/d2d/f63 1102935 0 2024-09-06T14:44:49.724 INFO:tasks.workunit.client.0.smithi052.stdout:0/504: symlink d0/d1a/d26/d3a/d14/d20/d22/d8b/lb3 0 2024-09-06T14:44:49.726 INFO:tasks.workunit.client.0.smithi052.stdout:3/516: dwrite d0/d11/d71/d98/d19/f2c [0,4194304] 0 2024-09-06T14:44:49.728 INFO:tasks.workunit.client.0.smithi052.stdout:3/517: dread - d0/d11/d12/d4c/d93/d64/f8f zero size 2024-09-06T14:44:49.730 INFO:tasks.workunit.client.0.smithi052.stdout:4/466: dread d9/d2d/d33/d4d/f76 [0,4194304] 0 2024-09-06T14:44:49.731 INFO:tasks.workunit.client.0.smithi052.stdout:7/436: write d11/d1c/d3f/f5f [1258532,73915] 0 2024-09-06T14:44:49.733 INFO:tasks.workunit.client.0.smithi052.stdout:3/518: dread d0/f3 [4194304,4194304] 0 2024-09-06T14:44:49.734 INFO:tasks.workunit.client.0.smithi052.stdout:1/511: chown d1/db/de/d74/d12/f70 1992226 1 2024-09-06T14:44:49.735 INFO:tasks.workunit.client.0.smithi052.stdout:5/586: mkdir d2/d20/d42/d8b/dc8 0 2024-09-06T14:44:49.737 INFO:tasks.workunit.client.0.smithi052.stdout:0/505: mknod d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/cb4 0 2024-09-06T14:44:49.741 INFO:tasks.workunit.client.0.smithi052.stdout:0/506: dread d0/d1a/d26/f87 [0,4194304] 0 2024-09-06T14:44:49.745 INFO:tasks.workunit.client.0.smithi052.stdout:0/507: dread d0/d19/fa8 [0,4194304] 0 2024-09-06T14:44:49.746 INFO:tasks.workunit.client.0.smithi052.stdout:7/437: unlink d11/d1c/d24/l82 0 2024-09-06T14:44:49.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/438: mknod d11/d1c/d24/d3b/c91 0 2024-09-06T14:44:49.755 INFO:tasks.workunit.client.0.smithi052.stdout:1/512: truncate d1/db/de/d74/d14/d2e/f84 596536 0 2024-09-06T14:44:49.757 INFO:tasks.workunit.client.0.smithi052.stdout:4/467: creat d9/d10/d17/fa0 x:0 0 0 2024-09-06T14:44:49.760 INFO:tasks.workunit.client.0.smithi052.stdout:5/587: rename d2/d1a/d22/l4d to d2/d20/lc9 0 2024-09-06T14:44:49.761 INFO:tasks.workunit.client.0.smithi052.stdout:4/468: mkdir d9/da1 0 2024-09-06T14:44:49.762 INFO:tasks.workunit.client.0.smithi052.stdout:4/469: fdatasync d9/d10/d17/d39/d3a/d5c/f98 0 2024-09-06T14:44:49.763 INFO:tasks.workunit.client.0.smithi052.stdout:5/588: mkdir d2/d20/d42/d8b/dca 0 2024-09-06T14:44:49.764 INFO:tasks.workunit.client.0.smithi052.stdout:7/439: getdents d11/d1c/d24/d64 0 2024-09-06T14:44:49.766 INFO:tasks.workunit.client.0.smithi052.stdout:4/470: readlink d9/d10/d17/d39/d7b/l95 0 2024-09-06T14:44:49.769 INFO:tasks.workunit.client.0.smithi052.stdout:5/589: dread d2/d1a/d22/d26/d62/f72 [0,4194304] 0 2024-09-06T14:44:49.771 INFO:tasks.workunit.client.0.smithi052.stdout:7/440: dwrite d11/f43 [4194304,4194304] 0 2024-09-06T14:44:49.771 INFO:tasks.workunit.client.0.smithi052.stdout:4/471: creat d9/d10/d17/d39/d3a/d5c/fa2 x:0 0 0 2024-09-06T14:44:49.772 INFO:tasks.workunit.client.0.smithi052.stdout:7/441: stat d11/d1c/d3f/f7f 0 2024-09-06T14:44:49.773 INFO:tasks.workunit.client.0.smithi052.stdout:7/442: write d11/f43 [6477344,117112] 0 2024-09-06T14:44:49.775 INFO:tasks.workunit.client.0.smithi052.stdout:1/513: dread d1/db/de/d74/f32 [0,4194304] 0 2024-09-06T14:44:49.778 INFO:tasks.workunit.client.0.smithi052.stdout:7/443: rename d11/f39 to d11/d1c/d24/d3b/d50/f92 0 2024-09-06T14:44:49.780 INFO:tasks.workunit.client.0.smithi052.stdout:1/514: fsync d1/db/d50/f5b 0 2024-09-06T14:44:49.784 INFO:tasks.workunit.client.0.smithi052.stdout:7/444: stat d11/d1c/d24/c33 0 2024-09-06T14:44:49.787 INFO:tasks.workunit.client.0.smithi052.stdout:1/515: rename d1/db/de/d68/l8e to d1/db/de/d74/d12/lb2 0 2024-09-06T14:44:49.787 INFO:tasks.workunit.client.0.smithi052.stdout:4/472: getdents d9/d2d/d33 0 2024-09-06T14:44:49.791 INFO:tasks.workunit.client.0.smithi052.stdout:1/516: chown d1/db/d50/l88 2 1 2024-09-06T14:44:49.794 INFO:tasks.workunit.client.0.smithi052.stdout:4/473: dwrite d9/d10/d19/f29 [0,4194304] 0 2024-09-06T14:44:49.799 INFO:tasks.workunit.client.0.smithi052.stdout:1/517: creat d1/db/fb3 x:0 0 0 2024-09-06T14:44:49.803 INFO:tasks.workunit.client.0.smithi052.stdout:1/518: rename d1/db/de/d74/d14/d90/fab to d1/db/d18/fb4 0 2024-09-06T14:44:49.805 INFO:tasks.workunit.client.0.smithi052.stdout:1/519: dread - d1/db/de/d74/d36/d9b/fa9 zero size 2024-09-06T14:44:49.806 INFO:tasks.workunit.client.0.smithi052.stdout:5/590: write d2/d1a/d22/d26/d62/f6d [3291819,87492] 0 2024-09-06T14:44:49.809 INFO:tasks.workunit.client.0.smithi052.stdout:1/520: unlink d1/db/d50/f5b 0 2024-09-06T14:44:49.810 INFO:tasks.workunit.client.0.smithi052.stdout:1/521: stat d1/db/l4d 0 2024-09-06T14:44:49.811 INFO:tasks.workunit.client.0.smithi052.stdout:5/591: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/fcb x:0 0 0 2024-09-06T14:44:49.814 INFO:tasks.workunit.client.0.smithi052.stdout:1/522: creat d1/db/de/d74/d36/daa/fb5 x:0 0 0 2024-09-06T14:44:49.817 INFO:tasks.workunit.client.0.smithi052.stdout:7/445: write f5 [264437,68372] 0 2024-09-06T14:44:49.819 INFO:tasks.workunit.client.0.smithi052.stdout:4/474: write d9/d10/d17/f3d [812756,126070] 0 2024-09-06T14:44:49.820 INFO:tasks.workunit.client.0.smithi052.stdout:4/475: dread - d9/d2d/f8d zero size 2024-09-06T14:44:49.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/592: getdents d2/d1a/d22/d26/d2b/d48 0 2024-09-06T14:44:49.824 INFO:tasks.workunit.client.0.smithi052.stdout:1/523: dwrite d1/db/d72/faf [0,4194304] 0 2024-09-06T14:44:49.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/593: rmdir d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e 39 2024-09-06T14:44:49.832 INFO:tasks.workunit.client.0.smithi052.stdout:7/446: write d11/d1c/f32 [156386,97559] 0 2024-09-06T14:44:49.832 INFO:tasks.workunit.client.0.smithi052.stdout:1/524: dwrite d1/f1d [4194304,4194304] 0 2024-09-06T14:44:49.833 INFO:tasks.workunit.client.0.smithi052.stdout:4/476: creat d9/d10/d17/d39/d3a/d64/fa3 x:0 0 0 2024-09-06T14:44:49.835 INFO:tasks.workunit.client.0.smithi052.stdout:7/447: truncate d11/d1c/d3f/f72 816724 0 2024-09-06T14:44:49.837 INFO:tasks.workunit.client.0.smithi052.stdout:1/525: truncate d1/db/d18/f66 1372467 0 2024-09-06T14:44:49.837 INFO:tasks.workunit.client.0.smithi052.stdout:4/477: chown d9/d10/d19/d41/c87 374847 1 2024-09-06T14:44:49.841 INFO:tasks.workunit.client.0.smithi052.stdout:1/526: creat d1/db/d50/da4/fb6 x:0 0 0 2024-09-06T14:44:49.845 INFO:tasks.workunit.client.0.smithi052.stdout:5/594: getdents d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c 0 2024-09-06T14:44:49.846 INFO:tasks.workunit.client.0.smithi052.stdout:5/595: chown d2/d1a/d22/f3e 94284 1 2024-09-06T14:44:49.846 INFO:tasks.workunit.client.0.smithi052.stdout:7/448: fsync d11/d1c/d24/f29 0 2024-09-06T14:44:49.848 INFO:tasks.workunit.client.0.smithi052.stdout:7/449: read - d11/d1c/d57/d89/f8b zero size 2024-09-06T14:44:49.849 INFO:tasks.workunit.client.0.smithi052.stdout:1/527: link d1/db/de/d74/d3e/f94 d1/db/de/d74/d14/fb7 0 2024-09-06T14:44:49.850 INFO:tasks.workunit.client.0.smithi052.stdout:7/450: dread d11/f2c [0,4194304] 0 2024-09-06T14:44:49.851 INFO:tasks.workunit.client.0.smithi052.stdout:7/451: chown d11/f2c 5747694 1 2024-09-06T14:44:49.851 INFO:tasks.workunit.client.0.smithi052.stdout:7/452: dread - d11/d1c/d57/d89/f8b zero size 2024-09-06T14:44:49.856 INFO:tasks.workunit.client.0.smithi052.stdout:4/478: write d9/d10/d19/f28 [19398,94692] 0 2024-09-06T14:44:49.857 INFO:tasks.workunit.client.0.smithi052.stdout:1/528: rmdir d1/db/de/d74/d36/daa 39 2024-09-06T14:44:49.864 INFO:tasks.workunit.client.0.smithi052.stdout:1/529: dwrite d1/db/de/d74/d36/d9b/fa9 [0,4194304] 0 2024-09-06T14:44:49.864 INFO:tasks.workunit.client.0.smithi052.stdout:5/596: link d2/d20/d56/f95 d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fcc 0 2024-09-06T14:44:49.868 INFO:tasks.workunit.client.0.smithi052.stdout:4/479: truncate d9/d10/f4f 231107 0 2024-09-06T14:44:49.869 INFO:tasks.workunit.client.0.smithi052.stdout:7/453: creat d11/d1c/d24/f93 x:0 0 0 2024-09-06T14:44:49.876 INFO:tasks.workunit.client.0.smithi052.stdout:5/597: getdents d2/d1a/d22/d26/d2b/d37/d84/d97 0 2024-09-06T14:44:49.877 INFO:tasks.workunit.client.0.smithi052.stdout:7/454: dread d11/d1c/d26/f28 [0,4194304] 0 2024-09-06T14:44:49.880 INFO:tasks.workunit.client.0.smithi052.stdout:4/480: symlink d9/d10/d17/la4 0 2024-09-06T14:44:49.881 INFO:tasks.workunit.client.0.smithi052.stdout:4/481: chown d9/d2d/l32 1806116 1 2024-09-06T14:44:49.883 INFO:tasks.workunit.client.0.smithi052.stdout:7/455: chown d11/d1c/d24/d3b/d50/f8c 62 1 2024-09-06T14:44:49.884 INFO:tasks.workunit.client.0.smithi052.stdout:1/530: dwrite d1/db/de/d74/d14/f25 [0,4194304] 0 2024-09-06T14:44:49.888 INFO:tasks.workunit.client.0.smithi052.stdout:5/598: link d2/d1a/d22/d26/d2b/d37/d6a/f96 d2/d1a/d22/d26/d2b/d37/d6a/fcd 0 2024-09-06T14:44:49.889 INFO:tasks.workunit.client.0.smithi052.stdout:1/531: fdatasync d1/db/d18/fb4 0 2024-09-06T14:44:49.895 INFO:tasks.workunit.client.0.smithi052.stdout:5/599: dwrite d2/d1a/fbe [0,4194304] 0 2024-09-06T14:44:49.896 INFO:tasks.workunit.client.0.smithi052.stdout:5/600: chown d2/d1a/d22/d26/d62/f8a 5351015 1 2024-09-06T14:44:49.955 INFO:tasks.workunit.client.0.smithi052.stdout:7/456: getdents d11/d1c/d26 0 2024-09-06T14:44:49.957 INFO:tasks.workunit.client.0.smithi052.stdout:4/482: link d9/d10/f4f d9/d72/fa5 0 2024-09-06T14:44:50.027 INFO:tasks.workunit.client.0.smithi052.stdout:4/483: rename d9/d10/d19/d41 to d9/d2d/d33/d5d/da6 0 2024-09-06T14:44:50.027 INFO:tasks.workunit.client.0.smithi052.stdout:4/484: readlink d9/d2d/l32 0 2024-09-06T14:44:50.030 INFO:tasks.workunit.client.0.smithi052.stdout:1/532: getdents d1/db/de/d74/d12 0 2024-09-06T14:44:50.030 INFO:tasks.workunit.client.0.smithi052.stdout:5/601: write d2/d1a/d22/d26/d62/f72 [1559996,74331] 0 2024-09-06T14:44:50.031 INFO:tasks.workunit.client.0.smithi052.stdout:7/457: write d11/d1c/d24/d4b/f63 [620152,79837] 0 2024-09-06T14:44:50.037 INFO:tasks.workunit.client.0.smithi052.stdout:7/458: creat d11/d1c/d26/f94 x:0 0 0 2024-09-06T14:44:50.039 INFO:tasks.workunit.client.0.smithi052.stdout:4/485: link d9/d2d/d33/c97 d9/d10/d17/d39/d3a/ca7 0 2024-09-06T14:44:50.041 INFO:tasks.workunit.client.0.smithi052.stdout:4/486: dread d9/d2d/d33/d5d/f89 [0,4194304] 0 2024-09-06T14:44:50.043 INFO:tasks.workunit.client.0.smithi052.stdout:1/533: dwrite d1/db/de/d74/f32 [0,4194304] 0 2024-09-06T14:44:50.045 INFO:tasks.workunit.client.0.smithi052.stdout:4/487: truncate d9/d10/d17/d39/d3a/d64/fa3 71097 0 2024-09-06T14:44:50.048 INFO:tasks.workunit.client.0.smithi052.stdout:5/602: getdents d2/d1a/d22 0 2024-09-06T14:44:50.048 INFO:tasks.workunit.client.0.smithi052.stdout:7/459: creat d11/d1c/f95 x:0 0 0 2024-09-06T14:44:50.049 INFO:tasks.workunit.client.0.smithi052.stdout:1/534: creat d1/db/d72/d81/fb8 x:0 0 0 2024-09-06T14:44:50.053 INFO:tasks.workunit.client.0.smithi052.stdout:7/460: rename d11/d1c/d24/d3b/l77 to d11/d1c/d24/d4b/l96 0 2024-09-06T14:44:50.060 INFO:tasks.workunit.client.0.smithi052.stdout:7/461: rename d11/d1c/d24/f29 to d11/d1c/d24/d3b/f97 0 2024-09-06T14:44:50.061 INFO:tasks.workunit.client.0.smithi052.stdout:7/462: chown d11/d1c/d24/f84 3383386 1 2024-09-06T14:44:50.066 INFO:tasks.workunit.client.0.smithi052.stdout:1/535: write d1/db/de/d74/d3e/f5a [479761,112066] 0 2024-09-06T14:44:50.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/463: mkdir d11/d1c/d78/d98 0 2024-09-06T14:44:50.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/603: write d2/d1a/f3a [1843893,18946] 0 2024-09-06T14:44:50.068 INFO:tasks.workunit.client.0.smithi052.stdout:4/488: dwrite d9/d10/d17/d39/f58 [4194304,4194304] 0 2024-09-06T14:44:50.069 INFO:tasks.workunit.client.0.smithi052.stdout:5/604: read - d2/d1a/d22/f9f zero size 2024-09-06T14:44:50.070 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:49 smithi052 ceph-mon[28627]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 93 MiB/s rd, 273 MiB/s wr, 545 op/s 2024-09-06T14:44:50.072 INFO:tasks.workunit.client.0.smithi052.stdout:1/536: creat d1/db/de/d74/d12/fb9 x:0 0 0 2024-09-06T14:44:50.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:49 smithi165 ceph-mon[36229]: pgmap v27: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 93 MiB/s rd, 273 MiB/s wr, 545 op/s 2024-09-06T14:44:50.077 INFO:tasks.workunit.client.0.smithi052.stdout:7/464: creat d11/d1c/d78/d98/f99 x:0 0 0 2024-09-06T14:44:50.079 INFO:tasks.workunit.client.0.smithi052.stdout:5/605: rename d2/d1a/d22/d26/d2b/d48/c7d to d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/cce 0 2024-09-06T14:44:50.081 INFO:tasks.workunit.client.0.smithi052.stdout:4/489: symlink d9/d10/d17/la8 0 2024-09-06T14:44:50.085 INFO:tasks.workunit.client.0.smithi052.stdout:4/490: readlink d9/d10/d19/l1d 0 2024-09-06T14:44:50.111 INFO:tasks.workunit.client.0.smithi052.stdout:7/465: write d11/d1c/d26/f67 [1291793,83204] 0 2024-09-06T14:44:50.111 INFO:tasks.workunit.client.0.smithi052.stdout:4/491: write d9/d10/f6e [288345,106272] 0 2024-09-06T14:44:50.115 INFO:tasks.workunit.client.0.smithi052.stdout:7/466: creat d11/d1c/d78/d98/f9a x:0 0 0 2024-09-06T14:44:50.117 INFO:tasks.workunit.client.0.smithi052.stdout:1/537: dread d1/db/de/d74/ff [4194304,4194304] 0 2024-09-06T14:44:50.119 INFO:tasks.workunit.client.0.smithi052.stdout:1/538: mknod d1/db/de/d74/d36/d9b/cba 0 2024-09-06T14:44:50.122 INFO:tasks.workunit.client.0.smithi052.stdout:4/492: write d9/d10/d17/d39/f93 [528488,31759] 0 2024-09-06T14:44:50.122 INFO:tasks.workunit.client.0.smithi052.stdout:7/467: dwrite d11/d1c/d3f/f7f [0,4194304] 0 2024-09-06T14:44:50.125 INFO:tasks.workunit.client.0.smithi052.stdout:1/539: truncate d1/db/de/d74/d12/f46 2794771 0 2024-09-06T14:44:50.126 INFO:tasks.workunit.client.0.smithi052.stdout:4/493: rmdir d9/d10/d19 39 2024-09-06T14:44:50.130 INFO:tasks.workunit.client.0.smithi052.stdout:7/468: creat d11/d1c/d24/d4b/f9b x:0 0 0 2024-09-06T14:44:50.130 INFO:tasks.workunit.client.0.smithi052.stdout:1/540: fsync d1/db/de/d74/d3e/f44 0 2024-09-06T14:44:50.132 INFO:tasks.workunit.client.0.smithi052.stdout:4/494: mknod d9/d2d/d33/d4d/d81/ca9 0 2024-09-06T14:44:50.134 INFO:tasks.workunit.client.0.smithi052.stdout:7/469: mkdir d11/d1c/d3f/d9c 0 2024-09-06T14:44:50.137 INFO:tasks.workunit.client.0.smithi052.stdout:4/495: truncate d9/d10/d19/f3c 1441978 0 2024-09-06T14:44:50.138 INFO:tasks.workunit.client.0.smithi052.stdout:4/496: chown d9/f2e 75799 1 2024-09-06T14:44:50.145 INFO:tasks.workunit.client.0.smithi052.stdout:4/497: dwrite d9/d10/d17/f42 [0,4194304] 0 2024-09-06T14:44:50.150 INFO:tasks.workunit.client.0.smithi052.stdout:1/541: dwrite d1/f9 [0,4194304] 0 2024-09-06T14:44:50.156 INFO:tasks.workunit.client.0.smithi052.stdout:7/470: dwrite d11/d1c/d24/d3b/d50/f8c [0,4194304] 0 2024-09-06T14:44:50.158 INFO:tasks.workunit.client.0.smithi052.stdout:7/471: write d11/d1c/d3f/f5f [660385,76063] 0 2024-09-06T14:44:50.159 INFO:tasks.workunit.client.0.smithi052.stdout:7/472: chown d11/d1c/d24/f93 473488 1 2024-09-06T14:44:50.160 INFO:tasks.workunit.client.0.smithi052.stdout:1/542: symlink d1/db/d18/lbb 0 2024-09-06T14:44:50.161 INFO:tasks.workunit.client.0.smithi052.stdout:7/473: write d11/d1c/d24/f93 [29982,5847] 0 2024-09-06T14:44:50.163 INFO:tasks.workunit.client.0.smithi052.stdout:4/498: dread d9/f2e [0,4194304] 0 2024-09-06T14:44:50.164 INFO:tasks.workunit.client.0.smithi052.stdout:7/474: write d11/d1c/d26/f40 [934105,97472] 0 2024-09-06T14:44:50.166 INFO:tasks.workunit.client.0.smithi052.stdout:7/475: chown d11/d1c/d24/d4b/c8f 3 1 2024-09-06T14:44:50.169 INFO:tasks.workunit.client.0.smithi052.stdout:1/543: rename d1/db/d18/cae to d1/d6c/cbc 0 2024-09-06T14:44:50.171 INFO:tasks.workunit.client.0.smithi052.stdout:7/476: symlink d11/d1c/d26/l9d 0 2024-09-06T14:44:50.171 INFO:tasks.workunit.client.0.smithi052.stdout:4/499: mkdir d9/d10/d17/daa 0 2024-09-06T14:44:50.176 INFO:tasks.workunit.client.0.smithi052.stdout:4/500: chown d9/d10/d17 1841524987 1 2024-09-06T14:44:50.179 INFO:tasks.workunit.client.0.smithi052.stdout:1/544: dwrite d1/f1d [4194304,4194304] 0 2024-09-06T14:44:50.197 INFO:tasks.workunit.client.0.smithi052.stdout:1/545: fsync d1/db/de/d74/d36/f7e 0 2024-09-06T14:44:50.199 INFO:tasks.workunit.client.0.smithi052.stdout:7/477: creat d11/d1c/d3f/f9e x:0 0 0 2024-09-06T14:44:50.203 INFO:tasks.workunit.client.0.smithi052.stdout:1/546: rename d1/db/de/d74/d3e/d47/d4a/f4e to d1/db/d18/fbd 0 2024-09-06T14:44:50.204 INFO:tasks.workunit.client.0.smithi052.stdout:6/394: sync 2024-09-06T14:44:50.205 INFO:tasks.workunit.client.0.smithi052.stdout:9/372: sync 2024-09-06T14:44:50.209 INFO:tasks.workunit.client.0.smithi052.stdout:1/547: creat d1/db/de/d74/d36/d9b/fbe x:0 0 0 2024-09-06T14:44:50.211 INFO:tasks.workunit.client.0.smithi052.stdout:1/548: truncate d1/db/d50/f5e 1715187 0 2024-09-06T14:44:50.216 INFO:tasks.workunit.client.0.smithi052.stdout:1/549: link d1/db/de/d74/d12/c96 d1/db/de/cbf 0 2024-09-06T14:44:50.220 INFO:tasks.workunit.client.0.smithi052.stdout:4/501: write d9/d10/d17/d39/d3a/f92 [467258,51575] 0 2024-09-06T14:44:50.222 INFO:tasks.workunit.client.0.smithi052.stdout:9/373: dread d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:50.223 INFO:tasks.workunit.client.0.smithi052.stdout:4/502: dread - d9/d2d/d33/d5d/f94 zero size 2024-09-06T14:44:50.225 INFO:tasks.workunit.client.0.smithi052.stdout:7/478: truncate d11/d1c/d3f/f7f 50789 0 2024-09-06T14:44:50.226 INFO:tasks.workunit.client.0.smithi052.stdout:1/550: dwrite d1/db/de/d74/d3e/f5a [0,4194304] 0 2024-09-06T14:44:50.227 INFO:tasks.workunit.client.0.smithi052.stdout:7/479: write d11/d1c/d78/d98/f99 [409548,121623] 0 2024-09-06T14:44:50.229 INFO:tasks.workunit.client.0.smithi052.stdout:9/374: creat d1/d4/df/f6d x:0 0 0 2024-09-06T14:44:50.231 INFO:tasks.workunit.client.0.smithi052.stdout:6/395: truncate d2/dd/d18/d2d/d32/f40 1117885 0 2024-09-06T14:44:50.232 INFO:tasks.workunit.client.0.smithi052.stdout:6/396: write d2/dd/d18/f6d [636077,38014] 0 2024-09-06T14:44:50.233 INFO:tasks.workunit.client.0.smithi052.stdout:7/480: creat d11/d1c/d57/f9f x:0 0 0 2024-09-06T14:44:50.237 INFO:tasks.workunit.client.0.smithi052.stdout:1/551: rename d1/db/de/d74/d3e/f44 to d1/d5f/fc0 0 2024-09-06T14:44:50.239 INFO:tasks.workunit.client.0.smithi052.stdout:1/552: truncate d1/db/de/d74/d3e/d47/f6e 5220685 0 2024-09-06T14:44:50.240 INFO:tasks.workunit.client.0.smithi052.stdout:6/397: stat d2/dd/d18/c36 0 2024-09-06T14:44:50.242 INFO:tasks.workunit.client.0.smithi052.stdout:7/481: fdatasync d11/d1c/d24/f38 0 2024-09-06T14:44:50.246 INFO:tasks.workunit.client.0.smithi052.stdout:4/503: creat d9/d10/fab x:0 0 0 2024-09-06T14:44:50.246 INFO:tasks.workunit.client.0.smithi052.stdout:4/504: chown d9/f65 64 1 2024-09-06T14:44:50.247 INFO:tasks.workunit.client.0.smithi052.stdout:9/375: symlink d1/d4/d6/dc/d38/d5a/l6e 0 2024-09-06T14:44:50.255 INFO:tasks.workunit.client.0.smithi052.stdout:7/482: read d11/d1c/f7c [197220,97565] 0 2024-09-06T14:44:50.258 INFO:tasks.workunit.client.0.smithi052.stdout:9/376: truncate d1/d4/d6/dd/f13 4480067 0 2024-09-06T14:44:50.259 INFO:tasks.workunit.client.0.smithi052.stdout:9/377: chown d1/d4/d6/dc 22505428 1 2024-09-06T14:44:50.261 INFO:tasks.workunit.client.0.smithi052.stdout:4/505: mkdir d9/d2d/d33/d4d/d81/d9c/dac 0 2024-09-06T14:44:50.263 INFO:tasks.workunit.client.0.smithi052.stdout:4/506: chown d9/d10/d17/d39/d3a/d5c/f90 181867513 1 2024-09-06T14:44:50.264 INFO:tasks.workunit.client.0.smithi052.stdout:6/398: creat d2/dd/d18/d25/f87 x:0 0 0 2024-09-06T14:44:50.266 INFO:tasks.workunit.client.0.smithi052.stdout:9/378: dwrite d1/d4/f43 [0,4194304] 0 2024-09-06T14:44:50.268 INFO:tasks.workunit.client.0.smithi052.stdout:4/507: stat d9/d10/d19/f2c 0 2024-09-06T14:44:50.271 INFO:tasks.workunit.client.0.smithi052.stdout:4/508: readlink d9/d10/d19/l1d 0 2024-09-06T14:44:50.272 INFO:tasks.workunit.client.0.smithi052.stdout:7/483: dwrite d11/d1c/d24/d3b/d50/f92 [0,4194304] 0 2024-09-06T14:44:50.275 INFO:tasks.workunit.client.0.smithi052.stdout:9/379: dwrite d1/d4/d4b/f62 [0,4194304] 0 2024-09-06T14:44:50.277 INFO:tasks.workunit.client.0.smithi052.stdout:6/399: creat d2/dd/d18/f88 x:0 0 0 2024-09-06T14:44:50.280 INFO:tasks.workunit.client.0.smithi052.stdout:4/509: unlink d9/d10/d17/l26 0 2024-09-06T14:44:50.283 INFO:tasks.workunit.client.0.smithi052.stdout:9/380: symlink d1/d4/df/d56/l6f 0 2024-09-06T14:44:50.284 INFO:tasks.workunit.client.0.smithi052.stdout:9/381: write d1/d4/df/f6d [585646,48066] 0 2024-09-06T14:44:50.285 INFO:tasks.workunit.client.0.smithi052.stdout:9/382: fsync d1/d26/d3d/f4a 0 2024-09-06T14:44:50.286 INFO:tasks.workunit.client.0.smithi052.stdout:4/510: unlink d9/d2d/d33/d5d/f94 0 2024-09-06T14:44:50.287 INFO:tasks.workunit.client.0.smithi052.stdout:4/511: read - d9/d10/fab zero size 2024-09-06T14:44:50.288 INFO:tasks.workunit.client.0.smithi052.stdout:9/383: chown d1/d26/d41 0 1 2024-09-06T14:44:50.289 INFO:tasks.workunit.client.0.smithi052.stdout:9/384: dread - d1/d4/df/f59 zero size 2024-09-06T14:44:50.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/385: mkdir d1/d4/d6/dc/d38/d5a/d70 0 2024-09-06T14:44:50.296 INFO:tasks.workunit.client.0.smithi052.stdout:7/484: truncate d11/d1c/d24/d4b/f4c 2858982 0 2024-09-06T14:44:50.296 INFO:tasks.workunit.client.0.smithi052.stdout:7/485: chown d11/d1c/d3f 81785673 1 2024-09-06T14:44:50.301 INFO:tasks.workunit.client.0.smithi052.stdout:4/512: link d9/d2d/d33/c7c d9/d2d/d33/d4d/d81/cad 0 2024-09-06T14:44:50.303 INFO:tasks.workunit.client.0.smithi052.stdout:4/513: write d9/d10/d17/d39/d3a/d5c/f98 [424744,14694] 0 2024-09-06T14:44:50.304 INFO:tasks.workunit.client.0.smithi052.stdout:4/514: chown d9/d2d/f67 2498595 1 2024-09-06T14:44:50.309 INFO:tasks.workunit.client.0.smithi052.stdout:4/515: symlink d9/d2d/d33/d5d/lae 0 2024-09-06T14:44:50.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/516: write d9/d10/f6e [1683963,14033] 0 2024-09-06T14:44:50.310 INFO:tasks.workunit.client.0.smithi052.stdout:9/386: getdents d1/d4/d6/dd 0 2024-09-06T14:44:50.313 INFO:tasks.workunit.client.0.smithi052.stdout:7/486: write d11/d1c/d26/f60 [1333012,38882] 0 2024-09-06T14:44:50.315 INFO:tasks.workunit.client.0.smithi052.stdout:4/517: write d9/d10/d19/f28 [1436584,68869] 0 2024-09-06T14:44:50.320 INFO:tasks.workunit.client.0.smithi052.stdout:7/487: rename d11/d1c/d24/d4b/l90 to d11/d1c/d57/d89/la0 0 2024-09-06T14:44:50.321 INFO:tasks.workunit.client.0.smithi052.stdout:7/488: dread - d11/d1c/d57/f9f zero size 2024-09-06T14:44:50.322 INFO:tasks.workunit.client.0.smithi052.stdout:7/489: fsync d11/d1c/d24/d3b/d50/f6e 0 2024-09-06T14:44:50.323 INFO:tasks.workunit.client.0.smithi052.stdout:4/518: creat d9/d10/d17/d39/faf x:0 0 0 2024-09-06T14:44:50.323 INFO:tasks.workunit.client.0.smithi052.stdout:9/387: fdatasync d1/d4/d6/dc/d10/f34 0 2024-09-06T14:44:50.325 INFO:tasks.workunit.client.0.smithi052.stdout:9/388: write d1/d4/d6/dd/f48 [3732243,82574] 0 2024-09-06T14:44:50.333 INFO:tasks.workunit.client.0.smithi052.stdout:9/389: mkdir d1/d4/df/d71 0 2024-09-06T14:44:50.337 INFO:tasks.workunit.client.0.smithi052.stdout:4/519: creat d9/d2d/fb0 x:0 0 0 2024-09-06T14:44:50.340 INFO:tasks.workunit.client.0.smithi052.stdout:7/490: truncate f5 1347932 0 2024-09-06T14:44:50.342 INFO:tasks.workunit.client.0.smithi052.stdout:4/520: getdents d9/d2d/d33/d5d 0 2024-09-06T14:44:50.345 INFO:tasks.workunit.client.0.smithi052.stdout:4/521: read f2 [4216547,76831] 0 2024-09-06T14:44:50.348 INFO:tasks.workunit.client.0.smithi052.stdout:4/522: write d9/d10/d17/f3d [293715,34100] 0 2024-09-06T14:44:50.348 INFO:tasks.workunit.client.0.smithi052.stdout:7/491: dwrite d11/d1c/d3f/f65 [0,4194304] 0 2024-09-06T14:44:50.351 INFO:tasks.workunit.client.0.smithi052.stdout:4/523: creat d9/d10/d17/d39/d3a/fb1 x:0 0 0 2024-09-06T14:44:50.354 INFO:tasks.workunit.client.0.smithi052.stdout:4/524: dread d9/d72/fa5 [0,4194304] 0 2024-09-06T14:44:50.355 INFO:tasks.workunit.client.0.smithi052.stdout:7/492: mknod d11/d1c/d3f/d5d/d88/ca1 0 2024-09-06T14:44:50.358 INFO:tasks.workunit.client.0.smithi052.stdout:4/525: unlink d9/d2d/d33/f37 0 2024-09-06T14:44:50.360 INFO:tasks.workunit.client.0.smithi052.stdout:7/493: mkdir d11/d1c/d24/d4b/da2 0 2024-09-06T14:44:50.362 INFO:tasks.workunit.client.0.smithi052.stdout:4/526: mknod d9/d2d/d33/d4d/cb2 0 2024-09-06T14:44:50.366 INFO:tasks.workunit.client.0.smithi052.stdout:7/494: dwrite d11/d1c/d26/f2b [4194304,4194304] 0 2024-09-06T14:44:50.367 INFO:tasks.workunit.client.0.smithi052.stdout:7/495: stat d11/d1c/d78/f79 0 2024-09-06T14:44:50.369 INFO:tasks.workunit.client.0.smithi052.stdout:7/496: read d11/d1c/f7c [3193044,5619] 0 2024-09-06T14:44:50.379 INFO:tasks.workunit.client.0.smithi052.stdout:7/497: rmdir d11/d1c/d3f/d9c 0 2024-09-06T14:44:50.380 INFO:tasks.workunit.client.0.smithi052.stdout:7/498: write d11/d1c/d26/f48 [2374536,130933] 0 2024-09-06T14:44:50.381 INFO:tasks.workunit.client.0.smithi052.stdout:7/499: write d11/d1c/d24/f93 [1079812,43558] 0 2024-09-06T14:44:50.417 INFO:tasks.workunit.client.0.smithi052.stdout:2/540: sync 2024-09-06T14:44:50.417 INFO:tasks.workunit.client.0.smithi052.stdout:2/541: write da/d19/d3a/d31/fb4 [142470,25370] 0 2024-09-06T14:44:50.421 INFO:tasks.workunit.client.0.smithi052.stdout:2/542: mkdir da/d19/d3a/d31/d76/d6a/dbf 0 2024-09-06T14:44:50.422 INFO:tasks.workunit.client.0.smithi052.stdout:2/543: read - da/db/d60/daa/fbc zero size 2024-09-06T14:44:50.424 INFO:tasks.workunit.client.0.smithi052.stdout:2/544: mknod da/d19/d3a/d31/d7a/cc0 0 2024-09-06T14:44:50.431 INFO:tasks.workunit.client.0.smithi052.stdout:2/545: link da/ld da/d64/lc1 0 2024-09-06T14:44:50.433 INFO:tasks.workunit.client.0.smithi052.stdout:2/546: truncate da/db/d60/db1/d70/f85 4746772 0 2024-09-06T14:44:50.437 INFO:tasks.workunit.client.0.smithi052.stdout:2/547: unlink da/db/d60/l30 0 2024-09-06T14:44:50.438 INFO:tasks.workunit.client.0.smithi052.stdout:2/548: chown da/db/d18/l3e 4456 1 2024-09-06T14:44:50.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/549: truncate da/db/f12 1508949 0 2024-09-06T14:44:50.440 INFO:tasks.workunit.client.0.smithi052.stdout:2/550: chown da/db/d60/daa/fbc 1 1 2024-09-06T14:44:50.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/551: dread da/db/d60/db1/d70/f85 [0,4194304] 0 2024-09-06T14:44:50.472 INFO:tasks.workunit.client.0.smithi052.stdout:2/552: dwrite da/db/d46/d55/f68 [0,4194304] 0 2024-09-06T14:44:50.482 INFO:tasks.workunit.client.0.smithi052.stdout:2/553: rename da/db/d60/db1/c89 to da/d19/cc2 0 2024-09-06T14:44:50.494 INFO:tasks.workunit.client.0.smithi052.stdout:2/554: dread da/f2f [4194304,4194304] 0 2024-09-06T14:44:50.497 INFO:tasks.workunit.client.0.smithi052.stdout:2/555: symlink da/d2d/d34/lc3 0 2024-09-06T14:44:50.499 INFO:tasks.workunit.client.0.smithi052.stdout:2/556: chown da/d19/f6d 2097400815 1 2024-09-06T14:44:50.507 INFO:tasks.workunit.client.0.smithi052.stdout:2/557: dread da/d19/f2c [0,4194304] 0 2024-09-06T14:44:50.510 INFO:tasks.workunit.client.0.smithi052.stdout:2/558: mkdir da/d19/d3a/dc4 0 2024-09-06T14:44:50.511 INFO:tasks.workunit.client.0.smithi052.stdout:2/559: rmdir da/db/d46/d6b 39 2024-09-06T14:44:50.512 INFO:tasks.workunit.client.0.smithi052.stdout:2/560: fsync da/db/d60/db1/d70/f93 0 2024-09-06T14:44:50.514 INFO:tasks.workunit.client.0.smithi052.stdout:2/561: symlink da/d19/d3a/d61/d7b/lc5 0 2024-09-06T14:44:50.515 INFO:tasks.workunit.client.0.smithi052.stdout:2/562: fdatasync da/d19/d3a/d31/f37 0 2024-09-06T14:44:50.516 INFO:tasks.workunit.client.0.smithi052.stdout:2/563: read da/d19/d3a/d31/f43 [2351353,18367] 0 2024-09-06T14:44:50.522 INFO:tasks.workunit.client.0.smithi052.stdout:2/564: dwrite da/d19/d3a/d31/fb4 [0,4194304] 0 2024-09-06T14:44:50.540 INFO:tasks.workunit.client.0.smithi052.stdout:2/565: write da/d4f/f5b [3406960,2898] 0 2024-09-06T14:44:50.672 INFO:tasks.workunit.client.0.smithi052.stdout:3/519: sync 2024-09-06T14:44:50.672 INFO:tasks.workunit.client.0.smithi052.stdout:8/737: sync 2024-09-06T14:44:50.673 INFO:tasks.workunit.client.0.smithi052.stdout:8/738: chown d6/d16/f2c 13144 1 2024-09-06T14:44:50.675 INFO:tasks.workunit.client.0.smithi052.stdout:8/739: chown d6/d22/d36/d3e/d47/d56/d68/d69/cd0 110379109 1 2024-09-06T14:44:50.681 INFO:tasks.workunit.client.0.smithi052.stdout:3/520: dwrite d0/d11/d71/d98/f4e [0,4194304] 0 2024-09-06T14:44:50.689 INFO:tasks.workunit.client.0.smithi052.stdout:3/521: dwrite d0/d11/d71/d98/d19/f7f [0,4194304] 0 2024-09-06T14:44:50.794 INFO:tasks.workunit.client.0.smithi052.stdout:8/740: truncate d6/d9/fb2 638246 0 2024-09-06T14:44:50.796 INFO:tasks.workunit.client.0.smithi052.stdout:3/522: truncate d0/d11/d71/d98/d1b/f27 140768 0 2024-09-06T14:44:50.800 INFO:tasks.workunit.client.0.smithi052.stdout:3/523: creat d0/d11/d12/d4c/d93/d35/d46/d5b/fa3 x:0 0 0 2024-09-06T14:44:50.800 INFO:tasks.workunit.client.0.smithi052.stdout:8/741: dwrite d6/d9/d1f/d33/da8/d1b/f30 [0,4194304] 0 2024-09-06T14:44:50.803 INFO:tasks.workunit.client.0.smithi052.stdout:3/524: mkdir d0/d11/d71/d98/d19/da4 0 2024-09-06T14:44:50.807 INFO:tasks.workunit.client.0.smithi052.stdout:8/742: dwrite d6/d4c/f80 [0,4194304] 0 2024-09-06T14:44:50.818 INFO:tasks.workunit.client.0.smithi052.stdout:8/743: creat d6/d9/d1f/d33/da8/f106 x:0 0 0 2024-09-06T14:44:50.827 INFO:tasks.workunit.client.0.smithi052.stdout:3/525: dwrite d0/d11/d12/d4c/d93/d35/f2a [0,4194304] 0 2024-09-06T14:44:50.832 INFO:tasks.workunit.client.0.smithi052.stdout:8/744: write d6/d22/d31/ffe [4540261,91626] 0 2024-09-06T14:44:50.835 INFO:tasks.workunit.client.0.smithi052.stdout:3/526: fsync d0/d11/d12/d4c/d93/d35/f28 0 2024-09-06T14:44:50.838 INFO:tasks.workunit.client.0.smithi052.stdout:8/745: unlink d6/d9/d1f/d19/d6f/d72/fd4 0 2024-09-06T14:44:50.841 INFO:tasks.workunit.client.0.smithi052.stdout:8/746: creat d6/d22/d36/d3e/d47/d56/d68/f107 x:0 0 0 2024-09-06T14:44:50.842 INFO:tasks.workunit.client.0.smithi052.stdout:3/527: getdents d0/d11/d71/d98/d19/da4 0 2024-09-06T14:44:50.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/528: fdatasync d0/d11/d71/d98/f50 0 2024-09-06T14:44:50.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/529: truncate d0/d11/d12/f47 6544204 0 2024-09-06T14:44:50.853 INFO:tasks.workunit.client.0.smithi052.stdout:3/530: mkdir d0/d11/d12/d17/d7b/da5 0 2024-09-06T14:44:50.853 INFO:tasks.workunit.client.0.smithi052.stdout:8/747: dread d6/d9/d1f/d14/f29 [0,4194304] 0 2024-09-06T14:44:50.854 INFO:tasks.workunit.client.0.smithi052.stdout:3/531: write d0/d11/f2e [2822735,86473] 0 2024-09-06T14:44:50.856 INFO:tasks.workunit.client.0.smithi052.stdout:8/748: symlink d6/d9/d1f/d19/dc4/l108 0 2024-09-06T14:44:50.857 INFO:tasks.workunit.client.0.smithi052.stdout:3/532: fsync d0/d11/d12/d4c/d93/d35/f28 0 2024-09-06T14:44:50.864 INFO:tasks.workunit.client.0.smithi052.stdout:3/533: fsync d0/f3 0 2024-09-06T14:44:50.864 INFO:tasks.workunit.client.0.smithi052.stdout:3/534: read d0/d11/d71/d98/d19/f2c [2173397,46639] 0 2024-09-06T14:44:50.866 INFO:tasks.workunit.client.0.smithi052.stdout:8/749: write d6/d9/f2e [618885,97411] 0 2024-09-06T14:44:50.867 INFO:tasks.workunit.client.0.smithi052.stdout:8/750: chown d6/d9/d1f/d14/le8 72 1 2024-09-06T14:44:50.868 INFO:tasks.workunit.client.0.smithi052.stdout:8/751: chown d6/d3c 1808 1 2024-09-06T14:44:50.871 INFO:tasks.workunit.client.0.smithi052.stdout:8/752: creat d6/d4c/f109 x:0 0 0 2024-09-06T14:44:50.873 INFO:tasks.workunit.client.0.smithi052.stdout:8/753: write d6/d22/d36/d3e/d47/d56/d68/f107 [151574,24341] 0 2024-09-06T14:44:50.874 INFO:tasks.workunit.client.0.smithi052.stdout:5/606: sync 2024-09-06T14:44:50.874 INFO:tasks.workunit.client.0.smithi052.stdout:0/508: sync 2024-09-06T14:44:50.875 INFO:tasks.workunit.client.0.smithi052.stdout:3/535: dread d0/d11/d71/d98/f50 [0,4194304] 0 2024-09-06T14:44:50.877 INFO:tasks.workunit.client.0.smithi052.stdout:0/509: mknod d0/d3d/cb5 0 2024-09-06T14:44:50.878 INFO:tasks.workunit.client.0.smithi052.stdout:8/754: creat d6/d9/d1f/d33/da8/d1b/d87/f10a x:0 0 0 2024-09-06T14:44:50.882 INFO:tasks.workunit.client.0.smithi052.stdout:3/536: dwrite d0/d11/d71/d98/d1b/f60 [4194304,4194304] 0 2024-09-06T14:44:50.888 INFO:tasks.workunit.client.0.smithi052.stdout:5/607: creat d2/d1a/d22/d26/d2b/fcf x:0 0 0 2024-09-06T14:44:50.890 INFO:tasks.workunit.client.0.smithi052.stdout:0/510: fdatasync d0/d1a/d8e/fab 0 2024-09-06T14:44:50.895 INFO:tasks.workunit.client.0.smithi052.stdout:3/537: rename d0/d11/d71/d98/d19/da4 to d0/d11/d12/d4c/d93/d35/d46/d5b/da0/da6 0 2024-09-06T14:44:50.895 INFO:tasks.workunit.client.0.smithi052.stdout:3/538: readlink d0/d11/d12/d4c/d93/d64/l69 0 2024-09-06T14:44:50.896 INFO:tasks.workunit.client.0.smithi052.stdout:3/539: dread - d0/d11/d12/d4c/d93/d35/f92 zero size 2024-09-06T14:44:50.898 INFO:tasks.workunit.client.0.smithi052.stdout:3/540: fdatasync d0/d11/d12/d4c/d93/d35/d46/d67/f94 0 2024-09-06T14:44:50.903 INFO:tasks.workunit.client.0.smithi052.stdout:0/511: fdatasync d0/d1a/d26/d3a/d14/d2d/d56/f73 0 2024-09-06T14:44:50.910 INFO:tasks.workunit.client.0.smithi052.stdout:8/755: dwrite d6/d4c/fc8 [0,4194304] 0 2024-09-06T14:44:50.912 INFO:tasks.workunit.client.0.smithi052.stdout:3/541: creat d0/d11/d12/d17/fa7 x:0 0 0 2024-09-06T14:44:50.917 INFO:tasks.workunit.client.0.smithi052.stdout:8/756: mknod d6/d9/d1f/d33/da8/d41/db8/c10b 0 2024-09-06T14:44:50.920 INFO:tasks.workunit.client.0.smithi052.stdout:0/512: write d0/d19/d29/f91 [475930,74525] 0 2024-09-06T14:44:50.923 INFO:tasks.workunit.client.0.smithi052.stdout:7/500: sync 2024-09-06T14:44:50.923 INFO:tasks.workunit.client.0.smithi052.stdout:1/553: sync 2024-09-06T14:44:50.923 INFO:tasks.workunit.client.0.smithi052.stdout:9/390: sync 2024-09-06T14:44:50.923 INFO:tasks.workunit.client.0.smithi052.stdout:6/400: sync 2024-09-06T14:44:50.924 INFO:tasks.workunit.client.0.smithi052.stdout:2/566: sync 2024-09-06T14:44:50.924 INFO:tasks.workunit.client.0.smithi052.stdout:4/527: sync 2024-09-06T14:44:50.925 INFO:tasks.workunit.client.0.smithi052.stdout:0/513: truncate d0/d1a/f52 619103 0 2024-09-06T14:44:50.925 INFO:tasks.workunit.client.0.smithi052.stdout:5/608: write d2/d1a/d22/d26/d2b/d48/f90 [98126,68995] 0 2024-09-06T14:44:50.926 INFO:tasks.workunit.client.0.smithi052.stdout:3/542: link d0/d11/d12/d4c/d93/d64/c6e d0/d11/d12/d4c/d93/ca8 0 2024-09-06T14:44:50.929 INFO:tasks.workunit.client.0.smithi052.stdout:1/554: read d1/db/fd [1085802,102581] 0 2024-09-06T14:44:50.929 INFO:tasks.workunit.client.0.smithi052.stdout:0/514: chown d0/d1a/d26/c78 3218 1 2024-09-06T14:44:50.930 INFO:tasks.workunit.client.0.smithi052.stdout:7/501: symlink d11/d1c/d24/d3b/d50/la3 0 2024-09-06T14:44:50.932 INFO:tasks.workunit.client.0.smithi052.stdout:4/528: mknod d9/d2d/d33/d4d/d81/cb3 0 2024-09-06T14:44:50.933 INFO:tasks.workunit.client.0.smithi052.stdout:1/555: creat d1/d5f/fc1 x:0 0 0 2024-09-06T14:44:50.933 INFO:tasks.workunit.client.0.smithi052.stdout:7/502: dread - d11/d1c/d24/d4b/f9b zero size 2024-09-06T14:44:50.934 INFO:tasks.workunit.client.0.smithi052.stdout:2/567: truncate da/f1d 1851712 0 2024-09-06T14:44:50.934 INFO:tasks.workunit.client.0.smithi052.stdout:3/543: read d0/d11/d71/d98/d19/f2c [3729189,113096] 0 2024-09-06T14:44:50.936 INFO:tasks.workunit.client.0.smithi052.stdout:9/391: dread d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:50.936 INFO:tasks.workunit.client.0.smithi052.stdout:8/757: dread d6/d9/f18 [0,4194304] 0 2024-09-06T14:44:50.937 INFO:tasks.workunit.client.0.smithi052.stdout:2/568: fdatasync da/db/fa2 0 2024-09-06T14:44:50.940 INFO:tasks.workunit.client.0.smithi052.stdout:4/529: mknod d9/d2d/d33/d4d/d81/cb4 0 2024-09-06T14:44:50.942 INFO:tasks.workunit.client.0.smithi052.stdout:6/401: dwrite d2/dd/d18/d25/d4c/f86 [0,4194304] 0 2024-09-06T14:44:50.942 INFO:tasks.workunit.client.0.smithi052.stdout:7/503: dread d11/d1c/d24/d4b/f63 [0,4194304] 0 2024-09-06T14:44:50.950 INFO:tasks.workunit.client.0.smithi052.stdout:5/609: write d2/d1a/d22/d26/f73 [1014815,121468] 0 2024-09-06T14:44:50.953 INFO:tasks.workunit.client.0.smithi052.stdout:3/544: write d0/d11/d71/d98/d1b/f6b [69283,125421] 0 2024-09-06T14:44:50.954 INFO:tasks.workunit.client.0.smithi052.stdout:7/504: dwrite d11/d1c/d24/f35 [0,4194304] 0 2024-09-06T14:44:50.956 INFO:tasks.workunit.client.0.smithi052.stdout:1/556: creat d1/db/de/d74/d36/d7c/fc2 x:0 0 0 2024-09-06T14:44:50.957 INFO:tasks.workunit.client.0.smithi052.stdout:9/392: mknod d1/d4/d6/dd/d22/d6a/c72 0 2024-09-06T14:44:50.958 INFO:tasks.workunit.client.0.smithi052.stdout:7/505: dread - d11/d1c/d24/d3b/d50/f86 zero size 2024-09-06T14:44:50.959 INFO:tasks.workunit.client.0.smithi052.stdout:6/402: dwrite d2/dd/d18/f88 [0,4194304] 0 2024-09-06T14:44:50.964 INFO:tasks.workunit.client.0.smithi052.stdout:2/569: mkdir da/d19/d3a/d31/d7a/dbd/dc6 0 2024-09-06T14:44:50.965 INFO:tasks.workunit.client.0.smithi052.stdout:5/610: creat d2/d20/d42/fd0 x:0 0 0 2024-09-06T14:44:50.970 INFO:tasks.workunit.client.0.smithi052.stdout:3/545: dwrite d0/d11/d12/d4c/d93/d35/d46/d67/f94 [0,4194304] 0 2024-09-06T14:44:50.971 INFO:tasks.workunit.client.0.smithi052.stdout:3/546: chown d0/d11/d12/d4c/d93/d35/d46/d67 35 1 2024-09-06T14:44:50.973 INFO:tasks.workunit.client.0.smithi052.stdout:1/557: creat d1/db/de/d74/d14/d90/fc3 x:0 0 0 2024-09-06T14:44:50.976 INFO:tasks.workunit.client.0.smithi052.stdout:2/570: mkdir da/d19/d3a/d31/d76/dc7 0 2024-09-06T14:44:50.979 INFO:tasks.workunit.client.0.smithi052.stdout:2/571: fdatasync da/d64/f8f 0 2024-09-06T14:44:50.979 INFO:tasks.workunit.client.0.smithi052.stdout:8/758: getdents d6/d9/d1f/dcf/de6 0 2024-09-06T14:44:50.979 INFO:tasks.workunit.client.0.smithi052.stdout:5/611: read d2/d20/f28 [1105637,82637] 0 2024-09-06T14:44:50.980 INFO:tasks.workunit.client.0.smithi052.stdout:6/403: mkdir d2/dd/d18/d2d/d71/d89 0 2024-09-06T14:44:50.981 INFO:tasks.workunit.client.0.smithi052.stdout:8/759: chown d6/d9/d1f/d33/da8/d41/d71/f81 2 1 2024-09-06T14:44:50.982 INFO:tasks.workunit.client.0.smithi052.stdout:4/530: mkdir d9/d10/d17/daa/db5 0 2024-09-06T14:44:50.984 INFO:tasks.workunit.client.0.smithi052.stdout:3/547: creat d0/d11/d12/d73/fa9 x:0 0 0 2024-09-06T14:44:50.988 INFO:tasks.workunit.client.0.smithi052.stdout:5/612: mknod d2/d1a/cd1 0 2024-09-06T14:44:50.991 INFO:tasks.workunit.client.0.smithi052.stdout:7/506: dwrite d11/d1c/d24/d4b/f4c [0,4194304] 0 2024-09-06T14:44:50.991 INFO:tasks.workunit.client.0.smithi052.stdout:2/572: creat da/d19/d3a/d31/d76/fc8 x:0 0 0 2024-09-06T14:44:50.994 INFO:tasks.workunit.client.0.smithi052.stdout:3/548: dread d0/d11/d71/d98/f4e [0,4194304] 0 2024-09-06T14:44:50.994 INFO:tasks.workunit.client.0.smithi052.stdout:4/531: mknod d9/d10/d17/d39/d7b/cb6 0 2024-09-06T14:44:50.995 INFO:tasks.workunit.client.0.smithi052.stdout:2/573: stat da/db/d60/db1/d70/f93 0 2024-09-06T14:44:50.995 INFO:tasks.workunit.client.0.smithi052.stdout:8/760: chown d6/d22/d36/d3e/d47/d56/d68/d69/cce 242 1 2024-09-06T14:44:50.995 INFO:tasks.workunit.client.0.smithi052.stdout:1/558: dwrite d1/db/de/d74/d36/daa/fb5 [0,4194304] 0 2024-09-06T14:44:50.997 INFO:tasks.workunit.client.0.smithi052.stdout:2/574: stat da/db/l40 0 2024-09-06T14:44:50.999 INFO:tasks.workunit.client.0.smithi052.stdout:2/575: chown da/f2f 6176258 1 2024-09-06T14:44:51.000 INFO:tasks.workunit.client.0.smithi052.stdout:4/532: dread d9/d10/d17/d39/d3a/d64/fa3 [0,4194304] 0 2024-09-06T14:44:51.000 INFO:tasks.workunit.client.0.smithi052.stdout:9/393: getdents d1/d4/d6/dc/d38/d5a 0 2024-09-06T14:44:51.001 INFO:tasks.workunit.client.0.smithi052.stdout:5/613: creat d2/d20/d56/fd2 x:0 0 0 2024-09-06T14:44:51.001 INFO:tasks.workunit.client.0.smithi052.stdout:6/404: mknod d2/dd/d18/d33/d44/d79/c8a 0 2024-09-06T14:44:51.002 INFO:tasks.workunit.client.0.smithi052.stdout:7/507: readlink d11/d1c/d57/d89/la0 0 2024-09-06T14:44:51.003 INFO:tasks.workunit.client.0.smithi052.stdout:3/549: creat d0/d11/d71/d98/d1b/d85/faa x:0 0 0 2024-09-06T14:44:51.005 INFO:tasks.workunit.client.0.smithi052.stdout:7/508: read - d11/d1c/d57/d89/f8b zero size 2024-09-06T14:44:51.013 INFO:tasks.workunit.client.0.smithi052.stdout:1/559: dwrite d1/db/d18/fbd [0,4194304] 0 2024-09-06T14:44:51.017 INFO:tasks.workunit.client.0.smithi052.stdout:4/533: read d9/d2d/f67 [4094584,109545] 0 2024-09-06T14:44:51.017 INFO:tasks.workunit.client.0.smithi052.stdout:6/405: dwrite d2/dd/d18/d25/d6a/f83 [0,4194304] 0 2024-09-06T14:44:51.018 INFO:tasks.workunit.client.0.smithi052.stdout:9/394: mkdir d1/d4/d6/dc/d10/d73 0 2024-09-06T14:44:51.023 INFO:tasks.workunit.client.0.smithi052.stdout:4/534: readlink d9/d10/d17/d39/d3a/d5c/l82 0 2024-09-06T14:44:51.025 INFO:tasks.workunit.client.0.smithi052.stdout:5/614: dread d2/d1a/d22/f3e [4194304,4194304] 0 2024-09-06T14:44:51.025 INFO:tasks.workunit.client.0.smithi052.stdout:8/761: fsync d6/d9/d1f/d33/da8/f57 0 2024-09-06T14:44:51.029 INFO:tasks.workunit.client.0.smithi052.stdout:2/576: mkdir da/d54/dc9 0 2024-09-06T14:44:51.030 INFO:tasks.workunit.client.0.smithi052.stdout:2/577: read da/db/d18/f3c [725502,101477] 0 2024-09-06T14:44:51.030 INFO:tasks.workunit.client.0.smithi052.stdout:3/550: creat d0/d11/d12/d4c/d93/d35/d46/d5b/da0/fab x:0 0 0 2024-09-06T14:44:51.033 INFO:tasks.workunit.client.0.smithi052.stdout:1/560: write d1/db/fd [6839295,115907] 0 2024-09-06T14:44:51.034 INFO:tasks.workunit.client.0.smithi052.stdout:1/561: chown d1/db 21196303 1 2024-09-06T14:44:51.048 INFO:tasks.workunit.client.0.smithi052.stdout:5/615: write d2/d20/d42/f9d [5045404,105597] 0 2024-09-06T14:44:51.048 INFO:tasks.workunit.client.0.smithi052.stdout:2/578: mknod da/cca 0 2024-09-06T14:44:51.049 INFO:tasks.workunit.client.0.smithi052.stdout:7/509: dread d11/d1c/f1d [0,4194304] 0 2024-09-06T14:44:51.051 INFO:tasks.workunit.client.0.smithi052.stdout:3/551: creat d0/d11/d12/d4c/d93/fac x:0 0 0 2024-09-06T14:44:51.053 INFO:tasks.workunit.client.0.smithi052.stdout:2/579: dread da/db/d60/f80 [0,4194304] 0 2024-09-06T14:44:51.055 INFO:tasks.workunit.client.0.smithi052.stdout:2/580: chown da/d19/d3a/d31/d76/dc7 14 1 2024-09-06T14:44:51.055 INFO:tasks.workunit.client.0.smithi052.stdout:6/406: truncate d2/dd/d18/d25/f26 433425 0 2024-09-06T14:44:51.057 INFO:tasks.workunit.client.0.smithi052.stdout:8/762: mkdir d6/d9/d1f/d19/d10c 0 2024-09-06T14:44:51.060 INFO:tasks.workunit.client.0.smithi052.stdout:7/510: symlink d11/d1c/d3f/d5d/d88/la4 0 2024-09-06T14:44:51.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/395: rmdir d1/d4/d6/dc/d38/d5a/d70 0 2024-09-06T14:44:51.066 INFO:tasks.workunit.client.0.smithi052.stdout:3/552: truncate d0/d11/d71/d98/f55 1246197 0 2024-09-06T14:44:51.066 INFO:tasks.workunit.client.0.smithi052.stdout:4/535: dwrite d9/d10/f12 [0,4194304] 0 2024-09-06T14:44:51.074 INFO:tasks.workunit.client.0.smithi052.stdout:1/562: truncate d1/db/d72/faf 2656408 0 2024-09-06T14:44:51.074 INFO:tasks.workunit.client.0.smithi052.stdout:1/563: fdatasync d1/db/fb3 0 2024-09-06T14:44:51.075 INFO:tasks.workunit.client.0.smithi052.stdout:8/763: fsync d6/d22/d31/ffe 0 2024-09-06T14:44:51.077 INFO:tasks.workunit.client.0.smithi052.stdout:7/511: rmdir d11/d1c/d78 39 2024-09-06T14:44:51.079 INFO:tasks.workunit.client.0.smithi052.stdout:9/396: creat d1/d4/d6/dc/d10/d18/f74 x:0 0 0 2024-09-06T14:44:51.080 INFO:tasks.workunit.client.0.smithi052.stdout:4/536: symlink d9/d10/d17/d39/d3a/d64/lb7 0 2024-09-06T14:44:51.081 INFO:tasks.workunit.client.0.smithi052.stdout:9/397: write d1/d4/d6/dc/d10/d18/f74 [520497,22896] 0 2024-09-06T14:44:51.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/537: chown d9/d2d/d33/d4d/d81/cb4 134 1 2024-09-06T14:44:51.082 INFO:tasks.workunit.client.0.smithi052.stdout:6/407: mknod d2/dd/d18/d25/c8b 0 2024-09-06T14:44:51.082 INFO:tasks.workunit.client.0.smithi052.stdout:9/398: chown d1/c54 323 1 2024-09-06T14:44:51.085 INFO:tasks.workunit.client.0.smithi052.stdout:8/764: symlink d6/d22/d36/d3e/d47/d56/d68/l10d 0 2024-09-06T14:44:51.093 INFO:tasks.workunit.client.0.smithi052.stdout:2/581: link da/d19/f1c da/d19/d3a/d31/d76/dc7/fcb 0 2024-09-06T14:44:51.095 INFO:tasks.workunit.client.0.smithi052.stdout:9/399: write d1/d4/f5 [3646069,75632] 0 2024-09-06T14:44:51.097 INFO:tasks.workunit.client.0.smithi052.stdout:6/408: fdatasync d2/dd/d18/d33/f69 0 2024-09-06T14:44:51.100 INFO:tasks.workunit.client.0.smithi052.stdout:2/582: dwrite da/f57 [0,4194304] 0 2024-09-06T14:44:51.104 INFO:tasks.workunit.client.0.smithi052.stdout:8/765: creat d6/d9/d1f/d19/d6f/d72/f10e x:0 0 0 2024-09-06T14:44:51.105 INFO:tasks.workunit.client.0.smithi052.stdout:3/553: truncate d0/f1a 3142502 0 2024-09-06T14:44:51.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/400: read - d1/d4/d6/dd/d22/f40 zero size 2024-09-06T14:44:51.107 INFO:tasks.workunit.client.0.smithi052.stdout:8/766: dread - d6/d9/d1f/d19/f100 zero size 2024-09-06T14:44:51.108 INFO:tasks.workunit.client.0.smithi052.stdout:3/554: readlink d0/d11/d71/d98/d1b/l52 0 2024-09-06T14:44:51.109 INFO:tasks.workunit.client.0.smithi052.stdout:1/564: dwrite d1/db/de/d74/d14/f28 [0,4194304] 0 2024-09-06T14:44:51.111 INFO:tasks.workunit.client.0.smithi052.stdout:3/555: truncate d0/d11/f2e 5040485 0 2024-09-06T14:44:51.111 INFO:tasks.workunit.client.0.smithi052.stdout:4/538: creat d9/d10/d17/daa/db5/fb8 x:0 0 0 2024-09-06T14:44:51.113 INFO:tasks.workunit.client.0.smithi052.stdout:3/556: dread d0/d11/d71/d98/f43 [0,4194304] 0 2024-09-06T14:44:51.114 INFO:tasks.workunit.client.0.smithi052.stdout:2/583: fdatasync da/d19/d3a/d31/d76/f4d 0 2024-09-06T14:44:51.115 INFO:tasks.workunit.client.0.smithi052.stdout:7/512: link d11/d1c/d57/l6b d11/d1c/d24/d4b/da2/la5 0 2024-09-06T14:44:51.115 INFO:tasks.workunit.client.0.smithi052.stdout:3/557: dread - d0/d11/d12/d4c/d93/d35/d46/d5b/fa3 zero size 2024-09-06T14:44:51.122 INFO:tasks.workunit.client.0.smithi052.stdout:9/401: rmdir d1/d4/d6 39 2024-09-06T14:44:51.125 INFO:tasks.workunit.client.0.smithi052.stdout:8/767: creat d6/d9/d1f/d19/d6f/f10f x:0 0 0 2024-09-06T14:44:51.125 INFO:tasks.workunit.client.0.smithi052.stdout:1/565: mknod d1/db/d18/cc4 0 2024-09-06T14:44:51.126 INFO:tasks.workunit.client.0.smithi052.stdout:6/409: mkdir d2/dd/d18/d25/d8c 0 2024-09-06T14:44:51.127 INFO:tasks.workunit.client.0.smithi052.stdout:1/566: fsync d1/db/de/d74/d14/f28 0 2024-09-06T14:44:51.128 INFO:tasks.workunit.client.0.smithi052.stdout:4/539: rename d9/d2d/d84 to d9/d10/d17/daa/db5/db9 0 2024-09-06T14:44:51.129 INFO:tasks.workunit.client.0.smithi052.stdout:4/540: write d9/d10/d17/f42 [3700762,79621] 0 2024-09-06T14:44:51.132 INFO:tasks.workunit.client.0.smithi052.stdout:2/584: mknod da/db/d60/daa/ccc 0 2024-09-06T14:44:51.136 INFO:tasks.workunit.client.0.smithi052.stdout:3/558: creat d0/d11/d71/fad x:0 0 0 2024-09-06T14:44:51.138 INFO:tasks.workunit.client.0.smithi052.stdout:8/768: creat d6/d9/d1f/d19/de3/f110 x:0 0 0 2024-09-06T14:44:51.140 INFO:tasks.workunit.client.0.smithi052.stdout:4/541: dread d9/f40 [0,4194304] 0 2024-09-06T14:44:51.141 INFO:tasks.workunit.client.0.smithi052.stdout:6/410: creat d2/dd/d18/d25/d4c/d61/f8d x:0 0 0 2024-09-06T14:44:51.142 INFO:tasks.workunit.client.0.smithi052.stdout:1/567: creat d1/db/de/d74/d14/d2e/fc5 x:0 0 0 2024-09-06T14:44:51.147 INFO:tasks.workunit.client.0.smithi052.stdout:2/585: write da/d2d/f9f [1101673,68696] 0 2024-09-06T14:44:51.152 INFO:tasks.workunit.client.0.smithi052.stdout:3/559: dread d0/d11/d12/d4c/d93/f3e [0,4194304] 0 2024-09-06T14:44:51.159 INFO:tasks.workunit.client.0.smithi052.stdout:3/560: dwrite d0/d11/d71/d98/d1b/f6b [0,4194304] 0 2024-09-06T14:44:51.159 INFO:tasks.workunit.client.0.smithi052.stdout:8/769: rename d6/d9/d1f/d33/da8/d1b/d87 to d6/d22/d31/d5b/dd3/d111 0 2024-09-06T14:44:51.161 INFO:tasks.workunit.client.0.smithi052.stdout:1/568: mkdir d1/db/de/d74/d14/d2e/dc6 0 2024-09-06T14:44:51.166 INFO:tasks.workunit.client.0.smithi052.stdout:7/513: write d11/f21 [632062,14726] 0 2024-09-06T14:44:51.169 INFO:tasks.workunit.client.0.smithi052.stdout:4/542: symlink d9/lba 0 2024-09-06T14:44:51.172 INFO:tasks.workunit.client.0.smithi052.stdout:3/561: unlink d0/d11/d12/d4c/d93/d35/f8c 0 2024-09-06T14:44:51.172 INFO:tasks.workunit.client.0.smithi052.stdout:8/770: rmdir d6/d22/d36/d3e/d47/da7 39 2024-09-06T14:44:51.173 INFO:tasks.workunit.client.0.smithi052.stdout:1/569: creat d1/db/de/d74/d14/d2e/fc7 x:0 0 0 2024-09-06T14:44:51.174 INFO:tasks.workunit.client.0.smithi052.stdout:2/586: symlink da/d19/lcd 0 2024-09-06T14:44:51.175 INFO:tasks.workunit.client.0.smithi052.stdout:2/587: chown da/d54 215 1 2024-09-06T14:44:51.180 INFO:tasks.workunit.client.0.smithi052.stdout:8/771: rmdir d6/d22/d36/dec 39 2024-09-06T14:44:51.181 INFO:tasks.workunit.client.0.smithi052.stdout:2/588: chown da/db/d18/c1e 6242 1 2024-09-06T14:44:51.181 INFO:tasks.workunit.client.0.smithi052.stdout:7/514: write d11/d1c/f1f [916370,86632] 0 2024-09-06T14:44:51.183 INFO:tasks.workunit.client.0.smithi052.stdout:8/772: chown d6/d9/d1f/d14/f29 15 1 2024-09-06T14:44:51.203 INFO:tasks.workunit.client.0.smithi052.stdout:3/562: getdents d0/d89 0 2024-09-06T14:44:51.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/515: rmdir d11/d1c/d57 39 2024-09-06T14:44:51.206 INFO:tasks.workunit.client.0.smithi052.stdout:8/773: fdatasync d6/d9/d1f/d33/da8/f4e 0 2024-09-06T14:44:51.210 INFO:tasks.workunit.client.0.smithi052.stdout:1/570: creat d1/fc8 x:0 0 0 2024-09-06T14:44:51.210 INFO:tasks.workunit.client.0.smithi052.stdout:1/571: readlink d1/db/de/d74/l15 0 2024-09-06T14:44:51.211 INFO:tasks.workunit.client.0.smithi052.stdout:2/589: creat da/d19/d3a/d31/d7a/dbd/dc6/fce x:0 0 0 2024-09-06T14:44:51.212 INFO:tasks.workunit.client.0.smithi052.stdout:2/590: chown da/c4b 6 1 2024-09-06T14:44:51.217 INFO:tasks.workunit.client.0.smithi052.stdout:1/572: mkdir d1/db/d18/dc9 0 2024-09-06T14:44:51.221 INFO:tasks.workunit.client.0.smithi052.stdout:7/516: mknod d11/d1c/d3f/ca6 0 2024-09-06T14:44:51.222 INFO:tasks.workunit.client.0.smithi052.stdout:8/774: mknod d6/d9/d1f/d19/d10c/c112 0 2024-09-06T14:44:51.223 INFO:tasks.workunit.client.0.smithi052.stdout:7/517: write d11/d1c/d24/d3b/d50/f92 [466165,108893] 0 2024-09-06T14:44:51.223 INFO:tasks.workunit.client.0.smithi052.stdout:1/573: symlink d1/db/de/d74/d14/d2e/lca 0 2024-09-06T14:44:51.224 INFO:tasks.workunit.client.0.smithi052.stdout:1/574: read - d1/db/d72/f97 zero size 2024-09-06T14:44:51.225 INFO:tasks.workunit.client.0.smithi052.stdout:1/575: chown d1/fc8 50270677 1 2024-09-06T14:44:51.227 INFO:tasks.workunit.client.0.smithi052.stdout:1/576: symlink d1/d5f/lcb 0 2024-09-06T14:44:51.229 INFO:tasks.workunit.client.0.smithi052.stdout:7/518: mkdir d11/d1c/d57/da7 0 2024-09-06T14:44:51.236 INFO:tasks.workunit.client.0.smithi052.stdout:1/577: rename d1/db/de/d74/d3e to d1/db/de/d74/d14/d9f/dcc 0 2024-09-06T14:44:51.236 INFO:tasks.workunit.client.0.smithi052.stdout:7/519: mknod d11/d1c/d24/d64/ca8 0 2024-09-06T14:44:51.240 INFO:tasks.workunit.client.0.smithi052.stdout:7/520: dwrite d11/d1c/f95 [0,4194304] 0 2024-09-06T14:44:51.244 INFO:tasks.workunit.client.0.smithi052.stdout:7/521: read d11/f2c [714014,24305] 0 2024-09-06T14:44:51.245 INFO:tasks.workunit.client.0.smithi052.stdout:1/578: dread d1/db/f3f [0,4194304] 0 2024-09-06T14:44:51.246 INFO:tasks.workunit.client.0.smithi052.stdout:1/579: fdatasync d1/db/de/d74/d12/f8a 0 2024-09-06T14:44:51.249 INFO:tasks.workunit.client.0.smithi052.stdout:1/580: creat d1/db/d50/fcd x:0 0 0 2024-09-06T14:44:51.255 INFO:tasks.workunit.client.0.smithi052.stdout:3/563: write d0/d11/d12/d4c/d93/d35/f28 [890296,50849] 0 2024-09-06T14:44:51.258 INFO:tasks.workunit.client.0.smithi052.stdout:2/591: write da/d2d/f7e [4166320,71735] 0 2024-09-06T14:44:51.261 INFO:tasks.workunit.client.0.smithi052.stdout:4/543: dwrite d9/d10/f4f [0,4194304] 0 2024-09-06T14:44:51.262 INFO:tasks.workunit.client.0.smithi052.stdout:2/592: write da/d19/d3a/d31/d76/d6a/fa5 [1329307,11962] 0 2024-09-06T14:44:51.264 INFO:tasks.workunit.client.0.smithi052.stdout:3/564: mknod d0/d11/d71/d98/d9d/cae 0 2024-09-06T14:44:51.267 INFO:tasks.workunit.client.0.smithi052.stdout:2/593: creat da/d2d/d34/d66/fcf x:0 0 0 2024-09-06T14:44:51.268 INFO:tasks.workunit.client.0.smithi052.stdout:8/775: truncate d6/d9/d1f/d14/f2b 2582677 0 2024-09-06T14:44:51.269 INFO:tasks.workunit.client.0.smithi052.stdout:1/581: dread d1/db/de/d74/d12/f8a [0,4194304] 0 2024-09-06T14:44:51.270 INFO:tasks.workunit.client.0.smithi052.stdout:3/565: stat d0/d11/d12/d4c/d93/d35/d46/d5b/da0/fab 0 2024-09-06T14:44:51.276 INFO:tasks.workunit.client.0.smithi052.stdout:4/544: dwrite d9/d10/d17/d39/d3a/fb1 [0,4194304] 0 2024-09-06T14:44:51.278 INFO:tasks.workunit.client.0.smithi052.stdout:3/566: write d0/d11/d12/d4c/d93/d35/d46/d67/f94 [3594586,107092] 0 2024-09-06T14:44:51.283 INFO:tasks.workunit.client.0.smithi052.stdout:3/567: write d0/d11/d71/d98/d19/f87 [3105375,112767] 0 2024-09-06T14:44:51.286 INFO:tasks.workunit.client.0.smithi052.stdout:8/776: creat d6/d22/d36/d3e/d47/da7/f113 x:0 0 0 2024-09-06T14:44:51.286 INFO:tasks.workunit.client.0.smithi052.stdout:2/594: dwrite da/f23 [0,4194304] 0 2024-09-06T14:44:51.287 INFO:tasks.workunit.client.0.smithi052.stdout:8/777: dread - d6/d9/d1f/d19/de3/fe9 zero size 2024-09-06T14:44:51.289 INFO:tasks.workunit.client.0.smithi052.stdout:2/595: write da/d19/d3a/d31/d76/d6a/f86 [2092672,115899] 0 2024-09-06T14:44:51.290 INFO:tasks.workunit.client.0.smithi052.stdout:4/545: creat d9/d10/fbb x:0 0 0 2024-09-06T14:44:51.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/582: truncate d1/db/fd 7290407 0 2024-09-06T14:44:51.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/583: chown d1/db/d18/d6b 116580 1 2024-09-06T14:44:51.301 INFO:tasks.workunit.client.0.smithi052.stdout:4/546: write d9/d10/f9f [19869,13937] 0 2024-09-06T14:44:51.304 INFO:tasks.workunit.client.0.smithi052.stdout:1/584: symlink d1/db/de/d74/d14/lce 0 2024-09-06T14:44:51.305 INFO:tasks.workunit.client.0.smithi052.stdout:2/596: dwrite da/db/d60/db1/d70/fa6 [0,4194304] 0 2024-09-06T14:44:51.310 INFO:tasks.workunit.client.0.smithi052.stdout:4/547: unlink d9/l16 0 2024-09-06T14:44:51.311 INFO:tasks.workunit.client.0.smithi052.stdout:8/778: write d6/d22/d36/d3e/d47/f67 [312189,22033] 0 2024-09-06T14:44:51.311 INFO:tasks.workunit.client.0.smithi052.stdout:3/568: dread d0/f3 [4194304,4194304] 0 2024-09-06T14:44:51.314 INFO:tasks.workunit.client.0.smithi052.stdout:3/569: chown d0/d11/d12/d4c/d93/d35/d46/d5b/da0 170569 1 2024-09-06T14:44:51.315 INFO:tasks.workunit.client.0.smithi052.stdout:2/597: mknod da/db/d60/db1/cd0 0 2024-09-06T14:44:51.317 INFO:tasks.workunit.client.0.smithi052.stdout:3/570: write d0/d11/d12/d4c/d93/d35/d46/d5b/da0/fab [354262,56447] 0 2024-09-06T14:44:51.319 INFO:tasks.workunit.client.0.smithi052.stdout:3/571: write d0/d11/d71/d98/d19/f87 [4229977,21537] 0 2024-09-06T14:44:51.323 INFO:tasks.workunit.client.0.smithi052.stdout:8/779: mkdir d6/d16/dbf/d114 0 2024-09-06T14:44:51.329 INFO:tasks.workunit.client.0.smithi052.stdout:1/585: dread d1/db/d72/faf [0,4194304] 0 2024-09-06T14:44:51.333 INFO:tasks.workunit.client.0.smithi052.stdout:8/780: dwrite d6/fe2 [0,4194304] 0 2024-09-06T14:44:51.334 INFO:tasks.workunit.client.0.smithi052.stdout:1/586: fsync d1/db/de/d74/d14/d9f/dcc/d47/d4a/f95 0 2024-09-06T14:44:51.335 INFO:tasks.workunit.client.0.smithi052.stdout:1/587: dread - d1/fc8 zero size 2024-09-06T14:44:51.336 INFO:tasks.workunit.client.0.smithi052.stdout:8/781: truncate d6/d9/d1f/d19/f100 92980 0 2024-09-06T14:44:51.338 INFO:tasks.workunit.client.0.smithi052.stdout:3/572: write d0/d11/d12/d4c/d93/d64/f6f [4448113,33211] 0 2024-09-06T14:44:51.338 INFO:tasks.workunit.client.0.smithi052.stdout:8/782: read d6/d4c/f65 [781753,50372] 0 2024-09-06T14:44:51.339 INFO:tasks.workunit.client.0.smithi052.stdout:2/598: truncate da/db/fe 865801 0 2024-09-06T14:44:51.341 INFO:tasks.workunit.client.0.smithi052.stdout:2/599: readlink da/d19/d3a/d61/d7b/lc5 0 2024-09-06T14:44:51.343 INFO:tasks.workunit.client.0.smithi052.stdout:2/600: write da/d64/f8f [111354,97276] 0 2024-09-06T14:44:51.346 INFO:tasks.workunit.client.0.smithi052.stdout:1/588: truncate d1/db/de/d74/d12/f63 6122374 0 2024-09-06T14:44:51.348 INFO:tasks.workunit.client.0.smithi052.stdout:3/573: dwrite d0/d11/d71/d98/d1b/f6b [0,4194304] 0 2024-09-06T14:44:51.349 INFO:tasks.workunit.client.0.smithi052.stdout:8/783: creat d6/d9/d1f/d14/f115 x:0 0 0 2024-09-06T14:44:51.357 INFO:tasks.workunit.client.0.smithi052.stdout:2/601: creat da/d19/d3a/dc4/fd1 x:0 0 0 2024-09-06T14:44:51.358 INFO:tasks.workunit.client.0.smithi052.stdout:0/515: sync 2024-09-06T14:44:51.360 INFO:tasks.workunit.client.0.smithi052.stdout:3/574: mkdir d0/d11/d71/daf 0 2024-09-06T14:44:51.361 INFO:tasks.workunit.client.0.smithi052.stdout:0/516: read d0/d1a/d26/f27 [2054590,41031] 0 2024-09-06T14:44:51.364 INFO:tasks.workunit.client.0.smithi052.stdout:1/589: mkdir d1/db/de/d74/dcf 0 2024-09-06T14:44:51.368 INFO:tasks.workunit.client.0.smithi052.stdout:3/575: mknod d0/d11/d12/d4c/d93/d35/d46/d5b/cb0 0 2024-09-06T14:44:51.372 INFO:tasks.workunit.client.0.smithi052.stdout:8/784: dread d6/d9/d1f/d14/f2b [0,4194304] 0 2024-09-06T14:44:51.373 INFO:tasks.workunit.client.0.smithi052.stdout:1/590: creat d1/db/d18/fd0 x:0 0 0 2024-09-06T14:44:51.377 INFO:tasks.workunit.client.0.smithi052.stdout:0/517: dread d0/d3d/f99 [0,4194304] 0 2024-09-06T14:44:51.380 INFO:tasks.workunit.client.0.smithi052.stdout:2/602: dwrite da/db/d60/db1/d70/f85 [0,4194304] 0 2024-09-06T14:44:51.380 INFO:tasks.workunit.client.0.smithi052.stdout:0/518: chown d0/d1a/d26/d3a/d14/d20/d22 18139 1 2024-09-06T14:44:51.382 INFO:tasks.workunit.client.0.smithi052.stdout:3/576: unlink d0/d11/d12/d4c/d93/d35/f92 0 2024-09-06T14:44:51.382 INFO:tasks.workunit.client.0.smithi052.stdout:8/785: mknod d6/d16/dbf/c116 0 2024-09-06T14:44:51.382 INFO:tasks.workunit.client.0.smithi052.stdout:0/519: stat d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/l77 0 2024-09-06T14:44:51.383 INFO:tasks.workunit.client.0.smithi052.stdout:1/591: mkdir d1/db/de/d74/d14/dd1 0 2024-09-06T14:44:51.383 INFO:tasks.workunit.client.0.smithi052.stdout:8/786: chown d6/d22/d31/d5b/dd3/d111/l99 94646 1 2024-09-06T14:44:51.385 INFO:tasks.workunit.client.0.smithi052.stdout:0/520: truncate d0/f8d 4785679 0 2024-09-06T14:44:51.388 INFO:tasks.workunit.client.0.smithi052.stdout:3/577: truncate d0/d11/d12/d4c/d93/d35/f3a 3198907 0 2024-09-06T14:44:51.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/592: creat d1/d6c/d98/fd2 x:0 0 0 2024-09-06T14:44:51.395 INFO:tasks.workunit.client.0.smithi052.stdout:8/787: dwrite d6/d9/d1f/d19/d6f/d72/f86 [4194304,4194304] 0 2024-09-06T14:44:51.399 INFO:tasks.workunit.client.0.smithi052.stdout:3/578: dread d0/d11/d12/d4c/d93/f3e [0,4194304] 0 2024-09-06T14:44:51.399 INFO:tasks.workunit.client.0.smithi052.stdout:8/788: getdents d6/d22/d31/d5b/dfc 0 2024-09-06T14:44:51.400 INFO:tasks.workunit.client.0.smithi052.stdout:3/579: write d0/d8d/f9e [1025959,45250] 0 2024-09-06T14:44:51.401 INFO:tasks.workunit.client.0.smithi052.stdout:8/789: chown d6/d9/fb5 9 1 2024-09-06T14:44:51.404 INFO:tasks.workunit.client.0.smithi052.stdout:3/580: creat d0/d11/d71/d98/d1b/d85/fb1 x:0 0 0 2024-09-06T14:44:51.409 INFO:tasks.workunit.client.0.smithi052.stdout:3/581: mknod d0/d11/d12/d4c/cb2 0 2024-09-06T14:44:51.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/582: dread - d0/d11/f79 zero size 2024-09-06T14:44:51.419 INFO:tasks.workunit.client.0.smithi052.stdout:3/583: creat d0/d11/d12/d4c/d93/d35/d46/d5b/fb3 x:0 0 0 2024-09-06T14:44:51.431 INFO:tasks.workunit.client.0.smithi052.stdout:1/593: dwrite d1/db/de/d74/d14/d9f/dcc/d47/f6f [0,4194304] 0 2024-09-06T14:44:51.435 INFO:tasks.workunit.client.0.smithi052.stdout:3/584: write d0/f3 [7499069,101082] 0 2024-09-06T14:44:51.441 INFO:tasks.workunit.client.0.smithi052.stdout:8/790: dwrite d6/d22/d36/d3e/d47/d56/d68/f3f [0,4194304] 0 2024-09-06T14:44:51.443 INFO:tasks.workunit.client.0.smithi052.stdout:1/594: dwrite d1/db/de/fa0 [0,4194304] 0 2024-09-06T14:44:51.443 INFO:tasks.workunit.client.0.smithi052.stdout:3/585: truncate d0/d11/d71/d98/d1b/f76 848444 0 2024-09-06T14:44:51.447 INFO:tasks.workunit.client.0.smithi052.stdout:1/595: chown d1/db/de/d74/d12/lb2 1410379 1 2024-09-06T14:44:51.447 INFO:tasks.workunit.client.0.smithi052.stdout:3/586: write d0/d11/d71/fad [988181,24437] 0 2024-09-06T14:44:51.451 INFO:tasks.workunit.client.0.smithi052.stdout:8/791: mknod d6/d22/d36/d3e/d47/d56/d68/d69/c117 0 2024-09-06T14:44:51.452 INFO:tasks.workunit.client.0.smithi052.stdout:1/596: fdatasync d1/db/de/d74/d14/fb7 0 2024-09-06T14:44:51.457 INFO:tasks.workunit.client.0.smithi052.stdout:8/792: mknod d6/c118 0 2024-09-06T14:44:51.458 INFO:tasks.workunit.client.0.smithi052.stdout:8/793: read d6/d9/d1f/d14/f2b [1652028,38528] 0 2024-09-06T14:44:51.460 INFO:tasks.workunit.client.0.smithi052.stdout:8/794: write d6/d9/d1f/d19/ff7 [2444154,99626] 0 2024-09-06T14:44:51.461 INFO:tasks.workunit.client.0.smithi052.stdout:1/597: fsync d1/d5f/fc0 0 2024-09-06T14:44:51.462 INFO:tasks.workunit.client.0.smithi052.stdout:3/587: dwrite d0/d11/d12/d4c/d93/f80 [0,4194304] 0 2024-09-06T14:44:51.464 INFO:tasks.workunit.client.0.smithi052.stdout:8/795: symlink d6/d9/d1f/d19/dc4/l119 0 2024-09-06T14:44:51.466 INFO:tasks.workunit.client.0.smithi052.stdout:8/796: chown d6/d9/d1f/d19/c70 0 1 2024-09-06T14:44:51.468 INFO:tasks.workunit.client.0.smithi052.stdout:3/588: creat d0/d11/d71/fb4 x:0 0 0 2024-09-06T14:44:51.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/797: creat d6/d9/d1f/d33/da8/d41/d71/f11a x:0 0 0 2024-09-06T14:44:51.474 INFO:tasks.workunit.client.0.smithi052.stdout:8/798: mkdir d6/d9/d6d/d11b 0 2024-09-06T14:44:51.475 INFO:tasks.workunit.client.0.smithi052.stdout:8/799: readlink d6/d22/d36/d3e/d47/da7/lbd 0 2024-09-06T14:44:51.479 INFO:tasks.workunit.client.0.smithi052.stdout:8/800: dread d6/d9/d1f/d14/f29 [0,4194304] 0 2024-09-06T14:44:51.480 INFO:tasks.workunit.client.0.smithi052.stdout:3/589: dread d0/d11/d12/d4c/d93/d35/d46/f5e [0,4194304] 0 2024-09-06T14:44:51.480 INFO:tasks.workunit.client.0.smithi052.stdout:8/801: chown d6/d16/fd5 6 1 2024-09-06T14:44:51.485 INFO:tasks.workunit.client.0.smithi052.stdout:8/802: creat d6/d4c/f11c x:0 0 0 2024-09-06T14:44:51.485 INFO:tasks.workunit.client.0.smithi052.stdout:3/590: rmdir d0/d11/d12/d4c/d93/d35/d46/d5b 39 2024-09-06T14:44:51.485 INFO:tasks.workunit.client.0.smithi052.stdout:8/803: mkdir d6/d22/d36/d3e/d47/d56/d68/d11d 0 2024-09-06T14:44:51.486 INFO:tasks.workunit.client.0.smithi052.stdout:3/591: mkdir d0/d11/d12/d4c/d93/d35/db5 0 2024-09-06T14:44:51.488 INFO:tasks.workunit.client.0.smithi052.stdout:3/592: write d0/d11/d12/d4c/d93/d35/f28 [4433301,122793] 0 2024-09-06T14:44:51.490 INFO:tasks.workunit.client.0.smithi052.stdout:3/593: fdatasync d0/d11/d12/d4c/d93/d35/d46/d67/f94 0 2024-09-06T14:44:51.492 INFO:tasks.workunit.client.0.smithi052.stdout:8/804: truncate d6/d22/d36/d3e/d47/d56/d68/f6c 3614724 0 2024-09-06T14:44:51.496 INFO:tasks.workunit.client.0.smithi052.stdout:3/594: dwrite d0/d11/d12/d4c/d93/f80 [0,4194304] 0 2024-09-06T14:44:51.497 INFO:tasks.workunit.client.0.smithi052.stdout:8/805: rename d6/d22/d31/d5b/dd3/d111/c9c to d6/d9/d1f/dcf/de6/c11e 0 2024-09-06T14:44:51.498 INFO:tasks.workunit.client.0.smithi052.stdout:3/595: dread - d0/d11/d71/fb4 zero size 2024-09-06T14:44:51.501 INFO:tasks.workunit.client.0.smithi052.stdout:8/806: rmdir d6/d22/d36/d3e/d47/d56/d68/d69 39 2024-09-06T14:44:51.502 INFO:tasks.workunit.client.0.smithi052.stdout:3/596: mknod d0/d11/d71/d98/d19/cb6 0 2024-09-06T14:44:51.504 INFO:tasks.workunit.client.0.smithi052.stdout:8/807: creat d6/d16/dbf/d114/f11f x:0 0 0 2024-09-06T14:44:51.504 INFO:tasks.workunit.client.0.smithi052.stdout:3/597: write d0/d11/d12/d73/fa9 [589802,58126] 0 2024-09-06T14:44:51.506 INFO:tasks.workunit.client.0.smithi052.stdout:8/808: chown d6/d9/d1f/d19/c101 47 1 2024-09-06T14:44:51.510 INFO:tasks.workunit.client.0.smithi052.stdout:8/809: creat d6/d22/d31/d5b/dd3/f120 x:0 0 0 2024-09-06T14:44:51.513 INFO:tasks.workunit.client.0.smithi052.stdout:3/598: dwrite d0/d11/d12/d17/f48 [0,4194304] 0 2024-09-06T14:44:51.515 INFO:tasks.workunit.client.0.smithi052.stdout:8/810: unlink d6/d9/d1f/d33/cc7 0 2024-09-06T14:44:51.516 INFO:tasks.workunit.client.0.smithi052.stdout:8/811: fsync d6/d22/d36/fe4 0 2024-09-06T14:44:51.525 INFO:tasks.workunit.client.0.smithi052.stdout:8/812: creat d6/d9/d1f/d33/da8/d41/d71/f121 x:0 0 0 2024-09-06T14:44:51.529 INFO:tasks.workunit.client.0.smithi052.stdout:8/813: dread d6/d16/f6b [0,4194304] 0 2024-09-06T14:44:51.530 INFO:tasks.workunit.client.0.smithi052.stdout:8/814: dread - d6/d9/d1f/d33/da8/d1b/ff3 zero size 2024-09-06T14:44:51.531 INFO:tasks.workunit.client.0.smithi052.stdout:3/599: write d0/ff [1259415,64168] 0 2024-09-06T14:44:51.533 INFO:tasks.workunit.client.0.smithi052.stdout:8/815: dread d6/d9/d1f/d19/f100 [0,4194304] 0 2024-09-06T14:44:51.534 INFO:tasks.workunit.client.0.smithi052.stdout:3/600: symlink d0/d11/d71/d98/d19/lb7 0 2024-09-06T14:44:51.534 INFO:tasks.workunit.client.0.smithi052.stdout:8/816: write d6/d9/d1f/d33/da8/d1b/f2f [5011685,54211] 0 2024-09-06T14:44:51.538 INFO:tasks.workunit.client.0.smithi052.stdout:8/817: creat d6/d22/d31/f122 x:0 0 0 2024-09-06T14:44:51.542 INFO:tasks.workunit.client.0.smithi052.stdout:3/601: rename d0/d11/d71/d98/fa2 to d0/d11/d12/d4c/d93/d35/fb8 0 2024-09-06T14:44:51.545 INFO:tasks.workunit.client.0.smithi052.stdout:8/818: link d6/d9/d1f/d19/d10c/c112 d6/d22/d36/d3e/df6/c123 0 2024-09-06T14:44:51.546 INFO:tasks.workunit.client.0.smithi052.stdout:3/602: creat d0/d11/d71/d98/d1b/d85/d9f/fb9 x:0 0 0 2024-09-06T14:44:51.548 INFO:tasks.workunit.client.0.smithi052.stdout:8/819: symlink d6/d16/dbf/d114/l124 0 2024-09-06T14:44:51.563 INFO:tasks.workunit.client.0.smithi052.stdout:3/603: truncate d0/d11/d71/d98/d1b/f76 319943 0 2024-09-06T14:44:51.565 INFO:tasks.workunit.client.0.smithi052.stdout:3/604: write d0/d11/d71/d98/d1b/d85/faa [655874,130149] 0 2024-09-06T14:44:51.570 INFO:tasks.workunit.client.0.smithi052.stdout:8/820: dwrite d6/d9/d1f/d14/f53 [0,4194304] 0 2024-09-06T14:44:51.571 INFO:tasks.workunit.client.0.smithi052.stdout:3/605: dread d0/d8d/f9e [0,4194304] 0 2024-09-06T14:44:51.573 INFO:tasks.workunit.client.0.smithi052.stdout:8/821: rmdir d6/d9/d1f/d33/da8/d41 39 2024-09-06T14:44:51.575 INFO:tasks.workunit.client.0.smithi052.stdout:3/606: symlink d0/d11/d12/d4c/d93/d35/d46/lba 0 2024-09-06T14:44:51.577 INFO:tasks.workunit.client.0.smithi052.stdout:8/822: truncate d6/d16/f8c 1199924 0 2024-09-06T14:44:51.578 INFO:tasks.workunit.client.0.smithi052.stdout:8/823: write d6/d9/f2e [2364844,100146] 0 2024-09-06T14:44:51.580 INFO:tasks.workunit.client.0.smithi052.stdout:3/607: write d0/d8d/f9e [1185246,98579] 0 2024-09-06T14:44:51.582 INFO:tasks.workunit.client.0.smithi052.stdout:3/608: chown d0/d11/d12/d4c/d93/d35/f28 2763540 1 2024-09-06T14:44:51.583 INFO:tasks.workunit.client.0.smithi052.stdout:3/609: readlink d0/d11/d71/d98/d1b/l39 0 2024-09-06T14:44:51.583 INFO:tasks.workunit.client.0.smithi052.stdout:8/824: rename d6/d22/d31/d5b/dd3/d111/fe7 to d6/d22/d31/d5b/dd3/f125 0 2024-09-06T14:44:51.590 INFO:tasks.workunit.client.0.smithi052.stdout:3/610: dwrite d0/d11/d12/d73/fa9 [0,4194304] 0 2024-09-06T14:44:51.597 INFO:tasks.workunit.client.0.smithi052.stdout:8/825: mkdir d6/d9/d1f/d33/da8/d1b/d126 0 2024-09-06T14:44:51.604 INFO:tasks.workunit.client.0.smithi052.stdout:8/826: unlink d6/d22/dd1/cfd 0 2024-09-06T14:44:51.606 INFO:tasks.workunit.client.0.smithi052.stdout:3/611: mkdir d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb 0 2024-09-06T14:44:51.607 INFO:tasks.workunit.client.0.smithi052.stdout:3/612: truncate d0/d11/d12/f83 352271 0 2024-09-06T14:44:51.608 INFO:tasks.workunit.client.0.smithi052.stdout:3/613: dread - d0/d11/d12/d17/fa7 zero size 2024-09-06T14:44:51.609 INFO:tasks.workunit.client.0.smithi052.stdout:8/827: chown d6/d9/d1f/dcf/cc1 0 1 2024-09-06T14:44:51.611 INFO:tasks.workunit.client.0.smithi052.stdout:3/614: symlink d0/d11/d71/d98/d1b/d85/d9f/lbc 0 2024-09-06T14:44:51.612 INFO:tasks.workunit.client.0.smithi052.stdout:8/828: mknod d6/d9/d1f/dcf/de6/c127 0 2024-09-06T14:44:51.613 INFO:tasks.workunit.client.0.smithi052.stdout:3/615: write d0/d11/d12/d4c/d93/d35/d46/d5b/fb3 [731367,33794] 0 2024-09-06T14:44:51.615 INFO:tasks.workunit.client.0.smithi052.stdout:8/829: stat d6/d9/d1f/d33/da8/d41/fac 0 2024-09-06T14:44:51.616 INFO:tasks.workunit.client.0.smithi052.stdout:3/616: creat d0/d11/d12/d17/fbd x:0 0 0 2024-09-06T14:44:51.617 INFO:tasks.workunit.client.0.smithi052.stdout:8/830: mkdir d6/d22/d31/d128 0 2024-09-06T14:44:51.619 INFO:tasks.workunit.client.0.smithi052.stdout:3/617: rename d0/d11/d12/c58 to d0/d11/d12/d17/cbe 0 2024-09-06T14:44:51.620 INFO:tasks.workunit.client.0.smithi052.stdout:3/618: readlink d0/d11/d12/d4c/d93/d35/d46/lba 0 2024-09-06T14:44:51.621 INFO:tasks.workunit.client.0.smithi052.stdout:3/619: fsync d0/d11/d12/d73/fa9 0 2024-09-06T14:44:51.621 INFO:tasks.workunit.client.0.smithi052.stdout:8/831: creat d6/d22/d36/d3e/d47/d56/d68/d11d/f129 x:0 0 0 2024-09-06T14:44:51.622 INFO:tasks.workunit.client.0.smithi052.stdout:3/620: chown d0/d11/d71/d98/d19/f87 311775 1 2024-09-06T14:44:51.623 INFO:tasks.workunit.client.0.smithi052.stdout:8/832: read - d6/d22/d31/d5b/dd3/d111/fba zero size 2024-09-06T14:44:51.623 INFO:tasks.workunit.client.0.smithi052.stdout:3/621: write d0/d8d/f9e [389577,29256] 0 2024-09-06T14:44:51.709 INFO:tasks.workunit.client.0.smithi052.stdout:3/622: mknod d0/d11/d71/d98/cbf 0 2024-09-06T14:44:51.711 INFO:tasks.workunit.client.0.smithi052.stdout:8/833: mkdir d6/df4/d12a 0 2024-09-06T14:44:51.715 INFO:tasks.workunit.client.0.smithi052.stdout:3/623: rename d0/d11/d71/d98/d1b/d85/d9f/fb9 to d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/fc0 0 2024-09-06T14:44:51.716 INFO:tasks.workunit.client.0.smithi052.stdout:3/624: fdatasync d0/d11/d12/d17/fa7 0 2024-09-06T14:44:51.717 INFO:tasks.workunit.client.0.smithi052.stdout:8/834: dread d6/d22/d31/f55 [0,4194304] 0 2024-09-06T14:44:51.724 INFO:tasks.workunit.client.0.smithi052.stdout:8/835: mkdir d6/d9/d1f/d33/da8/d1b/d126/d12b 0 2024-09-06T14:44:51.728 INFO:tasks.workunit.client.0.smithi052.stdout:3/625: dread d0/d11/d12/d73/f78 [0,4194304] 0 2024-09-06T14:44:51.728 INFO:tasks.workunit.client.0.smithi052.stdout:8/836: mkdir d6/d22/d36/d12c 0 2024-09-06T14:44:51.729 INFO:tasks.workunit.client.0.smithi052.stdout:8/837: chown d6/d9/cd 17912687 1 2024-09-06T14:44:51.736 INFO:tasks.workunit.client.0.smithi052.stdout:8/838: creat d6/d22/d36/d3e/d47/da7/f12d x:0 0 0 2024-09-06T14:44:51.737 INFO:tasks.workunit.client.0.smithi052.stdout:3/626: unlink d0/d11/d12/d4c/d93/c7c 0 2024-09-06T14:44:51.741 INFO:tasks.workunit.client.0.smithi052.stdout:8/839: rename d6/d9/d1f/cea to d6/d22/d36/d12c/c12e 0 2024-09-06T14:44:51.753 INFO:tasks.workunit.client.0.smithi052.stdout:8/840: dread d6/d9/d1f/d33/da8/d41/d71/f81 [0,4194304] 0 2024-09-06T14:44:51.762 INFO:tasks.workunit.client.0.smithi052.stdout:8/841: rename d6/d9/l92 to d6/d9/d1f/d19/d6f/l12f 0 2024-09-06T14:44:51.763 INFO:tasks.workunit.client.0.smithi052.stdout:8/842: fsync d6/d22/d31/d5b/dd3/d111/fba 0 2024-09-06T14:44:51.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/843: link d6/d9/f18 d6/d9/d1f/d14/da0/f130 0 2024-09-06T14:44:51.769 INFO:tasks.workunit.client.0.smithi052.stdout:8/844: stat d6/d4c/f11c 0 2024-09-06T14:44:51.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/845: chown d6/d9/d1f/d19/la4 668559 1 2024-09-06T14:44:51.772 INFO:tasks.workunit.client.0.smithi052.stdout:8/846: write d6/d9/d1f/d14/fe0 [866011,113531] 0 2024-09-06T14:44:51.774 INFO:tasks.workunit.client.0.smithi052.stdout:8/847: truncate d6/d22/d36/fe4 13764 0 2024-09-06T14:44:51.775 INFO:tasks.workunit.client.0.smithi052.stdout:8/848: dread - d6/d9/d1f/d33/da8/d41/d71/f11a zero size 2024-09-06T14:44:51.832 INFO:tasks.workunit.client.0.smithi052.stdout:8/849: creat d6/d22/d31/d5b/dd3/f131 x:0 0 0 2024-09-06T14:44:51.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/627: write d0/d11/d71/d98/f4e [1415034,98555] 0 2024-09-06T14:44:51.849 INFO:tasks.workunit.client.0.smithi052.stdout:3/628: chown d0/d11/d71/d98/d9d/cae 108 1 2024-09-06T14:44:51.852 INFO:tasks.workunit.client.0.smithi052.stdout:3/629: unlink d0/d11/d71/d98/d1b/f6b 0 2024-09-06T14:44:51.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/630: dwrite d0/d11/d71/d98/d19/f2c [0,4194304] 0 2024-09-06T14:44:51.959 INFO:tasks.workunit.client.0.smithi052.stdout:3/631: read d0/d11/d12/d4c/f57 [1725731,77856] 0 2024-09-06T14:44:51.963 INFO:tasks.workunit.client.0.smithi052.stdout:3/632: getdents d0/d89 0 2024-09-06T14:44:51.967 INFO:tasks.workunit.client.0.smithi052.stdout:3/633: symlink d0/d11/d12/d4c/d93/d35/lc1 0 2024-09-06T14:44:51.971 INFO:tasks.workunit.client.0.smithi052.stdout:3/634: symlink d0/d11/d12/d73/lc2 0 2024-09-06T14:44:51.976 INFO:tasks.workunit.client.0.smithi052.stdout:3/635: rename d0/d11/d12/d73/f78 to d0/d11/d12/d4c/d93/d35/d46/d5b/da0/da6/fc3 0 2024-09-06T14:44:51.976 INFO:tasks.workunit.client.0.smithi052.stdout:3/636: readlink d0/d11/d12/l14 0 2024-09-06T14:44:51.980 INFO:tasks.workunit.client.0.smithi052.stdout:3/637: rename d0/d11/d12/d4c/d93/d64/f6f to d0/d11/d71/d98/d9d/fc4 0 2024-09-06T14:44:51.983 INFO:tasks.workunit.client.0.smithi052.stdout:3/638: mkdir d0/d11/d71/d98/d1b/d85/dc5 0 2024-09-06T14:44:51.997 INFO:tasks.workunit.client.0.smithi052.stdout:8/850: rmdir d6/d9/d1f/d33/da8/d1b 39 2024-09-06T14:44:51.999 INFO:tasks.workunit.client.0.smithi052.stdout:8/851: symlink d6/d9/d1f/d19/dc4/l132 0 2024-09-06T14:44:52.002 INFO:tasks.workunit.client.0.smithi052.stdout:8/852: unlink d6/d16/dbf/cf9 0 2024-09-06T14:44:52.003 INFO:tasks.workunit.client.0.smithi052.stdout:8/853: chown d6/d22/d36/d3e/d47/d56/d68/f107 921589 1 2024-09-06T14:44:52.005 INFO:tasks.workunit.client.0.smithi052.stdout:8/854: symlink d6/d22/d36/d3e/l133 0 2024-09-06T14:44:52.007 INFO:tasks.workunit.client.0.smithi052.stdout:8/855: mkdir d6/d22/d36/d3e/d47/da7/d134 0 2024-09-06T14:44:52.014 INFO:tasks.workunit.client.0.smithi052.stdout:8/856: dwrite d6/d9/d1f/d33/da8/d1b/f2f [0,4194304] 0 2024-09-06T14:44:52.022 INFO:tasks.workunit.client.0.smithi052.stdout:8/857: dwrite d6/d9/f2e [0,4194304] 0 2024-09-06T14:44:52.025 INFO:tasks.workunit.client.0.smithi052.stdout:8/858: read d6/d9/d1f/d19/ff7 [2322278,61288] 0 2024-09-06T14:44:52.026 INFO:tasks.workunit.client.0.smithi052.stdout:8/859: fdatasync d6/d22/d36/fe4 0 2024-09-06T14:44:52.032 INFO:tasks.workunit.client.0.smithi052.stdout:3/639: write d0/d11/d12/d17/f72 [189322,71995] 0 2024-09-06T14:44:52.032 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:51 smithi052 ceph-mon[28627]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 52 MiB/s rd, 152 MiB/s wr, 327 op/s 2024-09-06T14:44:52.034 INFO:tasks.workunit.client.0.smithi052.stdout:3/640: chown d0/d11/d12/d4c/d93/d35/d46/d5b/fa3 2072909090 1 2024-09-06T14:44:52.038 INFO:tasks.workunit.client.0.smithi052.stdout:3/641: creat d0/d11/d71/d98/d19/fc6 x:0 0 0 2024-09-06T14:44:52.042 INFO:tasks.workunit.client.0.smithi052.stdout:3/642: mknod d0/d11/d71/daf/cc7 0 2024-09-06T14:44:52.045 INFO:tasks.workunit.client.0.smithi052.stdout:8/860: link d6/d22/d31/d5b/dd3/f131 d6/d9/d1f/d33/f135 0 2024-09-06T14:44:52.050 INFO:tasks.workunit.client.0.smithi052.stdout:3/643: getdents d0/d11/d12/d17/d7b 0 2024-09-06T14:44:52.052 INFO:tasks.workunit.client.0.smithi052.stdout:8/861: dwrite d6/d4c/fc8 [0,4194304] 0 2024-09-06T14:44:52.053 INFO:tasks.workunit.client.0.smithi052.stdout:8/862: chown d6/d22/d36/c44 343 1 2024-09-06T14:44:52.054 INFO:tasks.workunit.client.0.smithi052.stdout:3/644: mknod d0/d11/d71/d98/d1b/d85/d9f/cc8 0 2024-09-06T14:44:52.055 INFO:tasks.workunit.client.0.smithi052.stdout:3/645: readlink d0/d11/d12/l14 0 2024-09-06T14:44:52.066 INFO:tasks.workunit.client.0.smithi052.stdout:8/863: rename d6/d9/d1f/d33/fcc to d6/d22/d36/d3e/d47/d56/f136 0 2024-09-06T14:44:52.073 INFO:tasks.workunit.client.0.smithi052.stdout:3/646: link d0/d11/l74 d0/d11/d12/d4c/d93/d35/lc9 0 2024-09-06T14:44:52.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:51 smithi165 ceph-mon[36229]: pgmap v28: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 52 MiB/s rd, 152 MiB/s wr, 327 op/s 2024-09-06T14:44:52.074 INFO:tasks.workunit.client.0.smithi052.stdout:8/864: creat d6/d22/d31/d128/f137 x:0 0 0 2024-09-06T14:44:52.074 INFO:tasks.workunit.client.0.smithi052.stdout:3/647: read d0/d11/d12/d4c/d93/d35/d46/d67/f94 [693367,62999] 0 2024-09-06T14:44:52.077 INFO:tasks.workunit.client.0.smithi052.stdout:8/865: creat d6/d16/dbf/f138 x:0 0 0 2024-09-06T14:44:52.080 INFO:tasks.workunit.client.0.smithi052.stdout:3/648: symlink d0/d11/d12/d4c/d93/d35/d46/lca 0 2024-09-06T14:44:52.081 INFO:tasks.workunit.client.0.smithi052.stdout:8/866: dread d6/d9/fc9 [0,4194304] 0 2024-09-06T14:44:52.083 INFO:tasks.workunit.client.0.smithi052.stdout:8/867: unlink d6/d9/ca 0 2024-09-06T14:44:52.291 INFO:tasks.workunit.client.0.smithi052.stdout:6/411: sync 2024-09-06T14:44:52.291 INFO:tasks.workunit.client.0.smithi052.stdout:9/402: sync 2024-09-06T14:44:52.291 INFO:tasks.workunit.client.0.smithi052.stdout:5/616: sync 2024-09-06T14:44:52.293 INFO:tasks.workunit.client.0.smithi052.stdout:5/617: write d2/d20/d42/f5f [1561948,35310] 0 2024-09-06T14:44:52.293 INFO:tasks.workunit.client.0.smithi052.stdout:6/412: write d2/dd/d18/d25/d4c/d61/f8d [55293,58826] 0 2024-09-06T14:44:52.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/403: stat d1/d4/d6/dc/l3b 0 2024-09-06T14:44:52.296 INFO:tasks.workunit.client.0.smithi052.stdout:5/618: truncate d2/d1a/d22/f3e 9220089 0 2024-09-06T14:44:52.300 INFO:tasks.workunit.client.0.smithi052.stdout:6/413: rename d2/la to d2/dd/l8e 0 2024-09-06T14:44:52.301 INFO:tasks.workunit.client.0.smithi052.stdout:9/404: dwrite d1/d4/f5e [0,4194304] 0 2024-09-06T14:44:52.302 INFO:tasks.workunit.client.0.smithi052.stdout:5/619: write d2/d1a/d22/d26/d2b/d48/f8d [3170733,88971] 0 2024-09-06T14:44:52.304 INFO:tasks.workunit.client.0.smithi052.stdout:5/620: truncate d2/d1a/fba 443371 0 2024-09-06T14:44:52.307 INFO:tasks.workunit.client.0.smithi052.stdout:6/414: dread d2/dd/d18/f22 [4194304,4194304] 0 2024-09-06T14:44:52.309 INFO:tasks.workunit.client.0.smithi052.stdout:9/405: link d1/d4/c36 d1/d26/c75 0 2024-09-06T14:44:52.313 INFO:tasks.workunit.client.0.smithi052.stdout:9/406: creat d1/d4/d6/dc/d10/d18/f76 x:0 0 0 2024-09-06T14:44:52.319 INFO:tasks.workunit.client.0.smithi052.stdout:6/415: dread d2/dd/d18/f31 [0,4194304] 0 2024-09-06T14:44:52.319 INFO:tasks.workunit.client.0.smithi052.stdout:9/407: link d1/f37 d1/d4/d6/dd/f77 0 2024-09-06T14:44:52.321 INFO:tasks.workunit.client.0.smithi052.stdout:9/408: write d1/f37 [3011630,122747] 0 2024-09-06T14:44:52.322 INFO:tasks.workunit.client.0.smithi052.stdout:6/416: fdatasync d2/dd/d18/d2d/d32/f3f 0 2024-09-06T14:44:52.323 INFO:tasks.workunit.client.0.smithi052.stdout:9/409: mknod d1/d26/d3d/c78 0 2024-09-06T14:44:52.327 INFO:tasks.workunit.client.0.smithi052.stdout:6/417: dread d2/dd/d18/d33/d44/d47/f80 [0,4194304] 0 2024-09-06T14:44:52.333 INFO:tasks.workunit.client.0.smithi052.stdout:6/418: symlink d2/dd/d18/d25/l8f 0 2024-09-06T14:44:52.338 INFO:tasks.workunit.client.0.smithi052.stdout:9/410: mkdir d1/d4/d6/dd/d22/d6a/d79 0 2024-09-06T14:44:52.339 INFO:tasks.workunit.client.0.smithi052.stdout:9/411: stat d1/d4/f5e 0 2024-09-06T14:44:52.339 INFO:tasks.workunit.client.0.smithi052.stdout:6/419: dwrite d2/dd/d18/f88 [0,4194304] 0 2024-09-06T14:44:52.346 INFO:tasks.workunit.client.0.smithi052.stdout:9/412: mkdir d1/d4/d6/dc/d7a 0 2024-09-06T14:44:52.350 INFO:tasks.workunit.client.0.smithi052.stdout:6/420: rmdir d2/dd/d18/d2d/d71/d89 0 2024-09-06T14:44:52.351 INFO:tasks.workunit.client.0.smithi052.stdout:6/421: fsync d2/dd/d18/d2d/d32/f55 0 2024-09-06T14:44:52.352 INFO:tasks.workunit.client.0.smithi052.stdout:9/413: rename d1/d4/df/c3f to d1/d4/d6/dd/d2b/c7b 0 2024-09-06T14:44:52.355 INFO:tasks.workunit.client.0.smithi052.stdout:6/422: creat d2/dd/d18/d33/f90 x:0 0 0 2024-09-06T14:44:52.355 INFO:tasks.workunit.client.0.smithi052.stdout:9/414: fdatasync d1/d4/d6/dd/f48 0 2024-09-06T14:44:52.358 INFO:tasks.workunit.client.0.smithi052.stdout:9/415: creat d1/d4/df/d56/f7c x:0 0 0 2024-09-06T14:44:52.363 INFO:tasks.workunit.client.0.smithi052.stdout:9/416: truncate d1/d26/f4c 2010394 0 2024-09-06T14:44:52.365 INFO:tasks.workunit.client.0.smithi052.stdout:9/417: write d1/d4/d6/dd/f5f [707423,45684] 0 2024-09-06T14:44:52.366 INFO:tasks.workunit.client.0.smithi052.stdout:9/418: write d1/f30 [3376947,5787] 0 2024-09-06T14:44:52.367 INFO:tasks.workunit.client.0.smithi052.stdout:9/419: readlink d1/d4/d6/dc/d38/l44 0 2024-09-06T14:44:52.373 INFO:tasks.workunit.client.0.smithi052.stdout:6/423: dwrite d2/d4a/f73 [0,4194304] 0 2024-09-06T14:44:52.391 INFO:tasks.workunit.client.0.smithi052.stdout:6/424: dwrite d2/dd/d18/f2b [0,4194304] 0 2024-09-06T14:44:52.398 INFO:tasks.workunit.client.0.smithi052.stdout:6/425: rename d2/dd/d18/d33/d44/d79/c82 to d2/d4a/c91 0 2024-09-06T14:44:52.400 INFO:tasks.workunit.client.0.smithi052.stdout:6/426: read d2/dd/d18/d33/d44/d47/f80 [232324,75812] 0 2024-09-06T14:44:52.403 INFO:tasks.workunit.client.0.smithi052.stdout:6/427: unlink d2/d4a/f73 0 2024-09-06T14:44:52.410 INFO:tasks.workunit.client.0.smithi052.stdout:6/428: dwrite d2/dd/d18/f6d [0,4194304] 0 2024-09-06T14:44:52.415 INFO:tasks.workunit.client.0.smithi052.stdout:6/429: mknod d2/dd/d18/d33/c92 0 2024-09-06T14:44:52.419 INFO:tasks.workunit.client.0.smithi052.stdout:6/430: truncate d2/dd/d18/f51 343208 0 2024-09-06T14:44:52.423 INFO:tasks.workunit.client.0.smithi052.stdout:6/431: rename d2/dd/d18/d2d/l5c to d2/dd/d18/d33/l93 0 2024-09-06T14:44:52.431 INFO:tasks.workunit.client.0.smithi052.stdout:6/432: dread d2/dd/d18/d25/f3e [0,4194304] 0 2024-09-06T14:44:52.445 INFO:tasks.workunit.client.0.smithi052.stdout:6/433: dread d2/dd/d18/d2d/f46 [0,4194304] 0 2024-09-06T14:44:52.461 INFO:tasks.workunit.client.0.smithi052.stdout:6/434: dwrite d2/dd/f2f [4194304,4194304] 0 2024-09-06T14:44:52.462 INFO:tasks.workunit.client.0.smithi052.stdout:6/435: readlink d2/dd/d18/d2d/d32/l67 0 2024-09-06T14:44:52.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/436: read d2/f30 [6656642,68335] 0 2024-09-06T14:44:52.466 INFO:tasks.workunit.client.0.smithi052.stdout:6/437: write d2/dd/d18/d4b/f53 [3984341,564] 0 2024-09-06T14:44:52.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/438: creat d2/dd/d18/d4b/f94 x:0 0 0 2024-09-06T14:44:52.472 INFO:tasks.workunit.client.0.smithi052.stdout:7/522: sync 2024-09-06T14:44:52.477 INFO:tasks.workunit.client.0.smithi052.stdout:6/439: link d2/dd/d18/d25/c68 d2/d4a/d6e/c95 0 2024-09-06T14:44:52.479 INFO:tasks.workunit.client.0.smithi052.stdout:7/523: getdents d11/d1c/d26 0 2024-09-06T14:44:52.481 INFO:tasks.workunit.client.0.smithi052.stdout:6/440: read d2/f3b [2382005,114455] 0 2024-09-06T14:44:52.481 INFO:tasks.workunit.client.0.smithi052.stdout:6/441: stat d2/dd/d18/d25/d4c/l59 0 2024-09-06T14:44:52.483 INFO:tasks.workunit.client.0.smithi052.stdout:6/442: creat d2/dd/d18/d2d/d32/f96 x:0 0 0 2024-09-06T14:44:52.484 INFO:tasks.workunit.client.0.smithi052.stdout:7/524: creat d11/d1c/fa9 x:0 0 0 2024-09-06T14:44:52.484 INFO:tasks.workunit.client.0.smithi052.stdout:6/443: chown d2/dd/d18/d33/f50 200947668 1 2024-09-06T14:44:52.487 INFO:tasks.workunit.client.0.smithi052.stdout:7/525: symlink d11/d1c/d57/da7/laa 0 2024-09-06T14:44:52.492 INFO:tasks.workunit.client.0.smithi052.stdout:7/526: creat d11/d1c/d24/d3b/d50/fab x:0 0 0 2024-09-06T14:44:52.496 INFO:tasks.workunit.client.0.smithi052.stdout:7/527: creat d11/d1c/d3f/d73/fac x:0 0 0 2024-09-06T14:44:52.499 INFO:tasks.workunit.client.0.smithi052.stdout:7/528: chown d11/d1c/c80 42757151 1 2024-09-06T14:44:52.506 INFO:tasks.workunit.client.0.smithi052.stdout:6/444: dwrite d2/dd/d18/d2d/d32/f3f [0,4194304] 0 2024-09-06T14:44:52.513 INFO:tasks.workunit.client.0.smithi052.stdout:6/445: dread d2/dd/d18/f51 [0,4194304] 0 2024-09-06T14:44:52.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/529: dwrite d11/d1c/d24/f2d [0,4194304] 0 2024-09-06T14:44:52.518 INFO:tasks.workunit.client.0.smithi052.stdout:6/446: creat d2/dd/d18/d25/d4c/d61/f97 x:0 0 0 2024-09-06T14:44:52.522 INFO:tasks.workunit.client.0.smithi052.stdout:7/530: truncate d11/d1c/d57/d89/f8b 614752 0 2024-09-06T14:44:52.523 INFO:tasks.workunit.client.0.smithi052.stdout:6/447: link d2/dd/d5e/l64 d2/dd/l98 0 2024-09-06T14:44:52.523 INFO:tasks.workunit.client.0.smithi052.stdout:7/531: chown d11/d1c/d24/d3b/d50/c55 45899635 1 2024-09-06T14:44:52.525 INFO:tasks.workunit.client.0.smithi052.stdout:7/532: rmdir d11/d1c/d57/da7 39 2024-09-06T14:44:52.528 INFO:tasks.workunit.client.0.smithi052.stdout:7/533: symlink d11/d1c/lad 0 2024-09-06T14:44:52.530 INFO:tasks.workunit.client.0.smithi052.stdout:7/534: readlink d11/d1c/d24/d4b/l96 0 2024-09-06T14:44:52.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/535: write d11/d1c/d24/d3b/d50/f92 [27087,41567] 0 2024-09-06T14:44:52.539 INFO:tasks.workunit.client.0.smithi052.stdout:6/448: write d2/dd/d18/d2d/d32/f40 [1836529,15646] 0 2024-09-06T14:44:52.541 INFO:tasks.workunit.client.0.smithi052.stdout:7/536: write d11/d1c/d3f/d5d/f69 [399979,9498] 0 2024-09-06T14:44:52.542 INFO:tasks.workunit.client.0.smithi052.stdout:6/449: getdents d2/d4a/d6e/d76 0 2024-09-06T14:44:52.544 INFO:tasks.workunit.client.0.smithi052.stdout:7/537: mkdir d11/d1c/d3f/d73/dae 0 2024-09-06T14:44:52.545 INFO:tasks.workunit.client.0.smithi052.stdout:6/450: mknod d2/dd/d18/c99 0 2024-09-06T14:44:52.546 INFO:tasks.workunit.client.0.smithi052.stdout:7/538: creat d11/d1c/d24/d64/faf x:0 0 0 2024-09-06T14:44:52.548 INFO:tasks.workunit.client.0.smithi052.stdout:7/539: chown d11/d1c/d78/d98 104625020 1 2024-09-06T14:44:52.548 INFO:tasks.workunit.client.0.smithi052.stdout:7/540: stat d11/f49 0 2024-09-06T14:44:52.550 INFO:tasks.workunit.client.0.smithi052.stdout:6/451: rename d2/dd/d18/d25/f26 to d2/dd/d18/d2d/d32/f9a 0 2024-09-06T14:44:52.561 INFO:tasks.workunit.client.0.smithi052.stdout:6/452: rmdir d2/dd/d18/d25/d8c 0 2024-09-06T14:44:52.562 INFO:tasks.workunit.client.0.smithi052.stdout:7/541: truncate d11/f43 2188205 0 2024-09-06T14:44:52.564 INFO:tasks.workunit.client.0.smithi052.stdout:6/453: rmdir d2/dd/d18/d33/d44/d47 39 2024-09-06T14:44:52.564 INFO:tasks.workunit.client.0.smithi052.stdout:6/454: fsync d2/dd/d18/d25/f87 0 2024-09-06T14:44:52.565 INFO:tasks.workunit.client.0.smithi052.stdout:7/542: unlink d11/d1c/d24/d3b/l4f 0 2024-09-06T14:44:52.565 INFO:tasks.workunit.client.0.smithi052.stdout:7/543: readlink d11/d1c/d26/l30 0 2024-09-06T14:44:52.566 INFO:tasks.workunit.client.0.smithi052.stdout:7/544: chown d11/d1c/d24/d64/l66 1 1 2024-09-06T14:44:52.567 INFO:tasks.workunit.client.0.smithi052.stdout:6/455: rmdir d2/dd/d18/d25 39 2024-09-06T14:44:52.569 INFO:tasks.workunit.client.0.smithi052.stdout:6/456: unlink d2/dd/d18/d2d/d32/f96 0 2024-09-06T14:44:52.571 INFO:tasks.workunit.client.0.smithi052.stdout:7/545: getdents d11/d1c/d24/d4b 0 2024-09-06T14:44:52.571 INFO:tasks.workunit.client.0.smithi052.stdout:6/457: rmdir d2/dd/d18/d33/d44 39 2024-09-06T14:44:52.573 INFO:tasks.workunit.client.0.smithi052.stdout:6/458: symlink d2/dd/d18/d2d/l9b 0 2024-09-06T14:44:52.576 INFO:tasks.workunit.client.0.smithi052.stdout:6/459: chown d2/dd/d18/d25/l60 4174119 1 2024-09-06T14:44:52.577 INFO:tasks.workunit.client.0.smithi052.stdout:6/460: rmdir d2/dd/d18/d33 39 2024-09-06T14:44:52.583 INFO:tasks.workunit.client.0.smithi052.stdout:6/461: rename d2/dd/d18/d2d/f38 to d2/dd/d18/d33/d44/d79/f9c 0 2024-09-06T14:44:53.197 INFO:tasks.workunit.client.0.smithi052.stdout:4/548: sync 2024-09-06T14:44:53.198 INFO:tasks.workunit.client.0.smithi052.stdout:4/549: read d9/d10/d17/d39/f93 [183165,25574] 0 2024-09-06T14:44:53.387 INFO:tasks.workunit.client.0.smithi052.stdout:2/603: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:0/521: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:1/598: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:8/868: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:7/546: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:5/621: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:9/420: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:3/649: sync 2024-09-06T14:44:53.388 INFO:tasks.workunit.client.0.smithi052.stdout:6/462: sync 2024-09-06T14:44:53.389 INFO:tasks.workunit.client.0.smithi052.stdout:3/650: readlink d0/d11/d12/l77 0 2024-09-06T14:44:53.391 INFO:tasks.workunit.client.0.smithi052.stdout:1/599: write d1/db/de/d74/d14/d2e/fc7 [455802,103587] 0 2024-09-06T14:44:53.391 INFO:tasks.workunit.client.0.smithi052.stdout:6/463: write d2/dd/d18/d4b/f94 [217085,15249] 0 2024-09-06T14:44:53.392 INFO:tasks.workunit.client.0.smithi052.stdout:6/464: write d2/dd/d18/d4b/f53 [3751038,55343] 0 2024-09-06T14:44:53.393 INFO:tasks.workunit.client.0.smithi052.stdout:8/869: symlink d6/d9/d1f/d19/de3/l139 0 2024-09-06T14:44:53.394 INFO:tasks.workunit.client.0.smithi052.stdout:8/870: dread - d6/d22/d36/d3e/d47/da7/f113 zero size 2024-09-06T14:44:53.443 INFO:tasks.workunit.client.0.smithi052.stdout:5/622: creat d2/d20/d42/d8b/fd3 x:0 0 0 2024-09-06T14:44:53.443 INFO:tasks.workunit.client.0.smithi052.stdout:9/421: rmdir d1/d4/d6/dc/d45 39 2024-09-06T14:44:53.444 INFO:tasks.workunit.client.0.smithi052.stdout:7/547: mknod d11/d1c/d3f/d5d/d88/cb0 0 2024-09-06T14:44:53.444 INFO:tasks.workunit.client.0.smithi052.stdout:1/600: mkdir d1/db/de/d74/d12/dd3 0 2024-09-06T14:44:53.445 INFO:tasks.workunit.client.0.smithi052.stdout:0/522: symlink d0/d1a/d26/d3a/d14/d20/lb6 0 2024-09-06T14:44:53.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/601: readlink d1/l11 0 2024-09-06T14:44:53.445 INFO:tasks.workunit.client.0.smithi052.stdout:6/465: mkdir d2/dd/d9d 0 2024-09-06T14:44:53.448 INFO:tasks.workunit.client.0.smithi052.stdout:9/422: fdatasync d1/f23 0 2024-09-06T14:44:53.450 INFO:tasks.workunit.client.0.smithi052.stdout:8/871: read d6/d16/f8c [731273,48790] 0 2024-09-06T14:44:53.450 INFO:tasks.workunit.client.0.smithi052.stdout:9/423: chown d1/c54 46 1 2024-09-06T14:44:53.453 INFO:tasks.workunit.client.0.smithi052.stdout:8/872: chown d6/d4c/f109 760 1 2024-09-06T14:44:53.453 INFO:tasks.workunit.client.0.smithi052.stdout:0/523: mkdir d0/d1a/d26/db7 0 2024-09-06T14:44:53.455 INFO:tasks.workunit.client.0.smithi052.stdout:2/604: dwrite da/d19/d3a/d31/d76/d6a/f9c [4194304,4194304] 0 2024-09-06T14:44:53.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/605: stat da/d4f/l52 0 2024-09-06T14:44:53.456 INFO:tasks.workunit.client.0.smithi052.stdout:6/466: dwrite d2/dd/f2f [0,4194304] 0 2024-09-06T14:44:53.457 INFO:tasks.workunit.client.0.smithi052.stdout:5/623: rename d2/d1a/d22/d26/fb6 to d2/d20/fd4 0 2024-09-06T14:44:53.459 INFO:tasks.workunit.client.0.smithi052.stdout:2/606: dread - da/d19/d3a/d31/d7a/dbd/dc6/fce zero size 2024-09-06T14:44:53.462 INFO:tasks.workunit.client.0.smithi052.stdout:1/602: creat d1/db/d18/dc9/fd4 x:0 0 0 2024-09-06T14:44:53.464 INFO:tasks.workunit.client.0.smithi052.stdout:9/424: read d1/d4/d6/f35 [1654551,44410] 0 2024-09-06T14:44:53.466 INFO:tasks.workunit.client.0.smithi052.stdout:7/548: rename d11/d1c/d24/f2d to d11/d1c/d24/d4b/da2/fb1 0 2024-09-06T14:44:53.466 INFO:tasks.workunit.client.0.smithi052.stdout:1/603: dread - d1/db/d72/d81/fb8 zero size 2024-09-06T14:44:53.467 INFO:tasks.workunit.client.0.smithi052.stdout:6/467: dread d2/dd/d18/d33/d44/d79/f9c [0,4194304] 0 2024-09-06T14:44:53.473 INFO:tasks.workunit.client.0.smithi052.stdout:5/624: truncate d2/d20/d42/f52 2986549 0 2024-09-06T14:44:53.475 INFO:tasks.workunit.client.0.smithi052.stdout:6/468: dwrite d2/dd/d18/f88 [0,4194304] 0 2024-09-06T14:44:53.476 INFO:tasks.workunit.client.0.smithi052.stdout:8/873: rename d6/d22/d36/d3e/dca to d6/d13a 0 2024-09-06T14:44:53.479 INFO:tasks.workunit.client.0.smithi052.stdout:2/607: fsync da/db/fe 0 2024-09-06T14:44:53.485 INFO:tasks.workunit.client.0.smithi052.stdout:7/549: unlink d11/d1c/d3f/f54 0 2024-09-06T14:44:53.487 INFO:tasks.workunit.client.0.smithi052.stdout:5/625: dwrite d2/d1a/d22/d26/f73 [0,4194304] 0 2024-09-06T14:44:53.495 INFO:tasks.workunit.client.0.smithi052.stdout:8/874: rmdir d6/d9/d1f/d14/da0 39 2024-09-06T14:44:53.502 INFO:tasks.workunit.client.0.smithi052.stdout:2/608: dwrite da/d19/d3a/d31/d76/d6a/fa5 [0,4194304] 0 2024-09-06T14:44:53.502 INFO:tasks.workunit.client.0.smithi052.stdout:9/425: rename d1/d26/c58 to d1/d4/c7d 0 2024-09-06T14:44:53.507 INFO:tasks.workunit.client.0.smithi052.stdout:0/524: dwrite d0/d1a/d26/f87 [0,4194304] 0 2024-09-06T14:44:53.507 INFO:tasks.workunit.client.0.smithi052.stdout:8/875: creat d6/d9/d1f/d33/da8/d41/db8/f13b x:0 0 0 2024-09-06T14:44:53.511 INFO:tasks.workunit.client.0.smithi052.stdout:5/626: dwrite d2/d20/d42/d8b/fab [0,4194304] 0 2024-09-06T14:44:53.511 INFO:tasks.workunit.client.0.smithi052.stdout:2/609: readlink da/d2d/d34/l39 0 2024-09-06T14:44:53.519 INFO:tasks.workunit.client.0.smithi052.stdout:7/550: getdents d11/d1c/d57/da7 0 2024-09-06T14:44:53.525 INFO:tasks.workunit.client.0.smithi052.stdout:1/604: dwrite d1/db/de/d74/d14/fb7 [0,4194304] 0 2024-09-06T14:44:53.525 INFO:tasks.workunit.client.0.smithi052.stdout:2/610: fsync da/db/d18/f3c 0 2024-09-06T14:44:53.525 INFO:tasks.workunit.client.0.smithi052.stdout:6/469: truncate d2/dd/d18/d2d/d32/f9a 581719 0 2024-09-06T14:44:53.529 INFO:tasks.workunit.client.0.smithi052.stdout:6/470: write d2/dd/d81/f85 [656149,34339] 0 2024-09-06T14:44:53.529 INFO:tasks.workunit.client.0.smithi052.stdout:7/551: mkdir d11/d1c/d57/d89/db2 0 2024-09-06T14:44:53.529 INFO:tasks.workunit.client.0.smithi052.stdout:5/627: creat d2/d1a/d22/d26/d2b/d37/d84/d97/fd5 x:0 0 0 2024-09-06T14:44:53.533 INFO:tasks.workunit.client.0.smithi052.stdout:9/426: rename d1/d4/d6/dc/d45 to d1/d26/d41/d7e 0 2024-09-06T14:44:53.535 INFO:tasks.workunit.client.0.smithi052.stdout:7/552: rmdir d11 39 2024-09-06T14:44:53.538 INFO:tasks.workunit.client.0.smithi052.stdout:8/876: rename d6/f59 to d6/d9/d1f/d33/da8/d41/d71/f13c 0 2024-09-06T14:44:53.540 INFO:tasks.workunit.client.0.smithi052.stdout:1/605: mkdir d1/db/de/d74/dcf/dd5 0 2024-09-06T14:44:53.541 INFO:tasks.workunit.client.0.smithi052.stdout:8/877: write d6/d9/d1f/d33/da8/d1b/f60 [2562091,49491] 0 2024-09-06T14:44:53.542 INFO:tasks.workunit.client.0.smithi052.stdout:1/606: write d1/d6c/d98/fd2 [621612,20950] 0 2024-09-06T14:44:53.542 INFO:tasks.workunit.client.0.smithi052.stdout:6/471: rename d2/dd/d18/d33/l34 to d2/dd/d5e/l9e 0 2024-09-06T14:44:53.545 INFO:tasks.workunit.client.0.smithi052.stdout:8/878: mkdir d6/d22/dd1/d13d 0 2024-09-06T14:44:53.547 INFO:tasks.workunit.client.0.smithi052.stdout:5/628: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/fd6 x:0 0 0 2024-09-06T14:44:53.547 INFO:tasks.workunit.client.0.smithi052.stdout:2/611: dread da/d19/f1a [0,4194304] 0 2024-09-06T14:44:53.548 INFO:tasks.workunit.client.0.smithi052.stdout:8/879: chown d6/d22/d36/d3e/d47/d56 9946 1 2024-09-06T14:44:53.548 INFO:tasks.workunit.client.0.smithi052.stdout:6/472: mkdir d2/dd/d18/d2d/d32/d9f 0 2024-09-06T14:44:53.549 INFO:tasks.workunit.client.0.smithi052.stdout:6/473: read d2/dd/d18/f31 [746661,113487] 0 2024-09-06T14:44:53.550 INFO:tasks.workunit.client.0.smithi052.stdout:1/607: unlink d1/db/de/c56 0 2024-09-06T14:44:53.551 INFO:tasks.workunit.client.0.smithi052.stdout:0/525: write d0/d1a/d26/d3a/d14/d2d/f83 [561101,84671] 0 2024-09-06T14:44:53.551 INFO:tasks.workunit.client.0.smithi052.stdout:5/629: fsync d2/d1a/d22/f45 0 2024-09-06T14:44:53.554 INFO:tasks.workunit.client.0.smithi052.stdout:8/880: write d6/d9/d1f/d19/f100 [519044,59224] 0 2024-09-06T14:44:53.557 INFO:tasks.workunit.client.0.smithi052.stdout:2/612: truncate da/db/d60/db1/f9a 2043320 0 2024-09-06T14:44:53.557 INFO:tasks.workunit.client.0.smithi052.stdout:4/550: sync 2024-09-06T14:44:53.557 INFO:tasks.workunit.client.0.smithi052.stdout:5/630: truncate d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fad 669668 0 2024-09-06T14:44:53.557 INFO:tasks.workunit.client.0.smithi052.stdout:1/608: mknod d1/db/d18/d5c/cd6 0 2024-09-06T14:44:53.558 INFO:tasks.workunit.client.0.smithi052.stdout:8/881: dread d6/d22/d36/d3e/d47/d56/d68/f107 [0,4194304] 0 2024-09-06T14:44:53.562 INFO:tasks.workunit.client.0.smithi052.stdout:6/474: rename d2/dd/d18/d2d/d32/f49 to d2/dd/d18/d33/d44/d79/fa0 0 2024-09-06T14:44:53.565 INFO:tasks.workunit.client.0.smithi052.stdout:8/882: dwrite d6/d16/f2c [4194304,4194304] 0 2024-09-06T14:44:53.566 INFO:tasks.workunit.client.0.smithi052.stdout:8/883: dread - d6/d4c/fdf zero size 2024-09-06T14:44:53.566 INFO:tasks.workunit.client.0.smithi052.stdout:0/526: truncate d0/d1a/d26/d3a/f88 726860 0 2024-09-06T14:44:53.570 INFO:tasks.workunit.client.0.smithi052.stdout:4/551: readlink d9/l61 0 2024-09-06T14:44:53.574 INFO:tasks.workunit.client.0.smithi052.stdout:1/609: creat d1/db/de/d74/d14/d90/fd7 x:0 0 0 2024-09-06T14:44:53.576 INFO:tasks.workunit.client.0.smithi052.stdout:8/884: truncate d6/d22/d36/dec/f105 89369 0 2024-09-06T14:44:53.577 INFO:tasks.workunit.client.0.smithi052.stdout:0/527: unlink d0/d1a/d26/d3a/d14/d2d/d56/l85 0 2024-09-06T14:44:53.578 INFO:tasks.workunit.client.0.smithi052.stdout:2/613: fsync da/db/f12 0 2024-09-06T14:44:53.579 INFO:tasks.workunit.client.0.smithi052.stdout:8/885: write d6/d9/d1f/d33/da8/d41/db8/f13b [589000,29300] 0 2024-09-06T14:44:53.580 INFO:tasks.workunit.client.0.smithi052.stdout:5/631: symlink d2/d20/d42/d8b/dca/ld7 0 2024-09-06T14:44:53.584 INFO:tasks.workunit.client.0.smithi052.stdout:6/475: rename d2/c9 to d2/dd/d18/d33/ca1 0 2024-09-06T14:44:53.589 INFO:tasks.workunit.client.0.smithi052.stdout:2/614: mknod da/d2d/d34/cd2 0 2024-09-06T14:44:53.593 INFO:tasks.workunit.client.0.smithi052.stdout:1/610: dread d1/d5f/f65 [0,4194304] 0 2024-09-06T14:44:53.593 INFO:tasks.workunit.client.0.smithi052.stdout:5/632: unlink d2/d1a/d22/d26/d2b/f69 0 2024-09-06T14:44:53.597 INFO:tasks.workunit.client.0.smithi052.stdout:6/476: creat d2/d4a/d6e/fa2 x:0 0 0 2024-09-06T14:44:53.602 INFO:tasks.workunit.client.0.smithi052.stdout:6/477: truncate d2/dd/d18/d33/f4d 649438 0 2024-09-06T14:44:53.604 INFO:tasks.workunit.client.0.smithi052.stdout:5/633: dwrite d2/d1a/d22/d26/d62/fb3 [0,4194304] 0 2024-09-06T14:44:53.606 INFO:tasks.workunit.client.0.smithi052.stdout:2/615: dread da/db/d60/f80 [0,4194304] 0 2024-09-06T14:44:53.609 INFO:tasks.workunit.client.0.smithi052.stdout:0/528: mknod d0/d1a/d26/d3a/d14/d2d/cb8 0 2024-09-06T14:44:53.611 INFO:tasks.workunit.client.0.smithi052.stdout:0/529: readlink d0/d1a/d26/l7c 0 2024-09-06T14:44:53.613 INFO:tasks.workunit.client.0.smithi052.stdout:4/552: getdents d9/d2d/d33/d4d/d81/d9c 0 2024-09-06T14:44:53.614 INFO:tasks.workunit.client.0.smithi052.stdout:2/616: dwrite da/d2d/d34/d66/fcf [0,4194304] 0 2024-09-06T14:44:53.626 INFO:tasks.workunit.client.0.smithi052.stdout:8/886: truncate d6/d9/d1f/d14/da0/f130 1717538 0 2024-09-06T14:44:53.629 INFO:tasks.workunit.client.0.smithi052.stdout:0/530: mknod d0/d1a/d26/d3a/d14/cb9 0 2024-09-06T14:44:53.641 INFO:tasks.workunit.client.0.smithi052.stdout:0/531: symlink d0/d19/d29/lba 0 2024-09-06T14:44:53.645 INFO:tasks.workunit.client.0.smithi052.stdout:1/611: link d1/db/de/d74/d14/lce d1/d5f/ld8 0 2024-09-06T14:44:53.647 INFO:tasks.workunit.client.0.smithi052.stdout:8/887: symlink d6/d22/d36/l13e 0 2024-09-06T14:44:53.649 INFO:tasks.workunit.client.0.smithi052.stdout:2/617: dwrite da/d19/f29 [0,4194304] 0 2024-09-06T14:44:53.651 INFO:tasks.workunit.client.0.smithi052.stdout:1/612: creat d1/db/d18/dc9/fd9 x:0 0 0 2024-09-06T14:44:53.654 INFO:tasks.workunit.client.0.smithi052.stdout:8/888: symlink d6/d22/d31/d5b/dd3/d111/l13f 0 2024-09-06T14:44:53.655 INFO:tasks.workunit.client.0.smithi052.stdout:8/889: chown d6/d4c/f109 0 1 2024-09-06T14:44:53.658 INFO:tasks.workunit.client.0.smithi052.stdout:1/613: rmdir d1/db/de/d74/d14/d2e 39 2024-09-06T14:44:53.660 INFO:tasks.workunit.client.0.smithi052.stdout:4/553: write d9/d10/d17/f23 [1236220,51516] 0 2024-09-06T14:44:53.661 INFO:tasks.workunit.client.0.smithi052.stdout:8/890: rmdir d6/d22/d36/d3e/d47/d56 39 2024-09-06T14:44:53.664 INFO:tasks.workunit.client.0.smithi052.stdout:8/891: rmdir d6/d9/d1f/d19 39 2024-09-06T14:44:53.665 INFO:tasks.workunit.client.0.smithi052.stdout:8/892: dread - d6/d4c/f11c zero size 2024-09-06T14:44:53.666 INFO:tasks.workunit.client.0.smithi052.stdout:1/614: mkdir d1/db/de/d74/d14/dda 0 2024-09-06T14:44:53.667 INFO:tasks.workunit.client.0.smithi052.stdout:1/615: chown d1/d5f/f7d 24797826 1 2024-09-06T14:44:53.672 INFO:tasks.workunit.client.0.smithi052.stdout:6/478: truncate d2/dd/d18/d25/d6a/f83 2269454 0 2024-09-06T14:44:53.673 INFO:tasks.workunit.client.0.smithi052.stdout:5/634: dwrite d2/d20/d42/d65/f55 [0,4194304] 0 2024-09-06T14:44:53.675 INFO:tasks.workunit.client.0.smithi052.stdout:1/616: creat d1/db/de/d74/d14/d9f/fdb x:0 0 0 2024-09-06T14:44:53.681 INFO:tasks.workunit.client.0.smithi052.stdout:2/618: dread da/d19/d3a/d31/d76/dc7/fcb [0,4194304] 0 2024-09-06T14:44:53.681 INFO:tasks.workunit.client.0.smithi052.stdout:8/893: creat d6/d22/d36/d3e/d47/d56/d68/d69/f140 x:0 0 0 2024-09-06T14:44:53.682 INFO:tasks.workunit.client.0.smithi052.stdout:1/617: dread d1/d6c/d98/fd2 [0,4194304] 0 2024-09-06T14:44:53.683 INFO:tasks.workunit.client.0.smithi052.stdout:2/619: chown da/db/d60/db1 1440 1 2024-09-06T14:44:53.683 INFO:tasks.workunit.client.0.smithi052.stdout:5/635: read - d2/d1a/d22/d26/d2b/d37/d84/f9b zero size 2024-09-06T14:44:53.684 INFO:tasks.workunit.client.0.smithi052.stdout:1/618: rename d1/db/d72 to d1/db/d72/db1/ddc 22 2024-09-06T14:44:53.687 INFO:tasks.workunit.client.0.smithi052.stdout:5/636: stat d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/la0 0 2024-09-06T14:44:53.689 INFO:tasks.workunit.client.0.smithi052.stdout:5/637: dread - d2/d20/d42/d8b/fd3 zero size 2024-09-06T14:44:53.689 INFO:tasks.workunit.client.0.smithi052.stdout:8/894: creat d6/d16/dbf/f141 x:0 0 0 2024-09-06T14:44:53.691 INFO:tasks.workunit.client.0.smithi052.stdout:8/895: chown d6/d9/d1f/d14/fe0 97 1 2024-09-06T14:44:53.691 INFO:tasks.workunit.client.0.smithi052.stdout:2/620: dwrite da/db/d60/db1/d70/fa6 [0,4194304] 0 2024-09-06T14:44:53.693 INFO:tasks.workunit.client.0.smithi052.stdout:1/619: unlink d1/db/de/d74/d36/d9b/fa9 0 2024-09-06T14:44:53.694 INFO:tasks.workunit.client.0.smithi052.stdout:5/638: mkdir d2/d1a/d22/d26/d2b/d37/d84/dd8 0 2024-09-06T14:44:53.696 INFO:tasks.workunit.client.0.smithi052.stdout:2/621: symlink da/d19/d3a/d31/d7a/dbd/ld3 0 2024-09-06T14:44:53.697 INFO:tasks.workunit.client.0.smithi052.stdout:2/622: chown da/f57 750 1 2024-09-06T14:44:53.698 INFO:tasks.workunit.client.0.smithi052.stdout:5/639: symlink d2/d1a/d22/d26/d2b/d48/d64/ld9 0 2024-09-06T14:44:53.701 INFO:tasks.workunit.client.0.smithi052.stdout:8/896: dwrite d6/d22/d31/d5b/dd3/d111/fba [0,4194304] 0 2024-09-06T14:44:53.706 INFO:tasks.workunit.client.0.smithi052.stdout:0/532: truncate d0/d19/f59 2665160 0 2024-09-06T14:44:53.710 INFO:tasks.workunit.client.0.smithi052.stdout:5/640: dwrite d2/d1a/d22/d26/f73 [0,4194304] 0 2024-09-06T14:44:53.711 INFO:tasks.workunit.client.0.smithi052.stdout:1/620: rename d1/db/de/d74/d14/d2e/fc7 to d1/db/de/d74/d14/d9f/dcc/d47/d4a/fdd 0 2024-09-06T14:44:53.714 INFO:tasks.workunit.client.0.smithi052.stdout:8/897: write d6/d9/d1f/d33/da8/d41/d71/f81 [2598537,83892] 0 2024-09-06T14:44:53.720 INFO:tasks.workunit.client.0.smithi052.stdout:5/641: rmdir d2/d1a/d22/d26/d2b/d48 39 2024-09-06T14:44:53.721 INFO:tasks.workunit.client.0.smithi052.stdout:5/642: dread - d2/d1a/d22/f9f zero size 2024-09-06T14:44:53.721 INFO:tasks.workunit.client.0.smithi052.stdout:0/533: creat d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/fbb x:0 0 0 2024-09-06T14:44:53.722 INFO:tasks.workunit.client.0.smithi052.stdout:8/898: chown d6/d3c/lc6 30 1 2024-09-06T14:44:53.723 INFO:tasks.workunit.client.0.smithi052.stdout:5/643: read d2/d1a/d22/d26/f73 [906700,122852] 0 2024-09-06T14:44:53.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/554: truncate d9/d2d/d33/d5d/da6/f75 131743 0 2024-09-06T14:44:53.732 INFO:tasks.workunit.client.0.smithi052.stdout:2/623: dread da/d19/d3a/d31/f43 [0,4194304] 0 2024-09-06T14:44:53.735 INFO:tasks.workunit.client.0.smithi052.stdout:1/621: rename d1/db/d18/l93 to d1/db/de/d74/d36/d9b/lde 0 2024-09-06T14:44:53.737 INFO:tasks.workunit.client.0.smithi052.stdout:1/622: truncate d1/db/de/d74/d14/d90/fc3 487549 0 2024-09-06T14:44:53.738 INFO:tasks.workunit.client.0.smithi052.stdout:5/644: creat d2/d20/d42/d65/fda x:0 0 0 2024-09-06T14:44:53.745 INFO:tasks.workunit.client.0.smithi052.stdout:1/623: dwrite d1/db/d18/fb4 [0,4194304] 0 2024-09-06T14:44:53.748 INFO:tasks.workunit.client.0.smithi052.stdout:1/624: chown d1/db/de/d74/d14/d9f/dcc/d47/d4a/f77 501254432 1 2024-09-06T14:44:53.750 INFO:tasks.workunit.client.0.smithi052.stdout:8/899: mknod d6/d9/d1f/c142 0 2024-09-06T14:44:53.750 INFO:tasks.workunit.client.0.smithi052.stdout:2/624: fdatasync da/d19/d3a/d31/d76/dc7/fcb 0 2024-09-06T14:44:53.752 INFO:tasks.workunit.client.0.smithi052.stdout:2/625: truncate da/db/d60/faf 161954 0 2024-09-06T14:44:53.754 INFO:tasks.workunit.client.0.smithi052.stdout:5/645: mkdir d2/d1a/ddb 0 2024-09-06T14:44:53.757 INFO:tasks.workunit.client.0.smithi052.stdout:4/555: mknod d9/da1/cbc 0 2024-09-06T14:44:53.758 INFO:tasks.workunit.client.0.smithi052.stdout:1/625: fsync d1/db/de/d74/d12/f70 0 2024-09-06T14:44:53.759 INFO:tasks.workunit.client.0.smithi052.stdout:8/900: creat d6/d22/d36/dec/f143 x:0 0 0 2024-09-06T14:44:53.760 INFO:tasks.workunit.client.0.smithi052.stdout:4/556: dread d9/d2d/d33/d5d/f89 [0,4194304] 0 2024-09-06T14:44:53.763 INFO:tasks.workunit.client.0.smithi052.stdout:5/646: write d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fb5 [642106,8765] 0 2024-09-06T14:44:53.763 INFO:tasks.workunit.client.0.smithi052.stdout:8/901: rmdir d6/d22/d36/d3e/d47/d56/d68 39 2024-09-06T14:44:53.767 INFO:tasks.workunit.client.0.smithi052.stdout:5/647: write d2/d1a/d22/d26/d2b/d48/d64/dbf/fd6 [567443,14194] 0 2024-09-06T14:44:53.768 INFO:tasks.workunit.client.0.smithi052.stdout:4/557: chown d9/d2d/d33/d5d/c73 836 1 2024-09-06T14:44:53.771 INFO:tasks.workunit.client.0.smithi052.stdout:8/902: symlink d6/d22/d36/d12c/l144 0 2024-09-06T14:44:53.778 INFO:tasks.workunit.client.0.smithi052.stdout:8/903: unlink d6/d22/dd1/le5 0 2024-09-06T14:44:53.778 INFO:tasks.workunit.client.0.smithi052.stdout:1/626: link d1/db/de/d74/d14/d2e/lca d1/db/de/d74/d14/d9f/dcc/d47/ldf 0 2024-09-06T14:44:53.780 INFO:tasks.workunit.client.0.smithi052.stdout:8/904: chown d6/d22/d36/d3e/df6/caf 1230041 1 2024-09-06T14:44:53.788 INFO:tasks.workunit.client.0.smithi052.stdout:1/627: creat d1/db/de/d74/fe0 x:0 0 0 2024-09-06T14:44:53.788 INFO:tasks.workunit.client.0.smithi052.stdout:0/534: dwrite d0/d4f/d7d/f5c [0,4194304] 0 2024-09-06T14:44:53.790 INFO:tasks.workunit.client.0.smithi052.stdout:0/535: chown d0/d2e/f9c 0 1 2024-09-06T14:44:53.792 INFO:tasks.workunit.client.0.smithi052.stdout:8/905: getdents d6/d9/d1f/d33/da8/d41/db8 0 2024-09-06T14:44:53.798 INFO:tasks.workunit.client.0.smithi052.stdout:8/906: symlink d6/d9/d1f/dcf/l145 0 2024-09-06T14:44:53.798 INFO:tasks.workunit.client.0.smithi052.stdout:1/628: dwrite d1/db/fb3 [0,4194304] 0 2024-09-06T14:44:53.799 INFO:tasks.workunit.client.0.smithi052.stdout:0/536: mknod d0/d1a/d26/d3a/d14/d20/d22/d41/cbc 0 2024-09-06T14:44:53.801 INFO:tasks.workunit.client.0.smithi052.stdout:1/629: dread - d1/db/d18/fd0 zero size 2024-09-06T14:44:53.801 INFO:tasks.workunit.client.0.smithi052.stdout:6/479: dwrite d2/dd/d18/d25/d6a/f83 [0,4194304] 0 2024-09-06T14:44:53.802 INFO:tasks.workunit.client.0.smithi052.stdout:1/630: readlink d1/db/l26 0 2024-09-06T14:44:53.802 INFO:tasks.workunit.client.0.smithi052.stdout:0/537: chown d0/d1a/d26/d3a/d14/d20/d22/l3c 643024902 1 2024-09-06T14:44:53.804 INFO:tasks.workunit.client.0.smithi052.stdout:6/480: fsync d2/dd/d18/d2d/d32/f3f 0 2024-09-06T14:44:53.804 INFO:tasks.workunit.client.0.smithi052.stdout:8/907: fdatasync d6/d22/d31/d5b/f96 0 2024-09-06T14:44:53.809 INFO:tasks.workunit.client.0.smithi052.stdout:1/631: mknod d1/db/de/d74/d36/d7c/ce1 0 2024-09-06T14:44:53.810 INFO:tasks.workunit.client.0.smithi052.stdout:5/648: write d2/ff [2742762,116873] 0 2024-09-06T14:44:53.811 INFO:tasks.workunit.client.0.smithi052.stdout:8/908: mkdir d6/d9/d1f/d33/da8/d41/d146 0 2024-09-06T14:44:53.813 INFO:tasks.workunit.client.0.smithi052.stdout:4/558: write d9/f40 [88988,9773] 0 2024-09-06T14:44:53.814 INFO:tasks.workunit.client.0.smithi052.stdout:8/909: write d6/d22/d31/d5b/dd3/d111/f10a [881982,122261] 0 2024-09-06T14:44:53.815 INFO:tasks.workunit.client.0.smithi052.stdout:5/649: write d2/d1a/d22/d26/d62/f66 [858749,62644] 0 2024-09-06T14:44:53.816 INFO:tasks.workunit.client.0.smithi052.stdout:6/481: getdents d2/dd/d18/d2d/d32/d9f 0 2024-09-06T14:44:53.820 INFO:tasks.workunit.client.0.smithi052.stdout:4/559: mknod d9/d2d/d33/d4d/cbd 0 2024-09-06T14:44:53.823 INFO:tasks.workunit.client.0.smithi052.stdout:5/650: truncate d2/d1a/d22/d26/fc7 900188 0 2024-09-06T14:44:53.823 INFO:tasks.workunit.client.0.smithi052.stdout:6/482: symlink d2/dd/d81/la3 0 2024-09-06T14:44:53.825 INFO:tasks.workunit.client.0.smithi052.stdout:0/538: dread d0/d4f/d7d/f62 [0,4194304] 0 2024-09-06T14:44:53.825 INFO:tasks.workunit.client.0.smithi052.stdout:1/632: dwrite d1/db/de/d74/d14/f28 [0,4194304] 0 2024-09-06T14:44:53.826 INFO:tasks.workunit.client.0.smithi052.stdout:8/910: creat d6/d22/d36/d3e/df6/f147 x:0 0 0 2024-09-06T14:44:53.830 INFO:tasks.workunit.client.0.smithi052.stdout:3/651: sync 2024-09-06T14:44:53.830 INFO:tasks.workunit.client.0.smithi052.stdout:0/539: write d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/fbb [1027750,118839] 0 2024-09-06T14:44:53.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/483: symlink d2/dd/d18/d2d/d71/la4 0 2024-09-06T14:44:53.837 INFO:tasks.workunit.client.0.smithi052.stdout:8/911: creat d6/d22/d36/d3e/f148 x:0 0 0 2024-09-06T14:44:53.838 INFO:tasks.workunit.client.0.smithi052.stdout:8/912: dread - d6/d9/d1f/dcf/fee zero size 2024-09-06T14:44:53.839 INFO:tasks.workunit.client.0.smithi052.stdout:8/913: chown d6/d22/d36/cdb 229 1 2024-09-06T14:44:53.840 INFO:tasks.workunit.client.0.smithi052.stdout:5/651: mknod d2/d20/cdc 0 2024-09-06T14:44:53.842 INFO:tasks.workunit.client.0.smithi052.stdout:1/633: dread d1/f1d [0,4194304] 0 2024-09-06T14:44:53.842 INFO:tasks.workunit.client.0.smithi052.stdout:3/652: symlink d0/d11/d12/d17/lcb 0 2024-09-06T14:44:53.850 INFO:tasks.workunit.client.0.smithi052.stdout:4/560: dwrite d9/d2d/d33/d5d/f99 [0,4194304] 0 2024-09-06T14:44:53.850 INFO:tasks.workunit.client.0.smithi052.stdout:3/653: creat d0/d11/fcc x:0 0 0 2024-09-06T14:44:53.856 INFO:tasks.workunit.client.0.smithi052.stdout:1/634: fsync d1/db/de/d74/d14/d9f/dcc/d47/d4a/f77 0 2024-09-06T14:44:53.857 INFO:tasks.workunit.client.0.smithi052.stdout:5/652: mknod d2/d20/d42/d8b/dc8/cdd 0 2024-09-06T14:44:53.859 INFO:tasks.workunit.client.0.smithi052.stdout:8/914: dwrite d6/d22/d36/d3e/d47/d56/d68/d69/f74 [0,4194304] 0 2024-09-06T14:44:53.860 INFO:tasks.workunit.client.0.smithi052.stdout:6/484: creat d2/dd/d18/d33/fa5 x:0 0 0 2024-09-06T14:44:53.864 INFO:tasks.workunit.client.0.smithi052.stdout:3/654: mkdir d0/dcd 0 2024-09-06T14:44:53.868 INFO:tasks.workunit.client.0.smithi052.stdout:0/540: getdents d0/d1a/d26/d3a/d14/d20/d22 0 2024-09-06T14:44:53.870 INFO:tasks.workunit.client.0.smithi052.stdout:6/485: rename d2/dd/d18/f31 to d2/dd/d18/d4b/fa6 0 2024-09-06T14:44:53.870 INFO:tasks.workunit.client.0.smithi052.stdout:5/653: dread d2/d1a/d22/d26/f73 [0,4194304] 0 2024-09-06T14:44:53.872 INFO:tasks.workunit.client.0.smithi052.stdout:4/561: dread d9/d10/f12 [0,4194304] 0 2024-09-06T14:44:53.874 INFO:tasks.workunit.client.0.smithi052.stdout:3/655: readlink d0/d11/d12/d4c/d93/d35/lc9 0 2024-09-06T14:44:53.876 INFO:tasks.workunit.client.0.smithi052.stdout:6/486: unlink d2/dd/d18/d25/d6a/f83 0 2024-09-06T14:44:53.877 INFO:tasks.workunit.client.0.smithi052.stdout:5/654: rmdir d2/d1a/d22/d26/d62 39 2024-09-06T14:44:53.879 INFO:tasks.workunit.client.0.smithi052.stdout:5/655: dread - d2/d20/d56/fd2 zero size 2024-09-06T14:44:53.885 INFO:tasks.workunit.client.0.smithi052.stdout:6/487: unlink d2/dd/d18/d25/d4c/c7b 0 2024-09-06T14:44:53.888 INFO:tasks.workunit.client.0.smithi052.stdout:5/656: mknod d2/d20/d42/d8b/cde 0 2024-09-06T14:44:53.888 INFO:tasks.workunit.client.0.smithi052.stdout:0/541: dread d0/d2e/f4b [0,4194304] 0 2024-09-06T14:44:53.889 INFO:tasks.workunit.client.0.smithi052.stdout:3/656: mknod d0/d11/d71/d98/d1b/d85/dc5/cce 0 2024-09-06T14:44:53.891 INFO:tasks.workunit.client.0.smithi052.stdout:6/488: write d2/f30 [7477412,66291] 0 2024-09-06T14:44:53.894 INFO:tasks.workunit.client.0.smithi052.stdout:4/562: unlink d9/d10/d17/d39/d3a/d5c/f98 0 2024-09-06T14:44:53.894 INFO:tasks.workunit.client.0.smithi052.stdout:1/635: dwrite d1/db/de/d74/d14/d2e/f84 [0,4194304] 0 2024-09-06T14:44:53.896 INFO:tasks.workunit.client.0.smithi052.stdout:5/657: unlink d2/d20/d42/d65/fa5 0 2024-09-06T14:44:53.897 INFO:tasks.workunit.client.0.smithi052.stdout:3/657: mkdir d0/d11/d71/d98/d1b/d85/d9f/dcf 0 2024-09-06T14:44:53.898 INFO:tasks.workunit.client.0.smithi052.stdout:3/658: dread - d0/d11/f79 zero size 2024-09-06T14:44:53.902 INFO:tasks.workunit.client.0.smithi052.stdout:6/489: mkdir d2/dd/d18/d2d/da7 0 2024-09-06T14:44:53.907 INFO:tasks.workunit.client.0.smithi052.stdout:3/659: truncate d0/d11/d71/d98/d19/f61 1446142 0 2024-09-06T14:44:53.909 INFO:tasks.workunit.client.0.smithi052.stdout:6/490: rmdir d2/dd/d18/d4b 39 2024-09-06T14:44:53.914 INFO:tasks.workunit.client.0.smithi052.stdout:4/563: write d9/d10/d17/d39/d3a/d64/fa3 [1058684,91229] 0 2024-09-06T14:44:53.916 INFO:tasks.workunit.client.0.smithi052.stdout:6/491: readlink d2/dd/d5e/l9e 0 2024-09-06T14:44:53.918 INFO:tasks.workunit.client.0.smithi052.stdout:1/636: rmdir d1/db/de/d74/dcf/dd5 0 2024-09-06T14:44:53.919 INFO:tasks.workunit.client.0.smithi052.stdout:1/637: chown d1/db/l85 924 1 2024-09-06T14:44:53.920 INFO:tasks.workunit.client.0.smithi052.stdout:3/660: dread d0/d11/d71/d98/f4e [0,4194304] 0 2024-09-06T14:44:53.921 INFO:tasks.workunit.client.0.smithi052.stdout:5/658: rename d2/d1a/d22/d26/d2b/d37/d6a/fbc to d2/d1a/d22/d26/d2b/fdf 0 2024-09-06T14:44:53.921 INFO:tasks.workunit.client.0.smithi052.stdout:0/542: getdents d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a 0 2024-09-06T14:44:53.923 INFO:tasks.workunit.client.0.smithi052.stdout:5/659: readlink d2/d1a/d22/d26/d2b/l40 0 2024-09-06T14:44:53.923 INFO:tasks.workunit.client.0.smithi052.stdout:6/492: dwrite d2/dd/d18/d25/d4c/d61/f8d [0,4194304] 0 2024-09-06T14:44:53.925 INFO:tasks.workunit.client.0.smithi052.stdout:1/638: rmdir d1/db/de 39 2024-09-06T14:44:53.928 INFO:tasks.workunit.client.0.smithi052.stdout:4/564: mknod d9/d2d/d33/d5d/da6/d83/cbe 0 2024-09-06T14:44:53.930 INFO:tasks.workunit.client.0.smithi052.stdout:0/543: fdatasync d0/d1a/d26/f27 0 2024-09-06T14:44:53.933 INFO:tasks.workunit.client.0.smithi052.stdout:5/660: symlink d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/le0 0 2024-09-06T14:44:53.940 INFO:tasks.workunit.client.0.smithi052.stdout:0/544: dwrite d0/d1a/d26/d3a/d14/d20/d22/d8b/faf [0,4194304] 0 2024-09-06T14:44:53.940 INFO:tasks.workunit.client.0.smithi052.stdout:3/661: creat d0/fd0 x:0 0 0 2024-09-06T14:44:53.942 INFO:tasks.workunit.client.0.smithi052.stdout:5/661: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fe1 x:0 0 0 2024-09-06T14:44:53.944 INFO:tasks.workunit.client.0.smithi052.stdout:0/545: symlink d0/d1a/d26/d3a/d14/d20/d22/d8b/lbd 0 2024-09-06T14:44:53.947 INFO:tasks.workunit.client.0.smithi052.stdout:0/546: symlink d0/d1a/d26/lbe 0 2024-09-06T14:44:53.949 INFO:tasks.workunit.client.0.smithi052.stdout:0/547: chown d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/l77 123857 1 2024-09-06T14:44:53.952 INFO:tasks.workunit.client.0.smithi052.stdout:1/639: getdents d1/db/de/d74/d14/d2e 0 2024-09-06T14:44:53.954 INFO:tasks.workunit.client.0.smithi052.stdout:3/662: write d0/d11/d12/d4c/d93/f3e [2457237,7736] 0 2024-09-06T14:44:53.954 INFO:tasks.workunit.client.0.smithi052.stdout:4/565: dwrite d9/d10/d17/d39/f93 [0,4194304] 0 2024-09-06T14:44:53.955 INFO:tasks.workunit.client.0.smithi052.stdout:1/640: rename d1/d6c to d1/d6c/de2 22 2024-09-06T14:44:53.956 INFO:tasks.workunit.client.0.smithi052.stdout:0/548: dread d0/d1a/d26/d3a/d14/d2d/f83 [0,4194304] 0 2024-09-06T14:44:53.957 INFO:tasks.workunit.client.0.smithi052.stdout:3/663: symlink d0/d89/ld1 0 2024-09-06T14:44:53.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/664: read - d0/f9a zero size 2024-09-06T14:44:53.959 INFO:tasks.workunit.client.0.smithi052.stdout:4/566: mkdir d9/d2d/d33/d5d/da6/dbf 0 2024-09-06T14:44:53.962 INFO:tasks.workunit.client.0.smithi052.stdout:0/549: dread d0/d4f/d7d/f5c [0,4194304] 0 2024-09-06T14:44:53.963 INFO:tasks.workunit.client.0.smithi052.stdout:3/665: truncate d0/d11/d71/d98/f43 848847 0 2024-09-06T14:44:53.967 INFO:tasks.workunit.client.0.smithi052.stdout:3/666: mkdir d0/d11/d71/d98/d1b/dd2 0 2024-09-06T14:44:53.968 INFO:tasks.workunit.client.0.smithi052.stdout:4/567: creat d9/d2d/d33/d4d/d81/d9c/dac/fc0 x:0 0 0 2024-09-06T14:44:53.969 INFO:tasks.workunit.client.0.smithi052.stdout:1/641: getdents d1/db/de/d74/d36/d7c 0 2024-09-06T14:44:53.970 INFO:tasks.workunit.client.0.smithi052.stdout:4/568: stat d9/d2d/f4a 0 2024-09-06T14:44:53.970 INFO:tasks.workunit.client.0.smithi052.stdout:0/550: mkdir d0/d1a/d26/d3a/d14/d20/dbf 0 2024-09-06T14:44:53.972 INFO:tasks.workunit.client.0.smithi052.stdout:3/667: symlink d0/d11/d12/d4c/d93/d35/d46/d5b/da0/ld3 0 2024-09-06T14:44:53.973 INFO:tasks.workunit.client.0.smithi052.stdout:3/668: dread - d0/d11/d12/d4c/d93/d35/d46/d5b/fa3 zero size 2024-09-06T14:44:53.973 INFO:tasks.workunit.client.0.smithi052.stdout:4/569: mkdir d9/d2d/d33/d4d/d81/dc1 0 2024-09-06T14:44:53.974 INFO:tasks.workunit.client.0.smithi052.stdout:4/570: fsync d9/f69 0 2024-09-06T14:44:53.975 INFO:tasks.workunit.client.0.smithi052.stdout:4/571: chown d9/d2d/f8d 2 1 2024-09-06T14:44:53.975 INFO:tasks.workunit.client.0.smithi052.stdout:0/551: unlink d0/d18/f50 0 2024-09-06T14:44:53.977 INFO:tasks.workunit.client.0.smithi052.stdout:3/669: creat d0/d11/d12/d4c/d93/fd4 x:0 0 0 2024-09-06T14:44:53.979 INFO:tasks.workunit.client.0.smithi052.stdout:4/572: dread - d9/d10/fab zero size 2024-09-06T14:44:53.982 INFO:tasks.workunit.client.0.smithi052.stdout:4/573: write d9/d2d/d33/d4d/d81/d9c/dac/fc0 [331258,3779] 0 2024-09-06T14:44:53.985 INFO:tasks.workunit.client.0.smithi052.stdout:3/670: link d0/d11/d71/d98/d1b/f60 d0/d11/d71/d98/fd5 0 2024-09-06T14:44:53.985 INFO:tasks.workunit.client.0.smithi052.stdout:1/642: dread d1/db/de/d74/d12/f1e [0,4194304] 0 2024-09-06T14:44:53.985 INFO:tasks.workunit.client.0.smithi052.stdout:3/671: chown d0/f9a 3809 1 2024-09-06T14:44:53.988 INFO:tasks.workunit.client.0.smithi052.stdout:4/574: mknod d9/d2d/d33/d5d/da6/dbf/cc2 0 2024-09-06T14:44:53.988 INFO:tasks.workunit.client.0.smithi052.stdout:3/672: write d0/d11/d71/d98/d19/f87 [4280983,74420] 0 2024-09-06T14:44:53.991 INFO:tasks.workunit.client.0.smithi052.stdout:3/673: chown d0/d11/f79 6506137 1 2024-09-06T14:44:53.994 INFO:tasks.workunit.client.0.smithi052.stdout:4/575: unlink d9/d10/d17/d39/d3a/f5b 0 2024-09-06T14:44:53.994 INFO:tasks.workunit.client.0.smithi052.stdout:0/552: dread d0/d1a/d26/f27 [0,4194304] 0 2024-09-06T14:44:53.994 INFO:tasks.workunit.client.0.smithi052.stdout:1/643: dwrite d1/d5f/fc0 [0,4194304] 0 2024-09-06T14:44:53.996 INFO:tasks.workunit.client.0.smithi052.stdout:3/674: write d0/d11/d12/d4c/f57 [369977,51430] 0 2024-09-06T14:44:53.997 INFO:tasks.workunit.client.0.smithi052.stdout:1/644: chown d1/db/d18/f66 124278551 1 2024-09-06T14:44:54.000 INFO:tasks.workunit.client.0.smithi052.stdout:4/576: fdatasync d9/d10/d19/f29 0 2024-09-06T14:44:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:53 smithi165 ceph-mon[36229]: pgmap v29: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 204 MiB/s wr, 470 op/s 2024-09-06T14:44:54.083 INFO:tasks.workunit.client.0.smithi052.stdout:3/675: symlink d0/d11/d12/ld6 0 2024-09-06T14:44:54.084 INFO:tasks.workunit.client.0.smithi052.stdout:9/427: sync 2024-09-06T14:44:54.085 INFO:tasks.workunit.client.0.smithi052.stdout:0/553: rename d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/l77 to d0/d1a/d26/d3a/d14/d20/d22/lc0 0 2024-09-06T14:44:54.088 INFO:tasks.workunit.client.0.smithi052.stdout:4/577: creat d9/d10/d17/d39/d7b/d91/fc3 x:0 0 0 2024-09-06T14:44:54.093 INFO:tasks.workunit.client.0.smithi052.stdout:3/676: dread d0/d11/d71/d98/d19/f61 [0,4194304] 0 2024-09-06T14:44:54.096 INFO:tasks.workunit.client.0.smithi052.stdout:4/578: creat d9/d10/d17/d39/d3a/d64/fc4 x:0 0 0 2024-09-06T14:44:54.101 INFO:tasks.workunit.client.0.smithi052.stdout:4/579: creat d9/da1/fc5 x:0 0 0 2024-09-06T14:44:54.101 INFO:tasks.workunit.client.0.smithi052.stdout:3/677: dread d0/d11/d71/d98/d1b/f27 [0,4194304] 0 2024-09-06T14:44:54.104 INFO:tasks.workunit.client.0.smithi052.stdout:1/645: write d1/db/de/d74/d12/f46 [1819300,121188] 0 2024-09-06T14:44:54.105 INFO:tasks.workunit.client.0.smithi052.stdout:0/554: write d0/d1a/d26/d3a/d14/d2d/f33 [2261289,80461] 0 2024-09-06T14:44:54.106 INFO:tasks.workunit.client.0.smithi052.stdout:4/580: fdatasync d9/f38 0 2024-09-06T14:44:54.107 INFO:tasks.workunit.client.0.smithi052.stdout:4/581: dread - d9/d10/fbb zero size 2024-09-06T14:44:54.108 INFO:tasks.workunit.client.0.smithi052.stdout:4/582: readlink d9/lba 0 2024-09-06T14:44:54.108 INFO:tasks.workunit.client.0.smithi052.stdout:3/678: fsync d0/d11/d71/d98/fd5 0 2024-09-06T14:44:54.115 INFO:tasks.workunit.client.0.smithi052.stdout:1/646: dread d1/db/de/d74/d12/f46 [0,4194304] 0 2024-09-06T14:44:54.115 INFO:tasks.workunit.client.0.smithi052.stdout:0/555: creat d0/d1a/d26/d3a/d14/d2d/d94/fc1 x:0 0 0 2024-09-06T14:44:54.116 INFO:tasks.workunit.client.0.smithi052.stdout:1/647: chown d1/db/d18/f92 121 1 2024-09-06T14:44:54.117 INFO:tasks.workunit.client.0.smithi052.stdout:0/556: write d0/d19/d29/f91 [195995,20394] 0 2024-09-06T14:44:54.122 INFO:tasks.workunit.client.0.smithi052.stdout:0/557: mkdir d0/d1a/d26/d3a/d14/d2d/d56/da3/dc2 0 2024-09-06T14:44:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:53 smithi052 ceph-mon[28627]: pgmap v29: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 72 MiB/s rd, 204 MiB/s wr, 470 op/s 2024-09-06T14:44:54.123 INFO:tasks.workunit.client.0.smithi052.stdout:4/583: rename d9/da1/cbc to d9/d10/d17/d39/d3a/d5c/cc6 0 2024-09-06T14:44:54.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/558: rmdir d0/d1a/d8e 39 2024-09-06T14:44:54.131 INFO:tasks.workunit.client.0.smithi052.stdout:1/648: dread d1/db/de/fa0 [0,4194304] 0 2024-09-06T14:44:54.133 INFO:tasks.workunit.client.0.smithi052.stdout:1/649: truncate d1/db/d50/fcd 857625 0 2024-09-06T14:44:54.134 INFO:tasks.workunit.client.0.smithi052.stdout:1/650: chown d1/db/de/d74/d14/d2e/l75 32549 1 2024-09-06T14:44:54.135 INFO:tasks.workunit.client.0.smithi052.stdout:1/651: chown d1/db/de/d74/d12/c60 5320262 1 2024-09-06T14:44:54.136 INFO:tasks.workunit.client.0.smithi052.stdout:3/679: rename d0/d11/d71/d98/d19/f87 to d0/fd7 0 2024-09-06T14:44:54.137 INFO:tasks.workunit.client.0.smithi052.stdout:4/584: symlink d9/d2d/d33/d4d/lc7 0 2024-09-06T14:44:54.138 INFO:tasks.workunit.client.0.smithi052.stdout:3/680: fsync d0/d11/d71/d98/d1b/d85/fb1 0 2024-09-06T14:44:54.139 INFO:tasks.workunit.client.0.smithi052.stdout:0/559: creat d0/d1a/d26/d3a/d14/d20/d22/d41/d8a/fc3 x:0 0 0 2024-09-06T14:44:54.142 INFO:tasks.workunit.client.0.smithi052.stdout:1/652: creat d1/db/de/d74/d14/d9f/dcc/fe3 x:0 0 0 2024-09-06T14:44:54.143 INFO:tasks.workunit.client.0.smithi052.stdout:0/560: creat d0/d4f/fc4 x:0 0 0 2024-09-06T14:44:54.148 INFO:tasks.workunit.client.0.smithi052.stdout:3/681: dwrite d0/d11/d12/d4c/d93/fd4 [0,4194304] 0 2024-09-06T14:44:54.151 INFO:tasks.workunit.client.0.smithi052.stdout:4/585: rename d9/d10/d17/d39/d3a/c55 to d9/cc8 0 2024-09-06T14:44:54.155 INFO:tasks.workunit.client.0.smithi052.stdout:3/682: mkdir d0/d11/d12/dd8 0 2024-09-06T14:44:54.161 INFO:tasks.workunit.client.0.smithi052.stdout:3/683: symlink d0/d11/d71/d98/d1b/d85/d9f/dcf/ld9 0 2024-09-06T14:44:54.163 INFO:tasks.workunit.client.0.smithi052.stdout:4/586: link d9/d2d/fb0 d9/d2d/d33/d5d/fc9 0 2024-09-06T14:44:54.165 INFO:tasks.workunit.client.0.smithi052.stdout:0/561: write d0/d4f/d7d/f76 [176125,113587] 0 2024-09-06T14:44:54.167 INFO:tasks.workunit.client.0.smithi052.stdout:4/587: rmdir d9/d10/d17/daa 39 2024-09-06T14:44:54.168 INFO:tasks.workunit.client.0.smithi052.stdout:0/562: write d0/d4f/fc4 [726555,26212] 0 2024-09-06T14:44:54.171 INFO:tasks.workunit.client.0.smithi052.stdout:1/653: dwrite d1/db/de/d74/d36/f3d [0,4194304] 0 2024-09-06T14:44:54.172 INFO:tasks.workunit.client.0.smithi052.stdout:3/684: getdents d0/d11/d71/d98/d1b/d85/d9f 0 2024-09-06T14:44:54.173 INFO:tasks.workunit.client.0.smithi052.stdout:0/563: read - d0/d1a/d26/d3a/d14/f3e zero size 2024-09-06T14:44:54.180 INFO:tasks.workunit.client.0.smithi052.stdout:3/685: dread d0/d11/d12/d4c/d93/fd4 [0,4194304] 0 2024-09-06T14:44:54.183 INFO:tasks.workunit.client.0.smithi052.stdout:0/564: creat d0/d1a/d26/d3a/d14/d20/fc5 x:0 0 0 2024-09-06T14:44:54.190 INFO:tasks.workunit.client.0.smithi052.stdout:1/654: write d1/db/de/d74/d14/d9f/fdb [1730,64127] 0 2024-09-06T14:44:54.192 INFO:tasks.workunit.client.0.smithi052.stdout:4/588: dread d9/f2e [0,4194304] 0 2024-09-06T14:44:54.211 INFO:tasks.workunit.client.0.smithi052.stdout:1/655: creat d1/db/de/d74/d14/d9f/fe4 x:0 0 0 2024-09-06T14:44:54.211 INFO:tasks.workunit.client.0.smithi052.stdout:4/589: mkdir d9/d72/dca 0 2024-09-06T14:44:54.213 INFO:tasks.workunit.client.0.smithi052.stdout:0/565: creat d0/d1a/daa/fc6 x:0 0 0 2024-09-06T14:44:54.214 INFO:tasks.workunit.client.0.smithi052.stdout:1/656: rmdir d1/db/de/d74/d36/daa 39 2024-09-06T14:44:54.217 INFO:tasks.workunit.client.0.smithi052.stdout:3/686: rename d0/d11/d71/d98/d19/c8e to d0/d11/d12/cda 0 2024-09-06T14:44:54.218 INFO:tasks.workunit.client.0.smithi052.stdout:3/687: dread - d0/d11/fcc zero size 2024-09-06T14:44:54.220 INFO:tasks.workunit.client.0.smithi052.stdout:1/657: mkdir d1/db/de/d74/d12/dd3/de5 0 2024-09-06T14:44:54.222 INFO:tasks.workunit.client.0.smithi052.stdout:4/590: dwrite d9/d10/d17/daa/db5/fb8 [0,4194304] 0 2024-09-06T14:44:54.251 INFO:tasks.workunit.client.0.smithi052.stdout:4/591: dread d9/d10/f1f [4194304,4194304] 0 2024-09-06T14:44:54.253 INFO:tasks.workunit.client.0.smithi052.stdout:4/592: symlink d9/d2d/d33/d5d/da6/lcb 0 2024-09-06T14:44:54.254 INFO:tasks.workunit.client.0.smithi052.stdout:1/658: write d1/db/d50/fa6 [868453,125514] 0 2024-09-06T14:44:54.256 INFO:tasks.workunit.client.0.smithi052.stdout:1/659: stat d1/db/d72/d81/c86 0 2024-09-06T14:44:54.261 INFO:tasks.workunit.client.0.smithi052.stdout:4/593: dread d9/d10/d17/f23 [0,4194304] 0 2024-09-06T14:44:54.261 INFO:tasks.workunit.client.0.smithi052.stdout:3/688: dwrite d0/d11/d71/d98/d1b/f76 [0,4194304] 0 2024-09-06T14:44:54.263 INFO:tasks.workunit.client.0.smithi052.stdout:1/660: mkdir d1/db/de/d74/d14/d90/de6 0 2024-09-06T14:44:54.265 INFO:tasks.workunit.client.0.smithi052.stdout:4/594: chown d9/cc8 8 1 2024-09-06T14:44:54.266 INFO:tasks.workunit.client.0.smithi052.stdout:3/689: creat d0/d11/d71/d98/d1b/d85/fdb x:0 0 0 2024-09-06T14:44:54.267 INFO:tasks.workunit.client.0.smithi052.stdout:1/661: symlink d1/db/d50/da4/le7 0 2024-09-06T14:44:54.268 INFO:tasks.workunit.client.0.smithi052.stdout:3/690: read - d0/d11/d12/d4c/d93/d35/d46/d67/f9b zero size 2024-09-06T14:44:54.269 INFO:tasks.workunit.client.0.smithi052.stdout:3/691: stat d0/d11/d71/d98/d1b/d85/dc5 0 2024-09-06T14:44:54.273 INFO:tasks.workunit.client.0.smithi052.stdout:4/595: truncate d9/d10/d17/d39/d3a/d5c/fa2 927923 0 2024-09-06T14:44:54.276 INFO:tasks.workunit.client.0.smithi052.stdout:3/692: write d0/d11/d71/d98/f4e [280552,19478] 0 2024-09-06T14:44:54.281 INFO:tasks.workunit.client.0.smithi052.stdout:1/662: rename d1/db/de/d74/d36/f7e to d1/db/d76/fe8 0 2024-09-06T14:44:54.283 INFO:tasks.workunit.client.0.smithi052.stdout:4/596: unlink d9/d10/d17/c36 0 2024-09-06T14:44:54.284 INFO:tasks.workunit.client.0.smithi052.stdout:1/663: stat d1/db/de/d74/d14/d9f/dcc/d47/d4a/fa2 0 2024-09-06T14:44:54.284 INFO:tasks.workunit.client.0.smithi052.stdout:3/693: dwrite d0/d11/d12/d4c/d93/d35/d46/d5b/fb3 [0,4194304] 0 2024-09-06T14:44:54.294 INFO:tasks.workunit.client.0.smithi052.stdout:1/664: dwrite d1/db/d18/dc9/fd4 [0,4194304] 0 2024-09-06T14:44:54.298 INFO:tasks.workunit.client.0.smithi052.stdout:4/597: dwrite d9/d10/d17/d39/d3a/d64/fc4 [0,4194304] 0 2024-09-06T14:44:54.302 INFO:tasks.workunit.client.0.smithi052.stdout:4/598: mknod d9/d72/ccc 0 2024-09-06T14:44:54.303 INFO:tasks.workunit.client.0.smithi052.stdout:3/694: truncate d0/d11/d12/d4c/d93/d35/d46/d5b/fb3 2905731 0 2024-09-06T14:44:54.305 INFO:tasks.workunit.client.0.smithi052.stdout:3/695: chown d0/d11/d12/d4c/d93/d35/d46/lba 9 1 2024-09-06T14:44:54.306 INFO:tasks.workunit.client.0.smithi052.stdout:3/696: fdatasync d0/d11/d12/d4c/d93/fac 0 2024-09-06T14:44:54.308 INFO:tasks.workunit.client.0.smithi052.stdout:1/665: creat d1/db/de/d74/d14/fe9 x:0 0 0 2024-09-06T14:44:54.309 INFO:tasks.workunit.client.0.smithi052.stdout:4/599: symlink d9/d2d/d33/d5d/da6/dbf/lcd 0 2024-09-06T14:44:54.310 INFO:tasks.workunit.client.0.smithi052.stdout:1/666: read d1/db/de/d74/d14/d2e/f87 [95152,111321] 0 2024-09-06T14:44:54.311 INFO:tasks.workunit.client.0.smithi052.stdout:3/697: dread d0/d11/d71/d98/d1b/f76 [0,4194304] 0 2024-09-06T14:44:54.312 INFO:tasks.workunit.client.0.smithi052.stdout:4/600: write d9/d10/d17/d39/f58 [4168602,113944] 0 2024-09-06T14:44:54.316 INFO:tasks.workunit.client.0.smithi052.stdout:3/698: truncate d0/d11/d12/d17/fbd 633087 0 2024-09-06T14:44:54.316 INFO:tasks.workunit.client.0.smithi052.stdout:4/601: dread d9/d10/d17/d39/d3a/d5c/fa2 [0,4194304] 0 2024-09-06T14:44:54.316 INFO:tasks.workunit.client.0.smithi052.stdout:1/667: dread d1/db/de/d74/d12/f46 [0,4194304] 0 2024-09-06T14:44:54.317 INFO:tasks.workunit.client.0.smithi052.stdout:3/699: readlink d0/d11/d12/d4c/d93/d35/d46/lca 0 2024-09-06T14:44:54.318 INFO:tasks.workunit.client.0.smithi052.stdout:1/668: write d1/db/d50/fa6 [1709431,118058] 0 2024-09-06T14:44:54.320 INFO:tasks.workunit.client.0.smithi052.stdout:1/669: chown d1/db/de/d74/d12/dd3/de5 114 1 2024-09-06T14:44:54.326 INFO:tasks.workunit.client.0.smithi052.stdout:1/670: creat d1/db/d50/da4/fea x:0 0 0 2024-09-06T14:44:54.327 INFO:tasks.workunit.client.0.smithi052.stdout:3/700: mkdir d0/dcd/ddc 0 2024-09-06T14:44:54.329 INFO:tasks.workunit.client.0.smithi052.stdout:3/701: dread d0/d11/d12/d17/fbd [0,4194304] 0 2024-09-06T14:44:54.329 INFO:tasks.workunit.client.0.smithi052.stdout:1/671: symlink d1/db/d18/leb 0 2024-09-06T14:44:54.334 INFO:tasks.workunit.client.0.smithi052.stdout:4/602: link f7 d9/d10/d17/d39/d7b/d91/fce 0 2024-09-06T14:44:54.336 INFO:tasks.workunit.client.0.smithi052.stdout:1/672: creat d1/db/de/d74/d14/dd1/fec x:0 0 0 2024-09-06T14:44:54.341 INFO:tasks.workunit.client.0.smithi052.stdout:4/603: symlink d9/d2d/d33/d4d/d81/dc1/lcf 0 2024-09-06T14:44:54.343 INFO:tasks.workunit.client.0.smithi052.stdout:4/604: write d9/f69 [1549571,108520] 0 2024-09-06T14:44:54.343 INFO:tasks.workunit.client.0.smithi052.stdout:3/702: dread d0/ff [4194304,4194304] 0 2024-09-06T14:44:54.345 INFO:tasks.workunit.client.0.smithi052.stdout:3/703: chown d0/d11/d71/d98/d1b/d85/d9f/cc8 45812973 1 2024-09-06T14:44:54.345 INFO:tasks.workunit.client.0.smithi052.stdout:3/704: stat d0/d8d 0 2024-09-06T14:44:54.348 INFO:tasks.workunit.client.0.smithi052.stdout:4/605: symlink d9/d2d/ld0 0 2024-09-06T14:44:54.351 INFO:tasks.workunit.client.0.smithi052.stdout:3/705: mknod d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/cdd 0 2024-09-06T14:44:54.352 INFO:tasks.workunit.client.0.smithi052.stdout:3/706: stat d0/d11/d12/d4c/d93/d35/f70 0 2024-09-06T14:44:54.353 INFO:tasks.workunit.client.0.smithi052.stdout:1/673: dwrite d1/db/d76/fe8 [0,4194304] 0 2024-09-06T14:44:54.354 INFO:tasks.workunit.client.0.smithi052.stdout:4/606: creat d9/d2d/d33/d5d/fd1 x:0 0 0 2024-09-06T14:44:54.355 INFO:tasks.workunit.client.0.smithi052.stdout:1/674: chown d1/db/de/d74/d14/d9f/fe4 852205372 1 2024-09-06T14:44:54.358 INFO:tasks.workunit.client.0.smithi052.stdout:4/607: symlink d9/d10/d17/d39/d7b/ld2 0 2024-09-06T14:44:54.358 INFO:tasks.workunit.client.0.smithi052.stdout:3/707: fsync d0/d11/d71/d98/d19/f2f 0 2024-09-06T14:44:54.363 INFO:tasks.workunit.client.0.smithi052.stdout:4/608: dread d9/d10/d19/f2c [0,4194304] 0 2024-09-06T14:44:54.365 INFO:tasks.workunit.client.0.smithi052.stdout:1/675: link d1/db/de/d74/ca5 d1/db/d72/d81/ced 0 2024-09-06T14:44:54.366 INFO:tasks.workunit.client.0.smithi052.stdout:3/708: dwrite d0/d11/f2e [0,4194304] 0 2024-09-06T14:44:54.368 INFO:tasks.workunit.client.0.smithi052.stdout:4/609: unlink d9/cc8 0 2024-09-06T14:44:54.374 INFO:tasks.workunit.client.0.smithi052.stdout:3/709: dwrite d0/d11/d71/d98/f50 [4194304,4194304] 0 2024-09-06T14:44:54.376 INFO:tasks.workunit.client.0.smithi052.stdout:3/710: stat d0/d11/d71/d98/d19/f2f 0 2024-09-06T14:44:54.384 INFO:tasks.workunit.client.0.smithi052.stdout:3/711: read - d0/d11/d12/d4c/d93/d35/fb8 zero size 2024-09-06T14:44:54.385 INFO:tasks.workunit.client.0.smithi052.stdout:1/676: getdents d1/db/d50/da4 0 2024-09-06T14:44:54.392 INFO:tasks.workunit.client.0.smithi052.stdout:3/712: link d0/d11/d12/c90 d0/dcd/ddc/cde 0 2024-09-06T14:44:54.396 INFO:tasks.workunit.client.0.smithi052.stdout:9/428: sync 2024-09-06T14:44:54.396 INFO:tasks.workunit.client.0.smithi052.stdout:5/662: sync 2024-09-06T14:44:54.396 INFO:tasks.workunit.client.0.smithi052.stdout:6/493: sync 2024-09-06T14:44:54.396 INFO:tasks.workunit.client.0.smithi052.stdout:2/626: sync 2024-09-06T14:44:54.396 INFO:tasks.workunit.client.0.smithi052.stdout:8/915: sync 2024-09-06T14:44:54.397 INFO:tasks.workunit.client.0.smithi052.stdout:7/553: sync 2024-09-06T14:44:54.399 INFO:tasks.workunit.client.0.smithi052.stdout:4/610: write d9/d10/d17/d39/d3a/d5c/fa2 [425729,77763] 0 2024-09-06T14:44:54.400 INFO:tasks.workunit.client.0.smithi052.stdout:9/429: readlink d1/d4/d6/dd/d22/l3a 0 2024-09-06T14:44:54.401 INFO:tasks.workunit.client.0.smithi052.stdout:1/677: dread d1/db/de/d74/d12/f63 [0,4194304] 0 2024-09-06T14:44:54.404 INFO:tasks.workunit.client.0.smithi052.stdout:3/713: dwrite d0/d11/d12/d4c/d93/f3e [0,4194304] 0 2024-09-06T14:44:54.409 INFO:tasks.workunit.client.0.smithi052.stdout:8/916: fsync d6/d9/d1f/d19/de3/f110 0 2024-09-06T14:44:54.410 INFO:tasks.workunit.client.0.smithi052.stdout:3/714: write d0/d11/d12/f83 [1320170,39537] 0 2024-09-06T14:44:54.416 INFO:tasks.workunit.client.0.smithi052.stdout:5/663: dwrite d2/d1a/d22/d26/d62/f66 [4194304,4194304] 0 2024-09-06T14:44:54.429 INFO:tasks.workunit.client.0.smithi052.stdout:9/430: write d1/d4/d6/dd/d22/f40 [985501,40603] 0 2024-09-06T14:44:54.429 INFO:tasks.workunit.client.0.smithi052.stdout:3/715: dread d0/d11/f2e [0,4194304] 0 2024-09-06T14:44:54.432 INFO:tasks.workunit.client.0.smithi052.stdout:6/494: dwrite d2/dd/d18/f22 [4194304,4194304] 0 2024-09-06T14:44:54.434 INFO:tasks.workunit.client.0.smithi052.stdout:9/431: chown d1/d26/d41/f67 1 1 2024-09-06T14:44:54.435 INFO:tasks.workunit.client.0.smithi052.stdout:2/627: dwrite da/d19/d3a/d31/d76/f4d [0,4194304] 0 2024-09-06T14:44:54.436 INFO:tasks.workunit.client.0.smithi052.stdout:2/628: chown da/f23 271348264 1 2024-09-06T14:44:54.437 INFO:tasks.workunit.client.0.smithi052.stdout:9/432: chown d1/d4/d6/dd/f5f 44 1 2024-09-06T14:44:54.441 INFO:tasks.workunit.client.0.smithi052.stdout:4/611: dread d9/d10/f22 [0,4194304] 0 2024-09-06T14:44:54.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/554: symlink d11/d1c/lb3 0 2024-09-06T14:44:54.444 INFO:tasks.workunit.client.0.smithi052.stdout:5/664: mknod d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/ce2 0 2024-09-06T14:44:54.446 INFO:tasks.workunit.client.0.smithi052.stdout:6/495: fsync d2/dd/d18/d33/f50 0 2024-09-06T14:44:54.449 INFO:tasks.workunit.client.0.smithi052.stdout:0/566: sync 2024-09-06T14:44:54.450 INFO:tasks.workunit.client.0.smithi052.stdout:3/716: creat d0/d11/d71/d98/d1b/d85/fdf x:0 0 0 2024-09-06T14:44:54.452 INFO:tasks.workunit.client.0.smithi052.stdout:2/629: mkdir da/db/d60/daa/dd4 0 2024-09-06T14:44:54.455 INFO:tasks.workunit.client.0.smithi052.stdout:1/678: link d1/db/d18/d5c/f9a d1/db/d18/d5c/fee 0 2024-09-06T14:44:54.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/496: write d2/dd/d18/d4b/f53 [935549,23958] 0 2024-09-06T14:44:54.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/497: chown d2/dd/d18/d33 797839 1 2024-09-06T14:44:54.466 INFO:tasks.workunit.client.0.smithi052.stdout:6/498: truncate d2/dd/d18/d25/f87 801914 0 2024-09-06T14:44:54.467 INFO:tasks.workunit.client.0.smithi052.stdout:3/717: mkdir d0/d11/d71/de0 0 2024-09-06T14:44:54.467 INFO:tasks.workunit.client.0.smithi052.stdout:8/917: write d6/d9/d1f/d33/da8/d41/d71/f13c [683005,107700] 0 2024-09-06T14:44:54.470 INFO:tasks.workunit.client.0.smithi052.stdout:9/433: write d1/f23 [1343959,47424] 0 2024-09-06T14:44:54.472 INFO:tasks.workunit.client.0.smithi052.stdout:2/630: symlink da/db/d18/d7f/ld5 0 2024-09-06T14:44:54.475 INFO:tasks.workunit.client.0.smithi052.stdout:7/555: write d11/f49 [471998,71393] 0 2024-09-06T14:44:54.477 INFO:tasks.workunit.client.0.smithi052.stdout:3/718: dwrite d0/d11/d12/d4c/d93/d35/f28 [0,4194304] 0 2024-09-06T14:44:54.478 INFO:tasks.workunit.client.0.smithi052.stdout:5/665: write d2/d1a/d22/d26/d62/f75 [2193022,100661] 0 2024-09-06T14:44:54.480 INFO:tasks.workunit.client.0.smithi052.stdout:3/719: dread - d0/d11/d71/d98/d1b/d85/fb1 zero size 2024-09-06T14:44:54.483 INFO:tasks.workunit.client.0.smithi052.stdout:0/567: link d0/d1a/d26/d3a/d14/d20/f48 d0/d1a/d26/fc7 0 2024-09-06T14:44:54.486 INFO:tasks.workunit.client.0.smithi052.stdout:4/612: mknod d9/d2d/d33/d5d/da6/d83/cd3 0 2024-09-06T14:44:54.488 INFO:tasks.workunit.client.0.smithi052.stdout:9/434: rename d1/d4/f5e to d1/d4/d6/dc/d38/f7f 0 2024-09-06T14:44:54.490 INFO:tasks.workunit.client.0.smithi052.stdout:6/499: dread d2/dd/d18/d2d/d32/f3f [0,4194304] 0 2024-09-06T14:44:54.491 INFO:tasks.workunit.client.0.smithi052.stdout:3/720: symlink d0/d11/le1 0 2024-09-06T14:44:54.493 INFO:tasks.workunit.client.0.smithi052.stdout:3/721: chown d0/d11/d71/d98/d1b/d85/fb1 10437 1 2024-09-06T14:44:54.495 INFO:tasks.workunit.client.0.smithi052.stdout:8/918: symlink d6/d9/d1f/d33/da8/d1b/d126/d12b/l149 0 2024-09-06T14:44:54.496 INFO:tasks.workunit.client.0.smithi052.stdout:8/919: readlink d6/d9/d1f/d19/d6f/ld6 0 2024-09-06T14:44:54.499 INFO:tasks.workunit.client.0.smithi052.stdout:4/613: chown d9/cb 7895 1 2024-09-06T14:44:54.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/435: creat d1/d4/d6/dc/d10/f80 x:0 0 0 2024-09-06T14:44:54.507 INFO:tasks.workunit.client.0.smithi052.stdout:1/679: truncate d1/db/de/d74/ff 7366613 0 2024-09-06T14:44:54.509 INFO:tasks.workunit.client.0.smithi052.stdout:5/666: symlink d2/d20/le3 0 2024-09-06T14:44:54.511 INFO:tasks.workunit.client.0.smithi052.stdout:5/667: chown d2/d1a/d22/d26/d2b/d48/d64/dbf 315712 1 2024-09-06T14:44:54.511 INFO:tasks.workunit.client.0.smithi052.stdout:0/568: dread d0/f1c [0,4194304] 0 2024-09-06T14:44:54.512 INFO:tasks.workunit.client.0.smithi052.stdout:3/722: symlink d0/dcd/le2 0 2024-09-06T14:44:54.512 INFO:tasks.workunit.client.0.smithi052.stdout:0/569: chown d0/l67 531 1 2024-09-06T14:44:54.516 INFO:tasks.workunit.client.0.smithi052.stdout:4/614: creat d9/d2d/d33/d4d/d81/fd4 x:0 0 0 2024-09-06T14:44:54.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/556: write d11/f43 [2996263,2273] 0 2024-09-06T14:44:54.516 INFO:tasks.workunit.client.0.smithi052.stdout:4/615: readlink d9/l3e 0 2024-09-06T14:44:54.519 INFO:tasks.workunit.client.0.smithi052.stdout:6/500: creat d2/dd/d7d/fa8 x:0 0 0 2024-09-06T14:44:54.523 INFO:tasks.workunit.client.0.smithi052.stdout:5/668: symlink d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/le4 0 2024-09-06T14:44:54.531 INFO:tasks.workunit.client.0.smithi052.stdout:9/436: dwrite d1/d4/d6/dc/d10/d18/f33 [0,4194304] 0 2024-09-06T14:44:54.534 INFO:tasks.workunit.client.0.smithi052.stdout:4/616: write d9/f5f [264392,44848] 0 2024-09-06T14:44:54.538 INFO:tasks.workunit.client.0.smithi052.stdout:8/920: rename d6/d9/d1f/d33/da8/d41/d71 to d6/d9/d1f/d14/d14a 0 2024-09-06T14:44:54.540 INFO:tasks.workunit.client.0.smithi052.stdout:8/921: truncate d6/d9/fc9 998940 0 2024-09-06T14:44:54.541 INFO:tasks.workunit.client.0.smithi052.stdout:5/669: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/fe5 x:0 0 0 2024-09-06T14:44:54.544 INFO:tasks.workunit.client.0.smithi052.stdout:0/570: write d0/d19/f72 [216743,4425] 0 2024-09-06T14:44:54.544 INFO:tasks.workunit.client.0.smithi052.stdout:7/557: symlink d11/d1c/d87/lb4 0 2024-09-06T14:44:54.545 INFO:tasks.workunit.client.0.smithi052.stdout:1/680: link d1/db/de/d74/d12/c8f d1/db/de/cef 0 2024-09-06T14:44:54.546 INFO:tasks.workunit.client.0.smithi052.stdout:0/571: chown d0/d1a/d26/d3a/d14/d20/f48 918313 1 2024-09-06T14:44:54.546 INFO:tasks.workunit.client.0.smithi052.stdout:7/558: chown d11/d1c/d24/d4b/f9b 268 1 2024-09-06T14:44:54.552 INFO:tasks.workunit.client.0.smithi052.stdout:3/723: rename d0/f3 to d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/fe3 0 2024-09-06T14:44:54.553 INFO:tasks.workunit.client.0.smithi052.stdout:8/922: rename d6/d9/d1f/d14/d14a/f81 to d6/d9/d1f/d14/d14a/f14b 0 2024-09-06T14:44:54.554 INFO:tasks.workunit.client.0.smithi052.stdout:1/681: dwrite d1/db/de/d74/d14/d9f/dcc/f94 [0,4194304] 0 2024-09-06T14:44:54.560 INFO:tasks.workunit.client.0.smithi052.stdout:9/437: symlink d1/d4/d6/l81 0 2024-09-06T14:44:54.568 INFO:tasks.workunit.client.0.smithi052.stdout:0/572: mkdir d0/d1a/d26/d3a/d14/d2d/d56/d9d/dc8 0 2024-09-06T14:44:54.576 INFO:tasks.workunit.client.0.smithi052.stdout:1/682: unlink d1/d5f/f65 0 2024-09-06T14:44:54.578 INFO:tasks.workunit.client.0.smithi052.stdout:5/670: link d2/d1a/d22/d26/d2b/d48/f8d d2/d1a/d22/d26/d2b/d37/d6a/fe6 0 2024-09-06T14:44:54.580 INFO:tasks.workunit.client.0.smithi052.stdout:5/671: read d2/d1a/d22/d26/d62/fb3 [1650540,48490] 0 2024-09-06T14:44:54.580 INFO:tasks.workunit.client.0.smithi052.stdout:9/438: fsync d1/d4/d6/dc/f61 0 2024-09-06T14:44:54.584 INFO:tasks.workunit.client.0.smithi052.stdout:4/617: write d9/d10/d17/d39/d3a/d5c/f7f [196225,63397] 0 2024-09-06T14:44:54.587 INFO:tasks.workunit.client.0.smithi052.stdout:9/439: dwrite d1/d4/d4b/f62 [0,4194304] 0 2024-09-06T14:44:54.592 INFO:tasks.workunit.client.0.smithi052.stdout:7/559: creat d11/d1c/d57/fb5 x:0 0 0 2024-09-06T14:44:54.594 INFO:tasks.workunit.client.0.smithi052.stdout:8/923: dwrite d6/d9/d1f/d19/f93 [0,4194304] 0 2024-09-06T14:44:54.600 INFO:tasks.workunit.client.0.smithi052.stdout:3/724: truncate d0/d11/d71/d98/d19/f7f 926736 0 2024-09-06T14:44:54.604 INFO:tasks.workunit.client.0.smithi052.stdout:0/573: creat d0/d1a/d26/d3a/d14/d2d/d56/da3/dc2/fc9 x:0 0 0 2024-09-06T14:44:54.605 INFO:tasks.workunit.client.0.smithi052.stdout:9/440: mkdir d1/d4/d6/dc/d10/d18/d82 0 2024-09-06T14:44:54.606 INFO:tasks.workunit.client.0.smithi052.stdout:3/725: write d0/d11/d12/d4c/d93/d35/d46/d67/f9b [639582,66226] 0 2024-09-06T14:44:54.677 INFO:tasks.workunit.client.0.smithi052.stdout:7/560: unlink d11/d1c/d24/d3b/d50/f92 0 2024-09-06T14:44:54.685 INFO:tasks.workunit.client.0.smithi052.stdout:5/672: dwrite d2/f11 [0,4194304] 0 2024-09-06T14:44:54.687 INFO:tasks.workunit.client.0.smithi052.stdout:0/574: creat d0/d1a/d26/d3a/fca x:0 0 0 2024-09-06T14:44:54.689 INFO:tasks.workunit.client.0.smithi052.stdout:9/441: symlink d1/d4/d6/dd/d2b/l83 0 2024-09-06T14:44:54.691 INFO:tasks.workunit.client.0.smithi052.stdout:9/442: write d1/d4/f43 [5226382,80362] 0 2024-09-06T14:44:54.692 INFO:tasks.workunit.client.0.smithi052.stdout:5/673: dread d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fb5 [0,4194304] 0 2024-09-06T14:44:54.695 INFO:tasks.workunit.client.0.smithi052.stdout:8/924: mkdir d6/d22/d36/d3e/d47/d56/d14c 0 2024-09-06T14:44:54.697 INFO:tasks.workunit.client.0.smithi052.stdout:1/683: dwrite d1/db/de/d74/ff [0,4194304] 0 2024-09-06T14:44:54.697 INFO:tasks.workunit.client.0.smithi052.stdout:9/443: truncate d1/d4/d6/dc/d10/d18/f74 1330333 0 2024-09-06T14:44:54.701 INFO:tasks.workunit.client.0.smithi052.stdout:5/674: chown d2/d1a/d22/d26/d2b/l2e 46955 1 2024-09-06T14:44:54.702 INFO:tasks.workunit.client.0.smithi052.stdout:8/925: rmdir d6/d22/d36/d3e/df6 39 2024-09-06T14:44:54.704 INFO:tasks.workunit.client.0.smithi052.stdout:9/444: write d1/d4/d6/f6c [945956,129750] 0 2024-09-06T14:44:54.707 INFO:tasks.workunit.client.0.smithi052.stdout:0/575: rename d0/d1a/d26/d3a/f88 to d0/d2e/fcb 0 2024-09-06T14:44:54.708 INFO:tasks.workunit.client.0.smithi052.stdout:0/576: chown d0/d4f/d7d/f86 215 1 2024-09-06T14:44:54.709 INFO:tasks.workunit.client.0.smithi052.stdout:7/561: creat d11/d1c/d24/fb6 x:0 0 0 2024-09-06T14:44:54.713 INFO:tasks.workunit.client.0.smithi052.stdout:5/675: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fe7 x:0 0 0 2024-09-06T14:44:54.716 INFO:tasks.workunit.client.0.smithi052.stdout:9/445: creat d1/d4/d6/dc/d10/d18/f84 x:0 0 0 2024-09-06T14:44:54.718 INFO:tasks.workunit.client.0.smithi052.stdout:3/726: dread d0/f1a [0,4194304] 0 2024-09-06T14:44:54.719 INFO:tasks.workunit.client.0.smithi052.stdout:5/676: mkdir d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/de8 0 2024-09-06T14:44:54.720 INFO:tasks.workunit.client.0.smithi052.stdout:3/727: chown d0/d11/d12/d4c/d93/d64/l69 61198 1 2024-09-06T14:44:54.720 INFO:tasks.workunit.client.0.smithi052.stdout:5/677: readlink d2/d20/d42/d8b/dca/ld7 0 2024-09-06T14:44:54.721 INFO:tasks.workunit.client.0.smithi052.stdout:5/678: write d2/d20/d42/d65/f55 [750892,129731] 0 2024-09-06T14:44:54.722 INFO:tasks.workunit.client.0.smithi052.stdout:5/679: readlink d2/d20/d42/d8b/dca/ld7 0 2024-09-06T14:44:54.725 INFO:tasks.workunit.client.0.smithi052.stdout:0/577: creat d0/d1a/d26/d3a/d14/d20/dbf/fcc x:0 0 0 2024-09-06T14:44:54.726 INFO:tasks.workunit.client.0.smithi052.stdout:0/578: write d0/d2e/fac [240328,61050] 0 2024-09-06T14:44:54.727 INFO:tasks.workunit.client.0.smithi052.stdout:1/684: link d1/db/de/d74/d36/d9b/lde d1/db/de/d74/d14/d9f/dcc/d47/d4a/lf0 0 2024-09-06T14:44:54.732 INFO:tasks.workunit.client.0.smithi052.stdout:8/926: rename d6/d9/d1f/d33/da8/f57 to d6/d9/d1f/f14d 0 2024-09-06T14:44:54.733 INFO:tasks.workunit.client.0.smithi052.stdout:8/927: chown d6/d9/d1f/d33/da8/d41/db8/ff8 772 1 2024-09-06T14:44:54.733 INFO:tasks.workunit.client.0.smithi052.stdout:8/928: write d6/d9/d1f/d14/fe0 [403295,77392] 0 2024-09-06T14:44:54.734 INFO:tasks.workunit.client.0.smithi052.stdout:8/929: stat d6/d22/d31/c90 0 2024-09-06T14:44:54.734 INFO:tasks.workunit.client.0.smithi052.stdout:8/930: chown d6/d3c/f83 57873 1 2024-09-06T14:44:54.737 INFO:tasks.workunit.client.0.smithi052.stdout:1/685: mknod d1/db/de/d74/d14/d9f/cf1 0 2024-09-06T14:44:54.737 INFO:tasks.workunit.client.0.smithi052.stdout:8/931: truncate d6/d9/d1f/d19/d6f/d72/f10e 994623 0 2024-09-06T14:44:54.744 INFO:tasks.workunit.client.0.smithi052.stdout:3/728: link d0/d11/d12/l77 d0/d11/d71/d98/d1b/d85/d9f/le4 0 2024-09-06T14:44:54.748 INFO:tasks.workunit.client.0.smithi052.stdout:7/562: rename d11/d1c/d3f/f72 to d11/d1c/d24/fb7 0 2024-09-06T14:44:54.752 INFO:tasks.workunit.client.0.smithi052.stdout:3/729: mknod d0/d11/d12/d4c/d93/d35/d46/ce5 0 2024-09-06T14:44:54.753 INFO:tasks.workunit.client.0.smithi052.stdout:3/730: chown d0/d11/d12/d17/d7b 20499722 1 2024-09-06T14:44:54.753 INFO:tasks.workunit.client.0.smithi052.stdout:7/563: dread d11/d1c/d26/f60 [0,4194304] 0 2024-09-06T14:44:54.754 INFO:tasks.workunit.client.0.smithi052.stdout:7/564: stat d11/d1c/d24/f35 0 2024-09-06T14:44:54.754 INFO:tasks.workunit.client.0.smithi052.stdout:1/686: getdents d1/db/de/d74/d14/dd1 0 2024-09-06T14:44:54.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/565: fsync d11/d1c/fa9 0 2024-09-06T14:44:54.761 INFO:tasks.workunit.client.0.smithi052.stdout:1/687: fsync d1/db/de/d74/d14/d9f/dcc/d47/d4a/f77 0 2024-09-06T14:44:54.761 INFO:tasks.workunit.client.0.smithi052.stdout:3/731: dwrite d0/d8d/f9e [0,4194304] 0 2024-09-06T14:44:54.762 INFO:tasks.workunit.client.0.smithi052.stdout:3/732: truncate d0/f9a 670147 0 2024-09-06T14:44:54.763 INFO:tasks.workunit.client.0.smithi052.stdout:3/733: stat d0/f9a 0 2024-09-06T14:44:54.763 INFO:tasks.workunit.client.0.smithi052.stdout:5/680: rename d2/d20/l98 to d2/d1a/d22/d26/d2b/d48/d64/dbf/le9 0 2024-09-06T14:44:54.763 INFO:tasks.workunit.client.0.smithi052.stdout:1/688: dread - d1/d6c/d98/f9e zero size 2024-09-06T14:44:54.771 INFO:tasks.workunit.client.0.smithi052.stdout:1/689: creat d1/db/de/d74/ff2 x:0 0 0 2024-09-06T14:44:54.771 INFO:tasks.workunit.client.0.smithi052.stdout:9/446: write d1/d4/d6/dc/d10/d18/f5d [2237276,32165] 0 2024-09-06T14:44:54.773 INFO:tasks.workunit.client.0.smithi052.stdout:1/690: chown d1/db/de/d74/d12/f46 15832075 1 2024-09-06T14:44:54.775 INFO:tasks.workunit.client.0.smithi052.stdout:1/691: fsync d1/db/de/d74/d14/d9f/dcc/d47/d4a/f95 0 2024-09-06T14:44:54.777 INFO:tasks.workunit.client.0.smithi052.stdout:7/566: dread d11/d1c/d24/f41 [0,4194304] 0 2024-09-06T14:44:54.777 INFO:tasks.workunit.client.0.smithi052.stdout:9/447: rename d1/d4/df/d56/l6f to d1/d26/l85 0 2024-09-06T14:44:54.778 INFO:tasks.workunit.client.0.smithi052.stdout:1/692: mkdir d1/db/de/d68/df3 0 2024-09-06T14:44:54.778 INFO:tasks.workunit.client.0.smithi052.stdout:9/448: write d1/d4/df/f24 [2453576,67831] 0 2024-09-06T14:44:54.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/567: rename d11/d1c/f1d to d11/d1c/d24/fb8 0 2024-09-06T14:44:54.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/568: chown d11/d1c/d26/f28 42062014 1 2024-09-06T14:44:54.787 INFO:tasks.workunit.client.0.smithi052.stdout:7/569: chown d11/d1c/d24/d64/l66 67411 1 2024-09-06T14:44:54.789 INFO:tasks.workunit.client.0.smithi052.stdout:1/693: creat d1/db/de/d74/d36/ff4 x:0 0 0 2024-09-06T14:44:54.789 INFO:tasks.workunit.client.0.smithi052.stdout:9/449: link d1/fa d1/d4/df/d56/f86 0 2024-09-06T14:44:54.791 INFO:tasks.workunit.client.0.smithi052.stdout:1/694: dread - d1/db/de/d74/d14/dd1/fec zero size 2024-09-06T14:44:54.793 INFO:tasks.workunit.client.0.smithi052.stdout:0/579: dwrite d0/d1a/d26/d3a/d14/d2d/d56/f73 [0,4194304] 0 2024-09-06T14:44:54.795 INFO:tasks.workunit.client.0.smithi052.stdout:1/695: write d1/db/de/d74/d14/d9f/fe4 [395020,115684] 0 2024-09-06T14:44:54.795 INFO:tasks.workunit.client.0.smithi052.stdout:7/570: creat d11/d1c/d57/fb9 x:0 0 0 2024-09-06T14:44:54.795 INFO:tasks.workunit.client.0.smithi052.stdout:9/450: truncate d1/d4/d6/dc/f61 83882 0 2024-09-06T14:44:54.796 INFO:tasks.workunit.client.0.smithi052.stdout:1/696: readlink d1/db/de/d74/l62 0 2024-09-06T14:44:54.797 INFO:tasks.workunit.client.0.smithi052.stdout:7/571: stat d11/d1c/d3f/d5d/d88/ca1 0 2024-09-06T14:44:54.798 INFO:tasks.workunit.client.0.smithi052.stdout:0/580: creat d0/d1a/d26/d3a/d14/d2d/d92/fcd x:0 0 0 2024-09-06T14:44:54.798 INFO:tasks.workunit.client.0.smithi052.stdout:1/697: readlink d1/db/de/d74/d14/d2e/l48 0 2024-09-06T14:44:54.799 INFO:tasks.workunit.client.0.smithi052.stdout:7/572: unlink d11/d1c/d24/d4b/l53 0 2024-09-06T14:44:54.801 INFO:tasks.workunit.client.0.smithi052.stdout:0/581: write d0/d1a/d26/d3a/d14/d2d/d56/da3/dc2/fc9 [41874,130127] 0 2024-09-06T14:44:54.803 INFO:tasks.workunit.client.0.smithi052.stdout:7/573: symlink d11/d1c/d3f/d5d/lba 0 2024-09-06T14:44:54.804 INFO:tasks.workunit.client.0.smithi052.stdout:0/582: stat d0/d19/f59 0 2024-09-06T14:44:54.805 INFO:tasks.workunit.client.0.smithi052.stdout:9/451: truncate d1/d4/d6/dc/d10/d18/f3c 1894312 0 2024-09-06T14:44:54.813 INFO:tasks.workunit.client.0.smithi052.stdout:7/574: rename d11/d1c/c81 to d11/d1c/d57/d89/cbb 0 2024-09-06T14:44:54.814 INFO:tasks.workunit.client.0.smithi052.stdout:7/575: truncate d11/f21 1404895 0 2024-09-06T14:44:54.818 INFO:tasks.workunit.client.0.smithi052.stdout:9/452: dread d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:54.818 INFO:tasks.workunit.client.0.smithi052.stdout:7/576: symlink d11/d1c/d57/lbc 0 2024-09-06T14:44:54.819 INFO:tasks.workunit.client.0.smithi052.stdout:9/453: readlink d1/d4/d6/dc/d10/d18/l52 0 2024-09-06T14:44:54.823 INFO:tasks.workunit.client.0.smithi052.stdout:9/454: mkdir d1/d26/d87 0 2024-09-06T14:44:54.826 INFO:tasks.workunit.client.0.smithi052.stdout:9/455: creat d1/d4/d6/dd/d22/d6a/f88 x:0 0 0 2024-09-06T14:44:54.829 INFO:tasks.workunit.client.0.smithi052.stdout:5/681: truncate d2/f38 3833171 0 2024-09-06T14:44:54.831 INFO:tasks.workunit.client.0.smithi052.stdout:3/734: truncate d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/fe3 709798 0 2024-09-06T14:44:54.832 INFO:tasks.workunit.client.0.smithi052.stdout:3/735: stat d0/d89 0 2024-09-06T14:44:54.835 INFO:tasks.workunit.client.0.smithi052.stdout:5/682: rename d2/d1a/d22/d26/d2b/d48/d64/f8f to d2/d1a/d22/d26/d2b/d48/fea 0 2024-09-06T14:44:54.838 INFO:tasks.workunit.client.0.smithi052.stdout:3/736: dwrite d0/d11/d71/d98/d1b/d85/faa [0,4194304] 0 2024-09-06T14:44:54.841 INFO:tasks.workunit.client.0.smithi052.stdout:3/737: mknod d0/d8d/ce6 0 2024-09-06T14:44:54.843 INFO:tasks.workunit.client.0.smithi052.stdout:3/738: chown d0/d11/d12/c90 298 1 2024-09-06T14:44:54.845 INFO:tasks.workunit.client.0.smithi052.stdout:3/739: mknod d0/d11/d71/ce7 0 2024-09-06T14:44:54.846 INFO:tasks.workunit.client.0.smithi052.stdout:3/740: readlink d0/d11/d12/d4c/d93/d35/lc9 0 2024-09-06T14:44:54.848 INFO:tasks.workunit.client.0.smithi052.stdout:3/741: read d0/d11/d12/f47 [1418287,1826] 0 2024-09-06T14:44:54.852 INFO:tasks.workunit.client.0.smithi052.stdout:3/742: unlink d0/d11/d12/d4c/d93/d35/lc9 0 2024-09-06T14:44:54.853 INFO:tasks.workunit.client.0.smithi052.stdout:3/743: chown d0/d11/d12/d17/fa7 11 1 2024-09-06T14:44:54.855 INFO:tasks.workunit.client.0.smithi052.stdout:3/744: unlink d0/d8d/f9e 0 2024-09-06T14:44:54.856 INFO:tasks.workunit.client.0.smithi052.stdout:3/745: readlink d0/d11/d71/d98/l6a 0 2024-09-06T14:44:54.857 INFO:tasks.workunit.client.0.smithi052.stdout:3/746: chown d0/d11/d12/d4c/c75 8450 1 2024-09-06T14:44:54.857 INFO:tasks.workunit.client.0.smithi052.stdout:7/577: getdents d11/d1c/d3f/d5d 0 2024-09-06T14:44:54.860 INFO:tasks.workunit.client.0.smithi052.stdout:3/747: write d0/d11/d71/d98/d9d/fc4 [47629,27051] 0 2024-09-06T14:44:54.863 INFO:tasks.workunit.client.0.smithi052.stdout:3/748: mkdir d0/d11/d12/d73/de8 0 2024-09-06T14:44:54.865 INFO:tasks.workunit.client.0.smithi052.stdout:7/578: dwrite d11/d1c/d24/d64/faf [0,4194304] 0 2024-09-06T14:44:54.867 INFO:tasks.workunit.client.0.smithi052.stdout:3/749: mknod d0/d11/d12/d17/d7b/ce9 0 2024-09-06T14:44:54.873 INFO:tasks.workunit.client.0.smithi052.stdout:7/579: creat d11/d1c/d3f/d5d/fbd x:0 0 0 2024-09-06T14:44:54.876 INFO:tasks.workunit.client.0.smithi052.stdout:0/583: dwrite d0/d18/f5f [4194304,4194304] 0 2024-09-06T14:44:54.878 INFO:tasks.workunit.client.0.smithi052.stdout:0/584: dread - d0/d1a/d26/d3a/d14/d20/d22/d41/d8a/fb2 zero size 2024-09-06T14:44:54.884 INFO:tasks.workunit.client.0.smithi052.stdout:7/580: creat d11/d1c/d24/d7e/fbe x:0 0 0 2024-09-06T14:44:54.887 INFO:tasks.workunit.client.0.smithi052.stdout:7/581: write d11/d1c/d26/f94 [124008,32733] 0 2024-09-06T14:44:54.889 INFO:tasks.workunit.client.0.smithi052.stdout:7/582: dread d11/d1c/d26/f60 [0,4194304] 0 2024-09-06T14:44:54.896 INFO:tasks.workunit.client.0.smithi052.stdout:3/750: rename d0/dcd/ddc to d0/d11/d12/dea 0 2024-09-06T14:44:54.898 INFO:tasks.workunit.client.0.smithi052.stdout:7/583: write d11/d1c/d26/f67 [410128,79396] 0 2024-09-06T14:44:54.898 INFO:tasks.workunit.client.0.smithi052.stdout:3/751: dread - d0/d11/d12/d4c/d93/d35/d46/d5b/fa3 zero size 2024-09-06T14:44:54.899 INFO:tasks.workunit.client.0.smithi052.stdout:9/456: write d1/d4/d6/dc/d10/d18/f5b [903271,17823] 0 2024-09-06T14:44:54.901 INFO:tasks.workunit.client.0.smithi052.stdout:3/752: fsync d0/d11/d71/d98/d1b/d85/fb1 0 2024-09-06T14:44:54.903 INFO:tasks.workunit.client.0.smithi052.stdout:9/457: read d1/d4/df/f24 [2330369,97068] 0 2024-09-06T14:44:54.904 INFO:tasks.workunit.client.0.smithi052.stdout:7/584: fsync d11/d1c/f7c 0 2024-09-06T14:44:54.905 INFO:tasks.workunit.client.0.smithi052.stdout:7/585: fsync d11/d1c/f32 0 2024-09-06T14:44:54.906 INFO:tasks.workunit.client.0.smithi052.stdout:7/586: write d11/d1c/d24/d4b/f4c [3107404,78359] 0 2024-09-06T14:44:54.911 INFO:tasks.workunit.client.0.smithi052.stdout:0/585: dread d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/f6c [0,4194304] 0 2024-09-06T14:44:54.917 INFO:tasks.workunit.client.0.smithi052.stdout:7/587: creat d11/d1c/d24/d3b/fbf x:0 0 0 2024-09-06T14:44:54.918 INFO:tasks.workunit.client.0.smithi052.stdout:3/753: symlink d0/leb 0 2024-09-06T14:44:54.924 INFO:tasks.workunit.client.0.smithi052.stdout:7/588: fdatasync d11/d1c/d24/f41 0 2024-09-06T14:44:54.927 INFO:tasks.workunit.client.0.smithi052.stdout:3/754: mkdir d0/d11/d12/d4c/d93/d64/dec 0 2024-09-06T14:44:54.933 INFO:tasks.workunit.client.0.smithi052.stdout:5/683: dwrite d2/d1a/d22/d26/d2b/d37/f44 [4194304,4194304] 0 2024-09-06T14:44:54.937 INFO:tasks.workunit.client.0.smithi052.stdout:7/589: truncate d11/d1c/d24/d3b/d50/f58 705595 0 2024-09-06T14:44:54.938 INFO:tasks.workunit.client.0.smithi052.stdout:3/755: write d0/d11/d12/d4c/d93/d35/d46/d5b/da0/da6/fc3 [6784839,38656] 0 2024-09-06T14:44:54.942 INFO:tasks.workunit.client.0.smithi052.stdout:7/590: symlink d11/d1c/d3f/d5d/d88/lc0 0 2024-09-06T14:44:54.953 INFO:tasks.workunit.client.0.smithi052.stdout:5/684: link d2/d1a/d22/d26/d2b/d37/l50 d2/d1a/d22/d26/d2b/leb 0 2024-09-06T14:44:54.957 INFO:tasks.workunit.client.0.smithi052.stdout:5/685: read d2/d20/f23 [1752816,16901] 0 2024-09-06T14:44:54.968 INFO:tasks.workunit.client.0.smithi052.stdout:5/686: truncate d2/d1a/d22/f45 1034365 0 2024-09-06T14:44:54.971 INFO:tasks.workunit.client.0.smithi052.stdout:9/458: dwrite d1/d26/f4c [0,4194304] 0 2024-09-06T14:44:54.973 INFO:tasks.workunit.client.0.smithi052.stdout:9/459: dread - d1/d4/d6/dd/d22/d6a/f88 zero size 2024-09-06T14:44:54.977 INFO:tasks.workunit.client.0.smithi052.stdout:3/756: dread d0/d11/f40 [0,4194304] 0 2024-09-06T14:44:54.978 INFO:tasks.workunit.client.0.smithi052.stdout:9/460: rmdir d1/d4/d6/dc/d10/d18 39 2024-09-06T14:44:54.984 INFO:tasks.workunit.client.0.smithi052.stdout:3/757: chown d0/d11/l74 3 1 2024-09-06T14:44:54.986 INFO:tasks.workunit.client.0.smithi052.stdout:0/586: dwrite d0/d2e/f4b [4194304,4194304] 0 2024-09-06T14:44:54.989 INFO:tasks.workunit.client.0.smithi052.stdout:0/587: write d0/d1a/d26/d3a/d14/d20/dbf/fcc [328931,77679] 0 2024-09-06T14:44:54.995 INFO:tasks.workunit.client.0.smithi052.stdout:3/758: dwrite d0/d11/d12/d4c/d93/d35/f28 [0,4194304] 0 2024-09-06T14:44:55.002 INFO:tasks.workunit.client.0.smithi052.stdout:9/461: dread d1/d4/d6/f6c [0,4194304] 0 2024-09-06T14:44:55.002 INFO:tasks.workunit.client.0.smithi052.stdout:3/759: chown d0/d11/d12/d4c/d93/d35/d46/d5b/cb0 116 1 2024-09-06T14:44:55.002 INFO:tasks.workunit.client.0.smithi052.stdout:7/591: dwrite d11/d1c/d24/f44 [0,4194304] 0 2024-09-06T14:44:55.004 INFO:tasks.workunit.client.0.smithi052.stdout:0/588: creat d0/d1a/fce x:0 0 0 2024-09-06T14:44:55.006 INFO:tasks.workunit.client.0.smithi052.stdout:3/760: chown d0/d11/d12/d4c/d93/d35/f28 168 1 2024-09-06T14:44:55.009 INFO:tasks.workunit.client.0.smithi052.stdout:9/462: write d1/d4/d6/dc/d10/d18/f74 [1202507,107316] 0 2024-09-06T14:44:55.012 INFO:tasks.workunit.client.0.smithi052.stdout:5/687: truncate d2/d20/d42/d8b/fab 1151218 0 2024-09-06T14:44:55.014 INFO:tasks.workunit.client.0.smithi052.stdout:7/592: creat d11/d1c/d24/d7e/fc1 x:0 0 0 2024-09-06T14:44:55.015 INFO:tasks.workunit.client.0.smithi052.stdout:7/593: chown d11/f23 0 1 2024-09-06T14:44:55.016 INFO:tasks.workunit.client.0.smithi052.stdout:7/594: write d11/d1c/d24/fb6 [984876,65740] 0 2024-09-06T14:44:55.017 INFO:tasks.workunit.client.0.smithi052.stdout:3/761: truncate d0/d11/d12/f41 1477387 0 2024-09-06T14:44:55.020 INFO:tasks.workunit.client.0.smithi052.stdout:9/463: symlink d1/d26/d41/d7e/l89 0 2024-09-06T14:44:55.022 INFO:tasks.workunit.client.0.smithi052.stdout:9/464: read d1/d4/f5 [3221907,53633] 0 2024-09-06T14:44:55.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/589: rename d0/d1a/d8e/fab to d0/d1a/d26/d3a/d14/fcf 0 2024-09-06T14:44:55.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/688: creat d2/d20/d56/fec x:0 0 0 2024-09-06T14:44:55.074 INFO:tasks.workunit.client.0.smithi052.stdout:9/465: dread - d1/d4/d6/dc/d10/d18/f4e zero size 2024-09-06T14:44:55.076 INFO:tasks.workunit.client.0.smithi052.stdout:7/595: rename d11/d1c/d24/c33 to d11/d1c/d78/cc2 0 2024-09-06T14:44:55.080 INFO:tasks.workunit.client.0.smithi052.stdout:0/590: creat d0/d1a/d26/d3a/d14/d20/d22/d41/fd0 x:0 0 0 2024-09-06T14:44:55.082 INFO:tasks.workunit.client.0.smithi052.stdout:0/591: write d0/d1a/d26/f87 [244425,29913] 0 2024-09-06T14:44:55.082 INFO:tasks.workunit.client.0.smithi052.stdout:5/689: creat d2/d20/d42/d65/fed x:0 0 0 2024-09-06T14:44:55.083 INFO:tasks.workunit.client.0.smithi052.stdout:5/690: readlink d2/la 0 2024-09-06T14:44:55.086 INFO:tasks.workunit.client.0.smithi052.stdout:3/762: mknod d0/d11/d12/d73/de8/ced 0 2024-09-06T14:44:55.087 INFO:tasks.workunit.client.0.smithi052.stdout:5/691: write d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/fa1 [215833,52241] 0 2024-09-06T14:44:55.095 INFO:tasks.workunit.client.0.smithi052.stdout:0/592: rename d0/d1a/d26/d3a/d14/d20/d22/d41/l45 to d0/d1a/d26/d3a/d14/d2d/d92/ld1 0 2024-09-06T14:44:55.097 INFO:tasks.workunit.client.0.smithi052.stdout:5/692: readlink d2/d1a/d22/d26/d2b/d37/l50 0 2024-09-06T14:44:55.102 INFO:tasks.workunit.client.0.smithi052.stdout:0/593: creat d0/d1a/d26/d3a/d14/d2d/d56/da3/fd2 x:0 0 0 2024-09-06T14:44:55.102 INFO:tasks.workunit.client.0.smithi052.stdout:9/466: write d1/d4/f7 [2448539,81660] 0 2024-09-06T14:44:55.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/693: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/fcb [0,4194304] 0 2024-09-06T14:44:55.105 INFO:tasks.workunit.client.0.smithi052.stdout:7/596: getdents d11/d1c/d24/d3b 0 2024-09-06T14:44:55.106 INFO:tasks.workunit.client.0.smithi052.stdout:9/467: fdatasync d1/d4/d6/dc/d10/d18/f76 0 2024-09-06T14:44:55.108 INFO:tasks.workunit.client.0.smithi052.stdout:9/468: fsync d1/f23 0 2024-09-06T14:44:55.112 INFO:tasks.workunit.client.0.smithi052.stdout:0/594: rename d0/d1a/d26/d3a/d14/d2d/f83 to d0/d1a/d26/fd3 0 2024-09-06T14:44:55.114 INFO:tasks.workunit.client.0.smithi052.stdout:7/597: creat d11/d1c/d24/d4b/da2/fc3 x:0 0 0 2024-09-06T14:44:55.117 INFO:tasks.workunit.client.0.smithi052.stdout:5/694: rmdir d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/de8 0 2024-09-06T14:44:55.118 INFO:tasks.workunit.client.0.smithi052.stdout:7/598: mknod d11/d1c/d24/cc4 0 2024-09-06T14:44:55.119 INFO:tasks.workunit.client.0.smithi052.stdout:5/695: write d2/d20/fac [419741,79611] 0 2024-09-06T14:44:55.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:54 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:55.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:54 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:55.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:54 smithi052 ceph-mon[28627]: Reconfiguring prometheus.smithi052 (dependencies changed)... 2024-09-06T14:44:55.123 INFO:tasks.workunit.client.0.smithi052.stdout:0/595: truncate d0/d3d/f99 1946897 0 2024-09-06T14:44:55.125 INFO:tasks.workunit.client.0.smithi052.stdout:0/596: write d0/d1a/d26/d3a/d14/d20/dbf/fcc [1202003,33415] 0 2024-09-06T14:44:55.129 INFO:tasks.workunit.client.0.smithi052.stdout:5/696: link d2/d1a/d22/f7a d2/fee 0 2024-09-06T14:44:55.132 INFO:tasks.workunit.client.0.smithi052.stdout:7/599: dwrite d11/d1c/d24/d3b/f56 [0,4194304] 0 2024-09-06T14:44:55.133 INFO:tasks.workunit.client.0.smithi052.stdout:7/600: chown d11/d1c/d24/f35 2277 1 2024-09-06T14:44:55.140 INFO:tasks.workunit.client.0.smithi052.stdout:5/697: write d2/d20/f23 [219591,26945] 0 2024-09-06T14:44:55.142 INFO:tasks.workunit.client.0.smithi052.stdout:7/601: getdents d11/d1c/d87 0 2024-09-06T14:44:55.144 INFO:tasks.workunit.client.0.smithi052.stdout:5/698: fdatasync d2/d1a/d22/d26/d2b/d37/d6a/f8e 0 2024-09-06T14:44:55.147 INFO:tasks.workunit.client.0.smithi052.stdout:7/602: dread d11/d1c/d3f/f7f [0,4194304] 0 2024-09-06T14:44:55.147 INFO:tasks.workunit.client.0.smithi052.stdout:5/699: creat d2/d20/d42/fef x:0 0 0 2024-09-06T14:44:55.152 INFO:tasks.workunit.client.0.smithi052.stdout:7/603: unlink d11/d1c/d78/cc2 0 2024-09-06T14:44:55.153 INFO:tasks.workunit.client.0.smithi052.stdout:7/604: write d11/d1c/d24/fb6 [1541784,116741] 0 2024-09-06T14:44:55.154 INFO:tasks.workunit.client.0.smithi052.stdout:7/605: chown d11/d1c/d24/d64/faf 0 1 2024-09-06T14:44:55.155 INFO:tasks.workunit.client.0.smithi052.stdout:5/700: link d2/c1f d2/d1a/ddb/cf0 0 2024-09-06T14:44:55.155 INFO:tasks.workunit.client.0.smithi052.stdout:5/701: fsync d2/ff 0 2024-09-06T14:44:55.156 INFO:tasks.workunit.client.0.smithi052.stdout:5/702: readlink d2/l35 0 2024-09-06T14:44:55.157 INFO:tasks.workunit.client.0.smithi052.stdout:5/703: write d2/d1a/f82 [982483,71367] 0 2024-09-06T14:44:55.158 INFO:tasks.workunit.client.0.smithi052.stdout:7/606: rename d11/d1c/d24/fb7 to d11/d1c/d3f/d73/dae/fc5 0 2024-09-06T14:44:55.159 INFO:tasks.workunit.client.0.smithi052.stdout:7/607: chown d11/d1c/d57 200 1 2024-09-06T14:44:55.161 INFO:tasks.workunit.client.0.smithi052.stdout:5/704: read d2/d1a/d22/d26/d2b/fdf [1656099,47913] 0 2024-09-06T14:44:55.162 INFO:tasks.workunit.client.0.smithi052.stdout:7/608: getdents d11/d1c/d78/d98 0 2024-09-06T14:44:55.164 INFO:tasks.workunit.client.0.smithi052.stdout:7/609: write d11/d1c/d24/f44 [3977493,115295] 0 2024-09-06T14:44:55.168 INFO:tasks.workunit.client.0.smithi052.stdout:5/705: dread d2/d1a/d22/f7a [0,4194304] 0 2024-09-06T14:44:55.168 INFO:tasks.workunit.client.0.smithi052.stdout:5/706: readlink d2/l21 0 2024-09-06T14:44:55.168 INFO:tasks.workunit.client.0.smithi052.stdout:7/610: link d11/d1c/d3f/f9e d11/d1c/d3f/d73/dae/fc6 0 2024-09-06T14:44:55.169 INFO:tasks.workunit.client.0.smithi052.stdout:7/611: stat d11 0 2024-09-06T14:44:55.169 INFO:tasks.workunit.client.0.smithi052.stdout:7/612: fdatasync d11/d1c/d57/f9f 0 2024-09-06T14:44:55.172 INFO:tasks.workunit.client.0.smithi052.stdout:5/707: creat d2/d1a/ff1 x:0 0 0 2024-09-06T14:44:55.173 INFO:tasks.workunit.client.0.smithi052.stdout:5/708: write d2/d20/fac [129867,53437] 0 2024-09-06T14:44:55.189 INFO:tasks.workunit.client.0.smithi052.stdout:5/709: dread d2/d1a/d22/d26/d62/fb3 [0,4194304] 0 2024-09-06T14:44:55.195 INFO:tasks.workunit.client.0.smithi052.stdout:5/710: stat d2/d20/d42/d65/fda 0 2024-09-06T14:44:55.223 INFO:tasks.workunit.client.0.smithi052.stdout:5/711: creat d2/d20/d42/d65/ff2 x:0 0 0 2024-09-06T14:44:55.230 INFO:tasks.workunit.client.0.smithi052.stdout:5/712: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fad [0,4194304] 0 2024-09-06T14:44:55.238 INFO:tasks.workunit.client.0.smithi052.stdout:5/713: dwrite d2/d1a/d22/d26/d2b/d37/f44 [4194304,4194304] 0 2024-09-06T14:44:55.249 INFO:tasks.workunit.client.0.smithi052.stdout:5/714: dread d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/fa1 [0,4194304] 0 2024-09-06T14:44:55.250 INFO:tasks.workunit.client.0.smithi052.stdout:5/715: dread - d2/d1a/d22/f9f zero size 2024-09-06T14:44:55.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:54 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:55.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:54 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:44:55.290 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:54 smithi165 ceph-mon[36229]: Reconfiguring prometheus.smithi052 (dependencies changed)... 2024-09-06T14:44:55.448 INFO:tasks.workunit.client.0.smithi052.stdout:2/631: sync 2024-09-06T14:44:55.449 INFO:tasks.workunit.client.0.smithi052.stdout:2/632: write da/d4f/f5b [2264493,71812] 0 2024-09-06T14:44:55.451 INFO:tasks.workunit.client.0.smithi052.stdout:2/633: creat da/d19/d3a/d31/fd6 x:0 0 0 2024-09-06T14:44:55.454 INFO:tasks.workunit.client.0.smithi052.stdout:2/634: mkdir da/d2d/d34/dd7 0 2024-09-06T14:44:55.456 INFO:tasks.workunit.client.0.smithi052.stdout:2/635: chown da/db/d46/l8e 69 1 2024-09-06T14:44:55.457 INFO:tasks.workunit.client.0.smithi052.stdout:2/636: mknod da/d19/d3a/d61/cd8 0 2024-09-06T14:44:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:4/618: sync 2024-09-06T14:44:55.645 INFO:tasks.workunit.client.0.smithi052.stdout:6/501: sync 2024-09-06T14:44:55.716 INFO:tasks.workunit.client.0.smithi052.stdout:4/619: readlink d9/d2d/l32 0 2024-09-06T14:44:55.718 INFO:tasks.workunit.client.0.smithi052.stdout:6/502: symlink d2/dd/d18/d4b/la9 0 2024-09-06T14:44:55.719 INFO:tasks.workunit.client.0.smithi052.stdout:6/503: chown d2/dd/d18/d4b/f94 1386 1 2024-09-06T14:44:55.720 INFO:tasks.workunit.client.0.smithi052.stdout:4/620: unlink f2 0 2024-09-06T14:44:55.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/504: mknod d2/caa 0 2024-09-06T14:44:55.723 INFO:tasks.workunit.client.0.smithi052.stdout:4/621: mkdir d9/d2d/d33/d5d/da6/dbf/dd5 0 2024-09-06T14:44:55.724 INFO:tasks.workunit.client.0.smithi052.stdout:6/505: creat d2/dd/d18/d2d/d71/fab x:0 0 0 2024-09-06T14:44:55.729 INFO:tasks.workunit.client.0.smithi052.stdout:4/622: dread d9/d2d/f63 [0,4194304] 0 2024-09-06T14:44:55.730 INFO:tasks.workunit.client.0.smithi052.stdout:6/506: creat d2/dd/d18/d33/d44/d47/fac x:0 0 0 2024-09-06T14:44:55.730 INFO:tasks.workunit.client.0.smithi052.stdout:6/507: stat d2/dd/d18/d33/fa5 0 2024-09-06T14:44:55.732 INFO:tasks.workunit.client.0.smithi052.stdout:6/508: chown d2/dd/d18/c6b 35 1 2024-09-06T14:44:55.746 INFO:tasks.workunit.client.0.smithi052.stdout:4/623: write d9/f35 [2219613,2900] 0 2024-09-06T14:44:55.749 INFO:tasks.workunit.client.0.smithi052.stdout:4/624: mknod d9/d10/cd6 0 2024-09-06T14:44:55.750 INFO:tasks.workunit.client.0.smithi052.stdout:4/625: write d9/d72/fa5 [3530031,127879] 0 2024-09-06T14:44:55.751 INFO:tasks.workunit.client.0.smithi052.stdout:6/509: write d2/dd/d18/d25/d4c/d61/f8d [4632090,14229] 0 2024-09-06T14:44:55.752 INFO:tasks.workunit.client.0.smithi052.stdout:4/626: dread - d9/d10/d17/d39/faf zero size 2024-09-06T14:44:55.760 INFO:tasks.workunit.client.0.smithi052.stdout:6/510: dwrite d2/dd/d18/d33/f4d [0,4194304] 0 2024-09-06T14:44:55.763 INFO:tasks.workunit.client.0.smithi052.stdout:6/511: mkdir d2/dd/d7d/dad 0 2024-09-06T14:44:55.765 INFO:tasks.workunit.client.0.smithi052.stdout:6/512: write d2/dd/d18/d4b/f53 [1047509,116940] 0 2024-09-06T14:44:55.766 INFO:tasks.workunit.client.0.smithi052.stdout:6/513: readlink d2/dd/d18/d2d/l9b 0 2024-09-06T14:44:55.774 INFO:tasks.workunit.client.0.smithi052.stdout:8/932: sync 2024-09-06T14:44:55.778 INFO:tasks.workunit.client.0.smithi052.stdout:6/514: dwrite d2/dd/d18/d33/d44/d47/f80 [0,4194304] 0 2024-09-06T14:44:55.784 INFO:tasks.workunit.client.0.smithi052.stdout:4/627: dread d9/f35 [0,4194304] 0 2024-09-06T14:44:55.788 INFO:tasks.workunit.client.0.smithi052.stdout:6/515: dwrite d2/dd/d18/f6d [0,4194304] 0 2024-09-06T14:44:55.788 INFO:tasks.workunit.client.0.smithi052.stdout:4/628: chown d9/c78 888 1 2024-09-06T14:44:55.796 INFO:tasks.workunit.client.0.smithi052.stdout:6/516: chown d2/dd/d18/d33/d44/c56 1 1 2024-09-06T14:44:55.798 INFO:tasks.workunit.client.0.smithi052.stdout:4/629: mknod d9/d10/d17/d39/d7b/d91/d9e/cd7 0 2024-09-06T14:44:55.805 INFO:tasks.workunit.client.0.smithi052.stdout:6/517: symlink d2/dd/d18/lae 0 2024-09-06T14:44:55.805 INFO:tasks.workunit.client.0.smithi052.stdout:4/630: rename d9/f40 to d9/d72/fd8 0 2024-09-06T14:44:55.806 INFO:tasks.workunit.client.0.smithi052.stdout:4/631: readlink d9/d2d/d33/d4d/lc7 0 2024-09-06T14:44:55.807 INFO:tasks.workunit.client.0.smithi052.stdout:4/632: stat d9/d72/fd8 0 2024-09-06T14:44:55.813 INFO:tasks.workunit.client.0.smithi052.stdout:4/633: symlink d9/d2d/d33/d5d/ld9 0 2024-09-06T14:44:55.822 INFO:tasks.workunit.client.0.smithi052.stdout:4/634: link d9/d10/d17/d39/c8e d9/d2d/d33/d4d/d81/dc1/cda 0 2024-09-06T14:44:55.826 INFO:tasks.workunit.client.0.smithi052.stdout:8/933: dwrite d6/d9/d1f/d19/ff7 [0,4194304] 0 2024-09-06T14:44:55.827 INFO:tasks.workunit.client.0.smithi052.stdout:8/934: truncate d6/d22/d31/d128/f137 387643 0 2024-09-06T14:44:55.829 INFO:tasks.workunit.client.0.smithi052.stdout:4/635: getdents d9/d10/d17/daa 0 2024-09-06T14:44:55.835 INFO:tasks.workunit.client.0.smithi052.stdout:6/518: truncate d2/dd/d18/f2b 1160120 0 2024-09-06T14:44:55.836 INFO:tasks.workunit.client.0.smithi052.stdout:6/519: chown d2/dd/d18/d25/d4c/l59 122867 1 2024-09-06T14:44:55.841 INFO:tasks.workunit.client.0.smithi052.stdout:8/935: truncate d6/d22/d36/d3e/d47/d56/d68/f3f 2187211 0 2024-09-06T14:44:55.841 INFO:tasks.workunit.client.0.smithi052.stdout:4/636: link d9/d10/d17/c56 d9/d10/d17/daa/db5/db9/cdb 0 2024-09-06T14:44:55.843 INFO:tasks.workunit.client.0.smithi052.stdout:6/520: mknod d2/dd/d18/d25/caf 0 2024-09-06T14:44:55.850 INFO:tasks.workunit.client.0.smithi052.stdout:6/521: dwrite d2/dd/d18/d2d/d71/fab [0,4194304] 0 2024-09-06T14:44:55.851 INFO:tasks.workunit.client.0.smithi052.stdout:8/936: rmdir d6/d22/dd1/d13d 0 2024-09-06T14:44:55.852 INFO:tasks.workunit.client.0.smithi052.stdout:6/522: read d2/dd/d18/d25/d4c/d61/f8d [1246230,49044] 0 2024-09-06T14:44:55.863 INFO:tasks.workunit.client.0.smithi052.stdout:4/637: link c1 d9/d2d/d33/d5d/da6/dbf/cdc 0 2024-09-06T14:44:55.870 INFO:tasks.workunit.client.0.smithi052.stdout:8/937: rename d6/d16/dbf/d114 to d6/d22/d36/d3e/d47/d56/d68/d14e 0 2024-09-06T14:44:55.873 INFO:tasks.workunit.client.0.smithi052.stdout:4/638: rename d9/d10/d17/d39/faf to d9/da1/fdd 0 2024-09-06T14:44:55.876 INFO:tasks.workunit.client.0.smithi052.stdout:4/639: fsync d9/d10/d17/d39/d3a/d5c/f7f 0 2024-09-06T14:44:55.876 INFO:tasks.workunit.client.0.smithi052.stdout:6/523: dwrite d2/dd/d18/d2d/d32/f9a [0,4194304] 0 2024-09-06T14:44:55.877 INFO:tasks.workunit.client.0.smithi052.stdout:8/938: creat d6/d22/d36/d3e/df6/f14f x:0 0 0 2024-09-06T14:44:55.882 INFO:tasks.workunit.client.0.smithi052.stdout:4/640: stat d9/d2d/d33/d4d/d81/dc1/cda 0 2024-09-06T14:44:55.886 INFO:tasks.workunit.client.0.smithi052.stdout:4/641: stat d9/d10/d17/d39/d7b/cb6 0 2024-09-06T14:44:55.888 INFO:tasks.workunit.client.0.smithi052.stdout:6/524: dwrite d2/dd/d18/f22 [8388608,4194304] 0 2024-09-06T14:44:55.890 INFO:tasks.workunit.client.0.smithi052.stdout:8/939: dwrite d6/d22/d36/d3e/df6/f14f [0,4194304] 0 2024-09-06T14:44:55.891 INFO:tasks.workunit.client.0.smithi052.stdout:4/642: chown f7 0 1 2024-09-06T14:44:55.900 INFO:tasks.workunit.client.0.smithi052.stdout:6/525: mknod d2/d4a/d6e/d76/cb0 0 2024-09-06T14:44:55.900 INFO:tasks.workunit.client.0.smithi052.stdout:6/526: write d2/dd/d18/d25/d4c/d61/f97 [915112,22238] 0 2024-09-06T14:44:55.909 INFO:tasks.workunit.client.0.smithi052.stdout:8/940: dwrite d6/d13a/fd8 [0,4194304] 0 2024-09-06T14:44:55.957 INFO:tasks.workunit.client.0.smithi052.stdout:1/698: sync 2024-09-06T14:44:56.007 INFO:tasks.workunit.client.0.smithi052.stdout:1/699: rename d1/db/d50/l88 to d1/db/de/d74/d12/dd3/de5/lf5 0 2024-09-06T14:44:56.008 INFO:tasks.workunit.client.0.smithi052.stdout:4/643: link d9/d2d/d33/d4d/d81/c9a d9/d2d/d33/d5d/da6/dbf/cde 0 2024-09-06T14:44:56.008 INFO:tasks.workunit.client.0.smithi052.stdout:1/700: read d1/db/de/d74/d12/f8a [3206132,86359] 0 2024-09-06T14:44:56.011 INFO:tasks.workunit.client.0.smithi052.stdout:8/941: fdatasync d6/d22/d36/d3e/d47/d56/d68/f3f 0 2024-09-06T14:44:56.012 INFO:tasks.workunit.client.0.smithi052.stdout:8/942: dread - d6/d22/d36/d3e/d47/da7/f12d zero size 2024-09-06T14:44:56.015 INFO:tasks.workunit.client.0.smithi052.stdout:1/701: symlink d1/d5f/lf6 0 2024-09-06T14:44:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:8/943: rename d6/d9/d1f/d14/c8f to d6/d9/d1f/d33/da8/d41/c150 0 2024-09-06T14:44:56.018 INFO:tasks.workunit.client.0.smithi052.stdout:4/644: mkdir d9/d10/d19/ddf 0 2024-09-06T14:44:56.020 INFO:tasks.workunit.client.0.smithi052.stdout:1/702: write d1/db/de/d74/d36/daa/fb5 [1944368,50721] 0 2024-09-06T14:44:56.021 INFO:tasks.workunit.client.0.smithi052.stdout:1/703: stat d1/db/de/d74/d36/daa 0 2024-09-06T14:44:56.023 INFO:tasks.workunit.client.0.smithi052.stdout:4/645: truncate d9/d10/f6e 2498842 0 2024-09-06T14:44:56.023 INFO:tasks.workunit.client.0.smithi052.stdout:1/704: chown d1/db/de/d74/d14/d9f/dcc/d47/d4a/l53 29 1 2024-09-06T14:44:56.025 INFO:tasks.workunit.client.0.smithi052.stdout:1/705: write d1/db/d50/f5e [1903927,72448] 0 2024-09-06T14:44:56.025 INFO:tasks.workunit.client.0.smithi052.stdout:8/944: mknod d6/d22/d36/d3e/d47/da7/d134/c151 0 2024-09-06T14:44:56.026 INFO:tasks.workunit.client.0.smithi052.stdout:8/945: stat d6/d9/d1f/d14/d14a/f13c 0 2024-09-06T14:44:56.027 INFO:tasks.workunit.client.0.smithi052.stdout:4/646: mknod d9/d2d/d33/d4d/d81/ce0 0 2024-09-06T14:44:56.030 INFO:tasks.workunit.client.0.smithi052.stdout:1/706: mknod d1/db/d50/da4/cf7 0 2024-09-06T14:44:56.035 INFO:tasks.workunit.client.0.smithi052.stdout:8/946: link d6/d22/d31/d5b/dd3/d111/l99 d6/d22/d31/d5b/dfc/l152 0 2024-09-06T14:44:56.036 INFO:tasks.workunit.client.0.smithi052.stdout:4/647: rename d9/d10/d17/d39/d3a/c5e to d9/d2d/ce1 0 2024-09-06T14:44:56.038 INFO:tasks.workunit.client.0.smithi052.stdout:1/707: link d1/db/de/f24 d1/db/de/d74/ff8 0 2024-09-06T14:44:56.038 INFO:tasks.workunit.client.0.smithi052.stdout:1/708: chown d1/db/de/d68 16976624 1 2024-09-06T14:44:56.039 INFO:tasks.workunit.client.0.smithi052.stdout:8/947: creat d6/d9/d1f/d19/d6f/d72/f153 x:0 0 0 2024-09-06T14:44:56.040 INFO:tasks.workunit.client.0.smithi052.stdout:8/948: stat d6/d9/d1f/dcf/de6 0 2024-09-06T14:44:56.040 INFO:tasks.workunit.client.0.smithi052.stdout:1/709: symlink d1/d5f/lf9 0 2024-09-06T14:44:56.041 INFO:tasks.workunit.client.0.smithi052.stdout:4/648: creat d9/d72/dca/fe2 x:0 0 0 2024-09-06T14:44:56.042 INFO:tasks.workunit.client.0.smithi052.stdout:8/949: stat d6/d9/d1f/d33/da8/d41/c6e 0 2024-09-06T14:44:56.043 INFO:tasks.workunit.client.0.smithi052.stdout:1/710: dread - d1/d5f/f7d zero size 2024-09-06T14:44:56.043 INFO:tasks.workunit.client.0.smithi052.stdout:4/649: rmdir d9/d10/d19 39 2024-09-06T14:44:56.044 INFO:tasks.workunit.client.0.smithi052.stdout:8/950: creat d6/f154 x:0 0 0 2024-09-06T14:44:56.045 INFO:tasks.workunit.client.0.smithi052.stdout:1/711: creat d1/db/de/d74/d36/d7c/ffa x:0 0 0 2024-09-06T14:44:56.049 INFO:tasks.workunit.client.0.smithi052.stdout:8/951: mkdir d6/d9/d6d/d11b/d155 0 2024-09-06T14:44:56.050 INFO:tasks.workunit.client.0.smithi052.stdout:8/952: write d6/d22/d36/d3e/d47/d56/d68/d69/f140 [780020,122737] 0 2024-09-06T14:44:56.051 INFO:tasks.workunit.client.0.smithi052.stdout:1/712: fsync d1/db/d18/d5c/f9a 0 2024-09-06T14:44:56.057 INFO:tasks.workunit.client.0.smithi052.stdout:8/953: symlink d6/d9/d1f/dcf/de6/l156 0 2024-09-06T14:44:56.058 INFO:tasks.workunit.client.0.smithi052.stdout:1/713: creat d1/db/de/d74/d14/dda/ffb x:0 0 0 2024-09-06T14:44:56.058 INFO:tasks.workunit.client.0.smithi052.stdout:8/954: write d6/d22/d36/d3e/d47/d56/d68/d69/f74 [9036176,121703] 0 2024-09-06T14:44:56.063 INFO:tasks.workunit.client.0.smithi052.stdout:1/714: fsync d1/db/d18/d5c/fee 0 2024-09-06T14:44:56.070 INFO:tasks.workunit.client.0.smithi052.stdout:4/650: write d9/f38 [807859,55737] 0 2024-09-06T14:44:56.072 INFO:tasks.workunit.client.0.smithi052.stdout:8/955: rename d6/d22/d36/d3e/f148 to d6/d9/d1f/d19/f157 0 2024-09-06T14:44:56.081 INFO:tasks.workunit.client.0.smithi052.stdout:1/715: write d1/db/de/d74/d14/d2e/f80 [1103733,97663] 0 2024-09-06T14:44:56.083 INFO:tasks.workunit.client.0.smithi052.stdout:8/956: creat d6/d9/d1f/d19/f158 x:0 0 0 2024-09-06T14:44:56.083 INFO:tasks.workunit.client.0.smithi052.stdout:4/651: getdents d9/d10/d17/d39/d3a/d5c 0 2024-09-06T14:44:56.088 INFO:tasks.workunit.client.0.smithi052.stdout:1/716: rename d1/db/de/d74/f49 to d1/db/de/d74/d14/d90/ffc 0 2024-09-06T14:44:56.088 INFO:tasks.workunit.client.0.smithi052.stdout:1/717: readlink d1/db/l4d 0 2024-09-06T14:44:56.091 INFO:tasks.workunit.client.0.smithi052.stdout:1/718: fdatasync d1/db/de/d74/d14/d9f/dcc/d47/f6e 0 2024-09-06T14:44:56.093 INFO:tasks.workunit.client.0.smithi052.stdout:1/719: read d1/db/de/d74/f78 [278713,109122] 0 2024-09-06T14:44:56.097 INFO:tasks.workunit.client.0.smithi052.stdout:4/652: dwrite f7 [0,4194304] 0 2024-09-06T14:44:56.099 INFO:tasks.workunit.client.0.smithi052.stdout:0/597: sync 2024-09-06T14:44:56.099 INFO:tasks.workunit.client.0.smithi052.stdout:9/469: sync 2024-09-06T14:44:56.099 INFO:tasks.workunit.client.0.smithi052.stdout:3/763: sync 2024-09-06T14:44:56.102 INFO:tasks.workunit.client.0.smithi052.stdout:4/653: creat d9/d2d/d33/d5d/da6/dbf/dd5/fe3 x:0 0 0 2024-09-06T14:44:56.102 INFO:tasks.workunit.client.0.smithi052.stdout:8/957: dread d6/d16/f2c [4194304,4194304] 0 2024-09-06T14:44:56.105 INFO:tasks.workunit.client.0.smithi052.stdout:9/470: dread d1/d4/d6/dc/f61 [0,4194304] 0 2024-09-06T14:44:56.107 INFO:tasks.workunit.client.0.smithi052.stdout:3/764: mkdir d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/dee 0 2024-09-06T14:44:56.109 INFO:tasks.workunit.client.0.smithi052.stdout:1/720: dread d1/db/de/d74/d14/d2e/f42 [0,4194304] 0 2024-09-06T14:44:56.111 INFO:tasks.workunit.client.0.smithi052.stdout:0/598: rename d0/d1a/d26/d3a/d14/d20/d22/d8b/lbd to d0/d1a/d26/d3a/d14/d20/d22/d8b/ld4 0 2024-09-06T14:44:56.113 INFO:tasks.workunit.client.0.smithi052.stdout:3/765: rename d0/d11/f40 to d0/d11/d12/dea/fef 0 2024-09-06T14:44:56.115 INFO:tasks.workunit.client.0.smithi052.stdout:1/721: read - d1/db/de/d74/d14/d9f/dcc/d47/d4a/fa2 zero size 2024-09-06T14:44:56.116 INFO:tasks.workunit.client.0.smithi052.stdout:4/654: mkdir d9/d10/d19/de4 0 2024-09-06T14:44:56.120 INFO:tasks.workunit.client.0.smithi052.stdout:0/599: symlink d0/d1a/d26/d3a/d14/d2d/d56/da3/ld5 0 2024-09-06T14:44:56.121 INFO:tasks.workunit.client.0.smithi052.stdout:0/600: fsync d0/d1a/d26/d3a/d14/d2d/d92/fcd 0 2024-09-06T14:44:56.121 INFO:tasks.workunit.client.0.smithi052.stdout:8/958: creat d6/d9/f159 x:0 0 0 2024-09-06T14:44:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:55 smithi052 ceph-mon[28627]: Reconfiguring daemon prometheus.smithi052 on smithi052 2024-09-06T14:44:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:55 smithi052 ceph-mon[28627]: pgmap v30: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 108 MiB/s wr, 270 op/s 2024-09-06T14:44:56.124 INFO:tasks.workunit.client.0.smithi052.stdout:3/766: mknod d0/d11/d71/d98/d1b/d85/dc5/cf0 0 2024-09-06T14:44:56.124 INFO:tasks.workunit.client.0.smithi052.stdout:3/767: dread - d0/d11/f79 zero size 2024-09-06T14:44:56.126 INFO:tasks.workunit.client.0.smithi052.stdout:1/722: mknod d1/db/d18/d6b/cfd 0 2024-09-06T14:44:56.128 INFO:tasks.workunit.client.0.smithi052.stdout:0/601: truncate d0/d1a/d26/d3a/d14/d2d/fa9 347338 0 2024-09-06T14:44:56.129 INFO:tasks.workunit.client.0.smithi052.stdout:9/471: dwrite d1/fa [4194304,4194304] 0 2024-09-06T14:44:56.129 INFO:tasks.workunit.client.0.smithi052.stdout:3/768: mkdir d0/d11/d12/d4c/d93/d64/df1 0 2024-09-06T14:44:56.131 INFO:tasks.workunit.client.0.smithi052.stdout:3/769: stat d0/d11/d12/d4c/d93/d35/d46/d5b 0 2024-09-06T14:44:56.133 INFO:tasks.workunit.client.0.smithi052.stdout:1/723: fsync d1/db/de/d74/d14/d9f/dcc/d47/d4a/fa2 0 2024-09-06T14:44:56.134 INFO:tasks.workunit.client.0.smithi052.stdout:1/724: readlink d1/l11 0 2024-09-06T14:44:56.134 INFO:tasks.workunit.client.0.smithi052.stdout:0/602: mkdir d0/d18/dd6 0 2024-09-06T14:44:56.135 INFO:tasks.workunit.client.0.smithi052.stdout:3/770: dread d0/d11/d12/d4c/d93/d35/d46/d5b/da0/fab [0,4194304] 0 2024-09-06T14:44:56.136 INFO:tasks.workunit.client.0.smithi052.stdout:4/655: creat d9/d10/d17/fe5 x:0 0 0 2024-09-06T14:44:56.138 INFO:tasks.workunit.client.0.smithi052.stdout:3/771: truncate d0/d11/d71/d98/d19/fc6 952219 0 2024-09-06T14:44:56.143 INFO:tasks.workunit.client.0.smithi052.stdout:8/959: write d6/d9/f18 [2512872,63301] 0 2024-09-06T14:44:56.146 INFO:tasks.workunit.client.0.smithi052.stdout:0/603: mknod d0/d1a/d26/d3a/d14/d20/d22/d41/cd7 0 2024-09-06T14:44:56.151 INFO:tasks.workunit.client.0.smithi052.stdout:9/472: symlink d1/d4/l8a 0 2024-09-06T14:44:56.152 INFO:tasks.workunit.client.0.smithi052.stdout:3/772: dread d0/d11/d71/d98/d19/f7f [0,4194304] 0 2024-09-06T14:44:56.156 INFO:tasks.workunit.client.0.smithi052.stdout:1/725: symlink d1/db/d72/db1/lfe 0 2024-09-06T14:44:56.162 INFO:tasks.workunit.client.0.smithi052.stdout:3/773: mknod d0/d11/d71/cf2 0 2024-09-06T14:44:56.166 INFO:tasks.workunit.client.0.smithi052.stdout:1/726: rmdir d1/db/d76 39 2024-09-06T14:44:56.167 INFO:tasks.workunit.client.0.smithi052.stdout:0/604: creat d0/d1a/d26/d3a/d14/d20/d22/d55/fd8 x:0 0 0 2024-09-06T14:44:56.169 INFO:tasks.workunit.client.0.smithi052.stdout:3/774: dwrite d0/d11/d71/d98/f4e [4194304,4194304] 0 2024-09-06T14:44:56.171 INFO:tasks.workunit.client.0.smithi052.stdout:7/613: sync 2024-09-06T14:44:56.171 INFO:tasks.workunit.client.0.smithi052.stdout:5/716: sync 2024-09-06T14:44:56.171 INFO:tasks.workunit.client.0.smithi052.stdout:2/637: sync 2024-09-06T14:44:56.171 INFO:tasks.workunit.client.0.smithi052.stdout:6/527: sync 2024-09-06T14:44:56.171 INFO:tasks.workunit.client.0.smithi052.stdout:9/473: creat d1/d4/d6/dc/d10/d18/d82/f8b x:0 0 0 2024-09-06T14:44:56.174 INFO:tasks.workunit.client.0.smithi052.stdout:8/960: creat d6/d22/d36/d3e/d47/f15a x:0 0 0 2024-09-06T14:44:56.180 INFO:tasks.workunit.client.0.smithi052.stdout:8/961: write d6/d9/d1f/d19/d6f/d72/f10e [1431388,114059] 0 2024-09-06T14:44:56.181 INFO:tasks.workunit.client.0.smithi052.stdout:7/614: dread d11/d1c/d3f/d73/dae/fc5 [0,4194304] 0 2024-09-06T14:44:56.181 INFO:tasks.workunit.client.0.smithi052.stdout:1/727: symlink d1/db/de/d74/d14/dd1/lff 0 2024-09-06T14:44:56.183 INFO:tasks.workunit.client.0.smithi052.stdout:3/775: mkdir d0/d11/d71/daf/df3 0 2024-09-06T14:44:56.184 INFO:tasks.workunit.client.0.smithi052.stdout:1/728: readlink d1/db/de/d74/d14/l16 0 2024-09-06T14:44:56.185 INFO:tasks.workunit.client.0.smithi052.stdout:4/656: write d9/d2d/f4a [3693762,128060] 0 2024-09-06T14:44:56.187 INFO:tasks.workunit.client.0.smithi052.stdout:0/605: dread d0/d2e/f9c [0,4194304] 0 2024-09-06T14:44:56.187 INFO:tasks.workunit.client.0.smithi052.stdout:5/717: dwrite d2/d1a/d22/d26/d2b/d37/d84/d97/fd5 [0,4194304] 0 2024-09-06T14:44:56.188 INFO:tasks.workunit.client.0.smithi052.stdout:9/474: rename d1/d4/d6/dd/d2b/f2e to d1/d26/d41/d7e/f8c 0 2024-09-06T14:44:56.192 INFO:tasks.workunit.client.0.smithi052.stdout:2/638: dread - da/d19/d5a/fbb zero size 2024-09-06T14:44:56.194 INFO:tasks.workunit.client.0.smithi052.stdout:2/639: truncate da/d64/f8f 522053 0 2024-09-06T14:44:56.195 INFO:tasks.workunit.client.0.smithi052.stdout:6/528: creat d2/dd/d18/d2d/da7/fb1 x:0 0 0 2024-09-06T14:44:56.200 INFO:tasks.workunit.client.0.smithi052.stdout:3/776: fsync d0/d11/d12/d73/f99 0 2024-09-06T14:44:56.202 INFO:tasks.workunit.client.0.smithi052.stdout:1/729: creat d1/db/de/d74/d12/f100 x:0 0 0 2024-09-06T14:44:56.205 INFO:tasks.workunit.client.0.smithi052.stdout:6/529: dread d2/dd/d18/d2d/d32/f3f [0,4194304] 0 2024-09-06T14:44:56.206 INFO:tasks.workunit.client.0.smithi052.stdout:0/606: mknod d0/d1a/d8e/cd9 0 2024-09-06T14:44:56.207 INFO:tasks.workunit.client.0.smithi052.stdout:6/530: write d2/dd/f2f [5839247,26029] 0 2024-09-06T14:44:56.210 INFO:tasks.workunit.client.0.smithi052.stdout:8/962: mknod d6/d22/c15b 0 2024-09-06T14:44:56.216 INFO:tasks.workunit.client.0.smithi052.stdout:2/640: dread da/f1b [0,4194304] 0 2024-09-06T14:44:56.217 INFO:tasks.workunit.client.0.smithi052.stdout:2/641: stat da/db/d46 0 2024-09-06T14:44:56.218 INFO:tasks.workunit.client.0.smithi052.stdout:5/718: dwrite d2/d1a/d22/d26/d2b/d48/fea [4194304,4194304] 0 2024-09-06T14:44:56.219 INFO:tasks.workunit.client.0.smithi052.stdout:7/615: dwrite d11/d1c/f7c [0,4194304] 0 2024-09-06T14:44:56.220 INFO:tasks.workunit.client.0.smithi052.stdout:2/642: dread da/db/d60/faf [0,4194304] 0 2024-09-06T14:44:56.251 INFO:tasks.workunit.client.0.smithi052.stdout:1/730: truncate d1/db/de/d74/d12/f34 4235529 0 2024-09-06T14:44:56.251 INFO:tasks.workunit.client.0.smithi052.stdout:1/731: chown d1/db/d18/d5c/fee 15 1 2024-09-06T14:44:56.252 INFO:tasks.workunit.client.0.smithi052.stdout:9/475: unlink d1/d4/c1c 0 2024-09-06T14:44:56.253 INFO:tasks.workunit.client.0.smithi052.stdout:1/732: write d1/db/de/d74/d36/f7b [1140911,77288] 0 2024-09-06T14:44:56.254 INFO:tasks.workunit.client.0.smithi052.stdout:6/531: mknod d2/dd/d7d/cb2 0 2024-09-06T14:44:56.254 INFO:tasks.workunit.client.0.smithi052.stdout:1/733: chown d1/db/d72/f97 1696 1 2024-09-06T14:44:56.256 INFO:tasks.workunit.client.0.smithi052.stdout:1/734: write d1/db/de/d74/ff2 [701464,118910] 0 2024-09-06T14:44:56.258 INFO:tasks.workunit.client.0.smithi052.stdout:0/607: rename d0/d1a/d26/d3a/d14/d2d/d56/d9d/dc8 to d0/d1a/d26/d3a/d14/d2d/d94/dda 0 2024-09-06T14:44:56.259 INFO:tasks.workunit.client.0.smithi052.stdout:8/963: creat d6/d9/d1f/d14/da0/f15c x:0 0 0 2024-09-06T14:44:56.260 INFO:tasks.workunit.client.0.smithi052.stdout:8/964: readlink d6/d9/d1f/dcf/de6/l156 0 2024-09-06T14:44:56.261 INFO:tasks.workunit.client.0.smithi052.stdout:8/965: stat d6/d9/d1f/d19/f100 0 2024-09-06T14:44:56.263 INFO:tasks.workunit.client.0.smithi052.stdout:7/616: mknod d11/d1c/d3f/d5d/cc7 0 2024-09-06T14:44:56.264 INFO:tasks.workunit.client.0.smithi052.stdout:5/719: mknod d2/d1a/d22/d26/d62/cf3 0 2024-09-06T14:44:56.265 INFO:tasks.workunit.client.0.smithi052.stdout:5/720: write d2/d1a/d22/d26/d62/f75 [997684,11647] 0 2024-09-06T14:44:56.271 INFO:tasks.workunit.client.0.smithi052.stdout:2/643: dwrite da/d19/d3a/d31/d76/fc8 [0,4194304] 0 2024-09-06T14:44:56.273 INFO:tasks.workunit.client.0.smithi052.stdout:2/644: stat da/d19/d3a/dc4/fd1 0 2024-09-06T14:44:56.282 INFO:tasks.workunit.client.0.smithi052.stdout:7/617: symlink d11/d1c/d87/lc8 0 2024-09-06T14:44:56.285 INFO:tasks.workunit.client.0.smithi052.stdout:5/721: mkdir d2/d1a/df4 0 2024-09-06T14:44:56.288 INFO:tasks.workunit.client.0.smithi052.stdout:6/532: mknod d2/dd/d7d/dad/cb3 0 2024-09-06T14:44:56.289 INFO:tasks.workunit.client.0.smithi052.stdout:2/645: symlink da/d19/d3a/d31/d7a/dbd/ld9 0 2024-09-06T14:44:56.293 INFO:tasks.workunit.client.0.smithi052.stdout:1/735: rename d1/db/de/d68/l83 to d1/db/de/d74/d36/daa/l101 0 2024-09-06T14:44:56.294 INFO:tasks.workunit.client.0.smithi052.stdout:1/736: stat d1/db/de/d74/f32 0 2024-09-06T14:44:56.295 INFO:tasks.workunit.client.0.smithi052.stdout:0/608: mkdir d0/d7e/ddb 0 2024-09-06T14:44:56.295 INFO:tasks.workunit.client.0.smithi052.stdout:0/609: readlink d0/d1a/d26/l7c 0 2024-09-06T14:44:56.299 INFO:tasks.workunit.client.0.smithi052.stdout:5/722: mkdir d2/d1a/d22/d26/d2b/d37/d84/df5 0 2024-09-06T14:44:56.302 INFO:tasks.workunit.client.0.smithi052.stdout:6/533: fsync d2/dd/d18/d25/f2c 0 2024-09-06T14:44:56.306 INFO:tasks.workunit.client.0.smithi052.stdout:7/618: write d11/d1c/d24/d3b/fbf [836510,2840] 0 2024-09-06T14:44:56.307 INFO:tasks.workunit.client.0.smithi052.stdout:5/723: mknod d2/d1a/d22/d26/d2b/d37/d84/cf6 0 2024-09-06T14:44:56.312 INFO:tasks.workunit.client.0.smithi052.stdout:4/657: dwrite d9/d2d/d33/f6a [0,4194304] 0 2024-09-06T14:44:56.313 INFO:tasks.workunit.client.0.smithi052.stdout:4/658: chown d9/d2d/d33 1814 1 2024-09-06T14:44:56.314 INFO:tasks.workunit.client.0.smithi052.stdout:0/610: rename d0/d1a/d26/d3a/d14/d20/d22/d41/c43 to d0/d1a/d26/d3a/d7a/cdc 0 2024-09-06T14:44:56.316 INFO:tasks.workunit.client.0.smithi052.stdout:0/611: dread - d0/d1a/d26/d3a/d14/f3e zero size 2024-09-06T14:44:56.320 INFO:tasks.workunit.client.0.smithi052.stdout:2/646: link da/d19/d3a/f3f da/db/d18/d7f/fda 0 2024-09-06T14:44:56.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:55 smithi165 ceph-mon[36229]: Reconfiguring daemon prometheus.smithi052 on smithi052 2024-09-06T14:44:56.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:55 smithi165 ceph-mon[36229]: pgmap v30: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 108 MiB/s wr, 270 op/s 2024-09-06T14:44:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:3/777: truncate d0/d11/d12/d4c/d93/fd4 1721872 0 2024-09-06T14:44:56.323 INFO:tasks.workunit.client.0.smithi052.stdout:6/534: dread d2/dd/d18/d25/d4c/d61/f8d [0,4194304] 0 2024-09-06T14:44:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:3/778: chown d0/d11/d12/d4c/d93/f80 749724 1 2024-09-06T14:44:56.324 INFO:tasks.workunit.client.0.smithi052.stdout:4/659: unlink d9/d10/d17/d39/d7b/d91/fce 0 2024-09-06T14:44:56.327 INFO:tasks.workunit.client.0.smithi052.stdout:0/612: mknod d0/d1a/daa/cdd 0 2024-09-06T14:44:56.328 INFO:tasks.workunit.client.0.smithi052.stdout:9/476: write d1/d4/d6/dd/d2b/f49 [5142088,32902] 0 2024-09-06T14:44:56.329 INFO:tasks.workunit.client.0.smithi052.stdout:7/619: dread d11/d1c/d24/d4b/f4e [0,4194304] 0 2024-09-06T14:44:56.329 INFO:tasks.workunit.client.0.smithi052.stdout:5/724: creat d2/d1a/df4/ff7 x:0 0 0 2024-09-06T14:44:56.334 INFO:tasks.workunit.client.0.smithi052.stdout:1/737: getdents d1/db/de/d74/d14 0 2024-09-06T14:44:56.335 INFO:tasks.workunit.client.0.smithi052.stdout:4/660: symlink d9/d2d/d33/d4d/le6 0 2024-09-06T14:44:56.472 INFO:tasks.workunit.client.0.smithi052.stdout:8/966: dwrite d6/d22/d36/d3e/d47/d56/d68/f3f [0,4194304] 0 2024-09-06T14:44:56.473 INFO:tasks.workunit.client.0.smithi052.stdout:0/613: creat d0/d18/dd6/fde x:0 0 0 2024-09-06T14:44:56.474 INFO:tasks.workunit.client.0.smithi052.stdout:4/661: mknod d9/d10/d17/daa/db5/db9/ce7 0 2024-09-06T14:44:56.474 INFO:tasks.workunit.client.0.smithi052.stdout:9/477: dwrite d1/d4/d6/dc/d10/d18/f5b [0,4194304] 0 2024-09-06T14:44:56.477 INFO:tasks.workunit.client.0.smithi052.stdout:5/725: mknod d2/d1a/d22/d26/d2b/d37/d84/dd8/cf8 0 2024-09-06T14:44:56.479 INFO:tasks.workunit.client.0.smithi052.stdout:1/738: write d1/db/d18/d5c/fee [4285471,78174] 0 2024-09-06T14:44:56.479 INFO:tasks.workunit.client.0.smithi052.stdout:8/967: symlink d6/d9/d1f/d14/d14a/l15d 0 2024-09-06T14:44:56.482 INFO:tasks.workunit.client.0.smithi052.stdout:0/614: creat d0/d1a/d8e/fdf x:0 0 0 2024-09-06T14:44:56.483 INFO:tasks.workunit.client.0.smithi052.stdout:4/662: chown d9/d10/d17/d39/d3a/d5c/cc6 1540358199 1 2024-09-06T14:44:56.485 INFO:tasks.workunit.client.0.smithi052.stdout:3/779: dread d0/d11/d12/d4c/d93/f3e [0,4194304] 0 2024-09-06T14:44:56.486 INFO:tasks.workunit.client.0.smithi052.stdout:7/620: getdents d11/d1c/d3f/d73/dae 0 2024-09-06T14:44:56.488 INFO:tasks.workunit.client.0.smithi052.stdout:1/739: fdatasync d1/db/d50/da4/fea 0 2024-09-06T14:44:56.488 INFO:tasks.workunit.client.0.smithi052.stdout:2/647: dwrite da/f11 [0,4194304] 0 2024-09-06T14:44:56.490 INFO:tasks.workunit.client.0.smithi052.stdout:9/478: symlink d1/d4/d6/dc/d10/d18/l8d 0 2024-09-06T14:44:56.491 INFO:tasks.workunit.client.0.smithi052.stdout:7/621: write d11/d1c/f7c [4626958,3316] 0 2024-09-06T14:44:56.492 INFO:tasks.workunit.client.0.smithi052.stdout:0/615: truncate d0/d1a/d26/d3a/fca 833328 0 2024-09-06T14:44:56.493 INFO:tasks.workunit.client.0.smithi052.stdout:4/663: unlink d9/d2d/d33/d5d/da6/c87 0 2024-09-06T14:44:56.497 INFO:tasks.workunit.client.0.smithi052.stdout:8/968: dwrite d6/d22/d36/dec/f143 [0,4194304] 0 2024-09-06T14:44:56.501 INFO:tasks.workunit.client.0.smithi052.stdout:2/648: chown da/d19/d3a/d31/d76/l6f 9967 1 2024-09-06T14:44:56.503 INFO:tasks.workunit.client.0.smithi052.stdout:1/740: creat d1/db/d18/d5c/f102 x:0 0 0 2024-09-06T14:44:56.512 INFO:tasks.workunit.client.0.smithi052.stdout:0/616: mknod d0/d1a/d26/d3a/d14/d2d/d56/ce0 0 2024-09-06T14:44:56.514 INFO:tasks.workunit.client.0.smithi052.stdout:3/780: rename d0/d11/d12/f41 to d0/d11/d71/d98/d1b/ff4 0 2024-09-06T14:44:56.515 INFO:tasks.workunit.client.0.smithi052.stdout:0/617: fsync d0/d1a/d26/d3a/d14/d20/d22/d41/fd0 0 2024-09-06T14:44:56.516 INFO:tasks.workunit.client.0.smithi052.stdout:4/664: symlink d9/le8 0 2024-09-06T14:44:56.517 INFO:tasks.workunit.client.0.smithi052.stdout:5/726: dwrite d2/d20/d56/fc2 [0,4194304] 0 2024-09-06T14:44:56.518 INFO:tasks.workunit.client.0.smithi052.stdout:7/622: creat d11/d1c/d57/d89/db2/fc9 x:0 0 0 2024-09-06T14:44:56.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/479: creat d1/d4/d6/dc/d10/d73/f8e x:0 0 0 2024-09-06T14:44:56.528 INFO:tasks.workunit.client.0.smithi052.stdout:7/623: dwrite d11/d1c/d26/f94 [0,4194304] 0 2024-09-06T14:44:56.533 INFO:tasks.workunit.client.0.smithi052.stdout:9/480: dwrite d1/d4/d6/dc/d10/d18/f74 [0,4194304] 0 2024-09-06T14:44:56.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/481: stat d1/d4/d6/dc/d38/d5a 0 2024-09-06T14:44:56.538 INFO:tasks.workunit.client.0.smithi052.stdout:7/624: fdatasync d11/d1c/d78/f79 0 2024-09-06T14:44:56.539 INFO:tasks.workunit.client.0.smithi052.stdout:1/741: link d1/db/de/d74/d14/l16 d1/db/de/d74/d14/d9f/dcc/l103 0 2024-09-06T14:44:56.539 INFO:tasks.workunit.client.0.smithi052.stdout:2/649: write da/db/d60/db1/f9a [24247,77346] 0 2024-09-06T14:44:56.541 INFO:tasks.workunit.client.0.smithi052.stdout:0/618: mknod d0/d1a/d26/db7/ce1 0 2024-09-06T14:44:56.547 INFO:tasks.workunit.client.0.smithi052.stdout:8/969: getdents d6/d22/d31/d5b/dd3/d111 0 2024-09-06T14:44:56.552 INFO:tasks.workunit.client.0.smithi052.stdout:4/665: creat d9/d10/fe9 x:0 0 0 2024-09-06T14:44:56.553 INFO:tasks.workunit.client.0.smithi052.stdout:5/727: link d2/l35 d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/lf9 0 2024-09-06T14:44:56.555 INFO:tasks.workunit.client.0.smithi052.stdout:3/781: dwrite d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/fe3 [0,4194304] 0 2024-09-06T14:44:56.557 INFO:tasks.workunit.client.0.smithi052.stdout:0/619: mkdir d0/d1a/d26/d3a/d14/d2d/de2 0 2024-09-06T14:44:56.559 INFO:tasks.workunit.client.0.smithi052.stdout:9/482: creat d1/d4/d6/dd/f8f x:0 0 0 2024-09-06T14:44:56.562 INFO:tasks.workunit.client.0.smithi052.stdout:7/625: rename d11/d1c/d87 to d11/d1c/d24/dca 0 2024-09-06T14:44:56.565 INFO:tasks.workunit.client.0.smithi052.stdout:5/728: dwrite d2/d20/d42/d65/fda [0,4194304] 0 2024-09-06T14:44:56.565 INFO:tasks.workunit.client.0.smithi052.stdout:9/483: truncate d1/d4/f43 5789842 0 2024-09-06T14:44:56.569 INFO:tasks.workunit.client.0.smithi052.stdout:1/742: dread d1/db/fd [0,4194304] 0 2024-09-06T14:44:56.573 INFO:tasks.workunit.client.0.smithi052.stdout:2/650: getdents da/d19/d3a/d31/d76/dc7 0 2024-09-06T14:44:56.574 INFO:tasks.workunit.client.0.smithi052.stdout:5/729: dread d2/d1a/d22/d26/d2b/d37/d6a/f8e [0,4194304] 0 2024-09-06T14:44:56.579 INFO:tasks.workunit.client.0.smithi052.stdout:9/484: unlink d1/c54 0 2024-09-06T14:44:56.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/651: dwrite da/f11 [0,4194304] 0 2024-09-06T14:44:56.584 INFO:tasks.workunit.client.0.smithi052.stdout:9/485: read d1/fa [1029005,104765] 0 2024-09-06T14:44:56.585 INFO:tasks.workunit.client.0.smithi052.stdout:8/970: link d6/d9/d1f/c1c d6/d22/d36/d3e/d47/d56/d68/c15e 0 2024-09-06T14:44:56.586 INFO:tasks.workunit.client.0.smithi052.stdout:9/486: write d1/d4/d6/dc/d10/d18/f74 [2481833,7463] 0 2024-09-06T14:44:56.587 INFO:tasks.workunit.client.0.smithi052.stdout:5/730: symlink d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/lfa 0 2024-09-06T14:44:56.588 INFO:tasks.workunit.client.0.smithi052.stdout:5/731: write d2/d20/d56/fc2 [135685,50958] 0 2024-09-06T14:44:56.591 INFO:tasks.workunit.client.0.smithi052.stdout:0/620: link d0/d1a/d26/l7c d0/d19/le3 0 2024-09-06T14:44:56.594 INFO:tasks.workunit.client.0.smithi052.stdout:3/782: link d0/d11/d12/l6d d0/d11/d12/d4c/d93/d35/d46/d5b/da0/da6/lf5 0 2024-09-06T14:44:56.596 INFO:tasks.workunit.client.0.smithi052.stdout:7/626: creat d11/fcb x:0 0 0 2024-09-06T14:44:56.601 INFO:tasks.workunit.client.0.smithi052.stdout:3/783: dwrite d0/d11/d71/d98/d19/f2c [0,4194304] 0 2024-09-06T14:44:56.601 INFO:tasks.workunit.client.0.smithi052.stdout:2/652: write f2 [5225554,82392] 0 2024-09-06T14:44:56.603 INFO:tasks.workunit.client.0.smithi052.stdout:2/653: chown da/db/d18/d7f 85316 1 2024-09-06T14:44:56.604 INFO:tasks.workunit.client.0.smithi052.stdout:2/654: chown da/d2d/d34/c81 162 1 2024-09-06T14:44:56.615 INFO:tasks.workunit.client.0.smithi052.stdout:9/487: symlink d1/d4/d6/dc/d10/l90 0 2024-09-06T14:44:56.618 INFO:tasks.workunit.client.0.smithi052.stdout:2/655: rmdir da/db/d46/d55 39 2024-09-06T14:44:56.619 INFO:tasks.workunit.client.0.smithi052.stdout:1/743: link d1/d6c/cbc d1/db/d18/c104 0 2024-09-06T14:44:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:0/621: dwrite d0/d19/fa8 [0,4194304] 0 2024-09-06T14:44:56.620 INFO:tasks.workunit.client.0.smithi052.stdout:1/744: readlink d1/l22 0 2024-09-06T14:44:56.621 INFO:tasks.workunit.client.0.smithi052.stdout:0/622: readlink d0/d1a/d8e/la2 0 2024-09-06T14:44:56.622 INFO:tasks.workunit.client.0.smithi052.stdout:7/627: rmdir d11/d1c/d24/d7e 39 2024-09-06T14:44:56.622 INFO:tasks.workunit.client.0.smithi052.stdout:8/971: creat d6/d22/d36/d3e/d47/d56/f15f x:0 0 0 2024-09-06T14:44:56.625 INFO:tasks.workunit.client.0.smithi052.stdout:9/488: stat d1/d26/c75 0 2024-09-06T14:44:56.625 INFO:tasks.workunit.client.0.smithi052.stdout:1/745: read d1/db/de/d74/d14/d9f/fdb [10555,77237] 0 2024-09-06T14:44:56.627 INFO:tasks.workunit.client.0.smithi052.stdout:5/732: link d2/d1a/cd1 d2/d20/d42/cfb 0 2024-09-06T14:44:56.630 INFO:tasks.workunit.client.0.smithi052.stdout:7/628: mknod d11/d1c/d78/d98/ccc 0 2024-09-06T14:44:56.630 INFO:tasks.workunit.client.0.smithi052.stdout:5/733: stat d2/d1a/d22/d26/d2b/d37/faf 0 2024-09-06T14:44:56.630 INFO:tasks.workunit.client.0.smithi052.stdout:8/972: rmdir d6/d22/d36/d3e/d47/d56 39 2024-09-06T14:44:56.631 INFO:tasks.workunit.client.0.smithi052.stdout:7/629: stat d11/c20 0 2024-09-06T14:44:56.633 INFO:tasks.workunit.client.0.smithi052.stdout:2/656: unlink da/d19/c32 0 2024-09-06T14:44:56.635 INFO:tasks.workunit.client.0.smithi052.stdout:3/784: dwrite d0/d11/d12/d73/f99 [0,4194304] 0 2024-09-06T14:44:56.635 INFO:tasks.workunit.client.0.smithi052.stdout:1/746: creat d1/db/de/d74/d36/d9b/f105 x:0 0 0 2024-09-06T14:44:56.639 INFO:tasks.workunit.client.0.smithi052.stdout:0/623: fsync d0/fe 0 2024-09-06T14:44:56.640 INFO:tasks.workunit.client.0.smithi052.stdout:0/624: chown d0/d18 505595469 1 2024-09-06T14:44:56.640 INFO:tasks.workunit.client.0.smithi052.stdout:8/973: unlink d6/d9/d1f/d14/da0/fb7 0 2024-09-06T14:44:56.642 INFO:tasks.workunit.client.0.smithi052.stdout:8/974: stat d6/d9/d1f/d33/da8/d1b/f2f 0 2024-09-06T14:44:56.642 INFO:tasks.workunit.client.0.smithi052.stdout:2/657: creat da/db/d18/d7f/fdb x:0 0 0 2024-09-06T14:44:56.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/630: rename d11/d1c/d3f/d5d/cc7 to d11/d1c/d24/d4b/da2/ccd 0 2024-09-06T14:44:56.645 INFO:tasks.workunit.client.0.smithi052.stdout:9/489: dread d1/d4/f5 [4194304,4194304] 0 2024-09-06T14:44:56.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/631: dread - d11/fcb zero size 2024-09-06T14:44:56.648 INFO:tasks.workunit.client.0.smithi052.stdout:3/785: fsync d0/d11/d71/d98/d19/f7f 0 2024-09-06T14:44:56.650 INFO:tasks.workunit.client.0.smithi052.stdout:3/786: dread - d0/fd0 zero size 2024-09-06T14:44:56.654 INFO:tasks.workunit.client.0.smithi052.stdout:3/787: dread d0/d11/d71/d98/d1b/f27 [0,4194304] 0 2024-09-06T14:44:56.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/490: dwrite d1/d4/d6/dc/d10/d18/f74 [0,4194304] 0 2024-09-06T14:44:56.655 INFO:tasks.workunit.client.0.smithi052.stdout:2/658: read da/f23 [6324,125920] 0 2024-09-06T14:44:56.657 INFO:tasks.workunit.client.0.smithi052.stdout:1/747: rename d1/db/de/d74/d14/c33 to d1/d5f/c106 0 2024-09-06T14:44:56.658 INFO:tasks.workunit.client.0.smithi052.stdout:7/632: fdatasync d11/f23 0 2024-09-06T14:44:56.661 INFO:tasks.workunit.client.0.smithi052.stdout:1/748: read d1/db/de/f24 [1880912,40324] 0 2024-09-06T14:44:56.664 INFO:tasks.workunit.client.0.smithi052.stdout:9/491: dwrite d1/f23 [0,4194304] 0 2024-09-06T14:44:56.667 INFO:tasks.workunit.client.0.smithi052.stdout:5/734: dwrite d2/f16 [4194304,4194304] 0 2024-09-06T14:44:56.674 INFO:tasks.workunit.client.0.smithi052.stdout:0/625: dwrite d0/d2e/f9c [0,4194304] 0 2024-09-06T14:44:56.675 INFO:tasks.workunit.client.0.smithi052.stdout:7/633: fdatasync d11/d1c/d26/f60 0 2024-09-06T14:44:56.678 INFO:tasks.workunit.client.0.smithi052.stdout:7/634: dread d11/d1c/d24/d4b/f4e [0,4194304] 0 2024-09-06T14:44:56.690 INFO:tasks.workunit.client.0.smithi052.stdout:1/749: rename d1/db/d18/c4c to d1/db/d18/d6b/c107 0 2024-09-06T14:44:56.693 INFO:tasks.workunit.client.0.smithi052.stdout:3/788: rmdir d0/d11/d12/d17/d7b/da5 0 2024-09-06T14:44:56.695 INFO:tasks.workunit.client.0.smithi052.stdout:9/492: link d1/c11 d1/c91 0 2024-09-06T14:44:56.699 INFO:tasks.workunit.client.0.smithi052.stdout:0/626: dread d0/d1a/d26/d3a/d14/d20/d22/d41/f64 [0,4194304] 0 2024-09-06T14:44:56.700 INFO:tasks.workunit.client.0.smithi052.stdout:2/659: getdents da/d2d/d34/d66 0 2024-09-06T14:44:56.701 INFO:tasks.workunit.client.0.smithi052.stdout:5/735: write d2/d1a/d22/d26/d2b/d37/faf [1394400,4137] 0 2024-09-06T14:44:56.705 INFO:tasks.workunit.client.0.smithi052.stdout:9/493: dwrite d1/f37 [4194304,4194304] 0 2024-09-06T14:44:56.706 INFO:tasks.workunit.client.0.smithi052.stdout:0/627: mkdir d0/d3d/de4 0 2024-09-06T14:44:56.711 INFO:tasks.workunit.client.0.smithi052.stdout:7/635: link d11/d1c/d24/d3b/d50/f6e d11/fce 0 2024-09-06T14:44:56.713 INFO:tasks.workunit.client.0.smithi052.stdout:1/750: creat d1/db/de/d74/d14/d2e/f108 x:0 0 0 2024-09-06T14:44:56.714 INFO:tasks.workunit.client.0.smithi052.stdout:5/736: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/fd6 [0,4194304] 0 2024-09-06T14:44:56.727 INFO:tasks.workunit.client.0.smithi052.stdout:7/636: mknod d11/d1c/d26/ccf 0 2024-09-06T14:44:56.732 INFO:tasks.workunit.client.0.smithi052.stdout:5/737: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/ffc x:0 0 0 2024-09-06T14:44:56.733 INFO:tasks.workunit.client.0.smithi052.stdout:2/660: link da/db/fa2 da/fdc 0 2024-09-06T14:44:56.735 INFO:tasks.workunit.client.0.smithi052.stdout:3/789: dwrite d0/d11/d71/d98/f55 [0,4194304] 0 2024-09-06T14:44:56.741 INFO:tasks.workunit.client.0.smithi052.stdout:9/494: creat d1/d4/f92 x:0 0 0 2024-09-06T14:44:56.748 INFO:tasks.workunit.client.0.smithi052.stdout:7/637: mknod d11/d1c/d57/cd0 0 2024-09-06T14:44:56.749 INFO:tasks.workunit.client.0.smithi052.stdout:1/751: write d1/d6c/d98/fd2 [789633,120872] 0 2024-09-06T14:44:56.749 INFO:tasks.workunit.client.0.smithi052.stdout:7/638: chown d11/d1c/d57 260564 1 2024-09-06T14:44:56.750 INFO:tasks.workunit.client.0.smithi052.stdout:7/639: stat d11/d1c/d26/f60 0 2024-09-06T14:44:56.753 INFO:tasks.workunit.client.0.smithi052.stdout:5/738: rename d2/d20/fac to d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/ffd 0 2024-09-06T14:44:56.756 INFO:tasks.workunit.client.0.smithi052.stdout:9/495: truncate d1/d4/d6/dc/d10/f34 4427697 0 2024-09-06T14:44:56.757 INFO:tasks.workunit.client.0.smithi052.stdout:9/496: chown d1/d26/d41/d7e/l89 160163 1 2024-09-06T14:44:56.758 INFO:tasks.workunit.client.0.smithi052.stdout:2/661: symlink da/d19/d5a/ldd 0 2024-09-06T14:44:56.759 INFO:tasks.workunit.client.0.smithi052.stdout:1/752: mknod d1/db/d72/d81/c109 0 2024-09-06T14:44:56.760 INFO:tasks.workunit.client.0.smithi052.stdout:7/640: read d11/d1c/d24/fb6 [812817,26055] 0 2024-09-06T14:44:56.762 INFO:tasks.workunit.client.0.smithi052.stdout:7/641: fsync d11/d1c/d24/d3b/fbf 0 2024-09-06T14:44:56.762 INFO:tasks.workunit.client.0.smithi052.stdout:7/642: chown d11/d1c/d24/dca 0 1 2024-09-06T14:44:56.763 INFO:tasks.workunit.client.0.smithi052.stdout:7/643: fsync d11/fcb 0 2024-09-06T14:44:56.763 INFO:tasks.workunit.client.0.smithi052.stdout:5/739: unlink d2/d1a/d22/d26/l67 0 2024-09-06T14:44:56.765 INFO:tasks.workunit.client.0.smithi052.stdout:2/662: unlink da/d64/f8f 0 2024-09-06T14:44:56.772 INFO:tasks.workunit.client.0.smithi052.stdout:2/663: dwrite da/d19/d3a/d31/d76/d6a/f9c [4194304,4194304] 0 2024-09-06T14:44:56.778 INFO:tasks.workunit.client.0.smithi052.stdout:2/664: rename da/d2d/d34/c7d to da/d2d/d34/d62/cde 0 2024-09-06T14:44:56.779 INFO:tasks.workunit.client.0.smithi052.stdout:5/740: link d2/d1a/d22/f7a d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/ffe 0 2024-09-06T14:44:56.779 INFO:tasks.workunit.client.0.smithi052.stdout:2/665: chown da/d2d/d34/d66 272638983 1 2024-09-06T14:44:56.780 INFO:tasks.workunit.client.0.smithi052.stdout:5/741: chown d2/d1a/d22/cb7 49714000 1 2024-09-06T14:44:56.781 INFO:tasks.workunit.client.0.smithi052.stdout:2/666: chown da/d19/d3a/d31/d7a/dbd/ld3 308 1 2024-09-06T14:44:56.781 INFO:tasks.workunit.client.0.smithi052.stdout:2/667: fsync f2 0 2024-09-06T14:44:56.793 INFO:tasks.workunit.client.0.smithi052.stdout:2/668: dread da/d19/d3a/d31/d76/f4d [0,4194304] 0 2024-09-06T14:44:56.815 INFO:tasks.workunit.client.0.smithi052.stdout:3/790: write d0/d11/d71/d98/d1b/f60 [2998012,104302] 0 2024-09-06T14:44:56.816 INFO:tasks.workunit.client.0.smithi052.stdout:3/791: fdatasync d0/d11/d71/d98/d9d/fc4 0 2024-09-06T14:44:56.816 INFO:tasks.workunit.client.0.smithi052.stdout:2/669: creat da/db/d60/daa/fdf x:0 0 0 2024-09-06T14:44:56.817 INFO:tasks.workunit.client.0.smithi052.stdout:2/670: stat da/d19/d5a/d6c 0 2024-09-06T14:44:56.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/671: dread - da/d19/d3a/d31/fd6 zero size 2024-09-06T14:44:56.824 INFO:tasks.workunit.client.0.smithi052.stdout:3/792: symlink d0/d11/d12/d4c/d93/d35/db5/lf6 0 2024-09-06T14:44:56.826 INFO:tasks.workunit.client.0.smithi052.stdout:2/672: link da/d2d/d34/lc3 da/d2d/d34/d62/le0 0 2024-09-06T14:44:56.828 INFO:tasks.workunit.client.0.smithi052.stdout:3/793: truncate d0/d11/d71/d98/f56 442665 0 2024-09-06T14:44:56.836 INFO:tasks.workunit.client.0.smithi052.stdout:9/497: truncate d1/d4/d6/f6c 230587 0 2024-09-06T14:44:56.837 INFO:tasks.workunit.client.0.smithi052.stdout:9/498: readlink d1/d4/d6/dc/d38/d5a/l6e 0 2024-09-06T14:44:56.837 INFO:tasks.workunit.client.0.smithi052.stdout:2/673: dread da/d19/d3a/d31/d76/d6a/f9c [0,4194304] 0 2024-09-06T14:44:56.838 INFO:tasks.workunit.client.0.smithi052.stdout:1/753: truncate d1/d6c/d98/fd2 899647 0 2024-09-06T14:44:56.839 INFO:tasks.workunit.client.0.smithi052.stdout:9/499: rmdir d1/d4/d6/dd 39 2024-09-06T14:44:56.849 INFO:tasks.workunit.client.0.smithi052.stdout:2/674: getdents da/d54 0 2024-09-06T14:44:56.849 INFO:tasks.workunit.client.0.smithi052.stdout:9/500: read d1/d4/df/f24 [211173,25934] 0 2024-09-06T14:44:56.853 INFO:tasks.workunit.client.0.smithi052.stdout:2/675: mknod da/db/d18/ce1 0 2024-09-06T14:44:56.858 INFO:tasks.workunit.client.0.smithi052.stdout:2/676: mknod da/d19/d3a/d61/ce2 0 2024-09-06T14:44:56.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/677: truncate da/db/d60/daa/fbc 970100 0 2024-09-06T14:44:56.870 INFO:tasks.workunit.client.0.smithi052.stdout:1/754: dread d1/db/de/d74/d14/f1f [0,4194304] 0 2024-09-06T14:44:56.873 INFO:tasks.workunit.client.0.smithi052.stdout:1/755: rmdir d1/db/de/d74/d14/d2e 39 2024-09-06T14:44:56.907 INFO:tasks.workunit.client.0.smithi052.stdout:9/501: write d1/f17 [5957105,48060] 0 2024-09-06T14:44:56.912 INFO:tasks.workunit.client.0.smithi052.stdout:9/502: getdents d1/d4/d6/dc/d38 0 2024-09-06T14:44:56.914 INFO:tasks.workunit.client.0.smithi052.stdout:9/503: symlink d1/d26/d3d/l93 0 2024-09-06T14:44:56.914 INFO:tasks.workunit.client.0.smithi052.stdout:9/504: readlink d1/d4/d6/dc/d10/d18/l8d 0 2024-09-06T14:44:56.916 INFO:tasks.workunit.client.0.smithi052.stdout:9/505: creat d1/d26/d3d/f94 x:0 0 0 2024-09-06T14:44:56.917 INFO:tasks.workunit.client.0.smithi052.stdout:9/506: dread - d1/d4/d6/dc/d10/d18/d82/f8b zero size 2024-09-06T14:44:56.919 INFO:tasks.workunit.client.0.smithi052.stdout:5/742: mkdir d2/d1a/d22/d26/d2b/d48/d64/dff 0 2024-09-06T14:44:56.920 INFO:tasks.workunit.client.0.smithi052.stdout:9/507: truncate d1/d4/d6/dc/d10/d18/f4e 4838 0 2024-09-06T14:44:56.920 INFO:tasks.workunit.client.0.smithi052.stdout:5/743: stat d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/ce2 0 2024-09-06T14:44:56.922 INFO:tasks.workunit.client.0.smithi052.stdout:3/794: creat d0/d11/d12/d4c/d93/d35/d46/d5b/ff7 x:0 0 0 2024-09-06T14:44:56.922 INFO:tasks.workunit.client.0.smithi052.stdout:9/508: read d1/fa [6624343,83687] 0 2024-09-06T14:44:56.925 INFO:tasks.workunit.client.0.smithi052.stdout:5/744: creat d2/d1a/d22/d26/d2b/d37/d84/d97/f100 x:0 0 0 2024-09-06T14:44:56.928 INFO:tasks.workunit.client.0.smithi052.stdout:5/745: read d2/d1a/d22/d26/d2b/f94 [1784433,13166] 0 2024-09-06T14:44:56.931 INFO:tasks.workunit.client.0.smithi052.stdout:9/509: creat d1/d26/f95 x:0 0 0 2024-09-06T14:44:56.933 INFO:tasks.workunit.client.0.smithi052.stdout:5/746: fdatasync d2/d20/d56/fbd 0 2024-09-06T14:44:56.940 INFO:tasks.workunit.client.0.smithi052.stdout:9/510: write d1/d4/d6/dd/f5f [1419141,116824] 0 2024-09-06T14:44:56.944 INFO:tasks.workunit.client.0.smithi052.stdout:9/511: creat d1/d4/df/d56/f96 x:0 0 0 2024-09-06T14:44:56.950 INFO:tasks.workunit.client.0.smithi052.stdout:3/795: dwrite d0/d11/d71/d98/d1b/f27 [0,4194304] 0 2024-09-06T14:44:56.951 INFO:tasks.workunit.client.0.smithi052.stdout:3/796: chown d0/d11/d12/d73/lc2 1420899651 1 2024-09-06T14:44:56.956 INFO:tasks.workunit.client.0.smithi052.stdout:5/747: write d2/d1a/d22/d26/d2b/d37/d6a/fcd [912285,42669] 0 2024-09-06T14:44:56.961 INFO:tasks.workunit.client.0.smithi052.stdout:3/797: getdents d0/d11/d71 0 2024-09-06T14:44:56.963 INFO:tasks.workunit.client.0.smithi052.stdout:9/512: dwrite d1/d4/d6/dc/f61 [0,4194304] 0 2024-09-06T14:44:56.964 INFO:tasks.workunit.client.0.smithi052.stdout:5/748: truncate d2/d1a/d22/d26/d2b/d37/d6a/f8e 546357 0 2024-09-06T14:44:56.966 INFO:tasks.workunit.client.0.smithi052.stdout:3/798: write d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/fe3 [3859876,74797] 0 2024-09-06T14:44:56.969 INFO:tasks.workunit.client.0.smithi052.stdout:9/513: chown d1/d26/l85 8622 1 2024-09-06T14:44:56.972 INFO:tasks.workunit.client.0.smithi052.stdout:5/749: dwrite d2/d1a/d22/d26/d2b/d37/f44 [0,4194304] 0 2024-09-06T14:44:56.975 INFO:tasks.workunit.client.0.smithi052.stdout:9/514: chown d1/d4/d6/dd/d2b/f64 929022 1 2024-09-06T14:44:56.976 INFO:tasks.workunit.client.0.smithi052.stdout:9/515: chown d1/d4/df/f6d 5345845 1 2024-09-06T14:44:56.978 INFO:tasks.workunit.client.0.smithi052.stdout:3/799: mkdir d0/d11/d12/d4c/d93/d35/d46/df8 0 2024-09-06T14:44:56.980 INFO:tasks.workunit.client.0.smithi052.stdout:3/800: dread - d0/d11/d12/d4c/d93/d35/d46/d5b/fa3 zero size 2024-09-06T14:44:56.981 INFO:tasks.workunit.client.0.smithi052.stdout:9/516: mknod d1/d26/d3d/c97 0 2024-09-06T14:44:56.987 INFO:tasks.workunit.client.0.smithi052.stdout:9/517: symlink d1/d4/df/d71/l98 0 2024-09-06T14:44:56.987 INFO:tasks.workunit.client.0.smithi052.stdout:9/518: write d1/f17 [7529625,1551] 0 2024-09-06T14:44:56.990 INFO:tasks.workunit.client.0.smithi052.stdout:9/519: unlink d1/d4/d6/dc/d38/f7f 0 2024-09-06T14:44:56.996 INFO:tasks.workunit.client.0.smithi052.stdout:9/520: mknod d1/d4/d6/dd/d22/c99 0 2024-09-06T14:44:56.998 INFO:tasks.workunit.client.0.smithi052.stdout:5/750: write d2/d1a/d22/d26/d2b/d37/d84/f9b [50153,57792] 0 2024-09-06T14:44:56.999 INFO:tasks.workunit.client.0.smithi052.stdout:5/751: chown d2/d1a/d22/d26/d2b/d48/d64/ld9 1 1 2024-09-06T14:44:57.003 INFO:tasks.workunit.client.0.smithi052.stdout:9/521: creat d1/d4/d6/dd/f9a x:0 0 0 2024-09-06T14:44:57.008 INFO:tasks.workunit.client.0.smithi052.stdout:9/522: mknod d1/d26/d87/c9b 0 2024-09-06T14:44:57.009 INFO:tasks.workunit.client.0.smithi052.stdout:3/801: dwrite d0/d11/d12/d4c/d93/d35/d46/d5b/f7e [0,4194304] 0 2024-09-06T14:44:57.009 INFO:tasks.workunit.client.0.smithi052.stdout:5/752: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/ffc [0,4194304] 0 2024-09-06T14:44:57.011 INFO:tasks.workunit.client.0.smithi052.stdout:9/523: rmdir d1/d4/df/d71 39 2024-09-06T14:44:57.015 INFO:tasks.workunit.client.0.smithi052.stdout:3/802: rmdir d0/d11/d12 39 2024-09-06T14:44:57.017 INFO:tasks.workunit.client.0.smithi052.stdout:5/753: fdatasync d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fa8 0 2024-09-06T14:44:57.019 INFO:tasks.workunit.client.0.smithi052.stdout:9/524: fdatasync d1/d4/df/d56/f86 0 2024-09-06T14:44:57.021 INFO:tasks.workunit.client.0.smithi052.stdout:3/803: write d0/d11/d12/d17/f48 [3629548,68662] 0 2024-09-06T14:44:57.024 INFO:tasks.workunit.client.0.smithi052.stdout:5/754: creat d2/d20/d42/d8b/dca/f101 x:0 0 0 2024-09-06T14:44:57.029 INFO:tasks.workunit.client.0.smithi052.stdout:5/755: creat d2/d1a/d22/d26/d2b/d37/d84/df5/f102 x:0 0 0 2024-09-06T14:44:57.031 INFO:tasks.workunit.client.0.smithi052.stdout:3/804: getdents d0/d11/d12/d73 0 2024-09-06T14:44:57.035 INFO:tasks.workunit.client.0.smithi052.stdout:9/525: link d1/d4/c7d d1/d4/d6/dd/d22/c9c 0 2024-09-06T14:44:57.036 INFO:tasks.workunit.client.0.smithi052.stdout:5/756: creat d2/d1a/d22/d26/d2b/d37/f103 x:0 0 0 2024-09-06T14:44:57.038 INFO:tasks.workunit.client.0.smithi052.stdout:5/757: fdatasync d2/d1a/d22/d26/d2b/d48/f90 0 2024-09-06T14:44:57.040 INFO:tasks.workunit.client.0.smithi052.stdout:5/758: chown d2/d20/d56/fd2 4 1 2024-09-06T14:44:57.046 INFO:tasks.workunit.client.0.smithi052.stdout:5/759: dwrite d2/d1a/d22/d26/f73 [0,4194304] 0 2024-09-06T14:44:57.047 INFO:tasks.workunit.client.0.smithi052.stdout:3/805: dread d0/d11/d71/d98/d19/f2f [0,4194304] 0 2024-09-06T14:44:57.047 INFO:tasks.workunit.client.0.smithi052.stdout:5/760: chown d2/d20/d42/d65/ff2 0 1 2024-09-06T14:44:57.050 INFO:tasks.workunit.client.0.smithi052.stdout:5/761: creat d2/d1a/d22/d26/d2b/f104 x:0 0 0 2024-09-06T14:44:57.122 INFO:tasks.workunit.client.0.smithi052.stdout:9/526: dwrite d1/d4/df/d56/f86 [4194304,4194304] 0 2024-09-06T14:44:57.124 INFO:tasks.workunit.client.0.smithi052.stdout:9/527: chown d1/d4/d6/dc/d10/d18/d82/f8b 295531212 1 2024-09-06T14:44:57.125 INFO:tasks.workunit.client.0.smithi052.stdout:9/528: chown d1/f30 2040 1 2024-09-06T14:44:57.126 INFO:tasks.workunit.client.0.smithi052.stdout:5/762: dwrite d2/d20/d42/d8b/fab [0,4194304] 0 2024-09-06T14:44:57.128 INFO:tasks.workunit.client.0.smithi052.stdout:9/529: chown d1/d4/d6/dc/d10/d18/f5d 28827609 1 2024-09-06T14:44:57.129 INFO:tasks.workunit.client.0.smithi052.stdout:5/763: dread - d2/d1a/d22/d26/d2b/d37/d84/df5/f102 zero size 2024-09-06T14:44:57.135 INFO:tasks.workunit.client.0.smithi052.stdout:9/530: creat d1/d4/d6/dc/d10/d18/f9d x:0 0 0 2024-09-06T14:44:57.137 INFO:tasks.workunit.client.0.smithi052.stdout:5/764: mknod d2/d20/d42/c105 0 2024-09-06T14:44:57.140 INFO:tasks.workunit.client.0.smithi052.stdout:9/531: mkdir d1/d4/d6/dc/d10/d18/d82/d9e 0 2024-09-06T14:44:57.140 INFO:tasks.workunit.client.0.smithi052.stdout:9/532: fsync d1/d4/d6/dd/d2b/f49 0 2024-09-06T14:44:57.141 INFO:tasks.workunit.client.0.smithi052.stdout:5/765: symlink d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/l106 0 2024-09-06T14:44:57.145 INFO:tasks.workunit.client.0.smithi052.stdout:5/766: truncate d2/d1a/d22/d26/d2b/d37/d6a/fe6 1678501 0 2024-09-06T14:44:57.146 INFO:tasks.workunit.client.0.smithi052.stdout:9/533: dwrite d1/d4/d6/dc/d10/d18/f33 [0,4194304] 0 2024-09-06T14:44:57.148 INFO:tasks.workunit.client.0.smithi052.stdout:9/534: dread - d1/d4/d6/dd/f9a zero size 2024-09-06T14:44:57.156 INFO:tasks.workunit.client.0.smithi052.stdout:9/535: dwrite d1/d26/f4c [0,4194304] 0 2024-09-06T14:44:57.156 INFO:tasks.workunit.client.0.smithi052.stdout:5/767: getdents d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c 0 2024-09-06T14:44:57.157 INFO:tasks.workunit.client.0.smithi052.stdout:9/536: write d1/d4/d6/dc/d10/d18/f33 [4933937,40623] 0 2024-09-06T14:44:57.161 INFO:tasks.workunit.client.0.smithi052.stdout:5/768: symlink d2/d20/l107 0 2024-09-06T14:44:57.165 INFO:tasks.workunit.client.0.smithi052.stdout:5/769: mkdir d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/d108 0 2024-09-06T14:44:57.167 INFO:tasks.workunit.client.0.smithi052.stdout:9/537: dread d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:57.178 INFO:tasks.workunit.client.0.smithi052.stdout:5/770: link d2/d1a/d22/d26/d2b/d37/d84/da7/cbb d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/c109 0 2024-09-06T14:44:57.180 INFO:tasks.workunit.client.0.smithi052.stdout:9/538: dread d1/d4/d6/dc/d10/d18/f5d [0,4194304] 0 2024-09-06T14:44:57.183 INFO:tasks.workunit.client.0.smithi052.stdout:9/539: mkdir d1/d4/d6/dc/d10/d18/d9f 0 2024-09-06T14:44:57.184 INFO:tasks.workunit.client.0.smithi052.stdout:5/771: getdents d2/d1a/d22/d26/d2b/d37/d84/dd8 0 2024-09-06T14:44:57.184 INFO:tasks.workunit.client.0.smithi052.stdout:9/540: fsync d1/d4/d6/dc/d10/d18/d82/f8b 0 2024-09-06T14:44:57.185 INFO:tasks.workunit.client.0.smithi052.stdout:9/541: dread - d1/d26/d3d/f94 zero size 2024-09-06T14:44:57.186 INFO:tasks.workunit.client.0.smithi052.stdout:5/772: mkdir d2/d20/d42/d8b/dca/d10a 0 2024-09-06T14:44:57.191 INFO:tasks.workunit.client.0.smithi052.stdout:9/542: dwrite d1/fa [0,4194304] 0 2024-09-06T14:44:57.193 INFO:tasks.workunit.client.0.smithi052.stdout:5/773: dwrite d2/d1a/d22/d26/f85 [0,4194304] 0 2024-09-06T14:44:57.195 INFO:tasks.workunit.client.0.smithi052.stdout:5/774: chown d2/d1a/d22/d26/d2b/d48/d64/dbf 213283661 1 2024-09-06T14:44:57.206 INFO:tasks.workunit.client.0.smithi052.stdout:9/543: truncate d1/fa 6874892 0 2024-09-06T14:44:57.208 INFO:tasks.workunit.client.0.smithi052.stdout:5/775: write d2/d1a/f2d [253196,5854] 0 2024-09-06T14:44:57.226 INFO:tasks.workunit.client.0.smithi052.stdout:9/544: read d1/d4/d6/dc/d10/d18/f4e [2613,62059] 0 2024-09-06T14:44:57.226 INFO:tasks.workunit.client.0.smithi052.stdout:5/776: fdatasync d2/d1a/d22/d26/d62/f8a 0 2024-09-06T14:44:57.230 INFO:tasks.workunit.client.0.smithi052.stdout:9/545: mkdir d1/d4/d6/dc/d38/d5a/da0 0 2024-09-06T14:44:57.233 INFO:tasks.workunit.client.0.smithi052.stdout:5/777: dwrite d2/f16 [8388608,4194304] 0 2024-09-06T14:44:57.236 INFO:tasks.workunit.client.0.smithi052.stdout:5/778: fsync d2/d20/d56/fc0 0 2024-09-06T14:44:57.237 INFO:tasks.workunit.client.0.smithi052.stdout:9/546: creat d1/d4/d6/dc/fa1 x:0 0 0 2024-09-06T14:44:57.238 INFO:tasks.workunit.client.0.smithi052.stdout:5/779: truncate d2/d1a/d22/d26/d2b/d37/d6a/fcd 961460 0 2024-09-06T14:44:57.239 INFO:tasks.workunit.client.0.smithi052.stdout:9/547: rmdir d1/d4/d6/dc/d10/d73 39 2024-09-06T14:44:57.239 INFO:tasks.workunit.client.0.smithi052.stdout:5/780: chown d2/d20/d42/d65 1051 1 2024-09-06T14:44:57.242 INFO:tasks.workunit.client.0.smithi052.stdout:9/548: mkdir d1/d4/d6/dd/da2 0 2024-09-06T14:44:57.247 INFO:tasks.workunit.client.0.smithi052.stdout:9/549: dread d1/d4/d6/dd/d2b/f64 [0,4194304] 0 2024-09-06T14:44:57.253 INFO:tasks.workunit.client.0.smithi052.stdout:9/550: dwrite d1/d4/d6/dc/d10/d18/f3c [4194304,4194304] 0 2024-09-06T14:44:57.255 INFO:tasks.workunit.client.0.smithi052.stdout:5/781: write d2/d20/d56/fbd [679717,117396] 0 2024-09-06T14:44:57.256 INFO:tasks.workunit.client.0.smithi052.stdout:9/551: symlink d1/d26/d3d/la3 0 2024-09-06T14:44:57.258 INFO:tasks.workunit.client.0.smithi052.stdout:9/552: fdatasync d1/d4/d6/dd/d2b/f64 0 2024-09-06T14:44:57.260 INFO:tasks.workunit.client.0.smithi052.stdout:5/782: creat d2/d1a/d22/d26/d2b/d37/d84/d97/f10b x:0 0 0 2024-09-06T14:44:57.261 INFO:tasks.workunit.client.0.smithi052.stdout:9/553: creat d1/d26/d87/fa4 x:0 0 0 2024-09-06T14:44:57.262 INFO:tasks.workunit.client.0.smithi052.stdout:9/554: chown d1/d26/d87/fa4 11799 1 2024-09-06T14:44:57.262 INFO:tasks.workunit.client.0.smithi052.stdout:5/783: mknod d2/d20/d56/c10c 0 2024-09-06T14:44:57.268 INFO:tasks.workunit.client.0.smithi052.stdout:9/555: mkdir d1/d4/df/d71/da5 0 2024-09-06T14:44:57.269 INFO:tasks.workunit.client.0.smithi052.stdout:5/784: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fe1 [0,4194304] 0 2024-09-06T14:44:57.271 INFO:tasks.workunit.client.0.smithi052.stdout:9/556: rmdir d1/d26/d41/d7e 39 2024-09-06T14:44:57.273 INFO:tasks.workunit.client.0.smithi052.stdout:5/785: mknod d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/c10d 0 2024-09-06T14:44:57.283 INFO:tasks.workunit.client.0.smithi052.stdout:9/557: getdents d1/d4/d4b 0 2024-09-06T14:44:57.293 INFO:tasks.workunit.client.0.smithi052.stdout:5/786: dread d2/d20/f23 [0,4194304] 0 2024-09-06T14:44:57.296 INFO:tasks.workunit.client.0.smithi052.stdout:5/787: creat d2/d1a/ddb/f10e x:0 0 0 2024-09-06T14:44:57.300 INFO:tasks.workunit.client.0.smithi052.stdout:5/788: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/f10f x:0 0 0 2024-09-06T14:44:57.301 INFO:tasks.workunit.client.0.smithi052.stdout:9/558: dread d1/d4/f43 [0,4194304] 0 2024-09-06T14:44:57.302 INFO:tasks.workunit.client.0.smithi052.stdout:9/559: chown d1/d26/d3d/la3 33754814 1 2024-09-06T14:44:57.309 INFO:tasks.workunit.client.0.smithi052.stdout:5/789: getdents d2/d20/d42/d8b 0 2024-09-06T14:44:57.309 INFO:tasks.workunit.client.0.smithi052.stdout:9/560: getdents d1/d4/df/d56 0 2024-09-06T14:44:57.309 INFO:tasks.workunit.client.0.smithi052.stdout:5/790: symlink d2/d1a/df4/l110 0 2024-09-06T14:44:57.310 INFO:tasks.workunit.client.0.smithi052.stdout:9/561: truncate d1/d26/d41/f67 696702 0 2024-09-06T14:44:57.310 INFO:tasks.workunit.client.0.smithi052.stdout:5/791: stat d2/d1a/d22/d26/d2b/d48/f4b 0 2024-09-06T14:44:57.311 INFO:tasks.workunit.client.0.smithi052.stdout:5/792: chown d2/l9 2081840 1 2024-09-06T14:44:57.313 INFO:tasks.workunit.client.0.smithi052.stdout:9/562: unlink d1/d4/df/d56/f96 0 2024-09-06T14:44:57.314 INFO:tasks.workunit.client.0.smithi052.stdout:5/793: rmdir d2/d1a/d22/d26/d2b/d37/d6a 39 2024-09-06T14:44:57.314 INFO:tasks.workunit.client.0.smithi052.stdout:9/563: write d1/d4/d6/dd/d2b/f49 [5863229,29204] 0 2024-09-06T14:44:57.317 INFO:tasks.workunit.client.0.smithi052.stdout:5/794: chown d2/d1a/d22/d26/d2b/d48/f8d 3 1 2024-09-06T14:44:57.327 INFO:tasks.workunit.client.0.smithi052.stdout:9/564: write d1/d4/df/f24 [4170637,69369] 0 2024-09-06T14:44:57.330 INFO:tasks.workunit.client.0.smithi052.stdout:5/795: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/f6e [0,4194304] 0 2024-09-06T14:44:57.331 INFO:tasks.workunit.client.0.smithi052.stdout:9/565: mkdir d1/d4/d6/dc/d10/d18/d82/da6 0 2024-09-06T14:44:57.336 INFO:tasks.workunit.client.0.smithi052.stdout:9/566: link d1/d4/d6/dc/d10/d18/f74 d1/d4/df/d71/fa7 0 2024-09-06T14:44:57.347 INFO:tasks.workunit.client.0.smithi052.stdout:9/567: truncate d1/d4/d6/dd/f77 4496250 0 2024-09-06T14:44:57.350 INFO:tasks.workunit.client.0.smithi052.stdout:9/568: mkdir d1/d26/d3d/da8 0 2024-09-06T14:44:57.350 INFO:tasks.workunit.client.0.smithi052.stdout:9/569: truncate d1/d4/d6/dd/f9a 698611 0 2024-09-06T14:44:57.354 INFO:tasks.workunit.client.0.smithi052.stdout:9/570: mkdir d1/d4/d6/dc/d10/d73/da9 0 2024-09-06T14:44:57.372 INFO:tasks.workunit.client.0.smithi052.stdout:9/571: dread d1/d4/f5 [0,4194304] 0 2024-09-06T14:44:57.375 INFO:tasks.workunit.client.0.smithi052.stdout:9/572: creat d1/d4/d6/dd/d22/faa x:0 0 0 2024-09-06T14:44:57.380 INFO:tasks.workunit.client.0.smithi052.stdout:9/573: readlink d1/d4/d6/dd/d22/l3a 0 2024-09-06T14:44:57.383 INFO:tasks.workunit.client.0.smithi052.stdout:9/574: link d1/d4/d6/l81 d1/d4/d6/dc/d10/d73/da9/lab 0 2024-09-06T14:44:57.384 INFO:tasks.workunit.client.0.smithi052.stdout:9/575: readlink d1/d26/d41/d7e/l89 0 2024-09-06T14:44:57.385 INFO:tasks.workunit.client.0.smithi052.stdout:9/576: chown d1/d4/d6/dc/d10/d18/l52 649 1 2024-09-06T14:44:57.389 INFO:tasks.workunit.client.0.smithi052.stdout:9/577: dread d1/d4/d6/dc/d10/d18/f5d [0,4194304] 0 2024-09-06T14:44:57.390 INFO:tasks.workunit.client.0.smithi052.stdout:9/578: dread - d1/d4/d6/dc/d10/d18/f9d zero size 2024-09-06T14:44:57.391 INFO:tasks.workunit.client.0.smithi052.stdout:9/579: chown d1/d4/df/d56/f86 210277 1 2024-09-06T14:44:57.392 INFO:tasks.workunit.client.0.smithi052.stdout:9/580: creat d1/d26/d87/fac x:0 0 0 2024-09-06T14:44:57.393 INFO:tasks.workunit.client.0.smithi052.stdout:9/581: truncate d1/d4/d6/dd/f8f 987951 0 2024-09-06T14:44:57.394 INFO:tasks.workunit.client.0.smithi052.stdout:9/582: chown d1/d4/f7 53 1 2024-09-06T14:44:57.397 INFO:tasks.workunit.client.0.smithi052.stdout:9/583: getdents d1/d4/df/d56 0 2024-09-06T14:44:57.398 INFO:tasks.workunit.client.0.smithi052.stdout:9/584: chown d1/d4/d6/dc/fa1 15527850 1 2024-09-06T14:44:57.399 INFO:tasks.workunit.client.0.smithi052.stdout:9/585: rmdir d1 39 2024-09-06T14:44:57.401 INFO:tasks.workunit.client.0.smithi052.stdout:9/586: mkdir d1/d4/d6/dc/d38/d5a/dad 0 2024-09-06T14:44:57.403 INFO:tasks.workunit.client.0.smithi052.stdout:9/587: write d1/d4/d6/dd/f9a [1060459,9529] 0 2024-09-06T14:44:57.406 INFO:tasks.workunit.client.0.smithi052.stdout:9/588: rename d1/d4/d6/dc/d10/d18/d82/f8b to d1/d4/d6/dc/d10/d73/fae 0 2024-09-06T14:44:57.411 INFO:tasks.workunit.client.0.smithi052.stdout:9/589: dwrite d1/d4/d6/dc/d10/d18/f84 [0,4194304] 0 2024-09-06T14:44:57.413 INFO:tasks.workunit.client.0.smithi052.stdout:9/590: chown d1/d4/d6/dc/fa1 2 1 2024-09-06T14:44:57.769 INFO:tasks.workunit.client.0.smithi052.stdout:4/666: sync 2024-09-06T14:44:57.769 INFO:tasks.workunit.client.0.smithi052.stdout:6/535: sync 2024-09-06T14:44:57.772 INFO:tasks.workunit.client.0.smithi052.stdout:4/667: mknod d9/d10/d17/d39/d3a/cea 0 2024-09-06T14:44:57.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/536: mkdir d2/dd/d9d/db4 0 2024-09-06T14:44:57.775 INFO:tasks.workunit.client.0.smithi052.stdout:4/668: rmdir d9/d2d/d33/d4d/d81/d9c/dac 39 2024-09-06T14:44:57.777 INFO:tasks.workunit.client.0.smithi052.stdout:6/537: symlink d2/dd/d18/lb5 0 2024-09-06T14:44:57.778 INFO:tasks.workunit.client.0.smithi052.stdout:6/538: write d2/f30 [6286507,71042] 0 2024-09-06T14:44:57.779 INFO:tasks.workunit.client.0.smithi052.stdout:6/539: chown d2/caa 3813 1 2024-09-06T14:44:57.780 INFO:tasks.workunit.client.0.smithi052.stdout:4/669: fsync d9/d10/d19/f3c 0 2024-09-06T14:44:57.784 INFO:tasks.workunit.client.0.smithi052.stdout:4/670: rename d9/d2d/d33/d4d to d9/d2d/d33/d5d/da6/deb 0 2024-09-06T14:44:57.802 INFO:tasks.workunit.client.0.smithi052.stdout:6/540: dread d2/dd/d18/d33/d44/d47/f80 [0,4194304] 0 2024-09-06T14:44:57.807 INFO:tasks.workunit.client.0.smithi052.stdout:6/541: rename d2/dd/d18/d33/d44/d47 to d2/db6 0 2024-09-06T14:44:57.809 INFO:tasks.workunit.client.0.smithi052.stdout:6/542: creat d2/dd/d18/d2d/da7/fb7 x:0 0 0 2024-09-06T14:44:57.815 INFO:tasks.workunit.client.0.smithi052.stdout:6/543: dwrite d2/db6/fac [0,4194304] 0 2024-09-06T14:44:57.822 INFO:tasks.workunit.client.0.smithi052.stdout:6/544: truncate d2/dd/d18/d25/d4c/f74 1956761 0 2024-09-06T14:44:57.828 INFO:tasks.workunit.client.0.smithi052.stdout:6/545: dwrite d2/dd/d18/d25/f87 [0,4194304] 0 2024-09-06T14:44:57.829 INFO:tasks.workunit.client.0.smithi052.stdout:6/546: readlink d2/l4e 0 2024-09-06T14:44:57.830 INFO:tasks.workunit.client.0.smithi052.stdout:6/547: write d2/dd/d18/d25/f87 [426311,114237] 0 2024-09-06T14:44:57.836 INFO:tasks.workunit.client.0.smithi052.stdout:6/548: creat d2/d4a/d6e/fb8 x:0 0 0 2024-09-06T14:44:57.837 INFO:tasks.workunit.client.0.smithi052.stdout:6/549: dread - d2/d4a/d6e/fb8 zero size 2024-09-06T14:44:57.841 INFO:tasks.workunit.client.0.smithi052.stdout:6/550: rmdir d2/dd/d18/d4b 39 2024-09-06T14:44:57.848 INFO:tasks.workunit.client.0.smithi052.stdout:6/551: dwrite d2/dd/d18/d2d/da7/fb7 [0,4194304] 0 2024-09-06T14:44:57.855 INFO:tasks.workunit.client.0.smithi052.stdout:6/552: write d2/dd/d18/d33/f50 [731353,120087] 0 2024-09-06T14:44:57.856 INFO:tasks.workunit.client.0.smithi052.stdout:6/553: dread - d2/d4a/d6e/fb8 zero size 2024-09-06T14:44:57.863 INFO:tasks.workunit.client.0.smithi052.stdout:6/554: dwrite d2/dd/d18/f22 [8388608,4194304] 0 2024-09-06T14:44:57.865 INFO:tasks.workunit.client.0.smithi052.stdout:6/555: rmdir d2/dd/d7d 39 2024-09-06T14:44:57.876 INFO:tasks.workunit.client.0.smithi052.stdout:6/556: dwrite d2/dd/d7d/fa8 [0,4194304] 0 2024-09-06T14:44:57.877 INFO:tasks.workunit.client.0.smithi052.stdout:6/557: chown d2/dd/d18/d33/d44/d79 1266753025 1 2024-09-06T14:44:57.877 INFO:tasks.workunit.client.0.smithi052.stdout:6/558: fsync d2/db6/fac 0 2024-09-06T14:44:57.880 INFO:tasks.workunit.client.0.smithi052.stdout:6/559: rmdir d2/dd/d18/d2d/d32 39 2024-09-06T14:44:57.885 INFO:tasks.workunit.client.0.smithi052.stdout:6/560: dread d2/dd/d7d/fa8 [0,4194304] 0 2024-09-06T14:44:57.888 INFO:tasks.workunit.client.0.smithi052.stdout:6/561: creat d2/db6/fb9 x:0 0 0 2024-09-06T14:44:57.895 INFO:tasks.workunit.client.0.smithi052.stdout:6/562: rename d2/dd/d18/d4b/l5a to d2/dd/d18/d2d/da7/lba 0 2024-09-06T14:44:57.908 INFO:tasks.workunit.client.0.smithi052.stdout:6/563: truncate d2/dd/d18/d33/f4d 551407 0 2024-09-06T14:44:57.910 INFO:tasks.workunit.client.0.smithi052.stdout:6/564: mknod d2/dd/d81/cbb 0 2024-09-06T14:44:57.912 INFO:tasks.workunit.client.0.smithi052.stdout:6/565: fsync d2/dd/d18/d25/f2c 0 2024-09-06T14:44:57.913 INFO:tasks.workunit.client.0.smithi052.stdout:6/566: dread - d2/dd/d18/d2d/da7/fb1 zero size 2024-09-06T14:44:57.926 INFO:tasks.workunit.client.0.smithi052.stdout:7/644: sync 2024-09-06T14:44:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:2/678: sync 2024-09-06T14:44:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:9/591: sync 2024-09-06T14:44:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:3/806: sync 2024-09-06T14:44:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:0/628: sync 2024-09-06T14:44:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:8/975: sync 2024-09-06T14:44:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:1/756: sync 2024-09-06T14:44:57.927 INFO:tasks.workunit.client.0.smithi052.stdout:5/796: sync 2024-09-06T14:44:57.929 INFO:tasks.workunit.client.0.smithi052.stdout:6/567: dwrite d2/d4a/f5b [0,4194304] 0 2024-09-06T14:44:57.934 INFO:tasks.workunit.client.0.smithi052.stdout:2/679: stat da/d2d/d34/lc3 0 2024-09-06T14:44:57.935 INFO:tasks.workunit.client.0.smithi052.stdout:8/976: creat d6/d16/dbf/f160 x:0 0 0 2024-09-06T14:44:57.935 INFO:tasks.workunit.client.0.smithi052.stdout:7/645: mknod d11/d1c/d24/d3b/d50/cd1 0 2024-09-06T14:44:57.936 INFO:tasks.workunit.client.0.smithi052.stdout:3/807: truncate d0/d11/d71/d98/d1b/d85/fdb 331846 0 2024-09-06T14:44:57.938 INFO:tasks.workunit.client.0.smithi052.stdout:9/592: write d1/d4/df/d56/f86 [2983532,99338] 0 2024-09-06T14:44:57.941 INFO:tasks.workunit.client.0.smithi052.stdout:3/808: write d0/f9a [836499,98903] 0 2024-09-06T14:44:57.941 INFO:tasks.workunit.client.0.smithi052.stdout:0/629: creat d0/d1a/d26/d3a/d14/d2d/de2/fe5 x:0 0 0 2024-09-06T14:44:57.944 INFO:tasks.workunit.client.0.smithi052.stdout:8/977: symlink d6/d9/d6d/d11b/l161 0 2024-09-06T14:44:57.944 INFO:tasks.workunit.client.0.smithi052.stdout:2/680: fsync da/d19/d3a/f3f 0 2024-09-06T14:44:57.947 INFO:tasks.workunit.client.0.smithi052.stdout:6/568: rename d2/dd/f7a to d2/dd/d18/d2d/d71/fbc 0 2024-09-06T14:44:57.951 INFO:tasks.workunit.client.0.smithi052.stdout:1/757: dread d1/db/f3f [0,4194304] 0 2024-09-06T14:44:57.951 INFO:tasks.workunit.client.0.smithi052.stdout:8/978: read d6/d22/d36/dec/f143 [1001078,78643] 0 2024-09-06T14:44:57.952 INFO:tasks.workunit.client.0.smithi052.stdout:6/569: write d2/db6/fac [4223023,7265] 0 2024-09-06T14:44:57.952 INFO:tasks.workunit.client.0.smithi052.stdout:7/646: dread d11/d1c/d24/d3b/d50/f58 [0,4194304] 0 2024-09-06T14:44:57.952 INFO:tasks.workunit.client.0.smithi052.stdout:0/630: unlink d0/d1a/l3f 0 2024-09-06T14:44:57.953 INFO:tasks.workunit.client.0.smithi052.stdout:5/797: write d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fcc [974352,4385] 0 2024-09-06T14:44:57.954 INFO:tasks.workunit.client.0.smithi052.stdout:7/647: stat d11/c1b 0 2024-09-06T14:44:57.956 INFO:tasks.workunit.client.0.smithi052.stdout:1/758: write d1/db/de/d74/d36/f3d [1814569,90577] 0 2024-09-06T14:44:57.958 INFO:tasks.workunit.client.0.smithi052.stdout:7/648: dread - d11/d1c/d3f/d73/dae/fc6 zero size 2024-09-06T14:44:57.961 INFO:tasks.workunit.client.0.smithi052.stdout:7/649: chown d11/d1c/lb3 12 1 2024-09-06T14:44:57.962 INFO:tasks.workunit.client.0.smithi052.stdout:9/593: rename d1/d4/df/f6d to d1/d4/d6/dc/d38/d5a/faf 0 2024-09-06T14:44:57.963 INFO:tasks.workunit.client.0.smithi052.stdout:7/650: chown d11/d1c/d24/d4b/f9b 21612372 1 2024-09-06T14:44:57.965 INFO:tasks.workunit.client.0.smithi052.stdout:3/809: dread d0/d11/d12/d17/f48 [0,4194304] 0 2024-09-06T14:44:57.966 INFO:tasks.workunit.client.0.smithi052.stdout:6/570: dwrite d2/dd/d18/d25/d4c/d61/f97 [0,4194304] 0 2024-09-06T14:44:57.969 INFO:tasks.workunit.client.0.smithi052.stdout:6/571: stat d2/d4a/d6e/fa2 0 2024-09-06T14:44:57.969 INFO:tasks.workunit.client.0.smithi052.stdout:3/810: chown d0/d11/d12/d4c/d93/l81 175126 1 2024-09-06T14:44:57.973 INFO:tasks.workunit.client.0.smithi052.stdout:3/811: chown d0/d11/d71/d98/f55 195840 1 2024-09-06T14:44:57.974 INFO:tasks.workunit.client.0.smithi052.stdout:6/572: truncate d2/db6/fb9 512490 0 2024-09-06T14:44:57.975 INFO:tasks.workunit.client.0.smithi052.stdout:9/594: dwrite d1/d4/d6/dd/d22/faa [0,4194304] 0 2024-09-06T14:44:57.975 INFO:tasks.workunit.client.0.smithi052.stdout:1/759: creat d1/db/de/f10a x:0 0 0 2024-09-06T14:44:57.981 INFO:tasks.workunit.client.0.smithi052.stdout:5/798: symlink d2/d1a/d22/d26/d2b/d37/d84/dd8/l111 0 2024-09-06T14:44:57.982 INFO:tasks.workunit.client.0.smithi052.stdout:6/573: chown d2/dd/d18/d25/f87 11580 1 2024-09-06T14:44:57.982 INFO:tasks.workunit.client.0.smithi052.stdout:7/651: mkdir d11/d1c/d3f/d5d/d88/dd2 0 2024-09-06T14:44:57.982 INFO:tasks.workunit.client.0.smithi052.stdout:8/979: stat d6/d22/d36/d3e/d47/d56/l5e 0 2024-09-06T14:44:57.983 INFO:tasks.workunit.client.0.smithi052.stdout:7/652: truncate d11/f49 1034223 0 2024-09-06T14:44:57.983 INFO:tasks.workunit.client.0.smithi052.stdout:2/681: getdents da/d19 0 2024-09-06T14:44:57.986 INFO:tasks.workunit.client.0.smithi052.stdout:3/812: symlink d0/d11/d12/d4c/d93/d35/lf9 0 2024-09-06T14:44:57.988 INFO:tasks.workunit.client.0.smithi052.stdout:0/631: dwrite d0/d4f/d7d/f62 [4194304,4194304] 0 2024-09-06T14:44:57.989 INFO:tasks.workunit.client.0.smithi052.stdout:6/574: write d2/dd/d18/d4b/f58 [1296593,89082] 0 2024-09-06T14:44:57.989 INFO:tasks.workunit.client.0.smithi052.stdout:7/653: write d11/d1c/d26/f94 [3775175,125483] 0 2024-09-06T14:44:57.993 INFO:tasks.workunit.client.0.smithi052.stdout:9/595: rename c0 to d1/d4/d6/dc/d10/d73/da9/cb0 0 2024-09-06T14:44:57.998 INFO:tasks.workunit.client.0.smithi052.stdout:2/682: mknod da/d19/d3a/d31/d7a/dbd/ce3 0 2024-09-06T14:44:58.001 INFO:tasks.workunit.client.0.smithi052.stdout:0/632: mknod d0/d1a/d8e/ce6 0 2024-09-06T14:44:58.006 INFO:tasks.workunit.client.0.smithi052.stdout:8/980: rename d6/fdd to d6/d9/d1f/d33/da8/d1b/d126/d12b/f162 0 2024-09-06T14:44:58.007 INFO:tasks.workunit.client.0.smithi052.stdout:8/981: readlink d6/d9/d1f/d19/dc4/l132 0 2024-09-06T14:44:58.008 INFO:tasks.workunit.client.0.smithi052.stdout:5/799: creat d2/d1a/d22/d26/d2b/d37/d6a/f112 x:0 0 0 2024-09-06T14:44:58.009 INFO:tasks.workunit.client.0.smithi052.stdout:1/760: dwrite d1/db/d72/f97 [0,4194304] 0 2024-09-06T14:44:58.013 INFO:tasks.workunit.client.0.smithi052.stdout:2/683: truncate da/d2d/d34/d62/f79 761659 0 2024-09-06T14:44:58.014 INFO:tasks.workunit.client.0.smithi052.stdout:2/684: chown da/d2d/d34/d66 2801 1 2024-09-06T14:44:58.016 INFO:tasks.workunit.client.0.smithi052.stdout:0/633: dread - d0/d1a/d26/d3a/d14/d2d/d56/d9d/fa1 zero size 2024-09-06T14:44:58.018 INFO:tasks.workunit.client.0.smithi052.stdout:3/813: creat d0/d11/d12/ffa x:0 0 0 2024-09-06T14:44:58.018 INFO:tasks.workunit.client.0.smithi052.stdout:1/761: mknod d1/db/de/c10b 0 2024-09-06T14:44:58.020 INFO:tasks.workunit.client.0.smithi052.stdout:0/634: chown d0/d1a/d26/d3a/d14/d20/d22/d55 4 1 2024-09-06T14:44:58.022 INFO:tasks.workunit.client.0.smithi052.stdout:2/685: dwrite da/f1b [4194304,4194304] 0 2024-09-06T14:44:58.025 INFO:tasks.workunit.client.0.smithi052.stdout:3/814: chown d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/cdd 2 1 2024-09-06T14:44:58.025 INFO:tasks.workunit.client.0.smithi052.stdout:2/686: write da/db/d60/db1/d70/fa6 [2527721,107468] 0 2024-09-06T14:44:58.026 INFO:tasks.workunit.client.0.smithi052.stdout:2/687: chown da/db/d60/l3b 64 1 2024-09-06T14:44:58.027 INFO:tasks.workunit.client.0.smithi052.stdout:8/982: symlink d6/d22/d36/d3e/d47/d56/d68/d14e/l163 0 2024-09-06T14:44:58.034 INFO:tasks.workunit.client.0.smithi052.stdout:7/654: dwrite d11/d1c/f1f [0,4194304] 0 2024-09-06T14:44:58.035 INFO:tasks.workunit.client.0.smithi052.stdout:0/635: dread - d0/d2e/fb1 zero size 2024-09-06T14:44:58.038 INFO:tasks.workunit.client.0.smithi052.stdout:2/688: creat da/d4f/fe4 x:0 0 0 2024-09-06T14:44:58.040 INFO:tasks.workunit.client.0.smithi052.stdout:5/800: dread d2/d20/d42/d65/f79 [0,4194304] 0 2024-09-06T14:44:58.040 INFO:tasks.workunit.client.0.smithi052.stdout:8/983: rename d6/d9/f159 to d6/d9/d1f/d19/d6f/f164 0 2024-09-06T14:44:58.042 INFO:tasks.workunit.client.0.smithi052.stdout:5/801: write d2/d1a/f2d [686572,102131] 0 2024-09-06T14:44:58.046 INFO:tasks.workunit.client.0.smithi052.stdout:0/636: mkdir d0/d1a/d26/db7/de7 0 2024-09-06T14:44:58.050 INFO:tasks.workunit.client.0.smithi052.stdout:8/984: creat d6/d9/d1f/d19/dc4/f165 x:0 0 0 2024-09-06T14:44:58.053 INFO:tasks.workunit.client.0.smithi052.stdout:9/596: link d1/c11 d1/d4/cb1 0 2024-09-06T14:44:58.055 INFO:tasks.workunit.client.0.smithi052.stdout:2/689: dread da/d19/f26 [0,4194304] 0 2024-09-06T14:44:58.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/815: link d0/leb d0/d11/d71/d98/d1b/d85/d9f/lfb 0 2024-09-06T14:44:58.063 INFO:tasks.workunit.client.0.smithi052.stdout:5/802: rename d2/d1a/d22/d26/d2b/d37/d84/d97/f10b to d2/d20/d56/f113 0 2024-09-06T14:44:58.067 INFO:tasks.workunit.client.0.smithi052.stdout:5/803: dread d2/d1a/d22/d26/d2b/d37/d84/f9b [0,4194304] 0 2024-09-06T14:44:58.067 INFO:tasks.workunit.client.0.smithi052.stdout:1/762: dwrite d1/d6c/d98/fd2 [0,4194304] 0 2024-09-06T14:44:58.068 INFO:tasks.workunit.client.0.smithi052.stdout:9/597: dread d1/f23 [0,4194304] 0 2024-09-06T14:44:58.069 INFO:tasks.workunit.client.0.smithi052.stdout:8/985: fdatasync d6/d22/d31/d5b/dd3/f125 0 2024-09-06T14:44:58.071 INFO:tasks.workunit.client.0.smithi052.stdout:5/804: chown d2/d1a/d22/d26/d2b/fcf 996076 1 2024-09-06T14:44:58.072 INFO:tasks.workunit.client.0.smithi052.stdout:8/986: write d6/d22/d36/d3e/d47/d56/d68/f3f [4236992,90036] 0 2024-09-06T14:44:58.075 INFO:tasks.workunit.client.0.smithi052.stdout:2/690: creat da/d19/d3a/d31/d7a/dbd/dc6/fe5 x:0 0 0 2024-09-06T14:44:58.079 INFO:tasks.workunit.client.0.smithi052.stdout:7/655: link d11/d1c/d24/d3b/c91 d11/d1c/d24/d4b/cd3 0 2024-09-06T14:44:58.080 INFO:tasks.workunit.client.0.smithi052.stdout:0/637: mkdir d0/d1a/de8 0 2024-09-06T14:44:58.080 INFO:tasks.workunit.client.0.smithi052.stdout:0/638: fsync d0/fe 0 2024-09-06T14:44:58.081 INFO:tasks.workunit.client.0.smithi052.stdout:1/763: mkdir d1/db/d72/d81/d10c 0 2024-09-06T14:44:58.085 INFO:tasks.workunit.client.0.smithi052.stdout:5/805: mknod d2/d1a/d22/d26/d62/c114 0 2024-09-06T14:44:58.094 INFO:tasks.workunit.client.0.smithi052.stdout:1/764: rename d1/d5f/fc1 to d1/db/de/d74/d12/dd3/f10d 0 2024-09-06T14:44:58.094 INFO:tasks.workunit.client.0.smithi052.stdout:1/765: dread - d1/db/d18/dc9/fd9 zero size 2024-09-06T14:44:58.096 INFO:tasks.workunit.client.0.smithi052.stdout:0/639: creat d0/d1a/d26/d3a/d14/d20/d22/d41/fe9 x:0 0 0 2024-09-06T14:44:58.100 INFO:tasks.workunit.client.0.smithi052.stdout:7/656: write d11/f23 [162387,109959] 0 2024-09-06T14:44:58.102 INFO:tasks.workunit.client.0.smithi052.stdout:1/766: symlink d1/db/d72/l10e 0 2024-09-06T14:44:58.102 INFO:tasks.workunit.client.0.smithi052.stdout:2/691: dwrite da/db/d60/db1/d70/f99 [0,4194304] 0 2024-09-06T14:44:58.103 INFO:tasks.workunit.client.0.smithi052.stdout:9/598: creat d1/d4/d6/dc/fb2 x:0 0 0 2024-09-06T14:44:58.104 INFO:tasks.workunit.client.0.smithi052.stdout:8/987: creat d6/d9/d1f/d19/f166 x:0 0 0 2024-09-06T14:44:58.106 INFO:tasks.workunit.client.0.smithi052.stdout:0/640: creat d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/fea x:0 0 0 2024-09-06T14:44:58.106 INFO:tasks.workunit.client.0.smithi052.stdout:1/767: dread - d1/d6c/d98/f9e zero size 2024-09-06T14:44:58.107 INFO:tasks.workunit.client.0.smithi052.stdout:8/988: readlink d6/d9/d1f/d19/l50 0 2024-09-06T14:44:58.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/657: symlink d11/d1c/d26/ld4 0 2024-09-06T14:44:58.110 INFO:tasks.workunit.client.0.smithi052.stdout:5/806: mkdir d2/d1a/d22/d26/d2b/d48/d64/dbf/d115 0 2024-09-06T14:44:58.113 INFO:tasks.workunit.client.0.smithi052.stdout:9/599: rename d1/d4/d6/dc/d10/d18/f4e to d1/d4/d6/dc/d38/fb3 0 2024-09-06T14:44:58.114 INFO:tasks.workunit.client.0.smithi052.stdout:5/807: read d2/d1a/d22/d26/d62/f6d [2348690,65506] 0 2024-09-06T14:44:58.116 INFO:tasks.workunit.client.0.smithi052.stdout:8/989: truncate d6/d9/d1f/d33/da8/f4e 1815919 0 2024-09-06T14:44:58.122 INFO:tasks.workunit.client.0.smithi052.stdout:1/768: dread - d1/db/de/d74/d14/d2e/fc5 zero size 2024-09-06T14:44:58.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:57 smithi052 ceph-mon[28627]: pgmap v31: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 108 MiB/s wr, 270 op/s 2024-09-06T14:44:58.124 INFO:tasks.workunit.client.0.smithi052.stdout:5/808: mknod d2/d20/d42/d8b/dca/c116 0 2024-09-06T14:44:58.131 INFO:tasks.workunit.client.0.smithi052.stdout:2/692: dwrite da/d19/d3a/f63 [0,4194304] 0 2024-09-06T14:44:58.132 INFO:tasks.workunit.client.0.smithi052.stdout:0/641: creat d0/d1a/d26/d3a/d14/d20/feb x:0 0 0 2024-09-06T14:44:58.135 INFO:tasks.workunit.client.0.smithi052.stdout:8/990: write d6/d9/fb2 [428575,75999] 0 2024-09-06T14:44:58.141 INFO:tasks.workunit.client.0.smithi052.stdout:5/809: truncate d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fc1 3112 0 2024-09-06T14:44:58.141 INFO:tasks.workunit.client.0.smithi052.stdout:0/642: dwrite d0/d2e/fac [0,4194304] 0 2024-09-06T14:44:58.141 INFO:tasks.workunit.client.0.smithi052.stdout:1/769: write d1/db/de/d74/d12/fb9 [631589,70386] 0 2024-09-06T14:44:58.142 INFO:tasks.workunit.client.0.smithi052.stdout:5/810: read d2/f7 [4808700,27727] 0 2024-09-06T14:44:58.147 INFO:tasks.workunit.client.0.smithi052.stdout:7/658: link d11/d1c/d78/d98/ccc d11/d1c/cd5 0 2024-09-06T14:44:58.148 INFO:tasks.workunit.client.0.smithi052.stdout:7/659: dread - d11/d1c/d24/d4b/da2/fc3 zero size 2024-09-06T14:44:58.149 INFO:tasks.workunit.client.0.smithi052.stdout:9/600: getdents d1/d4 0 2024-09-06T14:44:58.151 INFO:tasks.workunit.client.0.smithi052.stdout:9/601: write d1/d4/df/f24 [2059344,66010] 0 2024-09-06T14:44:58.151 INFO:tasks.workunit.client.0.smithi052.stdout:0/643: creat d0/d1a/d26/db7/fec x:0 0 0 2024-09-06T14:44:58.153 INFO:tasks.workunit.client.0.smithi052.stdout:2/693: rename da/db/d60/db1 to da/db/d46/d55/de6 0 2024-09-06T14:44:58.155 INFO:tasks.workunit.client.0.smithi052.stdout:1/770: mkdir d1/db/d50/da4/d10f 0 2024-09-06T14:44:58.157 INFO:tasks.workunit.client.0.smithi052.stdout:7/660: creat d11/d1c/d24/dca/fd6 x:0 0 0 2024-09-06T14:44:58.160 INFO:tasks.workunit.client.0.smithi052.stdout:0/644: mkdir d0/d3d/ded 0 2024-09-06T14:44:58.160 INFO:tasks.workunit.client.0.smithi052.stdout:8/991: dread d6/d4c/f65 [0,4194304] 0 2024-09-06T14:44:58.162 INFO:tasks.workunit.client.0.smithi052.stdout:5/811: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/f117 x:0 0 0 2024-09-06T14:44:58.162 INFO:tasks.workunit.client.0.smithi052.stdout:2/694: read da/f2f [6680551,94706] 0 2024-09-06T14:44:58.164 INFO:tasks.workunit.client.0.smithi052.stdout:9/602: mknod d1/d4/d6/dc/d10/d18/d82/d9e/cb4 0 2024-09-06T14:44:58.165 INFO:tasks.workunit.client.0.smithi052.stdout:4/671: sync 2024-09-06T14:44:58.166 INFO:tasks.workunit.client.0.smithi052.stdout:0/645: creat d0/d19/fee x:0 0 0 2024-09-06T14:44:58.167 INFO:tasks.workunit.client.0.smithi052.stdout:7/661: unlink d11/d1c/cd5 0 2024-09-06T14:44:58.168 INFO:tasks.workunit.client.0.smithi052.stdout:7/662: write d11/d1c/f7c [5044622,19437] 0 2024-09-06T14:44:58.169 INFO:tasks.workunit.client.0.smithi052.stdout:2/695: mkdir da/d2d/de7 0 2024-09-06T14:44:58.170 INFO:tasks.workunit.client.0.smithi052.stdout:5/812: rmdir d2/d1a/d22/d26/d2b/d37/d84/d97 39 2024-09-06T14:44:58.171 INFO:tasks.workunit.client.0.smithi052.stdout:5/813: chown d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fe1 74 1 2024-09-06T14:44:58.172 INFO:tasks.workunit.client.0.smithi052.stdout:0/646: creat d0/d1a/d8e/fef x:0 0 0 2024-09-06T14:44:58.173 INFO:tasks.workunit.client.0.smithi052.stdout:4/672: chown d9/d2d/d33/d5d/da6/dbf/cdc 390 1 2024-09-06T14:44:58.174 INFO:tasks.workunit.client.0.smithi052.stdout:0/647: chown d0/d1a/d26/d3a/d14/d2d/d56/da3/fd2 1350317928 1 2024-09-06T14:44:58.178 INFO:tasks.workunit.client.0.smithi052.stdout:2/696: chown da/d19/d3a/d31/d76/c9e 608603 1 2024-09-06T14:44:58.179 INFO:tasks.workunit.client.0.smithi052.stdout:2/697: chown da/d19/c5d 46806 1 2024-09-06T14:44:58.179 INFO:tasks.workunit.client.0.smithi052.stdout:9/603: fsync d1/d4/d6/dc/d10/d18/f5c 0 2024-09-06T14:44:58.181 INFO:tasks.workunit.client.0.smithi052.stdout:2/698: read da/db/d60/f80 [1250490,80791] 0 2024-09-06T14:44:58.181 INFO:tasks.workunit.client.0.smithi052.stdout:7/663: dwrite d11/d1c/d24/f44 [0,4194304] 0 2024-09-06T14:44:58.183 INFO:tasks.workunit.client.0.smithi052.stdout:2/699: chown da/d2d/de7 135 1 2024-09-06T14:44:58.183 INFO:tasks.workunit.client.0.smithi052.stdout:2/700: chown da/d2d/d34/dd7 23 1 2024-09-06T14:44:58.184 INFO:tasks.workunit.client.0.smithi052.stdout:0/648: creat d0/d1a/d26/d3a/d14/d20/d22/d41/d8a/ff0 x:0 0 0 2024-09-06T14:44:58.190 INFO:tasks.workunit.client.0.smithi052.stdout:5/814: link d2/d20/d42/fef d2/d1a/d22/d26/d2b/d48/d64/f118 0 2024-09-06T14:44:58.190 INFO:tasks.workunit.client.0.smithi052.stdout:9/604: mknod d1/d4/df/d56/cb5 0 2024-09-06T14:44:58.194 INFO:tasks.workunit.client.0.smithi052.stdout:4/673: mkdir d9/d10/dec 0 2024-09-06T14:44:58.194 INFO:tasks.workunit.client.0.smithi052.stdout:2/701: symlink da/d19/le8 0 2024-09-06T14:44:58.197 INFO:tasks.workunit.client.0.smithi052.stdout:5/815: symlink d2/d20/d42/d8b/dca/d10a/l119 0 2024-09-06T14:44:58.199 INFO:tasks.workunit.client.0.smithi052.stdout:0/649: creat d0/d1a/d26/d3a/d14/d20/ff1 x:0 0 0 2024-09-06T14:44:58.203 INFO:tasks.workunit.client.0.smithi052.stdout:5/816: creat d2/d1a/d22/d26/d2b/d37/d84/dd8/f11a x:0 0 0 2024-09-06T14:44:58.208 INFO:tasks.workunit.client.0.smithi052.stdout:2/702: creat da/db/d46/fe9 x:0 0 0 2024-09-06T14:44:58.209 INFO:tasks.workunit.client.0.smithi052.stdout:9/605: rmdir d1/d4/d6/dd/d22/d6a/d79 0 2024-09-06T14:44:58.211 INFO:tasks.workunit.client.0.smithi052.stdout:4/674: dread d9/f2e [0,4194304] 0 2024-09-06T14:44:58.214 INFO:tasks.workunit.client.0.smithi052.stdout:7/664: dwrite d11/d1c/d78/d98/f9a [0,4194304] 0 2024-09-06T14:44:58.219 INFO:tasks.workunit.client.0.smithi052.stdout:4/675: dwrite d9/d2d/d33/d5d/f99 [0,4194304] 0 2024-09-06T14:44:58.221 INFO:tasks.workunit.client.0.smithi052.stdout:4/676: chown d9/d10/dec 0 1 2024-09-06T14:44:58.224 INFO:tasks.workunit.client.0.smithi052.stdout:0/650: symlink d0/d1a/d26/d3a/d14/d2d/lf2 0 2024-09-06T14:44:58.225 INFO:tasks.workunit.client.0.smithi052.stdout:9/606: unlink d1/d26/f4c 0 2024-09-06T14:44:58.226 INFO:tasks.workunit.client.0.smithi052.stdout:9/607: chown d1/d4/d6/dc/f61 63 1 2024-09-06T14:44:58.230 INFO:tasks.workunit.client.0.smithi052.stdout:7/665: chown d11/d1c/d24/f25 8894 1 2024-09-06T14:44:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:0/651: creat d0/d1a/d26/db7/ff3 x:0 0 0 2024-09-06T14:44:58.237 INFO:tasks.workunit.client.0.smithi052.stdout:9/608: dwrite d1/d26/d87/fac [0,4194304] 0 2024-09-06T14:44:58.239 INFO:tasks.workunit.client.0.smithi052.stdout:5/817: link d2/d20/cdc d2/d1a/d22/d26/d2b/d48/d64/c11b 0 2024-09-06T14:44:58.243 INFO:tasks.workunit.client.0.smithi052.stdout:5/818: dread - d2/d1a/d22/d26/d2b/d37/d84/d97/f100 zero size 2024-09-06T14:44:58.245 INFO:tasks.workunit.client.0.smithi052.stdout:7/666: rename d11/d1c/d3f/d73/dae/fc5 to d11/d1c/d24/fd7 0 2024-09-06T14:44:58.251 INFO:tasks.workunit.client.0.smithi052.stdout:9/609: dread d1/d26/d3d/f4a [0,4194304] 0 2024-09-06T14:44:58.255 INFO:tasks.workunit.client.0.smithi052.stdout:0/652: rename d0/c71 to d0/d1a/d26/d3a/d14/d2d/d56/da3/dc2/cf4 0 2024-09-06T14:44:58.259 INFO:tasks.workunit.client.0.smithi052.stdout:9/610: symlink d1/d26/d3d/lb6 0 2024-09-06T14:44:58.260 INFO:tasks.workunit.client.0.smithi052.stdout:2/703: write da/db/fa2 [584048,117096] 0 2024-09-06T14:44:58.263 INFO:tasks.workunit.client.0.smithi052.stdout:7/667: creat d11/d1c/d3f/fd8 x:0 0 0 2024-09-06T14:44:58.264 INFO:tasks.workunit.client.0.smithi052.stdout:5/819: getdents d2/d1a/d22/d26/d2b/d48/d64/dbf/d115 0 2024-09-06T14:44:58.264 INFO:tasks.workunit.client.0.smithi052.stdout:7/668: stat d11/d1c/d26/f2b 0 2024-09-06T14:44:58.269 INFO:tasks.workunit.client.0.smithi052.stdout:9/611: creat d1/d4/d6/dc/d10/d18/fb7 x:0 0 0 2024-09-06T14:44:58.271 INFO:tasks.workunit.client.0.smithi052.stdout:5/820: creat d2/d1a/d22/d26/d62/f11c x:0 0 0 2024-09-06T14:44:58.271 INFO:tasks.workunit.client.0.smithi052.stdout:7/669: dwrite d11/d1c/d24/d3b/f56 [0,4194304] 0 2024-09-06T14:44:58.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/612: truncate d1/d4/d6/f35 764145 0 2024-09-06T14:44:58.274 INFO:tasks.workunit.client.0.smithi052.stdout:5/821: read d2/d1a/d22/d26/d62/f8a [371423,36349] 0 2024-09-06T14:44:58.279 INFO:tasks.workunit.client.0.smithi052.stdout:2/704: rename da/db/c14 to da/d19/d3a/d31/d76/cea 0 2024-09-06T14:44:58.282 INFO:tasks.workunit.client.0.smithi052.stdout:9/613: creat d1/d4/fb8 x:0 0 0 2024-09-06T14:44:58.288 INFO:tasks.workunit.client.0.smithi052.stdout:2/705: mkdir da/db9/deb 0 2024-09-06T14:44:58.292 INFO:tasks.workunit.client.0.smithi052.stdout:5/822: write d2/d20/d42/f5f [4322275,45480] 0 2024-09-06T14:44:58.295 INFO:tasks.workunit.client.0.smithi052.stdout:7/670: write d11/d1c/d24/fb8 [2950415,126504] 0 2024-09-06T14:44:58.301 INFO:tasks.workunit.client.0.smithi052.stdout:7/671: rename d11/fce to d11/d1c/d57/d89/db2/fd9 0 2024-09-06T14:44:58.307 INFO:tasks.workunit.client.0.smithi052.stdout:2/706: dwrite da/d2d/d34/d62/f79 [0,4194304] 0 2024-09-06T14:44:58.310 INFO:tasks.workunit.client.0.smithi052.stdout:7/672: unlink d11/f21 0 2024-09-06T14:44:58.311 INFO:tasks.workunit.client.0.smithi052.stdout:7/673: chown d11/d1c 5217107 1 2024-09-06T14:44:58.313 INFO:tasks.workunit.client.0.smithi052.stdout:5/823: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/fb9 [0,4194304] 0 2024-09-06T14:44:58.316 INFO:tasks.workunit.client.0.smithi052.stdout:7/674: unlink d11/d1c/d24/fb6 0 2024-09-06T14:44:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:57 smithi165 ceph-mon[36229]: pgmap v31: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 38 MiB/s rd, 108 MiB/s wr, 270 op/s 2024-09-06T14:44:58.325 INFO:tasks.workunit.client.0.smithi052.stdout:7/675: link d11/d1c/d24/d3b/d50/f8c d11/fda 0 2024-09-06T14:44:58.339 INFO:tasks.workunit.client.0.smithi052.stdout:5/824: dwrite d2/d1a/d22/d26/d62/f72 [0,4194304] 0 2024-09-06T14:44:58.340 INFO:tasks.workunit.client.0.smithi052.stdout:7/676: truncate d11/f43 763730 0 2024-09-06T14:44:58.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/825: mkdir d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/d11d 0 2024-09-06T14:44:58.346 INFO:tasks.workunit.client.0.smithi052.stdout:5/826: symlink d2/d1a/d22/d26/d2b/d37/d84/d97/l11e 0 2024-09-06T14:44:58.351 INFO:tasks.workunit.client.0.smithi052.stdout:5/827: rename d2/d1a/d22/d26/fc7 to d2/d1a/d22/d26/d2b/d37/d84/dd8/f11f 0 2024-09-06T14:44:58.355 INFO:tasks.workunit.client.0.smithi052.stdout:5/828: fsync d2/f13 0 2024-09-06T14:44:58.356 INFO:tasks.workunit.client.0.smithi052.stdout:5/829: write d2/f11 [3537200,92281] 0 2024-09-06T14:44:58.358 INFO:tasks.workunit.client.0.smithi052.stdout:7/677: dread d11/d1c/d3f/f65 [0,4194304] 0 2024-09-06T14:44:58.358 INFO:tasks.workunit.client.0.smithi052.stdout:5/830: dread d2/d20/d42/d65/f79 [0,4194304] 0 2024-09-06T14:44:58.369 INFO:tasks.workunit.client.0.smithi052.stdout:7/678: creat d11/d1c/fdb x:0 0 0 2024-09-06T14:44:58.373 INFO:tasks.workunit.client.0.smithi052.stdout:7/679: fdatasync d11/d1c/d3f/f5f 0 2024-09-06T14:44:58.376 INFO:tasks.workunit.client.0.smithi052.stdout:7/680: truncate d11/d1c/d3f/d73/fac 1047876 0 2024-09-06T14:44:58.390 INFO:tasks.workunit.client.0.smithi052.stdout:7/681: dwrite d11/d1c/d24/d3b/f97 [0,4194304] 0 2024-09-06T14:44:58.400 INFO:tasks.workunit.client.0.smithi052.stdout:7/682: dread d11/d1c/f7c [4194304,4194304] 0 2024-09-06T14:44:58.407 INFO:tasks.workunit.client.0.smithi052.stdout:7/683: write d11/d1c/d24/d4b/f63 [1326357,27418] 0 2024-09-06T14:44:58.420 INFO:tasks.workunit.client.0.smithi052.stdout:7/684: dwrite d11/d1c/d3f/d73/fac [0,4194304] 0 2024-09-06T14:44:58.423 INFO:tasks.workunit.client.0.smithi052.stdout:7/685: mknod d11/d1c/d26/cdc 0 2024-09-06T14:44:58.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/686: chown d11/d1c/d57/lbc 15460 1 2024-09-06T14:44:58.429 INFO:tasks.workunit.client.0.smithi052.stdout:7/687: creat d11/d1c/d57/d74/fdd x:0 0 0 2024-09-06T14:44:58.431 INFO:tasks.workunit.client.0.smithi052.stdout:7/688: truncate d11/d1c/d24/d4b/f9b 633742 0 2024-09-06T14:44:58.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/689: link d11/d1c/d26/ccf d11/d1c/d3f/d73/dae/cde 0 2024-09-06T14:44:58.438 INFO:tasks.workunit.client.0.smithi052.stdout:7/690: creat d11/d1c/d24/d64/fdf x:0 0 0 2024-09-06T14:44:58.444 INFO:tasks.workunit.client.0.smithi052.stdout:7/691: creat d11/d1c/d3f/fe0 x:0 0 0 2024-09-06T14:44:58.447 INFO:tasks.workunit.client.0.smithi052.stdout:7/692: getdents d11/d1c/d3f/d5d 0 2024-09-06T14:44:58.459 INFO:tasks.workunit.client.0.smithi052.stdout:7/693: dread d11/d1c/d24/d4b/f4c [0,4194304] 0 2024-09-06T14:44:58.459 INFO:tasks.workunit.client.0.smithi052.stdout:7/694: chown d11/d1c/d24/d3b/f97 11839 1 2024-09-06T14:44:58.473 INFO:tasks.workunit.client.0.smithi052.stdout:7/695: dread d11/d1c/d24/f25 [0,4194304] 0 2024-09-06T14:44:58.476 INFO:tasks.workunit.client.0.smithi052.stdout:7/696: mknod d11/d1c/d78/ce1 0 2024-09-06T14:44:58.500 INFO:tasks.workunit.client.0.smithi052.stdout:7/697: dwrite d11/d1c/f1e [0,4194304] 0 2024-09-06T14:44:58.503 INFO:tasks.workunit.client.0.smithi052.stdout:7/698: mknod d11/d1c/d57/d89/db2/ce2 0 2024-09-06T14:44:58.512 INFO:tasks.workunit.client.0.smithi052.stdout:7/699: write d11/d1c/d3f/f65 [4542599,26530] 0 2024-09-06T14:44:58.512 INFO:tasks.workunit.client.0.smithi052.stdout:7/700: chown d11/d1c/d26 0 1 2024-09-06T14:44:58.513 INFO:tasks.workunit.client.0.smithi052.stdout:7/701: truncate d11/fcb 684729 0 2024-09-06T14:44:58.514 INFO:tasks.workunit.client.0.smithi052.stdout:7/702: stat d11/d1c/d24/d3b/l4a 0 2024-09-06T14:44:58.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/703: chown d11/d1c/d57/d74/fdd 52 1 2024-09-06T14:44:58.516 INFO:tasks.workunit.client.0.smithi052.stdout:7/704: rmdir d11/d1c/d78/d98 39 2024-09-06T14:44:58.517 INFO:tasks.workunit.client.0.smithi052.stdout:7/705: read d11/fcb [288249,38062] 0 2024-09-06T14:44:58.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/706: dwrite d11/d1c/d26/f60 [0,4194304] 0 2024-09-06T14:44:58.647 INFO:tasks.workunit.client.0.smithi052.stdout:7/707: mknod d11/ce3 0 2024-09-06T14:44:58.660 INFO:tasks.workunit.client.0.smithi052.stdout:7/708: dwrite d11/d1c/d78/f79 [0,4194304] 0 2024-09-06T14:44:58.697 INFO:tasks.workunit.client.0.smithi052.stdout:7/709: creat d11/d1c/d57/d74/fe4 x:0 0 0 2024-09-06T14:44:58.699 INFO:tasks.workunit.client.0.smithi052.stdout:7/710: mkdir d11/d1c/d57/d89/de5 0 2024-09-06T14:44:58.700 INFO:tasks.workunit.client.0.smithi052.stdout:7/711: rmdir d11/d1c 39 2024-09-06T14:44:58.803 INFO:tasks.workunit.client.0.smithi052.stdout:7/712: dwrite d11/d1c/d26/f40 [0,4194304] 0 2024-09-06T14:44:58.828 INFO:tasks.workunit.client.0.smithi052.stdout:6/575: sync 2024-09-06T14:44:58.828 INFO:tasks.workunit.client.0.smithi052.stdout:3/816: sync 2024-09-06T14:44:58.829 INFO:tasks.workunit.client.0.smithi052.stdout:3/817: chown d0/d11/f79 181 1 2024-09-06T14:44:58.837 INFO:tasks.workunit.client.0.smithi052.stdout:6/576: creat d2/dd/d18/d33/d44/fbd x:0 0 0 2024-09-06T14:44:58.838 INFO:tasks.workunit.client.0.smithi052.stdout:6/577: write d2/db6/fb9 [916041,74379] 0 2024-09-06T14:44:58.840 INFO:tasks.workunit.client.0.smithi052.stdout:6/578: write d2/dd/d18/d2d/d71/fab [3671484,64639] 0 2024-09-06T14:44:58.847 INFO:tasks.workunit.client.0.smithi052.stdout:6/579: unlink d2/dd/d7d/dad/cb3 0 2024-09-06T14:44:58.847 INFO:tasks.workunit.client.0.smithi052.stdout:6/580: chown d2/dd/d18/d33 12 1 2024-09-06T14:44:58.849 INFO:tasks.workunit.client.0.smithi052.stdout:6/581: write d2/dd/d18/d33/d44/d79/fa0 [763026,96628] 0 2024-09-06T14:44:58.853 INFO:tasks.workunit.client.0.smithi052.stdout:6/582: mkdir d2/dd/d18/d25/d4c/dbe 0 2024-09-06T14:44:58.860 INFO:tasks.workunit.client.0.smithi052.stdout:6/583: rename d2/c54 to d2/dd/d9d/db4/cbf 0 2024-09-06T14:44:58.863 INFO:tasks.workunit.client.0.smithi052.stdout:6/584: mkdir d2/dd/d9d/db4/dc0 0 2024-09-06T14:44:58.879 INFO:tasks.workunit.client.0.smithi052.stdout:6/585: truncate d2/fb 7350459 0 2024-09-06T14:44:58.881 INFO:tasks.workunit.client.0.smithi052.stdout:6/586: mknod d2/dd/d18/d2d/da7/cc1 0 2024-09-06T14:44:58.892 INFO:tasks.workunit.client.0.smithi052.stdout:6/587: dwrite d2/dd/d18/d2d/d32/f40 [0,4194304] 0 2024-09-06T14:44:58.894 INFO:tasks.workunit.client.0.smithi052.stdout:6/588: mknod d2/dd/d9d/db4/dc0/cc2 0 2024-09-06T14:44:58.900 INFO:tasks.workunit.client.0.smithi052.stdout:6/589: dwrite d2/dd/d18/d4b/f58 [0,4194304] 0 2024-09-06T14:44:58.907 INFO:tasks.workunit.client.0.smithi052.stdout:6/590: dwrite d2/f30 [0,4194304] 0 2024-09-06T14:44:58.915 INFO:tasks.workunit.client.0.smithi052.stdout:6/591: write d2/dd/f2f [3726037,95354] 0 2024-09-06T14:44:58.918 INFO:tasks.workunit.client.0.smithi052.stdout:6/592: symlink d2/dd/d18/d33/d44/d79/lc3 0 2024-09-06T14:44:58.924 INFO:tasks.workunit.client.0.smithi052.stdout:6/593: dwrite d2/f30 [4194304,4194304] 0 2024-09-06T14:44:59.000 INFO:tasks.workunit.client.0.smithi052.stdout:6/594: fsync d2/dd/d18/d33/f90 0 2024-09-06T14:44:59.000 INFO:tasks.workunit.client.0.smithi052.stdout:6/595: dread - d2/dd/d18/d33/f90 zero size 2024-09-06T14:44:59.006 INFO:tasks.workunit.client.0.smithi052.stdout:6/596: truncate d2/dd/d18/d33/f90 385668 0 2024-09-06T14:44:59.009 INFO:tasks.workunit.client.0.smithi052.stdout:6/597: symlink d2/dd/d18/d2d/lc4 0 2024-09-06T14:44:59.012 INFO:tasks.workunit.client.0.smithi052.stdout:6/598: getdents d2/dd/d18/d4b 0 2024-09-06T14:44:59.013 INFO:tasks.workunit.client.0.smithi052.stdout:6/599: write d2/db6/fb9 [1897770,92951] 0 2024-09-06T14:44:59.022 INFO:tasks.workunit.client.0.smithi052.stdout:6/600: dread d2/fb [4194304,4194304] 0 2024-09-06T14:44:59.029 INFO:tasks.workunit.client.0.smithi052.stdout:6/601: truncate d2/d4a/f5b 2940306 0 2024-09-06T14:44:59.030 INFO:tasks.workunit.client.0.smithi052.stdout:6/602: dread - d2/d4a/d6e/fb8 zero size 2024-09-06T14:44:59.031 INFO:tasks.workunit.client.0.smithi052.stdout:6/603: chown d2/dd/c70 55425 1 2024-09-06T14:44:59.034 INFO:tasks.workunit.client.0.smithi052.stdout:6/604: dread d2/dd/d18/d2d/da7/fb7 [0,4194304] 0 2024-09-06T14:44:59.041 INFO:tasks.workunit.client.0.smithi052.stdout:6/605: dwrite d2/dd/d18/d2d/d32/f3f [4194304,4194304] 0 2024-09-06T14:44:59.047 INFO:tasks.workunit.client.0.smithi052.stdout:6/606: truncate d2/dd/d18/d33/f90 725064 0 2024-09-06T14:44:59.086 INFO:tasks.workunit.client.0.smithi052.stdout:4/677: sync 2024-09-06T14:44:59.087 INFO:tasks.workunit.client.0.smithi052.stdout:1/771: sync 2024-09-06T14:44:59.087 INFO:tasks.workunit.client.0.smithi052.stdout:8/992: sync 2024-09-06T14:44:59.090 INFO:tasks.workunit.client.0.smithi052.stdout:1/772: truncate d1/db/d18/fbd 1084592 0 2024-09-06T14:44:59.092 INFO:tasks.workunit.client.0.smithi052.stdout:4/678: truncate d9/d10/d17/f42 3061690 0 2024-09-06T14:44:59.093 INFO:tasks.workunit.client.0.smithi052.stdout:8/993: dwrite d6/d9/d1f/d33/da8/d1b/f60 [0,4194304] 0 2024-09-06T14:44:59.107 INFO:tasks.workunit.client.0.smithi052.stdout:8/994: mknod d6/d22/d36/d3e/d47/c167 0 2024-09-06T14:44:59.119 INFO:tasks.workunit.client.0.smithi052.stdout:8/995: mknod d6/d22/d36/d3e/d47/d56/d68/c168 0 2024-09-06T14:44:59.120 INFO:tasks.workunit.client.0.smithi052.stdout:8/996: chown d6/d22/d36/d3e/d47/d56/f136 5035 1 2024-09-06T14:44:59.121 INFO:tasks.workunit.client.0.smithi052.stdout:8/997: truncate d6/d22/d36/d3e/d47/f15a 865123 0 2024-09-06T14:44:59.126 INFO:tasks.workunit.client.0.smithi052.stdout:8/998: rename d6/d22/ff2 to d6/d22/d36/d3e/d47/d56/d68/d11d/f169 0 2024-09-06T14:44:59.128 INFO:tasks.workunit.client.0.smithi052.stdout:1/773: dwrite d1/db/de/d74/d14/d9f/fdb [0,4194304] 0 2024-09-06T14:44:59.134 INFO:tasks.workunit.client.0.smithi052.stdout:4/679: dwrite f7 [0,4194304] 0 2024-09-06T14:44:59.135 INFO:tasks.workunit.client.0.smithi052.stdout:1/774: dread d1/db/de/d74/d14/d90/fc3 [0,4194304] 0 2024-09-06T14:44:59.135 INFO:tasks.workunit.client.0.smithi052.stdout:4/680: read - d9/d10/fab zero size 2024-09-06T14:44:59.136 INFO:tasks.workunit.client.0.smithi052.stdout:1/775: fdatasync d1/db/de/d74/d36/f3d 0 2024-09-06T14:44:59.137 INFO:tasks.workunit.client.0.smithi052.stdout:1/776: dread - d1/db/d18/d5c/f102 zero size 2024-09-06T14:44:59.145 INFO:tasks.workunit.client.0.smithi052.stdout:1/777: mkdir d1/db/de/d74/d12/d110 0 2024-09-06T14:44:59.147 INFO:tasks.workunit.client.0.smithi052.stdout:8/999: write d6/d9/d1f/d33/da8/d41/fac [2613340,44835] 0 2024-09-06T14:44:59.150 INFO:tasks.workunit.client.0.smithi052.stdout:1/778: mkdir d1/db/d72/d81/d111 0 2024-09-06T14:44:59.153 INFO:tasks.workunit.client.0.smithi052.stdout:1/779: mkdir d1/db/d72/d112 0 2024-09-06T14:44:59.153 INFO:tasks.workunit.client.0.smithi052.stdout:4/681: link d9/lba d9/d2d/d33/d5d/da6/deb/d81/d9c/led 0 2024-09-06T14:44:59.155 INFO:tasks.workunit.client.0.smithi052.stdout:4/682: creat d9/d10/d17/d39/fee x:0 0 0 2024-09-06T14:44:59.156 INFO:tasks.workunit.client.0.smithi052.stdout:1/780: symlink d1/db/de/d74/d12/dd3/l113 0 2024-09-06T14:44:59.173 INFO:tasks.workunit.client.0.smithi052.stdout:4/683: dwrite d9/d10/d17/f3d [0,4194304] 0 2024-09-06T14:44:59.173 INFO:tasks.workunit.client.0.smithi052.stdout:1/781: dwrite d1/db/de/d74/f32 [0,4194304] 0 2024-09-06T14:44:59.180 INFO:tasks.workunit.client.0.smithi052.stdout:1/782: read d1/db/fb3 [1404908,56484] 0 2024-09-06T14:44:59.183 INFO:tasks.workunit.client.0.smithi052.stdout:4/684: link d9/d10/d17/daa/db5/db9/c86 d9/d2d/d33/d5d/da6/dbf/dd5/cef 0 2024-09-06T14:44:59.187 INFO:tasks.workunit.client.0.smithi052.stdout:1/783: dwrite d1/db/de/f10a [0,4194304] 0 2024-09-06T14:44:59.189 INFO:tasks.workunit.client.0.smithi052.stdout:1/784: chown d1/db/de/d74/d14/d9f/dcc/d47/d4a 0 1 2024-09-06T14:44:59.211 INFO:tasks.workunit.client.0.smithi052.stdout:1/785: dread d1/db/d18/fbd [0,4194304] 0 2024-09-06T14:44:59.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/786: chown d1/f9 3866477 1 2024-09-06T14:44:59.213 INFO:tasks.workunit.client.0.smithi052.stdout:1/787: read - d1/db/d18/dc9/fd9 zero size 2024-09-06T14:44:59.215 INFO:tasks.workunit.client.0.smithi052.stdout:4/685: dread d9/d10/f4f [0,4194304] 0 2024-09-06T14:44:59.244 INFO:tasks.workunit.client.0.smithi052.stdout:0/653: sync 2024-09-06T14:44:59.244 INFO:tasks.workunit.client.0.smithi052.stdout:9/614: sync 2024-09-06T14:44:59.245 INFO:tasks.workunit.client.0.smithi052.stdout:0/654: readlink d0/d19/d29/lba 0 2024-09-06T14:44:59.256 INFO:tasks.workunit.client.0.smithi052.stdout:1/788: mknod d1/db/de/d74/d12/dd3/c114 0 2024-09-06T14:44:59.257 INFO:tasks.workunit.client.0.smithi052.stdout:4/686: mknod d9/d2d/d33/d5d/da6/deb/d81/dc1/cf0 0 2024-09-06T14:44:59.261 INFO:tasks.workunit.client.0.smithi052.stdout:1/789: rename d1/db/de/d74/d36/ff4 to d1/db/de/d74/d14/d2e/dc6/f115 0 2024-09-06T14:44:59.263 INFO:tasks.workunit.client.0.smithi052.stdout:4/687: truncate d9/d2d/f63 646016 0 2024-09-06T14:44:59.268 INFO:tasks.workunit.client.0.smithi052.stdout:1/790: truncate d1/db/de/d74/d14/d9f/dcc/f5a 3718966 0 2024-09-06T14:44:59.268 INFO:tasks.workunit.client.0.smithi052.stdout:1/791: fsync d1/db/de/d74/d14/d2e/f108 0 2024-09-06T14:44:59.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/615: dread d1/d4/d4b/f62 [0,4194304] 0 2024-09-06T14:44:59.276 INFO:tasks.workunit.client.0.smithi052.stdout:9/616: dread - d1/d4/d6/dc/fb2 zero size 2024-09-06T14:44:59.279 INFO:tasks.workunit.client.0.smithi052.stdout:0/655: write d0/d1a/f40 [2114163,44477] 0 2024-09-06T14:44:59.281 INFO:tasks.workunit.client.0.smithi052.stdout:0/656: chown d0/d19/c75 104 1 2024-09-06T14:44:59.285 INFO:tasks.workunit.client.0.smithi052.stdout:0/657: truncate d0/d1a/d26/d3a/fa4 826344 0 2024-09-06T14:44:59.286 INFO:tasks.workunit.client.0.smithi052.stdout:0/658: fdatasync d0/d1a/d26/d3a/d14/d2d/d56/da3/dc2/fc9 0 2024-09-06T14:44:59.289 INFO:tasks.workunit.client.0.smithi052.stdout:9/617: dread d1/d4/d6/dd/d2b/f49 [0,4194304] 0 2024-09-06T14:44:59.292 INFO:tasks.workunit.client.0.smithi052.stdout:0/659: rename d0/d1a/l8f to d0/d3d/ded/lf5 0 2024-09-06T14:44:59.293 INFO:tasks.workunit.client.0.smithi052.stdout:9/618: chown d1/d4/d6/dc/d10/d73/fae 4 1 2024-09-06T14:44:59.294 INFO:tasks.workunit.client.0.smithi052.stdout:4/688: dwrite d9/d10/d17/d39/d3a/d64/fa3 [0,4194304] 0 2024-09-06T14:44:59.297 INFO:tasks.workunit.client.0.smithi052.stdout:0/660: read d0/d1a/d26/d3a/fca [676732,126300] 0 2024-09-06T14:44:59.298 INFO:tasks.workunit.client.0.smithi052.stdout:1/792: dwrite d1/db/d18/fbd [0,4194304] 0 2024-09-06T14:44:59.299 INFO:tasks.workunit.client.0.smithi052.stdout:0/661: chown d0/d1a/d26/d3a/d14/d20/d22 1 1 2024-09-06T14:44:59.307 INFO:tasks.workunit.client.0.smithi052.stdout:4/689: dwrite d9/f35 [4194304,4194304] 0 2024-09-06T14:44:59.309 INFO:tasks.workunit.client.0.smithi052.stdout:0/662: fdatasync d0/d2e/fb1 0 2024-09-06T14:44:59.309 INFO:tasks.workunit.client.0.smithi052.stdout:4/690: chown d9/d2d/d33/d5d/da6/d83 131 1 2024-09-06T14:44:59.310 INFO:tasks.workunit.client.0.smithi052.stdout:0/663: write d0/d1a/f40 [2822113,38470] 0 2024-09-06T14:44:59.312 INFO:tasks.workunit.client.0.smithi052.stdout:1/793: symlink d1/db/de/d74/l116 0 2024-09-06T14:44:59.314 INFO:tasks.workunit.client.0.smithi052.stdout:4/691: creat d9/d10/d17/d39/ff1 x:0 0 0 2024-09-06T14:44:59.315 INFO:tasks.workunit.client.0.smithi052.stdout:4/692: chown d9/d10/d17/la8 34430871 1 2024-09-06T14:44:59.316 INFO:tasks.workunit.client.0.smithi052.stdout:0/664: creat d0/d4f/d7d/ff6 x:0 0 0 2024-09-06T14:44:59.319 INFO:tasks.workunit.client.0.smithi052.stdout:4/693: mkdir d9/df2 0 2024-09-06T14:44:59.320 INFO:tasks.workunit.client.0.smithi052.stdout:9/619: write d1/d4/d6/dc/d10/d18/f5b [4896878,112002] 0 2024-09-06T14:44:59.320 INFO:tasks.workunit.client.0.smithi052.stdout:0/665: creat d0/d3d/de4/ff7 x:0 0 0 2024-09-06T14:44:59.322 INFO:tasks.workunit.client.0.smithi052.stdout:9/620: dread d1/d4/d6/dd/f8f [0,4194304] 0 2024-09-06T14:44:59.325 INFO:tasks.workunit.client.0.smithi052.stdout:0/666: rename d0/d1a/fce to d0/d7e/ff8 0 2024-09-06T14:44:59.327 INFO:tasks.workunit.client.0.smithi052.stdout:0/667: fsync d0/d1a/d26/d3a/d14/d20/f2f 0 2024-09-06T14:44:59.331 INFO:tasks.workunit.client.0.smithi052.stdout:9/621: rename d1/d4/d6/dd/d2b/f49 to d1/fb9 0 2024-09-06T14:44:59.331 INFO:tasks.workunit.client.0.smithi052.stdout:1/794: write d1/db/d72/d81/fb8 [500264,10856] 0 2024-09-06T14:44:59.336 INFO:tasks.workunit.client.0.smithi052.stdout:4/694: write d9/d10/d19/f28 [2133169,37936] 0 2024-09-06T14:44:59.345 INFO:tasks.workunit.client.0.smithi052.stdout:0/668: write d0/d19/d29/f91 [188594,302] 0 2024-09-06T14:44:59.346 INFO:tasks.workunit.client.0.smithi052.stdout:1/795: mknod d1/db/d76/c117 0 2024-09-06T14:44:59.346 INFO:tasks.workunit.client.0.smithi052.stdout:9/622: link d1/d4/d6/c68 d1/d26/d3d/cba 0 2024-09-06T14:44:59.349 INFO:tasks.workunit.client.0.smithi052.stdout:1/796: write d1/db/de/d74/ff [6210385,48472] 0 2024-09-06T14:44:59.349 INFO:tasks.workunit.client.0.smithi052.stdout:4/695: dwrite d9/d10/f4f [0,4194304] 0 2024-09-06T14:44:59.351 INFO:tasks.workunit.client.0.smithi052.stdout:4/696: write d9/f35 [7287413,78670] 0 2024-09-06T14:44:59.351 INFO:tasks.workunit.client.0.smithi052.stdout:0/669: creat d0/d1a/daa/ff9 x:0 0 0 2024-09-06T14:44:59.352 INFO:tasks.workunit.client.0.smithi052.stdout:9/623: symlink d1/d26/lbb 0 2024-09-06T14:44:59.355 INFO:tasks.workunit.client.0.smithi052.stdout:4/697: symlink d9/d10/dec/lf3 0 2024-09-06T14:44:59.362 INFO:tasks.workunit.client.0.smithi052.stdout:4/698: creat d9/d2d/d33/d5d/da6/deb/ff4 x:0 0 0 2024-09-06T14:44:59.365 INFO:tasks.workunit.client.0.smithi052.stdout:1/797: dread d1/db/de/d74/d14/d90/fa3 [0,4194304] 0 2024-09-06T14:44:59.367 INFO:tasks.workunit.client.0.smithi052.stdout:9/624: creat d1/d4/d6/dc/d7a/fbc x:0 0 0 2024-09-06T14:44:59.375 INFO:tasks.workunit.client.0.smithi052.stdout:1/798: mkdir d1/db/d76/d118 0 2024-09-06T14:44:59.375 INFO:tasks.workunit.client.0.smithi052.stdout:0/670: dwrite d0/d1a/d26/d3a/d14/d2d/f33 [0,4194304] 0 2024-09-06T14:44:59.377 INFO:tasks.workunit.client.0.smithi052.stdout:4/699: write d9/d2d/d33/d5d/f89 [1093157,3684] 0 2024-09-06T14:44:59.378 INFO:tasks.workunit.client.0.smithi052.stdout:4/700: fsync d9/d2d/d33/d5d/da6/deb/ff4 0 2024-09-06T14:44:59.382 INFO:tasks.workunit.client.0.smithi052.stdout:9/625: truncate d1/d4/d6/dc/d10/d18/f84 3438042 0 2024-09-06T14:44:59.383 INFO:tasks.workunit.client.0.smithi052.stdout:1/799: mknod d1/d5f/c119 0 2024-09-06T14:44:59.383 INFO:tasks.workunit.client.0.smithi052.stdout:9/626: write d1/d26/d3d/f94 [359019,10706] 0 2024-09-06T14:44:59.386 INFO:tasks.workunit.client.0.smithi052.stdout:9/627: chown d1/d26/d3d/cba 1045008913 1 2024-09-06T14:44:59.389 INFO:tasks.workunit.client.0.smithi052.stdout:1/800: dread - d1/db/de/d74/d14/d90/fd7 zero size 2024-09-06T14:44:59.389 INFO:tasks.workunit.client.0.smithi052.stdout:4/701: mknod d9/d2d/cf5 0 2024-09-06T14:44:59.392 INFO:tasks.workunit.client.0.smithi052.stdout:9/628: stat d1/d4/df/f59 0 2024-09-06T14:44:59.393 INFO:tasks.workunit.client.0.smithi052.stdout:0/671: getdents d0/d1a/d26/d3a/d14 0 2024-09-06T14:44:59.394 INFO:tasks.workunit.client.0.smithi052.stdout:9/629: truncate d1/d4/d6/dc/d10/d18/f76 359394 0 2024-09-06T14:44:59.395 INFO:tasks.workunit.client.0.smithi052.stdout:1/801: truncate d1/db/d50/da4/fb6 97778 0 2024-09-06T14:44:59.399 INFO:tasks.workunit.client.0.smithi052.stdout:4/702: truncate d9/d2d/f63 343642 0 2024-09-06T14:44:59.404 INFO:tasks.workunit.client.0.smithi052.stdout:4/703: creat d9/d10/d17/d39/d3a/ff6 x:0 0 0 2024-09-06T14:44:59.407 INFO:tasks.workunit.client.0.smithi052.stdout:1/802: write d1/db/de/d74/d12/f70 [1137332,3633] 0 2024-09-06T14:44:59.409 INFO:tasks.workunit.client.0.smithi052.stdout:0/672: write d0/d1a/d26/d3a/d14/d20/d22/f6a [1430265,64715] 0 2024-09-06T14:44:59.412 INFO:tasks.workunit.client.0.smithi052.stdout:9/630: creat d1/d4/d6/dc/d10/fbd x:0 0 0 2024-09-06T14:44:59.414 INFO:tasks.workunit.client.0.smithi052.stdout:4/704: creat d9/d10/d17/d39/d3a/d64/ff7 x:0 0 0 2024-09-06T14:44:59.420 INFO:tasks.workunit.client.0.smithi052.stdout:4/705: mknod d9/d10/d17/d39/cf8 0 2024-09-06T14:44:59.422 INFO:tasks.workunit.client.0.smithi052.stdout:0/673: link d0/d19/fa8 d0/d1a/d26/d3a/ffa 0 2024-09-06T14:44:59.423 INFO:tasks.workunit.client.0.smithi052.stdout:9/631: mkdir d1/d4/d6/dc/d10/dbe 0 2024-09-06T14:44:59.425 INFO:tasks.workunit.client.0.smithi052.stdout:4/706: unlink d9/d10/d17/d39/d3a/d5c/f7f 0 2024-09-06T14:44:59.426 INFO:tasks.workunit.client.0.smithi052.stdout:0/674: read d0/d2e/f70 [328555,54342] 0 2024-09-06T14:44:59.427 INFO:tasks.workunit.client.0.smithi052.stdout:0/675: dread - d0/d1a/d26/d3a/d14/d20/d22/d55/fd8 zero size 2024-09-06T14:44:59.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/632: unlink d1/d4/df/f24 0 2024-09-06T14:44:59.430 INFO:tasks.workunit.client.0.smithi052.stdout:1/803: link d1/db/de/d74/d14/c29 d1/db/d18/d6b/c11a 0 2024-09-06T14:44:59.430 INFO:tasks.workunit.client.0.smithi052.stdout:9/633: dread - d1/d26/d87/fa4 zero size 2024-09-06T14:44:59.433 INFO:tasks.workunit.client.0.smithi052.stdout:0/676: creat d0/d18/ffb x:0 0 0 2024-09-06T14:44:59.434 INFO:tasks.workunit.client.0.smithi052.stdout:0/677: chown d0/d1a/d26/d3a/d14/d2d/c34 5 1 2024-09-06T14:44:59.437 INFO:tasks.workunit.client.0.smithi052.stdout:1/804: mknod d1/db/de/d68/c11b 0 2024-09-06T14:44:59.444 INFO:tasks.workunit.client.0.smithi052.stdout:9/634: link d1/d4/f43 d1/d26/d41/fbf 0 2024-09-06T14:44:59.452 INFO:tasks.workunit.client.0.smithi052.stdout:1/805: getdents d1/db/de/d74/d14/d2e 0 2024-09-06T14:44:59.473 INFO:tasks.workunit.client.0.smithi052.stdout:2/707: sync 2024-09-06T14:44:59.506 INFO:tasks.workunit.client.0.smithi052.stdout:4/707: rename d9/d10/d17/d39/d3a/d5c/l82 to d9/d2d/lf9 0 2024-09-06T14:44:59.507 INFO:tasks.workunit.client.0.smithi052.stdout:1/806: fsync d1/db/de/d74/d12/f46 0 2024-09-06T14:44:59.512 INFO:tasks.workunit.client.0.smithi052.stdout:9/635: rename d1/c29 to d1/d26/d3d/cc0 0 2024-09-06T14:44:59.514 INFO:tasks.workunit.client.0.smithi052.stdout:2/708: getdents da 0 2024-09-06T14:44:59.516 INFO:tasks.workunit.client.0.smithi052.stdout:1/807: rename d1/db/de/d74/d12/lb2 to d1/db/d50/da4/d10f/l11c 0 2024-09-06T14:44:59.518 INFO:tasks.workunit.client.0.smithi052.stdout:9/636: read d1/d26/d41/d7e/f8c [368521,64390] 0 2024-09-06T14:44:59.519 INFO:tasks.workunit.client.0.smithi052.stdout:1/808: mkdir d1/db/de/d68/df3/d11d 0 2024-09-06T14:44:59.530 INFO:tasks.workunit.client.0.smithi052.stdout:9/637: creat d1/d4/df/fc1 x:0 0 0 2024-09-06T14:44:59.530 INFO:tasks.workunit.client.0.smithi052.stdout:1/809: getdents d1/db/de/d74/d14/d2e 0 2024-09-06T14:44:59.533 INFO:tasks.workunit.client.0.smithi052.stdout:2/709: dwrite da/d19/d3a/d31/d76/f4d [0,4194304] 0 2024-09-06T14:44:59.533 INFO:tasks.workunit.client.0.smithi052.stdout:9/638: mkdir d1/d4/df/d71/da5/dc2 0 2024-09-06T14:44:59.534 INFO:tasks.workunit.client.0.smithi052.stdout:2/710: fdatasync da/d2d/d34/d62/f79 0 2024-09-06T14:44:59.542 INFO:tasks.workunit.client.0.smithi052.stdout:9/639: symlink d1/d4/d6/dc/lc3 0 2024-09-06T14:44:59.546 INFO:tasks.workunit.client.0.smithi052.stdout:2/711: getdents da/d19/d3a/d31/d7a 0 2024-09-06T14:44:59.550 INFO:tasks.workunit.client.0.smithi052.stdout:2/712: rename da/db/d18/l69 to da/db/d60/lec 0 2024-09-06T14:44:59.551 INFO:tasks.workunit.client.0.smithi052.stdout:9/640: dwrite d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:59.551 INFO:tasks.workunit.client.0.smithi052.stdout:2/713: fdatasync da/d19/d3a/d31/d76/f4d 0 2024-09-06T14:44:59.552 INFO:tasks.workunit.client.0.smithi052.stdout:2/714: chown da/d19/d3a/d31/d7a 1106 1 2024-09-06T14:44:59.555 INFO:tasks.workunit.client.0.smithi052.stdout:9/641: creat d1/d26/d87/fc4 x:0 0 0 2024-09-06T14:44:59.556 INFO:tasks.workunit.client.0.smithi052.stdout:2/715: truncate da/f1d 930852 0 2024-09-06T14:44:59.561 INFO:tasks.workunit.client.0.smithi052.stdout:2/716: rename da/db/d9d/lbe to da/db/d18/led 0 2024-09-06T14:44:59.570 INFO:tasks.workunit.client.0.smithi052.stdout:9/642: write d1/d4/d6/dc/d38/d5a/faf [287424,104660] 0 2024-09-06T14:44:59.573 INFO:tasks.workunit.client.0.smithi052.stdout:9/643: chown d1/d4/f5 53732024 1 2024-09-06T14:44:59.577 INFO:tasks.workunit.client.0.smithi052.stdout:2/717: dwrite da/d19/d3a/d31/d76/d6a/f7c [0,4194304] 0 2024-09-06T14:44:59.584 INFO:tasks.workunit.client.0.smithi052.stdout:2/718: read da/db/d46/d6b/f98 [2227853,124482] 0 2024-09-06T14:44:59.588 INFO:tasks.workunit.client.0.smithi052.stdout:9/644: dwrite d1/d4/df/f59 [0,4194304] 0 2024-09-06T14:44:59.588 INFO:tasks.workunit.client.0.smithi052.stdout:2/719: truncate da/d4f/fb3 1451435 0 2024-09-06T14:44:59.590 INFO:tasks.workunit.client.0.smithi052.stdout:2/720: chown da/d19/d3a/d31/d76/d6a/f86 2548 1 2024-09-06T14:44:59.591 INFO:tasks.workunit.client.0.smithi052.stdout:2/721: truncate da/d19/d3a/d31/fd6 469317 0 2024-09-06T14:44:59.591 INFO:tasks.workunit.client.0.smithi052.stdout:9/645: creat d1/d26/d87/fc5 x:0 0 0 2024-09-06T14:44:59.592 INFO:tasks.workunit.client.0.smithi052.stdout:2/722: chown da/d19/d3a/d31/d7a/dbd/dc6 80 1 2024-09-06T14:44:59.593 INFO:tasks.workunit.client.0.smithi052.stdout:9/646: symlink d1/d4/d6/dc/lc6 0 2024-09-06T14:44:59.595 INFO:tasks.workunit.client.0.smithi052.stdout:2/723: truncate da/db/d18/d7f/fb6 677467 0 2024-09-06T14:44:59.596 INFO:tasks.workunit.client.0.smithi052.stdout:2/724: chown da/d19/d3a/d31/d7a/cc0 18876241 1 2024-09-06T14:44:59.598 INFO:tasks.workunit.client.0.smithi052.stdout:2/725: readlink da/d19/d3a/d61/d7b/l83 0 2024-09-06T14:44:59.604 INFO:tasks.workunit.client.0.smithi052.stdout:9/647: write d1/d4/f43 [5541513,43306] 0 2024-09-06T14:44:59.610 INFO:tasks.workunit.client.0.smithi052.stdout:9/648: getdents d1/d4/d6/dc 0 2024-09-06T14:44:59.611 INFO:tasks.workunit.client.0.smithi052.stdout:2/726: dwrite da/d19/d3a/dc4/fd1 [0,4194304] 0 2024-09-06T14:44:59.612 INFO:tasks.workunit.client.0.smithi052.stdout:2/727: readlink da/d64/lc1 0 2024-09-06T14:44:59.614 INFO:tasks.workunit.client.0.smithi052.stdout:9/649: mknod d1/d4/d6/dc/d38/cc7 0 2024-09-06T14:44:59.617 INFO:tasks.workunit.client.0.smithi052.stdout:2/728: mkdir da/d2d/d34/dd7/dee 0 2024-09-06T14:44:59.618 INFO:tasks.workunit.client.0.smithi052.stdout:2/729: chown da/d19/d3a/d31/d7a/dbd 63582975 1 2024-09-06T14:44:59.619 INFO:tasks.workunit.client.0.smithi052.stdout:9/650: getdents d1/d4/df 0 2024-09-06T14:44:59.620 INFO:tasks.workunit.client.0.smithi052.stdout:2/730: mknod da/d2d/d34/d62/cef 0 2024-09-06T14:44:59.625 INFO:tasks.workunit.client.0.smithi052.stdout:2/731: dread da/fdc [0,4194304] 0 2024-09-06T14:44:59.627 INFO:tasks.workunit.client.0.smithi052.stdout:2/732: fsync da/d19/d3a/d61/f95 0 2024-09-06T14:44:59.628 INFO:tasks.workunit.client.0.smithi052.stdout:9/651: dwrite d1/d4/d6/dd/f9a [0,4194304] 0 2024-09-06T14:44:59.630 INFO:tasks.workunit.client.0.smithi052.stdout:9/652: write d1/d4/d6/dc/fb2 [218815,117631] 0 2024-09-06T14:44:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:9/653: stat d1/d26/f95 0 2024-09-06T14:44:59.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/733: mkdir da/d2d/d34/d66/da0/df0 0 2024-09-06T14:44:59.633 INFO:tasks.workunit.client.0.smithi052.stdout:2/734: chown da/db/d46/d55/de6/d70/f93 408656593 1 2024-09-06T14:44:59.635 INFO:tasks.workunit.client.0.smithi052.stdout:9/654: symlink d1/d4/df/d56/lc8 0 2024-09-06T14:44:59.647 INFO:tasks.workunit.client.0.smithi052.stdout:9/655: write d1/d4/d6/dd/f13 [5302908,91419] 0 2024-09-06T14:44:59.647 INFO:tasks.workunit.client.0.smithi052.stdout:2/735: dwrite da/d19/d3a/d31/d76/dc7/fcb [4194304,4194304] 0 2024-09-06T14:44:59.649 INFO:tasks.workunit.client.0.smithi052.stdout:9/656: write d1/d4/d6/dc/d10/f80 [613769,91700] 0 2024-09-06T14:44:59.651 INFO:tasks.workunit.client.0.smithi052.stdout:9/657: chown d1/d4/d6/dc/d10/d73/f8e 337720899 1 2024-09-06T14:44:59.657 INFO:tasks.workunit.client.0.smithi052.stdout:2/736: write da/d19/f26 [4886063,97681] 0 2024-09-06T14:44:59.658 INFO:tasks.workunit.client.0.smithi052.stdout:9/658: link d1/d26/d87/fa4 d1/d4/d6/dd/d22/d6a/fc9 0 2024-09-06T14:44:59.659 INFO:tasks.workunit.client.0.smithi052.stdout:2/737: write da/db/d46/d55/de6/d70/f99 [3300235,96825] 0 2024-09-06T14:44:59.661 INFO:tasks.workunit.client.0.smithi052.stdout:2/738: read da/db/fe [479518,12679] 0 2024-09-06T14:44:59.661 INFO:tasks.workunit.client.0.smithi052.stdout:9/659: mknod d1/d4/df/cca 0 2024-09-06T14:44:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:2/739: mknod da/d19/d3a/d31/d76/cf1 0 2024-09-06T14:44:59.664 INFO:tasks.workunit.client.0.smithi052.stdout:9/660: unlink d1/c91 0 2024-09-06T14:44:59.666 INFO:tasks.workunit.client.0.smithi052.stdout:9/661: chown d1/c3 1975 1 2024-09-06T14:44:59.670 INFO:tasks.workunit.client.0.smithi052.stdout:2/740: dwrite da/d19/f1c [0,4194304] 0 2024-09-06T14:44:59.674 INFO:tasks.workunit.client.0.smithi052.stdout:9/662: mkdir d1/d4/d6/dc/d10/d18/d82/da6/dcb 0 2024-09-06T14:44:59.676 INFO:tasks.workunit.client.0.smithi052.stdout:2/741: symlink da/d19/d5a/d6c/lf2 0 2024-09-06T14:44:59.683 INFO:tasks.workunit.client.0.smithi052.stdout:2/742: dwrite da/d19/d3a/d31/f43 [0,4194304] 0 2024-09-06T14:44:59.685 INFO:tasks.workunit.client.0.smithi052.stdout:9/663: link d1/d4/d6/dc/d10/d18/f84 d1/d4/d6/dc/d10/d73/da9/fcc 0 2024-09-06T14:44:59.686 INFO:tasks.workunit.client.0.smithi052.stdout:2/743: creat da/d19/d3a/d31/d7a/dbd/ff3 x:0 0 0 2024-09-06T14:44:59.688 INFO:tasks.workunit.client.0.smithi052.stdout:9/664: write d1/fa [5370579,103020] 0 2024-09-06T14:44:59.691 INFO:tasks.workunit.client.0.smithi052.stdout:9/665: fsync d1/d26/d41/d7e/f8c 0 2024-09-06T14:44:59.695 INFO:tasks.workunit.client.0.smithi052.stdout:2/744: dwrite da/d19/d3a/d31/d7a/dbd/ff3 [0,4194304] 0 2024-09-06T14:44:59.700 INFO:tasks.workunit.client.0.smithi052.stdout:2/745: dread da/d4f/fb3 [0,4194304] 0 2024-09-06T14:44:59.700 INFO:tasks.workunit.client.0.smithi052.stdout:9/666: rename d1/d4/d6/dc/d10/d73/da9/fcc to d1/d4/d6/dc/d10/d73/da9/fcd 0 2024-09-06T14:44:59.701 INFO:tasks.workunit.client.0.smithi052.stdout:2/746: dread - da/db/d60/daa/fdf zero size 2024-09-06T14:44:59.704 INFO:tasks.workunit.client.0.smithi052.stdout:2/747: chown da/db/d18/cab 112 1 2024-09-06T14:44:59.706 INFO:tasks.workunit.client.0.smithi052.stdout:2/748: write da/d19/d3a/d31/d76/d6a/f9c [1542099,90129] 0 2024-09-06T14:44:59.714 INFO:tasks.workunit.client.0.smithi052.stdout:9/667: dwrite d1/d4/d6/dd/d22/d6a/fc9 [0,4194304] 0 2024-09-06T14:44:59.718 INFO:tasks.workunit.client.0.smithi052.stdout:2/749: write da/d19/d3a/d31/f37 [59504,44604] 0 2024-09-06T14:44:59.725 INFO:tasks.workunit.client.0.smithi052.stdout:9/668: link d1/d4/df/d56/cb5 d1/d26/d41/d7e/cce 0 2024-09-06T14:44:59.726 INFO:tasks.workunit.client.0.smithi052.stdout:9/669: chown d1/d26/lbb 3 1 2024-09-06T14:44:59.727 INFO:tasks.workunit.client.0.smithi052.stdout:2/750: dwrite da/db/fa2 [0,4194304] 0 2024-09-06T14:44:59.736 INFO:tasks.workunit.client.0.smithi052.stdout:9/670: creat d1/d4/d6/dd/d22/fcf x:0 0 0 2024-09-06T14:44:59.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/671: mknod d1/d4/d6/dc/d38/d5a/cd0 0 2024-09-06T14:44:59.742 INFO:tasks.workunit.client.0.smithi052.stdout:2/751: dwrite da/d19/f29 [0,4194304] 0 2024-09-06T14:44:59.752 INFO:tasks.workunit.client.0.smithi052.stdout:9/672: dwrite d1/d4/d6/dc/d10/d18/f5c [0,4194304] 0 2024-09-06T14:44:59.762 INFO:tasks.workunit.client.0.smithi052.stdout:9/673: dwrite d1/f23 [0,4194304] 0 2024-09-06T14:44:59.763 INFO:tasks.workunit.client.0.smithi052.stdout:9/674: readlink d1/d4/d6/dc/d10/l90 0 2024-09-06T14:44:59.764 INFO:tasks.workunit.client.0.smithi052.stdout:9/675: write d1/d4/d6/dd/d22/fcf [826409,700] 0 2024-09-06T14:44:59.774 INFO:tasks.workunit.client.0.smithi052.stdout:2/752: dread da/f11 [0,4194304] 0 2024-09-06T14:44:59.778 INFO:tasks.workunit.client.0.smithi052.stdout:2/753: dread da/d19/f1c [0,4194304] 0 2024-09-06T14:44:59.779 INFO:tasks.workunit.client.0.smithi052.stdout:9/676: dread d1/d4/d6/dc/d10/d73/da9/fcd [0,4194304] 0 2024-09-06T14:44:59.781 INFO:tasks.workunit.client.0.smithi052.stdout:2/754: mknod da/cf4 0 2024-09-06T14:44:59.782 INFO:tasks.workunit.client.0.smithi052.stdout:9/677: truncate d1/d26/d41/d7e/f8c 3756367 0 2024-09-06T14:44:59.785 INFO:tasks.workunit.client.0.smithi052.stdout:9/678: mkdir d1/d4/d6/dd1 0 2024-09-06T14:44:59.786 INFO:tasks.workunit.client.0.smithi052.stdout:5/831: sync 2024-09-06T14:44:59.786 INFO:tasks.workunit.client.0.smithi052.stdout:7/713: sync 2024-09-06T14:44:59.786 INFO:tasks.workunit.client.0.smithi052.stdout:6/607: sync 2024-09-06T14:44:59.786 INFO:tasks.workunit.client.0.smithi052.stdout:3/818: sync 2024-09-06T14:44:59.788 INFO:tasks.workunit.client.0.smithi052.stdout:7/714: write d11/d1c/fdb [883724,42465] 0 2024-09-06T14:44:59.789 INFO:tasks.workunit.client.0.smithi052.stdout:5/832: dread - d2/d1a/d22/d26/d2b/d37/d84/d97/f100 zero size 2024-09-06T14:44:59.789 INFO:tasks.workunit.client.0.smithi052.stdout:3/819: stat d0/d11/d12/d4c/d93/d35/d46/d5b 0 2024-09-06T14:44:59.791 INFO:tasks.workunit.client.0.smithi052.stdout:5/833: stat d2/d20/d42/d65/fda 0 2024-09-06T14:44:59.792 INFO:tasks.workunit.client.0.smithi052.stdout:7/715: fdatasync d11/d1c/d24/d3b/d50/f6e 0 2024-09-06T14:44:59.798 INFO:tasks.workunit.client.0.smithi052.stdout:6/608: getdents d2/dd/d18/d2d/d32/d9f 0 2024-09-06T14:44:59.800 INFO:tasks.workunit.client.0.smithi052.stdout:5/834: chown d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/ffe 982 1 2024-09-06T14:44:59.804 INFO:tasks.workunit.client.0.smithi052.stdout:3/820: dread d0/d11/d12/f47 [0,4194304] 0 2024-09-06T14:44:59.807 INFO:tasks.workunit.client.0.smithi052.stdout:9/679: write d1/f30 [441262,21856] 0 2024-09-06T14:44:59.808 INFO:tasks.workunit.client.0.smithi052.stdout:6/609: mknod d2/cc5 0 2024-09-06T14:44:59.810 INFO:tasks.workunit.client.0.smithi052.stdout:5/835: dwrite d2/fb8 [0,4194304] 0 2024-09-06T14:44:59.813 INFO:tasks.workunit.client.0.smithi052.stdout:5/836: dread - d2/d1a/d22/d26/d62/f11c zero size 2024-09-06T14:44:59.814 INFO:tasks.workunit.client.0.smithi052.stdout:5/837: readlink d2/d20/d42/d8b/dca/ld7 0 2024-09-06T14:44:59.815 INFO:tasks.workunit.client.0.smithi052.stdout:6/610: dwrite d2/dd/d18/d25/d4c/d61/f97 [0,4194304] 0 2024-09-06T14:44:59.818 INFO:tasks.workunit.client.0.smithi052.stdout:7/716: truncate d11/d1c/d26/f60 404706 0 2024-09-06T14:44:59.824 INFO:tasks.workunit.client.0.smithi052.stdout:9/680: mknod d1/d4/d6/dd/d22/cd2 0 2024-09-06T14:44:59.827 INFO:tasks.workunit.client.0.smithi052.stdout:6/611: creat d2/dd/d9d/db4/fc6 x:0 0 0 2024-09-06T14:44:59.831 INFO:tasks.workunit.client.0.smithi052.stdout:9/681: mknod d1/d26/d87/cd3 0 2024-09-06T14:44:59.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/612: fdatasync d2/dd/d18/d25/f3e 0 2024-09-06T14:44:59.834 INFO:tasks.workunit.client.0.smithi052.stdout:5/838: rename d2/d1a/fbe to d2/d1a/d22/d26/d2b/d37/d84/f120 0 2024-09-06T14:44:59.843 INFO:tasks.workunit.client.0.smithi052.stdout:5/839: dwrite d2/d20/d42/d65/fda [0,4194304] 0 2024-09-06T14:44:59.844 INFO:tasks.workunit.client.0.smithi052.stdout:9/682: getdents d1/d4/d6/dc/d38 0 2024-09-06T14:44:59.847 INFO:tasks.workunit.client.0.smithi052.stdout:3/821: dwrite d0/d11/d71/d98/f43 [0,4194304] 0 2024-09-06T14:44:59.848 INFO:tasks.workunit.client.0.smithi052.stdout:6/613: dread d2/dd/d18/f6d [0,4194304] 0 2024-09-06T14:44:59.852 INFO:tasks.workunit.client.0.smithi052.stdout:6/614: fdatasync d2/dd/d18/d2d/d32/f40 0 2024-09-06T14:44:59.856 INFO:tasks.workunit.client.0.smithi052.stdout:5/840: unlink d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/lc4 0 2024-09-06T14:44:59.856 INFO:tasks.workunit.client.0.smithi052.stdout:7/717: write d11/d1c/d26/f46 [3109460,49428] 0 2024-09-06T14:44:59.861 INFO:tasks.workunit.client.0.smithi052.stdout:6/615: mknod d2/dd/d18/d25/d4c/cc7 0 2024-09-06T14:44:59.864 INFO:tasks.workunit.client.0.smithi052.stdout:7/718: creat d11/d1c/d24/d3b/fe6 x:0 0 0 2024-09-06T14:44:59.870 INFO:tasks.workunit.client.0.smithi052.stdout:7/719: creat d11/fe7 x:0 0 0 2024-09-06T14:44:59.871 INFO:tasks.workunit.client.0.smithi052.stdout:7/720: chown d11/d1c/d24/f44 1555435 1 2024-09-06T14:44:59.872 INFO:tasks.workunit.client.0.smithi052.stdout:7/721: stat d11/c8d 0 2024-09-06T14:44:59.878 INFO:tasks.workunit.client.0.smithi052.stdout:7/722: dwrite d11/d1c/d24/fb8 [4194304,4194304] 0 2024-09-06T14:44:59.879 INFO:tasks.workunit.client.0.smithi052.stdout:7/723: fdatasync d11/f49 0 2024-09-06T14:44:59.880 INFO:tasks.workunit.client.0.smithi052.stdout:6/616: dread d2/db6/fac [0,4194304] 0 2024-09-06T14:44:59.885 INFO:tasks.workunit.client.0.smithi052.stdout:6/617: creat d2/dd/d9d/fc8 x:0 0 0 2024-09-06T14:44:59.887 INFO:tasks.workunit.client.0.smithi052.stdout:7/724: rename d11/d1c/d24/d7e/fc1 to d11/d1c/d24/d4b/da2/fe8 0 2024-09-06T14:44:59.887 INFO:tasks.workunit.client.0.smithi052.stdout:9/683: truncate d1/d26/d87/fa4 1334016 0 2024-09-06T14:44:59.889 INFO:tasks.workunit.client.0.smithi052.stdout:6/618: symlink d2/dd/d18/d2d/d32/d9f/lc9 0 2024-09-06T14:44:59.897 INFO:tasks.workunit.client.0.smithi052.stdout:5/841: dwrite d2/d20/d56/fd2 [0,4194304] 0 2024-09-06T14:44:59.900 INFO:tasks.workunit.client.0.smithi052.stdout:6/619: dwrite d2/fb [0,4194304] 0 2024-09-06T14:44:59.902 INFO:tasks.workunit.client.0.smithi052.stdout:6/620: write d2/dd/d18/d2d/d32/f9a [3404177,46671] 0 2024-09-06T14:44:59.903 INFO:tasks.workunit.client.0.smithi052.stdout:6/621: chown d2/dd/d18/d33 219 1 2024-09-06T14:44:59.906 INFO:tasks.workunit.client.0.smithi052.stdout:1/810: sync 2024-09-06T14:44:59.906 INFO:tasks.workunit.client.0.smithi052.stdout:4/708: sync 2024-09-06T14:44:59.906 INFO:tasks.workunit.client.0.smithi052.stdout:0/678: sync 2024-09-06T14:44:59.908 INFO:tasks.workunit.client.0.smithi052.stdout:0/679: chown d0/d19/f80 11561453 1 2024-09-06T14:44:59.909 INFO:tasks.workunit.client.0.smithi052.stdout:0/680: chown d0/d4f/d7d/f62 5 1 2024-09-06T14:44:59.912 INFO:tasks.workunit.client.0.smithi052.stdout:6/622: mknod d2/d4a/d6e/d76/cca 0 2024-09-06T14:44:59.914 INFO:tasks.workunit.client.0.smithi052.stdout:1/811: dread - d1/db/de/d74/d14/d9f/dcc/f8c zero size 2024-09-06T14:44:59.929 INFO:tasks.workunit.client.0.smithi052.stdout:6/623: getdents d2/dd/d18/d25/d4c 0 2024-09-06T14:44:59.932 INFO:tasks.workunit.client.0.smithi052.stdout:6/624: link d2/dd/d18/d25/d4c/cc7 d2/dd/d18/d2d/da7/ccb 0 2024-09-06T14:44:59.946 INFO:tasks.workunit.client.0.smithi052.stdout:9/684: write d1/d4/d6/dc/d10/d18/f84 [1567761,35573] 0 2024-09-06T14:44:59.948 INFO:tasks.workunit.client.0.smithi052.stdout:9/685: write d1/d4/d6/dc/d38/d5a/faf [1675502,22715] 0 2024-09-06T14:44:59.953 INFO:tasks.workunit.client.0.smithi052.stdout:9/686: creat d1/d4/d6/dd/d2b/fd4 x:0 0 0 2024-09-06T14:44:59.960 INFO:tasks.workunit.client.0.smithi052.stdout:9/687: dwrite d1/d4/f7 [0,4194304] 0 2024-09-06T14:44:59.966 INFO:tasks.workunit.client.0.smithi052.stdout:5/842: dwrite d2/d1a/d22/d26/d62/f6d [0,4194304] 0 2024-09-06T14:44:59.967 INFO:tasks.workunit.client.0.smithi052.stdout:1/812: write d1/db/f52 [487774,10383] 0 2024-09-06T14:44:59.971 INFO:tasks.workunit.client.0.smithi052.stdout:4/709: write d9/d10/d17/d39/d3a/d5c/f9d [805781,56497] 0 2024-09-06T14:44:59.974 INFO:tasks.workunit.client.0.smithi052.stdout:0/681: dwrite d0/d1a/d26/f4e [0,4194304] 0 2024-09-06T14:44:59.976 INFO:tasks.workunit.client.0.smithi052.stdout:1/813: chown d1/db/d18/leb 2497132 1 2024-09-06T14:44:59.978 INFO:tasks.workunit.client.0.smithi052.stdout:9/688: rename d1/d4/df/d71/l98 to d1/d26/d3d/ld5 0 2024-09-06T14:44:59.979 INFO:tasks.workunit.client.0.smithi052.stdout:0/682: stat d0/d1a/d26/d3a/d14/d20/d22/d41/fe9 0 2024-09-06T14:44:59.989 INFO:tasks.workunit.client.0.smithi052.stdout:5/843: dread d2/d1a/d22/f7a [0,4194304] 0 2024-09-06T14:44:59.992 INFO:tasks.workunit.client.0.smithi052.stdout:9/689: rename d1/d4/df/d56/lc8 to d1/d4/df/d71/ld6 0 2024-09-06T14:44:59.992 INFO:tasks.workunit.client.0.smithi052.stdout:6/625: dwrite d2/dd/d18/d25/f3e [0,4194304] 0 2024-09-06T14:45:00.001 INFO:tasks.workunit.client.0.smithi052.stdout:5/844: creat d2/d1a/d22/d26/d2b/d37/d84/d97/f121 x:0 0 0 2024-09-06T14:45:00.006 INFO:tasks.workunit.client.0.smithi052.stdout:1/814: dread d1/db/de/d74/ff8 [0,4194304] 0 2024-09-06T14:45:00.008 INFO:tasks.workunit.client.0.smithi052.stdout:4/710: write d9/d10/f74 [665314,123703] 0 2024-09-06T14:45:00.008 INFO:tasks.workunit.client.0.smithi052.stdout:5/845: mkdir d2/d20/d42/d65/d122 0 2024-09-06T14:45:00.011 INFO:tasks.workunit.client.0.smithi052.stdout:5/846: fdatasync d2/d1a/d22/f7e 0 2024-09-06T14:45:00.013 INFO:tasks.workunit.client.0.smithi052.stdout:4/711: read d9/d10/d17/d39/d3a/d64/fc4 [3301644,123403] 0 2024-09-06T14:45:00.014 INFO:tasks.workunit.client.0.smithi052.stdout:1/815: creat d1/db/d72/db1/f11e x:0 0 0 2024-09-06T14:45:00.015 INFO:tasks.workunit.client.0.smithi052.stdout:4/712: write d9/d10/fe9 [678352,26039] 0 2024-09-06T14:45:00.019 INFO:tasks.workunit.client.0.smithi052.stdout:5/847: rename d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/la0 to d2/d1a/d22/d26/d2b/d37/d84/da7/l123 0 2024-09-06T14:45:00.019 INFO:tasks.workunit.client.0.smithi052.stdout:0/683: dread d0/d18/f5f [4194304,4194304] 0 2024-09-06T14:45:00.024 INFO:tasks.workunit.client.0.smithi052.stdout:4/713: dread d9/d10/d17/d39/f46 [0,4194304] 0 2024-09-06T14:45:00.026 INFO:tasks.workunit.client.0.smithi052.stdout:1/816: write d1/db/de/d74/d14/d2e/f80 [1871081,102286] 0 2024-09-06T14:45:00.027 INFO:tasks.workunit.client.0.smithi052.stdout:0/684: symlink d0/d1a/daa/lfc 0 2024-09-06T14:45:00.027 INFO:tasks.workunit.client.0.smithi052.stdout:4/714: chown f7 37904 1 2024-09-06T14:45:00.031 INFO:tasks.workunit.client.0.smithi052.stdout:9/690: dread d1/f17 [0,4194304] 0 2024-09-06T14:45:00.031 INFO:tasks.workunit.client.0.smithi052.stdout:5/848: symlink d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/d108/l124 0 2024-09-06T14:45:00.032 INFO:tasks.workunit.client.0.smithi052.stdout:6/626: dwrite d2/dd/d18/f51 [0,4194304] 0 2024-09-06T14:45:00.035 INFO:tasks.workunit.client.0.smithi052.stdout:0/685: truncate d0/d1a/d26/d3a/d14/d2d/f33 4781097 0 2024-09-06T14:45:00.038 INFO:tasks.workunit.client.0.smithi052.stdout:4/715: symlink d9/d10/d19/lfa 0 2024-09-06T14:45:00.039 INFO:tasks.workunit.client.0.smithi052.stdout:6/627: mkdir d2/dd/d18/d25/d6a/dcc 0 2024-09-06T14:45:00.041 INFO:tasks.workunit.client.0.smithi052.stdout:9/691: mkdir d1/d4/d6/dc/d10/d18/d82/d9e/dd7 0 2024-09-06T14:45:00.044 INFO:tasks.workunit.client.0.smithi052.stdout:4/716: rmdir d9 39 2024-09-06T14:45:00.048 INFO:tasks.workunit.client.0.smithi052.stdout:0/686: rename d0/d1a/d26/d3a/d14/d20/d22/d41/f68 to d0/d4f/d7d/ffd 0 2024-09-06T14:45:00.050 INFO:tasks.workunit.client.0.smithi052.stdout:9/692: chown d1/d4/d6/dd/f77 3 1 2024-09-06T14:45:00.051 INFO:tasks.workunit.client.0.smithi052.stdout:1/817: dwrite d1/db/de/d74/f78 [0,4194304] 0 2024-09-06T14:45:00.053 INFO:tasks.workunit.client.0.smithi052.stdout:9/693: write d1/d4/d6/dc/d7a/fbc [617627,5697] 0 2024-09-06T14:45:00.055 INFO:tasks.workunit.client.0.smithi052.stdout:5/849: rename d2/d20/d42/d65/d122 to d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/d11d/d125 0 2024-09-06T14:45:00.058 INFO:tasks.workunit.client.0.smithi052.stdout:0/687: symlink d0/d3d/ded/lfe 0 2024-09-06T14:45:00.064 INFO:tasks.workunit.client.0.smithi052.stdout:6/628: creat d2/dd/d18/d2d/fcd x:0 0 0 2024-09-06T14:45:00.066 INFO:tasks.workunit.client.0.smithi052.stdout:1/818: mkdir d1/db/de/d74/d14/d9f/dcc/d11f 0 2024-09-06T14:45:00.068 INFO:tasks.workunit.client.0.smithi052.stdout:1/819: dread - d1/db/d18/dc9/fd9 zero size 2024-09-06T14:45:00.068 INFO:tasks.workunit.client.0.smithi052.stdout:9/694: unlink d1/d4/d6/dc/d38/d5a/l6e 0 2024-09-06T14:45:00.070 INFO:tasks.workunit.client.0.smithi052.stdout:5/850: mkdir d2/d1a/d22/d26/d2b/d37/d84/df5/d126 0 2024-09-06T14:45:00.071 INFO:tasks.workunit.client.0.smithi052.stdout:5/851: truncate d2/d1a/ddb/f10e 647204 0 2024-09-06T14:45:00.072 INFO:tasks.workunit.client.0.smithi052.stdout:6/629: mknod d2/dd/d18/d25/d4c/d61/cce 0 2024-09-06T14:45:00.074 INFO:tasks.workunit.client.0.smithi052.stdout:1/820: mkdir d1/db/de/d74/d14/d90/d120 0 2024-09-06T14:45:00.075 INFO:tasks.workunit.client.0.smithi052.stdout:9/695: creat d1/d4/d6/dd/d2b/fd8 x:0 0 0 2024-09-06T14:45:00.080 INFO:tasks.workunit.client.0.smithi052.stdout:1/821: fdatasync d1/d6c/d98/f9e 0 2024-09-06T14:45:00.081 INFO:tasks.workunit.client.0.smithi052.stdout:9/696: unlink d1/d26/d3d/c78 0 2024-09-06T14:45:00.082 INFO:tasks.workunit.client.0.smithi052.stdout:4/717: link d9/d10/d17/f42 d9/d2d/d33/d5d/da6/dbf/dd5/ffb 0 2024-09-06T14:45:00.089 INFO:tasks.workunit.client.0.smithi052.stdout:0/688: dwrite d0/d19/fa8 [0,4194304] 0 2024-09-06T14:45:00.091 INFO:tasks.workunit.client.0.smithi052.stdout:0/689: write d0/d3d/de4/ff7 [469810,104817] 0 2024-09-06T14:45:00.092 INFO:tasks.workunit.client.0.smithi052.stdout:5/852: write d2/d1a/d22/d26/d2b/fa9 [2994659,2767] 0 2024-09-06T14:45:00.099 INFO:tasks.workunit.client.0.smithi052.stdout:1/822: truncate d1/db/de/d74/d14/d9f/dcc/d47/f6e 60484 0 2024-09-06T14:45:00.101 INFO:tasks.workunit.client.0.smithi052.stdout:1/823: fdatasync d1/db/de/d74/d14/d2e/f80 0 2024-09-06T14:45:00.101 INFO:tasks.workunit.client.0.smithi052.stdout:4/718: creat d9/d2d/ffc x:0 0 0 2024-09-06T14:45:00.102 INFO:tasks.workunit.client.0.smithi052.stdout:0/690: fsync d0/d1a/d26/d3a/d14/d2d/fa9 0 2024-09-06T14:45:00.105 INFO:tasks.workunit.client.0.smithi052.stdout:1/824: write d1/db/de/d74/d14/d9f/fe4 [625609,43970] 0 2024-09-06T14:45:00.107 INFO:tasks.workunit.client.0.smithi052.stdout:4/719: unlink d9/d10/f22 0 2024-09-06T14:45:00.107 INFO:tasks.workunit.client.0.smithi052.stdout:9/697: dwrite d1/d26/d87/fa4 [0,4194304] 0 2024-09-06T14:45:00.109 INFO:tasks.workunit.client.0.smithi052.stdout:1/825: chown d1/db/d18/f66 4059 1 2024-09-06T14:45:00.112 INFO:tasks.workunit.client.0.smithi052.stdout:5/853: getdents d2/d1a/d22/d26 0 2024-09-06T14:45:00.118 INFO:tasks.workunit.client.0.smithi052.stdout:9/698: rename d1/d4/df/d71/da5 to d1/d4/d6/dd1/dd9 0 2024-09-06T14:45:00.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:44:59 smithi052 ceph-mon[28627]: pgmap v32: 65 pgs: 65 active+clean; 2.6 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 54 MiB/s rd, 148 MiB/s wr, 389 op/s 2024-09-06T14:45:00.124 INFO:tasks.workunit.client.0.smithi052.stdout:9/699: rename d1/d4/d6/dd/d2b to d1/d4/d6/dc/d10/d18/d82/dda 0 2024-09-06T14:45:00.126 INFO:tasks.workunit.client.0.smithi052.stdout:1/826: write d1/db/d72/faf [1181037,111298] 0 2024-09-06T14:45:00.129 INFO:tasks.workunit.client.0.smithi052.stdout:9/700: unlink d1/d4/d6/dd/d22/faa 0 2024-09-06T14:45:00.130 INFO:tasks.workunit.client.0.smithi052.stdout:0/691: truncate d0/d1a/d26/d3a/d14/d2d/d56/f73 988186 0 2024-09-06T14:45:00.130 INFO:tasks.workunit.client.0.smithi052.stdout:9/701: chown d1/d26/d41/c4f 1 1 2024-09-06T14:45:00.131 INFO:tasks.workunit.client.0.smithi052.stdout:4/720: write d9/d10/d17/d39/d3a/d5c/f90 [282537,103361] 0 2024-09-06T14:45:00.134 INFO:tasks.workunit.client.0.smithi052.stdout:1/827: truncate d1/db/de/d74/d14/d9f/dcc/d47/f6f 4537382 0 2024-09-06T14:45:00.135 INFO:tasks.workunit.client.0.smithi052.stdout:9/702: dread d1/d26/d87/fa4 [0,4194304] 0 2024-09-06T14:45:00.136 INFO:tasks.workunit.client.0.smithi052.stdout:5/854: getdents d2/d20/d42/d8b 0 2024-09-06T14:45:00.138 INFO:tasks.workunit.client.0.smithi052.stdout:5/855: fsync d2/d1a/d22/d26/d2b/d37/d6a/f112 0 2024-09-06T14:45:00.143 INFO:tasks.workunit.client.0.smithi052.stdout:9/703: rename d1/d4/d6/dc/d10/fbd to d1/d4/df/d56/fdb 0 2024-09-06T14:45:00.147 INFO:tasks.workunit.client.0.smithi052.stdout:5/856: creat d2/d20/d42/d8b/f127 x:0 0 0 2024-09-06T14:45:00.153 INFO:tasks.workunit.client.0.smithi052.stdout:4/721: rename d9/d10/d17/fe5 to d9/d2d/d33/d5d/da6/deb/d81/d9c/dac/ffd 0 2024-09-06T14:45:00.154 INFO:tasks.workunit.client.0.smithi052.stdout:5/857: mknod d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/c128 0 2024-09-06T14:45:00.154 INFO:tasks.workunit.client.0.smithi052.stdout:0/692: write d0/d3d/f99 [1146534,43810] 0 2024-09-06T14:45:00.155 INFO:tasks.workunit.client.0.smithi052.stdout:1/828: write d1/d6c/d98/f9e [940292,17145] 0 2024-09-06T14:45:00.156 INFO:tasks.workunit.client.0.smithi052.stdout:0/693: chown d0/d1a/d26/lbe 5855 1 2024-09-06T14:45:00.157 INFO:tasks.workunit.client.0.smithi052.stdout:1/829: readlink d1/db/de/d74/l62 0 2024-09-06T14:45:00.157 INFO:tasks.workunit.client.0.smithi052.stdout:9/704: mknod d1/d26/cdc 0 2024-09-06T14:45:00.158 INFO:tasks.workunit.client.0.smithi052.stdout:9/705: fdatasync d1/f23 0 2024-09-06T14:45:00.158 INFO:tasks.workunit.client.0.smithi052.stdout:4/722: rmdir d9/d2d/d33/d5d/da6/deb/d81/d9c 39 2024-09-06T14:45:00.163 INFO:tasks.workunit.client.0.smithi052.stdout:1/830: unlink d1/l22 0 2024-09-06T14:45:00.166 INFO:tasks.workunit.client.0.smithi052.stdout:9/706: chown d1/d4/df/f59 31425 1 2024-09-06T14:45:00.169 INFO:tasks.workunit.client.0.smithi052.stdout:1/831: dwrite d1/db/de/d74/d36/f3d [0,4194304] 0 2024-09-06T14:45:00.175 INFO:tasks.workunit.client.0.smithi052.stdout:9/707: unlink d1/d4/df/d56/c63 0 2024-09-06T14:45:00.176 INFO:tasks.workunit.client.0.smithi052.stdout:5/858: dwrite d2/d1a/d22/d26/d2b/d37/d6a/fe6 [0,4194304] 0 2024-09-06T14:45:00.185 INFO:tasks.workunit.client.0.smithi052.stdout:5/859: dwrite d2/d1a/d22/d26/d62/f72 [0,4194304] 0 2024-09-06T14:45:00.187 INFO:tasks.workunit.client.0.smithi052.stdout:9/708: mknod d1/d4/d6/dd/d22/d6a/cdd 0 2024-09-06T14:45:00.188 INFO:tasks.workunit.client.0.smithi052.stdout:4/723: getdents d9/d2d/d33/d5d/da6/deb/d81/d9c/dac 0 2024-09-06T14:45:00.188 INFO:tasks.workunit.client.0.smithi052.stdout:0/694: dwrite d0/d2e/fcb [0,4194304] 0 2024-09-06T14:45:00.189 INFO:tasks.workunit.client.0.smithi052.stdout:1/832: getdents d1/db/de/d74/d36/d9b 0 2024-09-06T14:45:00.190 INFO:tasks.workunit.client.0.smithi052.stdout:4/724: chown d9/d10/dec 191 1 2024-09-06T14:45:00.190 INFO:tasks.workunit.client.0.smithi052.stdout:5/860: mkdir d2/d20/d42/d8b/dca/d10a/d129 0 2024-09-06T14:45:00.193 INFO:tasks.workunit.client.0.smithi052.stdout:4/725: chown d9/d10/fab 237243 1 2024-09-06T14:45:00.194 INFO:tasks.workunit.client.0.smithi052.stdout:9/709: mkdir d1/d4/d4b/dde 0 2024-09-06T14:45:00.197 INFO:tasks.workunit.client.0.smithi052.stdout:9/710: readlink d1/l65 0 2024-09-06T14:45:00.198 INFO:tasks.workunit.client.0.smithi052.stdout:1/833: mknod d1/db/de/d74/d14/d90/d120/c121 0 2024-09-06T14:45:00.200 INFO:tasks.workunit.client.0.smithi052.stdout:0/695: dwrite d0/d19/f80 [0,4194304] 0 2024-09-06T14:45:00.201 INFO:tasks.workunit.client.0.smithi052.stdout:0/696: write d0/d1a/daa/ff9 [73886,47686] 0 2024-09-06T14:45:00.202 INFO:tasks.workunit.client.0.smithi052.stdout:5/861: symlink d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/d108/l12a 0 2024-09-06T14:45:00.203 INFO:tasks.workunit.client.0.smithi052.stdout:9/711: rmdir d1/d4/df/d71 39 2024-09-06T14:45:00.204 INFO:tasks.workunit.client.0.smithi052.stdout:4/726: truncate d9/d10/d17/f2a 427150 0 2024-09-06T14:45:00.206 INFO:tasks.workunit.client.0.smithi052.stdout:1/834: mkdir d1/db/d122 0 2024-09-06T14:45:00.207 INFO:tasks.workunit.client.0.smithi052.stdout:9/712: truncate d1/d4/fb8 864253 0 2024-09-06T14:45:00.209 INFO:tasks.workunit.client.0.smithi052.stdout:4/727: symlink d9/d2d/d33/d5d/da6/dbf/dd5/lfe 0 2024-09-06T14:45:00.219 INFO:tasks.workunit.client.0.smithi052.stdout:0/697: rename d0/d1a/d26/d3a/d14/d20/d22/lc0 to d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/lff 0 2024-09-06T14:45:00.219 INFO:tasks.workunit.client.0.smithi052.stdout:9/713: unlink d1/d26/d41/d7e/l89 0 2024-09-06T14:45:00.219 INFO:tasks.workunit.client.0.smithi052.stdout:5/862: dwrite d2/d1a/d22/d26/d2b/d37/f44 [4194304,4194304] 0 2024-09-06T14:45:00.222 INFO:tasks.workunit.client.0.smithi052.stdout:4/728: write d9/d10/d17/d39/d3a/d5c/fa2 [320588,43346] 0 2024-09-06T14:45:00.223 INFO:tasks.workunit.client.0.smithi052.stdout:9/714: chown d1/d4/d6/dc/d10/d73/f8e 511614794 1 2024-09-06T14:45:00.262 INFO:tasks.workunit.client.0.smithi052.stdout:1/835: creat d1/db/d76/f123 x:0 0 0 2024-09-06T14:45:00.263 INFO:tasks.workunit.client.0.smithi052.stdout:0/698: mkdir d0/d1a/d26/d3a/d7a/d100 0 2024-09-06T14:45:00.265 INFO:tasks.workunit.client.0.smithi052.stdout:4/729: symlink d9/d2d/d33/d5d/da6/lff 0 2024-09-06T14:45:00.266 INFO:tasks.workunit.client.0.smithi052.stdout:9/715: symlink d1/d26/d3d/ldf 0 2024-09-06T14:45:00.266 INFO:tasks.workunit.client.0.smithi052.stdout:9/716: chown d1/d4/d4b/dde 39 1 2024-09-06T14:45:00.267 INFO:tasks.workunit.client.0.smithi052.stdout:1/836: mknod d1/db/de/d74/d14/d9f/c124 0 2024-09-06T14:45:00.269 INFO:tasks.workunit.client.0.smithi052.stdout:0/699: mknod d0/d3d/de4/c101 0 2024-09-06T14:45:00.270 INFO:tasks.workunit.client.0.smithi052.stdout:5/863: creat d2/d1a/d22/d26/d2b/d37/f12b x:0 0 0 2024-09-06T14:45:00.272 INFO:tasks.workunit.client.0.smithi052.stdout:5/864: truncate d2/d1a/d22/f7e 1036594 0 2024-09-06T14:45:00.272 INFO:tasks.workunit.client.0.smithi052.stdout:0/700: readlink d0/d1a/d26/d3a/d14/d2d/d92/ld1 0 2024-09-06T14:45:00.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/717: link d1/d4/d6/dc/d38/fb3 d1/d4/d6/dc/d10/d18/d82/fe0 0 2024-09-06T14:45:00.275 INFO:tasks.workunit.client.0.smithi052.stdout:5/865: truncate d2/d1a/d22/f7e 1275477 0 2024-09-06T14:45:00.278 INFO:tasks.workunit.client.0.smithi052.stdout:5/866: read d2/d20/d42/d8b/fab [1783812,97958] 0 2024-09-06T14:45:00.285 INFO:tasks.workunit.client.0.smithi052.stdout:9/718: creat d1/d4/d6/dc/d10/d18/d82/da6/dcb/fe1 x:0 0 0 2024-09-06T14:45:00.285 INFO:tasks.workunit.client.0.smithi052.stdout:1/837: dread d1/db/de/d74/d14/f25 [0,4194304] 0 2024-09-06T14:45:00.285 INFO:tasks.workunit.client.0.smithi052.stdout:9/719: chown d1/d4/d6/dc/d38/d5a/cd0 3 1 2024-09-06T14:45:00.285 INFO:tasks.workunit.client.0.smithi052.stdout:4/730: dread d9/f69 [0,4194304] 0 2024-09-06T14:45:00.286 INFO:tasks.workunit.client.0.smithi052.stdout:5/867: rename d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/l99 to d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/l12c 0 2024-09-06T14:45:00.287 INFO:tasks.workunit.client.0.smithi052.stdout:5/868: stat d2/d20/fd4 0 2024-09-06T14:45:00.288 INFO:tasks.workunit.client.0.smithi052.stdout:9/720: truncate d1/d26/d3d/f4a 65013 0 2024-09-06T14:45:00.289 INFO:tasks.workunit.client.0.smithi052.stdout:9/721: chown d1/d26/l85 53383995 1 2024-09-06T14:45:00.293 INFO:tasks.workunit.client.0.smithi052.stdout:4/731: dwrite d9/d2d/d33/d5d/f99 [0,4194304] 0 2024-09-06T14:45:00.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/722: creat d1/d4/d6/dd1/dd9/fe2 x:0 0 0 2024-09-06T14:45:00.297 INFO:tasks.workunit.client.0.smithi052.stdout:5/869: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/fb9 [4194304,4194304] 0 2024-09-06T14:45:00.301 INFO:tasks.workunit.client.0.smithi052.stdout:5/870: chown d2/d1a/d22/d26/l36 167677189 1 2024-09-06T14:45:00.303 INFO:tasks.workunit.client.0.smithi052.stdout:5/871: fdatasync d2/d1a/d22/d26/d2b/d48/d64/dbf/f10f 0 2024-09-06T14:45:00.304 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:44:59 smithi165 ceph-mon[36229]: pgmap v32: 65 pgs: 65 active+clean; 2.6 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 54 MiB/s rd, 148 MiB/s wr, 389 op/s 2024-09-06T14:45:00.304 INFO:tasks.workunit.client.0.smithi052.stdout:5/872: readlink d2/d20/d56/l70 0 2024-09-06T14:45:00.309 INFO:tasks.workunit.client.0.smithi052.stdout:5/873: dread d2/d1a/d22/d26/d2b/d37/d6a/fcd [0,4194304] 0 2024-09-06T14:45:00.316 INFO:tasks.workunit.client.0.smithi052.stdout:5/874: dwrite d2/d20/d56/fc2 [0,4194304] 0 2024-09-06T14:45:00.316 INFO:tasks.workunit.client.0.smithi052.stdout:9/723: fsync d1/d4/d6/dc/d10/d18/d82/fe0 0 2024-09-06T14:45:00.324 INFO:tasks.workunit.client.0.smithi052.stdout:0/701: dwrite d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/f6c [0,4194304] 0 2024-09-06T14:45:00.329 INFO:tasks.workunit.client.0.smithi052.stdout:5/875: rename d2/d1a/d22/d26/d2b/d48/d64/dbf/fcb to d2/d1a/d22/d26/d2b/d37/d84/da7/f12d 0 2024-09-06T14:45:00.333 INFO:tasks.workunit.client.0.smithi052.stdout:5/876: chown d2/d20/f28 66353 1 2024-09-06T14:45:00.334 INFO:tasks.workunit.client.0.smithi052.stdout:0/702: getdents d0/d1a/de8 0 2024-09-06T14:45:00.335 INFO:tasks.workunit.client.0.smithi052.stdout:4/732: dread d9/f65 [0,4194304] 0 2024-09-06T14:45:00.337 INFO:tasks.workunit.client.0.smithi052.stdout:9/724: dwrite d1/f17 [0,4194304] 0 2024-09-06T14:45:00.338 INFO:tasks.workunit.client.0.smithi052.stdout:0/703: mknod d0/d19/c102 0 2024-09-06T14:45:00.339 INFO:tasks.workunit.client.0.smithi052.stdout:1/838: dwrite d1/db/de/d74/d14/fb7 [4194304,4194304] 0 2024-09-06T14:45:00.341 INFO:tasks.workunit.client.0.smithi052.stdout:5/877: fdatasync d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fad 0 2024-09-06T14:45:00.341 INFO:tasks.workunit.client.0.smithi052.stdout:0/704: chown d0/d3d/de4/c101 1096652 1 2024-09-06T14:45:00.348 INFO:tasks.workunit.client.0.smithi052.stdout:4/733: creat d9/d2d/f100 x:0 0 0 2024-09-06T14:45:00.351 INFO:tasks.workunit.client.0.smithi052.stdout:9/725: unlink d1/d26/d3d/f4a 0 2024-09-06T14:45:00.356 INFO:tasks.workunit.client.0.smithi052.stdout:1/839: creat d1/db/de/d74/d36/f125 x:0 0 0 2024-09-06T14:45:00.360 INFO:tasks.workunit.client.0.smithi052.stdout:5/878: link d2/d1a/d22/d26/d2b/d37/d6a/f8e d2/d20/d42/d8b/dc8/f12e 0 2024-09-06T14:45:00.360 INFO:tasks.workunit.client.0.smithi052.stdout:9/726: dwrite d1/d4/d6/dc/d38/d5a/faf [0,4194304] 0 2024-09-06T14:45:00.360 INFO:tasks.workunit.client.0.smithi052.stdout:4/734: link d9/d2d/d33/d5d/da6/dbf/cc2 d9/d10/d17/d39/d7b/d91/d9e/c101 0 2024-09-06T14:45:00.362 INFO:tasks.workunit.client.0.smithi052.stdout:1/840: symlink d1/d6c/l126 0 2024-09-06T14:45:00.362 INFO:tasks.workunit.client.0.smithi052.stdout:5/879: dread - d2/d20/d42/d8b/faa zero size 2024-09-06T14:45:00.363 INFO:tasks.workunit.client.0.smithi052.stdout:5/880: fdatasync d2/fb8 0 2024-09-06T14:45:00.367 INFO:tasks.workunit.client.0.smithi052.stdout:1/841: mkdir d1/d6c/d98/d127 0 2024-09-06T14:45:00.370 INFO:tasks.workunit.client.0.smithi052.stdout:1/842: symlink d1/d5f/l128 0 2024-09-06T14:45:00.371 INFO:tasks.workunit.client.0.smithi052.stdout:5/881: dwrite d2/d1a/d22/d26/f85 [0,4194304] 0 2024-09-06T14:45:00.373 INFO:tasks.workunit.client.0.smithi052.stdout:5/882: dread - d2/d1a/d22/d26/d2b/d48/d64/dbf/f10f zero size 2024-09-06T14:45:00.382 INFO:tasks.workunit.client.0.smithi052.stdout:0/705: dwrite d0/d1a/f52 [0,4194304] 0 2024-09-06T14:45:00.383 INFO:tasks.workunit.client.0.smithi052.stdout:1/843: dwrite d1/db/de/d74/d12/f70 [0,4194304] 0 2024-09-06T14:45:00.384 INFO:tasks.workunit.client.0.smithi052.stdout:0/706: stat d0/d19/d29/f91 0 2024-09-06T14:45:00.386 INFO:tasks.workunit.client.0.smithi052.stdout:4/735: write d9/d10/d17/d39/d3a/f92 [234986,126285] 0 2024-09-06T14:45:00.386 INFO:tasks.workunit.client.0.smithi052.stdout:0/707: readlink d0/d4f/l6e 0 2024-09-06T14:45:00.389 INFO:tasks.workunit.client.0.smithi052.stdout:4/736: write d9/d10/d17/d39/d3a/ff6 [605016,82343] 0 2024-09-06T14:45:00.390 INFO:tasks.workunit.client.0.smithi052.stdout:4/737: fsync f7 0 2024-09-06T14:45:00.391 INFO:tasks.workunit.client.0.smithi052.stdout:9/727: dwrite d1/f37 [0,4194304] 0 2024-09-06T14:45:00.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/844: link d1/db/d72/d81/ced d1/db/de/d74/d14/d2e/dc6/c129 0 2024-09-06T14:45:00.398 INFO:tasks.workunit.client.0.smithi052.stdout:1/845: chown d1/d5f 2218 1 2024-09-06T14:45:00.400 INFO:tasks.workunit.client.0.smithi052.stdout:4/738: rename d9/d10/d19/f29 to d9/d10/d17/d39/d7b/d91/d9e/f102 0 2024-09-06T14:45:00.403 INFO:tasks.workunit.client.0.smithi052.stdout:4/739: write d9/d10/d17/d39/d3a/f92 [437039,54148] 0 2024-09-06T14:45:00.406 INFO:tasks.workunit.client.0.smithi052.stdout:1/846: rename d1/db/de/d74/d36/f7b to d1/db/de/d74/d14/d90/de6/f12a 0 2024-09-06T14:45:00.407 INFO:tasks.workunit.client.0.smithi052.stdout:1/847: stat d1/db/de/d74/d14/d90/de6/f12a 0 2024-09-06T14:45:00.408 INFO:tasks.workunit.client.0.smithi052.stdout:0/708: dread d0/f8d [0,4194304] 0 2024-09-06T14:45:00.410 INFO:tasks.workunit.client.0.smithi052.stdout:9/728: getdents d1 0 2024-09-06T14:45:00.410 INFO:tasks.workunit.client.0.smithi052.stdout:1/848: chown d1/db/de/d74/d36/d9b/fbe 0 1 2024-09-06T14:45:00.412 INFO:tasks.workunit.client.0.smithi052.stdout:4/740: mknod d9/d10/d17/d39/d3a/d64/c103 0 2024-09-06T14:45:00.412 INFO:tasks.workunit.client.0.smithi052.stdout:0/709: truncate d0/d1a/daa/fc6 657427 0 2024-09-06T14:45:00.414 INFO:tasks.workunit.client.0.smithi052.stdout:5/883: dread d2/f11 [0,4194304] 0 2024-09-06T14:45:00.415 INFO:tasks.workunit.client.0.smithi052.stdout:2/755: sync 2024-09-06T14:45:00.415 INFO:tasks.workunit.client.0.smithi052.stdout:5/884: stat d2/d20/d42/d8b/dca/f101 0 2024-09-06T14:45:00.416 INFO:tasks.workunit.client.0.smithi052.stdout:2/756: stat da/d19/d3a/d31 0 2024-09-06T14:45:00.416 INFO:tasks.workunit.client.0.smithi052.stdout:4/741: unlink d9/d10/d17/d39/ff1 0 2024-09-06T14:45:00.422 INFO:tasks.workunit.client.0.smithi052.stdout:2/757: dwrite da/d19/d3a/d61/f95 [0,4194304] 0 2024-09-06T14:45:00.426 INFO:tasks.workunit.client.0.smithi052.stdout:5/885: write d2/f7 [4683007,4334] 0 2024-09-06T14:45:00.428 INFO:tasks.workunit.client.0.smithi052.stdout:4/742: truncate d9/f69 3149786 0 2024-09-06T14:45:00.431 INFO:tasks.workunit.client.0.smithi052.stdout:2/758: read da/db/f16 [230375,93034] 0 2024-09-06T14:45:00.432 INFO:tasks.workunit.client.0.smithi052.stdout:4/743: dread d9/d2d/d33/d5d/f99 [0,4194304] 0 2024-09-06T14:45:00.432 INFO:tasks.workunit.client.0.smithi052.stdout:2/759: readlink da/d19/d3a/d31/d76/l6f 0 2024-09-06T14:45:00.437 INFO:tasks.workunit.client.0.smithi052.stdout:0/710: write d0/d1a/d26/f87 [1924027,9421] 0 2024-09-06T14:45:00.438 INFO:tasks.workunit.client.0.smithi052.stdout:2/760: creat da/db9/ff5 x:0 0 0 2024-09-06T14:45:00.439 INFO:tasks.workunit.client.0.smithi052.stdout:9/729: dwrite d1/d4/d6/dc/d10/d18/d82/fe0 [0,4194304] 0 2024-09-06T14:45:00.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/730: stat d1/d4/d6/dd/d22/d6a/cdd 0 2024-09-06T14:45:00.448 INFO:tasks.workunit.client.0.smithi052.stdout:0/711: dwrite d0/d1a/f52 [0,4194304] 0 2024-09-06T14:45:00.448 INFO:tasks.workunit.client.0.smithi052.stdout:2/761: mkdir da/db/d60/df6 0 2024-09-06T14:45:00.449 INFO:tasks.workunit.client.0.smithi052.stdout:9/731: dread d1/d4/d6/dc/d7a/fbc [0,4194304] 0 2024-09-06T14:45:00.450 INFO:tasks.workunit.client.0.smithi052.stdout:2/762: chown da/d19/d3a/d31/d76/cf1 5 1 2024-09-06T14:45:00.451 INFO:tasks.workunit.client.0.smithi052.stdout:4/744: creat d9/d10/d19/f104 x:0 0 0 2024-09-06T14:45:00.461 INFO:tasks.workunit.client.0.smithi052.stdout:5/886: dwrite d2/d20/d42/d8b/dc8/f12e [0,4194304] 0 2024-09-06T14:45:00.461 INFO:tasks.workunit.client.0.smithi052.stdout:4/745: stat d9/d2d/d33/c7c 0 2024-09-06T14:45:00.465 INFO:tasks.workunit.client.0.smithi052.stdout:0/712: dread d0/d1a/d26/f27 [0,4194304] 0 2024-09-06T14:45:00.467 INFO:tasks.workunit.client.0.smithi052.stdout:9/732: dwrite d1/d4/d6/dc/d10/d18/f5d [0,4194304] 0 2024-09-06T14:45:00.469 INFO:tasks.workunit.client.0.smithi052.stdout:4/746: creat d9/d72/f105 x:0 0 0 2024-09-06T14:45:00.472 INFO:tasks.workunit.client.0.smithi052.stdout:5/887: truncate d2/d20/d42/d65/f78 974200 0 2024-09-06T14:45:00.478 INFO:tasks.workunit.client.0.smithi052.stdout:9/733: symlink d1/d4/d6/dc/d10/d18/d82/d9e/dd7/le3 0 2024-09-06T14:45:00.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/747: mkdir d9/d10/d17/d39/d3a/d5c/d106 0 2024-09-06T14:45:00.485 INFO:tasks.workunit.client.0.smithi052.stdout:0/713: dread d0/d1a/f40 [4194304,4194304] 0 2024-09-06T14:45:00.485 INFO:tasks.workunit.client.0.smithi052.stdout:2/763: truncate da/db/fa2 1407079 0 2024-09-06T14:45:00.489 INFO:tasks.workunit.client.0.smithi052.stdout:0/714: mknod d0/d3d/de4/c103 0 2024-09-06T14:45:00.490 INFO:tasks.workunit.client.0.smithi052.stdout:2/764: symlink da/d19/d5a/lf7 0 2024-09-06T14:45:00.491 INFO:tasks.workunit.client.0.smithi052.stdout:2/765: mknod da/d19/d3a/d31/d7a/dbd/cf8 0 2024-09-06T14:45:00.494 INFO:tasks.workunit.client.0.smithi052.stdout:0/715: dread d0/d1a/d26/d3a/d14/d20/d22/f4a [0,4194304] 0 2024-09-06T14:45:00.502 INFO:tasks.workunit.client.0.smithi052.stdout:4/748: dread d9/d72/fd8 [8388608,4194304] 0 2024-09-06T14:45:00.504 INFO:tasks.workunit.client.0.smithi052.stdout:0/716: link d0/d1a/d26/d3a/d14/d20/d22/d55/c93 d0/d1a/d26/d3a/d14/d2d/d94/dda/c104 0 2024-09-06T14:45:00.506 INFO:tasks.workunit.client.0.smithi052.stdout:4/749: creat d9/d10/d17/d39/d7b/d91/d9e/f107 x:0 0 0 2024-09-06T14:45:00.509 INFO:tasks.workunit.client.0.smithi052.stdout:0/717: dread d0/d19/fa8 [0,4194304] 0 2024-09-06T14:45:00.511 INFO:tasks.workunit.client.0.smithi052.stdout:4/750: getdents d9/d10/d17/d39/d7b 0 2024-09-06T14:45:00.513 INFO:tasks.workunit.client.0.smithi052.stdout:4/751: chown d9/d2d/d33/d5d/da6/deb 24167 1 2024-09-06T14:45:00.513 INFO:tasks.workunit.client.0.smithi052.stdout:0/718: creat d0/d1a/d26/d3a/d14/d2d/d92/f105 x:0 0 0 2024-09-06T14:45:00.515 INFO:tasks.workunit.client.0.smithi052.stdout:2/766: dwrite da/db/d46/d6b/f98 [4194304,4194304] 0 2024-09-06T14:45:00.519 INFO:tasks.workunit.client.0.smithi052.stdout:4/752: symlink d9/d2d/d33/d5d/da6/d83/l108 0 2024-09-06T14:45:00.526 INFO:tasks.workunit.client.0.smithi052.stdout:4/753: dwrite d9/d72/fa5 [4194304,4194304] 0 2024-09-06T14:45:00.526 INFO:tasks.workunit.client.0.smithi052.stdout:4/754: readlink d9/l61 0 2024-09-06T14:45:00.532 INFO:tasks.workunit.client.0.smithi052.stdout:0/719: getdents d0/d1a/d26/d3a/d14/d20/dbf 0 2024-09-06T14:45:00.534 INFO:tasks.workunit.client.0.smithi052.stdout:0/720: dread d0/d1a/d26/d3a/d14/d20/d22/f6a [4194304,4194304] 0 2024-09-06T14:45:00.536 INFO:tasks.workunit.client.0.smithi052.stdout:2/767: truncate da/d19/d3a/d31/f43 2472804 0 2024-09-06T14:45:00.538 INFO:tasks.workunit.client.0.smithi052.stdout:0/721: mknod d0/d1a/d26/d3a/d14/d20/d22/d55/da0/c106 0 2024-09-06T14:45:00.539 INFO:tasks.workunit.client.0.smithi052.stdout:4/755: getdents d9/d2d 0 2024-09-06T14:45:00.540 INFO:tasks.workunit.client.0.smithi052.stdout:0/722: creat d0/d18/dd6/f107 x:0 0 0 2024-09-06T14:45:00.541 INFO:tasks.workunit.client.0.smithi052.stdout:0/723: stat d0/d7e/ff8 0 2024-09-06T14:45:00.545 INFO:tasks.workunit.client.0.smithi052.stdout:0/724: mkdir d0/d1a/d26/d3a/d14/d20/d108 0 2024-09-06T14:45:00.546 INFO:tasks.workunit.client.0.smithi052.stdout:2/768: getdents da/d19/d3a/d31/d7a/dbd 0 2024-09-06T14:45:00.547 INFO:tasks.workunit.client.0.smithi052.stdout:4/756: link d9/d10/d17/d39/c4e d9/d2d/d33/d5d/da6/c109 0 2024-09-06T14:45:00.548 INFO:tasks.workunit.client.0.smithi052.stdout:2/769: dread - da/db/d60/daa/fdf zero size 2024-09-06T14:45:00.553 INFO:tasks.workunit.client.0.smithi052.stdout:0/725: dwrite d0/d1a/d26/d3a/ffa [0,4194304] 0 2024-09-06T14:45:00.561 INFO:tasks.workunit.client.0.smithi052.stdout:0/726: dwrite d0/d1a/d26/d3a/d14/d20/d22/d55/fd8 [0,4194304] 0 2024-09-06T14:45:00.568 INFO:tasks.workunit.client.0.smithi052.stdout:0/727: rename d0/d1a/d26/d3a/d14/d2d/l1b to d0/d2e/l109 0 2024-09-06T14:45:00.570 INFO:tasks.workunit.client.0.smithi052.stdout:2/770: dwrite da/f57 [0,4194304] 0 2024-09-06T14:45:00.570 INFO:tasks.workunit.client.0.smithi052.stdout:4/757: dwrite d9/d10/d17/f42 [0,4194304] 0 2024-09-06T14:45:00.573 INFO:tasks.workunit.client.0.smithi052.stdout:4/758: chown d9/d10/d17/d39/d3a/f92 107 1 2024-09-06T14:45:00.577 INFO:tasks.workunit.client.0.smithi052.stdout:4/759: mknod d9/d10/dec/c10a 0 2024-09-06T14:45:00.577 INFO:tasks.workunit.client.0.smithi052.stdout:4/760: chown d9/f38 4866887 1 2024-09-06T14:45:00.577 INFO:tasks.workunit.client.0.smithi052.stdout:0/728: dwrite d0/d2e/fac [0,4194304] 0 2024-09-06T14:45:00.583 INFO:tasks.workunit.client.0.smithi052.stdout:2/771: write da/db/fe [770687,121033] 0 2024-09-06T14:45:00.586 INFO:tasks.workunit.client.0.smithi052.stdout:0/729: fsync d0/d1a/d26/d3a/d14/fcf 0 2024-09-06T14:45:00.587 INFO:tasks.workunit.client.0.smithi052.stdout:4/761: dwrite d9/f35 [0,4194304] 0 2024-09-06T14:45:00.587 INFO:tasks.workunit.client.0.smithi052.stdout:2/772: fdatasync da/db/d46/d55/de6/f9a 0 2024-09-06T14:45:00.590 INFO:tasks.workunit.client.0.smithi052.stdout:0/730: chown d0/d1a/d26/d3a/d14/fcf 0 1 2024-09-06T14:45:00.592 INFO:tasks.workunit.client.0.smithi052.stdout:2/773: fsync da/db/d46/d55/de6/f75 0 2024-09-06T14:45:00.593 INFO:tasks.workunit.client.0.smithi052.stdout:4/762: chown d9/d2d/d33/d5d/da6/c62 31001 1 2024-09-06T14:45:00.593 INFO:tasks.workunit.client.0.smithi052.stdout:0/731: mknod d0/d18/c10a 0 2024-09-06T14:45:00.595 INFO:tasks.workunit.client.0.smithi052.stdout:4/763: chown d9/d10/d17/d39/d7b/d91/d9e/f107 0 1 2024-09-06T14:45:00.596 INFO:tasks.workunit.client.0.smithi052.stdout:0/732: chown d0/d1a/d26/d3a/d14/d2d/d56/da3/fd2 28509 1 2024-09-06T14:45:00.597 INFO:tasks.workunit.client.0.smithi052.stdout:0/733: chown d0/d2e/c49 1 1 2024-09-06T14:45:00.599 INFO:tasks.workunit.client.0.smithi052.stdout:4/764: mknod d9/d2d/d33/d5d/da6/deb/d81/c10b 0 2024-09-06T14:45:00.601 INFO:tasks.workunit.client.0.smithi052.stdout:4/765: creat d9/d72/f10c x:0 0 0 2024-09-06T14:45:00.602 INFO:tasks.workunit.client.0.smithi052.stdout:2/774: getdents da/d19/d5a/da7 0 2024-09-06T14:45:00.604 INFO:tasks.workunit.client.0.smithi052.stdout:2/775: rmdir da/d19/d5a/d6c 39 2024-09-06T14:45:00.605 INFO:tasks.workunit.client.0.smithi052.stdout:4/766: dread d9/d10/f4f [4194304,4194304] 0 2024-09-06T14:45:00.605 INFO:tasks.workunit.client.0.smithi052.stdout:2/776: read da/d19/d3a/d31/d76/d6a/f9c [5993361,122012] 0 2024-09-06T14:45:00.607 INFO:tasks.workunit.client.0.smithi052.stdout:2/777: mknod da/db/d18/cf9 0 2024-09-06T14:45:00.607 INFO:tasks.workunit.client.0.smithi052.stdout:4/767: rmdir d9/d2d/d33/d5d/da6/deb/d81/d9c/dac 39 2024-09-06T14:45:00.609 INFO:tasks.workunit.client.0.smithi052.stdout:0/734: fsync d0/d2e/fac 0 2024-09-06T14:45:00.610 INFO:tasks.workunit.client.0.smithi052.stdout:4/768: unlink d9/d2d/d33/d5d/f8a 0 2024-09-06T14:45:00.612 INFO:tasks.workunit.client.0.smithi052.stdout:0/735: dread d0/d19/fa8 [0,4194304] 0 2024-09-06T14:45:00.613 INFO:tasks.workunit.client.0.smithi052.stdout:4/769: mkdir d9/d10/d19/d10d 0 2024-09-06T14:45:00.614 INFO:tasks.workunit.client.0.smithi052.stdout:0/736: dread - d0/d1a/d8e/fef zero size 2024-09-06T14:45:00.614 INFO:tasks.workunit.client.0.smithi052.stdout:7/725: sync 2024-09-06T14:45:00.615 INFO:tasks.workunit.client.0.smithi052.stdout:6/630: sync 2024-09-06T14:45:00.615 INFO:tasks.workunit.client.0.smithi052.stdout:3/822: sync 2024-09-06T14:45:00.616 INFO:tasks.workunit.client.0.smithi052.stdout:4/770: unlink d9/d10/d17/d39/d3a/d64/fa3 0 2024-09-06T14:45:00.622 INFO:tasks.workunit.client.0.smithi052.stdout:0/737: dwrite d0/d1a/d26/f4e [4194304,4194304] 0 2024-09-06T14:45:00.623 INFO:tasks.workunit.client.0.smithi052.stdout:2/778: dread da/db/d18/f3c [0,4194304] 0 2024-09-06T14:45:00.624 INFO:tasks.workunit.client.0.smithi052.stdout:2/779: chown da/d19/d3a/d31/d76/dc7/fcb 15126 1 2024-09-06T14:45:00.764 INFO:tasks.workunit.client.0.smithi052.stdout:7/726: write d11/d1c/d24/d3b/d50/f8c [3923250,78446] 0 2024-09-06T14:45:00.770 INFO:tasks.workunit.client.0.smithi052.stdout:7/727: dwrite d11/d1c/f1e [0,4194304] 0 2024-09-06T14:45:00.772 INFO:tasks.workunit.client.0.smithi052.stdout:0/738: rename d0/d1a/d26/d3a/d14/d20/d22/d41/cd7 to d0/d1a/d26/d3a/d14/d2d/d56/d9d/c10b 0 2024-09-06T14:45:00.773 INFO:tasks.workunit.client.0.smithi052.stdout:0/739: stat d0/d1a/d26/d3a/d14/d2d/fa9 0 2024-09-06T14:45:00.775 INFO:tasks.workunit.client.0.smithi052.stdout:0/740: write d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/f6c [3138946,15542] 0 2024-09-06T14:45:00.776 INFO:tasks.workunit.client.0.smithi052.stdout:0/741: rename d0/d4f/d7d to d0/d4f/d7d/d10c 22 2024-09-06T14:45:00.778 INFO:tasks.workunit.client.0.smithi052.stdout:6/631: creat d2/dd/d18/d25/d4c/dbe/fcf x:0 0 0 2024-09-06T14:45:00.779 INFO:tasks.workunit.client.0.smithi052.stdout:6/632: chown d2/dd/d18/d25/d4c 351069319 1 2024-09-06T14:45:00.780 INFO:tasks.workunit.client.0.smithi052.stdout:3/823: write d0/d11/d12/d4c/d93/d35/d46/f5e [159976,88699] 0 2024-09-06T14:45:00.782 INFO:tasks.workunit.client.0.smithi052.stdout:4/771: creat d9/d10/d17/d39/d3a/d5c/d106/f10e x:0 0 0 2024-09-06T14:45:00.783 INFO:tasks.workunit.client.0.smithi052.stdout:7/728: read - d11/d1c/d57/fb5 zero size 2024-09-06T14:45:00.788 INFO:tasks.workunit.client.0.smithi052.stdout:4/772: dwrite d9/f38 [0,4194304] 0 2024-09-06T14:45:00.795 INFO:tasks.workunit.client.0.smithi052.stdout:4/773: dwrite d9/d10/d17/d39/d3a/d5c/fa2 [0,4194304] 0 2024-09-06T14:45:00.799 INFO:tasks.workunit.client.0.smithi052.stdout:7/729: dread - d11/d1c/d24/d7e/fbe zero size 2024-09-06T14:45:00.812 INFO:tasks.workunit.client.0.smithi052.stdout:4/774: mkdir d9/da1/d10f 0 2024-09-06T14:45:00.813 INFO:tasks.workunit.client.0.smithi052.stdout:7/730: rename d11/d1c/d3f/d5d/d88/cb0 to d11/d1c/d24/d3b/d50/ce9 0 2024-09-06T14:45:00.814 INFO:tasks.workunit.client.0.smithi052.stdout:2/780: link da/db/d18/led da/db/d46/d55/de6/lfa 0 2024-09-06T14:45:00.818 INFO:tasks.workunit.client.0.smithi052.stdout:4/775: dread d9/d10/d17/d39/d3a/d5c/fa2 [0,4194304] 0 2024-09-06T14:45:00.821 INFO:tasks.workunit.client.0.smithi052.stdout:6/633: dread d2/f3d [0,4194304] 0 2024-09-06T14:45:00.824 INFO:tasks.workunit.client.0.smithi052.stdout:0/742: dwrite d0/f1c [0,4194304] 0 2024-09-06T14:45:00.825 INFO:tasks.workunit.client.0.smithi052.stdout:7/731: dwrite d11/d1c/d57/d74/fdd [0,4194304] 0 2024-09-06T14:45:00.827 INFO:tasks.workunit.client.0.smithi052.stdout:4/776: stat d9/d10/d17/daa/db5/db9/c86 0 2024-09-06T14:45:00.828 INFO:tasks.workunit.client.0.smithi052.stdout:0/743: chown d0/d19/f72 113859 1 2024-09-06T14:45:00.836 INFO:tasks.workunit.client.0.smithi052.stdout:3/824: dwrite d0/d11/d71/d98/f56 [0,4194304] 0 2024-09-06T14:45:00.839 INFO:tasks.workunit.client.0.smithi052.stdout:6/634: dwrite d2/dd/d9d/db4/fc6 [0,4194304] 0 2024-09-06T14:45:00.844 INFO:tasks.workunit.client.0.smithi052.stdout:2/781: write da/f92 [790948,54168] 0 2024-09-06T14:45:00.844 INFO:tasks.workunit.client.0.smithi052.stdout:4/777: dread d9/d10/d17/d39/d3a/d5c/f9d [0,4194304] 0 2024-09-06T14:45:00.847 INFO:tasks.workunit.client.0.smithi052.stdout:6/635: creat d2/dd/d18/d33/d44/d79/fd0 x:0 0 0 2024-09-06T14:45:00.851 INFO:tasks.workunit.client.0.smithi052.stdout:2/782: symlink da/d19/d3a/d31/lfb 0 2024-09-06T14:45:00.853 INFO:tasks.workunit.client.0.smithi052.stdout:4/778: mknod d9/d10/d17/d39/d7b/d91/c110 0 2024-09-06T14:45:00.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/779: readlink d9/d2d/d33/d5d/lae 0 2024-09-06T14:45:00.855 INFO:tasks.workunit.client.0.smithi052.stdout:6/636: fdatasync d2/db6/fac 0 2024-09-06T14:45:00.859 INFO:tasks.workunit.client.0.smithi052.stdout:0/744: getdents d0/d1a/d26/d3a/d14/d2d/de2 0 2024-09-06T14:45:00.862 INFO:tasks.workunit.client.0.smithi052.stdout:0/745: unlink d0/d1a/d26/d3a/d14/d20/feb 0 2024-09-06T14:45:00.864 INFO:tasks.workunit.client.0.smithi052.stdout:4/780: creat d9/d2d/d33/d5d/da6/deb/d81/d9c/f111 x:0 0 0 2024-09-06T14:45:00.900 INFO:tasks.workunit.client.0.smithi052.stdout:2/783: write da/db/d60/daa/fbc [1610180,105169] 0 2024-09-06T14:45:00.903 INFO:tasks.workunit.client.0.smithi052.stdout:3/825: dread d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/fe3 [0,4194304] 0 2024-09-06T14:45:00.903 INFO:tasks.workunit.client.0.smithi052.stdout:7/732: dread d11/d1c/d78/f79 [0,4194304] 0 2024-09-06T14:45:00.904 INFO:tasks.workunit.client.0.smithi052.stdout:0/746: dwrite d0/d18/dd6/fde [0,4194304] 0 2024-09-06T14:45:00.910 INFO:tasks.workunit.client.0.smithi052.stdout:0/747: symlink d0/d1a/d26/d3a/l10d 0 2024-09-06T14:45:00.911 INFO:tasks.workunit.client.0.smithi052.stdout:3/826: readlink d0/d11/d12/d4c/d93/d35/d46/d5b/da0/ld3 0 2024-09-06T14:45:00.912 INFO:tasks.workunit.client.0.smithi052.stdout:4/781: dwrite d9/d10/fe9 [0,4194304] 0 2024-09-06T14:45:00.912 INFO:tasks.workunit.client.0.smithi052.stdout:7/733: rmdir d11/d1c/d57/da7 39 2024-09-06T14:45:00.913 INFO:tasks.workunit.client.0.smithi052.stdout:2/784: dread da/db/fe [0,4194304] 0 2024-09-06T14:45:00.915 INFO:tasks.workunit.client.0.smithi052.stdout:3/827: read d0/d11/d71/d98/d19/fc6 [321049,106961] 0 2024-09-06T14:45:00.918 INFO:tasks.workunit.client.0.smithi052.stdout:4/782: dread - d9/da1/fc5 zero size 2024-09-06T14:45:00.919 INFO:tasks.workunit.client.0.smithi052.stdout:0/748: dread - d0/d4f/d7d/ffd zero size 2024-09-06T14:45:00.923 INFO:tasks.workunit.client.0.smithi052.stdout:7/734: write d11/d1c/d24/d4b/da2/fe8 [605040,70833] 0 2024-09-06T14:45:00.928 INFO:tasks.workunit.client.0.smithi052.stdout:3/828: rename d0/d11/d71/d98/l6a to d0/d11/d71/d98/d1b/d85/lfc 0 2024-09-06T14:45:00.929 INFO:tasks.workunit.client.0.smithi052.stdout:4/783: rmdir d9/d2d 39 2024-09-06T14:45:00.941 INFO:tasks.workunit.client.0.smithi052.stdout:3/829: rename d0/d11/d71/d98/c4b to d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/dee/cfd 0 2024-09-06T14:45:00.949 INFO:tasks.workunit.client.0.smithi052.stdout:2/785: dread da/db/d46/d55/de6/d70/fa6 [0,4194304] 0 2024-09-06T14:45:00.951 INFO:tasks.workunit.client.0.smithi052.stdout:3/830: creat d0/d11/d12/d4c/d93/d35/db5/ffe x:0 0 0 2024-09-06T14:45:00.956 INFO:tasks.workunit.client.0.smithi052.stdout:3/831: creat d0/d11/d71/d98/d19/fff x:0 0 0 2024-09-06T14:45:00.962 INFO:tasks.workunit.client.0.smithi052.stdout:3/832: rename d0/d11/d71/d98/f55 to d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/f100 0 2024-09-06T14:45:00.973 INFO:tasks.workunit.client.0.smithi052.stdout:3/833: dread d0/d11/d71/fad [0,4194304] 0 2024-09-06T14:45:00.977 INFO:tasks.workunit.client.0.smithi052.stdout:3/834: creat d0/d11/d12/d4c/f101 x:0 0 0 2024-09-06T14:45:00.978 INFO:tasks.workunit.client.0.smithi052.stdout:0/749: write d0/d4f/d7d/f76 [1230955,85024] 0 2024-09-06T14:45:00.985 INFO:tasks.workunit.client.0.smithi052.stdout:2/786: write da/db/f16 [195521,3851] 0 2024-09-06T14:45:00.985 INFO:tasks.workunit.client.0.smithi052.stdout:7/735: dwrite d11/d1c/d24/d3b/d50/fab [0,4194304] 0 2024-09-06T14:45:00.988 INFO:tasks.workunit.client.0.smithi052.stdout:4/784: dwrite d9/d10/d17/d39/d7b/d91/d9e/f102 [0,4194304] 0 2024-09-06T14:45:00.992 INFO:tasks.workunit.client.0.smithi052.stdout:3/835: write d0/d11/d12/d4c/d93/d35/d46/d5b/da0/fab [489338,86320] 0 2024-09-06T14:45:00.993 INFO:tasks.workunit.client.0.smithi052.stdout:0/750: write d0/d1a/d26/d3a/d14/d20/d22/d8b/faf [759045,63889] 0 2024-09-06T14:45:00.996 INFO:tasks.workunit.client.0.smithi052.stdout:0/751: chown d0/d1a/d26/d3a/d14/d2d/d56/ce0 62 1 2024-09-06T14:45:00.997 INFO:tasks.workunit.client.0.smithi052.stdout:7/736: symlink d11/d1c/d57/d89/lea 0 2024-09-06T14:45:01.001 INFO:tasks.workunit.client.0.smithi052.stdout:3/836: mknod d0/d11/d12/d4c/d93/d35/db5/c102 0 2024-09-06T14:45:01.001 INFO:tasks.workunit.client.0.smithi052.stdout:7/737: rmdir d11/d1c/d24/d4b/da2 39 2024-09-06T14:45:01.003 INFO:tasks.workunit.client.0.smithi052.stdout:4/785: symlink d9/d2d/d33/d5d/l112 0 2024-09-06T14:45:01.004 INFO:tasks.workunit.client.0.smithi052.stdout:0/752: truncate d0/d1a/d26/d3a/d14/d20/d22/d41/f4c 5566842 0 2024-09-06T14:45:01.005 INFO:tasks.workunit.client.0.smithi052.stdout:0/753: fdatasync d0/d1a/d26/d3a/d14/d20/d22/d41/fd0 0 2024-09-06T14:45:01.006 INFO:tasks.workunit.client.0.smithi052.stdout:3/837: symlink d0/d11/d12/d4c/d93/l103 0 2024-09-06T14:45:01.008 INFO:tasks.workunit.client.0.smithi052.stdout:4/786: write d9/d10/d17/d39/d3a/d5c/fa2 [4407272,106041] 0 2024-09-06T14:45:01.009 INFO:tasks.workunit.client.0.smithi052.stdout:0/754: symlink d0/d4f/d7d/l10e 0 2024-09-06T14:45:01.012 INFO:tasks.workunit.client.0.smithi052.stdout:2/787: dwrite da/db/d18/d7f/fb6 [0,4194304] 0 2024-09-06T14:45:01.013 INFO:tasks.workunit.client.0.smithi052.stdout:4/787: truncate d9/d10/d17/d39/d3a/d5c/fa2 4714305 0 2024-09-06T14:45:01.014 INFO:tasks.workunit.client.0.smithi052.stdout:2/788: write da/d19/d3a/d31/d76/f4d [1827903,44402] 0 2024-09-06T14:45:01.014 INFO:tasks.workunit.client.0.smithi052.stdout:0/755: unlink d0/fe 0 2024-09-06T14:45:01.016 INFO:tasks.workunit.client.0.smithi052.stdout:7/738: getdents d11/d1c/d3f/d73/dae 0 2024-09-06T14:45:01.017 INFO:tasks.workunit.client.0.smithi052.stdout:1/849: sync 2024-09-06T14:45:01.017 INFO:tasks.workunit.client.0.smithi052.stdout:5/888: sync 2024-09-06T14:45:01.017 INFO:tasks.workunit.client.0.smithi052.stdout:9/734: sync 2024-09-06T14:45:01.019 INFO:tasks.workunit.client.0.smithi052.stdout:2/789: symlink da/d19/d3a/dc4/lfc 0 2024-09-06T14:45:01.019 INFO:tasks.workunit.client.0.smithi052.stdout:9/735: write d1/d4/d6/dd/f5f [1193971,106463] 0 2024-09-06T14:45:01.020 INFO:tasks.workunit.client.0.smithi052.stdout:0/756: mkdir d0/d1a/d26/d3a/d7a/d10f 0 2024-09-06T14:45:01.021 INFO:tasks.workunit.client.0.smithi052.stdout:0/757: dread - d0/d18/dd6/f107 zero size 2024-09-06T14:45:01.022 INFO:tasks.workunit.client.0.smithi052.stdout:0/758: readlink d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/l6d 0 2024-09-06T14:45:01.025 INFO:tasks.workunit.client.0.smithi052.stdout:1/850: write d1/db/fb3 [3861937,22419] 0 2024-09-06T14:45:01.029 INFO:tasks.workunit.client.0.smithi052.stdout:3/838: write d0/d11/d12/f47 [416622,58526] 0 2024-09-06T14:45:01.030 INFO:tasks.workunit.client.0.smithi052.stdout:5/889: rmdir d2/d1a/d22 39 2024-09-06T14:45:01.033 INFO:tasks.workunit.client.0.smithi052.stdout:0/759: creat d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/f110 x:0 0 0 2024-09-06T14:45:01.035 INFO:tasks.workunit.client.0.smithi052.stdout:0/760: write d0/d3d/f99 [2334636,49729] 0 2024-09-06T14:45:01.035 INFO:tasks.workunit.client.0.smithi052.stdout:9/736: dread d1/d4/d6/f35 [0,4194304] 0 2024-09-06T14:45:01.036 INFO:tasks.workunit.client.0.smithi052.stdout:3/839: fsync d0/d11/d12/d4c/d93/f3e 0 2024-09-06T14:45:01.039 INFO:tasks.workunit.client.0.smithi052.stdout:2/790: dwrite da/d19/d3a/d31/d76/d6a/f9c [0,4194304] 0 2024-09-06T14:45:01.042 INFO:tasks.workunit.client.0.smithi052.stdout:1/851: getdents d1/db/d72/d112 0 2024-09-06T14:45:01.044 INFO:tasks.workunit.client.0.smithi052.stdout:5/890: mknod d2/d1a/c12f 0 2024-09-06T14:45:01.044 INFO:tasks.workunit.client.0.smithi052.stdout:1/852: write d1/db/d18/d5c/fee [2725942,129094] 0 2024-09-06T14:45:01.046 INFO:tasks.workunit.client.0.smithi052.stdout:7/739: dread d11/d1c/d24/d64/faf [0,4194304] 0 2024-09-06T14:45:01.052 INFO:tasks.workunit.client.0.smithi052.stdout:0/761: rename d0/d1a/d26/d3a/d14/f3e to d0/d1a/d26/d3a/d14/d2d/de2/f111 0 2024-09-06T14:45:01.053 INFO:tasks.workunit.client.0.smithi052.stdout:0/762: stat d0/d1a/d26/d3a/d14/d20/d22/f4a 0 2024-09-06T14:45:01.055 INFO:tasks.workunit.client.0.smithi052.stdout:5/891: fsync d2/d20/d42/fef 0 2024-09-06T14:45:01.057 INFO:tasks.workunit.client.0.smithi052.stdout:3/840: write d0/d11/d71/d98/d1b/d85/fdf [528662,5631] 0 2024-09-06T14:45:01.058 INFO:tasks.workunit.client.0.smithi052.stdout:1/853: symlink d1/db/d50/da4/l12b 0 2024-09-06T14:45:01.059 INFO:tasks.workunit.client.0.smithi052.stdout:1/854: readlink d1/d5f/l128 0 2024-09-06T14:45:01.061 INFO:tasks.workunit.client.0.smithi052.stdout:9/737: dwrite d1/d4/d6/dc/d10/d18/f74 [0,4194304] 0 2024-09-06T14:45:01.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/855: write d1/db/d50/f5e [3999,75903] 0 2024-09-06T14:45:01.064 INFO:tasks.workunit.client.0.smithi052.stdout:9/738: write d1/d4/d6/dc/d10/d18/d82/dda/fd4 [437047,115446] 0 2024-09-06T14:45:01.068 INFO:tasks.workunit.client.0.smithi052.stdout:7/740: symlink d11/d1c/d57/leb 0 2024-09-06T14:45:01.069 INFO:tasks.workunit.client.0.smithi052.stdout:2/791: link da/c4b da/db9/cfd 0 2024-09-06T14:45:01.075 INFO:tasks.workunit.client.0.smithi052.stdout:0/763: write d0/d1a/d26/d3a/d14/d20/d22/d41/d8a/fc3 [708879,73554] 0 2024-09-06T14:45:01.075 INFO:tasks.workunit.client.0.smithi052.stdout:3/841: dread d0/d11/d12/d4c/d93/d35/d46/d5b/f7e [0,4194304] 0 2024-09-06T14:45:01.077 INFO:tasks.workunit.client.0.smithi052.stdout:0/764: write d0/d1a/daa/ff9 [86607,41258] 0 2024-09-06T14:45:01.077 INFO:tasks.workunit.client.0.smithi052.stdout:1/856: mknod d1/db/de/d74/d36/daa/c12c 0 2024-09-06T14:45:01.079 INFO:tasks.workunit.client.0.smithi052.stdout:1/857: stat d1/db/de/d74/d14/d2e/f42 0 2024-09-06T14:45:01.082 INFO:tasks.workunit.client.0.smithi052.stdout:2/792: fdatasync da/db/d46/d55/de6/d70/f85 0 2024-09-06T14:45:01.087 INFO:tasks.workunit.client.0.smithi052.stdout:3/842: write d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb/fc0 [368141,67001] 0 2024-09-06T14:45:01.089 INFO:tasks.workunit.client.0.smithi052.stdout:1/858: symlink d1/db/de/d74/d14/d2e/dc6/l12d 0 2024-09-06T14:45:01.090 INFO:tasks.workunit.client.0.smithi052.stdout:3/843: truncate d0/d11/d12/d4c/d93/d35/d46/d5b/fa3 763246 0 2024-09-06T14:45:01.092 INFO:tasks.workunit.client.0.smithi052.stdout:9/739: mknod d1/d4/d6/dc/d38/d5a/da0/ce4 0 2024-09-06T14:45:01.094 INFO:tasks.workunit.client.0.smithi052.stdout:7/741: mknod d11/cec 0 2024-09-06T14:45:01.096 INFO:tasks.workunit.client.0.smithi052.stdout:5/892: write d2/d1a/d22/f7a [1144785,66835] 0 2024-09-06T14:45:01.105 INFO:tasks.workunit.client.0.smithi052.stdout:5/893: dwrite d2/d1a/d22/d26/d62/f11c [0,4194304] 0 2024-09-06T14:45:01.108 INFO:tasks.workunit.client.0.smithi052.stdout:0/765: write d0/d19/fa8 [4598815,108748] 0 2024-09-06T14:45:01.112 INFO:tasks.workunit.client.0.smithi052.stdout:9/740: unlink d1/d4/d6/dd/d22/f40 0 2024-09-06T14:45:01.115 INFO:tasks.workunit.client.0.smithi052.stdout:5/894: write d2/d1a/d22/d26/d2b/d37/f12b [216507,22976] 0 2024-09-06T14:45:01.118 INFO:tasks.workunit.client.0.smithi052.stdout:3/844: dwrite d0/d11/d12/d4c/d93/d35/d46/d5b/fb3 [0,4194304] 0 2024-09-06T14:45:01.122 INFO:tasks.workunit.client.0.smithi052.stdout:7/742: dwrite d11/d1c/d26/f4d [0,4194304] 0 2024-09-06T14:45:01.123 INFO:tasks.workunit.client.0.smithi052.stdout:0/766: mknod d0/d1a/d8e/c112 0 2024-09-06T14:45:01.124 INFO:tasks.workunit.client.0.smithi052.stdout:2/793: link da/db/l10 da/d2d/d34/lfe 0 2024-09-06T14:45:01.127 INFO:tasks.workunit.client.0.smithi052.stdout:1/859: dread d1/db/de/d74/d14/f28 [0,4194304] 0 2024-09-06T14:45:01.131 INFO:tasks.workunit.client.0.smithi052.stdout:5/895: chown d2/d1a/d22/d26/d2b/d48/d64/c11b 6422 1 2024-09-06T14:45:01.132 INFO:tasks.workunit.client.0.smithi052.stdout:0/767: dwrite d0/d4f/d7d/f76 [0,4194304] 0 2024-09-06T14:45:01.145 INFO:tasks.workunit.client.0.smithi052.stdout:5/896: rename d2/d1a/d22/d26/l36 to d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/d11d/l130 0 2024-09-06T14:45:01.146 INFO:tasks.workunit.client.0.smithi052.stdout:2/794: creat da/db/d46/fff x:0 0 0 2024-09-06T14:45:01.148 INFO:tasks.workunit.client.0.smithi052.stdout:1/860: creat d1/f12e x:0 0 0 2024-09-06T14:45:01.148 INFO:tasks.workunit.client.0.smithi052.stdout:2/795: stat da/d19/d3a/d61/d7b 0 2024-09-06T14:45:01.150 INFO:tasks.workunit.client.0.smithi052.stdout:2/796: mknod da/d54/c100 0 2024-09-06T14:45:01.151 INFO:tasks.workunit.client.0.smithi052.stdout:5/897: fsync d2/d1a/d22/f45 0 2024-09-06T14:45:01.152 INFO:tasks.workunit.client.0.smithi052.stdout:1/861: read - d1/db/de/d74/d14/d9f/dcc/fe3 zero size 2024-09-06T14:45:01.154 INFO:tasks.workunit.client.0.smithi052.stdout:2/797: creat da/db9/deb/f101 x:0 0 0 2024-09-06T14:45:01.156 INFO:tasks.workunit.client.0.smithi052.stdout:1/862: unlink d1/db/de/d74/d14/d9f/dcc/d47/d4a/c55 0 2024-09-06T14:45:01.157 INFO:tasks.workunit.client.0.smithi052.stdout:2/798: creat da/d19/d3a/d31/d7a/dbd/dc6/f102 x:0 0 0 2024-09-06T14:45:01.160 INFO:tasks.workunit.client.0.smithi052.stdout:1/863: dread - d1/db/de/d74/d14/dd1/fec zero size 2024-09-06T14:45:01.160 INFO:tasks.workunit.client.0.smithi052.stdout:9/741: truncate d1/d4/f7 3000653 0 2024-09-06T14:45:01.163 INFO:tasks.workunit.client.0.smithi052.stdout:7/743: write d11/d1c/d24/d4b/f9b [40688,98470] 0 2024-09-06T14:45:01.163 INFO:tasks.workunit.client.0.smithi052.stdout:7/744: fsync d11/fda 0 2024-09-06T14:45:01.165 INFO:tasks.workunit.client.0.smithi052.stdout:2/799: link da/db/d46/d55/de6/d70/fa6 da/d19/d3a/d61/d7b/f103 0 2024-09-06T14:45:01.166 INFO:tasks.workunit.client.0.smithi052.stdout:9/742: truncate d1/d4/df/d56/f7c 794256 0 2024-09-06T14:45:01.168 INFO:tasks.workunit.client.0.smithi052.stdout:1/864: mkdir d1/db/d76/d12f 0 2024-09-06T14:45:01.170 INFO:tasks.workunit.client.0.smithi052.stdout:0/768: dwrite d0/d1a/d26/d3a/d14/d20/f48 [0,4194304] 0 2024-09-06T14:45:01.179 INFO:tasks.workunit.client.0.smithi052.stdout:0/769: dwrite d0/d19/fa8 [0,4194304] 0 2024-09-06T14:45:01.184 INFO:tasks.workunit.client.0.smithi052.stdout:7/745: rename d11/d1c/d24/c5b to d11/d1c/d24/d3b/d50/ced 0 2024-09-06T14:45:01.185 INFO:tasks.workunit.client.0.smithi052.stdout:7/746: readlink d11/d1c/d3f/d5d/l83 0 2024-09-06T14:45:01.186 INFO:tasks.workunit.client.0.smithi052.stdout:7/747: chown d11/d1c/d57/d89/la0 24 1 2024-09-06T14:45:01.192 INFO:tasks.workunit.client.0.smithi052.stdout:9/743: unlink d1/d26/d41/d7e/c51 0 2024-09-06T14:45:01.193 INFO:tasks.workunit.client.0.smithi052.stdout:5/898: unlink d2/d1a/d22/d26/d2b/d37/d6a/fe6 0 2024-09-06T14:45:01.194 INFO:tasks.workunit.client.0.smithi052.stdout:2/800: write da/db/f45 [3428220,68842] 0 2024-09-06T14:45:01.195 INFO:tasks.workunit.client.0.smithi052.stdout:0/770: rmdir d0/d1a/d26/d3a/d14/d2d/d94/dda 39 2024-09-06T14:45:01.202 INFO:tasks.workunit.client.0.smithi052.stdout:5/899: fsync d2/d20/f5e 0 2024-09-06T14:45:01.205 INFO:tasks.workunit.client.0.smithi052.stdout:7/748: write d11/d1c/d57/f9f [1010661,5699] 0 2024-09-06T14:45:01.208 INFO:tasks.workunit.client.0.smithi052.stdout:1/865: getdents d1/db/de/d74/d36 0 2024-09-06T14:45:01.209 INFO:tasks.workunit.client.0.smithi052.stdout:5/900: mknod d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/d11d/d125/c131 0 2024-09-06T14:45:01.209 INFO:tasks.workunit.client.0.smithi052.stdout:5/901: readlink d2/l9 0 2024-09-06T14:45:01.211 INFO:tasks.workunit.client.0.smithi052.stdout:0/771: symlink d0/d1a/d26/d3a/d14/d2d/d94/dda/l113 0 2024-09-06T14:45:01.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/866: dread d1/db/de/d74/ff2 [0,4194304] 0 2024-09-06T14:45:01.214 INFO:tasks.workunit.client.0.smithi052.stdout:5/902: mknod d2/d1a/df4/c132 0 2024-09-06T14:45:01.218 INFO:tasks.workunit.client.0.smithi052.stdout:0/772: mknod d0/d1a/d26/d3a/d14/d2d/de2/c114 0 2024-09-06T14:45:01.224 INFO:tasks.workunit.client.0.smithi052.stdout:7/749: rename d11/d1c/fdb to d11/d1c/d3f/fee 0 2024-09-06T14:45:01.225 INFO:tasks.workunit.client.0.smithi052.stdout:5/903: dread d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/fc1 [0,4194304] 0 2024-09-06T14:45:01.226 INFO:tasks.workunit.client.0.smithi052.stdout:5/904: chown d2/d1a/f2d 22 1 2024-09-06T14:45:01.227 INFO:tasks.workunit.client.0.smithi052.stdout:5/905: chown d2/d1a/df4/ff7 5 1 2024-09-06T14:45:01.228 INFO:tasks.workunit.client.0.smithi052.stdout:1/867: write d1/fc8 [769946,96592] 0 2024-09-06T14:45:01.228 INFO:tasks.workunit.client.0.smithi052.stdout:5/906: fdatasync d2/d20/d42/d8b/dca/f101 0 2024-09-06T14:45:01.229 INFO:tasks.workunit.client.0.smithi052.stdout:0/773: unlink d0/d1a/d26/d3a/d14/cb9 0 2024-09-06T14:45:01.230 INFO:tasks.workunit.client.0.smithi052.stdout:0/774: readlink d0/d1a/d26/d3a/d14/l66 0 2024-09-06T14:45:01.232 INFO:tasks.workunit.client.0.smithi052.stdout:5/907: truncate d2/d1a/d22/d26/d2b/d37/f103 696275 0 2024-09-06T14:45:01.236 INFO:tasks.workunit.client.0.smithi052.stdout:7/750: dread d11/d1c/d26/f94 [0,4194304] 0 2024-09-06T14:45:01.237 INFO:tasks.workunit.client.0.smithi052.stdout:7/751: fsync d11/d1c/d24/dca/fd6 0 2024-09-06T14:45:01.241 INFO:tasks.workunit.client.0.smithi052.stdout:1/868: dread d1/db/d18/d5c/fee [0,4194304] 0 2024-09-06T14:45:01.260 INFO:tasks.workunit.client.0.smithi052.stdout:9/744: read d1/d4/f7 [1260354,115682] 0 2024-09-06T14:45:01.263 INFO:tasks.workunit.client.0.smithi052.stdout:0/775: creat d0/d1a/d26/d3a/f115 x:0 0 0 2024-09-06T14:45:01.265 INFO:tasks.workunit.client.0.smithi052.stdout:7/752: fdatasync d11/d1c/d3f/fd8 0 2024-09-06T14:45:01.274 INFO:tasks.workunit.client.0.smithi052.stdout:9/745: creat d1/d26/d3d/da8/fe5 x:0 0 0 2024-09-06T14:45:01.275 INFO:tasks.workunit.client.0.smithi052.stdout:9/746: chown d1/d26/d41 686182 1 2024-09-06T14:45:01.275 INFO:tasks.workunit.client.0.smithi052.stdout:0/776: unlink d0/d19/d29/f91 0 2024-09-06T14:45:01.277 INFO:tasks.workunit.client.0.smithi052.stdout:5/908: creat d2/d1a/d22/d26/f133 x:0 0 0 2024-09-06T14:45:01.280 INFO:tasks.workunit.client.0.smithi052.stdout:1/869: link d1/db/de/d74/d14/d2e/f42 d1/db/de/d74/d14/d2e/dc6/f130 0 2024-09-06T14:45:01.283 INFO:tasks.workunit.client.0.smithi052.stdout:9/747: dwrite d1/d4/d6/dd/f13 [0,4194304] 0 2024-09-06T14:45:01.284 INFO:tasks.workunit.client.0.smithi052.stdout:0/777: dwrite d0/d1a/d26/d3a/d14/d2d/de2/fe5 [0,4194304] 0 2024-09-06T14:45:01.288 INFO:tasks.workunit.client.0.smithi052.stdout:0/778: dread d0/d4f/d7d/f76 [0,4194304] 0 2024-09-06T14:45:01.292 INFO:tasks.workunit.client.0.smithi052.stdout:1/870: unlink d1/db/d18/leb 0 2024-09-06T14:45:01.293 INFO:tasks.workunit.client.0.smithi052.stdout:1/871: dread - d1/db/de/d74/d36/d9b/f105 zero size 2024-09-06T14:45:01.294 INFO:tasks.workunit.client.0.smithi052.stdout:9/748: mkdir d1/d26/d3d/de6 0 2024-09-06T14:45:01.295 INFO:tasks.workunit.client.0.smithi052.stdout:1/872: chown d1/db/d50/da4/le7 10 1 2024-09-06T14:45:01.296 INFO:tasks.workunit.client.0.smithi052.stdout:0/779: dread d0/d1a/d26/d3a/d14/d2d/fa9 [0,4194304] 0 2024-09-06T14:45:01.296 INFO:tasks.workunit.client.0.smithi052.stdout:1/873: dread - d1/db/de/d74/d14/d9f/dcc/f8c zero size 2024-09-06T14:45:01.297 INFO:tasks.workunit.client.0.smithi052.stdout:0/780: write d0/d2e/fcb [1458184,67638] 0 2024-09-06T14:45:01.298 INFO:tasks.workunit.client.0.smithi052.stdout:6/637: sync 2024-09-06T14:45:01.299 INFO:tasks.workunit.client.0.smithi052.stdout:5/909: unlink d2/d1a/d22/d26/d62/fb2 0 2024-09-06T14:45:01.304 INFO:tasks.workunit.client.0.smithi052.stdout:1/874: mknod d1/db/de/d74/d36/c131 0 2024-09-06T14:45:01.305 INFO:tasks.workunit.client.0.smithi052.stdout:6/638: creat d2/d4a/fd1 x:0 0 0 2024-09-06T14:45:01.309 INFO:tasks.workunit.client.0.smithi052.stdout:7/753: dwrite d11/d1c/d24/d64/faf [0,4194304] 0 2024-09-06T14:45:01.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/639: chown d2/dd/d18/d25/d4c/l57 26163 1 2024-09-06T14:45:01.310 INFO:tasks.workunit.client.0.smithi052.stdout:5/910: chown d2/lc3 1070854 1 2024-09-06T14:45:01.310 INFO:tasks.workunit.client.0.smithi052.stdout:6/640: chown d2/dd/d18/d25/caf 22 1 2024-09-06T14:45:01.312 INFO:tasks.workunit.client.0.smithi052.stdout:9/749: creat d1/d4/d6/dd1/dd9/dc2/fe7 x:0 0 0 2024-09-06T14:45:01.316 INFO:tasks.workunit.client.0.smithi052.stdout:7/754: truncate d11/d1c/d24/d4b/da2/fc3 907545 0 2024-09-06T14:45:01.323 INFO:tasks.workunit.client.0.smithi052.stdout:5/911: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/ffe [0,4194304] 0 2024-09-06T14:45:01.328 INFO:tasks.workunit.client.0.smithi052.stdout:5/912: dread d2/fee [0,4194304] 0 2024-09-06T14:45:01.331 INFO:tasks.workunit.client.0.smithi052.stdout:7/755: rename d11/d1c/d24/d4b/l96 to d11/d1c/d24/d4b/lef 0 2024-09-06T14:45:01.332 INFO:tasks.workunit.client.0.smithi052.stdout:9/750: getdents d1/d4/d6/dc/d10/d73/da9 0 2024-09-06T14:45:01.337 INFO:tasks.workunit.client.0.smithi052.stdout:1/875: dread d1/db/de/d74/d12/f1e [0,4194304] 0 2024-09-06T14:45:01.339 INFO:tasks.workunit.client.0.smithi052.stdout:9/751: dread d1/d4/d6/dd/f5f [0,4194304] 0 2024-09-06T14:45:01.341 INFO:tasks.workunit.client.0.smithi052.stdout:5/913: creat d2/d1a/d22/d26/f134 x:0 0 0 2024-09-06T14:45:01.342 INFO:tasks.workunit.client.0.smithi052.stdout:5/914: write d2/d1a/d22/d26/d2b/fa9 [2572272,79421] 0 2024-09-06T14:45:01.344 INFO:tasks.workunit.client.0.smithi052.stdout:7/756: rename d11/d1c/d57/d89/la0 to d11/d1c/d3f/lf0 0 2024-09-06T14:45:01.347 INFO:tasks.workunit.client.0.smithi052.stdout:5/915: dread - d2/d20/d42/d65/ff2 zero size 2024-09-06T14:45:01.348 INFO:tasks.workunit.client.0.smithi052.stdout:9/752: mkdir d1/d4/d6/dd/de8 0 2024-09-06T14:45:01.349 INFO:tasks.workunit.client.0.smithi052.stdout:1/876: link d1/d5f/fc0 d1/db/de/d68/df3/f132 0 2024-09-06T14:45:01.350 INFO:tasks.workunit.client.0.smithi052.stdout:5/916: fsync d2/d1a/d22/d26/d2b/d37/faf 0 2024-09-06T14:45:01.350 INFO:tasks.workunit.client.0.smithi052.stdout:6/641: dread d2/dd/d18/d25/f87 [0,4194304] 0 2024-09-06T14:45:01.353 INFO:tasks.workunit.client.0.smithi052.stdout:6/642: symlink d2/dd/d5e/ld2 0 2024-09-06T14:45:01.358 INFO:tasks.workunit.client.0.smithi052.stdout:6/643: fdatasync d2/dd/d18/d25/f2c 0 2024-09-06T14:45:01.358 INFO:tasks.workunit.client.0.smithi052.stdout:1/877: dwrite d1/f12e [0,4194304] 0 2024-09-06T14:45:01.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/753: dwrite d1/d4/d6/dc/d10/d18/f33 [4194304,4194304] 0 2024-09-06T14:45:01.443 INFO:tasks.workunit.client.0.smithi052.stdout:6/644: fdatasync d2/dd/d18/d2d/f46 0 2024-09-06T14:45:01.444 INFO:tasks.workunit.client.0.smithi052.stdout:9/754: chown d1/d4/df/f59 12012904 1 2024-09-06T14:45:01.444 INFO:tasks.workunit.client.0.smithi052.stdout:1/878: fsync d1/db/d18/f92 0 2024-09-06T14:45:01.445 INFO:tasks.workunit.client.0.smithi052.stdout:9/755: truncate d1/d4/fb8 905602 0 2024-09-06T14:45:01.450 INFO:tasks.workunit.client.0.smithi052.stdout:5/917: truncate d2/d1a/d22/d26/d2b/d48/fea 7197930 0 2024-09-06T14:45:01.450 INFO:tasks.workunit.client.0.smithi052.stdout:5/918: stat d2/d1a/ddb 0 2024-09-06T14:45:01.452 INFO:tasks.workunit.client.0.smithi052.stdout:9/756: rmdir d1/d26 39 2024-09-06T14:45:01.453 INFO:tasks.workunit.client.0.smithi052.stdout:1/879: unlink d1/d5f/lf9 0 2024-09-06T14:45:01.454 INFO:tasks.workunit.client.0.smithi052.stdout:1/880: truncate d1/db/d76/f123 797999 0 2024-09-06T14:45:01.456 INFO:tasks.workunit.client.0.smithi052.stdout:6/645: symlink d2/dd/d18/d33/d44/ld3 0 2024-09-06T14:45:01.459 INFO:tasks.workunit.client.0.smithi052.stdout:1/881: creat d1/db/de/d68/df3/f133 x:0 0 0 2024-09-06T14:45:01.460 INFO:tasks.workunit.client.0.smithi052.stdout:5/919: mkdir d2/d1a/d135 0 2024-09-06T14:45:01.461 INFO:tasks.workunit.client.0.smithi052.stdout:6/646: unlink d2/dd/d18/d4b/f53 0 2024-09-06T14:45:01.461 INFO:tasks.workunit.client.0.smithi052.stdout:5/920: truncate d2/d1a/d22/d26/f134 578395 0 2024-09-06T14:45:01.464 INFO:tasks.workunit.client.0.smithi052.stdout:9/757: write d1/d4/d6/dc/d10/d18/d82/dda/fd4 [67004,72123] 0 2024-09-06T14:45:01.465 INFO:tasks.workunit.client.0.smithi052.stdout:9/758: chown d1/d4/d6/dd1/dd9/fe2 13 1 2024-09-06T14:45:01.466 INFO:tasks.workunit.client.0.smithi052.stdout:5/921: rename d2/d20/d42/c60 to d2/d1a/d22/d26/d62/c136 0 2024-09-06T14:45:01.468 INFO:tasks.workunit.client.0.smithi052.stdout:9/759: mkdir d1/d4/d6/dd/de8/de9 0 2024-09-06T14:45:01.470 INFO:tasks.workunit.client.0.smithi052.stdout:5/922: mknod d2/d20/d42/d8b/dca/d10a/d129/c137 0 2024-09-06T14:45:01.471 INFO:tasks.workunit.client.0.smithi052.stdout:5/923: readlink d2/d20/d42/d65/l8c 0 2024-09-06T14:45:01.472 INFO:tasks.workunit.client.0.smithi052.stdout:9/760: creat d1/d4/d4b/fea x:0 0 0 2024-09-06T14:45:01.473 INFO:tasks.workunit.client.0.smithi052.stdout:6/647: dread d2/dd/d18/f88 [0,4194304] 0 2024-09-06T14:45:01.474 INFO:tasks.workunit.client.0.smithi052.stdout:6/648: read - d2/d4a/fd1 zero size 2024-09-06T14:45:01.477 INFO:tasks.workunit.client.0.smithi052.stdout:6/649: mkdir d2/d4a/d6e/d76/dd4 0 2024-09-06T14:45:01.478 INFO:tasks.workunit.client.0.smithi052.stdout:5/924: creat d2/d1a/d22/d26/d2b/d37/d84/f138 x:0 0 0 2024-09-06T14:45:01.479 INFO:tasks.workunit.client.0.smithi052.stdout:9/761: getdents d1/d4/df/d56 0 2024-09-06T14:45:01.481 INFO:tasks.workunit.client.0.smithi052.stdout:5/925: truncate d2/d20/d42/d65/fda 4960276 0 2024-09-06T14:45:01.483 INFO:tasks.workunit.client.0.smithi052.stdout:9/762: mkdir d1/d4/d6/dc/d10/dbe/deb 0 2024-09-06T14:45:01.484 INFO:tasks.workunit.client.0.smithi052.stdout:6/650: dwrite d2/d4a/d6e/fb8 [0,4194304] 0 2024-09-06T14:45:01.486 INFO:tasks.workunit.client.0.smithi052.stdout:5/926: creat d2/d1a/d22/f139 x:0 0 0 2024-09-06T14:45:01.486 INFO:tasks.workunit.client.0.smithi052.stdout:9/763: read - d1/d26/f95 zero size 2024-09-06T14:45:01.487 INFO:tasks.workunit.client.0.smithi052.stdout:6/651: rmdir d2/d4a 39 2024-09-06T14:45:01.487 INFO:tasks.workunit.client.0.smithi052.stdout:5/927: write d2/d20/d42/d65/f55 [4154286,12261] 0 2024-09-06T14:45:01.489 INFO:tasks.workunit.client.0.smithi052.stdout:9/764: truncate d1/d4/d6/dc/d38/fb3 4626626 0 2024-09-06T14:45:01.491 INFO:tasks.workunit.client.0.smithi052.stdout:9/765: fdatasync d1/d4/d6/dc/d10/f80 0 2024-09-06T14:45:01.504 INFO:tasks.workunit.client.0.smithi052.stdout:9/766: mkdir d1/d4/d6/dc/d10/dec 0 2024-09-06T14:45:01.518 INFO:tasks.workunit.client.0.smithi052.stdout:9/767: dread d1/d4/df/d56/f86 [0,4194304] 0 2024-09-06T14:45:01.520 INFO:tasks.workunit.client.0.smithi052.stdout:9/768: write d1/d4/d6/dd/d22/fcf [991051,50871] 0 2024-09-06T14:45:01.522 INFO:tasks.workunit.client.0.smithi052.stdout:5/928: dwrite d2/d1a/d22/d26/d2b/f94 [0,4194304] 0 2024-09-06T14:45:01.528 INFO:tasks.workunit.client.0.smithi052.stdout:5/929: mknod d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/d108/c13a 0 2024-09-06T14:45:01.530 INFO:tasks.workunit.client.0.smithi052.stdout:9/769: creat d1/d26/fed x:0 0 0 2024-09-06T14:45:01.533 INFO:tasks.workunit.client.0.smithi052.stdout:5/930: rename d2/d1a/d22/d26/f85 to d2/d20/d42/d65/f13b 0 2024-09-06T14:45:01.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/770: creat d1/d26/d41/d7e/fee x:0 0 0 2024-09-06T14:45:01.536 INFO:tasks.workunit.client.0.smithi052.stdout:9/771: fdatasync d1/d4/d6/f35 0 2024-09-06T14:45:01.541 INFO:tasks.workunit.client.0.smithi052.stdout:9/772: read d1/d26/d3d/f94 [330175,106139] 0 2024-09-06T14:45:01.562 INFO:tasks.workunit.client.0.smithi052.stdout:5/931: write d2/d20/d42/d65/ff2 [469018,32311] 0 2024-09-06T14:45:01.562 INFO:tasks.workunit.client.0.smithi052.stdout:9/773: write d1/d4/d6/f35 [22403,80433] 0 2024-09-06T14:45:01.564 INFO:tasks.workunit.client.0.smithi052.stdout:9/774: dread d1/d4/d6/f35 [0,4194304] 0 2024-09-06T14:45:01.564 INFO:tasks.workunit.client.0.smithi052.stdout:5/932: read d2/d20/d42/d8b/fab [274820,17386] 0 2024-09-06T14:45:01.565 INFO:tasks.workunit.client.0.smithi052.stdout:9/775: dread - d1/d4/d6/dd1/dd9/fe2 zero size 2024-09-06T14:45:01.568 INFO:tasks.workunit.client.0.smithi052.stdout:5/933: fdatasync d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/fa1 0 2024-09-06T14:45:01.574 INFO:tasks.workunit.client.0.smithi052.stdout:5/934: dread d2/d1a/d22/f45 [0,4194304] 0 2024-09-06T14:45:01.577 INFO:tasks.workunit.client.0.smithi052.stdout:9/776: write d1/d26/d41/f67 [1595664,60646] 0 2024-09-06T14:45:01.578 INFO:tasks.workunit.client.0.smithi052.stdout:9/777: dread - d1/d26/f95 zero size 2024-09-06T14:45:01.581 INFO:tasks.workunit.client.0.smithi052.stdout:5/935: write d2/d20/d56/fec [63758,66152] 0 2024-09-06T14:45:01.582 INFO:tasks.workunit.client.0.smithi052.stdout:9/778: creat d1/d4/d6/dd/de8/de9/fef x:0 0 0 2024-09-06T14:45:01.585 INFO:tasks.workunit.client.0.smithi052.stdout:9/779: creat d1/d4/d6/dc/d10/d73/ff0 x:0 0 0 2024-09-06T14:45:01.585 INFO:tasks.workunit.client.0.smithi052.stdout:5/936: dread d2/d1a/d22/d26/d2b/f94 [0,4194304] 0 2024-09-06T14:45:01.585 INFO:tasks.workunit.client.0.smithi052.stdout:9/780: stat d1/d26/lbb 0 2024-09-06T14:45:01.586 INFO:tasks.workunit.client.0.smithi052.stdout:4/788: sync 2024-09-06T14:45:01.587 INFO:tasks.workunit.client.0.smithi052.stdout:9/781: write d1/d4/d6/dc/d10/d73/da9/fcd [3158758,86579] 0 2024-09-06T14:45:01.592 INFO:tasks.workunit.client.0.smithi052.stdout:9/782: getdents d1/d4/d6/dd/de8 0 2024-09-06T14:45:01.595 INFO:tasks.workunit.client.0.smithi052.stdout:9/783: creat d1/d4/d6/ff1 x:0 0 0 2024-09-06T14:45:01.597 INFO:tasks.workunit.client.0.smithi052.stdout:5/937: dread d2/d20/d42/d8b/fab [0,4194304] 0 2024-09-06T14:45:01.597 INFO:tasks.workunit.client.0.smithi052.stdout:9/784: write d1/d4/d6/dc/d10/d18/fb7 [977184,50207] 0 2024-09-06T14:45:01.605 INFO:tasks.workunit.client.0.smithi052.stdout:9/785: rename d1/d26/d41/d7e/fee to d1/d4/d6/dd1/dd9/dc2/ff2 0 2024-09-06T14:45:01.606 INFO:tasks.workunit.client.0.smithi052.stdout:9/786: chown d1/d4/d6/dc/d38/d5a/faf 21 1 2024-09-06T14:45:01.614 INFO:tasks.workunit.client.0.smithi052.stdout:9/787: dwrite d1/d4/df/d56/fdb [0,4194304] 0 2024-09-06T14:45:01.615 INFO:tasks.workunit.client.0.smithi052.stdout:9/788: chown d1/d4/f7 16110 1 2024-09-06T14:45:01.621 INFO:tasks.workunit.client.0.smithi052.stdout:5/938: dwrite d2/d1a/d22/f9f [0,4194304] 0 2024-09-06T14:45:01.623 INFO:tasks.workunit.client.0.smithi052.stdout:5/939: write d2/d20/d56/f95 [1314251,110538] 0 2024-09-06T14:45:01.623 INFO:tasks.workunit.client.0.smithi052.stdout:9/789: write d1/d4/f7 [2559956,31848] 0 2024-09-06T14:45:01.626 INFO:tasks.workunit.client.0.smithi052.stdout:5/940: write d2/d1a/d22/d26/d62/f72 [29445,94699] 0 2024-09-06T14:45:01.629 INFO:tasks.workunit.client.0.smithi052.stdout:9/790: rename d1/d4/d4b to d1/d4/d6/dc/d10/d18/d82/da6/dcb/df3 0 2024-09-06T14:45:01.632 INFO:tasks.workunit.client.0.smithi052.stdout:5/941: unlink d2/d1a/d22/d26/d2b/d48/d64/dbf/f71 0 2024-09-06T14:45:01.633 INFO:tasks.workunit.client.0.smithi052.stdout:5/942: write d2/d1a/d22/d26/f134 [199500,120435] 0 2024-09-06T14:45:01.634 INFO:tasks.workunit.client.0.smithi052.stdout:9/791: symlink d1/d4/df/lf4 0 2024-09-06T14:45:01.638 INFO:tasks.workunit.client.0.smithi052.stdout:9/792: write d1/d4/d6/dd1/dd9/dc2/ff2 [726350,114169] 0 2024-09-06T14:45:01.642 INFO:tasks.workunit.client.0.smithi052.stdout:9/793: symlink d1/d4/d6/dd/da2/lf5 0 2024-09-06T14:45:01.643 INFO:tasks.workunit.client.0.smithi052.stdout:5/943: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fcc [0,4194304] 0 2024-09-06T14:45:01.648 INFO:tasks.workunit.client.0.smithi052.stdout:9/794: mkdir d1/d4/d6/dc/d10/d18/d9f/df6 0 2024-09-06T14:45:01.648 INFO:tasks.workunit.client.0.smithi052.stdout:5/944: truncate d2/d1a/d22/d26/d2b/d37/d6a/fcd 1024357 0 2024-09-06T14:45:01.649 INFO:tasks.workunit.client.0.smithi052.stdout:9/795: chown d1/d4/d6/dc/d38/d5a/da0 471374105 1 2024-09-06T14:45:01.650 INFO:tasks.workunit.client.0.smithi052.stdout:5/945: readlink d2/d20/lc9 0 2024-09-06T14:45:01.652 INFO:tasks.workunit.client.0.smithi052.stdout:9/796: mknod d1/d4/d6/cf7 0 2024-09-06T14:45:01.653 INFO:tasks.workunit.client.0.smithi052.stdout:5/946: symlink d2/d1a/d135/l13c 0 2024-09-06T14:45:01.657 INFO:tasks.workunit.client.0.smithi052.stdout:5/947: rename d2/d1a/d22/d26/d62/c9a to d2/d1a/d22/d26/d2b/d48/d64/dff/c13d 0 2024-09-06T14:45:01.662 INFO:tasks.workunit.client.0.smithi052.stdout:5/948: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/f10f [0,4194304] 0 2024-09-06T14:45:01.678 INFO:tasks.workunit.client.0.smithi052.stdout:5/949: dread d2/d1a/d22/d26/d2b/d37/d84/d97/fd5 [0,4194304] 0 2024-09-06T14:45:01.679 INFO:tasks.workunit.client.0.smithi052.stdout:5/950: write d2/d1a/ddb/f10e [870903,1300] 0 2024-09-06T14:45:01.689 INFO:tasks.workunit.client.0.smithi052.stdout:5/951: getdents d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93 0 2024-09-06T14:45:01.691 INFO:tasks.workunit.client.0.smithi052.stdout:5/952: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/f13e x:0 0 0 2024-09-06T14:45:01.697 INFO:tasks.workunit.client.0.smithi052.stdout:5/953: dwrite d2/d1a/d22/d26/d2b/d37/d6a/f8e [0,4194304] 0 2024-09-06T14:45:01.702 INFO:tasks.workunit.client.0.smithi052.stdout:5/954: dwrite d2/d20/f5e [4194304,4194304] 0 2024-09-06T14:45:01.708 INFO:tasks.workunit.client.0.smithi052.stdout:5/955: read d2/d20/d42/f9d [2270231,19174] 0 2024-09-06T14:45:01.710 INFO:tasks.workunit.client.0.smithi052.stdout:5/956: mkdir d2/d20/d42/d65/d13f 0 2024-09-06T14:45:01.712 INFO:tasks.workunit.client.0.smithi052.stdout:5/957: symlink d2/d20/d42/d8b/l140 0 2024-09-06T14:45:01.715 INFO:tasks.workunit.client.0.smithi052.stdout:5/958: getdents d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93 0 2024-09-06T14:45:01.717 INFO:tasks.workunit.client.0.smithi052.stdout:5/959: read d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/dc6/ffc [807402,73525] 0 2024-09-06T14:45:01.730 INFO:tasks.workunit.client.0.smithi052.stdout:5/960: link d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/d11d/l130 d2/l141 0 2024-09-06T14:45:01.732 INFO:tasks.workunit.client.0.smithi052.stdout:5/961: mknod d2/d1a/d22/d26/d2b/d37/d84/dd8/c142 0 2024-09-06T14:45:01.733 INFO:tasks.workunit.client.0.smithi052.stdout:5/962: chown d2/d20/d42/d8b/dca/ld7 160569457 1 2024-09-06T14:45:01.734 INFO:tasks.workunit.client.0.smithi052.stdout:5/963: chown d2/d1a/d22/d26/d2b/d48/d64/dbf/d115/d11d/d125 986620 1 2024-09-06T14:45:01.735 INFO:tasks.workunit.client.0.smithi052.stdout:5/964: rmdir d2/d20/d42/d8b/dca 39 2024-09-06T14:45:01.737 INFO:tasks.workunit.client.0.smithi052.stdout:5/965: mkdir d2/d1a/d22/d26/d62/d143 0 2024-09-06T14:45:01.738 INFO:tasks.workunit.client.0.smithi052.stdout:5/966: write d2/d20/d56/f95 [1005717,59754] 0 2024-09-06T14:45:01.741 INFO:tasks.workunit.client.0.smithi052.stdout:5/967: mkdir d2/d1a/d22/d26/d2b/d48/d64/dbf/d6c/d144 0 2024-09-06T14:45:01.756 INFO:tasks.workunit.client.0.smithi052.stdout:5/968: dread d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/fe1 [0,4194304] 0 2024-09-06T14:45:01.762 INFO:tasks.workunit.client.0.smithi052.stdout:5/969: write d2/f1d [6427865,89138] 0 2024-09-06T14:45:01.765 INFO:tasks.workunit.client.0.smithi052.stdout:5/970: read d2/f38 [632151,20030] 0 2024-09-06T14:45:01.768 INFO:tasks.workunit.client.0.smithi052.stdout:5/971: truncate d2/d1a/d22/d26/d62/fb3 219586 0 2024-09-06T14:45:01.768 INFO:tasks.workunit.client.0.smithi052.stdout:5/972: write d2/d1a/d22/d26/d2b/d37/f12b [979127,94444] 0 2024-09-06T14:45:01.783 INFO:tasks.workunit.client.0.smithi052.stdout:5/973: dwrite d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/d93/fe5 [0,4194304] 0 2024-09-06T14:45:01.935 INFO:tasks.workunit.client.0.smithi052.stdout:5/974: link d2/d1a/d22/d26/d2b/d37/d84/dd8/f11f d2/d20/d42/d65/f145 0 2024-09-06T14:45:01.938 INFO:tasks.workunit.client.0.smithi052.stdout:5/975: mknod d2/d1a/d22/d26/d2b/d37/d84/da7/c146 0 2024-09-06T14:45:01.938 INFO:tasks.workunit.client.0.smithi052.stdout:5/976: chown d2/d1a/d135 486 1 2024-09-06T14:45:01.938 INFO:tasks.workunit.client.0.smithi052.stdout:5/977: stat d2/d20/le3 0 2024-09-06T14:45:01.940 INFO:tasks.workunit.client.0.smithi052.stdout:5/978: truncate d2/d1a/d22/d26/d2b/d37/d84/d97/f100 492004 0 2024-09-06T14:45:01.947 INFO:tasks.workunit.client.0.smithi052.stdout:5/979: unlink d2/d1a/d22/d26/d2b/d48/d64/dff/c13d 0 2024-09-06T14:45:02.084 INFO:tasks.workunit.client.0.smithi052.stdout:3/845: sync 2024-09-06T14:45:02.121 INFO:tasks.workunit.client.0.smithi052.stdout:3/846: mkdir d0/d11/d12/d4c/d93/d35/d46/d67/d104 0 2024-09-06T14:45:02.121 INFO:tasks.workunit.client.0.smithi052.stdout:3/847: chown d0/fd7 185 1 2024-09-06T14:45:02.192 INFO:tasks.workunit.client.0.smithi052.stdout:3/848: rename d0/d11/d12/d4c/d93/d35/d46/d5b/da0/dbb to d0/d11/d71/d98/d1b/d105 0 2024-09-06T14:45:02.193 INFO:tasks.workunit.client.0.smithi052.stdout:3/849: symlink d0/d11/d71/d98/d1b/l106 0 2024-09-06T14:45:02.195 INFO:tasks.workunit.client.0.smithi052.stdout:3/850: creat d0/d11/d12/d4c/d93/d64/f107 x:0 0 0 2024-09-06T14:45:02.199 INFO:tasks.workunit.client.0.smithi052.stdout:3/851: fdatasync d0/d11/d12/d4c/d93/d35/d46/d5b/da0/da6/fc3 0 2024-09-06T14:45:02.204 INFO:tasks.workunit.client.0.smithi052.stdout:3/852: dread d0/d11/d71/d98/d19/f7f [0,4194304] 0 2024-09-06T14:45:02.205 INFO:tasks.workunit.client.0.smithi052.stdout:3/853: stat d0/d11/d12/d4c/d93/d64/f8f 0 2024-09-06T14:45:02.209 INFO:tasks.workunit.client.0.smithi052.stdout:3/854: dread d0/d11/d71/d98/d1b/d105/fe3 [0,4194304] 0 2024-09-06T14:45:02.209 INFO:tasks.workunit.client.0.smithi052.stdout:2/801: sync 2024-09-06T14:45:02.210 INFO:tasks.workunit.client.0.smithi052.stdout:1/882: sync 2024-09-06T14:45:02.213 INFO:tasks.workunit.client.0.smithi052.stdout:3/855: mknod d0/d11/d71/d98/c108 0 2024-09-06T14:45:02.217 INFO:tasks.workunit.client.0.smithi052.stdout:2/802: rename da/db/d46/fe9 to da/db/d46/d55/de6/f104 0 2024-09-06T14:45:02.219 INFO:tasks.workunit.client.0.smithi052.stdout:1/883: dwrite d1/db/de/d74/d14/d9f/fdb [0,4194304] 0 2024-09-06T14:45:02.223 INFO:tasks.workunit.client.0.smithi052.stdout:2/803: truncate da/db/d18/f3c 1826636 0 2024-09-06T14:45:02.227 INFO:tasks.workunit.client.0.smithi052.stdout:3/856: creat d0/d11/d12/d4c/d93/d35/d46/f109 x:0 0 0 2024-09-06T14:45:02.228 INFO:tasks.workunit.client.0.smithi052.stdout:3/857: read d0/f1a [2799383,71303] 0 2024-09-06T14:45:02.229 INFO:tasks.workunit.client.0.smithi052.stdout:3/858: chown d0/d11/d71/d98/d1b/d85/dc5 38 1 2024-09-06T14:45:02.247 INFO:tasks.workunit.client.0.smithi052.stdout:2/804: symlink da/db/d46/d55/l105 0 2024-09-06T14:45:02.248 INFO:tasks.workunit.client.0.smithi052.stdout:1/884: link d1/db/de/d74/d14/f28 d1/d5f/f134 0 2024-09-06T14:45:02.272 INFO:tasks.workunit.client.0.smithi052.stdout:2/805: dwrite da/d2d/d34/d66/f77 [0,4194304] 0 2024-09-06T14:45:02.275 INFO:tasks.workunit.client.0.smithi052.stdout:1/885: dwrite d1/db/de/d74/d14/fe9 [0,4194304] 0 2024-09-06T14:45:02.282 INFO:tasks.workunit.client.0.smithi052.stdout:2/806: dread da/db/d46/d55/de6/f9a [0,4194304] 0 2024-09-06T14:45:02.284 INFO:tasks.workunit.client.0.smithi052.stdout:2/807: symlink da/d19/d3a/d31/d7a/dbd/l106 0 2024-09-06T14:45:02.286 INFO:tasks.workunit.client.0.smithi052.stdout:2/808: symlink da/db/d46/d55/l107 0 2024-09-06T14:45:02.287 INFO:tasks.workunit.client.0.smithi052.stdout:2/809: mkdir da/d2d/d34/dd7/d108 0 2024-09-06T14:45:02.289 INFO:tasks.workunit.client.0.smithi052.stdout:2/810: mkdir da/db/d109 0 2024-09-06T14:45:02.292 INFO:tasks.workunit.client.0.smithi052.stdout:2/811: rename da/d2d/d34/d66/da0/df0 to da/d2d/d34/d66/d10a 0 2024-09-06T14:45:02.295 INFO:tasks.workunit.client.0.smithi052.stdout:2/812: rename da/db/d18/l41 to da/d19/d3a/d31/l10b 0 2024-09-06T14:45:02.296 INFO:tasks.workunit.client.0.smithi052.stdout:1/886: dwrite d1/db/de/d74/d14/d2e/f42 [0,4194304] 0 2024-09-06T14:45:02.297 INFO:tasks.workunit.client.0.smithi052.stdout:2/813: chown da/db/d18/cab 46298 1 2024-09-06T14:45:02.303 INFO:tasks.workunit.client.0.smithi052.stdout:1/887: dwrite d1/db/de/f10a [0,4194304] 0 2024-09-06T14:45:02.305 INFO:tasks.workunit.client.0.smithi052.stdout:1/888: chown d1/d5f/lcb 5809143 1 2024-09-06T14:45:02.309 INFO:tasks.workunit.client.0.smithi052.stdout:1/889: rename d1/db/d76/l7f to d1/db/d18/l135 0 2024-09-06T14:45:02.313 INFO:tasks.workunit.client.0.smithi052.stdout:1/890: readlink d1/db/de/d74/d36/d9b/lde 0 2024-09-06T14:45:02.317 INFO:tasks.workunit.client.0.smithi052.stdout:2/814: write da/f2f [2383973,37323] 0 2024-09-06T14:45:02.321 INFO:tasks.workunit.client.0.smithi052.stdout:1/891: dwrite d1/db/de/d74/d14/d2e/f108 [0,4194304] 0 2024-09-06T14:45:02.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:01 smithi165 ceph-mon[36229]: pgmap v33: 65 pgs: 65 active+clean; 2.6 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 91 MiB/s wr, 262 op/s 2024-09-06T14:45:02.325 INFO:tasks.workunit.client.0.smithi052.stdout:2/815: link da/d19/d3a/d31/d7a/dbd/dc6/fe5 da/db/d60/daa/f10c 0 2024-09-06T14:45:02.327 INFO:tasks.workunit.client.0.smithi052.stdout:1/892: symlink d1/l136 0 2024-09-06T14:45:02.330 INFO:tasks.workunit.client.0.smithi052.stdout:1/893: creat d1/db/de/d74/d12/dd3/de5/f137 x:0 0 0 2024-09-06T14:45:02.332 INFO:tasks.workunit.client.0.smithi052.stdout:1/894: truncate d1/db/de/d74/d36/f125 536468 0 2024-09-06T14:45:02.340 INFO:tasks.workunit.client.0.smithi052.stdout:1/895: dwrite d1/db/de/d74/d14/fe9 [0,4194304] 0 2024-09-06T14:45:02.343 INFO:tasks.workunit.client.0.smithi052.stdout:1/896: symlink d1/db/d18/d6b/l138 0 2024-09-06T14:45:02.347 INFO:tasks.workunit.client.0.smithi052.stdout:1/897: mkdir d1/db/de/d74/d14/d9f/dcc/d47/d4a/d139 0 2024-09-06T14:45:02.353 INFO:tasks.workunit.client.0.smithi052.stdout:1/898: dwrite d1/db/de/d74/f78 [0,4194304] 0 2024-09-06T14:45:02.356 INFO:tasks.workunit.client.0.smithi052.stdout:1/899: rename d1/db/d72/faf to d1/db/de/d74/d14/d9f/dcc/d11f/f13a 0 2024-09-06T14:45:02.358 INFO:tasks.workunit.client.0.smithi052.stdout:2/816: dread da/f57 [0,4194304] 0 2024-09-06T14:45:02.361 INFO:tasks.workunit.client.0.smithi052.stdout:6/652: sync 2024-09-06T14:45:02.361 INFO:tasks.workunit.client.0.smithi052.stdout:4/789: sync 2024-09-06T14:45:02.361 INFO:tasks.workunit.client.0.smithi052.stdout:9/797: sync 2024-09-06T14:45:02.361 INFO:tasks.workunit.client.0.smithi052.stdout:7/757: sync 2024-09-06T14:45:02.361 INFO:tasks.workunit.client.0.smithi052.stdout:5/980: sync 2024-09-06T14:45:02.362 INFO:tasks.workunit.client.0.smithi052.stdout:0/781: sync 2024-09-06T14:45:02.363 INFO:tasks.workunit.client.0.smithi052.stdout:9/798: dread - d1/d4/d6/dd1/dd9/fe2 zero size 2024-09-06T14:45:02.365 INFO:tasks.workunit.client.0.smithi052.stdout:1/900: creat d1/d6c/d98/f13b x:0 0 0 2024-09-06T14:45:02.366 INFO:tasks.workunit.client.0.smithi052.stdout:4/790: truncate d9/d10/d17/d39/d3a/d5c/d106/f10e 954534 0 2024-09-06T14:45:02.371 INFO:tasks.workunit.client.0.smithi052.stdout:9/799: dwrite d1/d4/fb8 [0,4194304] 0 2024-09-06T14:45:02.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:01 smithi052 ceph-mon[28627]: pgmap v33: 65 pgs: 65 active+clean; 2.6 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 37 MiB/s rd, 91 MiB/s wr, 262 op/s 2024-09-06T14:45:02.377 INFO:tasks.workunit.client.0.smithi052.stdout:0/782: dread d0/d19/f72 [0,4194304] 0 2024-09-06T14:45:02.381 INFO:tasks.workunit.client.0.smithi052.stdout:7/758: mknod d11/d1c/d57/da7/cf1 0 2024-09-06T14:45:02.383 INFO:tasks.workunit.client.0.smithi052.stdout:2/817: truncate da/db/d46/d6b/f98 1661198 0 2024-09-06T14:45:02.386 INFO:tasks.workunit.client.0.smithi052.stdout:9/800: mkdir d1/d4/d6/dc/d10/d73/da9/df8 0 2024-09-06T14:45:02.389 INFO:tasks.workunit.client.0.smithi052.stdout:7/759: fsync d11/d1c/f32 0 2024-09-06T14:45:02.389 INFO:tasks.workunit.client.0.smithi052.stdout:4/791: write d9/d10/f12 [1029729,81796] 0 2024-09-06T14:45:02.391 INFO:tasks.workunit.client.0.smithi052.stdout:2/818: rename da/d19/d3a/d31/d7a/dbd/l106 to da/d4f/l10d 0 2024-09-06T14:45:02.392 INFO:tasks.workunit.client.0.smithi052.stdout:5/981: dread d2/d1a/d22/d26/d62/f72 [0,4194304] 0 2024-09-06T14:45:02.396 INFO:tasks.workunit.client.0.smithi052.stdout:0/783: unlink d0/d1a/d26/d3a/d14/d20/d22/d41/f4c 0 2024-09-06T14:45:02.398 INFO:tasks.workunit.client.0.smithi052.stdout:6/653: write d2/dd/d18/d4b/f58 [1969947,57156] 0 2024-09-06T14:45:02.400 INFO:tasks.workunit.client.0.smithi052.stdout:1/901: write d1/db/de/d74/d14/d9f/dcc/d47/f6f [162658,46242] 0 2024-09-06T14:45:02.400 INFO:tasks.workunit.client.0.smithi052.stdout:6/654: write d2/dd/d9d/db4/fc6 [416090,23191] 0 2024-09-06T14:45:02.403 INFO:tasks.workunit.client.0.smithi052.stdout:2/819: rename da/d19/d3a/d61/f95 to da/d2d/d34/d62/f10e 0 2024-09-06T14:45:02.405 INFO:tasks.workunit.client.0.smithi052.stdout:9/801: write d1/d4/d6/dd/d22/d6a/fc9 [938948,61126] 0 2024-09-06T14:45:02.406 INFO:tasks.workunit.client.0.smithi052.stdout:9/802: chown d1/d26/d87/fac 1044 1 2024-09-06T14:45:02.407 INFO:tasks.workunit.client.0.smithi052.stdout:9/803: read d1/d26/d41/f67 [1187386,32059] 0 2024-09-06T14:45:02.408 INFO:tasks.workunit.client.0.smithi052.stdout:0/784: unlink d0/d1a/d26/d3a/d14/d2d/c34 0 2024-09-06T14:45:02.412 INFO:tasks.workunit.client.0.smithi052.stdout:4/792: mknod d9/c113 0 2024-09-06T14:45:02.415 INFO:tasks.workunit.client.0.smithi052.stdout:1/902: dread - d1/db/de/d74/fe0 zero size 2024-09-06T14:45:02.420 INFO:tasks.workunit.client.0.smithi052.stdout:5/982: dread d2/d1a/d22/d26/d2b/d48/fea [0,4194304] 0 2024-09-06T14:45:02.427 INFO:tasks.workunit.client.0.smithi052.stdout:4/793: rename d9/d2d to d9/d2d/d33/d5d/da6/deb/d81/d9c/d114 22 2024-09-06T14:45:02.427 INFO:tasks.workunit.client.0.smithi052.stdout:2/820: dread da/d2d/d34/f8a [0,4194304] 0 2024-09-06T14:45:02.427 INFO:tasks.workunit.client.0.smithi052.stdout:5/983: dwrite d2/d1a/d22/f7e [0,4194304] 0 2024-09-06T14:45:02.429 INFO:tasks.workunit.client.0.smithi052.stdout:1/903: mknod d1/db/de/d74/d14/d90/d120/c13c 0 2024-09-06T14:45:02.431 INFO:tasks.workunit.client.0.smithi052.stdout:9/804: dread d1/d4/d6/dd/d22/d6a/fc9 [0,4194304] 0 2024-09-06T14:45:02.432 INFO:tasks.workunit.client.0.smithi052.stdout:1/904: read - d1/db/de/d74/d14/d9f/dcc/d47/d4a/fa2 zero size 2024-09-06T14:45:02.439 INFO:tasks.workunit.client.0.smithi052.stdout:7/760: getdents d11 0 2024-09-06T14:45:02.440 INFO:tasks.workunit.client.0.smithi052.stdout:7/761: chown d11/d1c/c80 638 1 2024-09-06T14:45:02.442 INFO:tasks.workunit.client.0.smithi052.stdout:7/762: read d11/d1c/d24/d4b/f4c [2865169,110329] 0 2024-09-06T14:45:02.444 INFO:tasks.workunit.client.0.smithi052.stdout:9/805: write d1/f23 [3453601,126936] 0 2024-09-06T14:45:02.444 INFO:tasks.workunit.client.0.smithi052.stdout:4/794: dread d9/d2d/d33/d5d/da6/deb/f76 [0,4194304] 0 2024-09-06T14:45:02.445 INFO:tasks.workunit.client.0.smithi052.stdout:1/905: mkdir d1/db/d72/db1/d13d 0 2024-09-06T14:45:02.445 INFO:tasks.workunit.client.0.smithi052.stdout:7/763: chown d11/d1c/d57/da7/cf1 8 1 2024-09-06T14:45:02.446 INFO:tasks.workunit.client.0.smithi052.stdout:5/984: mkdir d2/d1a/d22/d26/d62/d143/d147 0 2024-09-06T14:45:02.446 INFO:tasks.workunit.client.0.smithi052.stdout:9/806: stat d1/d4/fb8 0 2024-09-06T14:45:02.449 INFO:tasks.workunit.client.0.smithi052.stdout:9/807: dread d1/d4/d6/dc/d10/d18/f76 [0,4194304] 0 2024-09-06T14:45:02.450 INFO:tasks.workunit.client.0.smithi052.stdout:4/795: rename d9/f38 to d9/da1/d10f/f115 0 2024-09-06T14:45:02.451 INFO:tasks.workunit.client.0.smithi052.stdout:2/821: link da/db/lf da/d19/d3a/d31/d76/dc7/l10f 0 2024-09-06T14:45:02.451 INFO:tasks.workunit.client.0.smithi052.stdout:2/822: fsync da/d19/f29 0 2024-09-06T14:45:02.453 INFO:tasks.workunit.client.0.smithi052.stdout:1/906: dread - d1/db/de/d74/d12/dd3/f10d zero size 2024-09-06T14:45:02.454 INFO:tasks.workunit.client.0.smithi052.stdout:5/985: creat d2/d1a/ddb/f148 x:0 0 0 2024-09-06T14:45:02.455 INFO:tasks.workunit.client.0.smithi052.stdout:7/764: truncate d11/d1c/d24/d3b/fbf 1111764 0 2024-09-06T14:45:02.457 INFO:tasks.workunit.client.0.smithi052.stdout:5/986: chown d2/d1a/d22/d26/d2b/d37/l50 55427517 1 2024-09-06T14:45:02.458 INFO:tasks.workunit.client.0.smithi052.stdout:4/796: dwrite d9/d2d/d33/d5d/da6/deb/ff4 [0,4194304] 0 2024-09-06T14:45:02.459 INFO:tasks.workunit.client.0.smithi052.stdout:9/808: rmdir d1/d4/d6/dc/d38/d5a/da0 39 2024-09-06T14:45:02.460 INFO:tasks.workunit.client.0.smithi052.stdout:4/797: read d9/d10/d17/d39/f46 [385496,89758] 0 2024-09-06T14:45:02.478 INFO:tasks.workunit.client.0.smithi052.stdout:2/823: getdents da/db/d60/daa/dd4 0 2024-09-06T14:45:02.484 INFO:tasks.workunit.client.0.smithi052.stdout:1/907: truncate d1/db/f52 1138466 0 2024-09-06T14:45:02.488 INFO:tasks.workunit.client.0.smithi052.stdout:2/824: truncate f2 4360558 0 2024-09-06T14:45:02.489 INFO:tasks.workunit.client.0.smithi052.stdout:7/765: dwrite d11/d1c/d24/fd7 [0,4194304] 0 2024-09-06T14:45:02.489 INFO:tasks.workunit.client.0.smithi052.stdout:5/987: creat d2/d1a/d22/d26/d2b/d37/f149 x:0 0 0 2024-09-06T14:45:02.491 INFO:tasks.workunit.client.0.smithi052.stdout:4/798: dwrite d9/d10/d17/d39/d3a/fb1 [0,4194304] 0 2024-09-06T14:45:02.492 INFO:tasks.workunit.client.0.smithi052.stdout:9/809: truncate d1/f23 70240 0 2024-09-06T14:45:02.506 INFO:tasks.workunit.client.0.smithi052.stdout:9/810: symlink d1/d4/d6/dc/d10/d73/da9/lf9 0 2024-09-06T14:45:02.508 INFO:tasks.workunit.client.0.smithi052.stdout:2/825: mkdir da/d2d/de7/d110 0 2024-09-06T14:45:02.510 INFO:tasks.workunit.client.0.smithi052.stdout:7/766: truncate d11/d1c/d24/f38 3060634 0 2024-09-06T14:45:02.513 INFO:tasks.workunit.client.0.smithi052.stdout:7/767: write d11/d1c/d24/d3b/f97 [529291,10102] 0 2024-09-06T14:45:02.513 INFO:tasks.workunit.client.0.smithi052.stdout:9/811: dwrite d1/d4/d6/dc/fa1 [0,4194304] 0 2024-09-06T14:45:02.516 INFO:tasks.workunit.client.0.smithi052.stdout:2/826: creat da/d19/d3a/d31/f111 x:0 0 0 2024-09-06T14:45:02.517 INFO:tasks.workunit.client.0.smithi052.stdout:5/988: creat d2/d1a/d22/d26/d2b/d48/f14a x:0 0 0 2024-09-06T14:45:02.520 INFO:tasks.workunit.client.0.smithi052.stdout:7/768: truncate d11/f43 980114 0 2024-09-06T14:45:02.522 INFO:tasks.workunit.client.0.smithi052.stdout:4/799: write d9/d10/d17/fa0 [490314,10524] 0 2024-09-06T14:45:02.529 INFO:tasks.workunit.client.0.smithi052.stdout:5/989: read - d2/d1a/ff1 zero size 2024-09-06T14:45:02.529 INFO:tasks.workunit.client.0.smithi052.stdout:1/908: dread d1/db/de/d74/d14/d9f/dcc/f5a [0,4194304] 0 2024-09-06T14:45:02.530 INFO:tasks.workunit.client.0.smithi052.stdout:9/812: dread d1/d4/d6/dc/d10/d18/f33 [0,4194304] 0 2024-09-06T14:45:02.532 INFO:tasks.workunit.client.0.smithi052.stdout:4/800: unlink d9/d72/fa5 0 2024-09-06T14:45:02.538 INFO:tasks.workunit.client.0.smithi052.stdout:1/909: fdatasync d1/db/de/d74/d12/f1e 0 2024-09-06T14:45:02.541 INFO:tasks.workunit.client.0.smithi052.stdout:4/801: truncate d9/fe 3040793 0 2024-09-06T14:45:02.545 INFO:tasks.workunit.client.0.smithi052.stdout:9/813: dwrite d1/f17 [0,4194304] 0 2024-09-06T14:45:02.546 INFO:tasks.workunit.client.0.smithi052.stdout:7/769: write d11/d1c/d3f/d5d/f69 [1358871,103029] 0 2024-09-06T14:45:02.546 INFO:tasks.workunit.client.0.smithi052.stdout:4/802: rmdir d9/d10/d17/daa 39 2024-09-06T14:45:02.552 INFO:tasks.workunit.client.0.smithi052.stdout:5/990: write d2/f13 [1701343,37647] 0 2024-09-06T14:45:02.553 INFO:tasks.workunit.client.0.smithi052.stdout:1/910: mknod d1/db/de/d68/df3/d11d/c13e 0 2024-09-06T14:45:02.556 INFO:tasks.workunit.client.0.smithi052.stdout:2/827: dread f2 [0,4194304] 0 2024-09-06T14:45:02.556 INFO:tasks.workunit.client.0.smithi052.stdout:7/770: rmdir d11/d1c/d57/d89/db2 39 2024-09-06T14:45:02.557 INFO:tasks.workunit.client.0.smithi052.stdout:2/828: write da/d19/d3a/d31/d76/d6a/f7c [459099,7049] 0 2024-09-06T14:45:02.558 INFO:tasks.workunit.client.0.smithi052.stdout:7/771: read d11/d1c/d57/f9f [834627,29116] 0 2024-09-06T14:45:02.560 INFO:tasks.workunit.client.0.smithi052.stdout:5/991: creat d2/d1a/d22/d26/d2b/d48/d64/dbf/d9e/dae/f14b x:0 0 0 2024-09-06T14:45:02.563 INFO:tasks.workunit.client.0.smithi052.stdout:4/803: mkdir d9/d10/d17/daa/db5/db9/d116 0 2024-09-06T14:45:02.564 INFO:tasks.workunit.client.0.smithi052.stdout:7/772: dwrite d11/d1c/d24/fb8 [4194304,4194304] 0 2024-09-06T14:45:02.571 INFO:tasks.workunit.client.0.smithi052.stdout:2/829: mknod da/d19/d3a/d31/d7a/dbd/dc6/c112 0 2024-09-06T14:45:02.576 INFO:tasks.workunit.client.0.smithi052.stdout:4/804: unlink d9/d2d/d33/d5d/da6/deb/ff4 0 2024-09-06T14:45:02.579 INFO:tasks.workunit.client.0.smithi052.stdout:1/911: write d1/db/de/d74/ff8 [9420546,107100] 0 2024-09-06T14:45:02.582 INFO:tasks.workunit.client.0.smithi052.stdout:9/814: link d1/d4/l8a d1/d4/df/lfa 0 2024-09-06T14:45:02.587 INFO:tasks.workunit.client.0.smithi052.stdout:3/859: sync 2024-09-06T14:45:02.587 INFO:tasks.workunit.client.0.smithi052.stdout:2/830: creat da/d19/d5a/d6c/f113 x:0 0 0 2024-09-06T14:45:02.589 INFO:tasks.workunit.client.0.smithi052.stdout:9/815: stat d1/d4/d6/dc/d10/d73/da9/cb0 0 2024-09-06T14:45:02.595 INFO:tasks.workunit.client.0.smithi052.stdout:3/860: readlink d0/d11/d71/d98/d1b/d85/d9f/le4 0 2024-09-06T14:45:02.595 INFO:tasks.workunit.client.0.smithi052.stdout:2/831: mknod da/db/d46/d6b/c114 0 2024-09-06T14:45:02.598 INFO:tasks.workunit.client.0.smithi052.stdout:9/816: mkdir d1/d4/d6/dd/de8/de9/dfb 0 2024-09-06T14:45:02.599 INFO:tasks.workunit.client.0.smithi052.stdout:4/805: link d9/d2d/d33/d5d/da6/deb/d81/fd4 d9/da1/f117 0 2024-09-06T14:45:02.601 INFO:tasks.workunit.client.0.smithi052.stdout:7/773: dwrite d11/d1c/d24/d3b/d50/f58 [0,4194304] 0 2024-09-06T14:45:02.603 INFO:tasks.workunit.client.0.smithi052.stdout:2/832: mknod da/d2d/de7/d110/c115 0 2024-09-06T14:45:02.607 INFO:tasks.workunit.client.0.smithi052.stdout:1/912: dwrite d1/db/de/d74/d14/d9f/dcc/fe3 [0,4194304] 0 2024-09-06T14:45:02.609 INFO:tasks.workunit.client.0.smithi052.stdout:9/817: write d1/d4/d6/dd/d22/d6a/fc9 [2255286,105179] 0 2024-09-06T14:45:02.613 INFO:tasks.workunit.client.0.smithi052.stdout:7/774: fdatasync d11/d1c/d3f/f5f 0 2024-09-06T14:45:02.614 INFO:tasks.workunit.client.0.smithi052.stdout:4/806: creat d9/d2d/d33/d5d/da6/dbf/dd5/f118 x:0 0 0 2024-09-06T14:45:02.617 INFO:tasks.workunit.client.0.smithi052.stdout:2/833: creat da/d19/d3a/d31/d76/d6a/f116 x:0 0 0 2024-09-06T14:45:02.619 INFO:tasks.workunit.client.0.smithi052.stdout:3/861: link d0/d11/d12/d4c/d93/d35/db5/c102 d0/d11/d12/d4c/d93/d64/c10a 0 2024-09-06T14:45:02.621 INFO:tasks.workunit.client.0.smithi052.stdout:9/818: mkdir d1/d4/d6/dc/d10/d18/d82/d9e/dfc 0 2024-09-06T14:45:02.623 INFO:tasks.workunit.client.0.smithi052.stdout:7/775: mkdir d11/d1c/d3f/d73/dae/df2 0 2024-09-06T14:45:02.626 INFO:tasks.workunit.client.0.smithi052.stdout:1/913: symlink d1/l13f 0 2024-09-06T14:45:02.630 INFO:tasks.workunit.client.0.smithi052.stdout:9/819: dwrite d1/d4/d6/dc/d10/d18/f9d [0,4194304] 0 2024-09-06T14:45:02.630 INFO:tasks.workunit.client.0.smithi052.stdout:7/776: dread d11/d1c/d24/d4b/f9b [0,4194304] 0 2024-09-06T14:45:02.630 INFO:tasks.workunit.client.0.smithi052.stdout:1/914: stat d1/db/de/d74/d36/d9b/lde 0 2024-09-06T14:45:02.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/777: symlink d11/d1c/d3f/d5d/lf3 0 2024-09-06T14:45:02.641 INFO:tasks.workunit.client.0.smithi052.stdout:9/820: mkdir d1/d4/d6/dc/d38/dfd 0 2024-09-06T14:45:02.644 INFO:tasks.workunit.client.0.smithi052.stdout:9/821: readlink d1/d4/d6/dc/d10/d73/da9/lf9 0 2024-09-06T14:45:02.644 INFO:tasks.workunit.client.0.smithi052.stdout:2/834: dwrite da/d19/d3a/d31/d76/d6a/fa5 [4194304,4194304] 0 2024-09-06T14:45:02.645 INFO:tasks.workunit.client.0.smithi052.stdout:9/822: chown d1/d4/d6/dc/d10/d18/fb7 1443 1 2024-09-06T14:45:02.646 INFO:tasks.workunit.client.0.smithi052.stdout:3/862: link d0/d11/d12/c90 d0/d11/d12/dea/c10b 0 2024-09-06T14:45:02.647 INFO:tasks.workunit.client.0.smithi052.stdout:7/778: mkdir d11/d1c/d24/d7e/df4 0 2024-09-06T14:45:02.650 INFO:tasks.workunit.client.0.smithi052.stdout:1/915: rename d1/db/d18/d6b/c107 to d1/db/d72/d81/c140 0 2024-09-06T14:45:02.652 INFO:tasks.workunit.client.0.smithi052.stdout:9/823: rmdir d1/d4/d6/dc/d10/d18/d82/d9e/dd7 39 2024-09-06T14:45:02.653 INFO:tasks.workunit.client.0.smithi052.stdout:9/824: chown d1/d4/d6/dc/d10/d18/d82/da6/dcb 816176 1 2024-09-06T14:45:02.654 INFO:tasks.workunit.client.0.smithi052.stdout:7/779: symlink d11/lf5 0 2024-09-06T14:45:02.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/825: write d1/d26/fed [45210,54831] 0 2024-09-06T14:45:02.655 INFO:tasks.workunit.client.0.smithi052.stdout:3/863: mknod d0/d89/c10c 0 2024-09-06T14:45:02.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/864: chown d0/d11/d71/d98/d19/fff 3634953 1 2024-09-06T14:45:02.659 INFO:tasks.workunit.client.0.smithi052.stdout:4/807: link d9/d2d/d33/c97 d9/d10/d17/d39/d3a/d5c/c119 0 2024-09-06T14:45:02.663 INFO:tasks.workunit.client.0.smithi052.stdout:9/826: creat d1/d4/d6/dd/d22/d6a/ffe x:0 0 0 2024-09-06T14:45:02.666 INFO:tasks.workunit.client.0.smithi052.stdout:2/835: write da/db/fa2 [218762,71886] 0 2024-09-06T14:45:02.667 INFO:tasks.workunit.client.0.smithi052.stdout:3/865: readlink d0/d11/d12/d4c/d93/l81 0 2024-09-06T14:45:02.669 INFO:tasks.workunit.client.0.smithi052.stdout:1/916: dread d1/db/de/d74/d12/f34 [0,4194304] 0 2024-09-06T14:45:02.670 INFO:tasks.workunit.client.0.smithi052.stdout:7/780: write d11/d1c/d24/d3b/d50/f8c [1059322,67058] 0 2024-09-06T14:45:02.671 INFO:tasks.workunit.client.0.smithi052.stdout:9/827: creat d1/d4/d6/dc/d10/dbe/fff x:0 0 0 2024-09-06T14:45:02.671 INFO:tasks.workunit.client.0.smithi052.stdout:7/781: fsync d11/d1c/d24/fb8 0 2024-09-06T14:45:02.674 INFO:tasks.workunit.client.0.smithi052.stdout:4/808: creat d9/d10/d19/de4/f11a x:0 0 0 2024-09-06T14:45:02.674 INFO:tasks.workunit.client.0.smithi052.stdout:9/828: truncate d1/d4/d6/dc/fb2 1035854 0 2024-09-06T14:45:02.674 INFO:tasks.workunit.client.0.smithi052.stdout:9/829: readlink d1/d26/l85 0 2024-09-06T14:45:02.679 INFO:tasks.workunit.client.0.smithi052.stdout:2/836: fdatasync da/d19/f2c 0 2024-09-06T14:45:02.680 INFO:tasks.workunit.client.0.smithi052.stdout:2/837: dread - da/db/d46/fff zero size 2024-09-06T14:45:02.685 INFO:tasks.workunit.client.0.smithi052.stdout:9/830: mknod d1/d26/d87/c100 0 2024-09-06T14:45:02.686 INFO:tasks.workunit.client.0.smithi052.stdout:1/917: mkdir d1/db/de/d74/d14/dda/d141 0 2024-09-06T14:45:02.687 INFO:tasks.workunit.client.0.smithi052.stdout:3/866: dwrite d0/d11/d12/d4c/d93/d35/d46/d67/f9b [0,4194304] 0 2024-09-06T14:45:02.691 INFO:tasks.workunit.client.0.smithi052.stdout:7/782: mknod d11/d1c/d3f/d73/dae/df2/cf6 0 2024-09-06T14:45:02.692 INFO:tasks.workunit.client.0.smithi052.stdout:2/838: rename da/db/d18/d7f/l91 to da/d2d/d34/d66/d10a/l117 0 2024-09-06T14:45:02.694 INFO:tasks.workunit.client.0.smithi052.stdout:4/809: dread d9/d10/d17/d39/f58 [0,4194304] 0 2024-09-06T14:45:02.697 INFO:tasks.workunit.client.0.smithi052.stdout:3/867: mknod d0/d11/d12/d4c/d93/d35/d46/d5b/da0/c10d 0 2024-09-06T14:45:02.699 INFO:tasks.workunit.client.0.smithi052.stdout:3/868: chown d0/f1a 45838036 1 2024-09-06T14:45:02.703 INFO:tasks.workunit.client.0.smithi052.stdout:4/810: creat d9/da1/f11b x:0 0 0 2024-09-06T14:45:02.703 INFO:tasks.workunit.client.0.smithi052.stdout:9/831: dwrite d1/d4/df/fc1 [0,4194304] 0 2024-09-06T14:45:02.706 INFO:tasks.workunit.client.0.smithi052.stdout:9/832: write d1/d4/d6/dc/d10/d18/f5b [3485507,129444] 0 2024-09-06T14:45:02.708 INFO:tasks.workunit.client.0.smithi052.stdout:9/833: chown d1/d4/d6/dc/d10/d18/d82/dda 1491 1 2024-09-06T14:45:02.709 INFO:tasks.workunit.client.0.smithi052.stdout:3/869: mkdir d0/d11/d12/d17/d7b/d10e 0 2024-09-06T14:45:02.710 INFO:tasks.workunit.client.0.smithi052.stdout:9/834: write d1/d4/d6/dc/d10/d18/f84 [3387624,42491] 0 2024-09-06T14:45:02.711 INFO:tasks.workunit.client.0.smithi052.stdout:7/783: truncate d11/f14 3453170 0 2024-09-06T14:45:02.712 INFO:tasks.workunit.client.0.smithi052.stdout:9/835: read d1/d4/d6/dc/d10/d18/f9d [3831520,50239] 0 2024-09-06T14:45:02.714 INFO:tasks.workunit.client.0.smithi052.stdout:4/811: mkdir d9/d10/d17/d39/d3a/d11c 0 2024-09-06T14:45:02.715 INFO:tasks.workunit.client.0.smithi052.stdout:9/836: readlink d1/d4/d6/dc/d10/d73/da9/lf9 0 2024-09-06T14:45:02.715 INFO:tasks.workunit.client.0.smithi052.stdout:4/812: rename d9 to d9/da1/d11d 22 2024-09-06T14:45:02.719 INFO:tasks.workunit.client.0.smithi052.stdout:3/870: readlink d0/d11/d12/d4c/d93/d35/d46/d5b/da0/da6/lf5 0 2024-09-06T14:45:02.721 INFO:tasks.workunit.client.0.smithi052.stdout:1/918: link d1/db/f3f d1/db/f142 0 2024-09-06T14:45:02.731 INFO:tasks.workunit.client.0.smithi052.stdout:7/784: symlink d11/d1c/d57/d89/db2/lf7 0 2024-09-06T14:45:02.732 INFO:tasks.workunit.client.0.smithi052.stdout:7/785: dread d11/d1c/d24/d4b/da2/fc3 [0,4194304] 0 2024-09-06T14:45:02.735 INFO:tasks.workunit.client.0.smithi052.stdout:4/813: link d9/d10/d17/d39/d3a/d5c/f90 d9/d10/d17/daa/db5/f11e 0 2024-09-06T14:45:02.740 INFO:tasks.workunit.client.0.smithi052.stdout:7/786: creat d11/d1c/d24/d7e/ff8 x:0 0 0 2024-09-06T14:45:02.743 INFO:tasks.workunit.client.0.smithi052.stdout:4/814: unlink d9/f2e 0 2024-09-06T14:45:02.743 INFO:tasks.workunit.client.0.smithi052.stdout:3/871: creat d0/d11/d12/d4c/d93/d35/d46/f10f x:0 0 0 2024-09-06T14:45:02.750 INFO:tasks.workunit.client.0.smithi052.stdout:9/837: getdents d1/d4/d6/dc/d10/dbe 0 2024-09-06T14:45:02.750 INFO:tasks.workunit.client.0.smithi052.stdout:4/815: creat d9/d10/d17/daa/db5/f11f x:0 0 0 2024-09-06T14:45:02.752 INFO:tasks.workunit.client.0.smithi052.stdout:4/816: stat d9/d2d/d33/d5d/da6/d83/cbe 0 2024-09-06T14:45:02.752 INFO:tasks.workunit.client.0.smithi052.stdout:3/872: symlink d0/d11/d71/d98/d19/l110 0 2024-09-06T14:45:02.753 INFO:tasks.workunit.client.0.smithi052.stdout:4/817: dread - d9/d10/d19/de4/f11a zero size 2024-09-06T14:45:02.754 INFO:tasks.workunit.client.0.smithi052.stdout:9/838: write d1/d4/df/d56/f86 [4350432,27327] 0 2024-09-06T14:45:02.755 INFO:tasks.workunit.client.0.smithi052.stdout:7/787: link d11/d1c/d57/d89/lea d11/lf9 0 2024-09-06T14:45:02.756 INFO:tasks.workunit.client.0.smithi052.stdout:9/839: stat d1/d4/d6/dd/d22/d6a/cdd 0 2024-09-06T14:45:02.757 INFO:tasks.workunit.client.0.smithi052.stdout:4/818: fdatasync d9/d2d/d33/f3f 0 2024-09-06T14:45:02.760 INFO:tasks.workunit.client.0.smithi052.stdout:9/840: symlink d1/d4/d6/dc/d10/d18/d82/da6/l101 0 2024-09-06T14:45:02.764 INFO:tasks.workunit.client.0.smithi052.stdout:4/819: rename d9/d2d/d33/d5d/da6/deb/d81/cb4 to d9/d10/d17/d39/d7b/d91/c120 0 2024-09-06T14:45:02.764 INFO:tasks.workunit.client.0.smithi052.stdout:4/820: dread - d9/d2d/f100 zero size 2024-09-06T14:45:02.766 INFO:tasks.workunit.client.0.smithi052.stdout:9/841: rmdir d1/d4/d6/dc/d38/d5a/da0 39 2024-09-06T14:45:02.768 INFO:tasks.workunit.client.0.smithi052.stdout:9/842: write d1/d26/d87/fc4 [534392,91847] 0 2024-09-06T14:45:02.770 INFO:tasks.workunit.client.0.smithi052.stdout:4/821: mkdir d9/d121 0 2024-09-06T14:45:02.771 INFO:tasks.workunit.client.0.smithi052.stdout:3/873: dread d0/ff [4194304,4194304] 0 2024-09-06T14:45:02.772 INFO:tasks.workunit.client.0.smithi052.stdout:9/843: write d1/f37 [2758234,40255] 0 2024-09-06T14:45:02.777 INFO:tasks.workunit.client.0.smithi052.stdout:3/874: mkdir d0/d11/d71/d98/d111 0 2024-09-06T14:45:02.778 INFO:tasks.workunit.client.0.smithi052.stdout:3/875: fdatasync d0/d11/d71/d98/f43 0 2024-09-06T14:45:02.780 INFO:tasks.workunit.client.0.smithi052.stdout:7/788: write d11/d1c/d57/fb9 [744474,72246] 0 2024-09-06T14:45:02.784 INFO:tasks.workunit.client.0.smithi052.stdout:3/876: rename d0/d11/d12/d4c/d93/d35/d46/d5b/da0 to d0/d11/d12/d73/de8/d112 0 2024-09-06T14:45:02.785 INFO:tasks.workunit.client.0.smithi052.stdout:9/844: mkdir d1/d4/d6/dd/d102 0 2024-09-06T14:45:02.786 INFO:tasks.workunit.client.0.smithi052.stdout:9/845: fsync d1/d4/d6/dd/f77 0 2024-09-06T14:45:02.787 INFO:tasks.workunit.client.0.smithi052.stdout:7/789: dread d11/d1c/d3f/fee [0,4194304] 0 2024-09-06T14:45:02.788 INFO:tasks.workunit.client.0.smithi052.stdout:7/790: fsync d11/d1c/d24/d3b/d50/f8c 0 2024-09-06T14:45:02.790 INFO:tasks.workunit.client.0.smithi052.stdout:3/877: rename d0/d11/d12/d4c/d93/d35/d46/lba to d0/d11/d71/d98/l113 0 2024-09-06T14:45:02.792 INFO:tasks.workunit.client.0.smithi052.stdout:9/846: creat d1/d4/d6/dd1/f103 x:0 0 0 2024-09-06T14:45:02.793 INFO:tasks.workunit.client.0.smithi052.stdout:4/822: write d9/d10/d19/f48 [1155554,67466] 0 2024-09-06T14:45:02.795 INFO:tasks.workunit.client.0.smithi052.stdout:7/791: truncate d11/d1c/d24/d4b/f4e 974235 0 2024-09-06T14:45:02.799 INFO:tasks.workunit.client.0.smithi052.stdout:9/847: dwrite d1/d26/f95 [0,4194304] 0 2024-09-06T14:45:02.801 INFO:tasks.workunit.client.0.smithi052.stdout:4/823: symlink d9/d2d/d33/d5d/da6/deb/d81/dc1/l122 0 2024-09-06T14:45:02.806 INFO:tasks.workunit.client.0.smithi052.stdout:3/878: write d0/d11/d71/d98/d19/fc6 [1605545,60303] 0 2024-09-06T14:45:02.813 INFO:tasks.workunit.client.0.smithi052.stdout:3/879: symlink d0/d11/d12/d4c/d93/d35/d46/l114 0 2024-09-06T14:45:02.816 INFO:tasks.workunit.client.0.smithi052.stdout:9/848: fsync d1/d26/f95 0 2024-09-06T14:45:02.817 INFO:tasks.workunit.client.0.smithi052.stdout:9/849: fdatasync d1/d26/d87/fc4 0 2024-09-06T14:45:02.818 INFO:tasks.workunit.client.0.smithi052.stdout:9/850: write d1/d4/d6/dc/d10/dbe/fff [99912,104563] 0 2024-09-06T14:45:02.819 INFO:tasks.workunit.client.0.smithi052.stdout:7/792: write d11/d1c/d57/d89/f8b [995960,32409] 0 2024-09-06T14:45:02.820 INFO:tasks.workunit.client.0.smithi052.stdout:4/824: getdents d9/d2d/d33/d5d/da6/deb/d81/d9c 0 2024-09-06T14:45:02.823 INFO:tasks.workunit.client.0.smithi052.stdout:9/851: stat d1/d4/c36 0 2024-09-06T14:45:02.824 INFO:tasks.workunit.client.0.smithi052.stdout:7/793: stat d11/d1c/d57/d89/lea 0 2024-09-06T14:45:02.827 INFO:tasks.workunit.client.0.smithi052.stdout:9/852: chown d1/d4/d6/dc/d10/d18/f3c 354149 1 2024-09-06T14:45:02.828 INFO:tasks.workunit.client.0.smithi052.stdout:7/794: stat f5 0 2024-09-06T14:45:02.831 INFO:tasks.workunit.client.0.smithi052.stdout:4/825: dread d9/d2d/d33/f3f [0,4194304] 0 2024-09-06T14:45:02.835 INFO:tasks.workunit.client.0.smithi052.stdout:3/880: dwrite d0/d11/f2e [4194304,4194304] 0 2024-09-06T14:45:02.838 INFO:tasks.workunit.client.0.smithi052.stdout:9/853: dwrite d1/d4/d6/dd/f13 [4194304,4194304] 0 2024-09-06T14:45:02.839 INFO:tasks.workunit.client.0.smithi052.stdout:7/795: getdents d11/d1c/d24/d3b/d50 0 2024-09-06T14:45:02.840 INFO:tasks.workunit.client.0.smithi052.stdout:4/826: dread d9/d10/d17/d39/d3a/ff6 [0,4194304] 0 2024-09-06T14:45:02.845 INFO:tasks.workunit.client.0.smithi052.stdout:3/881: rename d0/d11/d12/d4c/d93/d35/d46/l114 to d0/d11/d12/l115 0 2024-09-06T14:45:02.848 INFO:tasks.workunit.client.0.smithi052.stdout:7/796: truncate d11/d1c/d26/f60 1250817 0 2024-09-06T14:45:02.849 INFO:tasks.workunit.client.0.smithi052.stdout:9/854: creat d1/d4/d6/dd/de8/de9/dfb/f104 x:0 0 0 2024-09-06T14:45:02.849 INFO:tasks.workunit.client.0.smithi052.stdout:7/797: readlink d11/d1c/lb3 0 2024-09-06T14:45:02.850 INFO:tasks.workunit.client.0.smithi052.stdout:7/798: chown d11/d1c/d26/f40 9 1 2024-09-06T14:45:02.854 INFO:tasks.workunit.client.0.smithi052.stdout:9/855: rmdir d1/d4/d6/dc/d10/d18/d82 39 2024-09-06T14:45:02.857 INFO:tasks.workunit.client.0.smithi052.stdout:4/827: getdents d9/d10/d19 0 2024-09-06T14:45:02.858 INFO:tasks.workunit.client.0.smithi052.stdout:3/882: unlink d0/d11/d71/d98/d1b/c91 0 2024-09-06T14:45:02.859 INFO:tasks.workunit.client.0.smithi052.stdout:9/856: fsync d1/d4/d6/dc/d10/d73/fae 0 2024-09-06T14:45:02.860 INFO:tasks.workunit.client.0.smithi052.stdout:9/857: fdatasync d1/d26/fed 0 2024-09-06T14:45:02.861 INFO:tasks.workunit.client.0.smithi052.stdout:9/858: dread - d1/d4/d6/dd/de8/de9/fef zero size 2024-09-06T14:45:02.861 INFO:tasks.workunit.client.0.smithi052.stdout:4/828: creat d9/d10/d17/d39/d7b/d91/d9e/f123 x:0 0 0 2024-09-06T14:45:02.862 INFO:tasks.workunit.client.0.smithi052.stdout:3/883: symlink d0/d11/d12/d73/de8/l116 0 2024-09-06T14:45:02.864 INFO:tasks.workunit.client.0.smithi052.stdout:4/829: symlink d9/d72/dca/l124 0 2024-09-06T14:45:02.868 INFO:tasks.workunit.client.0.smithi052.stdout:4/830: rename d9/da1/d10f to d9/d10/d17/d39/d3a/d125 0 2024-09-06T14:45:02.868 INFO:tasks.workunit.client.0.smithi052.stdout:9/859: getdents d1/d4/d6/dc/d7a 0 2024-09-06T14:45:02.872 INFO:tasks.workunit.client.0.smithi052.stdout:9/860: rmdir d1/d4/d6/dc/d10/d18/d82 39 2024-09-06T14:45:02.872 INFO:tasks.workunit.client.0.smithi052.stdout:3/884: dread d0/d11/d12/d17/f48 [0,4194304] 0 2024-09-06T14:45:02.876 INFO:tasks.workunit.client.0.smithi052.stdout:9/861: creat d1/d26/f105 x:0 0 0 2024-09-06T14:45:02.877 INFO:tasks.workunit.client.0.smithi052.stdout:9/862: fdatasync d1/d4/d6/dd/f13 0 2024-09-06T14:45:02.877 INFO:tasks.workunit.client.0.smithi052.stdout:3/885: truncate d0/d11/d12/d73/de8/d112/da6/fc3 7941407 0 2024-09-06T14:45:02.878 INFO:tasks.workunit.client.0.smithi052.stdout:9/863: write d1/d4/d6/dd1/f103 [159660,88399] 0 2024-09-06T14:45:02.887 INFO:tasks.workunit.client.0.smithi052.stdout:9/864: dwrite d1/d26/d87/fc5 [0,4194304] 0 2024-09-06T14:45:02.890 INFO:tasks.workunit.client.0.smithi052.stdout:9/865: write d1/d4/d6/dd/f9a [1415263,126364] 0 2024-09-06T14:45:02.891 INFO:tasks.workunit.client.0.smithi052.stdout:9/866: fsync d1/d4/d6/dc/d10/d73/fae 0 2024-09-06T14:45:02.893 INFO:tasks.workunit.client.0.smithi052.stdout:9/867: write d1/d4/d6/dd/d22/fcf [1815679,127543] 0 2024-09-06T14:45:02.901 INFO:tasks.workunit.client.0.smithi052.stdout:9/868: dwrite d1/d4/f7 [0,4194304] 0 2024-09-06T14:45:02.909 INFO:tasks.workunit.client.0.smithi052.stdout:9/869: rename d1/d26/d3d/l93 to d1/d4/d6/dc/d10/dec/l106 0 2024-09-06T14:45:02.916 INFO:tasks.workunit.client.0.smithi052.stdout:9/870: mknod d1/d4/df/c107 0 2024-09-06T14:45:02.919 INFO:tasks.workunit.client.0.smithi052.stdout:9/871: read - d1/d4/f92 zero size 2024-09-06T14:45:02.919 INFO:tasks.workunit.client.0.smithi052.stdout:3/886: write d0/d11/d71/d98/d1b/f96 [1301450,17154] 0 2024-09-06T14:45:02.921 INFO:tasks.workunit.client.0.smithi052.stdout:3/887: readlink d0/d11/d71/d98/d1b/l39 0 2024-09-06T14:45:02.925 INFO:tasks.workunit.client.0.smithi052.stdout:3/888: mkdir d0/d11/d71/d98/d1b/d117 0 2024-09-06T14:45:02.925 INFO:tasks.workunit.client.0.smithi052.stdout:7/799: write d11/d1c/d26/f60 [793201,77718] 0 2024-09-06T14:45:02.929 INFO:tasks.workunit.client.0.smithi052.stdout:9/872: rename d1/d4/df/d56 to d1/d4/d6/dc/d10/d18/d9f/df6/d108 0 2024-09-06T14:45:02.941 INFO:tasks.workunit.client.0.smithi052.stdout:3/889: rename d0/d11/d71/d98/d1b/f96 to d0/d11/d71/d98/d1b/d85/d9f/dcf/f118 0 2024-09-06T14:45:02.942 INFO:tasks.workunit.client.0.smithi052.stdout:9/873: dread d1/d4/d6/dc/d10/d18/f5b [4194304,4194304] 0 2024-09-06T14:45:02.942 INFO:tasks.workunit.client.0.smithi052.stdout:9/874: stat d1/d4/d6/dc/d10/dbe 0 2024-09-06T14:45:02.942 INFO:tasks.workunit.client.0.smithi052.stdout:7/800: fsync d11/d1c/d24/f93 0 2024-09-06T14:45:02.943 INFO:tasks.workunit.client.0.smithi052.stdout:7/801: write d11/d1c/d24/dca/fd6 [999957,52236] 0 2024-09-06T14:45:02.945 INFO:tasks.workunit.client.0.smithi052.stdout:7/802: chown d11/d1c/f32 4147875 1 2024-09-06T14:45:02.958 INFO:tasks.workunit.client.0.smithi052.stdout:3/890: creat d0/d11/d71/daf/df3/f119 x:0 0 0 2024-09-06T14:45:02.959 INFO:tasks.workunit.client.0.smithi052.stdout:3/891: stat d0/d11/d12/d4c/d93/d64/df1 0 2024-09-06T14:45:02.961 INFO:tasks.workunit.client.0.smithi052.stdout:9/875: creat d1/d4/d6/dc/d10/d18/d82/d9e/dfc/f109 x:0 0 0 2024-09-06T14:45:02.963 INFO:tasks.workunit.client.0.smithi052.stdout:7/803: rename d11/d1c/d57/d89/lea to d11/d1c/d24/d4b/lfa 0 2024-09-06T14:45:02.966 INFO:tasks.workunit.client.0.smithi052.stdout:3/892: dwrite d0/d11/d12/d4c/d93/d35/db5/ffe [0,4194304] 0 2024-09-06T14:45:02.966 INFO:tasks.workunit.client.0.smithi052.stdout:7/804: creat d11/d1c/d24/d4b/da2/ffb x:0 0 0 2024-09-06T14:45:02.969 INFO:tasks.workunit.client.0.smithi052.stdout:7/805: creat d11/d1c/d3f/d73/ffc x:0 0 0 2024-09-06T14:45:02.970 INFO:tasks.workunit.client.0.smithi052.stdout:3/893: rmdir d0/d11/d71/d98/d9d 39 2024-09-06T14:45:02.970 INFO:tasks.workunit.client.0.smithi052.stdout:7/806: chown d11/d1c/d3f/d5d 1608 1 2024-09-06T14:45:02.974 INFO:tasks.workunit.client.0.smithi052.stdout:7/807: mknod d11/d1c/d24/d3b/d50/cfd 0 2024-09-06T14:45:02.976 INFO:tasks.workunit.client.0.smithi052.stdout:3/894: mknod d0/d11/d12/d4c/d93/d35/d46/d5b/c11a 0 2024-09-06T14:45:02.978 INFO:tasks.workunit.client.0.smithi052.stdout:7/808: readlink d11/l19 0 2024-09-06T14:45:02.978 INFO:tasks.workunit.client.0.smithi052.stdout:7/809: readlink d11/d1c/d24/dca/lc8 0 2024-09-06T14:45:02.984 INFO:tasks.workunit.client.0.smithi052.stdout:3/895: write d0/d11/d12/d4c/d93/d35/fb8 [149826,31340] 0 2024-09-06T14:45:02.985 INFO:tasks.workunit.client.0.smithi052.stdout:7/810: truncate d11/d1c/d24/d4b/f4c 2878712 0 2024-09-06T14:45:02.989 INFO:tasks.workunit.client.0.smithi052.stdout:3/896: symlink d0/d11/d12/d4c/d93/d35/d46/d5b/l11b 0 2024-09-06T14:45:02.991 INFO:tasks.workunit.client.0.smithi052.stdout:3/897: symlink d0/d89/l11c 0 2024-09-06T14:45:02.994 INFO:tasks.workunit.client.0.smithi052.stdout:3/898: fdatasync d0/d11/d71/d98/d1b/ff4 0 2024-09-06T14:45:02.996 INFO:tasks.workunit.client.0.smithi052.stdout:3/899: write d0/d11/d71/d98/d19/fc6 [2149238,99856] 0 2024-09-06T14:45:03.001 INFO:tasks.workunit.client.0.smithi052.stdout:7/811: dread d11/f14 [0,4194304] 0 2024-09-06T14:45:03.002 INFO:tasks.workunit.client.0.smithi052.stdout:3/900: mkdir d0/d11/d12/d4c/d93/d35/d46/d11d 0 2024-09-06T14:45:03.004 INFO:tasks.workunit.client.0.smithi052.stdout:7/812: mknod d11/d1c/d24/d4b/cfe 0 2024-09-06T14:45:03.005 INFO:tasks.workunit.client.0.smithi052.stdout:3/901: creat d0/d11/d12/d4c/d93/d64/f11e x:0 0 0 2024-09-06T14:45:03.007 INFO:tasks.workunit.client.0.smithi052.stdout:7/813: chown d11/l7d 13696 1 2024-09-06T14:45:03.008 INFO:tasks.workunit.client.0.smithi052.stdout:3/902: mknod d0/d11/d71/d98/d111/c11f 0 2024-09-06T14:45:03.009 INFO:tasks.workunit.client.0.smithi052.stdout:7/814: stat d11/c16 0 2024-09-06T14:45:03.010 INFO:tasks.workunit.client.0.smithi052.stdout:3/903: unlink d0/d11/d12/d4c/d93/d35/d46/d67/c86 0 2024-09-06T14:45:03.011 INFO:tasks.workunit.client.0.smithi052.stdout:7/815: read d11/d1c/f1e [2332327,71845] 0 2024-09-06T14:45:03.013 INFO:tasks.workunit.client.0.smithi052.stdout:7/816: creat d11/d1c/d24/d64/fff x:0 0 0 2024-09-06T14:45:03.014 INFO:tasks.workunit.client.0.smithi052.stdout:7/817: symlink d11/d1c/d57/da7/l100 0 2024-09-06T14:45:03.015 INFO:tasks.workunit.client.0.smithi052.stdout:7/818: fdatasync d11/d1c/d24/d3b/d50/f58 0 2024-09-06T14:45:03.019 INFO:tasks.workunit.client.0.smithi052.stdout:7/819: unlink d11/d1c/d24/d7e/ff8 0 2024-09-06T14:45:03.021 INFO:tasks.workunit.client.0.smithi052.stdout:7/820: rmdir d11/d1c/d24/d4b 39 2024-09-06T14:45:03.029 INFO:tasks.workunit.client.0.smithi052.stdout:7/821: symlink d11/d1c/d24/d4b/l101 0 2024-09-06T14:45:03.031 INFO:tasks.workunit.client.0.smithi052.stdout:7/822: rmdir d11/d1c/d57/d89 39 2024-09-06T14:45:03.033 INFO:tasks.workunit.client.0.smithi052.stdout:7/823: dread - d11/d1c/d3f/d5d/fbd zero size 2024-09-06T14:45:03.033 INFO:tasks.workunit.client.0.smithi052.stdout:3/904: truncate d0/d11/d71/d98/d1b/d105/fe3 1893912 0 2024-09-06T14:45:03.035 INFO:tasks.workunit.client.0.smithi052.stdout:3/905: chown d0/d11/d71/fad 11183 1 2024-09-06T14:45:03.038 INFO:tasks.workunit.client.0.smithi052.stdout:3/906: mknod d0/d11/d12/dd8/c120 0 2024-09-06T14:45:03.040 INFO:tasks.workunit.client.0.smithi052.stdout:7/824: dread d11/d1c/d57/d89/db2/fd9 [4194304,4194304] 0 2024-09-06T14:45:03.042 INFO:tasks.workunit.client.0.smithi052.stdout:7/825: mkdir d11/d1c/d3f/d73/dae/d102 0 2024-09-06T14:45:03.045 INFO:tasks.workunit.client.0.smithi052.stdout:7/826: truncate d11/d1c/f7c 2932601 0 2024-09-06T14:45:03.046 INFO:tasks.workunit.client.0.smithi052.stdout:7/827: readlink d11/l7d 0 2024-09-06T14:45:03.046 INFO:tasks.workunit.client.0.smithi052.stdout:7/828: dread - d11/d1c/d57/fb5 zero size 2024-09-06T14:45:03.047 INFO:tasks.workunit.client.0.smithi052.stdout:7/829: chown d11/d1c/d3f/d73/ffc 8 1 2024-09-06T14:45:03.051 INFO:tasks.workunit.client.0.smithi052.stdout:7/830: dread d11/d1c/d24/d3b/d50/f58 [0,4194304] 0 2024-09-06T14:45:03.052 INFO:tasks.workunit.client.0.smithi052.stdout:7/831: readlink d11/d1c/d3f/d5d/d88/lc0 0 2024-09-06T14:45:03.055 INFO:tasks.workunit.client.0.smithi052.stdout:7/832: symlink d11/d1c/d24/dca/l103 0 2024-09-06T14:45:03.066 INFO:tasks.workunit.client.0.smithi052.stdout:7/833: write f5 [212384,26602] 0 2024-09-06T14:45:03.204 INFO:tasks.workunit.client.0.smithi052.stdout:6/655: sync 2024-09-06T14:45:03.205 INFO:tasks.workunit.client.0.smithi052.stdout:6/656: read d2/dd/d18/f6d [2228431,93167] 0 2024-09-06T14:45:03.212 INFO:tasks.workunit.client.0.smithi052.stdout:6/657: dwrite d2/dd/d18/d25/f87 [0,4194304] 0 2024-09-06T14:45:03.216 INFO:tasks.workunit.client.0.smithi052.stdout:6/658: dread - d2/dd/d18/d33/fa5 zero size 2024-09-06T14:45:03.217 INFO:tasks.workunit.client.0.smithi052.stdout:6/659: truncate d2/db6/f80 4795314 0 2024-09-06T14:45:03.217 INFO:tasks.workunit.client.0.smithi052.stdout:6/660: chown d2/db6/fac 0 1 2024-09-06T14:45:03.221 INFO:tasks.workunit.client.0.smithi052.stdout:6/661: fsync d2/dd/d18/d25/d4c/f74 0 2024-09-06T14:45:03.222 INFO:tasks.workunit.client.0.smithi052.stdout:6/662: chown d2/dd/d18/d25/c8b 18721 1 2024-09-06T14:45:03.225 INFO:tasks.workunit.client.0.smithi052.stdout:6/663: symlink d2/dd/d9d/db4/dc0/ld5 0 2024-09-06T14:45:03.238 INFO:tasks.workunit.client.0.smithi052.stdout:6/664: dwrite d2/dd/d18/d4b/f94 [0,4194304] 0 2024-09-06T14:45:03.272 INFO:tasks.workunit.client.0.smithi052.stdout:6/665: mkdir d2/dd/d9d/db4/dc0/dd6 0 2024-09-06T14:45:03.276 INFO:tasks.workunit.client.0.smithi052.stdout:6/666: fdatasync d2/dd/d18/d33/d44/d79/f9c 0 2024-09-06T14:45:03.279 INFO:tasks.workunit.client.0.smithi052.stdout:6/667: fsync d2/dd/d18/d4b/fa6 0 2024-09-06T14:45:03.280 INFO:tasks.workunit.client.0.smithi052.stdout:6/668: chown d2/dd/d18/d25 6592669 1 2024-09-06T14:45:03.300 INFO:tasks.workunit.client.0.smithi052.stdout:6/669: truncate d2/fb 6199235 0 2024-09-06T14:45:03.305 INFO:tasks.workunit.client.0.smithi052.stdout:6/670: truncate d2/dd/d18/d2d/d32/f40 2404140 0 2024-09-06T14:45:03.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/671: symlink d2/dd/d81/ld7 0 2024-09-06T14:45:03.309 INFO:tasks.workunit.client.0.smithi052.stdout:6/672: readlink d2/dd/d81/la3 0 2024-09-06T14:45:03.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:02 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:03.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:02 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:03.508 INFO:tasks.workunit.client.0.smithi052.stdout:0/785: sync 2024-09-06T14:45:03.510 INFO:tasks.workunit.client.0.smithi052.stdout:0/786: read - d0/d1a/d26/d3a/d14/d20/d22/d41/d8a/fb2 zero size 2024-09-06T14:45:03.512 INFO:tasks.workunit.client.0.smithi052.stdout:0/787: read - d0/d1a/d26/d3a/d14/d2d/d92/fcd zero size 2024-09-06T14:45:03.514 INFO:tasks.workunit.client.0.smithi052.stdout:0/788: mknod d0/d3d/c116 0 2024-09-06T14:45:03.516 INFO:tasks.workunit.client.0.smithi052.stdout:0/789: read - d0/d1a/d26/d3a/d14/d2d/d94/fc1 zero size 2024-09-06T14:45:03.519 INFO:tasks.workunit.client.0.smithi052.stdout:0/790: symlink d0/d1a/d26/d3a/d14/d2d/l117 0 2024-09-06T14:45:03.520 INFO:tasks.workunit.client.0.smithi052.stdout:0/791: creat d0/d1a/daa/f118 x:0 0 0 2024-09-06T14:45:03.535 INFO:tasks.workunit.client.0.smithi052.stdout:0/792: dwrite d0/d1a/daa/fc6 [0,4194304] 0 2024-09-06T14:45:03.540 INFO:tasks.workunit.client.0.smithi052.stdout:0/793: rename d0/d19/fee to d0/d18/f119 0 2024-09-06T14:45:03.541 INFO:tasks.workunit.client.0.smithi052.stdout:0/794: chown d0/d1a/d26/d3a/d14/d20/d22/d41/f64 0 1 2024-09-06T14:45:03.547 INFO:tasks.workunit.client.0.smithi052.stdout:0/795: dwrite d0/d2e/fac [0,4194304] 0 2024-09-06T14:45:03.548 INFO:tasks.workunit.client.0.smithi052.stdout:0/796: stat d0/d1a/d26 0 2024-09-06T14:45:03.551 INFO:tasks.workunit.client.0.smithi052.stdout:0/797: creat d0/d1a/d26/d3a/d14/f11a x:0 0 0 2024-09-06T14:45:03.553 INFO:tasks.workunit.client.0.smithi052.stdout:0/798: rmdir d0/d7e 39 2024-09-06T14:45:03.558 INFO:tasks.workunit.client.0.smithi052.stdout:0/799: creat d0/d7e/ddb/f11b x:0 0 0 2024-09-06T14:45:03.560 INFO:tasks.workunit.client.0.smithi052.stdout:0/800: creat d0/d1a/d8e/f11c x:0 0 0 2024-09-06T14:45:03.563 INFO:tasks.workunit.client.0.smithi052.stdout:0/801: creat d0/d1a/d26/d3a/d14/d2d/d94/f11d x:0 0 0 2024-09-06T14:45:03.566 INFO:tasks.workunit.client.0.smithi052.stdout:0/802: symlink d0/d1a/d26/d3a/d14/d20/d22/d41/l11e 0 2024-09-06T14:45:03.569 INFO:tasks.workunit.client.0.smithi052.stdout:0/803: symlink d0/d1a/d26/d3a/d14/d20/d22/d55/l11f 0 2024-09-06T14:45:03.583 INFO:tasks.workunit.client.0.smithi052.stdout:0/804: dread d0/d18/f5f [4194304,4194304] 0 2024-09-06T14:45:03.584 INFO:tasks.workunit.client.0.smithi052.stdout:0/805: chown d0/d3d/ded/lfe 912800 1 2024-09-06T14:45:03.586 INFO:tasks.workunit.client.0.smithi052.stdout:5/992: sync 2024-09-06T14:45:03.588 INFO:tasks.workunit.client.0.smithi052.stdout:5/993: read - d2/d1a/d22/d26/d2b/d48/f14a zero size 2024-09-06T14:45:03.589 INFO:tasks.workunit.client.0.smithi052.stdout:0/806: dwrite d0/f1c [0,4194304] 0 2024-09-06T14:45:03.593 INFO:tasks.workunit.client.0.smithi052.stdout:5/994: fdatasync d2/d1a/d22/d26/d2b/fdf 0 2024-09-06T14:45:03.599 INFO:tasks.workunit.client.0.smithi052.stdout:5/995: creat d2/d1a/d22/d26/d2b/d48/f14c x:0 0 0 2024-09-06T14:45:03.603 INFO:tasks.workunit.client.0.smithi052.stdout:0/807: dread d0/d1a/d26/d3a/d14/d20/d22/d41/f64 [4194304,4194304] 0 2024-09-06T14:45:03.604 INFO:tasks.workunit.client.0.smithi052.stdout:0/808: chown d0/d7e/ff8 1 1 2024-09-06T14:45:03.604 INFO:tasks.workunit.client.0.smithi052.stdout:5/996: symlink d2/d1a/d22/d26/d2b/d37/d84/d97/l14d 0 2024-09-06T14:45:03.607 INFO:tasks.workunit.client.0.smithi052.stdout:0/809: mkdir d0/d1a/daa/d120 0 2024-09-06T14:45:03.609 INFO:tasks.workunit.client.0.smithi052.stdout:5/997: unlink d2/d1a/d22/d26/d2b/d48/f4b 0 2024-09-06T14:45:03.609 INFO:tasks.workunit.client.0.smithi052.stdout:5/998: dread - d2/d20/d42/d8b/faa zero size 2024-09-06T14:45:03.611 INFO:tasks.workunit.client.0.smithi052.stdout:0/810: fsync d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/fbb 0 2024-09-06T14:45:03.618 INFO:tasks.workunit.client.0.smithi052.stdout:5/999: dwrite d2/d20/fd4 [0,4194304] 0 2024-09-06T14:45:03.620 INFO:tasks.workunit.client.0.smithi052.stdout:0/811: dwrite d0/d1a/d26/d3a/d14/d2d/de2/fe5 [0,4194304] 0 2024-09-06T14:45:03.624 INFO:tasks.workunit.client.0.smithi052.stdout:0/812: dread d0/f1c [0,4194304] 0 2024-09-06T14:45:03.630 INFO:tasks.workunit.client.0.smithi052.stdout:0/813: creat d0/d1a/d26/d3a/d14/d20/d108/f121 x:0 0 0 2024-09-06T14:45:03.640 INFO:tasks.workunit.client.0.smithi052.stdout:0/814: dread d0/d1a/d26/d3a/d14/d2d/d56/da3/dc2/fc9 [0,4194304] 0 2024-09-06T14:45:03.642 INFO:tasks.workunit.client.0.smithi052.stdout:0/815: mknod d0/d2e/c122 0 2024-09-06T14:45:03.643 INFO:tasks.workunit.client.0.smithi052.stdout:0/816: truncate d0/d1a/d26/db7/ff3 485609 0 2024-09-06T14:45:03.643 INFO:tasks.workunit.client.0.smithi052.stdout:0/817: truncate d0/d1a/d8e/f11c 435165 0 2024-09-06T14:45:03.644 INFO:tasks.workunit.client.0.smithi052.stdout:0/818: chown d0/d1a/l31 0 1 2024-09-06T14:45:03.655 INFO:tasks.workunit.client.0.smithi052.stdout:0/819: dwrite d0/d1a/d26/d3a/d14/d2d/f11 [0,4194304] 0 2024-09-06T14:45:03.658 INFO:tasks.workunit.client.0.smithi052.stdout:0/820: creat d0/d18/f123 x:0 0 0 2024-09-06T14:45:03.660 INFO:tasks.workunit.client.0.smithi052.stdout:0/821: symlink d0/d4f/l124 0 2024-09-06T14:45:03.664 INFO:tasks.workunit.client.0.smithi052.stdout:0/822: read d0/d4f/d7d/f62 [3819786,108236] 0 2024-09-06T14:45:03.683 INFO:tasks.workunit.client.0.smithi052.stdout:0/823: dread d0/d1a/d26/d3a/d14/d20/d22/d8b/faf [0,4194304] 0 2024-09-06T14:45:03.688 INFO:tasks.workunit.client.0.smithi052.stdout:0/824: getdents d0/d1a/d26/d3a/d14/d2d 0 2024-09-06T14:45:03.690 INFO:tasks.workunit.client.0.smithi052.stdout:0/825: write d0/d1a/d26/db7/ff3 [695692,23912] 0 2024-09-06T14:45:03.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/826: mknod d0/d1a/d26/d3a/d14/d20/c125 0 2024-09-06T14:45:03.817 INFO:tasks.workunit.client.0.smithi052.stdout:0/827: creat d0/d1a/d26/d3a/d14/d20/d22/f126 x:0 0 0 2024-09-06T14:45:03.818 INFO:tasks.workunit.client.0.smithi052.stdout:0/828: truncate d0/d1a/daa/ff9 468283 0 2024-09-06T14:45:03.819 INFO:tasks.workunit.client.0.smithi052.stdout:0/829: write d0/d2e/f9c [789151,125606] 0 2024-09-06T14:45:03.825 INFO:tasks.workunit.client.0.smithi052.stdout:0/830: dread d0/d3d/de4/ff7 [0,4194304] 0 2024-09-06T14:45:03.827 INFO:tasks.workunit.client.0.smithi052.stdout:0/831: mkdir d0/d18/dd6/d127 0 2024-09-06T14:45:03.831 INFO:tasks.workunit.client.0.smithi052.stdout:0/832: creat d0/d1a/d26/d3a/d14/d2d/d56/f128 x:0 0 0 2024-09-06T14:45:03.834 INFO:tasks.workunit.client.0.smithi052.stdout:0/833: link d0/d1a/d26/d3a/d14/d20/d108/f121 d0/d2e/f129 0 2024-09-06T14:45:03.836 INFO:tasks.workunit.client.0.smithi052.stdout:0/834: fdatasync d0/d2e/fb1 0 2024-09-06T14:45:03.840 INFO:tasks.workunit.client.0.smithi052.stdout:0/835: rename d0/d1a/d26/d3a/d14/d20/d22 to d0/d3d/d12a 0 2024-09-06T14:45:03.845 INFO:tasks.workunit.client.0.smithi052.stdout:0/836: unlink d0/d1a/d26/d3a/d14/d2d/de2/f111 0 2024-09-06T14:45:03.848 INFO:tasks.workunit.client.0.smithi052.stdout:0/837: rmdir d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60 39 2024-09-06T14:45:03.873 INFO:tasks.workunit.client.0.smithi052.stdout:0/838: write d0/d3d/d12a/d41/d8a/ff0 [251472,46451] 0 2024-09-06T14:45:03.879 INFO:tasks.workunit.client.0.smithi052.stdout:0/839: unlink d0/d1a/d26/d3a/d14/d2d/lf2 0 2024-09-06T14:45:03.902 INFO:tasks.workunit.client.0.smithi052.stdout:0/840: stat d0/d1a/d26/d3a/d14/d2d/d56/d9d 0 2024-09-06T14:45:03.908 INFO:tasks.workunit.client.0.smithi052.stdout:0/841: mknod d0/d1a/c12b 0 2024-09-06T14:45:03.913 INFO:tasks.workunit.client.0.smithi052.stdout:0/842: dread d0/d4f/fc4 [0,4194304] 0 2024-09-06T14:45:03.917 INFO:tasks.workunit.client.0.smithi052.stdout:0/843: creat d0/d1a/d26/d3a/d14/d2d/d94/dda/f12c x:0 0 0 2024-09-06T14:45:03.925 INFO:tasks.workunit.client.0.smithi052.stdout:0/844: truncate d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/f6c 258519 0 2024-09-06T14:45:03.928 INFO:tasks.workunit.client.0.smithi052.stdout:0/845: rename d0/d1a/d26/d3a/d7a to d0/d2e/d12d 0 2024-09-06T14:45:03.940 INFO:tasks.workunit.client.0.smithi052.stdout:0/846: dwrite d0/d3d/d12a/d41/d8a/fb2 [0,4194304] 0 2024-09-06T14:45:03.961 INFO:tasks.workunit.client.0.smithi052.stdout:0/847: dread d0/d1a/d26/d3a/ffa [0,4194304] 0 2024-09-06T14:45:03.964 INFO:tasks.workunit.client.0.smithi052.stdout:0/848: creat d0/d1a/d26/d3a/d14/d2d/d94/dda/f12e x:0 0 0 2024-09-06T14:45:03.966 INFO:tasks.workunit.client.0.smithi052.stdout:0/849: mkdir d0/d1a/d26/d3a/d14/d20/d108/d12f 0 2024-09-06T14:45:03.966 INFO:tasks.workunit.client.0.smithi052.stdout:0/850: chown d0/d1a/c12b 1211233698 1 2024-09-06T14:45:03.971 INFO:tasks.workunit.client.0.smithi052.stdout:0/851: link d0/d1a/d26/d3a/d14/d2d/d92/f105 d0/d4f/d7d/f130 0 2024-09-06T14:45:03.973 INFO:tasks.workunit.client.0.smithi052.stdout:0/852: creat d0/d1a/de8/f131 x:0 0 0 2024-09-06T14:45:03.975 INFO:tasks.workunit.client.0.smithi052.stdout:0/853: creat d0/d1a/daa/d120/f132 x:0 0 0 2024-09-06T14:45:03.976 INFO:tasks.workunit.client.0.smithi052.stdout:0/854: mknod d0/d1a/daa/c133 0 2024-09-06T14:45:03.979 INFO:tasks.workunit.client.0.smithi052.stdout:0/855: unlink d0/d1a/d26/d3a/d14/d2d/d56/ce0 0 2024-09-06T14:45:03.981 INFO:tasks.workunit.client.0.smithi052.stdout:0/856: mknod d0/d2e/d12d/d100/c134 0 2024-09-06T14:45:03.981 INFO:tasks.workunit.client.0.smithi052.stdout:0/857: dread - d0/d1a/daa/d120/f132 zero size 2024-09-06T14:45:03.985 INFO:tasks.workunit.client.0.smithi052.stdout:0/858: rename d0/d3d/d12a/d55/fd8 to d0/d1a/d26/d3a/d14/d2d/d56/da3/dc2/f135 0 2024-09-06T14:45:03.986 INFO:tasks.workunit.client.0.smithi052.stdout:0/859: truncate d0/d1a/d8e/f11c 522216 0 2024-09-06T14:45:03.991 INFO:tasks.workunit.client.0.smithi052.stdout:0/860: link d0/d1a/d26/f4e d0/d7e/f136 0 2024-09-06T14:45:03.992 INFO:tasks.workunit.client.0.smithi052.stdout:0/861: write d0/d1a/d26/d3a/d14/d20/f48 [2246510,55730] 0 2024-09-06T14:45:03.998 INFO:tasks.workunit.client.0.smithi052.stdout:0/862: dwrite d0/d3d/d12a/f126 [0,4194304] 0 2024-09-06T14:45:04.002 INFO:tasks.workunit.client.0.smithi052.stdout:0/863: creat d0/d1a/de8/f137 x:0 0 0 2024-09-06T14:45:04.002 INFO:tasks.workunit.client.0.smithi052.stdout:0/864: chown d0/d3d/d12a/d55 257516507 1 2024-09-06T14:45:04.010 INFO:tasks.workunit.client.0.smithi052.stdout:0/865: dwrite d0/d1a/d26/d3a/d14/d2d/d94/dda/f12e [0,4194304] 0 2024-09-06T14:45:04.012 INFO:tasks.workunit.client.0.smithi052.stdout:0/866: fsync d0/d1a/d26/f87 0 2024-09-06T14:45:04.018 INFO:tasks.workunit.client.0.smithi052.stdout:0/867: rename d0/d1a/d26/d3a/d14/d2d/d94/fc1 to d0/d1a/d26/db7/de7/f138 0 2024-09-06T14:45:04.033 INFO:tasks.workunit.client.0.smithi052.stdout:0/868: write d0/d1a/d26/d3a/d14/d2d/fa9 [950002,73088] 0 2024-09-06T14:45:04.037 INFO:tasks.workunit.client.0.smithi052.stdout:0/869: write d0/f1c [3359967,115727] 0 2024-09-06T14:45:04.042 INFO:tasks.workunit.client.0.smithi052.stdout:0/870: rename d0/d3d/d12a/d41/f64 to d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/f139 0 2024-09-06T14:45:04.047 INFO:tasks.workunit.client.0.smithi052.stdout:0/871: link d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/cb4 d0/d1a/daa/d120/c13a 0 2024-09-06T14:45:04.048 INFO:tasks.workunit.client.0.smithi052.stdout:0/872: fdatasync d0/d1a/d26/d3a/d14/d2d/d94/f11d 0 2024-09-06T14:45:04.050 INFO:tasks.workunit.client.0.smithi052.stdout:0/873: write d0/d1a/daa/ff9 [827657,81955] 0 2024-09-06T14:45:04.050 INFO:tasks.workunit.client.0.smithi052.stdout:1/919: sync 2024-09-06T14:45:04.050 INFO:tasks.workunit.client.0.smithi052.stdout:4/831: sync 2024-09-06T14:45:04.051 INFO:tasks.workunit.client.0.smithi052.stdout:2/839: sync 2024-09-06T14:45:04.051 INFO:tasks.workunit.client.0.smithi052.stdout:4/832: stat d9/d10/d19/lfa 0 2024-09-06T14:45:04.053 INFO:tasks.workunit.client.0.smithi052.stdout:4/833: dread - d9/d2d/d33/d5d/da6/deb/d81/d9c/dac/ffd zero size 2024-09-06T14:45:04.058 INFO:tasks.workunit.client.0.smithi052.stdout:0/874: link d0/d1a/d8e/c112 d0/c13b 0 2024-09-06T14:45:04.059 INFO:tasks.workunit.client.0.smithi052.stdout:0/875: write d0/d1a/d26/d3a/d14/d2d/d56/f128 [44313,69313] 0 2024-09-06T14:45:04.060 INFO:tasks.workunit.client.0.smithi052.stdout:4/834: mknod d9/d121/c126 0 2024-09-06T14:45:04.062 INFO:tasks.workunit.client.0.smithi052.stdout:1/920: getdents d1/db/de/d74/d14/d90 0 2024-09-06T14:45:04.068 INFO:tasks.workunit.client.0.smithi052.stdout:4/835: rename d9/d2d/d33/c85 to d9/d2d/d33/d5d/da6/deb/d81/c127 0 2024-09-06T14:45:04.068 INFO:tasks.workunit.client.0.smithi052.stdout:1/921: dwrite d1/db/d18/dc9/fd9 [0,4194304] 0 2024-09-06T14:45:04.076 INFO:tasks.workunit.client.0.smithi052.stdout:4/836: unlink d9/d10/d17/d39/d3a/d5c/fa2 0 2024-09-06T14:45:04.077 INFO:tasks.workunit.client.0.smithi052.stdout:1/922: dwrite d1/db/de/d74/d14/d9f/fdb [4194304,4194304] 0 2024-09-06T14:45:04.086 INFO:tasks.workunit.client.0.smithi052.stdout:1/923: rename d1/db/d72/d81/c109 to d1/db/d18/d5c/c143 0 2024-09-06T14:45:04.088 INFO:tasks.workunit.client.0.smithi052.stdout:4/837: mkdir d9/d10/d19/ddf/d128 0 2024-09-06T14:45:04.092 INFO:tasks.workunit.client.0.smithi052.stdout:1/924: unlink d1/db/f52 0 2024-09-06T14:45:04.093 INFO:tasks.workunit.client.0.smithi052.stdout:4/838: mknod d9/d2d/d33/d5d/da6/deb/d81/d9c/dac/c129 0 2024-09-06T14:45:04.095 INFO:tasks.workunit.client.0.smithi052.stdout:4/839: chown d9/da1/f11b 239648 1 2024-09-06T14:45:04.095 INFO:tasks.workunit.client.0.smithi052.stdout:1/925: mkdir d1/db/de/d74/d36/d9b/d144 0 2024-09-06T14:45:04.099 INFO:tasks.workunit.client.0.smithi052.stdout:1/926: mknod d1/db/de/d74/d36/d7c/c145 0 2024-09-06T14:45:04.104 INFO:tasks.workunit.client.0.smithi052.stdout:1/927: creat d1/db/de/d74/d14/dd1/f146 x:0 0 0 2024-09-06T14:45:04.108 INFO:tasks.workunit.client.0.smithi052.stdout:4/840: write d9/d10/f6e [111454,31458] 0 2024-09-06T14:45:04.110 INFO:tasks.workunit.client.0.smithi052.stdout:1/928: getdents d1/db/d18 0 2024-09-06T14:45:04.113 INFO:tasks.workunit.client.0.smithi052.stdout:1/929: fdatasync d1/db/de/d74/d14/d90/ffc 0 2024-09-06T14:45:04.115 INFO:tasks.workunit.client.0.smithi052.stdout:4/841: dwrite d9/d2d/d33/d5d/da6/f75 [0,4194304] 0 2024-09-06T14:45:04.121 INFO:tasks.workunit.client.0.smithi052.stdout:1/930: truncate d1/db/f3f 641109 0 2024-09-06T14:45:04.123 INFO:tasks.workunit.client.0.smithi052.stdout:1/931: dread d1/db/d76/f123 [0,4194304] 0 2024-09-06T14:45:04.128 INFO:tasks.workunit.client.0.smithi052.stdout:4/842: write d9/d10/d17/d39/d7b/d91/fc3 [408841,110064] 0 2024-09-06T14:45:04.129 INFO:tasks.workunit.client.0.smithi052.stdout:4/843: dread - d9/d72/f10c zero size 2024-09-06T14:45:04.129 INFO:tasks.workunit.client.0.smithi052.stdout:4/844: readlink d9/l3e 0 2024-09-06T14:45:04.131 INFO:tasks.workunit.client.0.smithi052.stdout:4/845: fsync d9/d10/d17/d39/d7b/d91/d9e/f107 0 2024-09-06T14:45:04.132 INFO:tasks.workunit.client.0.smithi052.stdout:1/932: creat d1/db/d76/f147 x:0 0 0 2024-09-06T14:45:04.135 INFO:tasks.workunit.client.0.smithi052.stdout:1/933: mknod d1/db/d18/c148 0 2024-09-06T14:45:04.137 INFO:tasks.workunit.client.0.smithi052.stdout:4/846: creat d9/d10/d19/de4/f12a x:0 0 0 2024-09-06T14:45:04.140 INFO:tasks.workunit.client.0.smithi052.stdout:1/934: mkdir d1/db/d50/da4/d149 0 2024-09-06T14:45:04.144 INFO:tasks.workunit.client.0.smithi052.stdout:1/935: dread d1/d6c/d98/f9e [0,4194304] 0 2024-09-06T14:45:04.152 INFO:tasks.workunit.client.0.smithi052.stdout:1/936: getdents d1/db/d50/da4/d149 0 2024-09-06T14:45:04.153 INFO:tasks.workunit.client.0.smithi052.stdout:4/847: dread d9/f69 [0,4194304] 0 2024-09-06T14:45:04.157 INFO:tasks.workunit.client.0.smithi052.stdout:4/848: mkdir d9/d121/d12b 0 2024-09-06T14:45:04.161 INFO:tasks.workunit.client.0.smithi052.stdout:4/849: creat d9/d2d/d33/d5d/da6/deb/d81/d9c/dac/f12c x:0 0 0 2024-09-06T14:45:04.163 INFO:tasks.workunit.client.0.smithi052.stdout:4/850: creat d9/d2d/d33/d5d/da6/deb/d81/d9c/dac/f12d x:0 0 0 2024-09-06T14:45:04.165 INFO:tasks.workunit.client.0.smithi052.stdout:4/851: mknod d9/d2d/c12e 0 2024-09-06T14:45:04.168 INFO:tasks.workunit.client.0.smithi052.stdout:1/937: dwrite d1/db/de/d68/df3/f132 [0,4194304] 0 2024-09-06T14:45:04.172 INFO:tasks.workunit.client.0.smithi052.stdout:4/852: link d9/da1/fc5 d9/d10/d19/d10d/f12f 0 2024-09-06T14:45:04.185 INFO:tasks.workunit.client.0.smithi052.stdout:1/938: dwrite d1/db/de/d74/d14/f25 [0,4194304] 0 2024-09-06T14:45:04.189 INFO:tasks.workunit.client.0.smithi052.stdout:4/853: write d9/d2d/f8d [5162407,75553] 0 2024-09-06T14:45:04.192 INFO:tasks.workunit.client.0.smithi052.stdout:1/939: write d1/db/de/d74/d14/dda/ffb [452090,115571] 0 2024-09-06T14:45:04.195 INFO:tasks.workunit.client.0.smithi052.stdout:4/854: dread d9/d10/d17/d39/d3a/f92 [0,4194304] 0 2024-09-06T14:45:04.197 INFO:tasks.workunit.client.0.smithi052.stdout:1/940: dread d1/db/de/d74/d12/f34 [0,4194304] 0 2024-09-06T14:45:04.198 INFO:tasks.workunit.client.0.smithi052.stdout:1/941: stat d1/db/de/d74/d12/c38 0 2024-09-06T14:45:04.198 INFO:tasks.workunit.client.0.smithi052.stdout:4/855: mknod d9/d10/d19/ddf/d128/c130 0 2024-09-06T14:45:04.199 INFO:tasks.workunit.client.0.smithi052.stdout:1/942: write d1/fc8 [1319363,13632] 0 2024-09-06T14:45:04.201 INFO:tasks.workunit.client.0.smithi052.stdout:4/856: write d9/d10/d17/d39/d3a/fb1 [4956996,22976] 0 2024-09-06T14:45:04.202 INFO:tasks.workunit.client.0.smithi052.stdout:1/943: dread d1/db/de/d74/d36/f125 [0,4194304] 0 2024-09-06T14:45:04.203 INFO:tasks.workunit.client.0.smithi052.stdout:4/857: symlink d9/d121/l131 0 2024-09-06T14:45:04.204 INFO:tasks.workunit.client.0.smithi052.stdout:1/944: chown d1/db/de/d74/d14/d9f/dcc/l103 0 1 2024-09-06T14:45:04.204 INFO:tasks.workunit.client.0.smithi052.stdout:4/858: write d9/d10/d17/daa/db5/f11f [990493,80512] 0 2024-09-06T14:45:04.207 INFO:tasks.workunit.client.0.smithi052.stdout:4/859: rmdir d9/d10/d17/d39/d3a 39 2024-09-06T14:45:04.208 INFO:tasks.workunit.client.0.smithi052.stdout:1/945: symlink d1/db/de/d74/d14/d90/l14a 0 2024-09-06T14:45:04.210 INFO:tasks.workunit.client.0.smithi052.stdout:4/860: symlink d9/d10/d17/daa/db5/l132 0 2024-09-06T14:45:04.212 INFO:tasks.workunit.client.0.smithi052.stdout:1/946: getdents d1/db/de/d74/d36/d9b/d144 0 2024-09-06T14:45:04.218 INFO:tasks.workunit.client.0.smithi052.stdout:4/861: dwrite d9/d2d/f100 [0,4194304] 0 2024-09-06T14:45:04.227 INFO:tasks.workunit.client.0.smithi052.stdout:1/947: dread d1/db/de/d74/ff8 [0,4194304] 0 2024-09-06T14:45:04.230 INFO:tasks.workunit.client.0.smithi052.stdout:4/862: dread d9/d10/d17/d39/d3a/d5c/f9d [0,4194304] 0 2024-09-06T14:45:04.235 INFO:tasks.workunit.client.0.smithi052.stdout:4/863: rmdir d9/d10/d19/d10d 39 2024-09-06T14:45:04.237 INFO:tasks.workunit.client.0.smithi052.stdout:1/948: dread d1/db/f3f [0,4194304] 0 2024-09-06T14:45:04.252 INFO:tasks.workunit.client.0.smithi052.stdout:1/949: creat d1/db/d72/d81/d10c/f14b x:0 0 0 2024-09-06T14:45:04.255 INFO:tasks.workunit.client.0.smithi052.stdout:4/864: dread d9/d10/d19/f3c [0,4194304] 0 2024-09-06T14:45:04.258 INFO:tasks.workunit.client.0.smithi052.stdout:4/865: symlink d9/d2d/l133 0 2024-09-06T14:45:04.263 INFO:tasks.workunit.client.0.smithi052.stdout:4/866: link d9/d2d/d33/d5d/da6/deb/d81/dc1/cf0 d9/d10/d17/d39/d7b/d91/d9e/c134 0 2024-09-06T14:45:04.264 INFO:tasks.workunit.client.0.smithi052.stdout:4/867: chown d9/d2d/d33/d5d/da6/d83/cd3 210439853 1 2024-09-06T14:45:04.267 INFO:tasks.workunit.client.0.smithi052.stdout:4/868: creat d9/d2d/d33/d5d/f135 x:0 0 0 2024-09-06T14:45:04.270 INFO:tasks.workunit.client.0.smithi052.stdout:1/950: dwrite d1/db/d76/f123 [0,4194304] 0 2024-09-06T14:45:04.270 INFO:tasks.workunit.client.0.smithi052.stdout:4/869: readlink d9/d2d/l32 0 2024-09-06T14:45:04.275 INFO:tasks.workunit.client.0.smithi052.stdout:1/951: creat d1/db/de/d74/d12/dd3/de5/f14c x:0 0 0 2024-09-06T14:45:04.282 INFO:tasks.workunit.client.0.smithi052.stdout:4/870: write d9/d10/fbb [199197,67200] 0 2024-09-06T14:45:04.283 INFO:tasks.workunit.client.0.smithi052.stdout:4/871: chown d9/c113 6 1 2024-09-06T14:45:04.283 INFO:tasks.workunit.client.0.smithi052.stdout:1/952: link d1/db/de/d74/c1a d1/db/de/d74/d14/d9f/dcc/d47/d4a/d139/c14d 0 2024-09-06T14:45:04.285 INFO:tasks.workunit.client.0.smithi052.stdout:1/953: dread d1/db/f142 [0,4194304] 0 2024-09-06T14:45:04.286 INFO:tasks.workunit.client.0.smithi052.stdout:4/872: symlink d9/d10/d17/d39/d7b/d91/l136 0 2024-09-06T14:45:04.288 INFO:tasks.workunit.client.0.smithi052.stdout:4/873: write d9/d10/d17/d39/d3a/ff6 [1380410,100133] 0 2024-09-06T14:45:04.290 INFO:tasks.workunit.client.0.smithi052.stdout:1/954: rename d1/db/de/d74/d36/l4f to d1/db/d122/l14e 0 2024-09-06T14:45:04.291 INFO:tasks.workunit.client.0.smithi052.stdout:4/874: symlink d9/d2d/d33/d5d/da6/deb/d81/dc1/l137 0 2024-09-06T14:45:04.292 INFO:tasks.workunit.client.0.smithi052.stdout:1/955: rmdir d1/db/de/d74/d36/d7c 39 2024-09-06T14:45:04.293 INFO:tasks.workunit.client.0.smithi052.stdout:4/875: dread d9/d10/d17/d39/d3a/d5c/f9d [0,4194304] 0 2024-09-06T14:45:04.302 INFO:tasks.workunit.client.0.smithi052.stdout:4/876: dwrite d9/d10/d19/f48 [0,4194304] 0 2024-09-06T14:45:04.305 INFO:tasks.workunit.client.0.smithi052.stdout:1/956: dread d1/db/de/d74/d14/d90/de6/f12a [0,4194304] 0 2024-09-06T14:45:04.307 INFO:tasks.workunit.client.0.smithi052.stdout:1/957: write d1/db/de/d74/d12/dd3/de5/f14c [766293,87167] 0 2024-09-06T14:45:04.311 INFO:tasks.workunit.client.0.smithi052.stdout:1/958: creat d1/db/de/d68/f14f x:0 0 0 2024-09-06T14:45:04.315 INFO:tasks.workunit.client.0.smithi052.stdout:1/959: dwrite d1/db/de/d74/ff [0,4194304] 0 2024-09-06T14:45:04.320 INFO:tasks.workunit.client.0.smithi052.stdout:1/960: read d1/db/de/d74/d12/fb9 [604039,108694] 0 2024-09-06T14:45:04.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:03 smithi165 ceph-mon[36229]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 58 MiB/s rd, 143 MiB/s wr, 398 op/s 2024-09-06T14:45:04.324 INFO:tasks.workunit.client.0.smithi052.stdout:1/961: mkdir d1/d6c/d150 0 2024-09-06T14:45:04.328 INFO:tasks.workunit.client.0.smithi052.stdout:1/962: getdents d1/db/de/d68 0 2024-09-06T14:45:04.331 INFO:tasks.workunit.client.0.smithi052.stdout:1/963: symlink d1/db/d50/da4/d149/l151 0 2024-09-06T14:45:04.335 INFO:tasks.workunit.client.0.smithi052.stdout:1/964: link d1/db/de/d74/d12/dd3/l113 d1/db/de/d74/d14/d90/l152 0 2024-09-06T14:45:04.338 INFO:tasks.workunit.client.0.smithi052.stdout:1/965: unlink d1/db/de/d74/d14/d9f/dcc/f5a 0 2024-09-06T14:45:04.340 INFO:tasks.workunit.client.0.smithi052.stdout:1/966: symlink d1/d6c/l153 0 2024-09-06T14:45:04.344 INFO:tasks.workunit.client.0.smithi052.stdout:1/967: rename d1/db/d50/da4/le7 to d1/db/de/d74/d14/d2e/l154 0 2024-09-06T14:45:04.348 INFO:tasks.workunit.client.0.smithi052.stdout:1/968: getdents d1/db/d18/d5c 0 2024-09-06T14:45:04.352 INFO:tasks.workunit.client.0.smithi052.stdout:1/969: rename d1/db/de/d74/d14/dda/d141 to d1/db/d72/d81/d10c/d155 0 2024-09-06T14:45:04.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:03 smithi052 ceph-mon[28627]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 58 MiB/s rd, 143 MiB/s wr, 398 op/s 2024-09-06T14:45:04.399 INFO:tasks.workunit.client.0.smithi052.stdout:6/673: sync 2024-09-06T14:45:04.399 INFO:tasks.workunit.client.0.smithi052.stdout:9/876: sync 2024-09-06T14:45:04.399 INFO:tasks.workunit.client.0.smithi052.stdout:7/834: sync 2024-09-06T14:45:04.399 INFO:tasks.workunit.client.0.smithi052.stdout:3/907: sync 2024-09-06T14:45:04.402 INFO:tasks.workunit.client.0.smithi052.stdout:3/908: write d0/d11/d12/d4c/d93/d35/d46/d5b/fb3 [2615500,114398] 0 2024-09-06T14:45:04.404 INFO:tasks.workunit.client.0.smithi052.stdout:7/835: unlink d11/d1c/d24/d3b/d50/cd1 0 2024-09-06T14:45:04.405 INFO:tasks.workunit.client.0.smithi052.stdout:9/877: dread d1/d4/d6/dd1/dd9/dc2/ff2 [0,4194304] 0 2024-09-06T14:45:04.406 INFO:tasks.workunit.client.0.smithi052.stdout:3/909: truncate d0/d11/d12/d4c/d93/d35/d46/f10f 857298 0 2024-09-06T14:45:04.407 INFO:tasks.workunit.client.0.smithi052.stdout:9/878: write d1/d4/d6/dd1/dd9/dc2/fe7 [875735,96320] 0 2024-09-06T14:45:04.411 INFO:tasks.workunit.client.0.smithi052.stdout:6/674: dread d2/dd/d7d/fa8 [0,4194304] 0 2024-09-06T14:45:04.412 INFO:tasks.workunit.client.0.smithi052.stdout:3/910: read d0/d11/d12/d4c/d93/f88 [784962,97210] 0 2024-09-06T14:45:04.414 INFO:tasks.workunit.client.0.smithi052.stdout:9/879: creat d1/d4/d6/dd1/f10a x:0 0 0 2024-09-06T14:45:04.415 INFO:tasks.workunit.client.0.smithi052.stdout:7/836: mkdir d11/d1c/d24/d7e/df4/d104 0 2024-09-06T14:45:04.417 INFO:tasks.workunit.client.0.smithi052.stdout:3/911: truncate d0/d11/d12/d73/f99 5005114 0 2024-09-06T14:45:04.419 INFO:tasks.workunit.client.0.smithi052.stdout:3/912: fdatasync d0/d11/d12/d4c/d93/d35/db5/ffe 0 2024-09-06T14:45:04.419 INFO:tasks.workunit.client.0.smithi052.stdout:9/880: symlink d1/d4/d6/dc/d10/d18/d82/d9e/dfc/l10b 0 2024-09-06T14:45:04.421 INFO:tasks.workunit.client.0.smithi052.stdout:6/675: rmdir d2/d4a 39 2024-09-06T14:45:04.423 INFO:tasks.workunit.client.0.smithi052.stdout:7/837: mkdir d11/d1c/d57/d89/de5/d105 0 2024-09-06T14:45:04.424 INFO:tasks.workunit.client.0.smithi052.stdout:7/838: chown d11/d1c/d24/d4b/da2/fe8 1 1 2024-09-06T14:45:04.425 INFO:tasks.workunit.client.0.smithi052.stdout:3/913: chown d0/d11/d12/dea/c10b 226 1 2024-09-06T14:45:04.428 INFO:tasks.workunit.client.0.smithi052.stdout:9/881: creat d1/d4/d6/dc/d10/d73/da9/df8/f10c x:0 0 0 2024-09-06T14:45:04.437 INFO:tasks.workunit.client.0.smithi052.stdout:7/839: dread d11/d1c/d24/d3b/d50/f6e [0,4194304] 0 2024-09-06T14:45:04.437 INFO:tasks.workunit.client.0.smithi052.stdout:9/882: creat d1/d4/d6/dc/d10/dbe/deb/f10d x:0 0 0 2024-09-06T14:45:04.438 INFO:tasks.workunit.client.0.smithi052.stdout:3/914: getdents d0/d11/d71/d98/d111 0 2024-09-06T14:45:04.438 INFO:tasks.workunit.client.0.smithi052.stdout:9/883: write d1/d4/d6/dc/d10/d73/fae [623554,111930] 0 2024-09-06T14:45:04.439 INFO:tasks.workunit.client.0.smithi052.stdout:7/840: creat d11/d1c/d24/d4b/da2/f106 x:0 0 0 2024-09-06T14:45:04.440 INFO:tasks.workunit.client.0.smithi052.stdout:7/841: chown d11/d1c/d57/f9f 103077282 1 2024-09-06T14:45:04.441 INFO:tasks.workunit.client.0.smithi052.stdout:3/915: symlink d0/d11/d71/d98/d1b/l121 0 2024-09-06T14:45:04.442 INFO:tasks.workunit.client.0.smithi052.stdout:9/884: chown d1/d4/d6/dc/d10/d18/c27 383686 1 2024-09-06T14:45:04.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/916: mknod d0/d11/d12/d73/de8/d112/da6/c122 0 2024-09-06T14:45:04.447 INFO:tasks.workunit.client.0.smithi052.stdout:7/842: dread d11/d1c/d24/d4b/f9b [0,4194304] 0 2024-09-06T14:45:04.448 INFO:tasks.workunit.client.0.smithi052.stdout:9/885: creat d1/d4/d6/dc/d10/d18/d82/d9e/dfc/f10e x:0 0 0 2024-09-06T14:45:04.449 INFO:tasks.workunit.client.0.smithi052.stdout:3/917: unlink d0/d11/d12/c90 0 2024-09-06T14:45:04.451 INFO:tasks.workunit.client.0.smithi052.stdout:9/886: unlink d1/d4/df/cca 0 2024-09-06T14:45:04.452 INFO:tasks.workunit.client.0.smithi052.stdout:7/843: symlink d11/d1c/d57/d89/de5/d105/l107 0 2024-09-06T14:45:04.453 INFO:tasks.workunit.client.0.smithi052.stdout:9/887: chown d1/d4/df/f59 220692 1 2024-09-06T14:45:04.456 INFO:tasks.workunit.client.0.smithi052.stdout:3/918: dwrite d0/d11/d12/d4c/f101 [0,4194304] 0 2024-09-06T14:45:04.456 INFO:tasks.workunit.client.0.smithi052.stdout:7/844: mknod d11/d1c/d24/d64/c108 0 2024-09-06T14:45:04.457 INFO:tasks.workunit.client.0.smithi052.stdout:3/919: stat d0/d11/d12/d4c 0 2024-09-06T14:45:04.459 INFO:tasks.workunit.client.0.smithi052.stdout:3/920: write d0/d11/d71/d98/d19/fc6 [214603,76848] 0 2024-09-06T14:45:04.468 INFO:tasks.workunit.client.0.smithi052.stdout:3/921: creat d0/d11/d12/d73/f123 x:0 0 0 2024-09-06T14:45:04.473 INFO:tasks.workunit.client.0.smithi052.stdout:9/888: link d1/d4/d6/dd/c6b d1/d4/d6/dc/d10/d18/d82/da6/c10f 0 2024-09-06T14:45:04.476 INFO:tasks.workunit.client.0.smithi052.stdout:3/922: mkdir d0/d11/d71/d98/d124 0 2024-09-06T14:45:04.477 INFO:tasks.workunit.client.0.smithi052.stdout:7/845: dread d11/d1c/d24/d3b/d50/f8c [0,4194304] 0 2024-09-06T14:45:04.478 INFO:tasks.workunit.client.0.smithi052.stdout:9/889: dread d1/d4/d6/dd/f13 [4194304,4194304] 0 2024-09-06T14:45:04.480 INFO:tasks.workunit.client.0.smithi052.stdout:9/890: rmdir d1/d4/d6/dc/d10/d18 39 2024-09-06T14:45:04.484 INFO:tasks.workunit.client.0.smithi052.stdout:3/923: rename d0/d11/d71/d98/d1b/d85/d9f/lbc to d0/d11/d12/d73/l125 0 2024-09-06T14:45:04.485 INFO:tasks.workunit.client.0.smithi052.stdout:9/891: creat d1/d4/d6/dc/f110 x:0 0 0 2024-09-06T14:45:04.487 INFO:tasks.workunit.client.0.smithi052.stdout:3/924: creat d0/d11/d71/d98/d111/f126 x:0 0 0 2024-09-06T14:45:04.491 INFO:tasks.workunit.client.0.smithi052.stdout:9/892: fsync d1/f23 0 2024-09-06T14:45:04.494 INFO:tasks.workunit.client.0.smithi052.stdout:9/893: symlink d1/d4/d6/dd1/l111 0 2024-09-06T14:45:04.498 INFO:tasks.workunit.client.0.smithi052.stdout:9/894: write d1/d4/d6/dc/d10/d18/d82/fe0 [3462616,63679] 0 2024-09-06T14:45:04.499 INFO:tasks.workunit.client.0.smithi052.stdout:3/925: dwrite d0/fd0 [0,4194304] 0 2024-09-06T14:45:04.503 INFO:tasks.workunit.client.0.smithi052.stdout:9/895: read d1/d4/d6/dd1/dd9/dc2/ff2 [488766,100265] 0 2024-09-06T14:45:04.505 INFO:tasks.workunit.client.0.smithi052.stdout:3/926: unlink d0/d11/d12/d4c/d93/d35/d46/d5b/cb0 0 2024-09-06T14:45:04.508 INFO:tasks.workunit.client.0.smithi052.stdout:9/896: dread d1/d26/d87/fc5 [0,4194304] 0 2024-09-06T14:45:04.516 INFO:tasks.workunit.client.0.smithi052.stdout:9/897: symlink d1/d4/d6/dc/d10/d18/l112 0 2024-09-06T14:45:04.517 INFO:tasks.workunit.client.0.smithi052.stdout:9/898: chown d1/d26/d3d/de6 17551013 1 2024-09-06T14:45:04.518 INFO:tasks.workunit.client.0.smithi052.stdout:9/899: read - d1/d4/d6/dc/d10/dbe/deb/f10d zero size 2024-09-06T14:45:04.519 INFO:tasks.workunit.client.0.smithi052.stdout:9/900: write d1/d4/f7 [26788,34914] 0 2024-09-06T14:45:04.522 INFO:tasks.workunit.client.0.smithi052.stdout:9/901: truncate d1/d4/d6/dc/f61 1876256 0 2024-09-06T14:45:04.525 INFO:tasks.workunit.client.0.smithi052.stdout:9/902: dread d1/d4/d6/dc/d10/dbe/fff [0,4194304] 0 2024-09-06T14:45:04.527 INFO:tasks.workunit.client.0.smithi052.stdout:9/903: dread - d1/d4/d6/dd/de8/de9/dfb/f104 zero size 2024-09-06T14:45:04.531 INFO:tasks.workunit.client.0.smithi052.stdout:9/904: creat d1/d4/d6/dc/d10/d73/f113 x:0 0 0 2024-09-06T14:45:04.533 INFO:tasks.workunit.client.0.smithi052.stdout:3/927: dread d0/d11/d71/d98/d1b/d85/faa [0,4194304] 0 2024-09-06T14:45:04.534 INFO:tasks.workunit.client.0.smithi052.stdout:9/905: fsync d1/d4/d6/dc/d10/d18/d9f/df6/d108/f7c 0 2024-09-06T14:45:04.542 INFO:tasks.workunit.client.0.smithi052.stdout:9/906: unlink d1/d4/c36 0 2024-09-06T14:45:04.544 INFO:tasks.workunit.client.0.smithi052.stdout:9/907: dread - d1/d4/d6/dd/d22/d6a/f88 zero size 2024-09-06T14:45:04.545 INFO:tasks.workunit.client.0.smithi052.stdout:9/908: fdatasync d1/d26/d3d/da8/fe5 0 2024-09-06T14:45:04.632 INFO:tasks.workunit.client.0.smithi052.stdout:2/840: sync 2024-09-06T14:45:04.632 INFO:tasks.workunit.client.0.smithi052.stdout:3/928: creat d0/d11/d12/f127 x:0 0 0 2024-09-06T14:45:04.633 INFO:tasks.workunit.client.0.smithi052.stdout:9/909: mknod d1/d4/d6/dc/d38/dfd/c114 0 2024-09-06T14:45:04.636 INFO:tasks.workunit.client.0.smithi052.stdout:3/929: creat d0/d8d/f128 x:0 0 0 2024-09-06T14:45:04.639 INFO:tasks.workunit.client.0.smithi052.stdout:9/910: chown d1/d4/d6/dc/d10/dec/l106 661 1 2024-09-06T14:45:04.640 INFO:tasks.workunit.client.0.smithi052.stdout:9/911: fdatasync d1/d4/d6/dd/d22/d6a/ffe 0 2024-09-06T14:45:04.643 INFO:tasks.workunit.client.0.smithi052.stdout:3/930: creat d0/d89/f129 x:0 0 0 2024-09-06T14:45:04.644 INFO:tasks.workunit.client.0.smithi052.stdout:2/841: link da/db/d18/c59 da/d19/d3a/c118 0 2024-09-06T14:45:04.644 INFO:tasks.workunit.client.0.smithi052.stdout:3/931: fdatasync d0/d11/d12/f47 0 2024-09-06T14:45:04.647 INFO:tasks.workunit.client.0.smithi052.stdout:9/912: write d1/d4/d6/dd/f5f [1125006,32588] 0 2024-09-06T14:45:04.649 INFO:tasks.workunit.client.0.smithi052.stdout:9/913: write d1/d4/d6/dd1/dd9/fe2 [197413,56438] 0 2024-09-06T14:45:04.651 INFO:tasks.workunit.client.0.smithi052.stdout:2/842: mknod da/db/c119 0 2024-09-06T14:45:04.654 INFO:tasks.workunit.client.0.smithi052.stdout:9/914: readlink d1/d4/d6/dd/d22/l3a 0 2024-09-06T14:45:04.656 INFO:tasks.workunit.client.0.smithi052.stdout:3/932: dread d0/d11/d71/d98/f43 [0,4194304] 0 2024-09-06T14:45:04.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/933: chown d0/d11/d71/d98/c108 21184348 1 2024-09-06T14:45:04.657 INFO:tasks.workunit.client.0.smithi052.stdout:3/934: stat d0/d11/d71/daf/df3/f119 0 2024-09-06T14:45:04.658 INFO:tasks.workunit.client.0.smithi052.stdout:3/935: read d0/d11/d12/d4c/f101 [563691,121647] 0 2024-09-06T14:45:04.660 INFO:tasks.workunit.client.0.smithi052.stdout:2/843: mkdir da/d54/dc9/d11a 0 2024-09-06T14:45:04.665 INFO:tasks.workunit.client.0.smithi052.stdout:2/844: mkdir da/d19/d3a/d61/d11b 0 2024-09-06T14:45:04.672 INFO:tasks.workunit.client.0.smithi052.stdout:2/845: truncate da/db/f12 1844487 0 2024-09-06T14:45:04.675 INFO:tasks.workunit.client.0.smithi052.stdout:9/915: link d1/l42 d1/d26/d87/l115 0 2024-09-06T14:45:04.675 INFO:tasks.workunit.client.0.smithi052.stdout:2/846: dread da/db/fe [0,4194304] 0 2024-09-06T14:45:04.676 INFO:tasks.workunit.client.0.smithi052.stdout:3/936: write d0/d11/d12/d4c/d93/f7a [294644,13986] 0 2024-09-06T14:45:04.680 INFO:tasks.workunit.client.0.smithi052.stdout:3/937: mknod d0/d11/d71/d98/d1b/d85/d9f/c12a 0 2024-09-06T14:45:04.683 INFO:tasks.workunit.client.0.smithi052.stdout:9/916: write d1/d4/d6/dc/d38/d5a/faf [4269012,41045] 0 2024-09-06T14:45:04.687 INFO:tasks.workunit.client.0.smithi052.stdout:9/917: rename d1/f23 to d1/d26/d87/f116 0 2024-09-06T14:45:04.688 INFO:tasks.workunit.client.0.smithi052.stdout:2/847: link da/db/d46/d6b/f98 da/db/d46/d55/f11c 0 2024-09-06T14:45:04.689 INFO:tasks.workunit.client.0.smithi052.stdout:9/918: write d1/d4/d6/dc/d10/d18/f33 [7309104,126718] 0 2024-09-06T14:45:04.692 INFO:tasks.workunit.client.0.smithi052.stdout:9/919: chown d1/d4/d6/dc/d10/d18/d82/da6/dcb/df3/fea 78844 1 2024-09-06T14:45:04.696 INFO:tasks.workunit.client.0.smithi052.stdout:2/848: write da/db/d60/faf [107719,41584] 0 2024-09-06T14:45:04.698 INFO:tasks.workunit.client.0.smithi052.stdout:9/920: dwrite d1/d4/d6/dd/f77 [0,4194304] 0 2024-09-06T14:45:04.699 INFO:tasks.workunit.client.0.smithi052.stdout:2/849: mkdir da/d2d/d11d 0 2024-09-06T14:45:04.701 INFO:tasks.workunit.client.0.smithi052.stdout:9/921: chown d1/d4/d6/dc/d38/cc7 144 1 2024-09-06T14:45:04.702 INFO:tasks.workunit.client.0.smithi052.stdout:2/850: dread da/d4f/fb3 [0,4194304] 0 2024-09-06T14:45:04.703 INFO:tasks.workunit.client.0.smithi052.stdout:3/938: dread d0/d11/d71/d98/f4e [4194304,4194304] 0 2024-09-06T14:45:04.704 INFO:tasks.workunit.client.0.smithi052.stdout:9/922: write d1/d4/d6/dd/d22/fcf [1966577,129643] 0 2024-09-06T14:45:04.705 INFO:tasks.workunit.client.0.smithi052.stdout:3/939: readlink d0/d11/d71/d98/d1b/l82 0 2024-09-06T14:45:04.708 INFO:tasks.workunit.client.0.smithi052.stdout:9/923: truncate d1/d4/d6/dd/de8/de9/fef 180565 0 2024-09-06T14:45:04.709 INFO:tasks.workunit.client.0.smithi052.stdout:3/940: creat d0/d11/d12/d17/d7b/f12b x:0 0 0 2024-09-06T14:45:04.710 INFO:tasks.workunit.client.0.smithi052.stdout:3/941: write d0/d11/d12/d4c/d93/f3e [2792394,33368] 0 2024-09-06T14:45:04.711 INFO:tasks.workunit.client.0.smithi052.stdout:9/924: mknod d1/d4/d6/dd/d22/d6a/c117 0 2024-09-06T14:45:04.711 INFO:tasks.workunit.client.0.smithi052.stdout:3/942: read - d0/d8d/f128 zero size 2024-09-06T14:45:04.715 INFO:tasks.workunit.client.0.smithi052.stdout:3/943: mkdir d0/d11/d71/d98/d1b/d85/d9f/dcf/d12c 0 2024-09-06T14:45:04.715 INFO:tasks.workunit.client.0.smithi052.stdout:2/851: write da/d19/d3a/d31/f43 [2703903,59769] 0 2024-09-06T14:45:04.716 INFO:tasks.workunit.client.0.smithi052.stdout:3/944: fdatasync d0/d8d/f128 0 2024-09-06T14:45:04.720 INFO:tasks.workunit.client.0.smithi052.stdout:2/852: mkdir da/d19/d3a/d31/d11e 0 2024-09-06T14:45:04.720 INFO:tasks.workunit.client.0.smithi052.stdout:9/925: dwrite d1/d4/d6/dc/d10/d73/da9/df8/f10c [0,4194304] 0 2024-09-06T14:45:04.721 INFO:tasks.workunit.client.0.smithi052.stdout:3/945: chown d0/d11/d12/d73/de8/d112/da6/lf5 608 1 2024-09-06T14:45:04.722 INFO:tasks.workunit.client.0.smithi052.stdout:2/853: read - da/db/d60/daa/f10c zero size 2024-09-06T14:45:04.728 INFO:tasks.workunit.client.0.smithi052.stdout:3/946: readlink d0/d11/d12/d4c/d93/d35/l3d 0 2024-09-06T14:45:04.729 INFO:tasks.workunit.client.0.smithi052.stdout:2/854: rmdir da/d19/d5a/d6c 39 2024-09-06T14:45:04.730 INFO:tasks.workunit.client.0.smithi052.stdout:3/947: read d0/d11/d71/d98/d19/f7f [266008,80042] 0 2024-09-06T14:45:04.730 INFO:tasks.workunit.client.0.smithi052.stdout:2/855: chown da/d64 1237496 1 2024-09-06T14:45:04.733 INFO:tasks.workunit.client.0.smithi052.stdout:3/948: rename d0/ff to d0/d11/d71/d98/d124/f12d 0 2024-09-06T14:45:04.734 INFO:tasks.workunit.client.0.smithi052.stdout:2/856: symlink da/d2d/d34/dd7/dee/l11f 0 2024-09-06T14:45:04.736 INFO:tasks.workunit.client.0.smithi052.stdout:9/926: write d1/d4/d6/dc/d10/f34 [3787453,112004] 0 2024-09-06T14:45:04.738 INFO:tasks.workunit.client.0.smithi052.stdout:2/857: creat da/db/d46/d55/f120 x:0 0 0 2024-09-06T14:45:04.739 INFO:tasks.workunit.client.0.smithi052.stdout:9/927: stat d1/d26/d87/f116 0 2024-09-06T14:45:04.742 INFO:tasks.workunit.client.0.smithi052.stdout:9/928: rmdir d1/d26/d41 39 2024-09-06T14:45:04.743 INFO:tasks.workunit.client.0.smithi052.stdout:9/929: dread - d1/d4/d6/dc/d10/d18/d82/d9e/dfc/f109 zero size 2024-09-06T14:45:04.744 INFO:tasks.workunit.client.0.smithi052.stdout:2/858: rename da/db9/cfd to da/db/d46/d55/de6/d70/c121 0 2024-09-06T14:45:04.748 INFO:tasks.workunit.client.0.smithi052.stdout:3/949: dread d0/d11/d12/d4c/d93/d35/f2a [0,4194304] 0 2024-09-06T14:45:04.752 INFO:tasks.workunit.client.0.smithi052.stdout:9/930: dwrite d1/d26/d41/fbf [4194304,4194304] 0 2024-09-06T14:45:04.754 INFO:tasks.workunit.client.0.smithi052.stdout:2/859: write da/d19/d3a/d31/d7a/dbd/dc6/fce [211548,79282] 0 2024-09-06T14:45:04.756 INFO:tasks.workunit.client.0.smithi052.stdout:2/860: truncate da/f23 1051494 0 2024-09-06T14:45:04.757 INFO:tasks.workunit.client.0.smithi052.stdout:3/950: dwrite d0/d11/d71/d98/d19/fff [0,4194304] 0 2024-09-06T14:45:04.758 INFO:tasks.workunit.client.0.smithi052.stdout:9/931: read d1/d4/d6/dc/d10/d18/f76 [198778,90366] 0 2024-09-06T14:45:04.758 INFO:tasks.workunit.client.0.smithi052.stdout:2/861: write da/d19/f29 [960261,30090] 0 2024-09-06T14:45:04.759 INFO:tasks.workunit.client.0.smithi052.stdout:3/951: rmdir d0 39 2024-09-06T14:45:04.767 INFO:tasks.workunit.client.0.smithi052.stdout:2/862: dwrite da/f1b [0,4194304] 0 2024-09-06T14:45:04.770 INFO:tasks.workunit.client.0.smithi052.stdout:9/932: dwrite d1/d4/d6/dc/d10/d18/d9f/df6/d108/fdb [0,4194304] 0 2024-09-06T14:45:04.771 INFO:tasks.workunit.client.0.smithi052.stdout:9/933: fsync d1/d4/d6/dd/f5f 0 2024-09-06T14:45:04.775 INFO:tasks.workunit.client.0.smithi052.stdout:3/952: link d0/d11/d12/d4c/d93/d64/f11e d0/d11/d71/d98/d1b/d85/d9f/f12e 0 2024-09-06T14:45:04.777 INFO:tasks.workunit.client.0.smithi052.stdout:3/953: read d0/d11/d12/f47 [720964,25058] 0 2024-09-06T14:45:04.784 INFO:tasks.workunit.client.0.smithi052.stdout:2/863: rmdir da/db/d60/df6 0 2024-09-06T14:45:04.784 INFO:tasks.workunit.client.0.smithi052.stdout:9/934: creat d1/d4/f118 x:0 0 0 2024-09-06T14:45:04.789 INFO:tasks.workunit.client.0.smithi052.stdout:3/954: getdents d0/d11/d12/d17/d7b 0 2024-09-06T14:45:04.790 INFO:tasks.workunit.client.0.smithi052.stdout:3/955: mkdir d0/dcd/d12f 0 2024-09-06T14:45:04.792 INFO:tasks.workunit.client.0.smithi052.stdout:9/935: link d1/d4/df/c55 d1/d26/d3d/da8/c119 0 2024-09-06T14:45:04.807 INFO:tasks.workunit.client.0.smithi052.stdout:2/864: write da/db/d46/d55/f11c [1707472,123160] 0 2024-09-06T14:45:04.808 INFO:tasks.workunit.client.0.smithi052.stdout:2/865: chown da/db/fa2 1206489141 1 2024-09-06T14:45:04.809 INFO:tasks.workunit.client.0.smithi052.stdout:2/866: fdatasync da/d19/d3a/d31/d7a/dbd/ff3 0 2024-09-06T14:45:04.817 INFO:tasks.workunit.client.0.smithi052.stdout:2/867: getdents da/db9 0 2024-09-06T14:45:04.818 INFO:tasks.workunit.client.0.smithi052.stdout:2/868: read - da/d19/d3a/d31/d7a/dbd/dc6/fe5 zero size 2024-09-06T14:45:04.825 INFO:tasks.workunit.client.0.smithi052.stdout:2/869: dwrite da/d19/d5a/d6c/f113 [0,4194304] 0 2024-09-06T14:45:04.827 INFO:tasks.workunit.client.0.smithi052.stdout:2/870: fsync da/db/d60/daa/fdf 0 2024-09-06T14:45:04.847 INFO:tasks.workunit.client.0.smithi052.stdout:2/871: dwrite f2 [0,4194304] 0 2024-09-06T14:45:04.852 INFO:tasks.workunit.client.0.smithi052.stdout:2/872: dwrite da/fdc [0,4194304] 0 2024-09-06T14:45:04.857 INFO:tasks.workunit.client.0.smithi052.stdout:2/873: creat da/d19/d3a/d31/d76/d6a/dbf/f122 x:0 0 0 2024-09-06T14:45:04.859 INFO:tasks.workunit.client.0.smithi052.stdout:2/874: write da/d19/d3a/d31/f37 [710988,96967] 0 2024-09-06T14:45:04.862 INFO:tasks.workunit.client.0.smithi052.stdout:2/875: dread da/db/d60/faf [0,4194304] 0 2024-09-06T14:45:04.864 INFO:tasks.workunit.client.0.smithi052.stdout:2/876: dread da/db/fa2 [0,4194304] 0 2024-09-06T14:45:04.867 INFO:tasks.workunit.client.0.smithi052.stdout:2/877: dread da/db/fa2 [0,4194304] 0 2024-09-06T14:45:04.873 INFO:tasks.workunit.client.0.smithi052.stdout:2/878: dread da/f92 [0,4194304] 0 2024-09-06T14:45:04.882 INFO:tasks.workunit.client.0.smithi052.stdout:2/879: chown da/d2d/d34/l44 85689166 1 2024-09-06T14:45:04.883 INFO:tasks.workunit.client.0.smithi052.stdout:2/880: chown da/d19/d3a/d31/d76/d6a/l6e 1 1 2024-09-06T14:45:04.907 INFO:tasks.workunit.client.0.smithi052.stdout:2/881: link da/d19/d5a/lf7 da/db/d60/daa/l123 0 2024-09-06T14:45:04.912 INFO:tasks.workunit.client.0.smithi052.stdout:2/882: rename da/d19/d3a/d31/d7a/dbd/dc6/fe5 to da/d19/d3a/d61/d11b/f124 0 2024-09-06T14:45:04.938 INFO:tasks.workunit.client.0.smithi052.stdout:2/883: dread da/db/d18/d7f/fa3 [0,4194304] 0 2024-09-06T14:45:04.943 INFO:tasks.workunit.client.0.smithi052.stdout:2/884: creat da/db/d46/d55/de6/d70/f125 x:0 0 0 2024-09-06T14:45:04.952 INFO:tasks.workunit.client.0.smithi052.stdout:2/885: dread da/db/d46/d55/de6/f9a [0,4194304] 0 2024-09-06T14:45:04.955 INFO:tasks.workunit.client.0.smithi052.stdout:2/886: fdatasync da/d2d/d34/f8a 0 2024-09-06T14:45:04.956 INFO:tasks.workunit.client.0.smithi052.stdout:2/887: read da/d19/f1c [7445404,4627] 0 2024-09-06T14:45:04.979 INFO:tasks.workunit.client.0.smithi052.stdout:2/888: truncate da/db/d46/d6b/f98 1145064 0 2024-09-06T14:45:04.982 INFO:tasks.workunit.client.0.smithi052.stdout:2/889: rename da/d19/d3a/d31/f43 to da/db/d109/f126 0 2024-09-06T14:45:04.985 INFO:tasks.workunit.client.0.smithi052.stdout:2/890: dread - da/db/d18/d7f/fdb zero size 2024-09-06T14:45:04.989 INFO:tasks.workunit.client.0.smithi052.stdout:2/891: dread da/d19/d5a/d6c/f113 [0,4194304] 0 2024-09-06T14:45:04.989 INFO:tasks.workunit.client.0.smithi052.stdout:2/892: chown da/d2d/d34/l39 9794012 1 2024-09-06T14:45:04.994 INFO:tasks.workunit.client.0.smithi052.stdout:2/893: link da/d19/d3a/d31/d76/d6a/f116 da/d2d/de7/f127 0 2024-09-06T14:45:04.997 INFO:tasks.workunit.client.0.smithi052.stdout:2/894: rename da/db9/ff5 to da/db/d46/f128 0 2024-09-06T14:45:04.998 INFO:tasks.workunit.client.0.smithi052.stdout:2/895: chown da/d64 6186 1 2024-09-06T14:45:04.998 INFO:tasks.workunit.client.0.smithi052.stdout:2/896: truncate da/d2d/de7/f127 223400 0 2024-09-06T14:45:05.001 INFO:tasks.workunit.client.0.smithi052.stdout:2/897: mknod da/db/d46/d6b/c129 0 2024-09-06T14:45:05.001 INFO:tasks.workunit.client.0.smithi052.stdout:0/876: sync 2024-09-06T14:45:05.002 INFO:tasks.workunit.client.0.smithi052.stdout:2/898: mkdir da/db/d46/d6b/d12a 0 2024-09-06T14:45:05.004 INFO:tasks.workunit.client.0.smithi052.stdout:0/877: rename d0/d18 to d0/d1a/d26/d13c 0 2024-09-06T14:45:05.006 INFO:tasks.workunit.client.0.smithi052.stdout:2/899: fdatasync da/db/d46/d55/de6/d70/f85 0 2024-09-06T14:45:05.009 INFO:tasks.workunit.client.0.smithi052.stdout:2/900: creat da/db/d60/daa/f12b x:0 0 0 2024-09-06T14:45:05.012 INFO:tasks.workunit.client.0.smithi052.stdout:2/901: write da/db/d60/faf [1192238,130690] 0 2024-09-06T14:45:05.013 INFO:tasks.workunit.client.0.smithi052.stdout:2/902: read da/d19/f26 [2503715,4442] 0 2024-09-06T14:45:05.016 INFO:tasks.workunit.client.0.smithi052.stdout:2/903: fdatasync da/d19/d3a/d31/d76/dc7/fcb 0 2024-09-06T14:45:05.021 INFO:tasks.workunit.client.0.smithi052.stdout:2/904: mkdir da/db/d60/d12c 0 2024-09-06T14:45:05.024 INFO:tasks.workunit.client.0.smithi052.stdout:0/878: dwrite d0/d4f/fc4 [0,4194304] 0 2024-09-06T14:45:05.027 INFO:tasks.workunit.client.0.smithi052.stdout:2/905: unlink da/db/d60/daa/l123 0 2024-09-06T14:45:05.027 INFO:tasks.workunit.client.0.smithi052.stdout:2/906: chown da/d2d/de7/d110/c115 464734 1 2024-09-06T14:45:05.029 INFO:tasks.workunit.client.0.smithi052.stdout:0/879: mkdir d0/d2e/d12d/d10f/d13d 0 2024-09-06T14:45:05.036 INFO:tasks.workunit.client.0.smithi052.stdout:0/880: dwrite d0/d1a/de8/f131 [0,4194304] 0 2024-09-06T14:45:05.038 INFO:tasks.workunit.client.0.smithi052.stdout:0/881: mknod d0/d3d/c13e 0 2024-09-06T14:45:05.051 INFO:tasks.workunit.client.0.smithi052.stdout:2/907: dread da/d2d/d34/d62/f79 [0,4194304] 0 2024-09-06T14:45:05.054 INFO:tasks.workunit.client.0.smithi052.stdout:2/908: link da/db/d18/l3e da/l12d 0 2024-09-06T14:45:05.056 INFO:tasks.workunit.client.0.smithi052.stdout:2/909: mknod da/d19/c12e 0 2024-09-06T14:45:05.059 INFO:tasks.workunit.client.0.smithi052.stdout:2/910: rename da/db/d46/d55/de6/d70/f125 to da/d64/f12f 0 2024-09-06T14:45:05.061 INFO:tasks.workunit.client.0.smithi052.stdout:0/882: getdents d0/d2e/d12d/d10f 0 2024-09-06T14:45:05.063 INFO:tasks.workunit.client.0.smithi052.stdout:0/883: mkdir d0/d1a/d26/db7/d13f 0 2024-09-06T14:45:05.064 INFO:tasks.workunit.client.0.smithi052.stdout:0/884: fsync d0/d1a/d26/d3a/d14/d2d/d94/f11d 0 2024-09-06T14:45:05.065 INFO:tasks.workunit.client.0.smithi052.stdout:0/885: dread - d0/d4f/d7d/f130 zero size 2024-09-06T14:45:05.077 INFO:tasks.workunit.client.0.smithi052.stdout:2/911: dread da/d19/f26 [4194304,4194304] 0 2024-09-06T14:45:05.079 INFO:tasks.workunit.client.0.smithi052.stdout:2/912: truncate da/d19/d5a/fbb 786654 0 2024-09-06T14:45:05.080 INFO:tasks.workunit.client.0.smithi052.stdout:2/913: fsync da/d19/d3a/d31/d76/d6a/f9c 0 2024-09-06T14:45:05.081 INFO:tasks.workunit.client.0.smithi052.stdout:0/886: dread d0/d7e/f136 [4194304,4194304] 0 2024-09-06T14:45:05.082 INFO:tasks.workunit.client.0.smithi052.stdout:2/914: chown da/d19/lcd 7311054 1 2024-09-06T14:45:05.203 INFO:tasks.workunit.client.0.smithi052.stdout:2/915: unlink da/d19/d3a/d31/d7a/dbd/ff3 0 2024-09-06T14:45:05.205 INFO:tasks.workunit.client.0.smithi052.stdout:0/887: truncate d0/d1a/d26/d3a/d14/d20/ff1 866994 0 2024-09-06T14:45:05.209 INFO:tasks.workunit.client.0.smithi052.stdout:2/916: dwrite da/db/d60/daa/f12b [0,4194304] 0 2024-09-06T14:45:05.210 INFO:tasks.workunit.client.0.smithi052.stdout:2/917: stat da/db/d46/d6b 0 2024-09-06T14:45:05.215 INFO:tasks.workunit.client.0.smithi052.stdout:2/918: creat da/d19/d3a/d31/d7a/dbd/f130 x:0 0 0 2024-09-06T14:45:05.216 INFO:tasks.workunit.client.0.smithi052.stdout:2/919: chown da/d2d/d34/l44 1 1 2024-09-06T14:45:05.218 INFO:tasks.workunit.client.0.smithi052.stdout:2/920: truncate da/db/d46/d55/f120 259795 0 2024-09-06T14:45:05.220 INFO:tasks.workunit.client.0.smithi052.stdout:2/921: creat da/db/d46/d6b/f131 x:0 0 0 2024-09-06T14:45:05.220 INFO:tasks.workunit.client.0.smithi052.stdout:2/922: chown da/d19/d5a 65 1 2024-09-06T14:45:05.229 INFO:tasks.workunit.client.0.smithi052.stdout:0/888: write d0/d3d/d12a/d55/da0/f7b [420076,41830] 0 2024-09-06T14:45:05.232 INFO:tasks.workunit.client.0.smithi052.stdout:0/889: creat d0/d1a/d26/d3a/f140 x:0 0 0 2024-09-06T14:45:05.237 INFO:tasks.workunit.client.0.smithi052.stdout:1/970: sync 2024-09-06T14:45:05.238 INFO:tasks.workunit.client.0.smithi052.stdout:0/890: stat d0/d19/c65 0 2024-09-06T14:45:05.238 INFO:tasks.workunit.client.0.smithi052.stdout:2/923: write da/d4f/fb3 [1820514,61199] 0 2024-09-06T14:45:05.263 INFO:tasks.workunit.client.0.smithi052.stdout:0/891: read - d0/d1a/d26/d13c/f119 zero size 2024-09-06T14:45:05.264 INFO:tasks.workunit.client.0.smithi052.stdout:2/924: mkdir da/d19/d5a/d6c/d132 0 2024-09-06T14:45:05.265 INFO:tasks.workunit.client.0.smithi052.stdout:2/925: creat da/f133 x:0 0 0 2024-09-06T14:45:05.272 INFO:tasks.workunit.client.0.smithi052.stdout:2/926: rename da/db/d46/d55/de6/d70/f85 to da/d64/f134 0 2024-09-06T14:45:05.272 INFO:tasks.workunit.client.0.smithi052.stdout:0/892: truncate d0/d1a/d26/d3a/d14/d20/ff1 792604 0 2024-09-06T14:45:05.273 INFO:tasks.workunit.client.0.smithi052.stdout:2/927: chown da/d64 55 1 2024-09-06T14:45:05.274 INFO:tasks.workunit.client.0.smithi052.stdout:0/893: creat d0/d1a/d26/d13c/f141 x:0 0 0 2024-09-06T14:45:05.275 INFO:tasks.workunit.client.0.smithi052.stdout:0/894: chown d0/d3d/d12a/d41/l11e 42269962 1 2024-09-06T14:45:05.275 INFO:tasks.workunit.client.0.smithi052.stdout:2/928: symlink da/d19/d3a/d31/d76/l135 0 2024-09-06T14:45:05.277 INFO:tasks.workunit.client.0.smithi052.stdout:0/895: mknod d0/d1a/d26/d13c/dd6/c142 0 2024-09-06T14:45:05.279 INFO:tasks.workunit.client.0.smithi052.stdout:2/929: creat da/d2d/d34/f136 x:0 0 0 2024-09-06T14:45:05.280 INFO:tasks.workunit.client.0.smithi052.stdout:0/896: truncate d0/d4f/f95 52964 0 2024-09-06T14:45:05.280 INFO:tasks.workunit.client.0.smithi052.stdout:2/930: write da/db/d46/fff [887545,78320] 0 2024-09-06T14:45:05.282 INFO:tasks.workunit.client.0.smithi052.stdout:2/931: chown da/d19/d3a/d61/ce2 2547 1 2024-09-06T14:45:05.284 INFO:tasks.workunit.client.0.smithi052.stdout:2/932: dread da/db/fe [0,4194304] 0 2024-09-06T14:45:05.287 INFO:tasks.workunit.client.0.smithi052.stdout:0/897: dwrite d0/d1a/d26/d13c/dd6/fde [0,4194304] 0 2024-09-06T14:45:05.289 INFO:tasks.workunit.client.0.smithi052.stdout:2/933: getdents da/db/d109 0 2024-09-06T14:45:05.291 INFO:tasks.workunit.client.0.smithi052.stdout:2/934: mkdir da/d137 0 2024-09-06T14:45:05.294 INFO:tasks.workunit.client.0.smithi052.stdout:2/935: symlink da/d4f/l138 0 2024-09-06T14:45:05.295 INFO:tasks.workunit.client.0.smithi052.stdout:0/898: getdents d0/d1a/d26/d3a/d14/d20/d108 0 2024-09-06T14:45:05.297 INFO:tasks.workunit.client.0.smithi052.stdout:2/936: rename da/d2d/d34/dd7/dee/l11f to da/db/d46/d55/l139 0 2024-09-06T14:45:05.297 INFO:tasks.workunit.client.0.smithi052.stdout:0/899: write d0/d7e/f136 [214713,29] 0 2024-09-06T14:45:05.300 INFO:tasks.workunit.client.0.smithi052.stdout:0/900: mknod d0/d1a/de8/c143 0 2024-09-06T14:45:05.304 INFO:tasks.workunit.client.0.smithi052.stdout:2/937: dwrite da/d19/d3a/d31/d7a/dbd/dc6/f102 [0,4194304] 0 2024-09-06T14:45:05.307 INFO:tasks.workunit.client.0.smithi052.stdout:2/938: symlink da/db/d46/d6b/l13a 0 2024-09-06T14:45:05.309 INFO:tasks.workunit.client.0.smithi052.stdout:2/939: dread da/db/d18/d7f/fda [0,4194304] 0 2024-09-06T14:45:05.310 INFO:tasks.workunit.client.0.smithi052.stdout:2/940: chown da/db/d60/l65 27205877 1 2024-09-06T14:45:05.317 INFO:tasks.workunit.client.0.smithi052.stdout:2/941: rename da/d19/d3a/d31/l10b to da/d19/d5a/d6c/d132/l13b 0 2024-09-06T14:45:05.323 INFO:tasks.workunit.client.0.smithi052.stdout:2/942: dwrite da/d19/d3a/d31/d76/d6a/fa5 [4194304,4194304] 0 2024-09-06T14:45:05.325 INFO:tasks.workunit.client.0.smithi052.stdout:0/901: write d0/d1a/d26/d3a/d14/d2d/d92/f105 [578806,101659] 0 2024-09-06T14:45:05.329 INFO:tasks.workunit.client.0.smithi052.stdout:3/956: sync 2024-09-06T14:45:05.329 INFO:tasks.workunit.client.0.smithi052.stdout:4/877: sync 2024-09-06T14:45:05.330 INFO:tasks.workunit.client.0.smithi052.stdout:6/676: sync 2024-09-06T14:45:05.330 INFO:tasks.workunit.client.0.smithi052.stdout:7/846: sync 2024-09-06T14:45:05.333 INFO:tasks.workunit.client.0.smithi052.stdout:4/878: dread - d9/d2d/d33/d5d/da6/deb/d81/d9c/dac/f12d zero size 2024-09-06T14:45:05.333 INFO:tasks.workunit.client.0.smithi052.stdout:3/957: write d0/d11/d12/d17/d7b/f12b [774707,119564] 0 2024-09-06T14:45:05.336 INFO:tasks.workunit.client.0.smithi052.stdout:6/677: creat d2/dd/d18/d2d/d71/fd8 x:0 0 0 2024-09-06T14:45:05.340 INFO:tasks.workunit.client.0.smithi052.stdout:7/847: creat d11/d1c/d57/f109 x:0 0 0 2024-09-06T14:45:05.345 INFO:tasks.workunit.client.0.smithi052.stdout:6/678: chown d2/dd/d18/d25/d4c/l65 11644946 1 2024-09-06T14:45:05.345 INFO:tasks.workunit.client.0.smithi052.stdout:6/679: fdatasync d2/dd/d18/d2d/f46 0 2024-09-06T14:45:05.345 INFO:tasks.workunit.client.0.smithi052.stdout:4/879: symlink d9/d10/d17/d39/d3a/d5c/l138 0 2024-09-06T14:45:05.345 INFO:tasks.workunit.client.0.smithi052.stdout:6/680: read d2/dd/d18/d4b/fa6 [897793,15377] 0 2024-09-06T14:45:05.345 INFO:tasks.workunit.client.0.smithi052.stdout:3/958: mkdir d0/d11/d12/d4c/d93/d64/dec/d130 0 2024-09-06T14:45:05.349 INFO:tasks.workunit.client.0.smithi052.stdout:4/880: read d9/d2d/d33/f6a [1774411,44841] 0 2024-09-06T14:45:05.351 INFO:tasks.workunit.client.0.smithi052.stdout:2/943: dwrite da/db/d46/d55/f11c [0,4194304] 0 2024-09-06T14:45:05.353 INFO:tasks.workunit.client.0.smithi052.stdout:0/902: dwrite d0/f8d [0,4194304] 0 2024-09-06T14:45:05.357 INFO:tasks.workunit.client.0.smithi052.stdout:4/881: unlink d9/da1/f11b 0 2024-09-06T14:45:05.362 INFO:tasks.workunit.client.0.smithi052.stdout:2/944: write da/db/d18/d7f/fda [1423849,65199] 0 2024-09-06T14:45:05.362 INFO:tasks.workunit.client.0.smithi052.stdout:0/903: creat d0/d19/d29/f144 x:0 0 0 2024-09-06T14:45:05.365 INFO:tasks.workunit.client.0.smithi052.stdout:6/681: write d2/dd/d18/d33/fa5 [803615,23942] 0 2024-09-06T14:45:05.367 INFO:tasks.workunit.client.0.smithi052.stdout:7/848: dwrite d11/d1c/d24/d64/fdf [0,4194304] 0 2024-09-06T14:45:05.368 INFO:tasks.workunit.client.0.smithi052.stdout:4/882: symlink d9/d10/d17/d39/d3a/d125/l139 0 2024-09-06T14:45:05.370 INFO:tasks.workunit.client.0.smithi052.stdout:9/936: sync 2024-09-06T14:45:05.371 INFO:tasks.workunit.client.0.smithi052.stdout:3/959: dwrite d0/d11/d12/d4c/f57 [0,4194304] 0 2024-09-06T14:45:05.371 INFO:tasks.workunit.client.0.smithi052.stdout:0/904: mknod d0/d7e/c145 0 2024-09-06T14:45:05.373 INFO:tasks.workunit.client.0.smithi052.stdout:9/937: chown d1/d26/d41/f67 2056 1 2024-09-06T14:45:05.375 INFO:tasks.workunit.client.0.smithi052.stdout:2/945: mknod da/d2d/d34/c13c 0 2024-09-06T14:45:05.376 INFO:tasks.workunit.client.0.smithi052.stdout:0/905: read d0/d1a/d26/d3a/ffa [1128417,88821] 0 2024-09-06T14:45:05.376 INFO:tasks.workunit.client.0.smithi052.stdout:7/849: truncate d11/d1c/d24/d3b/d50/f6e 5641233 0 2024-09-06T14:45:05.379 INFO:tasks.workunit.client.0.smithi052.stdout:7/850: read - d11/d1c/d24/d64/fff zero size 2024-09-06T14:45:05.381 INFO:tasks.workunit.client.0.smithi052.stdout:3/960: mknod d0/d11/d71/daf/c131 0 2024-09-06T14:45:05.385 INFO:tasks.workunit.client.0.smithi052.stdout:0/906: fsync d0/d4f/d7d/f76 0 2024-09-06T14:45:05.388 INFO:tasks.workunit.client.0.smithi052.stdout:4/883: write d9/fe [1978120,65247] 0 2024-09-06T14:45:05.390 INFO:tasks.workunit.client.0.smithi052.stdout:2/946: creat da/db/d46/d6b/d12a/f13d x:0 0 0 2024-09-06T14:45:05.392 INFO:tasks.workunit.client.0.smithi052.stdout:3/961: unlink d0/d11/d12/d4c/d93/d35/d46/d67/f9b 0 2024-09-06T14:45:05.394 INFO:tasks.workunit.client.0.smithi052.stdout:0/907: symlink d0/d1a/d26/d3a/d14/l146 0 2024-09-06T14:45:05.398 INFO:tasks.workunit.client.0.smithi052.stdout:7/851: mkdir d11/d1c/d10a 0 2024-09-06T14:45:05.401 INFO:tasks.workunit.client.0.smithi052.stdout:4/884: mknod d9/d2d/d33/d5d/da6/dbf/dd5/c13a 0 2024-09-06T14:45:05.404 INFO:tasks.workunit.client.0.smithi052.stdout:2/947: write da/f11 [2952574,125019] 0 2024-09-06T14:45:05.405 INFO:tasks.workunit.client.0.smithi052.stdout:9/938: truncate d1/d4/d6/dc/d38/fb3 2921150 0 2024-09-06T14:45:05.406 INFO:tasks.workunit.client.0.smithi052.stdout:2/948: write da/d2d/d34/d66/f77 [3500569,117206] 0 2024-09-06T14:45:05.413 INFO:tasks.workunit.client.0.smithi052.stdout:9/939: rmdir d1/d4/d6/dc/d38 39 2024-09-06T14:45:05.416 INFO:tasks.workunit.client.0.smithi052.stdout:2/949: creat da/db/d46/d6b/f13e x:0 0 0 2024-09-06T14:45:05.417 INFO:tasks.workunit.client.0.smithi052.stdout:4/885: dread d9/f5f [0,4194304] 0 2024-09-06T14:45:05.421 INFO:tasks.workunit.client.0.smithi052.stdout:9/940: fsync d1/d26/fed 0 2024-09-06T14:45:05.427 INFO:tasks.workunit.client.0.smithi052.stdout:2/950: mkdir da/db/d46/d55/d13f 0 2024-09-06T14:45:05.428 INFO:tasks.workunit.client.0.smithi052.stdout:3/962: dwrite d0/d11/d12/d73/f99 [0,4194304] 0 2024-09-06T14:45:05.434 INFO:tasks.workunit.client.0.smithi052.stdout:7/852: dwrite d11/d1c/d24/d4b/f4c [0,4194304] 0 2024-09-06T14:45:05.435 INFO:tasks.workunit.client.0.smithi052.stdout:9/941: creat d1/d4/d6/dc/d10/d73/f11a x:0 0 0 2024-09-06T14:45:05.437 INFO:tasks.workunit.client.0.smithi052.stdout:0/908: rename d0/d1a/c98 to d0/d1a/d26/d3a/d14/d2d/c147 0 2024-09-06T14:45:05.438 INFO:tasks.workunit.client.0.smithi052.stdout:9/942: stat d1/d26/d41/d7e 0 2024-09-06T14:45:05.440 INFO:tasks.workunit.client.0.smithi052.stdout:4/886: creat d9/d121/d12b/f13b x:0 0 0 2024-09-06T14:45:05.444 INFO:tasks.workunit.client.0.smithi052.stdout:3/963: creat d0/d11/d12/dd8/f132 x:0 0 0 2024-09-06T14:45:05.445 INFO:tasks.workunit.client.0.smithi052.stdout:7/853: truncate d11/d1c/d3f/d73/dae/fc6 666159 0 2024-09-06T14:45:05.446 INFO:tasks.workunit.client.0.smithi052.stdout:7/854: chown d11/d1c/d3f/d5d/f68 2677 1 2024-09-06T14:45:05.449 INFO:tasks.workunit.client.0.smithi052.stdout:0/909: symlink d0/d3d/de4/l148 0 2024-09-06T14:45:05.451 INFO:tasks.workunit.client.0.smithi052.stdout:9/943: dread - d1/d4/d6/dc/d10/d73/f8e zero size 2024-09-06T14:45:05.452 INFO:tasks.workunit.client.0.smithi052.stdout:4/887: mknod d9/d10/d17/d39/d7b/d91/d9e/c13c 0 2024-09-06T14:45:05.455 INFO:tasks.workunit.client.0.smithi052.stdout:0/910: creat d0/d1a/d26/db7/de7/f149 x:0 0 0 2024-09-06T14:45:05.457 INFO:tasks.workunit.client.0.smithi052.stdout:9/944: truncate d1/d4/f92 409900 0 2024-09-06T14:45:05.458 INFO:tasks.workunit.client.0.smithi052.stdout:4/888: write d9/d10/d19/de4/f11a [454877,25719] 0 2024-09-06T14:45:05.459 INFO:tasks.workunit.client.0.smithi052.stdout:3/964: creat d0/dcd/d12f/f133 x:0 0 0 2024-09-06T14:45:05.463 INFO:tasks.workunit.client.0.smithi052.stdout:0/911: mkdir d0/d1a/d8e/d14a 0 2024-09-06T14:45:05.465 INFO:tasks.workunit.client.0.smithi052.stdout:2/951: getdents da/d64 0 2024-09-06T14:45:05.466 INFO:tasks.workunit.client.0.smithi052.stdout:9/945: fsync d1/d4/d6/dc/d10/d18/f5c 0 2024-09-06T14:45:05.467 INFO:tasks.workunit.client.0.smithi052.stdout:9/946: chown d1/d4/d6/f35 0 1 2024-09-06T14:45:05.468 INFO:tasks.workunit.client.0.smithi052.stdout:3/965: creat d0/d11/d12/d4c/d93/d64/f134 x:0 0 0 2024-09-06T14:45:05.469 INFO:tasks.workunit.client.0.smithi052.stdout:3/966: chown d0/d11/d71/d98/d1b/d105/f100 239837 1 2024-09-06T14:45:05.471 INFO:tasks.workunit.client.0.smithi052.stdout:2/952: readlink da/d2d/d34/d66/d10a/l117 0 2024-09-06T14:45:05.475 INFO:tasks.workunit.client.0.smithi052.stdout:0/912: dwrite d0/d1a/f40 [0,4194304] 0 2024-09-06T14:45:05.476 INFO:tasks.workunit.client.0.smithi052.stdout:9/947: unlink d1/d4/d6/dd/d22/c99 0 2024-09-06T14:45:05.480 INFO:tasks.workunit.client.0.smithi052.stdout:4/889: creat d9/f13d x:0 0 0 2024-09-06T14:45:05.481 INFO:tasks.workunit.client.0.smithi052.stdout:4/890: chown d9/d72/fd8 329673 1 2024-09-06T14:45:05.490 INFO:tasks.workunit.client.0.smithi052.stdout:0/913: dwrite d0/d3d/d12a/d8b/faf [0,4194304] 0 2024-09-06T14:45:05.492 INFO:tasks.workunit.client.0.smithi052.stdout:2/953: link da/db/d18/d7f/fa3 da/d19/d3a/d31/d7a/dbd/dc6/f140 0 2024-09-06T14:45:05.493 INFO:tasks.workunit.client.0.smithi052.stdout:7/855: dwrite d11/d1c/d3f/f9e [0,4194304] 0 2024-09-06T14:45:05.494 INFO:tasks.workunit.client.0.smithi052.stdout:7/856: stat d11/d1c/d24/d4b/da2/f106 0 2024-09-06T14:45:05.494 INFO:tasks.workunit.client.0.smithi052.stdout:4/891: rename d9/d10/l2b to d9/d2d/d33/d5d/da6/dbf/l13e 0 2024-09-06T14:45:05.495 INFO:tasks.workunit.client.0.smithi052.stdout:7/857: dread - d11/d1c/d24/d64/fff zero size 2024-09-06T14:45:05.495 INFO:tasks.workunit.client.0.smithi052.stdout:9/948: creat d1/d4/d6/dd/f11b x:0 0 0 2024-09-06T14:45:05.497 INFO:tasks.workunit.client.0.smithi052.stdout:4/892: chown d9/d10/d17/daa/db5/db9/c86 68048217 1 2024-09-06T14:45:05.501 INFO:tasks.workunit.client.0.smithi052.stdout:2/954: symlink da/db/d46/l141 0 2024-09-06T14:45:05.502 INFO:tasks.workunit.client.0.smithi052.stdout:4/893: truncate d9/d10/d17/daa/db5/f11f 1497081 0 2024-09-06T14:45:05.505 INFO:tasks.workunit.client.0.smithi052.stdout:2/955: mkdir da/d54/d142 0 2024-09-06T14:45:05.507 INFO:tasks.workunit.client.0.smithi052.stdout:4/894: symlink d9/d121/l13f 0 2024-09-06T14:45:05.510 INFO:tasks.workunit.client.0.smithi052.stdout:2/956: creat da/d19/d5a/d6c/d132/f143 x:0 0 0 2024-09-06T14:45:05.510 INFO:tasks.workunit.client.0.smithi052.stdout:4/895: fsync d9/d10/d17/d39/d3a/d125/f115 0 2024-09-06T14:45:05.511 INFO:tasks.workunit.client.0.smithi052.stdout:2/957: write da/db/f45 [4094806,97150] 0 2024-09-06T14:45:05.512 INFO:tasks.workunit.client.0.smithi052.stdout:2/958: chown da/d19/f1c 25560 1 2024-09-06T14:45:05.513 INFO:tasks.workunit.client.0.smithi052.stdout:0/914: rename d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/fea to d0/d1a/d26/d3a/d14/d2d/f14b 0 2024-09-06T14:45:05.514 INFO:tasks.workunit.client.0.smithi052.stdout:2/959: write da/db/d46/d6b/f13e [657542,16604] 0 2024-09-06T14:45:05.517 INFO:tasks.workunit.client.0.smithi052.stdout:2/960: write da/f1b [3988039,11066] 0 2024-09-06T14:45:05.518 INFO:tasks.workunit.client.0.smithi052.stdout:4/896: mknod d9/d10/d17/d39/c140 0 2024-09-06T14:45:05.518 INFO:tasks.workunit.client.0.smithi052.stdout:7/858: dread d11/d1c/d24/d4b/f4e [0,4194304] 0 2024-09-06T14:45:05.520 INFO:tasks.workunit.client.0.smithi052.stdout:2/961: dread - da/db/d60/daa/f10c zero size 2024-09-06T14:45:05.521 INFO:tasks.workunit.client.0.smithi052.stdout:4/897: creat d9/df2/f141 x:0 0 0 2024-09-06T14:45:05.524 INFO:tasks.workunit.client.0.smithi052.stdout:7/859: mknod d11/d1c/d24/c10b 0 2024-09-06T14:45:05.527 INFO:tasks.workunit.client.0.smithi052.stdout:2/962: unlink da/d19/cc2 0 2024-09-06T14:45:05.529 INFO:tasks.workunit.client.0.smithi052.stdout:9/949: dread d1/d26/d87/fa4 [0,4194304] 0 2024-09-06T14:45:05.530 INFO:tasks.workunit.client.0.smithi052.stdout:4/898: symlink d9/d10/d19/d10d/l142 0 2024-09-06T14:45:05.533 INFO:tasks.workunit.client.0.smithi052.stdout:2/963: truncate da/d19/f26 5662464 0 2024-09-06T14:45:05.533 INFO:tasks.workunit.client.0.smithi052.stdout:9/950: mkdir d1/d26/d87/d11c 0 2024-09-06T14:45:05.535 INFO:tasks.workunit.client.0.smithi052.stdout:4/899: chown d9/d10/d17/d39/d3a/d5c/l9b 2095123 1 2024-09-06T14:45:05.537 INFO:tasks.workunit.client.0.smithi052.stdout:2/964: creat da/d19/d3a/d31/d7a/f144 x:0 0 0 2024-09-06T14:45:05.537 INFO:tasks.workunit.client.0.smithi052.stdout:9/951: read d1/d4/d6/dd1/dd9/dc2/fe7 [799599,109597] 0 2024-09-06T14:45:05.540 INFO:tasks.workunit.client.0.smithi052.stdout:2/965: write da/d2d/f9f [1219781,109727] 0 2024-09-06T14:45:05.541 INFO:tasks.workunit.client.0.smithi052.stdout:7/860: dread d11/d1c/d3f/d73/fac [0,4194304] 0 2024-09-06T14:45:05.544 INFO:tasks.workunit.client.0.smithi052.stdout:0/915: dwrite d0/d1a/d8e/fdf [0,4194304] 0 2024-09-06T14:45:05.546 INFO:tasks.workunit.client.0.smithi052.stdout:9/952: stat d1/d4/d6/dc/d10/d18/d82/fe0 0 2024-09-06T14:45:05.549 INFO:tasks.workunit.client.0.smithi052.stdout:9/953: write d1/d4/d6/dc/fb2 [1772035,19983] 0 2024-09-06T14:45:05.551 INFO:tasks.workunit.client.0.smithi052.stdout:7/861: symlink d11/d1c/d78/l10c 0 2024-09-06T14:45:05.553 INFO:tasks.workunit.client.0.smithi052.stdout:2/966: dwrite da/d19/d5a/d6c/d132/f143 [0,4194304] 0 2024-09-06T14:45:05.559 INFO:tasks.workunit.client.0.smithi052.stdout:2/967: mkdir da/d19/d3a/d145 0 2024-09-06T14:45:05.562 INFO:tasks.workunit.client.0.smithi052.stdout:4/900: dwrite d9/f5f [0,4194304] 0 2024-09-06T14:45:05.563 INFO:tasks.workunit.client.0.smithi052.stdout:7/862: rename d11/d1c/d26/f60 to d11/d1c/d78/d98/f10d 0 2024-09-06T14:45:05.565 INFO:tasks.workunit.client.0.smithi052.stdout:0/916: write d0/d1a/d26/d13c/ffb [369774,28798] 0 2024-09-06T14:45:05.570 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-06T14:45:05.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-06T14:45:05.571 INFO:tasks.workunit.client.0.smithi052.stdout:9/954: creat d1/d4/d6/dc/f11d x:0 0 0 2024-09-06T14:45:05.572 INFO:tasks.workunit.client.0.smithi052.stdout:0/917: dread d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/fbb [0,4194304] 0 2024-09-06T14:45:05.575 INFO:tasks.workunit.client.0.smithi052.stdout:2/968: mknod da/d137/c146 0 2024-09-06T14:45:05.577 INFO:tasks.workunit.client.0.smithi052.stdout:2/969: fdatasync da/d19/d5a/d6c/d132/f143 0 2024-09-06T14:45:05.577 INFO:tasks.workunit.client.0.smithi052.stdout:7/863: getdents d11/d1c/d3f/d73/dae/d102 0 2024-09-06T14:45:05.580 INFO:tasks.workunit.client.0.smithi052.stdout:7/864: fdatasync d11/d1c/f1e 0 2024-09-06T14:45:05.581 INFO:tasks.workunit.client.0.smithi052.stdout:2/970: mkdir da/db/d46/d6b/d12a/d147 0 2024-09-06T14:45:05.582 INFO:tasks.workunit.client.0.smithi052.stdout:0/918: read d0/d1a/d26/d3a/d14/d2d/d94/dda/f12e [605093,125704] 0 2024-09-06T14:45:05.582 INFO:tasks.workunit.client.0.smithi052.stdout:4/901: getdents d9/d10/d17/d39/d7b/d91/d9e 0 2024-09-06T14:45:05.583 INFO:tasks.workunit.client.0.smithi052.stdout:7/865: read d11/d1c/d26/f4d [751344,93935] 0 2024-09-06T14:45:05.584 INFO:tasks.workunit.client.0.smithi052.stdout:0/919: chown d0/d1a/d26/d3a/f140 3813714 1 2024-09-06T14:45:05.589 INFO:tasks.workunit.client.0.smithi052.stdout:7/866: rmdir d11/d1c/d24/d3b/d50 39 2024-09-06T14:45:05.590 INFO:tasks.workunit.client.0.smithi052.stdout:4/902: rmdir d9/d2d/d33/d5d/da6/deb/d81/d9c/dac 39 2024-09-06T14:45:05.592 INFO:tasks.workunit.client.0.smithi052.stdout:2/971: dwrite da/d19/d3a/d31/d76/d6a/fa5 [4194304,4194304] 0 2024-09-06T14:45:05.595 INFO:tasks.workunit.client.0.smithi052.stdout:7/867: chown d11/f43 98532880 1 2024-09-06T14:45:05.597 INFO:tasks.workunit.client.0.smithi052.stdout:0/920: dwrite d0/d1a/d8e/fdf [0,4194304] 0 2024-09-06T14:45:05.597 INFO:tasks.workunit.client.0.smithi052.stdout:2/972: chown da/d19/d3a/d61/d7b/lc5 54960 1 2024-09-06T14:45:05.600 INFO:tasks.workunit.client.0.smithi052.stdout:4/903: creat d9/f143 x:0 0 0 2024-09-06T14:45:05.600 INFO:tasks.workunit.client.0.smithi052.stdout:9/955: dwrite d1/d26/d87/fc5 [0,4194304] 0 2024-09-06T14:45:05.601 INFO:tasks.workunit.client.0.smithi052.stdout:0/921: chown d0/d4f/fc4 50977712 1 2024-09-06T14:45:05.601 INFO:tasks.workunit.client.0.smithi052.stdout:7/868: creat d11/d1c/d57/d74/f10e x:0 0 0 2024-09-06T14:45:05.611 INFO:tasks.workunit.client.0.smithi052.stdout:9/956: dread d1/d4/d6/f6c [0,4194304] 0 2024-09-06T14:45:05.613 INFO:tasks.workunit.client.0.smithi052.stdout:0/922: dread d0/d3d/de4/ff7 [0,4194304] 0 2024-09-06T14:45:05.614 INFO:tasks.workunit.client.0.smithi052.stdout:9/957: fsync d1/d4/d6/dd/f8f 0 2024-09-06T14:45:05.615 INFO:tasks.workunit.client.0.smithi052.stdout:4/904: truncate d9/d2d/f100 2936781 0 2024-09-06T14:45:05.616 INFO:tasks.workunit.client.0.smithi052.stdout:4/905: fdatasync d9/d10/f6e 0 2024-09-06T14:45:05.617 INFO:tasks.workunit.client.0.smithi052.stdout:4/906: read d9/d10/d19/f48 [2806762,113418] 0 2024-09-06T14:45:05.618 INFO:tasks.workunit.client.0.smithi052.stdout:0/923: write d0/d1a/d26/d3a/d14/d2d/fa9 [924095,34992] 0 2024-09-06T14:45:05.619 INFO:tasks.workunit.client.0.smithi052.stdout:9/958: write d1/d4/d6/dc/d38/d5a/faf [2478916,110336] 0 2024-09-06T14:45:05.622 INFO:tasks.workunit.client.0.smithi052.stdout:2/973: dread da/db/d46/d55/de6/d70/f99 [0,4194304] 0 2024-09-06T14:45:05.625 INFO:tasks.workunit.client.0.smithi052.stdout:2/974: creat da/db/d46/d6b/d12a/d147/f148 x:0 0 0 2024-09-06T14:45:05.628 INFO:tasks.workunit.client.0.smithi052.stdout:2/975: rename da/d64/f12f to da/db/d60/daa/dd4/f149 0 2024-09-06T14:45:05.631 INFO:tasks.workunit.client.0.smithi052.stdout:2/976: mkdir da/d19/d3a/d31/d14a 0 2024-09-06T14:45:05.632 INFO:tasks.workunit.client.0.smithi052.stdout:0/924: dread d0/d4f/d7d/f62 [0,4194304] 0 2024-09-06T14:45:05.633 INFO:tasks.workunit.client.0.smithi052.stdout:9/959: write d1/d4/d6/dd1/dd9/dc2/fe7 [436184,6457] 0 2024-09-06T14:45:05.634 INFO:tasks.workunit.client.0.smithi052.stdout:0/925: truncate d0/d7e/f136 8972326 0 2024-09-06T14:45:05.636 INFO:tasks.workunit.client.0.smithi052.stdout:0/926: chown d0/d1a/d26/d3a/d14/d2d/d56/da3/ld5 24412 1 2024-09-06T14:45:05.637 INFO:tasks.workunit.client.0.smithi052.stdout:9/960: creat d1/d4/d6/dc/d38/d5a/dad/f11e x:0 0 0 2024-09-06T14:45:05.637 INFO:tasks.workunit.client.0.smithi052.stdout:0/927: dread - d0/d1a/d26/f84 zero size 2024-09-06T14:45:05.643 INFO:tasks.workunit.client.0.smithi052.stdout:9/961: rmdir d1/d4/d6/dd/d102 0 2024-09-06T14:45:05.646 INFO:tasks.workunit.client.0.smithi052.stdout:9/962: truncate d1/f30 178196 0 2024-09-06T14:45:05.648 INFO:tasks.workunit.client.0.smithi052.stdout:9/963: mkdir d1/d4/d6/dd1/dd9/d11f 0 2024-09-06T14:45:05.649 INFO:tasks.workunit.client.0.smithi052.stdout:0/928: dread d0/d2e/f4b [0,4194304] 0 2024-09-06T14:45:05.650 INFO:tasks.workunit.client.0.smithi052.stdout:1/971: sync 2024-09-06T14:45:05.650 INFO:tasks.workunit.client.0.smithi052.stdout:0/929: chown d0/d1a/d26/d13c/dd6/d127 50852279 1 2024-09-06T14:45:05.651 INFO:tasks.workunit.client.0.smithi052.stdout:0/930: fdatasync d0/d1a/de8/f131 0 2024-09-06T14:45:05.659 INFO:tasks.workunit.client.0.smithi052.stdout:2/977: dread da/f11 [0,4194304] 0 2024-09-06T14:45:05.660 INFO:tasks.workunit.client.0.smithi052.stdout:2/978: fdatasync da/d2d/f9f 0 2024-09-06T14:45:05.661 INFO:tasks.workunit.client.0.smithi052.stdout:9/964: link d1/d26/d3d/f94 d1/d4/d6/dc/d10/d18/f120 0 2024-09-06T14:45:05.662 INFO:tasks.workunit.client.0.smithi052.stdout:0/931: mknod d0/d1a/d26/d3a/d14/d20/c14c 0 2024-09-06T14:45:05.662 INFO:tasks.workunit.client.0.smithi052.stdout:9/965: write d1/d26/d87/fc4 [1197770,118861] 0 2024-09-06T14:45:05.664 INFO:tasks.workunit.client.0.smithi052.stdout:9/966: stat d1/d4/d6/dc/d10/d18/d9f 0 2024-09-06T14:45:05.665 INFO:tasks.workunit.client.0.smithi052.stdout:9/967: fsync d1/d4/d6/dc/d38/d5a/dad/f11e 0 2024-09-06T14:45:05.667 INFO:tasks.workunit.client.0.smithi052.stdout:2/979: dread - da/d19/f6d zero size 2024-09-06T14:45:05.667 INFO:tasks.workunit.client.0.smithi052.stdout:1/972: write d1/db/d50/da4/fea [149733,61078] 0 2024-09-06T14:45:05.670 INFO:tasks.workunit.client.0.smithi052.stdout:0/932: unlink d0/d1a/d26/d3a/d14/f11a 0 2024-09-06T14:45:05.674 INFO:tasks.workunit.client.0.smithi052.stdout:2/980: mknod da/d2d/d34/dd7/dee/c14b 0 2024-09-06T14:45:05.675 INFO:tasks.workunit.client.0.smithi052.stdout:2/981: read f2 [4212565,117744] 0 2024-09-06T14:45:05.677 INFO:tasks.workunit.client.0.smithi052.stdout:1/973: symlink d1/db/de/d74/d14/d9f/dcc/l156 0 2024-09-06T14:45:05.679 INFO:tasks.workunit.client.0.smithi052.stdout:9/968: mknod d1/d4/df/c121 0 2024-09-06T14:45:05.681 INFO:tasks.workunit.client.0.smithi052.stdout:2/982: chown da/c4b 83626591 1 2024-09-06T14:45:05.681 INFO:tasks.workunit.client.0.smithi052.stdout:9/969: chown d1/d4/d6/dc/d10/d18/d9f/df6/d108/f7c 1489901 1 2024-09-06T14:45:05.685 INFO:tasks.workunit.client.0.smithi052.stdout:2/983: creat da/d19/d3a/d31/d7a/dbd/dc6/f14c x:0 0 0 2024-09-06T14:45:05.687 INFO:tasks.workunit.client.0.smithi052.stdout:9/970: mknod d1/d4/df/d71/c122 0 2024-09-06T14:45:05.688 INFO:tasks.workunit.client.0.smithi052.stdout:1/974: dread d1/db/de/d74/d14/f25 [0,4194304] 0 2024-09-06T14:45:05.689 INFO:tasks.workunit.client.0.smithi052.stdout:0/933: link d0/d3d/d12a/l51 d0/d1a/d26/db7/l14d 0 2024-09-06T14:45:05.689 INFO:tasks.workunit.client.0.smithi052.stdout:2/984: write da/db/d60/daa/dd4/f149 [925423,10411] 0 2024-09-06T14:45:05.691 INFO:tasks.workunit.client.0.smithi052.stdout:9/971: rmdir d1/d4/d6/dc/d10/d18/d82/dda 39 2024-09-06T14:45:05.692 INFO:tasks.workunit.client.0.smithi052.stdout:0/934: chown d0/d3d/d12a/d8b/ld4 3170 1 2024-09-06T14:45:05.693 INFO:tasks.workunit.client.0.smithi052.stdout:1/975: dread d1/db/d18/f92 [0,4194304] 0 2024-09-06T14:45:05.693 INFO:tasks.workunit.client.0.smithi052.stdout:9/972: readlink d1/d4/d6/l81 0 2024-09-06T14:45:05.695 INFO:tasks.workunit.client.0.smithi052.stdout:2/985: link da/d19/f1c da/db/f14d 0 2024-09-06T14:45:05.695 INFO:tasks.workunit.client.0.smithi052.stdout:1/976: rmdir d1/db/de/d74 39 2024-09-06T14:45:05.698 INFO:tasks.workunit.client.0.smithi052.stdout:0/935: write d0/d1a/d26/d3a/d14/d2d/de2/fe5 [5094085,34561] 0 2024-09-06T14:45:05.699 INFO:tasks.workunit.client.0.smithi052.stdout:0/936: fdatasync d0/d4f/fc4 0 2024-09-06T14:45:05.700 INFO:tasks.workunit.client.0.smithi052.stdout:2/986: truncate da/d4f/f5b 4404162 0 2024-09-06T14:45:05.706 INFO:tasks.workunit.client.0.smithi052.stdout:9/973: dread d1/d4/fb8 [0,4194304] 0 2024-09-06T14:45:05.707 INFO:tasks.workunit.client.0.smithi052.stdout:1/977: rename d1/db/de/d74/d14/d2e/dc6/l12d to d1/db/d18/d6b/l157 0 2024-09-06T14:45:05.709 INFO:tasks.workunit.client.0.smithi052.stdout:9/974: truncate d1/d26/d41/f67 209983 0 2024-09-06T14:45:05.714 INFO:tasks.workunit.client.0.smithi052.stdout:2/987: link da/db/d18/l3e da/d19/d3a/d61/l14e 0 2024-09-06T14:45:05.715 INFO:tasks.workunit.client.0.smithi052.stdout:1/978: dwrite d1/db/de/d74/d14/d90/de6/f12a [0,4194304] 0 2024-09-06T14:45:05.716 INFO:tasks.workunit.client.0.smithi052.stdout:2/988: dread - da/db/d46/f128 zero size 2024-09-06T14:45:05.717 INFO:tasks.workunit.client.0.smithi052.stdout:9/975: mkdir d1/d4/d6/d123 0 2024-09-06T14:45:05.719 INFO:tasks.workunit.client.0.smithi052.stdout:1/979: mknod d1/db/de/d74/dcf/c158 0 2024-09-06T14:45:05.720 INFO:tasks.workunit.client.0.smithi052.stdout:9/976: read d1/d4/d6/dc/d10/f34 [1862649,59817] 0 2024-09-06T14:45:05.723 INFO:tasks.workunit.client.0.smithi052.stdout:1/980: truncate d1/db/de/d74/d14/dd1/f146 969408 0 2024-09-06T14:45:05.723 INFO:tasks.workunit.client.0.smithi052.stdout:2/989: rename da/db/d18/cab to da/db/d46/d6b/d12a/c14f 0 2024-09-06T14:45:05.726 INFO:tasks.workunit.client.0.smithi052.stdout:2/990: write da/d19/d5a/d6c/d132/f143 [5110961,88583] 0 2024-09-06T14:45:05.727 INFO:tasks.workunit.client.0.smithi052.stdout:1/981: rename d1/db/d72/d81/d10c to d1/d6c/d98/d159 0 2024-09-06T14:45:05.730 INFO:tasks.workunit.client.0.smithi052.stdout:2/991: dread da/d19/d3a/d31/d7a/dbd/dc6/fce [0,4194304] 0 2024-09-06T14:45:05.731 INFO:tasks.workunit.client.0.smithi052.stdout:1/982: mknod d1/db/d76/c15a 0 2024-09-06T14:45:05.733 INFO:tasks.workunit.client.0.smithi052.stdout:2/992: getdents da/db9/deb 0 2024-09-06T14:45:05.748 INFO:tasks.workunit.client.0.smithi052.stdout:9/977: dread d1/d4/d6/dc/d10/d18/d82/da6/dcb/df3/f62 [0,4194304] 0 2024-09-06T14:45:05.755 INFO:tasks.workunit.client.0.smithi052.stdout:2/993: dread da/d19/d3a/d61/d7b/f103 [0,4194304] 0 2024-09-06T14:45:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:2/994: dread - da/db/d46/d55/de6/f67 zero size 2024-09-06T14:45:05.757 INFO:tasks.workunit.client.0.smithi052.stdout:2/995: chown da/db/d109 122 1 2024-09-06T14:45:05.759 INFO:tasks.workunit.client.0.smithi052.stdout:2/996: dread da/f23 [0,4194304] 0 2024-09-06T14:45:05.766 INFO:tasks.workunit.client.0.smithi052.stdout:2/997: truncate da/d19/d3a/d31/d76/f4d 3782900 0 2024-09-06T14:45:05.767 INFO:tasks.workunit.client.0.smithi052.stdout:2/998: chown da/d4f/fb3 37 1 2024-09-06T14:45:05.777 INFO:tasks.workunit.client.0.smithi052.stdout:2/999: dread da/d19/f26 [0,4194304] 0 2024-09-06T14:45:05.950 INFO:tasks.workunit.client.0.smithi052.stdout:6/682: sync 2024-09-06T14:45:05.950 INFO:tasks.workunit.client.0.smithi052.stdout:6/683: readlink d2/dd/d5e/ld2 0 2024-09-06T14:45:06.036 INFO:tasks.workunit.client.0.smithi052.stdout:6/684: dwrite d2/dd/d18/d33/f69 [0,4194304] 0 2024-09-06T14:45:06.040 INFO:tasks.workunit.client.0.smithi052.stdout:6/685: symlink d2/dd/d18/d2d/ld9 0 2024-09-06T14:45:06.042 INFO:tasks.workunit.client.0.smithi052.stdout:6/686: mknod d2/dd/d18/d25/d6a/dcc/cda 0 2024-09-06T14:45:06.049 INFO:tasks.workunit.client.0.smithi052.stdout:6/687: link d2/dd/d18/d33/d44/d79/c8a d2/dd/d18/d25/d4c/dbe/cdb 0 2024-09-06T14:45:06.051 INFO:tasks.workunit.client.0.smithi052.stdout:6/688: getdents d2/dd/d9d/db4/dc0/dd6 0 2024-09-06T14:45:06.056 INFO:tasks.workunit.client.0.smithi052.stdout:6/689: dwrite d2/dd/d18/d25/f87 [4194304,4194304] 0 2024-09-06T14:45:06.064 INFO:tasks.workunit.client.0.smithi052.stdout:6/690: dwrite d2/dd/d9d/db4/fc6 [4194304,4194304] 0 2024-09-06T14:45:06.193 INFO:tasks.workunit.client.0.smithi052.stdout:3/967: sync 2024-09-06T14:45:06.193 INFO:tasks.workunit.client.0.smithi052.stdout:3/968: rmdir d0/d89 39 2024-09-06T14:45:06.199 INFO:tasks.workunit.client.0.smithi052.stdout:3/969: write d0/d11/d12/d4c/d93/d64/f8f [350950,40617] 0 2024-09-06T14:45:06.200 INFO:tasks.workunit.client.0.smithi052.stdout:3/970: read - d0/d11/d71/d98/d111/f126 zero size 2024-09-06T14:45:06.205 INFO:tasks.workunit.client.0.smithi052.stdout:3/971: getdents d0/d11/d12/d4c/d93/d64 0 2024-09-06T14:45:06.211 INFO:tasks.workunit.client.0.smithi052.stdout:3/972: dwrite d0/d11/d12/d4c/d93/d35/d46/f5e [0,4194304] 0 2024-09-06T14:45:06.231 INFO:tasks.workunit.client.0.smithi052.stdout:3/973: dwrite d0/d11/d71/d98/d1b/f60 [0,4194304] 0 2024-09-06T14:45:06.247 INFO:tasks.workunit.client.0.smithi052.stdout:3/974: dwrite d0/d11/d12/d4c/f101 [0,4194304] 0 2024-09-06T14:45:06.272 INFO:tasks.workunit.client.0.smithi052.stdout:3/975: dread d0/d11/d71/d98/d1b/d85/fdb [0,4194304] 0 2024-09-06T14:45:06.276 INFO:tasks.workunit.client.0.smithi052.stdout:3/976: rename d0/d11/d71/d98/d1b/d85/dc5/cce to d0/d11/d12/d4c/d93/d35/d46/d67/c135 0 2024-09-06T14:45:06.281 INFO:tasks.workunit.client.0.smithi052.stdout:3/977: dwrite d0/d11/d12/d4c/d93/f7a [0,4194304] 0 2024-09-06T14:45:06.283 INFO:tasks.workunit.client.0.smithi052.stdout:3/978: stat d0/d11/d71/d98/d1b/d85/d9f/dcf/d12c 0 2024-09-06T14:45:06.284 INFO:tasks.workunit.client.0.smithi052.stdout:3/979: write d0/d11/d12/d4c/d93/d35/db5/ffe [2598457,122757] 0 2024-09-06T14:45:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:05 smithi165 ceph-mon[36229]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 92 MiB/s wr, 254 op/s 2024-09-06T14:45:06.338 INFO:tasks.workunit.client.0.smithi052.stdout:7/869: sync 2024-09-06T14:45:06.339 INFO:tasks.workunit.client.0.smithi052.stdout:7/870: write d11/d1c/d3f/d73/dae/fc6 [2029570,96514] 0 2024-09-06T14:45:06.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:05 smithi052 ceph-mon[28627]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 92 MiB/s wr, 254 op/s 2024-09-06T14:45:06.382 INFO:tasks.workunit.client.0.smithi052.stdout:3/980: dwrite d0/d11/d12/d73/fa9 [0,4194304] 0 2024-09-06T14:45:06.383 INFO:tasks.workunit.client.0.smithi052.stdout:7/871: link d11/d1c/d24/d64/c108 d11/c10f 0 2024-09-06T14:45:06.386 INFO:tasks.workunit.client.0.smithi052.stdout:7/872: symlink d11/d1c/d3f/d73/dae/df2/l110 0 2024-09-06T14:45:06.387 INFO:tasks.workunit.client.0.smithi052.stdout:7/873: dread - d11/d1c/d3f/d5d/f68 zero size 2024-09-06T14:45:06.390 INFO:tasks.workunit.client.0.smithi052.stdout:3/981: link d0/d11/d12/l14 d0/d11/d12/d17/d7b/l136 0 2024-09-06T14:45:06.391 INFO:tasks.workunit.client.0.smithi052.stdout:7/874: fdatasync d11/d1c/d24/d3b/d50/f8c 0 2024-09-06T14:45:06.394 INFO:tasks.workunit.client.0.smithi052.stdout:3/982: mkdir d0/d11/d71/d98/d1b/d105/d137 0 2024-09-06T14:45:06.399 INFO:tasks.workunit.client.0.smithi052.stdout:3/983: mkdir d0/d11/d12/d4c/d138 0 2024-09-06T14:45:06.403 INFO:tasks.workunit.client.0.smithi052.stdout:3/984: creat d0/d11/d12/d4c/d93/d64/f139 x:0 0 0 2024-09-06T14:45:06.405 INFO:tasks.workunit.client.0.smithi052.stdout:3/985: dread d0/d11/d71/d98/d1b/d85/fdb [0,4194304] 0 2024-09-06T14:45:06.406 INFO:tasks.workunit.client.0.smithi052.stdout:4/907: sync 2024-09-06T14:45:06.411 INFO:tasks.workunit.client.0.smithi052.stdout:4/908: rename d9/d10/d17/d39/c4e to d9/d10/d17/daa/c144 0 2024-09-06T14:45:06.414 INFO:tasks.workunit.client.0.smithi052.stdout:3/986: write d0/d11/d12/f83 [1541807,100660] 0 2024-09-06T14:45:06.415 INFO:tasks.workunit.client.0.smithi052.stdout:7/875: dread d11/d1c/d24/fd7 [0,4194304] 0 2024-09-06T14:45:06.416 INFO:tasks.workunit.client.0.smithi052.stdout:4/909: getdents d9/d72/dca 0 2024-09-06T14:45:06.420 INFO:tasks.workunit.client.0.smithi052.stdout:7/876: rmdir d11/d1c/d78/d98 39 2024-09-06T14:45:06.421 INFO:tasks.workunit.client.0.smithi052.stdout:3/987: symlink d0/d11/l13a 0 2024-09-06T14:45:06.421 INFO:tasks.workunit.client.0.smithi052.stdout:7/877: rename d11/d1c/d24/f35 to d11/d1c/d24/d4b/da2/f111 0 2024-09-06T14:45:06.422 INFO:tasks.workunit.client.0.smithi052.stdout:7/878: stat d11/d1c/lb3 0 2024-09-06T14:45:06.423 INFO:tasks.workunit.client.0.smithi052.stdout:3/988: mknod d0/d11/d71/d98/d1b/d105/d137/c13b 0 2024-09-06T14:45:06.424 INFO:tasks.workunit.client.0.smithi052.stdout:3/989: chown d0/d11/d71/d98/f43 254269 1 2024-09-06T14:45:06.425 INFO:tasks.workunit.client.0.smithi052.stdout:7/879: dread d11/d1c/d57/d89/f8b [0,4194304] 0 2024-09-06T14:45:06.426 INFO:tasks.workunit.client.0.smithi052.stdout:3/990: read d0/d11/f2e [5390643,102439] 0 2024-09-06T14:45:06.431 INFO:tasks.workunit.client.0.smithi052.stdout:3/991: mknod d0/d11/d12/d73/de8/d112/c13c 0 2024-09-06T14:45:06.432 INFO:tasks.workunit.client.0.smithi052.stdout:7/880: dread d11/d1c/d24/d4b/da2/fe8 [0,4194304] 0 2024-09-06T14:45:06.434 INFO:tasks.workunit.client.0.smithi052.stdout:3/992: creat d0/d11/d71/d98/d1b/d105/d137/f13d x:0 0 0 2024-09-06T14:45:06.438 INFO:tasks.workunit.client.0.smithi052.stdout:3/993: symlink d0/d11/d71/d98/d1b/d85/dc5/l13e 0 2024-09-06T14:45:06.443 INFO:tasks.workunit.client.0.smithi052.stdout:7/881: truncate d11/d1c/d24/d64/faf 4014062 0 2024-09-06T14:45:06.444 INFO:tasks.workunit.client.0.smithi052.stdout:7/882: readlink d11/d1c/d57/l6b 0 2024-09-06T14:45:06.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/994: write d0/d11/d12/d4c/d93/d35/f3a [4947759,60802] 0 2024-09-06T14:45:06.446 INFO:tasks.workunit.client.0.smithi052.stdout:3/995: chown d0/fd7 264697 1 2024-09-06T14:45:06.447 INFO:tasks.workunit.client.0.smithi052.stdout:3/996: chown d0/d11/d71/fad 230694 1 2024-09-06T14:45:06.450 INFO:tasks.workunit.client.0.smithi052.stdout:3/997: rename d0/d8d to d0/d11/d71/d98/d124/d13f 0 2024-09-06T14:45:06.457 INFO:tasks.workunit.client.0.smithi052.stdout:7/883: dwrite d11/d1c/d24/d3b/fe6 [0,4194304] 0 2024-09-06T14:45:06.457 INFO:tasks.workunit.client.0.smithi052.stdout:3/998: dwrite d0/d11/d12/d73/f99 [0,4194304] 0 2024-09-06T14:45:06.459 INFO:tasks.workunit.client.0.smithi052.stdout:7/884: chown d11/d1c/d57/d89/db2/lf7 24201 1 2024-09-06T14:45:06.464 INFO:tasks.workunit.client.0.smithi052.stdout:7/885: unlink d11/d1c/d24/fd7 0 2024-09-06T14:45:06.471 INFO:tasks.workunit.client.0.smithi052.stdout:3/999: link d0/d89/ld1 d0/d11/d12/d4c/d93/d64/df1/l140 0 2024-09-06T14:45:06.474 INFO:tasks.workunit.client.0.smithi052.stdout:7/886: write d11/d1c/d26/f48 [1273575,101621] 0 2024-09-06T14:45:06.475 INFO:tasks.workunit.client.0.smithi052.stdout:7/887: chown d11/d1c/d24/d64/l66 109 1 2024-09-06T14:45:06.478 INFO:tasks.workunit.client.0.smithi052.stdout:7/888: creat d11/d1c/d24/f112 x:0 0 0 2024-09-06T14:45:06.480 INFO:tasks.workunit.client.0.smithi052.stdout:7/889: fsync d11/d1c/d78/d98/f10d 0 2024-09-06T14:45:06.483 INFO:tasks.workunit.client.0.smithi052.stdout:7/890: mknod d11/d1c/d24/d7e/c113 0 2024-09-06T14:45:06.486 INFO:tasks.workunit.client.0.smithi052.stdout:7/891: fdatasync d11/f49 0 2024-09-06T14:45:06.490 INFO:tasks.workunit.client.0.smithi052.stdout:7/892: truncate d11/d1c/d24/f41 1536095 0 2024-09-06T14:45:06.494 INFO:tasks.workunit.client.0.smithi052.stdout:7/893: link d11/c1b d11/d1c/d57/d89/de5/c114 0 2024-09-06T14:45:06.501 INFO:tasks.workunit.client.0.smithi052.stdout:7/894: dwrite d11/d1c/d3f/f9e [4194304,4194304] 0 2024-09-06T14:45:06.502 INFO:tasks.workunit.client.0.smithi052.stdout:7/895: chown d11/d1c/d57/da7 5653538 1 2024-09-06T14:45:06.506 INFO:tasks.workunit.client.0.smithi052.stdout:7/896: mknod d11/d1c/d24/d7e/c115 0 2024-09-06T14:45:06.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/897: fsync d11/d1c/d26/f48 0 2024-09-06T14:45:06.507 INFO:tasks.workunit.client.0.smithi052.stdout:7/898: readlink d11/d1c/d57/l59 0 2024-09-06T14:45:06.513 INFO:tasks.workunit.client.0.smithi052.stdout:7/899: link d11/f49 d11/d1c/d24/d7e/df4/f116 0 2024-09-06T14:45:06.513 INFO:tasks.workunit.client.0.smithi052.stdout:7/900: read - d11/d1c/d3f/d5d/fbd zero size 2024-09-06T14:45:06.515 INFO:tasks.workunit.client.0.smithi052.stdout:7/901: dread d11/d1c/d57/d89/f8b [0,4194304] 0 2024-09-06T14:45:06.518 INFO:tasks.workunit.client.0.smithi052.stdout:7/902: symlink d11/d1c/d24/l117 0 2024-09-06T14:45:06.531 INFO:tasks.workunit.client.0.smithi052.stdout:7/903: write d11/d1c/d3f/f5f [2375087,94761] 0 2024-09-06T14:45:06.541 INFO:tasks.workunit.client.0.smithi052.stdout:7/904: dwrite d11/d1c/d57/d89/db2/fc9 [0,4194304] 0 2024-09-06T14:45:06.544 INFO:tasks.workunit.client.0.smithi052.stdout:0/937: sync 2024-09-06T14:45:06.553 INFO:tasks.workunit.client.0.smithi052.stdout:0/938: write d0/d4f/d7d/f76 [273864,15154] 0 2024-09-06T14:45:06.567 INFO:tasks.workunit.client.0.smithi052.stdout:7/905: dread d11/d1c/d24/f44 [0,4194304] 0 2024-09-06T14:45:06.572 INFO:tasks.workunit.client.0.smithi052.stdout:0/939: dread d0/d1a/d26/d3a/ffa [0,4194304] 0 2024-09-06T14:45:06.574 INFO:tasks.workunit.client.0.smithi052.stdout:7/906: unlink d11/d1c/d24/f41 0 2024-09-06T14:45:06.575 INFO:tasks.workunit.client.0.smithi052.stdout:0/940: symlink d0/d2e/d12d/d100/l14e 0 2024-09-06T14:45:06.576 INFO:tasks.workunit.client.0.smithi052.stdout:7/907: rmdir d11/d1c/d57 39 2024-09-06T14:45:06.578 INFO:tasks.workunit.client.0.smithi052.stdout:7/908: chown d11/d1c/d57/d89/de5 26676 1 2024-09-06T14:45:06.585 INFO:tasks.workunit.client.0.smithi052.stdout:7/909: creat d11/d1c/d57/d89/f118 x:0 0 0 2024-09-06T14:45:06.586 INFO:tasks.workunit.client.0.smithi052.stdout:0/941: dwrite d0/d4f/d7d/f86 [0,4194304] 0 2024-09-06T14:45:06.587 INFO:tasks.workunit.client.0.smithi052.stdout:7/910: fdatasync d11/d1c/d57/f109 0 2024-09-06T14:45:06.588 INFO:tasks.workunit.client.0.smithi052.stdout:0/942: readlink d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/l6d 0 2024-09-06T14:45:06.591 INFO:tasks.workunit.client.0.smithi052.stdout:0/943: creat d0/d1a/daa/d120/f14f x:0 0 0 2024-09-06T14:45:06.592 INFO:tasks.workunit.client.0.smithi052.stdout:0/944: chown d0/d1a/d26/db7/d13f 3214240 1 2024-09-06T14:45:06.690 INFO:tasks.workunit.client.0.smithi052.stdout:0/945: link d0/d1a/d26/d13c/ffb d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/f150 0 2024-09-06T14:45:06.695 INFO:tasks.workunit.client.0.smithi052.stdout:0/946: dwrite d0/d1a/d26/fc7 [0,4194304] 0 2024-09-06T14:45:06.701 INFO:tasks.workunit.client.0.smithi052.stdout:0/947: creat d0/d1a/d26/db7/d13f/f151 x:0 0 0 2024-09-06T14:45:06.704 INFO:tasks.workunit.client.0.smithi052.stdout:0/948: dread - d0/d1a/d26/db7/de7/f138 zero size 2024-09-06T14:45:06.705 INFO:tasks.workunit.client.0.smithi052.stdout:0/949: write d0/d1a/de8/f131 [5066238,8695] 0 2024-09-06T14:45:06.712 INFO:tasks.workunit.client.0.smithi052.stdout:0/950: dwrite d0/d19/fa8 [4194304,4194304] 0 2024-09-06T14:45:06.714 INFO:tasks.workunit.client.0.smithi052.stdout:0/951: creat d0/d7e/f152 x:0 0 0 2024-09-06T14:45:06.718 INFO:tasks.workunit.client.0.smithi052.stdout:0/952: creat d0/d1a/d26/f153 x:0 0 0 2024-09-06T14:45:06.718 INFO:tasks.workunit.client.0.smithi052.stdout:0/953: fsync d0/d1a/d26/d13c/f123 0 2024-09-06T14:45:06.722 INFO:tasks.workunit.client.0.smithi052.stdout:0/954: creat d0/d1a/d26/db7/de7/f154 x:0 0 0 2024-09-06T14:45:06.723 INFO:tasks.workunit.client.0.smithi052.stdout:0/955: mknod d0/d1a/d8e/c155 0 2024-09-06T14:45:06.726 INFO:tasks.workunit.client.0.smithi052.stdout:0/956: symlink d0/d1a/d26/d3a/d14/d2d/d56/da3/l156 0 2024-09-06T14:45:06.728 INFO:tasks.workunit.client.0.smithi052.stdout:9/978: sync 2024-09-06T14:45:06.728 INFO:tasks.workunit.client.0.smithi052.stdout:1/983: sync 2024-09-06T14:45:06.728 INFO:tasks.workunit.client.0.smithi052.stdout:0/957: symlink d0/d1a/d26/d3a/d14/d2d/d94/dda/l157 0 2024-09-06T14:45:06.729 INFO:tasks.workunit.client.0.smithi052.stdout:1/984: stat d1/db/d72/db1/f11e 0 2024-09-06T14:45:06.731 INFO:tasks.workunit.client.0.smithi052.stdout:9/979: read d1/d4/d6/dd/f13 [1163572,110193] 0 2024-09-06T14:45:06.731 INFO:tasks.workunit.client.0.smithi052.stdout:0/958: stat d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/d60/f139 0 2024-09-06T14:45:06.733 INFO:tasks.workunit.client.0.smithi052.stdout:1/985: fsync d1/d5f/f134 0 2024-09-06T14:45:06.734 INFO:tasks.workunit.client.0.smithi052.stdout:9/980: read - d1/d4/d6/dc/d10/d18/d82/d9e/dfc/f10e zero size 2024-09-06T14:45:06.734 INFO:tasks.workunit.client.0.smithi052.stdout:0/959: truncate d0/d1a/daa/d120/f14f 336695 0 2024-09-06T14:45:06.735 INFO:tasks.workunit.client.0.smithi052.stdout:9/981: chown d1/f37 15777 1 2024-09-06T14:45:06.737 INFO:tasks.workunit.client.0.smithi052.stdout:9/982: write d1/f17 [2948424,94336] 0 2024-09-06T14:45:06.737 INFO:tasks.workunit.client.0.smithi052.stdout:1/986: read d1/db/de/d74/d14/d90/ffc [1999544,5501] 0 2024-09-06T14:45:06.738 INFO:tasks.workunit.client.0.smithi052.stdout:9/983: dread d1/d4/d6/f6c [0,4194304] 0 2024-09-06T14:45:06.741 INFO:tasks.workunit.client.0.smithi052.stdout:0/960: creat d0/d1a/d26/d13c/f158 x:0 0 0 2024-09-06T14:45:06.744 INFO:tasks.workunit.client.0.smithi052.stdout:1/987: fsync d1/db/de/d74/d12/f46 0 2024-09-06T14:45:06.744 INFO:tasks.workunit.client.0.smithi052.stdout:0/961: dread d0/d1a/d26/d3a/d14/d2d/d56/da3/dad/f150 [0,4194304] 0 2024-09-06T14:45:06.746 INFO:tasks.workunit.client.0.smithi052.stdout:9/984: creat d1/d4/d6/dd/de8/de9/dfb/f124 x:0 0 0 2024-09-06T14:45:06.747 INFO:tasks.workunit.client.0.smithi052.stdout:9/985: chown d1/d26/d3d/f94 1 1 2024-09-06T14:45:06.749 INFO:tasks.workunit.client.0.smithi052.stdout:9/986: truncate d1/d4/d6/dd/d22/d6a/ffe 724577 0 2024-09-06T14:45:06.751 INFO:tasks.workunit.client.0.smithi052.stdout:0/962: symlink d0/d1a/d26/db7/d13f/l159 0 2024-09-06T14:45:06.754 INFO:tasks.workunit.client.0.smithi052.stdout:0/963: symlink d0/d1a/l15a 0 2024-09-06T14:45:06.757 INFO:tasks.workunit.client.0.smithi052.stdout:0/964: creat d0/d4f/f15b x:0 0 0 2024-09-06T14:45:06.757 INFO:tasks.workunit.client.0.smithi052.stdout:1/988: dread d1/db/d18/f66 [0,4194304] 0 2024-09-06T14:45:06.757 INFO:tasks.workunit.client.0.smithi052.stdout:9/987: getdents d1/d4/d6/dc/d10/dbe/deb 0 2024-09-06T14:45:06.759 INFO:tasks.workunit.client.0.smithi052.stdout:0/965: unlink d0/d1a/d8e/c155 0 2024-09-06T14:45:06.759 INFO:tasks.workunit.client.0.smithi052.stdout:9/988: write d1/d4/d6/dc/d10/d18/d9f/df6/d108/f86 [2171942,96609] 0 2024-09-06T14:45:06.759 INFO:tasks.workunit.client.0.smithi052.stdout:0/966: readlink d0/d19/d29/lba 0 2024-09-06T14:45:06.760 INFO:tasks.workunit.client.0.smithi052.stdout:1/989: symlink d1/db/de/d74/d14/d9f/dcc/d47/d4a/l15b 0 2024-09-06T14:45:06.763 INFO:tasks.workunit.client.0.smithi052.stdout:1/990: creat d1/db/d122/f15c x:0 0 0 2024-09-06T14:45:06.765 INFO:tasks.workunit.client.0.smithi052.stdout:1/991: read d1/db/de/fa0 [1332700,324] 0 2024-09-06T14:45:06.766 INFO:tasks.workunit.client.0.smithi052.stdout:0/967: rename d0/d1a/d26/d3a/d14/d2d/d92 to d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/d15c 0 2024-09-06T14:45:06.770 INFO:tasks.workunit.client.0.smithi052.stdout:0/968: creat d0/d1a/d8e/d14a/f15d x:0 0 0 2024-09-06T14:45:06.773 INFO:tasks.workunit.client.0.smithi052.stdout:9/989: rename d1/d4/d6/dc/d10/d18/d82/dda/fd8 to d1/d4/d6/dc/d10/f125 0 2024-09-06T14:45:06.776 INFO:tasks.workunit.client.0.smithi052.stdout:1/992: link d1/db/de/c67 d1/db/d50/da4/d149/c15d 0 2024-09-06T14:45:06.777 INFO:tasks.workunit.client.0.smithi052.stdout:0/969: creat d0/d2e/d12d/d10f/d13d/f15e x:0 0 0 2024-09-06T14:45:06.778 INFO:tasks.workunit.client.0.smithi052.stdout:9/990: rename d1/d4/d6/dc/d10/d73/fae to d1/d4/d6/dc/d10/d18/d9f/f126 0 2024-09-06T14:45:06.779 INFO:tasks.workunit.client.0.smithi052.stdout:1/993: chown d1/db/l64 1993630013 1 2024-09-06T14:45:06.780 INFO:tasks.workunit.client.0.smithi052.stdout:0/970: creat d0/d3d/de4/f15f x:0 0 0 2024-09-06T14:45:06.781 INFO:tasks.workunit.client.0.smithi052.stdout:0/971: dread - d0/d7e/ff8 zero size 2024-09-06T14:45:06.782 INFO:tasks.workunit.client.0.smithi052.stdout:9/991: mkdir d1/d4/d6/dc/d38/dfd/d127 0 2024-09-06T14:45:06.784 INFO:tasks.workunit.client.0.smithi052.stdout:1/994: dread d1/db/de/d74/d14/f25 [0,4194304] 0 2024-09-06T14:45:06.784 INFO:tasks.workunit.client.0.smithi052.stdout:0/972: mkdir d0/d1a/d26/db7/de7/d160 0 2024-09-06T14:45:06.786 INFO:tasks.workunit.client.0.smithi052.stdout:9/992: unlink d1/d4/d6/dc/d10/d18/f120 0 2024-09-06T14:45:06.790 INFO:tasks.workunit.client.0.smithi052.stdout:4/910: sync 2024-09-06T14:45:06.790 INFO:tasks.workunit.client.0.smithi052.stdout:6/691: sync 2024-09-06T14:45:06.792 INFO:tasks.workunit.client.0.smithi052.stdout:6/692: read d2/dd/d18/f2b [675212,62511] 0 2024-09-06T14:45:06.809 INFO:tasks.workunit.client.0.smithi052.stdout:0/973: symlink d0/d4f/d7d/l161 0 2024-09-06T14:45:06.814 INFO:tasks.workunit.client.0.smithi052.stdout:9/993: rmdir d1/d4/d6/dc/d10/d18/d82/da6/dcb/df3 39 2024-09-06T14:45:06.815 INFO:tasks.workunit.client.0.smithi052.stdout:4/911: fdatasync d9/d72/fd8 0 2024-09-06T14:45:06.818 INFO:tasks.workunit.client.0.smithi052.stdout:1/995: link d1/d6c/d98/f13b d1/db/de/d74/d14/dda/f15e 0 2024-09-06T14:45:06.819 INFO:tasks.workunit.client.0.smithi052.stdout:9/994: dwrite d1/d4/d6/dc/d10/d18/d82/dda/fd4 [0,4194304] 0 2024-09-06T14:45:06.829 INFO:tasks.workunit.client.0.smithi052.stdout:9/995: dwrite d1/d4/d6/dc/d10/d18/d9f/df6/d108/fdb [0,4194304] 0 2024-09-06T14:45:06.829 INFO:tasks.workunit.client.0.smithi052.stdout:9/996: chown d1/d4/d6/ff1 223969 1 2024-09-06T14:45:06.830 INFO:tasks.workunit.client.0.smithi052.stdout:6/693: mknod d2/dd/d9d/db4/dc0/dd6/cdc 0 2024-09-06T14:45:06.830 INFO:tasks.workunit.client.0.smithi052.stdout:9/997: write d1/d4/d6/dd/d22/fcf [6297,17150] 0 2024-09-06T14:45:06.833 INFO:tasks.workunit.client.0.smithi052.stdout:1/996: chown d1/d5f/c106 87890 1 2024-09-06T14:45:06.835 INFO:tasks.workunit.client.0.smithi052.stdout:1/997: write d1/db/de/d74/d14/dd1/f146 [1296365,100966] 0 2024-09-06T14:45:06.840 INFO:tasks.workunit.client.0.smithi052.stdout:4/912: symlink d9/d10/d19/ddf/l145 0 2024-09-06T14:45:06.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/913: dread d9/d10/d19/f48 [0,4194304] 0 2024-09-06T14:45:06.864 INFO:tasks.workunit.client.0.smithi052.stdout:1/998: dread d1/db/de/d74/d14/f28 [0,4194304] 0 2024-09-06T14:45:06.880 INFO:tasks.workunit.client.0.smithi052.stdout:6/694: creat d2/d4a/d6e/fdd x:0 0 0 2024-09-06T14:45:06.881 INFO:tasks.workunit.client.0.smithi052.stdout:6/695: truncate d2/d4a/d6e/fdd 696838 0 2024-09-06T14:45:06.883 INFO:tasks.workunit.client.0.smithi052.stdout:6/696: creat d2/dd/d18/d25/d4c/dbe/fde x:0 0 0 2024-09-06T14:45:06.912 INFO:tasks.workunit.client.0.smithi052.stdout:1/999: write d1/db/de/d74/d14/d90/fd7 [980671,103901] 0 2024-09-06T14:45:06.963 INFO:tasks.workunit.client.0.smithi052.stdout:0/974: rename d0/d7e/f152 to d0/d1a/d26/d3a/d14/d2d/d56/f162 0 2024-09-06T14:45:06.966 INFO:tasks.workunit.client.0.smithi052.stdout:6/697: rename d2/d4a/f5b to d2/dd/d18/d25/d6a/dcc/fdf 0 2024-09-06T14:45:06.968 INFO:tasks.workunit.client.0.smithi052.stdout:0/975: creat d0/d3d/d12a/f163 x:0 0 0 2024-09-06T14:45:06.971 INFO:tasks.workunit.client.0.smithi052.stdout:0/976: rename d0/d3d/d12a/d8b/lb3 to d0/d4f/l164 0 2024-09-06T14:45:06.972 INFO:tasks.workunit.client.0.smithi052.stdout:7/911: sync 2024-09-06T14:45:06.972 INFO:tasks.workunit.client.0.smithi052.stdout:6/698: dwrite d2/dd/d9d/db4/fc6 [4194304,4194304] 0 2024-09-06T14:45:06.974 INFO:tasks.workunit.client.0.smithi052.stdout:7/912: chown d11/d1c/d24/d3b/d50/ce9 74249329 1 2024-09-06T14:45:06.976 INFO:tasks.workunit.client.0.smithi052.stdout:0/977: fdatasync d0/d1a/d26/d3a/d14/d2d/d94/dda/f12e 0 2024-09-06T14:45:06.979 INFO:tasks.workunit.client.0.smithi052.stdout:7/913: rmdir d11/d1c/d3f/d5d/d88 39 2024-09-06T14:45:06.983 INFO:tasks.workunit.client.0.smithi052.stdout:0/978: mkdir d0/d1a/d26/d3a/d14/d2d/d56/d9d/d165 0 2024-09-06T14:45:06.990 INFO:tasks.workunit.client.0.smithi052.stdout:7/914: link d11/d1c/d78/f79 d11/d1c/d3f/d73/dae/f119 0 2024-09-06T14:45:06.992 INFO:tasks.workunit.client.0.smithi052.stdout:7/915: readlink d11/d1c/d3f/d5d/d88/la4 0 2024-09-06T14:45:06.994 INFO:tasks.workunit.client.0.smithi052.stdout:6/699: dwrite d2/dd/d18/d33/d44/d79/f9c [0,4194304] 0 2024-09-06T14:45:06.998 INFO:tasks.workunit.client.0.smithi052.stdout:0/979: write d0/d1a/d26/d3a/d14/d2d/d56/f73 [1816711,45435] 0 2024-09-06T14:45:06.999 INFO:tasks.workunit.client.0.smithi052.stdout:6/700: symlink d2/dd/d18/d4b/le0 0 2024-09-06T14:45:07.004 INFO:tasks.workunit.client.0.smithi052.stdout:6/701: chown d2/dd/d18/d25/d4c/d61/f8d 14024 1 2024-09-06T14:45:07.008 INFO:tasks.workunit.client.0.smithi052.stdout:7/916: dwrite d11/d1c/d3f/d5d/fbd [0,4194304] 0 2024-09-06T14:45:07.008 INFO:tasks.workunit.client.0.smithi052.stdout:6/702: write d2/dd/d18/f6d [2620866,74172] 0 2024-09-06T14:45:07.009 INFO:tasks.workunit.client.0.smithi052.stdout:7/917: chown d11/c16 884812557 1 2024-09-06T14:45:07.011 INFO:tasks.workunit.client.0.smithi052.stdout:6/703: chown d2/dd/d9d/db4/cbf 6305 1 2024-09-06T14:45:07.015 INFO:tasks.workunit.client.0.smithi052.stdout:6/704: read - d2/dd/d18/d2d/d71/fbc zero size 2024-09-06T14:45:07.018 INFO:tasks.workunit.client.0.smithi052.stdout:6/705: symlink d2/dd/d18/d25/d4c/le1 0 2024-09-06T14:45:07.021 INFO:tasks.workunit.client.0.smithi052.stdout:6/706: symlink d2/dd/d18/d2d/da7/le2 0 2024-09-06T14:45:07.027 INFO:tasks.workunit.client.0.smithi052.stdout:0/980: dread d0/d1a/de8/f131 [0,4194304] 0 2024-09-06T14:45:07.029 INFO:tasks.workunit.client.0.smithi052.stdout:6/707: dwrite d2/dd/d18/d33/f69 [0,4194304] 0 2024-09-06T14:45:07.029 INFO:tasks.workunit.client.0.smithi052.stdout:7/918: dread d11/d1c/d57/d74/fdd [0,4194304] 0 2024-09-06T14:45:07.033 INFO:tasks.workunit.client.0.smithi052.stdout:0/981: symlink d0/d3d/ded/l166 0 2024-09-06T14:45:07.033 INFO:tasks.workunit.client.0.smithi052.stdout:7/919: fdatasync d11/d1c/d57/d74/f10e 0 2024-09-06T14:45:07.033 INFO:tasks.workunit.client.0.smithi052.stdout:0/982: write d0/d1a/d26/d3a/f115 [620828,40070] 0 2024-09-06T14:45:07.035 INFO:tasks.workunit.client.0.smithi052.stdout:0/983: write d0/d1a/daa/d120/f14f [739192,104479] 0 2024-09-06T14:45:07.039 INFO:tasks.workunit.client.0.smithi052.stdout:7/920: dwrite d11/d1c/d24/d3b/f97 [0,4194304] 0 2024-09-06T14:45:07.040 INFO:tasks.workunit.client.0.smithi052.stdout:7/921: read d11/d1c/d24/d3b/fe6 [2631832,25349] 0 2024-09-06T14:45:07.041 INFO:tasks.workunit.client.0.smithi052.stdout:0/984: creat d0/d2e/d12d/d10f/d13d/f167 x:0 0 0 2024-09-06T14:45:07.047 INFO:tasks.workunit.client.0.smithi052.stdout:7/922: getdents d11/d1c/d26 0 2024-09-06T14:45:07.051 INFO:tasks.workunit.client.0.smithi052.stdout:7/923: truncate d11/d1c/d24/d3b/d50/fab 2083770 0 2024-09-06T14:45:07.052 INFO:tasks.workunit.client.0.smithi052.stdout:7/924: read d11/d1c/d24/d3b/f97 [1712825,127978] 0 2024-09-06T14:45:07.054 INFO:tasks.workunit.client.0.smithi052.stdout:0/985: truncate d0/d1a/f40 468565 0 2024-09-06T14:45:07.057 INFO:tasks.workunit.client.0.smithi052.stdout:0/986: symlink d0/d1a/d26/d3a/d14/d20/d108/d12f/l168 0 2024-09-06T14:45:07.064 INFO:tasks.workunit.client.0.smithi052.stdout:7/925: write d11/d1c/d24/f84 [260276,76237] 0 2024-09-06T14:45:07.065 INFO:tasks.workunit.client.0.smithi052.stdout:7/926: chown d11/d1c/d24/d3b/l4a 5 1 2024-09-06T14:45:07.067 INFO:tasks.workunit.client.0.smithi052.stdout:7/927: mknod d11/d1c/d57/d89/db2/c11a 0 2024-09-06T14:45:07.068 INFO:tasks.workunit.client.0.smithi052.stdout:7/928: stat d11/d1c/d24/d3b/d50 0 2024-09-06T14:45:07.073 INFO:tasks.workunit.client.0.smithi052.stdout:0/987: dwrite d0/d1a/d26/d3a/d14/d2d/f33 [0,4194304] 0 2024-09-06T14:45:07.074 INFO:tasks.workunit.client.0.smithi052.stdout:0/988: write d0/d7e/ddb/f11b [705720,106451] 0 2024-09-06T14:45:07.075 INFO:tasks.workunit.client.0.smithi052.stdout:0/989: readlink d0/l67 0 2024-09-06T14:45:07.076 INFO:tasks.workunit.client.0.smithi052.stdout:0/990: fsync d0/d1a/daa/d120/f132 0 2024-09-06T14:45:07.078 INFO:tasks.workunit.client.0.smithi052.stdout:7/929: rmdir d11/d1c/d3f/d5d/d88/dd2 0 2024-09-06T14:45:07.090 INFO:tasks.workunit.client.0.smithi052.stdout:7/930: write d11/f14 [557837,85301] 0 2024-09-06T14:45:07.095 INFO:tasks.workunit.client.0.smithi052.stdout:7/931: getdents d11/d1c/d3f/d5d/d88 0 2024-09-06T14:45:07.097 INFO:tasks.workunit.client.0.smithi052.stdout:7/932: mkdir d11/d1c/d24/d11b 0 2024-09-06T14:45:07.099 INFO:tasks.workunit.client.0.smithi052.stdout:7/933: symlink d11/d1c/d24/d4b/l11c 0 2024-09-06T14:45:07.102 INFO:tasks.workunit.client.0.smithi052.stdout:7/934: rename d11/d1c/c80 to d11/d1c/d3f/d73/c11d 0 2024-09-06T14:45:07.107 INFO:tasks.workunit.client.0.smithi052.stdout:7/935: write d11/d1c/d24/d3b/d50/f8c [2385517,91285] 0 2024-09-06T14:45:07.109 INFO:tasks.workunit.client.0.smithi052.stdout:7/936: truncate d11/d1c/d26/f94 46978 0 2024-09-06T14:45:07.114 INFO:tasks.workunit.client.0.smithi052.stdout:7/937: write d11/d1c/d24/d64/faf [1021302,39755] 0 2024-09-06T14:45:07.119 INFO:tasks.workunit.client.0.smithi052.stdout:7/938: getdents d11/d1c/d24/d4b 0 2024-09-06T14:45:07.120 INFO:tasks.workunit.client.0.smithi052.stdout:7/939: mkdir d11/d1c/d57/d11e 0 2024-09-06T14:45:07.126 INFO:tasks.workunit.client.0.smithi052.stdout:7/940: write d11/d1c/d24/f44 [215876,69657] 0 2024-09-06T14:45:07.128 INFO:tasks.workunit.client.0.smithi052.stdout:7/941: symlink d11/d1c/d78/d98/l11f 0 2024-09-06T14:45:07.129 INFO:tasks.workunit.client.0.smithi052.stdout:7/942: creat d11/d1c/d26/f120 x:0 0 0 2024-09-06T14:45:07.133 INFO:tasks.workunit.client.0.smithi052.stdout:7/943: dread d11/d1c/d78/d98/f10d [0,4194304] 0 2024-09-06T14:45:07.136 INFO:tasks.workunit.client.0.smithi052.stdout:7/944: creat d11/d1c/d3f/f121 x:0 0 0 2024-09-06T14:45:07.137 INFO:tasks.workunit.client.0.smithi052.stdout:7/945: write d11/d1c/d26/f48 [2448078,21821] 0 2024-09-06T14:45:07.148 INFO:tasks.workunit.client.0.smithi052.stdout:7/946: dwrite d11/d1c/d24/d4b/f63 [0,4194304] 0 2024-09-06T14:45:07.150 INFO:tasks.workunit.client.0.smithi052.stdout:7/947: truncate d11/f43 813798 0 2024-09-06T14:45:07.160 INFO:tasks.workunit.client.0.smithi052.stdout:7/948: dwrite d11/d1c/d57/d74/fe4 [0,4194304] 0 2024-09-06T14:45:07.166 INFO:tasks.workunit.client.0.smithi052.stdout:7/949: unlink cb 0 2024-09-06T14:45:07.168 INFO:tasks.workunit.client.0.smithi052.stdout:7/950: creat d11/d1c/d57/d89/de5/f122 x:0 0 0 2024-09-06T14:45:07.249 INFO:tasks.workunit.client.0.smithi052.stdout:7/951: dwrite d11/d1c/d24/f25 [0,4194304] 0 2024-09-06T14:45:07.279 INFO:tasks.workunit.client.0.smithi052.stdout:7/952: creat d11/d1c/d3f/d73/dae/f123 x:0 0 0 2024-09-06T14:45:07.282 INFO:tasks.workunit.client.0.smithi052.stdout:7/953: creat d11/d1c/d57/da7/f124 x:0 0 0 2024-09-06T14:45:07.283 INFO:tasks.workunit.client.0.smithi052.stdout:7/954: stat d11/d1c/d3f/d73/dae/f123 0 2024-09-06T14:45:07.285 INFO:tasks.workunit.client.0.smithi052.stdout:7/955: creat d11/d1c/d3f/d73/f125 x:0 0 0 2024-09-06T14:45:07.307 INFO:tasks.workunit.client.0.smithi052.stdout:7/956: dwrite d11/fcb [0,4194304] 0 2024-09-06T14:45:07.313 INFO:tasks.workunit.client.0.smithi052.stdout:7/957: rename d11/d1c/d57/c6c to d11/d1c/d10a/c126 0 2024-09-06T14:45:07.328 INFO:tasks.workunit.client.0.smithi052.stdout:7/958: truncate d11/d1c/d3f/d5d/fbd 2454242 0 2024-09-06T14:45:07.329 INFO:tasks.workunit.client.0.smithi052.stdout:7/959: chown d11/d1c/d24/d7e/c115 161299 1 2024-09-06T14:45:07.335 INFO:tasks.workunit.client.0.smithi052.stdout:7/960: dwrite d11/d1c/d24/d4b/da2/ffb [0,4194304] 0 2024-09-06T14:45:07.336 INFO:tasks.workunit.client.0.smithi052.stdout:7/961: stat d11/d1c/d24/d3b/d50/la3 0 2024-09-06T14:45:07.343 INFO:tasks.workunit.client.0.smithi052.stdout:7/962: dwrite d11/d1c/d24/d3b/d50/f6e [4194304,4194304] 0 2024-09-06T14:45:07.346 INFO:tasks.workunit.client.0.smithi052.stdout:7/963: write d11/d1c/d24/d4b/da2/fb1 [169234,107208] 0 2024-09-06T14:45:07.347 INFO:tasks.workunit.client.0.smithi052.stdout:7/964: write d11/d1c/d3f/f121 [39634,11812] 0 2024-09-06T14:45:07.349 INFO:tasks.workunit.client.0.smithi052.stdout:7/965: fdatasync d11/d1c/d3f/fe0 0 2024-09-06T14:45:07.353 INFO:tasks.workunit.client.0.smithi052.stdout:9/998: sync 2024-09-06T14:45:07.353 INFO:tasks.workunit.client.0.smithi052.stdout:4/914: sync 2024-09-06T14:45:07.356 INFO:tasks.workunit.client.0.smithi052.stdout:9/999: read d1/d4/f92 [40193,20689] 0 2024-09-06T14:45:07.357 INFO:tasks.workunit.client.0.smithi052.stdout:4/915: symlink d9/l146 0 2024-09-06T14:45:07.364 INFO:tasks.workunit.client.0.smithi052.stdout:4/916: unlink d9/d10/c68 0 2024-09-06T14:45:07.366 INFO:tasks.workunit.client.0.smithi052.stdout:4/917: creat d9/df2/f147 x:0 0 0 2024-09-06T14:45:07.366 INFO:tasks.workunit.client.0.smithi052.stdout:7/966: write d11/d1c/d24/d4b/f9b [76644,25576] 0 2024-09-06T14:45:07.373 INFO:tasks.workunit.client.0.smithi052.stdout:4/918: dwrite d9/d121/d12b/f13b [0,4194304] 0 2024-09-06T14:45:07.374 INFO:tasks.workunit.client.0.smithi052.stdout:4/919: chown d9/d10/d17/d39/d3a/d125/l139 190 1 2024-09-06T14:45:07.383 INFO:tasks.workunit.client.0.smithi052.stdout:4/920: rename d9/d2d/d33/d5d/da6/deb/d81/c127 to d9/d10/d17/d39/c148 0 2024-09-06T14:45:07.383 INFO:tasks.workunit.client.0.smithi052.stdout:7/967: dwrite d11/d1c/d24/d4b/f4e [0,4194304] 0 2024-09-06T14:45:07.384 INFO:tasks.workunit.client.0.smithi052.stdout:7/968: readlink d11/l7d 0 2024-09-06T14:45:07.385 INFO:tasks.workunit.client.0.smithi052.stdout:4/921: chown d9/d10/d17/daa/db5/f11e 160330202 1 2024-09-06T14:45:07.388 INFO:tasks.workunit.client.0.smithi052.stdout:7/969: mknod d11/d1c/d3f/d5d/d88/c127 0 2024-09-06T14:45:07.389 INFO:tasks.workunit.client.0.smithi052.stdout:7/970: stat d11/d1c/d57/d89/db2 0 2024-09-06T14:45:07.389 INFO:tasks.workunit.client.0.smithi052.stdout:4/922: symlink d9/d121/l149 0 2024-09-06T14:45:07.390 INFO:tasks.workunit.client.0.smithi052.stdout:7/971: write f5 [594672,121240] 0 2024-09-06T14:45:07.391 INFO:tasks.workunit.client.0.smithi052.stdout:7/972: chown d11/d1c/d24/d3b/d50/f6d 94 1 2024-09-06T14:45:07.392 INFO:tasks.workunit.client.0.smithi052.stdout:4/923: read d9/d10/f74 [152669,38696] 0 2024-09-06T14:45:07.537 INFO:tasks.workunit.client.0.smithi052.stdout:6/708: sync 2024-09-06T14:45:07.538 INFO:tasks.workunit.client.0.smithi052.stdout:0/991: sync 2024-09-06T14:45:07.538 INFO:tasks.workunit.client.0.smithi052.stdout:0/992: dread - d0/d1a/d26/f84 zero size 2024-09-06T14:45:07.539 INFO:tasks.workunit.client.0.smithi052.stdout:6/709: rmdir d2/db6 39 2024-09-06T14:45:07.541 INFO:tasks.workunit.client.0.smithi052.stdout:6/710: fdatasync d2/dd/d18/d33/d44/d79/fd0 0 2024-09-06T14:45:07.543 INFO:tasks.workunit.client.0.smithi052.stdout:0/993: chown d0/d1a/d26/d3a/d14/d2d/d56/d9d/d9a/lff 588275 1 2024-09-06T14:45:07.551 INFO:tasks.workunit.client.0.smithi052.stdout:0/994: unlink d0/d1a/d26/d3a/d14/d2d/f2b 0 2024-09-06T14:45:07.553 INFO:tasks.workunit.client.0.smithi052.stdout:0/995: mknod d0/d3d/de4/c169 0 2024-09-06T14:45:07.554 INFO:tasks.workunit.client.0.smithi052.stdout:6/711: truncate d2/dd/d18/d4b/f94 1442638 0 2024-09-06T14:45:07.554 INFO:tasks.workunit.client.0.smithi052.stdout:6/712: stat d2/d4a/d6e/fdd 0 2024-09-06T14:45:07.556 INFO:tasks.workunit.client.0.smithi052.stdout:0/996: fsync d0/d1a/d26/d13c/f5f 0 2024-09-06T14:45:07.559 INFO:tasks.workunit.client.0.smithi052.stdout:0/997: rename d0/d1a/c12b to d0/d3d/c16a 0 2024-09-06T14:45:07.561 INFO:tasks.workunit.client.0.smithi052.stdout:0/998: write d0/d1a/d26/db7/de7/f149 [1003426,58656] 0 2024-09-06T14:45:07.563 INFO:tasks.workunit.client.0.smithi052.stdout:0/999: chown d0/d1a/d26/d3a/d14/d20/fc5 71 1 2024-09-06T14:45:07.565 INFO:tasks.workunit.client.0.smithi052.stdout:6/713: dread d2/dd/d18/f6d [0,4194304] 0 2024-09-06T14:45:07.568 INFO:tasks.workunit.client.0.smithi052.stdout:6/714: mknod d2/d4a/d6e/ce3 0 2024-09-06T14:45:07.573 INFO:tasks.workunit.client.0.smithi052.stdout:6/715: link d2/dd/d18/d4b/le0 d2/dd/d18/d25/d4c/dbe/le4 0 2024-09-06T14:45:07.589 INFO:tasks.workunit.client.0.smithi052.stdout:6/716: dwrite d2/dd/d18/d25/f3e [0,4194304] 0 2024-09-06T14:45:07.594 INFO:tasks.workunit.client.0.smithi052.stdout:6/717: rename d2/dd/d9d/fc8 to d2/dd/d18/d25/d4c/dbe/fe5 0 2024-09-06T14:45:07.596 INFO:tasks.workunit.client.0.smithi052.stdout:6/718: read - d2/dd/d18/d25/d4c/dbe/fde zero size 2024-09-06T14:45:07.615 INFO:tasks.workunit.client.0.smithi052.stdout:6/719: dwrite d2/dd/d18/d25/d6a/dcc/fdf [0,4194304] 0 2024-09-06T14:45:07.617 INFO:tasks.workunit.client.0.smithi052.stdout:6/720: fsync d2/dd/d18/d2d/d32/f35 0 2024-09-06T14:45:07.619 INFO:tasks.workunit.client.0.smithi052.stdout:6/721: chown d2/dd/d5e/l64 128265124 1 2024-09-06T14:45:07.622 INFO:tasks.workunit.client.0.smithi052.stdout:6/722: creat d2/dd/d9d/db4/dc0/fe6 x:0 0 0 2024-09-06T14:45:07.624 INFO:tasks.workunit.client.0.smithi052.stdout:7/973: sync 2024-09-06T14:45:07.624 INFO:tasks.workunit.client.0.smithi052.stdout:4/924: sync 2024-09-06T14:45:07.625 INFO:tasks.workunit.client.0.smithi052.stdout:6/723: chown d2/dd/d18/d25/c68 10 1 2024-09-06T14:45:07.626 INFO:tasks.workunit.client.0.smithi052.stdout:6/724: chown d2/d4a/d6e/fdd 162580537 1 2024-09-06T14:45:07.628 INFO:tasks.workunit.client.0.smithi052.stdout:7/974: creat d11/d1c/d57/da7/f128 x:0 0 0 2024-09-06T14:45:07.628 INFO:tasks.workunit.client.0.smithi052.stdout:6/725: read d2/dd/d18/d25/f2c [5279194,15220] 0 2024-09-06T14:45:07.629 INFO:tasks.workunit.client.0.smithi052.stdout:7/975: write d11/d1c/d3f/d73/ffc [410726,110539] 0 2024-09-06T14:45:07.634 INFO:tasks.workunit.client.0.smithi052.stdout:4/925: write d9/d10/d19/f3c [607112,94396] 0 2024-09-06T14:45:07.635 INFO:tasks.workunit.client.0.smithi052.stdout:7/976: write d11/d1c/d3f/fee [919253,122250] 0 2024-09-06T14:45:07.639 INFO:tasks.workunit.client.0.smithi052.stdout:4/926: fdatasync d9/d2d/d33/d5d/da6/deb/f76 0 2024-09-06T14:45:07.639 INFO:tasks.workunit.client.0.smithi052.stdout:7/977: mknod d11/d1c/d24/dca/c129 0 2024-09-06T14:45:07.642 INFO:tasks.workunit.client.0.smithi052.stdout:6/726: dwrite d2/dd/d18/d2d/d32/f55 [8388608,4194304] 0 2024-09-06T14:45:07.645 INFO:tasks.workunit.client.0.smithi052.stdout:7/978: mkdir d11/d1c/d57/d89/db2/d12a 0 2024-09-06T14:45:07.646 INFO:tasks.workunit.client.0.smithi052.stdout:7/979: readlink d11/d1c/d57/l59 0 2024-09-06T14:45:07.646 INFO:tasks.workunit.client.0.smithi052.stdout:4/927: fsync d9/d2d/f63 0 2024-09-06T14:45:07.647 INFO:tasks.workunit.client.0.smithi052.stdout:6/727: mknod d2/dd/d18/d25/d6a/ce7 0 2024-09-06T14:45:07.647 INFO:tasks.workunit.client.0.smithi052.stdout:6/728: write d2/dd/d18/d33/fa5 [1806918,85423] 0 2024-09-06T14:45:07.650 INFO:tasks.workunit.client.0.smithi052.stdout:7/980: readlink d11/lf9 0 2024-09-06T14:45:07.656 INFO:tasks.workunit.client.0.smithi052.stdout:6/729: creat d2/dd/d9d/db4/dc0/fe8 x:0 0 0 2024-09-06T14:45:07.658 INFO:tasks.workunit.client.0.smithi052.stdout:4/928: unlink d9/d2d/f8d 0 2024-09-06T14:45:07.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/730: creat d2/dd/d9d/db4/fe9 x:0 0 0 2024-09-06T14:45:07.660 INFO:tasks.workunit.client.0.smithi052.stdout:4/929: truncate d9/d10/d17/d39/d3a/d125/f115 4648985 0 2024-09-06T14:45:07.663 INFO:tasks.workunit.client.0.smithi052.stdout:6/731: symlink d2/db6/lea 0 2024-09-06T14:45:07.670 INFO:tasks.workunit.client.0.smithi052.stdout:7/981: dwrite d11/d1c/d57/f9f [0,4194304] 0 2024-09-06T14:45:07.673 INFO:tasks.workunit.client.0.smithi052.stdout:6/732: dread d2/db6/fb9 [0,4194304] 0 2024-09-06T14:45:07.675 INFO:tasks.workunit.client.0.smithi052.stdout:4/930: dwrite d9/d10/f9f [0,4194304] 0 2024-09-06T14:45:07.678 INFO:tasks.workunit.client.0.smithi052.stdout:6/733: stat d2/dd/d18/d2d/d32/f40 0 2024-09-06T14:45:07.680 INFO:tasks.workunit.client.0.smithi052.stdout:7/982: dwrite d11/d1c/d57/d89/db2/fd9 [4194304,4194304] 0 2024-09-06T14:45:07.681 INFO:tasks.workunit.client.0.smithi052.stdout:7/983: chown f5 41288 1 2024-09-06T14:45:07.682 INFO:tasks.workunit.client.0.smithi052.stdout:6/734: rmdir d2/dd/d9d/db4/dc0/dd6 39 2024-09-06T14:45:07.684 INFO:tasks.workunit.client.0.smithi052.stdout:7/984: mkdir d11/d1c/d3f/d5d/d88/d12b 0 2024-09-06T14:45:07.685 INFO:tasks.workunit.client.0.smithi052.stdout:7/985: readlink d11/d1c/d24/dca/l103 0 2024-09-06T14:45:07.689 INFO:tasks.workunit.client.0.smithi052.stdout:6/735: read d2/dd/d18/d4b/f94 [484504,100199] 0 2024-09-06T14:45:07.690 INFO:tasks.workunit.client.0.smithi052.stdout:7/986: truncate d11/d1c/d78/f79 2422439 0 2024-09-06T14:45:07.691 INFO:tasks.workunit.client.0.smithi052.stdout:6/736: fdatasync d2/dd/d18/d2d/fcd 0 2024-09-06T14:45:07.692 INFO:tasks.workunit.client.0.smithi052.stdout:6/737: chown d2/dd/d5e/c63 5751 1 2024-09-06T14:45:07.694 INFO:tasks.workunit.client.0.smithi052.stdout:7/987: chown d11/f23 14 1 2024-09-06T14:45:07.698 INFO:tasks.workunit.client.0.smithi052.stdout:6/738: rename d2/dd to d2/d4a/deb 0 2024-09-06T14:45:07.701 INFO:tasks.workunit.client.0.smithi052.stdout:6/739: creat d2/d4a/deb/d18/d2d/d71/fec x:0 0 0 2024-09-06T14:45:07.704 INFO:tasks.workunit.client.0.smithi052.stdout:6/740: fdatasync d2/fb 0 2024-09-06T14:45:07.705 INFO:tasks.workunit.client.0.smithi052.stdout:6/741: chown d2/f3b 1054978188 1 2024-09-06T14:45:07.707 INFO:tasks.workunit.client.0.smithi052.stdout:6/742: creat d2/d4a/deb/d18/d2d/d71/fed x:0 0 0 2024-09-06T14:45:07.710 INFO:tasks.workunit.client.0.smithi052.stdout:6/743: mkdir d2/d4a/deb/d9d/db4/dc0/dd6/dee 0 2024-09-06T14:45:07.713 INFO:tasks.workunit.client.0.smithi052.stdout:7/988: write d11/f49 [2030561,96015] 0 2024-09-06T14:45:07.714 INFO:tasks.workunit.client.0.smithi052.stdout:6/744: getdents d2/db6 0 2024-09-06T14:45:07.717 INFO:tasks.workunit.client.0.smithi052.stdout:6/745: creat d2/d4a/deb/d9d/db4/fef x:0 0 0 2024-09-06T14:45:07.722 INFO:tasks.workunit.client.0.smithi052.stdout:6/746: read d2/d4a/deb/d18/d25/d4c/d61/f97 [2825636,108110] 0 2024-09-06T14:45:07.724 INFO:tasks.workunit.client.0.smithi052.stdout:6/747: symlink d2/d4a/deb/d81/lf0 0 2024-09-06T14:45:07.726 INFO:tasks.workunit.client.0.smithi052.stdout:6/748: symlink d2/d4a/deb/d18/d33/lf1 0 2024-09-06T14:45:07.730 INFO:tasks.workunit.client.0.smithi052.stdout:6/749: creat d2/d4a/deb/d18/ff2 x:0 0 0 2024-09-06T14:45:07.732 INFO:tasks.workunit.client.0.smithi052.stdout:7/989: dread d11/d1c/d26/f48 [0,4194304] 0 2024-09-06T14:45:07.733 INFO:tasks.workunit.client.0.smithi052.stdout:7/990: fsync d11/d1c/d24/d4b/f63 0 2024-09-06T14:45:07.737 INFO:tasks.workunit.client.0.smithi052.stdout:6/750: creat d2/d4a/deb/d9d/db4/dc0/dd6/dee/ff3 x:0 0 0 2024-09-06T14:45:07.742 INFO:tasks.workunit.client.0.smithi052.stdout:7/991: creat d11/f12c x:0 0 0 2024-09-06T14:45:07.748 INFO:tasks.workunit.client.0.smithi052.stdout:7/992: dwrite d11/d1c/d24/d4b/f9b [0,4194304] 0 2024-09-06T14:45:07.762 INFO:tasks.workunit.client.0.smithi052.stdout:6/751: write d2/d4a/d6e/fa2 [1416,11564] 0 2024-09-06T14:45:07.762 INFO:tasks.workunit.client.0.smithi052.stdout:7/993: dwrite d11/d1c/d24/d7e/fbe [0,4194304] 0 2024-09-06T14:45:07.765 INFO:tasks.workunit.client.0.smithi052.stdout:6/752: mkdir d2/d4a/deb/d9d/df4 0 2024-09-06T14:45:07.766 INFO:tasks.workunit.client.0.smithi052.stdout:7/994: fsync d11/d1c/d57/d89/f8b 0 2024-09-06T14:45:07.774 INFO:tasks.workunit.client.0.smithi052.stdout:6/753: write d2/f30 [3119210,116853] 0 2024-09-06T14:45:07.785 INFO:tasks.workunit.client.0.smithi052.stdout:6/754: dread d2/d4a/deb/d18/d25/d4c/d61/f97 [0,4194304] 0 2024-09-06T14:45:07.785 INFO:tasks.workunit.client.0.smithi052.stdout:7/995: dread d11/d1c/d24/d3b/d50/fab [0,4194304] 0 2024-09-06T14:45:07.788 INFO:tasks.workunit.client.0.smithi052.stdout:7/996: symlink d11/d1c/d3f/d73/dae/l12d 0 2024-09-06T14:45:07.789 INFO:tasks.workunit.client.0.smithi052.stdout:7/997: chown d11/d1c/d26/l9d 22823 1 2024-09-06T14:45:07.795 INFO:tasks.workunit.client.0.smithi052.stdout:7/998: dwrite d11/d1c/d24/f38 [0,4194304] 0 2024-09-06T14:45:07.799 INFO:tasks.workunit.client.0.smithi052.stdout:7/999: rename d11/ce3 to d11/d1c/d24/d7e/c12e 0 2024-09-06T14:45:07.993 INFO:tasks.workunit.client.0.smithi052.stdout:6/755: sync 2024-09-06T14:45:07.993 INFO:tasks.workunit.client.0.smithi052.stdout:4/931: sync 2024-09-06T14:45:07.997 INFO:tasks.workunit.client.0.smithi052.stdout:6/756: link d2/d4a/deb/d18/d25/d6a/c72 d2/db6/cf5 0 2024-09-06T14:45:08.000 INFO:tasks.workunit.client.0.smithi052.stdout:4/932: write d9/d2d/d33/d5d/fd1 [511671,1079] 0 2024-09-06T14:45:08.004 INFO:tasks.workunit.client.0.smithi052.stdout:4/933: fdatasync d9/d2d/d33/d5d/da6/f75 0 2024-09-06T14:45:08.007 INFO:tasks.workunit.client.0.smithi052.stdout:6/757: dwrite d2/d4a/deb/d18/f88 [0,4194304] 0 2024-09-06T14:45:08.014 INFO:tasks.workunit.client.0.smithi052.stdout:6/758: mkdir d2/d4a/deb/d18/d25/d4c/df6 0 2024-09-06T14:45:08.014 INFO:tasks.workunit.client.0.smithi052.stdout:4/934: link d9/d10/d17/f2a d9/d72/dca/f14a 0 2024-09-06T14:45:08.018 INFO:tasks.workunit.client.0.smithi052.stdout:4/935: truncate d9/da1/fc5 945420 0 2024-09-06T14:45:08.021 INFO:tasks.workunit.client.0.smithi052.stdout:6/759: write d2/d4a/deb/d18/d2d/da7/fb1 [100648,129131] 0 2024-09-06T14:45:08.021 INFO:tasks.workunit.client.0.smithi052.stdout:4/936: mkdir d9/d10/d17/daa/db5/db9/d14b 0 2024-09-06T14:45:08.024 INFO:tasks.workunit.client.0.smithi052.stdout:6/760: creat d2/d4a/ff7 x:0 0 0 2024-09-06T14:45:08.026 INFO:tasks.workunit.client.0.smithi052.stdout:6/761: creat d2/d4a/deb/d18/d2d/d71/ff8 x:0 0 0 2024-09-06T14:45:08.030 INFO:tasks.workunit.client.0.smithi052.stdout:6/762: creat d2/d4a/deb/d9d/db4/dc0/ff9 x:0 0 0 2024-09-06T14:45:08.033 INFO:tasks.workunit.client.0.smithi052.stdout:6/763: fdatasync d2/d4a/deb/d18/d2d/d32/f9a 0 2024-09-06T14:45:08.034 INFO:tasks.workunit.client.0.smithi052.stdout:6/764: chown d2/d4a/deb/d5e/l9e 3656524 1 2024-09-06T14:45:08.035 INFO:tasks.workunit.client.0.smithi052.stdout:4/937: dwrite d9/f65 [0,4194304] 0 2024-09-06T14:45:08.038 INFO:tasks.workunit.client.0.smithi052.stdout:6/765: symlink d2/d4a/deb/d9d/lfa 0 2024-09-06T14:45:08.048 INFO:tasks.workunit.client.0.smithi052.stdout:6/766: write d2/d4a/deb/d18/d25/d4c/dbe/fcf [704551,10116] 0 2024-09-06T14:45:08.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:07 smithi052 ceph-mon[28627]: pgmap v36: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 92 MiB/s wr, 254 op/s 2024-09-06T14:45:08.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:07 smithi165 ceph-mon[36229]: pgmap v36: 65 pgs: 65 active+clean; 2.4 GiB data, 7.5 GiB used, 529 GiB / 536 GiB avail; 38 MiB/s rd, 92 MiB/s wr, 254 op/s 2024-09-06T14:45:08.436 INFO:tasks.workunit.client.0.smithi052.stdout:6/767: sync 2024-09-06T14:45:08.436 INFO:tasks.workunit.client.0.smithi052.stdout:4/938: sync 2024-09-06T14:45:08.438 INFO:tasks.workunit.client.0.smithi052.stdout:4/939: truncate d9/d10/d17/d39/f46 1627367 0 2024-09-06T14:45:08.441 INFO:tasks.workunit.client.0.smithi052.stdout:4/940: mknod d9/d2d/d33/d5d/da6/deb/d81/dc1/c14c 0 2024-09-06T14:45:08.441 INFO:tasks.workunit.client.0.smithi052.stdout:6/768: getdents d2/d4a/d6e/d76 0 2024-09-06T14:45:08.442 INFO:tasks.workunit.client.0.smithi052.stdout:4/941: readlink d9/d10/d17/d39/d3a/d64/lb7 0 2024-09-06T14:45:08.443 INFO:tasks.workunit.client.0.smithi052.stdout:6/769: mknod d2/d4a/deb/d18/d2d/d71/cfb 0 2024-09-06T14:45:08.448 INFO:tasks.workunit.client.0.smithi052.stdout:6/770: dwrite d2/d4a/d6e/fa2 [0,4194304] 0 2024-09-06T14:45:08.448 INFO:tasks.workunit.client.0.smithi052.stdout:4/942: getdents d9/d10/d19/de4 0 2024-09-06T14:45:08.450 INFO:tasks.workunit.client.0.smithi052.stdout:6/771: chown d2/d4a/deb/d7d/dad 743361977 1 2024-09-06T14:45:08.450 INFO:tasks.workunit.client.0.smithi052.stdout:4/943: write d9/d2d/d33/d5d/fd1 [659054,36612] 0 2024-09-06T14:45:08.455 INFO:tasks.workunit.client.0.smithi052.stdout:6/772: creat d2/d4a/deb/d9d/db4/ffc x:0 0 0 2024-09-06T14:45:08.456 INFO:tasks.workunit.client.0.smithi052.stdout:4/944: mkdir d9/d10/d19/ddf/d14d 0 2024-09-06T14:45:08.457 INFO:tasks.workunit.client.0.smithi052.stdout:6/773: write d2/d4a/deb/d18/f2b [2614786,3043] 0 2024-09-06T14:45:08.458 INFO:tasks.workunit.client.0.smithi052.stdout:6/774: chown d2/d4a/deb/d5e 6112599 1 2024-09-06T14:45:08.459 INFO:tasks.workunit.client.0.smithi052.stdout:4/945: mknod d9/d10/dec/c14e 0 2024-09-06T14:45:08.461 INFO:tasks.workunit.client.0.smithi052.stdout:6/775: truncate d2/d4a/deb/d18/d25/f2c 8159464 0 2024-09-06T14:45:08.462 INFO:tasks.workunit.client.0.smithi052.stdout:6/776: rmdir d2/d4a/d6e/d76 39 2024-09-06T14:45:08.464 INFO:tasks.workunit.client.0.smithi052.stdout:6/777: mknod d2/d4a/deb/d9d/db4/cfd 0 2024-09-06T14:45:08.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/778: creat d2/d4a/deb/d18/d2d/d32/ffe x:0 0 0 2024-09-06T14:45:08.469 INFO:tasks.workunit.client.0.smithi052.stdout:6/779: rmdir d2/d4a/deb/d18/d33/d44/d79 39 2024-09-06T14:45:08.470 INFO:tasks.workunit.client.0.smithi052.stdout:6/780: link d2/d4a/deb/d18/ff2 d2/d4a/fff 0 2024-09-06T14:45:08.472 INFO:tasks.workunit.client.0.smithi052.stdout:6/781: dread d2/db6/fb9 [0,4194304] 0 2024-09-06T14:45:08.527 INFO:tasks.workunit.client.0.smithi052.stdout:4/946: write d9/d10/d19/f2c [351394,62969] 0 2024-09-06T14:45:08.527 INFO:tasks.workunit.client.0.smithi052.stdout:4/947: chown d9/d10/d17 7330 1 2024-09-06T14:45:08.529 INFO:tasks.workunit.client.0.smithi052.stdout:4/948: mkdir d9/d10/d19/ddf/d128/d14f 0 2024-09-06T14:45:08.530 INFO:tasks.workunit.client.0.smithi052.stdout:6/782: write d2/d4a/deb/d18/d25/d4c/f86 [1120524,34170] 0 2024-09-06T14:45:08.532 INFO:tasks.workunit.client.0.smithi052.stdout:6/783: write d2/d4a/deb/d9d/db4/fe9 [484225,27206] 0 2024-09-06T14:45:08.534 INFO:tasks.workunit.client.0.smithi052.stdout:4/949: mkdir d9/d10/d17/daa/db5/db9/d116/d150 0 2024-09-06T14:45:08.534 INFO:tasks.workunit.client.0.smithi052.stdout:6/784: truncate d2/d4a/deb/d18/d33/f69 4983048 0 2024-09-06T14:45:08.538 INFO:tasks.workunit.client.0.smithi052.stdout:6/785: mkdir d2/d4a/deb/d18/d100 0 2024-09-06T14:45:08.539 INFO:tasks.workunit.client.0.smithi052.stdout:4/950: dread d9/d10/d19/f3c [0,4194304] 0 2024-09-06T14:45:08.539 INFO:tasks.workunit.client.0.smithi052.stdout:6/786: write d2/d4a/deb/d18/d33/f69 [1429252,22673] 0 2024-09-06T14:45:08.542 INFO:tasks.workunit.client.0.smithi052.stdout:6/787: write d2/d4a/deb/d18/d2d/d32/f55 [282849,16302] 0 2024-09-06T14:45:08.542 INFO:tasks.workunit.client.0.smithi052.stdout:6/788: chown d2/db6/fb9 182101 1 2024-09-06T14:45:08.547 INFO:tasks.workunit.client.0.smithi052.stdout:6/789: mkdir d2/d4a/deb/d18/d2d/d32/d101 0 2024-09-06T14:45:08.549 INFO:tasks.workunit.client.0.smithi052.stdout:4/951: link d9/d10/d17/d39/d3a/d125/l139 d9/d121/d12b/l151 0 2024-09-06T14:45:08.550 INFO:tasks.workunit.client.0.smithi052.stdout:6/790: mkdir d2/d4a/deb/d9d/db4/d102 0 2024-09-06T14:45:08.554 INFO:tasks.workunit.client.0.smithi052.stdout:6/791: creat d2/d4a/deb/d18/d25/d6a/f103 x:0 0 0 2024-09-06T14:45:08.560 INFO:tasks.workunit.client.0.smithi052.stdout:4/952: creat d9/d10/d17/f152 x:0 0 0 2024-09-06T14:45:08.562 INFO:tasks.workunit.client.0.smithi052.stdout:4/953: dread d9/d10/d19/f3c [0,4194304] 0 2024-09-06T14:45:08.563 INFO:tasks.workunit.client.0.smithi052.stdout:6/792: link d2/d4a/fff d2/d4a/deb/d18/d100/f104 0 2024-09-06T14:45:08.566 INFO:tasks.workunit.client.0.smithi052.stdout:4/954: rename d9/d2d/d33/d5d/da6/dbf/dd5 to d9/d10/d19/ddf/d14d/d153 0 2024-09-06T14:45:08.567 INFO:tasks.workunit.client.0.smithi052.stdout:4/955: dread - d9/da1/fdd zero size 2024-09-06T14:45:08.571 INFO:tasks.workunit.client.0.smithi052.stdout:4/956: rmdir d9/d2d/d33/d5d 39 2024-09-06T14:45:08.574 INFO:tasks.workunit.client.0.smithi052.stdout:4/957: chown d9/d2d/d33/d5d/da6/deb/d81/c10b 2750 1 2024-09-06T14:45:08.579 INFO:tasks.workunit.client.0.smithi052.stdout:4/958: symlink d9/d2d/d33/d5d/l154 0 2024-09-06T14:45:08.585 INFO:tasks.workunit.client.0.smithi052.stdout:6/793: write d2/db6/fac [4436509,113897] 0 2024-09-06T14:45:08.588 INFO:tasks.workunit.client.0.smithi052.stdout:6/794: creat d2/d4a/deb/d9d/df4/f105 x:0 0 0 2024-09-06T14:45:08.589 INFO:tasks.workunit.client.0.smithi052.stdout:6/795: chown d2/d4a/deb/d7d 4 1 2024-09-06T14:45:08.592 INFO:tasks.workunit.client.0.smithi052.stdout:6/796: mkdir d2/d4a/deb/d9d/db4/dc0/dd6/dee/d106 0 2024-09-06T14:45:08.593 INFO:tasks.workunit.client.0.smithi052.stdout:4/959: dread d9/d10/f4f [4194304,4194304] 0 2024-09-06T14:45:08.595 INFO:tasks.workunit.client.0.smithi052.stdout:6/797: mknod d2/d4a/deb/d9d/db4/dc0/dd6/dee/d106/c107 0 2024-09-06T14:45:08.598 INFO:tasks.workunit.client.0.smithi052.stdout:4/960: mknod d9/d10/d17/d39/c155 0 2024-09-06T14:45:08.605 INFO:tasks.workunit.client.0.smithi052.stdout:4/961: mkdir d9/d10/d17/d39/d3a/d11c/d156 0 2024-09-06T14:45:08.609 INFO:tasks.workunit.client.0.smithi052.stdout:4/962: unlink d9/d10/d17/d39/c140 0 2024-09-06T14:45:08.609 INFO:tasks.workunit.client.0.smithi052.stdout:4/963: chown d9/d72/l79 295512 1 2024-09-06T14:45:08.625 INFO:tasks.workunit.client.0.smithi052.stdout:6/798: dwrite d2/d4a/deb/d18/d33/d44/fbd [0,4194304] 0 2024-09-06T14:45:08.628 INFO:tasks.workunit.client.0.smithi052.stdout:6/799: write d2/d4a/deb/d9d/db4/dc0/ff9 [943631,62188] 0 2024-09-06T14:45:08.637 INFO:tasks.workunit.client.0.smithi052.stdout:6/800: dwrite d2/d4a/ff7 [0,4194304] 0 2024-09-06T14:45:08.637 INFO:tasks.workunit.client.0.smithi052.stdout:4/964: write d9/d2d/f67 [4004120,67744] 0 2024-09-06T14:45:08.644 INFO:tasks.workunit.client.0.smithi052.stdout:6/801: mkdir d2/d4a/deb/d9d/db4/d102/d108 0 2024-09-06T14:45:08.650 INFO:tasks.workunit.client.0.smithi052.stdout:4/965: link d9/d2d/c5a d9/d10/d17/daa/db5/db9/d116/d150/c157 0 2024-09-06T14:45:08.655 INFO:tasks.workunit.client.0.smithi052.stdout:4/966: truncate d9/d72/f105 236154 0 2024-09-06T14:45:08.664 INFO:tasks.workunit.client.0.smithi052.stdout:6/802: truncate d2/d4a/deb/d18/f2b 3867039 0 2024-09-06T14:45:08.670 INFO:tasks.workunit.client.0.smithi052.stdout:6/803: rename d2/d4a/deb/d18/d2d/d71/la4 to d2/d4a/deb/d18/d25/d4c/l109 0 2024-09-06T14:45:08.671 INFO:tasks.workunit.client.0.smithi052.stdout:6/804: fdatasync d2/d4a/deb/d18/d2d/d32/ffe 0 2024-09-06T14:45:08.674 INFO:tasks.workunit.client.0.smithi052.stdout:4/967: dread d9/d10/d19/ddf/d14d/d153/ffb [0,4194304] 0 2024-09-06T14:45:08.682 INFO:tasks.workunit.client.0.smithi052.stdout:6/805: write d2/d4a/deb/f2f [3050115,3523] 0 2024-09-06T14:45:08.686 INFO:tasks.workunit.client.0.smithi052.stdout:6/806: mkdir d2/d4a/deb/d10a 0 2024-09-06T14:45:08.688 INFO:tasks.workunit.client.0.smithi052.stdout:4/968: dwrite d9/d2d/d33/d5d/da6/deb/d81/fd4 [0,4194304] 0 2024-09-06T14:45:08.690 INFO:tasks.workunit.client.0.smithi052.stdout:6/807: unlink d2/d4a/deb/d18/d2d/d71/cfb 0 2024-09-06T14:45:08.690 INFO:tasks.workunit.client.0.smithi052.stdout:6/808: chown d2/d4a/fd1 14 1 2024-09-06T14:45:08.703 INFO:tasks.workunit.client.0.smithi052.stdout:6/809: getdents d2/d4a/deb/d9d/db4/dc0/dd6 0 2024-09-06T14:45:08.707 INFO:tasks.workunit.client.0.smithi052.stdout:4/969: dwrite d9/d10/d17/d39/d7b/d91/d9e/f123 [0,4194304] 0 2024-09-06T14:45:08.713 INFO:tasks.workunit.client.0.smithi052.stdout:4/970: mkdir d9/d10/d19/de4/d158 0 2024-09-06T14:45:08.716 INFO:tasks.workunit.client.0.smithi052.stdout:6/810: link d2/d4a/deb/d18/d4b/f94 d2/d4a/deb/d10a/f10b 0 2024-09-06T14:45:08.719 INFO:tasks.workunit.client.0.smithi052.stdout:4/971: mkdir d9/d159 0 2024-09-06T14:45:08.721 INFO:tasks.workunit.client.0.smithi052.stdout:4/972: fdatasync d9/d10/d17/f3d 0 2024-09-06T14:45:08.724 INFO:tasks.workunit.client.0.smithi052.stdout:4/973: dread d9/d10/f9f [0,4194304] 0 2024-09-06T14:45:08.725 INFO:tasks.workunit.client.0.smithi052.stdout:4/974: stat d9/d2d/d33/d5d/da6/c8f 0 2024-09-06T14:45:08.726 INFO:tasks.workunit.client.0.smithi052.stdout:4/975: chown d9/d10/d17/d39/d3a/d64/c103 7490 1 2024-09-06T14:45:08.736 INFO:tasks.workunit.client.0.smithi052.stdout:6/811: write d2/db6/f80 [1735037,39247] 0 2024-09-06T14:45:08.736 INFO:tasks.workunit.client.0.smithi052.stdout:4/976: link d9/d72/f105 d9/d2d/d33/d5d/da6/deb/f15a 0 2024-09-06T14:45:08.740 INFO:tasks.workunit.client.0.smithi052.stdout:6/812: mknod d2/d4a/deb/d18/d2d/d71/c10c 0 2024-09-06T14:45:08.741 INFO:tasks.workunit.client.0.smithi052.stdout:6/813: chown d2/d4a/deb/d9d/db4/d102/d108 41977 1 2024-09-06T14:45:08.754 INFO:tasks.workunit.client.0.smithi052.stdout:4/977: dwrite d9/d2d/f4a [0,4194304] 0 2024-09-06T14:45:08.756 INFO:tasks.workunit.client.0.smithi052.stdout:6/814: dwrite d2/d4a/deb/d18/d2d/d71/fab [0,4194304] 0 2024-09-06T14:45:08.760 INFO:tasks.workunit.client.0.smithi052.stdout:6/815: mkdir d2/d4a/deb/d18/d2d/da7/d10d 0 2024-09-06T14:45:08.762 INFO:tasks.workunit.client.0.smithi052.stdout:6/816: mkdir d2/d10e 0 2024-09-06T14:45:08.764 INFO:tasks.workunit.client.0.smithi052.stdout:6/817: write d2/d4a/d6e/fdd [301004,39925] 0 2024-09-06T14:45:08.768 INFO:tasks.workunit.client.0.smithi052.stdout:4/978: write d9/d2d/d33/d5d/da6/deb/d81/d9c/f111 [695807,23144] 0 2024-09-06T14:45:08.770 INFO:tasks.workunit.client.0.smithi052.stdout:4/979: dread - d9/d10/d19/f104 zero size 2024-09-06T14:45:08.794 INFO:tasks.workunit.client.0.smithi052.stdout:6/818: dread d2/fb [0,4194304] 0 2024-09-06T14:45:08.795 INFO:tasks.workunit.client.0.smithi052.stdout:6/819: rmdir d2/d4a/deb/d9d 39 2024-09-06T14:45:08.796 INFO:tasks.workunit.client.0.smithi052.stdout:6/820: fdatasync d2/d4a/deb/d18/d2d/d71/fed 0 2024-09-06T14:45:08.802 INFO:tasks.workunit.client.0.smithi052.stdout:6/821: rename d2/f3b to d2/d4a/deb/d18/d25/d4c/d61/f10f 0 2024-09-06T14:45:08.802 INFO:tasks.workunit.client.0.smithi052.stdout:4/980: dwrite d9/d2d/d33/d5d/da6/deb/f15a [0,4194304] 0 2024-09-06T14:45:08.814 INFO:tasks.workunit.client.0.smithi052.stdout:4/981: creat d9/d10/f15b x:0 0 0 2024-09-06T14:45:08.819 INFO:tasks.workunit.client.0.smithi052.stdout:4/982: unlink d9/d10/d17/d39/d7b/d91/d9e/f107 0 2024-09-06T14:45:08.823 INFO:tasks.workunit.client.0.smithi052.stdout:4/983: mknod d9/df2/c15c 0 2024-09-06T14:45:08.825 INFO:tasks.workunit.client.0.smithi052.stdout:4/984: truncate d9/d10/fe9 3534488 0 2024-09-06T14:45:08.830 INFO:tasks.workunit.client.0.smithi052.stdout:4/985: mkdir d9/d2d/d33/d5d/da6/deb/d81/d15d 0 2024-09-06T14:45:08.832 INFO:tasks.workunit.client.0.smithi052.stdout:6/822: dwrite d2/d4a/deb/d18/d33/d44/d79/f9c [0,4194304] 0 2024-09-06T14:45:08.843 INFO:tasks.workunit.client.0.smithi052.stdout:4/986: dread d9/d10/f12 [0,4194304] 0 2024-09-06T14:45:08.848 INFO:tasks.workunit.client.0.smithi052.stdout:4/987: unlink d9/d10/d17/d39/f46 0 2024-09-06T14:45:08.865 INFO:tasks.workunit.client.0.smithi052.stdout:6/823: write d2/d4a/deb/d18/d25/d4c/dbe/fe5 [200266,77274] 0 2024-09-06T14:45:08.877 INFO:tasks.workunit.client.0.smithi052.stdout:6/824: link d2/d4a/deb/d18/d33/f69 d2/d4a/d6e/f110 0 2024-09-06T14:45:08.882 INFO:tasks.workunit.client.0.smithi052.stdout:6/825: symlink d2/d4a/deb/d9d/df4/l111 0 2024-09-06T14:45:08.884 INFO:tasks.workunit.client.0.smithi052.stdout:6/826: mkdir d2/d4a/deb/d18/d2d/da7/d10d/d112 0 2024-09-06T14:45:08.889 INFO:tasks.workunit.client.0.smithi052.stdout:6/827: rename d2/d4a/c91 to d2/d4a/deb/d9d/db4/dc0/c113 0 2024-09-06T14:45:08.891 INFO:tasks.workunit.client.0.smithi052.stdout:6/828: unlink d2/d4a/deb/d18/d25/caf 0 2024-09-06T14:45:08.914 INFO:tasks.workunit.client.0.smithi052.stdout:6/829: dwrite d2/d4a/d6e/fb8 [0,4194304] 0 2024-09-06T14:45:08.918 INFO:tasks.workunit.client.0.smithi052.stdout:6/830: symlink d2/d4a/deb/d18/d2d/d32/d9f/l114 0 2024-09-06T14:45:08.923 INFO:tasks.workunit.client.0.smithi052.stdout:6/831: unlink d2/d4a/ff7 0 2024-09-06T14:45:08.926 INFO:tasks.workunit.client.0.smithi052.stdout:6/832: creat d2/d4a/deb/d18/d25/d4c/dbe/f115 x:0 0 0 2024-09-06T14:45:08.934 INFO:tasks.workunit.client.0.smithi052.stdout:6/833: dwrite d2/d4a/deb/d18/f2b [4194304,4194304] 0 2024-09-06T14:45:08.946 INFO:tasks.workunit.client.0.smithi052.stdout:6/834: rename d2/d4a/deb/d18/d25/l60 to d2/d4a/deb/d18/d33/l116 0 2024-09-06T14:45:08.950 INFO:tasks.workunit.client.0.smithi052.stdout:6/835: creat d2/d4a/deb/d81/f117 x:0 0 0 2024-09-06T14:45:08.954 INFO:tasks.workunit.client.0.smithi052.stdout:6/836: mknod d2/d10e/c118 0 2024-09-06T14:45:08.956 INFO:tasks.workunit.client.0.smithi052.stdout:6/837: symlink d2/d4a/deb/d9d/l119 0 2024-09-06T14:45:08.961 INFO:tasks.workunit.client.0.smithi052.stdout:6/838: dread d2/d4a/d6e/fdd [0,4194304] 0 2024-09-06T14:45:08.967 INFO:tasks.workunit.client.0.smithi052.stdout:6/839: creat d2/d4a/deb/d18/d2d/d32/d101/f11a x:0 0 0 2024-09-06T14:45:08.976 INFO:tasks.workunit.client.0.smithi052.stdout:6/840: creat d2/d4a/deb/d18/d33/d44/f11b x:0 0 0 2024-09-06T14:45:08.980 INFO:tasks.workunit.client.0.smithi052.stdout:6/841: fsync d2/d4a/deb/d18/d25/f2c 0 2024-09-06T14:45:09.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 -- 172.21.15.52:0/1013208362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc104d80 msgr2=0x7f97bc107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:09.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 --2- 172.21.15.52:0/1013208362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc104d80 0x7f97bc107170 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009880 tx=0x7f97b002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 -- 172.21.15.52:0/1013208362 shutdown_connections 2024-09-06T14:45:09.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 --2- 172.21.15.52:0/1013208362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc104d80 0x7f97bc107170 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 --2- 172.21.15.52:0/1013208362 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97bc102450 0x7f97bc104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 -- 172.21.15.52:0/1013208362 >> 172.21.15.52:0/1013208362 conn(0x7f97bc0fc010 msgr2=0x7f97bc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:09.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 -- 172.21.15.52:0/1013208362 shutdown_connections 2024-09-06T14:45:09.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.538+0000 7f97c13e9640 1 -- 172.21.15.52:0/1013208362 wait complete. 2024-09-06T14:45:09.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.539+0000 7f97c13e9640 1 Processor -- start 2024-09-06T14:45:09.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.539+0000 7f97c13e9640 1 -- start start 2024-09-06T14:45:09.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.539+0000 7f97c13e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc102450 0x7f97bc197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:09.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.539+0000 7f97c13e9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97bc104d80 0x7f97bc1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:09.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97c13e9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc10a720 con 0x7f97bc102450 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97c13e9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc10a5a0 con 0x7f97bc104d80 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc102450 0x7f97bc197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc102450 0x7f97bc197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36150/0 (socket says 172.21.15.52:36150) 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97baffd640 1 -- 172.21.15.52:0/3190370497 learned_addr learned my addr 172.21.15.52:0/3190370497 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97ba7fc640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97bc104d80 0x7f97bc1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97baffd640 1 -- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97bc104d80 msgr2=0x7f97bc1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97baffd640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97bc104d80 0x7f97bc1979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97baffd640 1 -- 172.21.15.52:0/3190370497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc198040 con 0x7f97bc102450 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.540+0000 7f97baffd640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc102450 0x7f97bc197480 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00e970 tx=0x7f97ac00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.541+0000 7f97a3fff640 1 -- 172.21.15.52:0/3190370497 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97ac00cac0 con 0x7f97bc102450 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.541+0000 7f97a3fff640 1 -- 172.21.15.52:0/3190370497 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97ac00cc60 con 0x7f97bc102450 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.541+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97bc19ca80 con 0x7f97bc102450 2024-09-06T14:45:09.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.541+0000 7f97a3fff640 1 -- 172.21.15.52:0/3190370497 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97ac018720 con 0x7f97bc102450 2024-09-06T14:45:09.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.541+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97bc19cfe0 con 0x7f97bc102450 2024-09-06T14:45:09.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.542+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97bc10af00 con 0x7f97bc102450 2024-09-06T14:45:09.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.543+0000 7f97a3fff640 1 -- 172.21.15.52:0/3190370497 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7f97ac010430 con 0x7f97bc102450 2024-09-06T14:45:09.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.543+0000 7f97a3fff640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f97a4072950 0x7f97a4074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:09.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.544+0000 7f97a3fff640 1 -- 172.21.15.52:0/3190370497 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f97ac093d50 con 0x7f97bc102450 2024-09-06T14:45:09.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.544+0000 7f97ba7fc640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f97a4072950 0x7f97a4074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:09.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.544+0000 7f97ba7fc640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f97a4072950 0x7f97a4074e10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009230 tx=0x7f97b00058d0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:09.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.550+0000 7f97a3fff640 1 -- 172.21.15.52:0/3190370497 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f97ac097030 con 0x7f97bc102450 2024-09-06T14:45:09.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.757+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f97bc105760 con 0x7f97a4072950 2024-09-06T14:45:09.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.758+0000 7f97a3fff640 1 -- 172.21.15.52:0/3190370497 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f97bc105760 con 0x7f97a4072950 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f97a4072950 msgr2=0x7f97a4074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f97a4072950 0x7f97a4074e10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009230 tx=0x7f97b00058d0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc102450 msgr2=0x7f97bc197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc102450 0x7f97bc197480 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00e970 tx=0x7f97ac00ee30 comp rx=0 tx=0).stop 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 shutdown_connections 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f97a4072950 0x7f97a4074e10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f97bc104d80 0x7f97bc1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 --2- 172.21.15.52:0/3190370497 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97bc102450 0x7f97bc197480 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.760+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 >> 172.21.15.52:0/3190370497 conn(0x7f97bc0fc010 msgr2=0x7f97bc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:09.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.761+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 shutdown_connections 2024-09-06T14:45:09.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.761+0000 7f97c13e9640 1 -- 172.21.15.52:0/3190370497 wait complete. 2024-09-06T14:45:09.767 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:45:09.818 INFO:tasks.workunit.client.0.smithi052.stdout:6/842: sync 2024-09-06T14:45:09.818 INFO:tasks.workunit.client.0.smithi052.stdout:4/988: sync 2024-09-06T14:45:09.820 INFO:tasks.workunit.client.0.smithi052.stdout:6/843: write d2/d4a/deb/d9d/db4/dc0/dd6/dee/ff3 [647182,89152] 0 2024-09-06T14:45:09.820 INFO:tasks.workunit.client.0.smithi052.stdout:4/989: rmdir d9/d2d/d33/d5d/da6 39 2024-09-06T14:45:09.830 INFO:tasks.workunit.client.0.smithi052.stdout:6/844: rename d2/d4a/deb/d18/d25/f87 to d2/d4a/deb/d18/d33/d44/f11c 0 2024-09-06T14:45:09.831 INFO:tasks.workunit.client.0.smithi052.stdout:6/845: chown d2/d4a/deb/d18/d33/f69 144888848 1 2024-09-06T14:45:09.832 INFO:tasks.workunit.client.0.smithi052.stdout:4/990: rmdir d9/d2d/d33/d5d/da6/deb/d81/d15d 0 2024-09-06T14:45:09.833 INFO:tasks.workunit.client.0.smithi052.stdout:4/991: chown d9/d10/d19 1309684 1 2024-09-06T14:45:09.840 INFO:tasks.workunit.client.0.smithi052.stdout:6/846: dwrite d2/d4a/deb/d18/f6d [0,4194304] 0 2024-09-06T14:45:09.843 INFO:tasks.workunit.client.0.smithi052.stdout:6/847: creat d2/d4a/deb/d18/d33/d44/d79/f11d x:0 0 0 2024-09-06T14:45:09.844 INFO:tasks.workunit.client.0.smithi052.stdout:4/992: getdents d9/da1 0 2024-09-06T14:45:09.845 INFO:tasks.workunit.client.0.smithi052.stdout:4/993: readlink d9/d2d/d33/d5d/da6/deb/lc7 0 2024-09-06T14:45:09.849 INFO:tasks.workunit.client.0.smithi052.stdout:4/994: creat d9/d10/d17/daa/db5/db9/d116/f15e x:0 0 0 2024-09-06T14:45:09.851 INFO:tasks.workunit.client.0.smithi052.stdout:6/848: creat d2/d4a/d6e/d76/f11e x:0 0 0 2024-09-06T14:45:09.854 INFO:tasks.workunit.client.0.smithi052.stdout:4/995: rename d9/d2d/d33/c7c to d9/d2d/d33/d5d/da6/deb/d81/dc1/c15f 0 2024-09-06T14:45:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.858+0000 7ff61a3c9640 1 -- 172.21.15.52:0/2045339027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 msgr2=0x7ff614100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.858+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/2045339027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff614100c60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009c20 tx=0x7ff60c02a970 comp rx=0 tx=0).stop 2024-09-06T14:45:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.859+0000 7ff61a3c9640 1 -- 172.21.15.52:0/2045339027 shutdown_connections 2024-09-06T14:45:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.859+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/2045339027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff614101a60 0x7ff614101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.859+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/2045339027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff614100c60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.859+0000 7ff61a3c9640 1 -- 172.21.15.52:0/2045339027 >> 172.21.15.52:0/2045339027 conn(0x7ff6140fc010 msgr2=0x7ff6140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.859+0000 7ff61a3c9640 1 -- 172.21.15.52:0/2045339027 shutdown_connections 2024-09-06T14:45:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.859+0000 7ff61a3c9640 1 -- 172.21.15.52:0/2045339027 wait complete. 2024-09-06T14:45:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.859+0000 7ff61a3c9640 1 Processor -- start 2024-09-06T14:45:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff61a3c9640 1 -- start start 2024-09-06T14:45:09.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff61a3c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff6141974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:09.858 INFO:tasks.workunit.client.0.smithi052.stdout:4/996: dread d9/da1/fc5 [0,4194304] 0 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff613fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff6141974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff613fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff6141974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36178/0 (socket says 172.21.15.52:36178) 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff61a3c9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff614101a60 0x7ff614197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff613fff640 1 -- 172.21.15.52:0/488756122 learned_addr learned my addr 172.21.15.52:0/488756122 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff61410a780 con 0x7ff614100860 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff61410a600 con 0x7ff614101a60 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.860+0000 7ff6137fe640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff614101a60 0x7ff614197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff613fff640 1 -- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff614101a60 msgr2=0x7ff614197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:09.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff613fff640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff614101a60 0x7ff614197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff613fff640 1 -- 172.21.15.52:0/488756122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff614198080 con 0x7ff614100860 2024-09-06T14:45:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff613fff640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff6141974c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006010 tx=0x7ff60c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff6117fa640 1 -- 172.21.15.52:0/488756122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff60c047070 con 0x7ff614100860 2024-09-06T14:45:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61419ca60 con 0x7ff614100860 2024-09-06T14:45:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff6117fa640 1 -- 172.21.15.52:0/488756122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff60c003e30 con 0x7ff614100860 2024-09-06T14:45:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff6117fa640 1 -- 172.21.15.52:0/488756122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff60c034070 con 0x7ff614100860 2024-09-06T14:45:09.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.861+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61419d070 con 0x7ff614100860 2024-09-06T14:45:09.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.863+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff614100c60 con 0x7ff614100860 2024-09-06T14:45:09.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.864+0000 7ff6117fa640 1 -- 172.21.15.52:0/488756122 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7ff60c04a070 con 0x7ff614100860 2024-09-06T14:45:09.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.864+0000 7ff6117fa640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7ff6000729a0 0x7ff600074e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:09.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.864+0000 7ff6117fa640 1 -- 172.21.15.52:0/488756122 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7ff60c0b44d0 con 0x7ff614100860 2024-09-06T14:45:09.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.864+0000 7ff6137fe640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7ff6000729a0 0x7ff600074e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:09.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.865+0000 7ff6137fe640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7ff6000729a0 0x7ff600074e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0095f0 tx=0x7ff5fc005f90 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:09.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:09.869+0000 7ff6117fa640 1 -- 172.21.15.52:0/488756122 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7ff60c03f070 con 0x7ff614100860 2024-09-06T14:45:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.098+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff614062630 con 0x7ff6000729a0 2024-09-06T14:45:10.096 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:09 smithi052 ceph-mon[28627]: pgmap v37: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 128 MiB/s wr, 385 op/s 2024-09-06T14:45:10.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.099+0000 7ff6117fa640 1 -- 172.21.15.52:0/488756122 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff614062630 con 0x7ff6000729a0 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.101+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7ff6000729a0 msgr2=0x7ff600074e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.101+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7ff6000729a0 0x7ff600074e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0095f0 tx=0x7ff5fc005f90 comp rx=0 tx=0).stop 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.101+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 msgr2=0x7ff6141974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.101+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff6141974c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff60c006010 tx=0x7ff60c02f5d0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.102+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 shutdown_connections 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.102+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7ff6000729a0 0x7ff600074e60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.102+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff614101a60 0x7ff614197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.102+0000 7ff61a3c9640 1 --2- 172.21.15.52:0/488756122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff614100860 0x7ff6141974c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.102+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 >> 172.21.15.52:0/488756122 conn(0x7ff6140fc010 msgr2=0x7ff614104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:10.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.102+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 shutdown_connections 2024-09-06T14:45:10.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.102+0000 7ff61a3c9640 1 -- 172.21.15.52:0/488756122 wait complete. 2024-09-06T14:45:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 -- 172.21.15.52:0/4108172806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 msgr2=0x7fc2a0101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/4108172806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a0101ee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc294009880 tx=0x7fc29402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 -- 172.21.15.52:0/4108172806 shutdown_connections 2024-09-06T14:45:10.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/4108172806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a0101ee0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/4108172806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2a0100860 0x7fc2a0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 -- 172.21.15.52:0/4108172806 >> 172.21.15.52:0/4108172806 conn(0x7fc2a00fc010 msgr2=0x7fc2a00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 -- 172.21.15.52:0/4108172806 shutdown_connections 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 -- 172.21.15.52:0/4108172806 wait complete. 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.186+0000 7fc2a5db2640 1 Processor -- start 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc2a5db2640 1 -- start start 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc2a5db2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2a0100860 0x7fc2a006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc2a5db2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc2a5db2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0109680 con 0x7fc2a0101a60 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc2a5db2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0109500 con 0x7fc2a0100860 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36190/0 (socket says 172.21.15.52:36190) 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29effd640 1 -- 172.21.15.52:0/904662879 learned_addr learned my addr 172.21.15.52:0/904662879 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29f7fe640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2a0100860 0x7fc2a006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29effd640 1 -- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2a0100860 msgr2=0x7fc2a006a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29effd640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2a0100860 0x7fc2a006a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29effd640 1 -- 172.21.15.52:0/904662879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a019c750 con 0x7fc2a0101a60 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.187+0000 7fc29f7fe640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2a0100860 0x7fc2a006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.188+0000 7fc29effd640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a019c1e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc294006010 tx=0x7fc2940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.188+0000 7fc29cff9640 1 -- 172.21.15.52:0/904662879 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc29403f070 con 0x7fc2a0101a60 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.188+0000 7fc29cff9640 1 -- 172.21.15.52:0/904662879 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2940044d0 con 0x7fc2a0101a60 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.188+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a019c9e0 con 0x7fc2a0101a60 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.188+0000 7fc29cff9640 1 -- 172.21.15.52:0/904662879 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc294035030 con 0x7fc2a0101a60 2024-09-06T14:45:10.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.188+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a019cf10 con 0x7fc2a0101a60 2024-09-06T14:45:10.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.189+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a0100c60 con 0x7fc2a0101a60 2024-09-06T14:45:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.189+0000 7fc29cff9640 1 -- 172.21.15.52:0/904662879 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7fc294042070 con 0x7fc2a0101a60 2024-09-06T14:45:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.190+0000 7fc29cff9640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fc288072900 0x7fc288074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.190+0000 7fc29cff9640 1 -- 172.21.15.52:0/904662879 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fc2940b45e0 con 0x7fc2a0101a60 2024-09-06T14:45:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.190+0000 7fc29f7fe640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fc288072900 0x7fc288074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.191+0000 7fc29f7fe640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fc288072900 0x7fc288074dc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc2a01018c0 tx=0x7fc29000a5e0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:10.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.194+0000 7fc29cff9640 1 -- 172.21.15.52:0/904662879 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fc29407d7e0 con 0x7fc2a0101a60 2024-09-06T14:45:10.304 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:09 smithi165 ceph-mon[36229]: pgmap v37: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 58 MiB/s rd, 128 MiB/s wr, 385 op/s 2024-09-06T14:45:10.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.365+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc2a0062630 con 0x7fc288072900 2024-09-06T14:45:10.369 INFO:tasks.workunit.client.0.smithi052.stdout:6/849: sync 2024-09-06T14:45:10.370 INFO:tasks.workunit.client.0.smithi052.stdout:4/997: sync 2024-09-06T14:45:10.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.374+0000 7fc29cff9640 1 -- 172.21.15.52:0/904662879 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc2a0062630 con 0x7fc288072900 2024-09-06T14:45:10.371 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (6m) 55s ago 8m 24.3M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 starting - - - - 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (7m) 62s ago 7m 5268k - 19.1.1-268-g635ed4cf b6db46a449e5 92f6280b935c 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (8m) 55s ago 8m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (7m) 62s ago 7m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (6m) 55s ago 8m 79.7M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (3m) 55s ago 3m 172M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (3m) 55s ago 3m 158M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (3m) 62s ago 3m 22.6M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (3m) 62s ago 3m 20.1M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:45:10.372 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:9283,8765,8443 running (9m) 55s ago 9m 276M - 19.1.1-268-g635ed4cf b6db46a449e5 39e44f4c0904 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (77s) 62s ago 7m 494M - 19.3.0-4704-g8b38c33c 1c45aca0610a 53aea8d00134 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (9m) 55s ago 9m 53.6M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (7m) 62s ago 7m 42.4M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (8m) 55s ago 8m 17.0M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (7m) 62s ago 7m 14.9M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (6m) 55s ago 6m 80.6M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (6m) 55s ago 6m 96.5M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (5m) 55s ago 5m 83.4M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:45:10.373 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (5m) 62s ago 5m 95.4M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:45:10.374 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (4m) 62s ago 4m 88.5M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:45:10.374 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (4m) 62s ago 4m 78.6M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:45:10.374 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (6m) 55s ago 8m 61.4M - 2.43.0 a07b618ecd1d 1b767954d6f6 2024-09-06T14:45:10.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fc288072900 msgr2=0x7fc288074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fc288072900 0x7fc288074dc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc2a01018c0 tx=0x7fc29000a5e0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 msgr2=0x7fc2a019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a019c1e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc294006010 tx=0x7fc2940048f0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 shutdown_connections 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fc288072900 0x7fc288074dc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc2a0101a60 0x7fc2a019c1e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 --2- 172.21.15.52:0/904662879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2a0100860 0x7fc2a006a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.376+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 >> 172.21.15.52:0/904662879 conn(0x7fc2a00fc010 msgr2=0x7fc2a0104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.377+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 shutdown_connections 2024-09-06T14:45:10.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.377+0000 7fc2a5db2640 1 -- 172.21.15.52:0/904662879 wait complete. 2024-09-06T14:45:10.376 INFO:tasks.workunit.client.0.smithi052.stdout:4/998: creat d9/d2d/d33/d5d/f160 x:0 0 0 2024-09-06T14:45:10.377 INFO:tasks.workunit.client.0.smithi052.stdout:6/850: truncate d2/f30 6597043 0 2024-09-06T14:45:10.382 INFO:tasks.workunit.client.0.smithi052.stdout:4/999: dwrite d9/d2d/d33/d5d/da6/deb/d81/fd4 [4194304,4194304] 0 2024-09-06T14:45:10.384 INFO:tasks.workunit.client.0.smithi052.stdout:6/851: unlink d2/d4a/deb/d18/d4b/fa6 0 2024-09-06T14:45:10.399 INFO:tasks.workunit.client.0.smithi052.stdout:6/852: write d2/d4a/deb/d18/d100/f104 [10697,4901] 0 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 -- 172.21.15.52:0/1252487535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 msgr2=0x7fd2241047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/1252487535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd2241047e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd2200098b0 tx=0x7fd22002a4d0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 -- 172.21.15.52:0/1252487535 shutdown_connections 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/1252487535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd224104d20 0x7fd224107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/1252487535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd2241047e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 -- 172.21.15.52:0/1252487535 >> 172.21.15.52:0/1252487535 conn(0x7fd2240fc010 msgr2=0x7fd2240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 -- 172.21.15.52:0/1252487535 shutdown_connections 2024-09-06T14:45:10.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.470+0000 7fd22b4ff640 1 -- 172.21.15.52:0/1252487535 wait complete. 2024-09-06T14:45:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22b4ff640 1 Processor -- start 2024-09-06T14:45:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22b4ff640 1 -- start start 2024-09-06T14:45:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22b4ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd224199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22b4ff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd224104d20 0x7fd224199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22b4ff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd22410a7e0 con 0x7fd2241023f0 2024-09-06T14:45:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22b4ff640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd22410a660 con 0x7fd224104d20 2024-09-06T14:45:10.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22929b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd224199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22929b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd224199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39758/0 (socket says 172.21.15.52:39758) 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.471+0000 7fd22929b640 1 -- 172.21.15.52:0/4021989351 learned_addr learned my addr 172.21.15.52:0/4021989351 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd228a9a640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd224104d20 0x7fd224199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd22929b640 1 -- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd224104d20 msgr2=0x7fd224199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd22929b640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd224104d20 0x7fd224199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd22929b640 1 -- 172.21.15.52:0/4021989351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22419a300 con 0x7fd2241023f0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd22929b640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd224199740 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd2200099d0 tx=0x7fd2200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd21a7fc640 1 -- 172.21.15.52:0/4021989351 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd22003f070 con 0x7fd2241023f0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd21a7fc640 1 -- 172.21.15.52:0/4021989351 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd220004a40 con 0x7fd2241023f0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22419ece0 con 0x7fd2241023f0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd21a7fc640 1 -- 172.21.15.52:0/4021989351 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd220035030 con 0x7fd2241023f0 2024-09-06T14:45:10.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.472+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22419f1c0 con 0x7fd2241023f0 2024-09-06T14:45:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.473+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2241027d0 con 0x7fd2241023f0 2024-09-06T14:45:10.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.474+0000 7fd21a7fc640 1 -- 172.21.15.52:0/4021989351 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7fd220042070 con 0x7fd2241023f0 2024-09-06T14:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.475+0000 7fd21a7fc640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fd210072900 0x7fd210074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.475+0000 7fd21a7fc640 1 -- 172.21.15.52:0/4021989351 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fd2200b4410 con 0x7fd2241023f0 2024-09-06T14:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.475+0000 7fd228a9a640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fd210072900 0x7fd210074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.476+0000 7fd228a9a640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fd210072900 0x7fd210074dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd22419abf0 tx=0x7fd21400b390 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:10.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.479+0000 7fd21a7fc640 1 -- 172.21.15.52:0/4021989351 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fd220081780 con 0x7fd2241023f0 2024-09-06T14:45:10.604 INFO:tasks.workunit.client.0.smithi052.stdout:6/853: sync 2024-09-06T14:45:10.608 INFO:tasks.workunit.client.0.smithi052.stdout:6/854: getdents d2/d4a/deb/d18/d25/d6a 0 2024-09-06T14:45:10.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/855: link d2/d4a/fff d2/d4a/deb/d18/d25/d4c/d61/f11f 0 2024-09-06T14:45:10.626 INFO:tasks.workunit.client.0.smithi052.stdout:6/856: dread d2/d4a/deb/d18/d25/d4c/f86 [0,4194304] 0 2024-09-06T14:45:10.632 INFO:tasks.workunit.client.0.smithi052.stdout:6/857: dwrite d2/d4a/deb/d9d/db4/fe9 [0,4194304] 0 2024-09-06T14:45:10.635 INFO:tasks.workunit.client.0.smithi052.stdout:6/858: creat d2/d4a/deb/d9d/db4/dc0/dd6/dee/f120 x:0 0 0 2024-09-06T14:45:10.639 INFO:tasks.workunit.client.0.smithi052.stdout:6/859: creat d2/d4a/deb/d18/d25/d4c/f121 x:0 0 0 2024-09-06T14:45:10.642 INFO:tasks.workunit.client.0.smithi052.stdout:6/860: creat d2/d4a/deb/d18/d25/d4c/d61/f122 x:0 0 0 2024-09-06T14:45:10.646 INFO:tasks.workunit.client.0.smithi052.stdout:6/861: unlink d2/l6 0 2024-09-06T14:45:10.652 INFO:tasks.workunit.client.0.smithi052.stdout:6/862: dwrite d2/d4a/d6e/fb8 [0,4194304] 0 2024-09-06T14:45:10.653 INFO:tasks.workunit.client.0.smithi052.stdout:6/863: readlink d2/d4a/deb/d9d/lfa 0 2024-09-06T14:45:10.665 INFO:tasks.workunit.client.0.smithi052.stdout:6/864: write d2/d4a/deb/d18/d2d/d32/f3f [5110353,1631] 0 2024-09-06T14:45:10.670 INFO:tasks.workunit.client.0.smithi052.stdout:6/865: creat d2/d4a/deb/d18/d2d/f123 x:0 0 0 2024-09-06T14:45:10.672 INFO:tasks.workunit.client.0.smithi052.stdout:6/866: mkdir d2/d4a/deb/d18/d25/d124 0 2024-09-06T14:45:10.674 INFO:tasks.workunit.client.0.smithi052.stdout:6/867: chown d2/d4a/deb/d18/d25/d4c/dbe/le4 190635 1 2024-09-06T14:45:10.676 INFO:tasks.workunit.client.0.smithi052.stdout:6/868: creat d2/d4a/deb/d10a/f125 x:0 0 0 2024-09-06T14:45:10.680 INFO:tasks.workunit.client.0.smithi052.stdout:6/869: rename d2/d4a/deb/d18/d25/d4c/d61/f10f to d2/d4a/deb/d5e/f126 0 2024-09-06T14:45:10.682 INFO:tasks.workunit.client.0.smithi052.stdout:6/870: mknod d2/d4a/deb/d18/d25/d4c/c127 0 2024-09-06T14:45:10.684 INFO:tasks.workunit.client.0.smithi052.stdout:6/871: unlink d2/d4a/deb/d18/d33/d44/c56 0 2024-09-06T14:45:10.691 INFO:tasks.workunit.client.0.smithi052.stdout:6/872: dwrite d2/d4a/deb/f2f [4194304,4194304] 0 2024-09-06T14:45:10.698 INFO:tasks.workunit.client.0.smithi052.stdout:6/873: dwrite d2/d4a/deb/d18/f22 [0,4194304] 0 2024-09-06T14:45:10.702 INFO:tasks.workunit.client.0.smithi052.stdout:6/874: creat d2/d4a/deb/d18/d2d/d32/f128 x:0 0 0 2024-09-06T14:45:10.703 INFO:tasks.workunit.client.0.smithi052.stdout:6/875: read - d2/d4a/deb/d18/d33/d44/d79/fd0 zero size 2024-09-06T14:45:10.704 INFO:tasks.workunit.client.0.smithi052.stdout:6/876: chown d2/f3d 23577 1 2024-09-06T14:45:10.705 INFO:tasks.workunit.client.0.smithi052.stdout:6/877: stat d2/d4a/deb/d9d/db4/dc0/ff9 0 2024-09-06T14:45:10.708 INFO:tasks.workunit.client.0.smithi052.stdout:6/878: symlink d2/d4a/deb/d9d/db4/dc0/dd6/l129 0 2024-09-06T14:45:10.709 INFO:tasks.workunit.client.0.smithi052.stdout:6/879: read d2/d4a/deb/d18/d25/f2c [3946721,70792] 0 2024-09-06T14:45:10.712 INFO:tasks.workunit.client.0.smithi052.stdout:6/880: mkdir d2/d4a/deb/d18/d2d/d32/d12a 0 2024-09-06T14:45:10.713 INFO:tasks.workunit.client.0.smithi052.stdout:6/881: stat d2/d4a/deb/d9d/db4/dc0/dd6/dee/d106 0 2024-09-06T14:45:10.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.752+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd22402d7c0 con 0x7fd2241023f0 2024-09-06T14:45:10.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.753+0000 7fd21a7fc640 1 -- 172.21.15.52:0/4021989351 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fd2200861a0 con 0x7fd2241023f0 2024-09-06T14:45:10.750 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:45:10.750 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:45:10.750 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:45:10.750 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:10.750 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 1, 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 13, 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:45:10.751 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:45:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.755+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fd210072900 msgr2=0x7fd210074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.755+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fd210072900 0x7fd210074dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd22419abf0 tx=0x7fd21400b390 comp rx=0 tx=0).stop 2024-09-06T14:45:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 msgr2=0x7fd224199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd224199740 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd2200099d0 tx=0x7fd2200046c0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 shutdown_connections 2024-09-06T14:45:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7fd210072900 0x7fd210074dc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd224104d20 0x7fd224199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 --2- 172.21.15.52:0/4021989351 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2241023f0 0x7fd224199740 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 >> 172.21.15.52:0/4021989351 conn(0x7fd2240fc010 msgr2=0x7fd224101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 shutdown_connections 2024-09-06T14:45:10.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.756+0000 7fd22b4ff640 1 -- 172.21.15.52:0/4021989351 wait complete. 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 -- 172.21.15.52:0/4230152139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0102450 msgr2=0x7f8ce0104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/4230152139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0102450 0x7f8ce0104840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009880 tx=0x7f8cd402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 -- 172.21.15.52:0/4230152139 shutdown_connections 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/4230152139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce0104d80 0x7f8ce0107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/4230152139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0102450 0x7f8ce0104840 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 -- 172.21.15.52:0/4230152139 >> 172.21.15.52:0/4230152139 conn(0x7f8ce00fc010 msgr2=0x7f8ce00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 -- 172.21.15.52:0/4230152139 shutdown_connections 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 -- 172.21.15.52:0/4230152139 wait complete. 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.845+0000 7f8ce6f68640 1 Processor -- start 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8ce6f68640 1 -- start start 2024-09-06T14:45:10.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8ce6f68640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce0102450 0x7f8ce0197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8ce6f68640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0104d80 0x7f8ce0197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8ce6f68640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce010a750 con 0x7f8ce0104d80 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8ce6f68640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce010a5d0 con 0x7f8ce0102450 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8cdffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0104d80 0x7f8ce0197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8cdffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0104d80 0x7f8ce0197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39768/0 (socket says 172.21.15.52:39768) 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8cdffff640 1 -- 172.21.15.52:0/1837902665 learned_addr learned my addr 172.21.15.52:0/1837902665 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8ce4d04640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce0102450 0x7f8ce0197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8cdffff640 1 -- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce0102450 msgr2=0x7f8ce0197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8cdffff640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce0102450 0x7f8ce0197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8cdffff640 1 -- 172.21.15.52:0/1837902665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce0198010 con 0x7f8ce0104d80 2024-09-06T14:45:10.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.846+0000 7f8cdffff640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0104d80 0x7f8ce0197990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00e940 tx=0x7f8ccc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.847+0000 7f8cddffb640 1 -- 172.21.15.52:0/1837902665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc00cac0 con 0x7f8ce0104d80 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.847+0000 7f8cddffb640 1 -- 172.21.15.52:0/1837902665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ccc0054e0 con 0x7f8ce0104d80 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.847+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce019ca50 con 0x7f8ce0104d80 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.847+0000 7f8cddffb640 1 -- 172.21.15.52:0/1837902665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ccc004e40 con 0x7f8ce0104d80 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.847+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce019cfe0 con 0x7f8ce0104d80 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.848+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce0102830 con 0x7f8ce0104d80 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.849+0000 7f8cddffb640 1 -- 172.21.15.52:0/1837902665 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 25) ==== 96028+0+0 (secure 0 0 0) 0x7f8ccc004fe0 con 0x7f8ce0104d80 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.849+0000 7f8cddffb640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f8cd0072900 0x7f8cd0074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:10.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.849+0000 7f8cddffb640 1 -- 172.21.15.52:0/1837902665 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f8ccc093e70 con 0x7f8ce0104d80 2024-09-06T14:45:10.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.849+0000 7f8ce4d04640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f8cd0072900 0x7f8cd0074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:10.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.850+0000 7f8ce4d04640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f8cd0072900 0x7f8cd0074dc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4000c00 tx=0x7f8cd40058d0 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:10.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:10.854+0000 7f8cddffb640 1 -- 172.21.15.52:0/1837902665 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f8ccc05d070 con 0x7f8ce0104d80 2024-09-06T14:45:10.979 INFO:tasks.workunit.client.0.smithi052.stdout:6/882: sync 2024-09-06T14:45:10.982 INFO:tasks.workunit.client.0.smithi052.stdout:6/883: rmdir d2/d4a/deb/d18/d2d/d32/d101 39 2024-09-06T14:45:10.994 INFO:tasks.workunit.client.0.smithi052.stdout:6/884: write d2/f3d [51438,101185] 0 2024-09-06T14:45:10.995 INFO:tasks.workunit.client.0.smithi052.stdout:6/885: chown d2/d4a/fd1 43904 1 2024-09-06T14:45:11.004 INFO:tasks.workunit.client.0.smithi052.stdout:6/886: link d2/d4a/deb/d18/d33/l93 d2/d4a/deb/d18/d2d/d32/d12a/l12b 0 2024-09-06T14:45:11.006 INFO:tasks.workunit.client.0.smithi052.stdout:6/887: write d2/d4a/deb/d18/d33/fa5 [1150804,37255] 0 2024-09-06T14:45:11.008 INFO:tasks.workunit.client.0.smithi052.stdout:6/888: write d2/d4a/deb/d18/d2d/d32/f3f [4663251,116578] 0 2024-09-06T14:45:11.016 INFO:tasks.workunit.client.0.smithi052.stdout:6/889: creat d2/d4a/deb/d9d/db4/dc0/f12c x:0 0 0 2024-09-06T14:45:11.016 INFO:tasks.workunit.client.0.smithi052.stdout:6/890: chown d2/caa 1033570061 1 2024-09-06T14:45:11.017 INFO:tasks.workunit.client.0.smithi052.stdout:6/891: fsync d2/d4a/d6e/fa2 0 2024-09-06T14:45:11.021 INFO:tasks.workunit.client.0.smithi052.stdout:6/892: symlink d2/d4a/deb/d18/d2d/d32/d9f/l12d 0 2024-09-06T14:45:11.022 INFO:tasks.workunit.client.0.smithi052.stdout:6/893: stat d2/d4a/deb/d9d/db4/fef 0 2024-09-06T14:45:11.029 INFO:tasks.workunit.client.0.smithi052.stdout:6/894: dwrite d2/d4a/deb/d18/d2d/d71/fab [0,4194304] 0 2024-09-06T14:45:11.051 INFO:tasks.workunit.client.0.smithi052.stdout:6/895: dwrite d2/d4a/deb/d18/d25/d4c/d61/f8d [4194304,4194304] 0 2024-09-06T14:45:11.053 INFO:tasks.workunit.client.0.smithi052.stdout:6/896: fdatasync d2/d4a/deb/d9d/db4/dc0/fe8 0 2024-09-06T14:45:11.059 INFO:tasks.workunit.client.0.smithi052.stdout:6/897: rename d2/d4a/d6e/ce3 to d2/d4a/deb/d18/d2d/d32/d101/c12e 0 2024-09-06T14:45:11.064 INFO:tasks.workunit.client.0.smithi052.stdout:6/898: symlink d2/d4a/deb/d18/d25/d6a/l12f 0 2024-09-06T14:45:11.071 INFO:tasks.workunit.client.0.smithi052.stdout:6/899: mknod d2/d4a/deb/d18/d25/c130 0 2024-09-06T14:45:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:10 smithi052 ceph-mon[28627]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:10 smithi052 ceph-mon[28627]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:10 smithi052 ceph-mon[28627]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:10 smithi052 ceph-mon[28627]: pgmap v38: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 42 MiB/s rd, 88 MiB/s wr, 265 op/s 2024-09-06T14:45:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:10 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/4021989351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:45:11.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.143+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8ce0105640 con 0x7f8cd0072900 2024-09-06T14:45:11.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.144+0000 7f8cddffb640 1 -- 172.21.15.52:0/1837902665 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f8ce0105640 con 0x7f8cd0072900 2024-09-06T14:45:11.141 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [], 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "1/2 daemons upgraded", 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:45:11.142 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:45:11.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f8cd0072900 msgr2=0x7f8cd0074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:11.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f8cd0072900 0x7f8cd0074dc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4000c00 tx=0x7f8cd40058d0 comp rx=0 tx=0).stop 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0104d80 msgr2=0x7f8ce0197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0104d80 0x7f8ce0197990 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00e940 tx=0x7f8ccc00ee00 comp rx=0 tx=0).stop 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 shutdown_connections 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f8cd0072900 0x7f8cd0074dc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ce0104d80 0x7f8ce0197990 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 --2- 172.21.15.52:0/1837902665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ce0102450 0x7f8ce0197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 >> 172.21.15.52:0/1837902665 conn(0x7f8ce00fc010 msgr2=0x7f8ce00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 shutdown_connections 2024-09-06T14:45:11.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:11.146+0000 7f8ce6f68640 1 -- 172.21.15.52:0/1837902665 wait complete. 2024-09-06T14:45:11.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:10 smithi165 ceph-mon[36229]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:11.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:10 smithi165 ceph-mon[36229]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:11.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:10 smithi165 ceph-mon[36229]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:11.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:10 smithi165 ceph-mon[36229]: pgmap v38: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 42 MiB/s rd, 88 MiB/s wr, 265 op/s 2024-09-06T14:45:11.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:10 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/4021989351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:45:11.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/900: sync 2024-09-06T14:45:11.615 INFO:tasks.workunit.client.0.smithi052.stdout:6/901: readlink d2/d4a/deb/d18/d33/d44/d79/lc3 0 2024-09-06T14:45:11.617 INFO:tasks.workunit.client.0.smithi052.stdout:6/902: mkdir d2/d4a/deb/d18/d25/d6a/dcc/d131 0 2024-09-06T14:45:11.619 INFO:tasks.workunit.client.0.smithi052.stdout:6/903: truncate d2/d4a/deb/d9d/db4/dc0/dd6/dee/ff3 1282559 0 2024-09-06T14:45:11.620 INFO:tasks.workunit.client.0.smithi052.stdout:6/904: readlink d2/d4a/deb/d18/d2d/d32/d9f/l12d 0 2024-09-06T14:45:11.625 INFO:tasks.workunit.client.0.smithi052.stdout:6/905: dwrite d2/d4a/deb/d9d/db4/dc0/ff9 [0,4194304] 0 2024-09-06T14:45:11.627 INFO:tasks.workunit.client.0.smithi052.stdout:6/906: dread - d2/d4a/deb/d18/d33/d44/d79/f11d zero size 2024-09-06T14:45:11.627 INFO:tasks.workunit.client.0.smithi052.stdout:6/907: chown d2/d4a/deb/d5e/ld2 289752949 1 2024-09-06T14:45:11.640 INFO:tasks.workunit.client.0.smithi052.stdout:6/908: dread d2/d4a/deb/d18/d4b/f94 [0,4194304] 0 2024-09-06T14:45:11.677 INFO:tasks.workunit.client.0.smithi052.stdout:6/909: truncate d2/d4a/d6e/fb8 2722681 0 2024-09-06T14:45:11.679 INFO:tasks.workunit.client.0.smithi052.stdout:6/910: fsync d2/d4a/deb/d81/f85 0 2024-09-06T14:45:11.680 INFO:tasks.workunit.client.0.smithi052.stdout:6/911: stat d2/d4a/deb/d81/ld7 0 2024-09-06T14:45:12.009 INFO:tasks.workunit.client.0.smithi052.stdout:6/912: sync 2024-09-06T14:45:12.014 INFO:tasks.workunit.client.0.smithi052.stdout:6/913: mkdir d2/d132 0 2024-09-06T14:45:12.019 INFO:tasks.workunit.client.0.smithi052.stdout:6/914: creat d2/d4a/deb/d18/d100/f133 x:0 0 0 2024-09-06T14:45:12.024 INFO:tasks.workunit.client.0.smithi052.stdout:6/915: getdents d2/d4a/deb/d18/d25/d124 0 2024-09-06T14:45:12.048 INFO:tasks.workunit.client.0.smithi052.stdout:6/916: dwrite d2/d4a/deb/d18/d100/f104 [0,4194304] 0 2024-09-06T14:45:12.056 INFO:tasks.workunit.client.0.smithi052.stdout:6/917: creat d2/d4a/deb/d10a/f134 x:0 0 0 2024-09-06T14:45:12.077 INFO:tasks.workunit.client.0.smithi052.stdout:6/918: dread d2/f3d [0,4194304] 0 2024-09-06T14:45:12.084 INFO:tasks.workunit.client.0.smithi052.stdout:6/919: dwrite d2/d4a/deb/d18/d25/f3e [0,4194304] 0 2024-09-06T14:45:12.095 INFO:tasks.workunit.client.0.smithi052.stdout:6/920: dwrite d2/d4a/d6e/fb8 [0,4194304] 0 2024-09-06T14:45:12.111 INFO:tasks.workunit.client.0.smithi052.stdout:6/921: dwrite d2/d4a/deb/d81/f85 [0,4194304] 0 2024-09-06T14:45:12.114 INFO:tasks.workunit.client.0.smithi052.stdout:6/922: unlink d2/d4a/deb/d18/d2d/da7/le2 0 2024-09-06T14:45:12.122 INFO:tasks.workunit.client.0.smithi052.stdout:6/923: rename d2/d4a/deb/d18/d2d/da7 to d2/d4a/deb/d18/d25/d124/d135 0 2024-09-06T14:45:12.125 INFO:tasks.workunit.client.0.smithi052.stdout:6/924: creat d2/d4a/deb/d10a/f136 x:0 0 0 2024-09-06T14:45:12.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:11 smithi165 ceph-mon[36229]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:12.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:11 smithi052 ceph-mon[28627]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:12.543 INFO:tasks.workunit.client.0.smithi052.stdout:6/925: sync 2024-09-06T14:45:12.554 INFO:tasks.workunit.client.0.smithi052.stdout:6/926: dwrite d2/d4a/deb/d18/d33/d44/d79/fa0 [0,4194304] 0 2024-09-06T14:45:12.555 INFO:tasks.workunit.client.0.smithi052.stdout:6/927: readlink d2/d4a/deb/d18/lae 0 2024-09-06T14:45:12.561 INFO:tasks.workunit.client.0.smithi052.stdout:6/928: dwrite d2/d4a/deb/d18/d33/d44/d79/fa0 [4194304,4194304] 0 2024-09-06T14:45:12.561 INFO:tasks.workunit.client.0.smithi052.stdout:6/929: stat d2/l4e 0 2024-09-06T14:45:12.563 INFO:tasks.workunit.client.0.smithi052.stdout:6/930: fsync d2/d4a/deb/d18/d25/d4c/d61/f8d 0 2024-09-06T14:45:12.565 INFO:tasks.workunit.client.0.smithi052.stdout:6/931: truncate d2/d4a/deb/d18/d25/d6a/f103 223348 0 2024-09-06T14:45:12.567 INFO:tasks.workunit.client.0.smithi052.stdout:6/932: write d2/d4a/deb/d18/d25/d4c/d61/f8d [162211,1101] 0 2024-09-06T14:45:12.572 INFO:tasks.workunit.client.0.smithi052.stdout:6/933: mknod d2/d4a/deb/d18/d25/d4c/dbe/c137 0 2024-09-06T14:45:12.574 INFO:tasks.workunit.client.0.smithi052.stdout:6/934: rmdir d2/d4a/deb/d18/d25/d124/d135/d10d 39 2024-09-06T14:45:12.579 INFO:tasks.workunit.client.0.smithi052.stdout:6/935: creat d2/d4a/deb/d18/d25/d124/d135/d10d/d112/f138 x:0 0 0 2024-09-06T14:45:12.582 INFO:tasks.workunit.client.0.smithi052.stdout:6/936: creat d2/f139 x:0 0 0 2024-09-06T14:45:12.592 INFO:tasks.workunit.client.0.smithi052.stdout:6/937: dwrite d2/d4a/d6e/f110 [0,4194304] 0 2024-09-06T14:45:12.595 INFO:tasks.workunit.client.0.smithi052.stdout:6/938: creat d2/d4a/deb/d18/d2d/d32/d9f/f13a x:0 0 0 2024-09-06T14:45:12.597 INFO:tasks.workunit.client.0.smithi052.stdout:6/939: truncate d2/d4a/deb/d10a/f125 194089 0 2024-09-06T14:45:12.607 INFO:tasks.workunit.client.0.smithi052.stdout:6/940: dread d2/d4a/deb/d18/d25/d4c/f74 [0,4194304] 0 2024-09-06T14:45:12.610 INFO:tasks.workunit.client.0.smithi052.stdout:6/941: rename d2/d4a/deb/d9d to d2/d4a/deb/d10a/d13b 0 2024-09-06T14:45:12.614 INFO:tasks.workunit.client.0.smithi052.stdout:6/942: rename d2/d4a/deb/d10a/d13b/db4/fef to d2/d4a/deb/d18/d2d/d32/d9f/f13c 0 2024-09-06T14:45:12.616 INFO:tasks.workunit.client.0.smithi052.stdout:6/943: dread d2/d4a/d6e/fdd [0,4194304] 0 2024-09-06T14:45:12.617 INFO:tasks.workunit.client.0.smithi052.stdout:6/944: dread - d2/d4a/deb/d18/d25/d4c/dbe/f115 zero size 2024-09-06T14:45:12.619 INFO:tasks.workunit.client.0.smithi052.stdout:6/945: creat d2/d4a/deb/d18/d25/d4c/d61/f13d x:0 0 0 2024-09-06T14:45:12.621 INFO:tasks.workunit.client.0.smithi052.stdout:6/946: truncate d2/d4a/deb/d18/d25/f2c 5201026 0 2024-09-06T14:45:12.642 INFO:tasks.workunit.client.0.smithi052.stdout:6/947: dwrite d2/d4a/deb/d18/d25/d124/d135/fb7 [0,4194304] 0 2024-09-06T14:45:12.643 INFO:tasks.workunit.client.0.smithi052.stdout:6/948: chown d2/d4a/deb/d18/f22 97195 1 2024-09-06T14:45:12.645 INFO:tasks.workunit.client.0.smithi052.stdout:6/949: creat d2/d4a/f13e x:0 0 0 2024-09-06T14:45:12.656 INFO:tasks.workunit.client.0.smithi052.stdout:6/950: dwrite d2/d4a/deb/d18/d2d/d71/fd8 [0,4194304] 0 2024-09-06T14:45:12.658 INFO:tasks.workunit.client.0.smithi052.stdout:6/951: truncate d2/d4a/deb/d18/f88 4604689 0 2024-09-06T14:45:12.665 INFO:tasks.workunit.client.0.smithi052.stdout:6/952: dwrite d2/d4a/deb/d18/d25/d4c/dbe/f115 [0,4194304] 0 2024-09-06T14:45:12.668 INFO:tasks.workunit.client.0.smithi052.stdout:6/953: truncate d2/d4a/deb/d18/d25/d4c/d61/f13d 25107 0 2024-09-06T14:45:12.670 INFO:tasks.workunit.client.0.smithi052.stdout:6/954: mknod d2/db6/c13f 0 2024-09-06T14:45:12.671 INFO:tasks.workunit.client.0.smithi052.stdout:6/955: stat d2/d4a/fd1 0 2024-09-06T14:45:12.677 INFO:tasks.workunit.client.0.smithi052.stdout:6/956: rename d2/d4a/deb/d18/d33/d44/d79/c8a to d2/d4a/deb/d18/d2d/d32/d101/c140 0 2024-09-06T14:45:12.679 INFO:tasks.workunit.client.0.smithi052.stdout:6/957: rmdir d2/d4a/deb/d18/d2d/d32/d12a 39 2024-09-06T14:45:12.681 INFO:tasks.workunit.client.0.smithi052.stdout:6/958: read d2/d4a/deb/d18/d25/f2c [1548953,128900] 0 2024-09-06T14:45:12.682 INFO:tasks.workunit.client.0.smithi052.stdout:6/959: chown d2/d4a/deb/d18/c99 1878111 1 2024-09-06T14:45:12.683 INFO:tasks.workunit.client.0.smithi052.stdout:6/960: dread - d2/d4a/d6e/d76/f11e zero size 2024-09-06T14:45:12.685 INFO:tasks.workunit.client.0.smithi052.stdout:6/961: mkdir d2/d4a/deb/d10a/d13b/db4/dc0/dd6/d141 0 2024-09-06T14:45:12.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/962: mkdir d2/d4a/deb/d18/d25/d4c/d61/d142 0 2024-09-06T14:45:12.687 INFO:tasks.workunit.client.0.smithi052.stdout:6/963: stat d2/d4a/deb/d10a/d13b/db4/dc0/cc2 0 2024-09-06T14:45:12.690 INFO:tasks.workunit.client.0.smithi052.stdout:6/964: chown d2/d4a/deb/d18/d25/d4c/dbe/cdb 5181130 1 2024-09-06T14:45:12.692 INFO:tasks.workunit.client.0.smithi052.stdout:6/965: chown d2/d4a/deb/d18/d33/f4d 38 1 2024-09-06T14:45:12.697 INFO:tasks.workunit.client.0.smithi052.stdout:6/966: rmdir d2/d4a/deb/d10a/d13b/db4/dc0/dd6/d141 0 2024-09-06T14:45:12.709 INFO:tasks.workunit.client.0.smithi052.stdout:6/967: dwrite d2/d4a/deb/d18/d2d/d32/f40 [0,4194304] 0 2024-09-06T14:45:12.711 INFO:tasks.workunit.client.0.smithi052.stdout:6/968: rename d2/d4a/deb/d7d/fa8 to d2/d132/f143 0 2024-09-06T14:45:12.713 INFO:tasks.workunit.client.0.smithi052.stdout:6/969: mknod d2/d4a/deb/d18/d25/d6a/dcc/c144 0 2024-09-06T14:45:12.717 INFO:tasks.workunit.client.0.smithi052.stdout:6/970: rename d2/d4a/deb/d7d/dad to d2/d4a/deb/d18/d33/d44/d79/d145 0 2024-09-06T14:45:12.719 INFO:tasks.workunit.client.0.smithi052.stdout:6/971: mknod d2/d4a/deb/d18/d25/d4c/dbe/c146 0 2024-09-06T14:45:12.720 INFO:tasks.workunit.client.0.smithi052.stdout:6/972: write d2/d4a/f13e [282084,39452] 0 2024-09-06T14:45:12.721 INFO:tasks.workunit.client.0.smithi052.stdout:6/973: stat d2/d4a/deb/d10a/d13b/db4/cfd 0 2024-09-06T14:45:12.726 INFO:tasks.workunit.client.0.smithi052.stdout:6/974: rename d2/d4a/deb/d10a/d13b/df4/f105 to d2/d4a/d6e/d76/dd4/f147 0 2024-09-06T14:45:12.732 INFO:tasks.workunit.client.0.smithi052.stdout:6/975: rename d2/d4a/deb/d10a/d13b/db4/dc0/cc2 to d2/d4a/deb/d18/d2d/c148 0 2024-09-06T14:45:12.735 INFO:tasks.workunit.client.0.smithi052.stdout:6/976: creat d2/d4a/deb/d10a/d13b/df4/f149 x:0 0 0 2024-09-06T14:45:12.738 INFO:tasks.workunit.client.0.smithi052.stdout:6/977: unlink d2/d4a/deb/d18/d25/d4c/c127 0 2024-09-06T14:45:12.968 INFO:tasks.workunit.client.0.smithi052.stdout:6/978: sync 2024-09-06T14:45:12.972 INFO:tasks.workunit.client.0.smithi052.stdout:6/979: write d2/d4a/deb/d18/d25/d4c/dbe/fcf [1302771,52220] 0 2024-09-06T14:45:12.980 INFO:tasks.workunit.client.0.smithi052.stdout:6/980: dwrite d2/d4a/deb/d18/d33/d44/d79/fa0 [4194304,4194304] 0 2024-09-06T14:45:12.984 INFO:tasks.workunit.client.0.smithi052.stdout:6/981: creat d2/d4a/deb/d18/d25/d124/d135/d10d/d112/f14a x:0 0 0 2024-09-06T14:45:12.986 INFO:tasks.workunit.client.0.smithi052.stdout:6/982: fsync d2/d4a/deb/d18/d25/d124/d135/d10d/d112/f138 0 2024-09-06T14:45:12.991 INFO:tasks.workunit.client.0.smithi052.stdout:6/983: creat d2/d4a/deb/d10a/d13b/db4/d102/f14b x:0 0 0 2024-09-06T14:45:12.994 INFO:tasks.workunit.client.0.smithi052.stdout:6/984: truncate d2/d4a/deb/d18/d2d/d71/ff8 842272 0 2024-09-06T14:45:12.997 INFO:tasks.workunit.client.0.smithi052.stdout:6/985: creat d2/d4a/deb/d10a/d13b/db4/f14c x:0 0 0 2024-09-06T14:45:13.001 INFO:tasks.workunit.client.0.smithi052.stdout:6/986: mknod d2/d4a/deb/d18/d2d/d32/d12a/c14d 0 2024-09-06T14:45:13.001 INFO:tasks.workunit.client.0.smithi052.stdout:6/987: chown d2 27324 1 2024-09-06T14:45:13.002 INFO:tasks.workunit.client.0.smithi052.stdout:6/988: truncate d2/f139 877027 0 2024-09-06T14:45:13.003 INFO:tasks.workunit.client.0.smithi052.stdout:6/989: chown d2/d4a/deb/d18/d25/d6a/l12f 176157 1 2024-09-06T14:45:13.005 INFO:tasks.workunit.client.0.smithi052.stdout:6/990: fsync d2/d4a/deb/d18/d2d/d71/fed 0 2024-09-06T14:45:13.007 INFO:tasks.workunit.client.0.smithi052.stdout:6/991: stat d2/d4a/deb/d18/l42 0 2024-09-06T14:45:13.018 INFO:tasks.workunit.client.0.smithi052.stdout:6/992: link d2/d4a/deb/d18/d33/d44/d79/lc3 d2/d4a/deb/d18/d100/l14e 0 2024-09-06T14:45:13.022 INFO:tasks.workunit.client.0.smithi052.stdout:6/993: readlink d2/d4a/deb/d5e/l75 0 2024-09-06T14:45:13.023 INFO:tasks.workunit.client.0.smithi052.stdout:6/994: read - d2/d4a/deb/d18/d25/d124/d135/d10d/d112/f138 zero size 2024-09-06T14:45:13.025 INFO:tasks.workunit.client.0.smithi052.stdout:6/995: truncate d2/d4a/d6e/d76/f11e 613789 0 2024-09-06T14:45:13.026 INFO:tasks.workunit.client.0.smithi052.stdout:6/996: chown d2/d4a/fd1 1473 1 2024-09-06T14:45:13.051 INFO:tasks.workunit.client.0.smithi052.stdout:6/997: dwrite d2/d4a/deb/d18/d33/f50 [0,4194304] 0 2024-09-06T14:45:13.053 INFO:tasks.workunit.client.0.smithi052.stdout:6/998: write d2/d4a/deb/d18/d25/f3e [35139,93530] 0 2024-09-06T14:45:13.054 INFO:tasks.workunit.client.0.smithi052.stdout:6/999: chown d2/d4a/deb/f2f 6209 1 2024-09-06T14:45:13.059 INFO:tasks.workunit.client.0.smithi052.stderr:+ rm -rf -- ./tmp.NdAH0p6z0x 2024-09-06T14:45:13.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:12 smithi052 ceph-mon[28627]: pgmap v39: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 103 MiB/s wr, 333 op/s 2024-09-06T14:45:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:12 smithi165 ceph-mon[36229]: pgmap v39: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 46 MiB/s rd, 103 MiB/s wr, 333 op/s 2024-09-06T14:45:15.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:15 smithi165 ceph-mon[36229]: pgmap v40: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 51 MiB/s wr, 198 op/s 2024-09-06T14:45:15.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:15.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:15.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:15 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:45:15.958 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:15 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:45:15.959 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:15 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:45:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:15 smithi052 ceph-mon[28627]: pgmap v40: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 51 MiB/s wr, 198 op/s 2024-09-06T14:45:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:15 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:45:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:15 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-06T14:45:16.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:15 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:45:16.773 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:16 smithi165 ceph-mon[36229]: Reconfiguring ceph-exporter.smithi165 (dependencies changed)... 2024-09-06T14:45:16.773 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:16 smithi165 ceph-mon[36229]: Deploying daemon ceph-exporter.smithi165 on smithi165 2024-09-06T14:45:17.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:16 smithi052 ceph-mon[28627]: Reconfiguring ceph-exporter.smithi165 (dependencies changed)... 2024-09-06T14:45:17.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:16 smithi052 ceph-mon[28627]: Deploying daemon ceph-exporter.smithi165 on smithi165 2024-09-06T14:45:17.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:17 smithi165 ceph-mon[36229]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 51 MiB/s wr, 198 op/s 2024-09-06T14:45:17.955 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:17 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:18.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:17 smithi052 ceph-mon[28627]: pgmap v41: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 51 MiB/s wr, 198 op/s 2024-09-06T14:45:18.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:17 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:20.058 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:19 smithi052 ceph-mon[28627]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 55 MiB/s wr, 247 op/s 2024-09-06T14:45:20.058 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:19 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:20.058 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:19 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:20.058 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:19 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:45:20.059 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:19 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:20.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:19 smithi165 ceph-mon[36229]: pgmap v42: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 25 MiB/s rd, 55 MiB/s wr, 247 op/s 2024-09-06T14:45:20.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:19 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:20.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:19 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:20.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:19 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:45:20.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:19 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:20.950 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:20 smithi052 ceph-mon[28627]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:45:20.950 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:20 smithi052 ceph-mon[28627]: Upgrade: Need to upgrade myself (mgr.smithi165.hcexoi) 2024-09-06T14:45:20.950 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:20 smithi052 ceph-mon[28627]: Upgrade: Need to upgrade myself (mgr.smithi165.hcexoi) 2024-09-06T14:45:21.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:20 smithi165 ceph-mon[36229]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:45:21.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:20 smithi165 ceph-mon[36229]: Upgrade: Need to upgrade myself (mgr.smithi165.hcexoi) 2024-09-06T14:45:21.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:20 smithi165 ceph-mon[36229]: Upgrade: Need to upgrade myself (mgr.smithi165.hcexoi) 2024-09-06T14:45:21.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:21 smithi052 ceph-mon[28627]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 5.1 MiB/s rd, 19 MiB/s wr, 117 op/s 2024-09-06T14:45:21.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:21 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:21.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:21 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.vsthpq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:45:21.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:21 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.vsthpq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:45:21.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:21 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:45:21.727 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:21 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:45:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:21 smithi165 ceph-mon[36229]: pgmap v43: 65 pgs: 65 active+clean; 2.0 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 5.1 MiB/s rd, 19 MiB/s wr, 117 op/s 2024-09-06T14:45:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:21 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:21 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.vsthpq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:45:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:21 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi052.vsthpq", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:45:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:21 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:45:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:21 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:45:22.859 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:22 smithi052 ceph-mon[28627]: Upgrade: Updating mgr.smithi052.vsthpq 2024-09-06T14:45:22.859 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:22 smithi052 ceph-mon[28627]: Deploying daemon mgr.smithi052.vsthpq on smithi052 2024-09-06T14:45:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:22 smithi165 ceph-mon[36229]: Upgrade: Updating mgr.smithi052.vsthpq 2024-09-06T14:45:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:22 smithi165 ceph-mon[36229]: Deploying daemon mgr.smithi052.vsthpq on smithi052 2024-09-06T14:45:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:23 smithi052 ceph-mon[28627]: pgmap v44: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 6.0 MiB/s rd, 20 MiB/s wr, 176 op/s 2024-09-06T14:45:23.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:23 smithi165 ceph-mon[36229]: pgmap v44: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 6.0 MiB/s rd, 20 MiB/s wr, 176 op/s 2024-09-06T14:45:25.910 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:25 smithi165 ceph-mon[36229]: pgmap v45: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 109 op/s 2024-09-06T14:45:25.910 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:25 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:25.910 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:25 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:25.910 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:25 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:26.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:25 smithi052 ceph-mon[28627]: pgmap v45: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 109 op/s 2024-09-06T14:45:26.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:25 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:26.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:25 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:26.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:25 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:27 smithi165 ceph-mon[36229]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 109 op/s 2024-09-06T14:45:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:27 smithi052 ceph-mon[28627]: pgmap v46: 65 pgs: 65 active+clean; 1.5 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 109 op/s 2024-09-06T14:45:29.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:29.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:29 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:29.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:29 smithi052 ceph-mon[28627]: pgmap v47: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 157 op/s 2024-09-06T14:45:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:29 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:29 smithi165 ceph-mon[36229]: pgmap v47: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 157 op/s 2024-09-06T14:45:32.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:31 smithi165 ceph-mon[36229]: pgmap v48: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-06T14:45:32.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:31 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:32.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:31 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:32.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:31 smithi052 ceph-mon[28627]: pgmap v48: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-06T14:45:32.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:31 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:32.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:31 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:33.015 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: Standby manager daemon smithi052.vsthpq restarted 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: Standby manager daemon smithi052.vsthpq started 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/crt"}]: dispatch 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/key"}]: dispatch 2024-09-06T14:45:33.016 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:32 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: Standby manager daemon smithi052.vsthpq restarted 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: Standby manager daemon smithi052.vsthpq started 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/crt"}]: dispatch 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi052.vsthpq/key"}]: dispatch 2024-09-06T14:45:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:32 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:45:33.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:33 smithi052 ceph-mon[28627]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:45:33.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:33 smithi052 ceph-mon[28627]: pgmap v49: 65 pgs: 65 active+clean; 823 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 166 op/s 2024-09-06T14:45:33.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:33 smithi052 ceph-mon[28627]: mgrmap e26: smithi165.hcexoi(active, since 92s), standbys: smithi052.vsthpq 2024-09-06T14:45:34.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:33 smithi165 ceph-mon[36229]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:45:34.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:33 smithi165 ceph-mon[36229]: pgmap v49: 65 pgs: 65 active+clean; 823 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 166 op/s 2024-09-06T14:45:34.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:33 smithi165 ceph-mon[36229]: mgrmap e26: smithi165.hcexoi(active, since 92s), standbys: smithi052.vsthpq 2024-09-06T14:45:35.072 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-06T14:45:35.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-06T14:45:36.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:35 smithi165 ceph-mon[36229]: pgmap v50: 65 pgs: 65 active+clean; 823 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-06T14:45:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:35 smithi052 ceph-mon[28627]: pgmap v50: 65 pgs: 65 active+clean; 823 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-06T14:45:38.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:37 smithi165 ceph-mon[36229]: pgmap v51: 65 pgs: 65 active+clean; 823 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-06T14:45:38.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:37 smithi052 ceph-mon[28627]: pgmap v51: 65 pgs: 65 active+clean; 823 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-06T14:45:40.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:39 smithi165 ceph-mon[36229]: pgmap v52: 65 pgs: 65 active+clean; 430 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 156 op/s 2024-09-06T14:45:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:39 smithi052 ceph-mon[28627]: pgmap v52: 65 pgs: 65 active+clean; 430 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 156 op/s 2024-09-06T14:45:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 -- 172.21.15.52:0/2718016217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 msgr2=0x7f732c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 --2- 172.21.15.52:0/2718016217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c101ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f731c009880 tx=0x7f731c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 -- 172.21.15.52:0/2718016217 shutdown_connections 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 --2- 172.21.15.52:0/2718016217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c101ee0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 --2- 172.21.15.52:0/2718016217 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f732c100860 0x7f732c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 -- 172.21.15.52:0/2718016217 >> 172.21.15.52:0/2718016217 conn(0x7f732c0fc010 msgr2=0x7f732c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 -- 172.21.15.52:0/2718016217 shutdown_connections 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.236+0000 7f73335cf640 1 -- 172.21.15.52:0/2718016217 wait complete. 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f73335cf640 1 Processor -- start 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f73335cf640 1 -- start start 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f73335cf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f732c100860 0x7f732c195280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f73335cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c1957c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f73335cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f732c108590 con 0x7f732c101a60 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f73335cf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f732c108410 con 0x7f732c100860 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f7330b6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c1957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f7330b6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c1957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60336/0 (socket says 172.21.15.52:60336) 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f7330b6a640 1 -- 172.21.15.52:0/3961876877 learned_addr learned my addr 172.21.15.52:0/3961876877 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f733136b640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f732c100860 0x7f732c195280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f7330b6a640 1 -- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f732c100860 msgr2=0x7f732c195280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.237+0000 7f7330b6a640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f732c100860 0x7f732c195280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.238+0000 7f7330b6a640 1 -- 172.21.15.52:0/3961876877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c195e40 con 0x7f732c101a60 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.238+0000 7f7330b6a640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c1957c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f731c006010 tx=0x7f731c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.238+0000 7f73227fc640 1 -- 172.21.15.52:0/3961876877 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f731c03f070 con 0x7f732c101a60 2024-09-06T14:45:41.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.238+0000 7f73227fc640 1 -- 172.21.15.52:0/3961876877 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f731c004ac0 con 0x7f732c101a60 2024-09-06T14:45:41.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.238+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c19a820 con 0x7f732c101a60 2024-09-06T14:45:41.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.238+0000 7f73227fc640 1 -- 172.21.15.52:0/3961876877 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f731c035030 con 0x7f732c101a60 2024-09-06T14:45:41.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.238+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c19adb0 con 0x7f732c101a60 2024-09-06T14:45:41.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.239+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732c100c60 con 0x7f732c101a60 2024-09-06T14:45:41.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.240+0000 7f73227fc640 1 -- 172.21.15.52:0/3961876877 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 26) ==== 99909+0+0 (secure 0 0 0) 0x7f731c042070 con 0x7f732c101a60 2024-09-06T14:45:41.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.240+0000 7f73227fc640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7318079650 0x7f731807bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.240+0000 7f73227fc640 1 -- 172.21.15.52:0/3961876877 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f731c0ba0f0 con 0x7f732c101a60 2024-09-06T14:45:41.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.240+0000 7f733136b640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7318079650 0x7f731807bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.241+0000 7f733136b640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7318079650 0x7f731807bb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7328005fd0 tx=0x7f732800b390 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:41.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.244+0000 7f73227fc640 1 -- 172.21.15.52:0/3961876877 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f731c087460 con 0x7f732c101a60 2024-09-06T14:45:41.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.487+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f732c106040 con 0x7f7318079650 2024-09-06T14:45:41.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.488+0000 7f73227fc640 1 -- 172.21.15.52:0/3961876877 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f732c106040 con 0x7f7318079650 2024-09-06T14:45:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7318079650 msgr2=0x7f731807bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7318079650 0x7f731807bb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7328005fd0 tx=0x7f732800b390 comp rx=0 tx=0).stop 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 msgr2=0x7f732c1957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c1957c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f731c006010 tx=0x7f731c0046c0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 shutdown_connections 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7318079650 0x7f731807bb10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f732c101a60 0x7f732c1957c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 --2- 172.21.15.52:0/3961876877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f732c100860 0x7f732c195280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 >> 172.21.15.52:0/3961876877 conn(0x7f732c0fc010 msgr2=0x7f732c0fe220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 shutdown_connections 2024-09-06T14:45:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.490+0000 7f73335cf640 1 -- 172.21.15.52:0/3961876877 wait complete. 2024-09-06T14:45:41.497 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:45:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 -- 172.21.15.52:0/3646366683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac100880 msgr2=0x7f7dac100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 --2- 172.21.15.52:0/3646366683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac100880 0x7f7dac100c80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7da8009880 tx=0x7f7da802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 -- 172.21.15.52:0/3646366683 shutdown_connections 2024-09-06T14:45:41.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 --2- 172.21.15.52:0/3646366683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7dac101a80 0x7f7dac101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 --2- 172.21.15.52:0/3646366683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac100880 0x7f7dac100c80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 -- 172.21.15.52:0/3646366683 >> 172.21.15.52:0/3646366683 conn(0x7f7dac0fc010 msgr2=0x7f7dac0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 -- 172.21.15.52:0/3646366683 shutdown_connections 2024-09-06T14:45:41.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 -- 172.21.15.52:0/3646366683 wait complete. 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.587+0000 7f7db3846640 1 Processor -- start 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db3846640 1 -- start start 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db3846640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7dac100880 0x7f7dac1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db3846640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac101a80 0x7f7dac197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db3846640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac10a7c0 con 0x7f7dac101a80 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db3846640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac10a640 con 0x7f7dac100880 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db0de1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac101a80 0x7f7dac197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db0de1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac101a80 0x7f7dac197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60342/0 (socket says 172.21.15.52:60342) 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db0de1640 1 -- 172.21.15.52:0/1703805727 learned_addr learned my addr 172.21.15.52:0/1703805727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db15e2640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7dac100880 0x7f7dac1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db15e2640 1 -- 172.21.15.52:0/1703805727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac101a80 msgr2=0x7f7dac197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db15e2640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac101a80 0x7f7dac197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db15e2640 1 -- 172.21.15.52:0/1703805727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac1980b0 con 0x7f7dac100880 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.588+0000 7f7db0de1640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac101a80 0x7f7dac197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.589+0000 7f7db15e2640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7dac100880 0x7f7dac1974f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7da8006010 tx=0x7f7da80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.589+0000 7f7da27fc640 1 -- 172.21.15.52:0/1703805727 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7da803f070 con 0x7f7dac100880 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.589+0000 7f7da27fc640 1 -- 172.21.15.52:0/1703805727 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7da80049d0 con 0x7f7dac100880 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.589+0000 7f7da27fc640 1 -- 172.21.15.52:0/1703805727 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7da8035030 con 0x7f7dac100880 2024-09-06T14:45:41.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.589+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac19ca90 con 0x7f7dac100880 2024-09-06T14:45:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.589+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac19d020 con 0x7f7dac100880 2024-09-06T14:45:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.591+0000 7f7da27fc640 1 -- 172.21.15.52:0/1703805727 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 26) ==== 99909+0+0 (secure 0 0 0) 0x7f7da8042070 con 0x7f7dac100880 2024-09-06T14:45:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.591+0000 7f7da27fc640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7d980774b0 0x7f7d98079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.591+0000 7f7da27fc640 1 -- 172.21.15.52:0/1703805727 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f7da80b9f60 con 0x7f7dac100880 2024-09-06T14:45:41.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.592+0000 7f7db0de1640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7d980774b0 0x7f7d98079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.592+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac10afa0 con 0x7f7dac100880 2024-09-06T14:45:41.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.592+0000 7f7db0de1640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7d980774b0 0x7f7d98079970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7dac1989a0 tx=0x7f7d9c005f90 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:41.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.597+0000 7f7da27fc640 1 -- 172.21.15.52:0/1703805727 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f7da8087230 con 0x7f7dac100880 2024-09-06T14:45:41.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:41 smithi052 ceph-mon[28627]: pgmap v53: 65 pgs: 65 active+clean; 430 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 108 op/s 2024-09-06T14:45:41.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.894+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7dac02db00 con 0x7f7d980774b0 2024-09-06T14:45:41.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.896+0000 7f7da27fc640 1 -- 172.21.15.52:0/1703805727 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f7dac02db00 con 0x7f7d980774b0 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7d980774b0 msgr2=0x7f7d98079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7d980774b0 0x7f7d98079970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7dac1989a0 tx=0x7f7d9c005f90 comp rx=0 tx=0).stop 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7dac100880 msgr2=0x7f7dac1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7dac100880 0x7f7dac1974f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7da8006010 tx=0x7f7da80045e0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 shutdown_connections 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f7d980774b0 0x7f7d98079970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7dac101a80 0x7f7dac197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 --2- 172.21.15.52:0/1703805727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7dac100880 0x7f7dac1974f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.898+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 >> 172.21.15.52:0/1703805727 conn(0x7f7dac0fc010 msgr2=0x7f7dac104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:41.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.899+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 shutdown_connections 2024-09-06T14:45:41.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.899+0000 7f7db3846640 1 -- 172.21.15.52:0/1703805727 wait complete. 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 -- 172.21.15.52:0/2999068531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 msgr2=0x7f5e94100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 --2- 172.21.15.52:0/2999068531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94100f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009880 tx=0x7f5e8802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 -- 172.21.15.52:0/2999068531 shutdown_connections 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 --2- 172.21.15.52:0/2999068531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94100f80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 --2- 172.21.15.52:0/2999068531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e941001e0 0x7f5e941005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 -- 172.21.15.52:0/2999068531 >> 172.21.15.52:0/2999068531 conn(0x7f5e940fc010 msgr2=0x7f5e940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 -- 172.21.15.52:0/2999068531 shutdown_connections 2024-09-06T14:45:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.989+0000 7f5e99d37640 1 -- 172.21.15.52:0/2999068531 wait complete. 2024-09-06T14:45:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.990+0000 7f5e99d37640 1 Processor -- start 2024-09-06T14:45:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.990+0000 7f5e99d37640 1 -- start start 2024-09-06T14:45:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.990+0000 7f5e99d37640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e941001e0 0x7f5e94199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.990+0000 7f5e99d37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.990+0000 7f5e99d37640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9410c990 con 0x7f5e94100b20 2024-09-06T14:45:41.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.990+0000 7f5e99d37640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9410c810 con 0x7f5e941001e0 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e92ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e92ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60350/0 (socket says 172.21.15.52:60350) 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e92ffd640 1 -- 172.21.15.52:0/3353413487 learned_addr learned my addr 172.21.15.52:0/3353413487 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e937fe640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e941001e0 0x7f5e94199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e92ffd640 1 -- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e941001e0 msgr2=0x7f5e94199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e92ffd640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e941001e0 0x7f5e94199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e92ffd640 1 -- 172.21.15.52:0/3353413487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9419a250 con 0x7f5e94100b20 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e937fe640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e941001e0 0x7f5e94199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e92ffd640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94199bd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e88006010 tx=0x7f5e88004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e90ff9640 1 -- 172.21.15.52:0/3353413487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e8803f070 con 0x7f5e94100b20 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e90ff9640 1 -- 172.21.15.52:0/3353413487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e880049d0 con 0x7f5e94100b20 2024-09-06T14:45:41.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.991+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9419ec30 con 0x7f5e94100b20 2024-09-06T14:45:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.992+0000 7f5e90ff9640 1 -- 172.21.15.52:0/3353413487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e88035030 con 0x7f5e94100b20 2024-09-06T14:45:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.992+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9419f1c0 con 0x7f5e94100b20 2024-09-06T14:45:41.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.993+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e941005e0 con 0x7f5e94100b20 2024-09-06T14:45:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.994+0000 7f5e90ff9640 1 -- 172.21.15.52:0/3353413487 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 26) ==== 99909+0+0 (secure 0 0 0) 0x7f5e88042070 con 0x7f5e94100b20 2024-09-06T14:45:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.994+0000 7f5e90ff9640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5e7c0774b0 0x7f5e7c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.994+0000 7f5e90ff9640 1 -- 172.21.15.52:0/3353413487 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f5e880ba000 con 0x7f5e94100b20 2024-09-06T14:45:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.994+0000 7f5e937fe640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5e7c0774b0 0x7f5e7c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:41.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:41.995+0000 7f5e937fe640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5e7c0774b0 0x7f5e7c079970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009fc0 tx=0x7f5e84005f90 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:41.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.002+0000 7f5e90ff9640 1 -- 172.21.15.52:0/3353413487 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f5e880873f0 con 0x7f5e94100b20 2024-09-06T14:45:42.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:41 smithi165 ceph-mon[36229]: pgmap v53: 65 pgs: 65 active+clean; 430 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 108 op/s 2024-09-06T14:45:42.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.225+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5e94062630 con 0x7f5e7c0774b0 2024-09-06T14:45:42.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.235+0000 7f5e90ff9640 1 -- 172.21.15.52:0/3353413487 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f5e94062630 con 0x7f5e7c0774b0 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (7m) 10s ago 8m 24.4M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (53s) 10s ago 9m 8350k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (23s) 13s ago 8m 8140k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (9m) 10s ago 9m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (8m) 13s ago 8m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (7m) 10s ago 8m 81.1M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:45:42.233 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (3m) 10s ago 3m 275M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (3m) 10s ago 3m 234M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (3m) 13s ago 3m 26.1M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (3m) 13s ago 3m 25.2M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (17s) 10s ago 10m 64.1M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (109s) 13s ago 8m 505M - 19.3.0-4704-g8b38c33c 1c45aca0610a 53aea8d00134 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (10m) 10s ago 10m 52.6M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (8m) 13s ago 8m 40.3M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (9m) 10s ago 9m 17.0M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (8m) 13s ago 8m 15.0M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (7m) 10s ago 7m 172M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (6m) 10s ago 6m 193M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (6m) 10s ago 6m 159M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:45:42.234 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (5m) 13s ago 5m 209M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:45:42.235 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (5m) 13s ago 5m 185M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:45:42.235 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (4m) 13s ago 4m 171M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:45:42.235 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (27s) 10s ago 8m 42.1M - 2.43.0 a07b618ecd1d 15ee09899a08 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5e7c0774b0 msgr2=0x7f5e7c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5e7c0774b0 0x7f5e7c079970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009fc0 tx=0x7f5e84005f90 comp rx=0 tx=0).stop 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 msgr2=0x7f5e94199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94199bd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5e88006010 tx=0x7f5e88004570 comp rx=0 tx=0).stop 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 shutdown_connections 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f5e7c0774b0 0x7f5e7c079970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e94100b20 0x7f5e94199bd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 --2- 172.21.15.52:0/3353413487 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e941001e0 0x7f5e94199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.238+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 >> 172.21.15.52:0/3353413487 conn(0x7f5e940fc010 msgr2=0x7f5e94108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.239+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 shutdown_connections 2024-09-06T14:45:42.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.239+0000 7f5e99d37640 1 -- 172.21.15.52:0/3353413487 wait complete. 2024-09-06T14:45:42.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 -- 172.21.15.52:0/3277297134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100ba0 msgr2=0x7f086c101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 --2- 172.21.15.52:0/3277297134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100ba0 0x7f086c101000 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0860009880 tx=0x7f086002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 -- 172.21.15.52:0/3277297134 shutdown_connections 2024-09-06T14:45:42.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 --2- 172.21.15.52:0/3277297134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100ba0 0x7f086c101000 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 --2- 172.21.15.52:0/3277297134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100260 0x7f086c100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 -- 172.21.15.52:0/3277297134 >> 172.21.15.52:0/3277297134 conn(0x7f086c0fc010 msgr2=0x7f086c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:42.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 -- 172.21.15.52:0/3277297134 shutdown_connections 2024-09-06T14:45:42.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.340+0000 7f087273b640 1 -- 172.21.15.52:0/3277297134 wait complete. 2024-09-06T14:45:42.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.341+0000 7f087273b640 1 Processor -- start 2024-09-06T14:45:42.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.341+0000 7f087273b640 1 -- start start 2024-09-06T14:45:42.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f087273b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100260 0x7f086c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:42.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f087273b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100ba0 0x7f086c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:42.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f087273b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f086c10c990 con 0x7f086c100260 2024-09-06T14:45:42.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f087273b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f086c10c810 con 0x7f086c100ba0 2024-09-06T14:45:42.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f086b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100ba0 0x7f086c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:42.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f086b7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100ba0 0x7f086c199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:49954/0 (socket says 172.21.15.52:49954) 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f086b7fe640 1 -- 172.21.15.52:0/3860456458 learned_addr learned my addr 172.21.15.52:0/3860456458 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f086bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100260 0x7f086c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f086b7fe640 1 -- 172.21.15.52:0/3860456458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100260 msgr2=0x7f086c199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f086b7fe640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100260 0x7f086c199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.342+0000 7f086b7fe640 1 -- 172.21.15.52:0/3860456458 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c19a240 con 0x7f086c100ba0 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.343+0000 7f086b7fe640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100ba0 0x7f086c199bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0860006010 tx=0x7f0860004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.343+0000 7f08697fa640 1 -- 172.21.15.52:0/3860456458 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f086003f070 con 0x7f086c100ba0 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.343+0000 7f08697fa640 1 -- 172.21.15.52:0/3860456458 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08600049d0 con 0x7f086c100ba0 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.343+0000 7f08697fa640 1 -- 172.21.15.52:0/3860456458 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0860035030 con 0x7f086c100ba0 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.343+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f086c102470 con 0x7f086c100ba0 2024-09-06T14:45:42.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.343+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086c102940 con 0x7f086c100ba0 2024-09-06T14:45:42.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.345+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086c100660 con 0x7f086c100ba0 2024-09-06T14:45:42.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.346+0000 7f08697fa640 1 -- 172.21.15.52:0/3860456458 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 26) ==== 99909+0+0 (secure 0 0 0) 0x7f0860042070 con 0x7f086c100ba0 2024-09-06T14:45:42.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.346+0000 7f08697fa640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f08540774b0 0x7f0854079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:42.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.346+0000 7f08697fa640 1 -- 172.21.15.52:0/3860456458 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f08600ba000 con 0x7f086c100ba0 2024-09-06T14:45:42.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.346+0000 7f086bfff640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f08540774b0 0x7f0854079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:42.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.347+0000 7f086bfff640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f08540774b0 0x7f0854079970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f085c004170 tx=0x7f085c018040 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:42.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.351+0000 7f08697fa640 1 -- 172.21.15.52:0/3860456458 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f08600873f0 con 0x7f086c100ba0 2024-09-06T14:45:42.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.687+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f086c062df0 con 0x7f086c100ba0 2024-09-06T14:45:42.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.688+0000 7f08697fa640 1 -- 172.21.15.52:0/3860456458 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f086008be10 con 0x7f086c100ba0 2024-09-06T14:45:42.685 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:45:42.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:45:42.685 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 12, 2024-09-06T14:45:42.686 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:45:42.687 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:45:42.687 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:45:42.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.690+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f08540774b0 msgr2=0x7f0854079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.690+0000 7f087273b640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f08540774b0 0x7f0854079970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f085c004170 tx=0x7f085c018040 comp rx=0 tx=0).stop 2024-09-06T14:45:42.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.690+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100ba0 msgr2=0x7f086c199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100ba0 0x7f086c199bc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0860006010 tx=0x7f0860004570 comp rx=0 tx=0).stop 2024-09-06T14:45:42.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 shutdown_connections 2024-09-06T14:45:42.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f08540774b0 0x7f0854079970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f086c100ba0 0x7f086c199bc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 --2- 172.21.15.52:0/3860456458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f086c100260 0x7f086c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 >> 172.21.15.52:0/3860456458 conn(0x7f086c0fc010 msgr2=0x7f086c108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:42.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 shutdown_connections 2024-09-06T14:45:42.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.691+0000 7f087273b640 1 -- 172.21.15.52:0/3860456458 wait complete. 2024-09-06T14:45:42.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 -- 172.21.15.52:0/2677985640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 msgr2=0x7f7798100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 --2- 172.21.15.52:0/2677985640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f7798100c60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7788009880 tx=0x7f778802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 -- 172.21.15.52:0/2677985640 shutdown_connections 2024-09-06T14:45:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 --2- 172.21.15.52:0/2677985640 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7798101a60 0x7f7798101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 --2- 172.21.15.52:0/2677985640 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f7798100c60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 -- 172.21.15.52:0/2677985640 >> 172.21.15.52:0/2677985640 conn(0x7f77980fc010 msgr2=0x7f77980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 -- 172.21.15.52:0/2677985640 shutdown_connections 2024-09-06T14:45:42.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.795+0000 7f779c97d640 1 -- 172.21.15.52:0/2677985640 wait complete. 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779c97d640 1 Processor -- start 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779c97d640 1 -- start start 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779c97d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f77981087a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779c97d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7798101a60 0x7f7798106e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779c97d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f779810a7a0 con 0x7f7798100860 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779c97d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f779810a620 con 0x7f7798101a60 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f77981087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f77981087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60396/0 (socket says 172.21.15.52:60396) 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f779659c640 1 -- 172.21.15.52:0/169772103 learned_addr learned my addr 172.21.15.52:0/169772103 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.796+0000 7f7795d9b640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7798101a60 0x7f7798106e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f779659c640 1 -- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7798101a60 msgr2=0x7f7798106e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f779659c640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7798101a60 0x7f7798106e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:42.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f779659c640 1 -- 172.21.15.52:0/169772103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77981073a0 con 0x7f7798100860 2024-09-06T14:45:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f779659c640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f77981087a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7788006010 tx=0x7f77880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f77877fe640 1 -- 172.21.15.52:0/169772103 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f778803f070 con 0x7f7798100860 2024-09-06T14:45:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7798107630 con 0x7f7798100860 2024-09-06T14:45:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f77877fe640 1 -- 172.21.15.52:0/169772103 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77880049d0 con 0x7f7798100860 2024-09-06T14:45:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7798107b60 con 0x7f7798100860 2024-09-06T14:45:42.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.797+0000 7f77877fe640 1 -- 172.21.15.52:0/169772103 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7788035030 con 0x7f7798100860 2024-09-06T14:45:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.799+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7798100c60 con 0x7f7798100860 2024-09-06T14:45:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.799+0000 7f77877fe640 1 -- 172.21.15.52:0/169772103 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 26) ==== 99909+0+0 (secure 0 0 0) 0x7f7788042070 con 0x7f7798100860 2024-09-06T14:45:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.800+0000 7f77877fe640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f77800774b0 0x7f7780079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:45:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.800+0000 7f77877fe640 1 -- 172.21.15.52:0/169772103 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f77880b9f40 con 0x7f7798100860 2024-09-06T14:45:42.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.800+0000 7f7795d9b640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f77800774b0 0x7f7780079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:45:42.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.800+0000 7f7795d9b640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f77800774b0 0x7f7780079970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7798108520 tx=0x7f778c005f90 comp rx=0 tx=0).ready entity=mgr.24363 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:45:42.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:42.804+0000 7f77877fe640 1 -- 172.21.15.52:0/169772103 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f7788087330 con 0x7f7798100860 2024-09-06T14:45:43.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.032+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 --> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7798062630 con 0x7f77800774b0 2024-09-06T14:45:43.029 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:42 smithi052 ceph-mon[28627]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:43.030 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:42 smithi052 ceph-mon[28627]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:43.030 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:42 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3860456458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:45:43.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.033+0000 7f77877fe640 1 -- 172.21.15.52:0/169772103 <== mgr.24363 v2:172.21.15.165:6828/100552479 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f7798062630 con 0x7f77800774b0 2024-09-06T14:45:43.030 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr" 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "2/2 daemons upgraded", 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mgr daemons", 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:45:43.031 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:45:43.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.036+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f77800774b0 msgr2=0x7f7780079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:43.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.036+0000 7f779c97d640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f77800774b0 0x7f7780079970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7798108520 tx=0x7f778c005f90 comp rx=0 tx=0).stop 2024-09-06T14:45:43.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.036+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 msgr2=0x7f77981087a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:45:43.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.036+0000 7f779c97d640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f77981087a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7788006010 tx=0x7f77880045e0 comp rx=0 tx=0).stop 2024-09-06T14:45:43.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.037+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 shutdown_connections 2024-09-06T14:45:43.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.037+0000 7f779c97d640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:6828/100552479,v1:172.21.15.165:6829/100552479] conn(0x7f77800774b0 0x7f7780079970 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:43.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.037+0000 7f779c97d640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7798101a60 0x7f7798106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:45:43.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.037+0000 7f779c97d640 1 --2- 172.21.15.52:0/169772103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7798100860 0x7f77981087a0 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7788006010 tx=0x7f77880045e0 comp rx=0 tx=0).stop 2024-09-06T14:45:43.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.037+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 >> 172.21.15.52:0/169772103 conn(0x7f77980fc010 msgr2=0x7f7798104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:45:43.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.037+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 shutdown_connections 2024-09-06T14:45:43.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:45:43.037+0000 7f779c97d640 1 -- 172.21.15.52:0/169772103 wait complete. 2024-09-06T14:45:43.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:42 smithi165 ceph-mon[36229]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:43.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:42 smithi165 ceph-mon[36229]: from='client.24445 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:43.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:42 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3860456458' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:45:44.051 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:43 smithi052 ceph-mon[28627]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:44.051 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:43 smithi052 ceph-mon[28627]: pgmap v54: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-09-06T14:45:44.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:43 smithi165 ceph-mon[36229]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:44.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:43 smithi165 ceph-mon[36229]: pgmap v54: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 157 op/s 2024-09-06T14:45:44.995 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:44 smithi052 ceph-mon[28627]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:45.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:44 smithi165 ceph-mon[36229]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:45:46.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:45 smithi165 ceph-mon[36229]: pgmap v55: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-09-06T14:45:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:45 smithi052 ceph-mon[28627]: pgmap v55: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-09-06T14:45:48.060 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:47 smithi052 ceph-mon[28627]: pgmap v56: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-09-06T14:45:48.061 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:47 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:48.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:47 smithi165 ceph-mon[36229]: pgmap v56: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-09-06T14:45:48.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:47 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:50.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:49 smithi165 ceph-mon[36229]: pgmap v57: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 136 op/s 2024-09-06T14:45:50.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:49 smithi052 ceph-mon[28627]: pgmap v57: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 136 op/s 2024-09-06T14:45:51.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 86 op/s 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr fail", "who": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr fail", "who": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: Activating manager daemon smithi052.vsthpq 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd='[{"prefix": "mgr fail", "who": "smithi165.hcexoi"}]': finished 2024-09-06T14:45:51.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: osdmap e48: 6 total, 6 up, 6 in 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: mgrmap e27: smithi052.vsthpq(active, starting, since 0.00735672s) 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:45:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:45:51.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:45:51.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:45:51.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:45:51.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:51 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: pgmap v58: 65 pgs: 65 active+clean; 300 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 86 op/s 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 172.21.15.165:0/3548519334' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr fail", "who": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:45:52.042 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "mgr fail", "who": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: Activating manager daemon smithi052.vsthpq 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.24363 ' entity='mgr.smithi165.hcexoi' cmd='[{"prefix": "mgr fail", "who": "smithi165.hcexoi"}]': finished 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: osdmap e48: 6 total, 6 up, 6 in 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: mgrmap e27: smithi052.vsthpq(active, starting, since 0.00735672s) 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"}]: dispatch 2024-09-06T14:45:52.043 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi052.vsthpq", "id": "smithi052.vsthpq"}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-06T14:45:52.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-06T14:45:52.045 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-06T14:45:52.045 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:51 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-06T14:45:52.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:52 smithi165 ceph-mon[36229]: Manager daemon smithi052.vsthpq is now available 2024-09-06T14:45:52.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:52 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:52.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:52 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:52.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:52 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:45:52.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:52 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:45:52.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:52 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/trash_purge_schedule"}]: dispatch 2024-09-06T14:45:53.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:52 smithi052 ceph-mon[28627]: Manager daemon smithi052.vsthpq is now available 2024-09-06T14:45:53.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:52 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:45:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:52 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:45:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:52 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:45:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:52 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/mirror_snapshot_schedule"}]: dispatch 2024-09-06T14:45:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:52 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi052.vsthpq/trash_purge_schedule"}]: dispatch 2024-09-06T14:45:54.060 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:53 smithi165 ceph-mon[36229]: mgrmap e28: smithi052.vsthpq(active, since 1.20476s) 2024-09-06T14:45:54.060 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:53 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:45:54.060 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:53 smithi165 ceph-mon[36229]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:53 smithi052 ceph-mon[28627]: mgrmap e28: smithi052.vsthpq(active, since 1.20476s) 2024-09-06T14:45:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:53 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:45:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:53 smithi052 ceph-mon[28627]: pgmap v3: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:54.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:54 smithi165 ceph-mon[36229]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:55.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:54 smithi052 ceph-mon[28627]: pgmap v4: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:55 smithi165 ceph-mon[36229]: [06/Sep/2024:14:45:54] ENGINE Bus STARTING 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:55 smithi165 ceph-mon[36229]: [06/Sep/2024:14:45:54] ENGINE Serving on https://172.21.15.52:7150 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:55 smithi165 ceph-mon[36229]: [06/Sep/2024:14:45:54] ENGINE Error in HTTPServer.serve 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Traceback (most recent call last): 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._connections.run(self.expiration_interval) 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._run(expiration_interval) 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T14:45:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: s = self.context.wrap_socket( 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: return self.sslsocket_class._create( 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self.do_handshake() 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: self._sslobj.do_handshake() 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:55 smithi165 ceph-mon[36229]: [06/Sep/2024:14:45:54] ENGINE Serving on http://172.21.15.52:8765 2024-09-06T14:45:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:55 smithi165 ceph-mon[36229]: [06/Sep/2024:14:45:54] ENGINE Bus STARTED 2024-09-06T14:45:55.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:55 smithi165 ceph-mon[36229]: mgrmap e29: smithi052.vsthpq(active, since 3s) 2024-09-06T14:45:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:55 smithi052 ceph-mon[28627]: [06/Sep/2024:14:45:54] ENGINE Bus STARTING 2024-09-06T14:45:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:55 smithi052 ceph-mon[28627]: [06/Sep/2024:14:45:54] ENGINE Serving on https://172.21.15.52:7150 2024-09-06T14:45:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:55 smithi052 ceph-mon[28627]: [06/Sep/2024:14:45:54] ENGINE Error in HTTPServer.serve 2024-09-06T14:45:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Traceback (most recent call last): 2024-09-06T14:45:56.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._connections.run(self.expiration_interval) 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._run(expiration_interval) 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: s = self.context.wrap_socket( 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: return self.sslsocket_class._create( 2024-09-06T14:45:56.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-06T14:45:56.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self.do_handshake() 2024-09-06T14:45:56.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-06T14:45:56.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: self._sslobj.do_handshake() 2024-09-06T14:45:56.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-06T14:45:56.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:55 smithi052 ceph-mon[28627]: [06/Sep/2024:14:45:54] ENGINE Serving on http://172.21.15.52:8765 2024-09-06T14:45:56.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:55 smithi052 ceph-mon[28627]: [06/Sep/2024:14:45:54] ENGINE Bus STARTED 2024-09-06T14:45:56.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:55 smithi052 ceph-mon[28627]: mgrmap e29: smithi052.vsthpq(active, since 3s) 2024-09-06T14:45:57.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:56 smithi165 ceph-mon[36229]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:57.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:56 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:57.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:56 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:57.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:56 smithi052 ceph-mon[28627]: pgmap v5: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:57.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:56 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:57.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:56 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: mgrmap e30: smithi052.vsthpq(active, since 5s) 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:45:58.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:58 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:45:58.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:58.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:45:58.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: mgrmap e30: smithi052.vsthpq(active, since 5s) 2024-09-06T14:45:58.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:45:58.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:45:58.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:45:58.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:45:58.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:45:58.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:58 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/676607050' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:45:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:59 smithi165 ceph-mon[36229]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:59 smithi165 ceph-mon[36229]: mgrmap e31: smithi052.vsthpq(active, since 6s), standbys: smithi165.hcexoi 2024-09-06T14:45:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:45:59 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi165.hcexoi", "id": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:45:59.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:59 smithi052 ceph-mon[28627]: pgmap v6: 65 pgs: 65 active+clean; 307 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:45:59.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:59 smithi052 ceph-mon[28627]: mgrmap e31: smithi052.vsthpq(active, since 6s), standbys: smithi165.hcexoi 2024-09-06T14:45:59.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:45:59 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr metadata", "who": "smithi165.hcexoi", "id": "smithi165.hcexoi"}]: dispatch 2024-09-06T14:46:01.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:01 smithi165 ceph-mon[36229]: pgmap v7: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 100 op/s 2024-09-06T14:46:01.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:01 smithi052 ceph-mon[28627]: pgmap v7: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 100 op/s 2024-09-06T14:46:03.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:03 smithi165 ceph-mon[36229]: pgmap v8: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 911 KiB/s wr, 77 op/s 2024-09-06T14:46:03.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:03 smithi052 ceph-mon[28627]: pgmap v8: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1017 KiB/s rd, 911 KiB/s wr, 77 op/s 2024-09-06T14:46:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:05 smithi165 ceph-mon[36229]: pgmap v9: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-06T14:46:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:05 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:05.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:05 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:05.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:05 smithi052 ceph-mon[28627]: pgmap v9: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-06T14:46:05.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:05 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:05.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:05 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:07.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:06 smithi052 ceph-mon[28627]: pgmap v10: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 182 op/s 2024-09-06T14:46:07.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:06 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:07.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:06 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:07.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:06 smithi165 ceph-mon[36229]: pgmap v10: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 182 op/s 2024-09-06T14:46:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:06 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:06 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:08.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:07 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:08.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:07 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:09.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:08 smithi052 ceph-mon[28627]: pgmap v11: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 182 op/s 2024-09-06T14:46:09.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:08 smithi165 ceph-mon[36229]: pgmap v11: 65 pgs: 65 active+clean; 303 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 182 op/s 2024-09-06T14:46:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:10 smithi052 ceph-mon[28627]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 427 op/s 2024-09-06T14:46:11.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:10 smithi165 ceph-mon[36229]: pgmap v12: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 427 op/s 2024-09-06T14:46:13.181 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:12 smithi052 ceph-mon[28627]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 370 op/s 2024-09-06T14:46:13.181 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:12 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:13.182 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:12 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:13.182 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:12 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:46:13.182 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:12 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:46:13.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.182+0000 7ff523efc640 1 -- 172.21.15.52:0/2277447733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 msgr2=0x7ff51c1099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.182+0000 7ff523efc640 1 --2- 172.21.15.52:0/2277447733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 0x7ff51c1099f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009880 tx=0x7ff50c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.183+0000 7ff523efc640 1 -- 172.21.15.52:0/2277447733 shutdown_connections 2024-09-06T14:46:13.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.183+0000 7ff523efc640 1 --2- 172.21.15.52:0/2277447733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 0x7ff51c1099f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.183+0000 7ff523efc640 1 --2- 172.21.15.52:0/2277447733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 0x7ff51c073930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.183+0000 7ff523efc640 1 -- 172.21.15.52:0/2277447733 >> 172.21.15.52:0/2277447733 conn(0x7ff51c06ed60 msgr2=0x7ff51c0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:13.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.186+0000 7ff523efc640 1 -- 172.21.15.52:0/2277447733 shutdown_connections 2024-09-06T14:46:13.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.186+0000 7ff523efc640 1 -- 172.21.15.52:0/2277447733 wait complete. 2024-09-06T14:46:13.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.187+0000 7ff523efc640 1 Processor -- start 2024-09-06T14:46:13.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.187+0000 7ff523efc640 1 -- start start 2024-09-06T14:46:13.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.187+0000 7ff523efc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 0x7ff51c1aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.187+0000 7ff523efc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 0x7ff51c1af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.187+0000 7ff523efc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10f9c0 con 0x7ff51c109570 2024-09-06T14:46:13.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.187+0000 7ff523efc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10f840 con 0x7ff51c073530 2024-09-06T14:46:13.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.188+0000 7ff521c98640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 0x7ff51c1aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.188+0000 7ff521c98640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 0x7ff51c1aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:48204/0 (socket says 172.21.15.52:48204) 2024-09-06T14:46:13.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.188+0000 7ff521c98640 1 -- 172.21.15.52:0/3359957996 learned_addr learned my addr 172.21.15.52:0/3359957996 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:13.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.188+0000 7ff521497640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 0x7ff51c1af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.189+0000 7ff521c98640 1 -- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 msgr2=0x7ff51c1af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.189+0000 7ff521c98640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 0x7ff51c1af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.189+0000 7ff521c98640 1 -- 172.21.15.52:0/3359957996 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c1af6d0 con 0x7ff51c073530 2024-09-06T14:46:13.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.190+0000 7ff521c98640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 0x7ff51c1aeaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e970 tx=0x7ff51800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:13.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.190+0000 7ff512ffd640 1 -- 172.21.15.52:0/3359957996 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff51800cac0 con 0x7ff51c073530 2024-09-06T14:46:13.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.190+0000 7ff512ffd640 1 -- 172.21.15.52:0/3359957996 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff51800cc60 con 0x7ff51c073530 2024-09-06T14:46:13.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.191+0000 7ff512ffd640 1 -- 172.21.15.52:0/3359957996 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff518018720 con 0x7ff51c073530 2024-09-06T14:46:13.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.191+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c1b4100 con 0x7ff51c073530 2024-09-06T14:46:13.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.192+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1b4610 con 0x7ff51c073530 2024-09-06T14:46:13.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.193+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c073930 con 0x7ff51c073530 2024-09-06T14:46:13.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.194+0000 7ff512ffd640 1 -- 172.21.15.52:0/3359957996 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 31) ==== 99907+0+0 (secure 0 0 0) 0x7ff518010430 con 0x7ff51c073530 2024-09-06T14:46:13.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.195+0000 7ff512ffd640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5080774e0 0x7ff5080799a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.195+0000 7ff512ffd640 1 -- 172.21.15.52:0/3359957996 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7ff518099b80 con 0x7ff51c073530 2024-09-06T14:46:13.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.195+0000 7ff521497640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5080774e0 0x7ff5080799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.196+0000 7ff521497640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5080774e0 0x7ff5080799a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006010 tx=0x7ff50c005a20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:13.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.200+0000 7ff512ffd640 1 -- 172.21.15.52:0/3359957996 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7ff518062d10 con 0x7ff51c073530 2024-09-06T14:46:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:12 smithi165 ceph-mon[36229]: pgmap v13: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 370 op/s 2024-09-06T14:46:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:12 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:12 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:12 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:46:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:12 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:46:13.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.464+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff51c02dbd0 con 0x7ff5080774e0 2024-09-06T14:46:13.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.466+0000 7ff512ffd640 1 -- 172.21.15.52:0/3359957996 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7ff51c02dbd0 con 0x7ff5080774e0 2024-09-06T14:46:13.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5080774e0 msgr2=0x7ff5080799a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5080774e0 0x7ff5080799a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006010 tx=0x7ff50c005a20 comp rx=0 tx=0).stop 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 msgr2=0x7ff51c1aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 0x7ff51c1aeaf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff51800e970 tx=0x7ff51800ee30 comp rx=0 tx=0).stop 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 shutdown_connections 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff51c109570 0x7ff51c1af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5080774e0 0x7ff5080799a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 --2- 172.21.15.52:0/3359957996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff51c073530 0x7ff51c1aeaf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 >> 172.21.15.52:0/3359957996 conn(0x7ff51c06ed60 msgr2=0x7ff51c10cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 shutdown_connections 2024-09-06T14:46:13.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.469+0000 7ff523efc640 1 -- 172.21.15.52:0/3359957996 wait complete. 2024-09-06T14:46:13.480 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:46:13.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 -- 172.21.15.52:0/1711275247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 msgr2=0x7faca4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 --2- 172.21.15.52:0/1711275247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4100c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac940097e0 tx=0x7fac9402a3f0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 -- 172.21.15.52:0/1711275247 shutdown_connections 2024-09-06T14:46:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 --2- 172.21.15.52:0/1711275247 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faca4101a60 0x7faca4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 --2- 172.21.15.52:0/1711275247 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4100c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 -- 172.21.15.52:0/1711275247 >> 172.21.15.52:0/1711275247 conn(0x7faca40fc010 msgr2=0x7faca40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 -- 172.21.15.52:0/1711275247 shutdown_connections 2024-09-06T14:46:13.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.586+0000 7faca8b8f640 1 -- 172.21.15.52:0/1711275247 wait complete. 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7faca8b8f640 1 Processor -- start 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7faca8b8f640 1 -- start start 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7faca8b8f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7faca8b8f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faca4101a60 0x7faca4102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7faca8b8f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faca4109680 con 0x7faca4101a60 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7faca8b8f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faca4109500 con 0x7faca4100860 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7faca259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.587+0000 7fac99d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faca4101a60 0x7faca4102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.588+0000 7faca259c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:48220/0 (socket says 172.21.15.52:48220) 2024-09-06T14:46:13.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.588+0000 7faca259c640 1 -- 172.21.15.52:0/2712809348 learned_addr learned my addr 172.21.15.52:0/2712809348 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.588+0000 7fac99d9b640 1 -- 172.21.15.52:0/2712809348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 msgr2=0x7faca4104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.588+0000 7fac99d9b640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.588+0000 7fac99d9b640 1 -- 172.21.15.52:0/2712809348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca4103380 con 0x7faca4101a60 2024-09-06T14:46:13.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.588+0000 7faca259c640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:46:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.588+0000 7fac99d9b640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faca4101a60 0x7faca4102e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fac8c005fd0 tx=0x7fac8c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.589+0000 7fac9bfff640 1 -- 172.21.15.52:0/2712809348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac8c00cac0 con 0x7faca4101a60 2024-09-06T14:46:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.589+0000 7fac9bfff640 1 -- 172.21.15.52:0/2712809348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac8c00cc60 con 0x7faca4101a60 2024-09-06T14:46:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.589+0000 7fac9bfff640 1 -- 172.21.15.52:0/2712809348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac8c003e00 con 0x7faca4101a60 2024-09-06T14:46:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.589+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca4103670 con 0x7faca4101a60 2024-09-06T14:46:13.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.589+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca4103c00 con 0x7faca4101a60 2024-09-06T14:46:13.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.591+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca4100c60 con 0x7faca4101a60 2024-09-06T14:46:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.592+0000 7fac9bfff640 1 -- 172.21.15.52:0/2712809348 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) ==== 99907+0+0 (secure 0 0 0) 0x7fac8c010500 con 0x7faca4101a60 2024-09-06T14:46:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.592+0000 7fac9bfff640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac900774b0 0x7fac90079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.592+0000 7fac9bfff640 1 -- 172.21.15.52:0/2712809348 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fac8c099970 con 0x7faca4101a60 2024-09-06T14:46:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.593+0000 7faca259c640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac900774b0 0x7fac90079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.593+0000 7faca259c640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac900774b0 0x7fac90079970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac940095f0 tx=0x7fac94030890 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:13.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.597+0000 7fac9bfff640 1 -- 172.21.15.52:0/2712809348 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fac8c062b20 con 0x7faca4101a60 2024-09-06T14:46:13.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.863+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faca419f5b0 con 0x7fac900774b0 2024-09-06T14:46:13.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.865+0000 7fac9bfff640 1 -- 172.21.15.52:0/2712809348 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7faca419f5b0 con 0x7fac900774b0 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac900774b0 msgr2=0x7fac90079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac900774b0 0x7fac90079970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac940095f0 tx=0x7fac94030890 comp rx=0 tx=0).stop 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faca4101a60 msgr2=0x7faca4102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faca4101a60 0x7faca4102e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fac8c005fd0 tx=0x7fac8c00edd0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 shutdown_connections 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faca4101a60 0x7faca4102e40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac900774b0 0x7fac90079970 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac940095f0 tx=0x7fac94030890 comp rx=0 tx=0).stop 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.867+0000 7faca8b8f640 1 --2- 172.21.15.52:0/2712809348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faca4100860 0x7faca4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.868+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 >> 172.21.15.52:0/2712809348 conn(0x7faca40fc010 msgr2=0x7faca4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:13.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.868+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 shutdown_connections 2024-09-06T14:46:13.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.868+0000 7faca8b8f640 1 -- 172.21.15.52:0/2712809348 wait complete. 2024-09-06T14:46:13.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.979+0000 7f8675938640 1 -- 172.21.15.52:0/3741719019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670101a60 msgr2=0x7f8670101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.979+0000 7f8675938640 1 --2- 172.21.15.52:0/3741719019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670101a60 0x7f8670101ee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8658009880 tx=0x7f865802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.980+0000 7f8675938640 1 -- 172.21.15.52:0/3741719019 shutdown_connections 2024-09-06T14:46:13.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.980+0000 7f8675938640 1 --2- 172.21.15.52:0/3741719019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670101a60 0x7f8670101ee0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.980+0000 7f8675938640 1 --2- 172.21.15.52:0/3741719019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8670100860 0x7f8670100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.980+0000 7f8675938640 1 -- 172.21.15.52:0/3741719019 >> 172.21.15.52:0/3741719019 conn(0x7f86700fc010 msgr2=0x7f86700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:13.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.980+0000 7f8675938640 1 -- 172.21.15.52:0/3741719019 shutdown_connections 2024-09-06T14:46:13.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.980+0000 7f8675938640 1 -- 172.21.15.52:0/3741719019 wait complete. 2024-09-06T14:46:13.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.981+0000 7f8675938640 1 Processor -- start 2024-09-06T14:46:13.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.981+0000 7f8675938640 1 -- start start 2024-09-06T14:46:13.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.981+0000 7f8675938640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670100860 0x7f8670199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.981+0000 7f8675938640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8670101a60 0x7f8670199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f8675938640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8670108570 con 0x7f8670100860 2024-09-06T14:46:13.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f8675938640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86701083f0 con 0x7f8670101a60 2024-09-06T14:46:13.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f866effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670100860 0x7f8670199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f866effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670100860 0x7f8670199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42558/0 (socket says 172.21.15.52:42558) 2024-09-06T14:46:13.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f866effd640 1 -- 172.21.15.52:0/1295190574 learned_addr learned my addr 172.21.15.52:0/1295190574 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:13.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f8667fff640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8670101a60 0x7f8670199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f866effd640 1 -- 172.21.15.52:0/1295190574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8670101a60 msgr2=0x7f8670199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f866effd640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8670101a60 0x7f8670199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f866effd640 1 -- 172.21.15.52:0/1295190574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867019a250 con 0x7f8670100860 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.982+0000 7f866effd640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670100860 0x7f8670199690 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f866000e940 tx=0x7f866000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.983+0000 7f8674936640 1 -- 172.21.15.52:0/1295190574 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f866000cac0 con 0x7f8670100860 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.983+0000 7f8674936640 1 -- 172.21.15.52:0/1295190574 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f866000cc60 con 0x7f8670100860 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.983+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867019ec90 con 0x7f8670100860 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.983+0000 7f8674936640 1 -- 172.21.15.52:0/1295190574 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8660003de0 con 0x7f8670100860 2024-09-06T14:46:13.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.983+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867019f1a0 con 0x7f8670100860 2024-09-06T14:46:13.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.984+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8670100c60 con 0x7f8670100860 2024-09-06T14:46:13.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.985+0000 7f8674936640 1 -- 172.21.15.52:0/1295190574 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) ==== 99907+0+0 (secure 0 0 0) 0x7f8660003f80 con 0x7f8670100860 2024-09-06T14:46:13.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.986+0000 7f8674936640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f865c077460 0x7f865c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:13.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.986+0000 7f8674936640 1 -- 172.21.15.52:0/1295190574 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f8660099d90 con 0x7f8670100860 2024-09-06T14:46:13.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.986+0000 7f8667fff640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f865c077460 0x7f865c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:13.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.987+0000 7f8667fff640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f865c077460 0x7f865c079920 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8658000c00 tx=0x7f8658005a20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:13.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:13.994+0000 7f8674936640 1 -- 172.21.15.52:0/1295190574 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f8660062e20 con 0x7f8670100860 2024-09-06T14:46:14.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:46:14.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-06T14:46:14.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:46:14.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:46:14.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:46:14.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:13 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.299+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8670062630 con 0x7f865c077460 2024-09-06T14:46:14.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.311+0000 7f8674936640 1 -- 172.21.15.52:0/1295190574 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8670062630 con 0x7f865c077460 2024-09-06T14:46:14.309 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:46:14.309 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (8m) 9s ago 9m 24.5M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (85s) 9s ago 9m 8484k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (55s) 17s ago 8m 8368k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (9m) 9s ago 9m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (8m) 17s ago 8m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (7m) 9s ago 9m 81.1M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (4m) 9s ago 4m 249M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (4m) 9s ago 4m 220M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (4m) 17s ago 4m 26.4M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:46:14.310 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (4m) 17s ago 4m 26.3M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (49s) 9s ago 10m 483M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (2m) 17s ago 8m 156M - 19.3.0-4704-g8b38c33c 1c45aca0610a 53aea8d00134 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (10m) 9s ago 10m 54.8M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (8m) 17s ago 8m 43.1M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (9m) 9s ago 9m 17.0M - 1.5.0 0da6a335fe13 b265c0245217 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (8m) 17s ago 8m 15.1M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (7m) 9s ago 7m 172M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (7m) 9s ago 7m 197M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (6m) 9s ago 6m 162M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (6m) 17s ago 6m 212M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (5m) 17s ago 5m 190M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (5m) 17s ago 5m 168M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:46:14.311 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (59s) 9s ago 9m 44.9M - 2.43.0 a07b618ecd1d 15ee09899a08 2024-09-06T14:46:14.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f865c077460 msgr2=0x7f865c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f865c077460 0x7f865c079920 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8658000c00 tx=0x7f8658005a20 comp rx=0 tx=0).stop 2024-09-06T14:46:14.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670100860 msgr2=0x7f8670199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670100860 0x7f8670199690 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f866000e940 tx=0x7f866000ee00 comp rx=0 tx=0).stop 2024-09-06T14:46:14.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 shutdown_connections 2024-09-06T14:46:14.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f865c077460 0x7f865c079920 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8670101a60 0x7f8670199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 --2- 172.21.15.52:0/1295190574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8670100860 0x7f8670199690 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 >> 172.21.15.52:0/1295190574 conn(0x7f86700fc010 msgr2=0x7f8670104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:14.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 shutdown_connections 2024-09-06T14:46:14.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.314+0000 7f8675938640 1 -- 172.21.15.52:0/1295190574 wait complete. 2024-09-06T14:46:14.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.conf 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:13 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.421+0000 7f088dac0640 1 -- 172.21.15.52:0/1846605019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 msgr2=0x7f0888101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.421+0000 7f088dac0640 1 --2- 172.21.15.52:0/1846605019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888101d60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0878009880 tx=0x7f087802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.422+0000 7f088dac0640 1 -- 172.21.15.52:0/1846605019 shutdown_connections 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.422+0000 7f088dac0640 1 --2- 172.21.15.52:0/1846605019 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0888102b60 0x7f0888102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.422+0000 7f088dac0640 1 --2- 172.21.15.52:0/1846605019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888101d60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.422+0000 7f088dac0640 1 -- 172.21.15.52:0/1846605019 >> 172.21.15.52:0/1846605019 conn(0x7f08880fd0f0 msgr2=0x7f08880ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.422+0000 7f088dac0640 1 -- 172.21.15.52:0/1846605019 shutdown_connections 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.422+0000 7f088dac0640 1 -- 172.21.15.52:0/1846605019 wait complete. 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.422+0000 7f088dac0640 1 Processor -- start 2024-09-06T14:46:14.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f088dac0640 1 -- start start 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f088dac0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f088dac0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0888102b60 0x7f08880745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f088dac0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f088810a780 con 0x7f0888101960 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f088dac0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f088810a600 con 0x7f0888102b60 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f08877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f08877fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42576/0 (socket says 172.21.15.52:42576) 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f08877fe640 1 -- 172.21.15.52:0/3945463926 learned_addr learned my addr 172.21.15.52:0/3945463926 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f0886ffd640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0888102b60 0x7f08880745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f08877fe640 1 -- 172.21.15.52:0/3945463926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0888102b60 msgr2=0x7f08880745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f08877fe640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0888102b60 0x7f08880745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.423+0000 7f08877fe640 1 -- 172.21.15.52:0/3945463926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0888074b20 con 0x7f0888101960 2024-09-06T14:46:14.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.424+0000 7f08877fe640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888075f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0878009230 tx=0x7f08780045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.424+0000 7f0884ff9640 1 -- 172.21.15.52:0/3945463926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f087803f070 con 0x7f0888101960 2024-09-06T14:46:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.424+0000 7f0884ff9640 1 -- 172.21.15.52:0/3945463926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0878004a50 con 0x7f0888101960 2024-09-06T14:46:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.425+0000 7f0884ff9640 1 -- 172.21.15.52:0/3945463926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0878035030 con 0x7f0888101960 2024-09-06T14:46:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.425+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0888074db0 con 0x7f0888101960 2024-09-06T14:46:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.425+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08880752e0 con 0x7f0888101960 2024-09-06T14:46:14.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.426+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0888101d60 con 0x7f0888101960 2024-09-06T14:46:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.427+0000 7f0884ff9640 1 -- 172.21.15.52:0/3945463926 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) ==== 99907+0+0 (secure 0 0 0) 0x7f0878042070 con 0x7f0888101960 2024-09-06T14:46:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.428+0000 7f0884ff9640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08700774b0 0x7f0870079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.428+0000 7f0884ff9640 1 -- 172.21.15.52:0/3945463926 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f08780ba070 con 0x7f0888101960 2024-09-06T14:46:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.428+0000 7f0886ffd640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08700774b0 0x7f0870079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:14.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.428+0000 7f0886ffd640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08700774b0 0x7f0870079970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0888075ca0 tx=0x7f087c00b410 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:14.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.432+0000 7f0884ff9640 1 -- 172.21.15.52:0/3945463926 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f0878087390 con 0x7f0888101960 2024-09-06T14:46:14.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.716+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f088819f530 con 0x7f0888101960 2024-09-06T14:46:14.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.716+0000 7f0884ff9640 1 -- 172.21.15.52:0/3945463926 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f087808bdb0 con 0x7f0888101960 2024-09-06T14:46:14.715 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:46:14.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:46:14.715 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:46:14.715 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:14.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:46:14.716 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:46:14.716 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:14.716 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:46:14.716 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:46:14.716 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:14.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:46:14.717 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:46:14.717 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:14.717 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:46:14.717 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 12, 2024-09-06T14:46:14.717 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:46:14.717 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:46:14.717 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:46:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08700774b0 msgr2=0x7f0870079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08700774b0 0x7f0870079970 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0888075ca0 tx=0x7f087c00b410 comp rx=0 tx=0).stop 2024-09-06T14:46:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 msgr2=0x7f0888075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888075f20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0878009230 tx=0x7f08780045c0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 shutdown_connections 2024-09-06T14:46:14.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08700774b0 0x7f0870079970 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0888102b60 0x7f08880745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 --2- 172.21.15.52:0/3945463926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0888101960 0x7f0888075f20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 >> 172.21.15.52:0/3945463926 conn(0x7f08880fd0f0 msgr2=0x7f08880ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.718+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 shutdown_connections 2024-09-06T14:46:14.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.719+0000 7f088dac0640 1 -- 172.21.15.52:0/3945463926 wait complete. 2024-09-06T14:46:14.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 -- 172.21.15.52:0/2161404593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 msgr2=0x7fa7ac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 --2- 172.21.15.52:0/2161404593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac100c60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009880 tx=0x7fa7a002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 -- 172.21.15.52:0/2161404593 shutdown_connections 2024-09-06T14:46:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 --2- 172.21.15.52:0/2161404593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7ac101a60 0x7fa7ac101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 --2- 172.21.15.52:0/2161404593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac100c60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 -- 172.21.15.52:0/2161404593 >> 172.21.15.52:0/2161404593 conn(0x7fa7ac0fc010 msgr2=0x7fa7ac0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 -- 172.21.15.52:0/2161404593 shutdown_connections 2024-09-06T14:46:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.829+0000 7fa7b3064640 1 -- 172.21.15.52:0/2161404593 wait complete. 2024-09-06T14:46:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b3064640 1 Processor -- start 2024-09-06T14:46:14.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b3064640 1 -- start start 2024-09-06T14:46:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b3064640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b3064640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7ac101a60 0x7fa7ac19c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b3064640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac109680 con 0x7fa7ac100860 2024-09-06T14:46:14.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b3064640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac109500 con 0x7fa7ac101a60 2024-09-06T14:46:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b0e00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac06a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42600/0 (socket says 172.21.15.52:42600) 2024-09-06T14:46:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b0e00640 1 -- 172.21.15.52:0/1333101360 learned_addr learned my addr 172.21.15.52:0/1333101360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:14.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7abfff640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7ac101a60 0x7fa7ac19c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b0e00640 1 -- 172.21.15.52:0/1333101360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7ac101a60 msgr2=0x7fa7ac19c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b0e00640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7ac101a60 0x7fa7ac19c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.830+0000 7fa7b0e00640 1 -- 172.21.15.52:0/1333101360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac19c7b0 con 0x7fa7ac100860 2024-09-06T14:46:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.831+0000 7fa7b0e00640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac06a7d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0006010 tx=0x7fa7a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:14.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.831+0000 7fa7a9ffb640 1 -- 172.21.15.52:0/1333101360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7a003f070 con 0x7fa7ac100860 2024-09-06T14:46:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.831+0000 7fa7a9ffb640 1 -- 172.21.15.52:0/1333101360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7a00049d0 con 0x7fa7ac100860 2024-09-06T14:46:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.831+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac19ca40 con 0x7fa7ac100860 2024-09-06T14:46:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.831+0000 7fa7a9ffb640 1 -- 172.21.15.52:0/1333101360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7a0035030 con 0x7fa7ac100860 2024-09-06T14:46:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.831+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac19ceb0 con 0x7fa7ac100860 2024-09-06T14:46:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.833+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac100c60 con 0x7fa7ac100860 2024-09-06T14:46:14.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.833+0000 7fa7a9ffb640 1 -- 172.21.15.52:0/1333101360 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 31) ==== 99907+0+0 (secure 0 0 0) 0x7fa7a0042070 con 0x7fa7ac100860 2024-09-06T14:46:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.833+0000 7fa7a9ffb640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa79c0774b0 0x7fa79c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.833+0000 7fa7a9ffb640 1 -- 172.21.15.52:0/1333101360 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fa7a00ba0c0 con 0x7fa7ac100860 2024-09-06T14:46:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.833+0000 7fa7abfff640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa79c0774b0 0x7fa79c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:14.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.834+0000 7fa7abfff640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa79c0774b0 0x7fa79c079970 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac06a550 tx=0x7fa798005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:14.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:14.839+0000 7fa7a9ffb640 1 -- 172.21.15.52:0/1333101360 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fa7a0087350 con 0x7fa7ac100860 2024-09-06T14:46:14.966 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:46:14.966 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:46:14.966 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:46:14.966 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:14.966 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: pgmap v14: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 496 op/s 2024-09-06T14:46:14.967 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: Reconfiguring prometheus.smithi052 (dependencies changed)... 2024-09-06T14:46:14.967 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:14.967 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: Reconfiguring daemon prometheus.smithi052 on smithi052 2024-09-06T14:46:14.967 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:14 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3945463926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:15.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.103+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa7ac106010 con 0x7fa79c0774b0 2024-09-06T14:46:15.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.108+0000 7fa7a9ffb640 1 -- 172.21.15.52:0/1333101360 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fa7ac106010 con 0x7fa79c0774b0 2024-09-06T14:46:15.107 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:46:15.107 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:46:15.107 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:46:15.108 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:46:15.108 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:46:15.108 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr" 2024-09-06T14:46:15.108 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:46:15.108 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "2/2 daemons upgraded", 2024-09-06T14:46:15.108 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-06T14:46:15.109 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:46:15.109 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:46:15.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa79c0774b0 msgr2=0x7fa79c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:15.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa79c0774b0 0x7fa79c079970 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac06a550 tx=0x7fa798005f90 comp rx=0 tx=0).stop 2024-09-06T14:46:15.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 msgr2=0x7fa7ac06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:15.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac06a7d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0006010 tx=0x7fa7a00045e0 comp rx=0 tx=0).stop 2024-09-06T14:46:15.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 shutdown_connections 2024-09-06T14:46:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa79c0774b0 0x7fa79c079970 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7ac101a60 0x7fa7ac19c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 --2- 172.21.15.52:0/1333101360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ac100860 0x7fa7ac06a7d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 >> 172.21.15.52:0/1333101360 conn(0x7fa7ac0fc010 msgr2=0x7fa7ac0fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:15.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 shutdown_connections 2024-09-06T14:46:15.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:15.112+0000 7fa7b3064640 1 -- 172.21.15.52:0/1333101360 wait complete. 2024-09-06T14:46:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-06T14:46:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: Updating smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:46:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: Updating smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/config/ceph.client.admin.keyring 2024-09-06T14:46:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: from='client.24477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: pgmap v14: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 496 op/s 2024-09-06T14:46:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: Reconfiguring prometheus.smithi052 (dependencies changed)... 2024-09-06T14:46:15.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:15.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: Reconfiguring daemon prometheus.smithi052 on smithi052 2024-09-06T14:46:15.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:14 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3945463926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:15.495 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-06T14:46:15.495 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-06T14:46:15.781 DEBUG:teuthology.parallel:result is None 2024-09-06T14:46:16.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:15 smithi165 ceph-mon[36229]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:15 smithi052 ceph-mon[28627]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:17.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:16 smithi052 ceph-mon[28627]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:17.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:16 smithi052 ceph-mon[28627]: pgmap v15: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 371 op/s 2024-09-06T14:46:17.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:16 smithi165 ceph-mon[36229]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:17.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:16 smithi165 ceph-mon[36229]: pgmap v15: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 371 op/s 2024-09-06T14:46:19.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:18 smithi052 ceph-mon[28627]: pgmap v16: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 371 op/s 2024-09-06T14:46:19.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:18 smithi165 ceph-mon[36229]: pgmap v16: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 371 op/s 2024-09-06T14:46:21.020 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:20 smithi052 ceph-mon[28627]: pgmap v17: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 478 op/s 2024-09-06T14:46:21.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:20 smithi165 ceph-mon[36229]: pgmap v17: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 478 op/s 2024-09-06T14:46:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:22 smithi052 ceph-mon[28627]: pgmap v18: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-09-06T14:46:23.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:22 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:22 smithi165 ceph-mon[36229]: pgmap v18: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-09-06T14:46:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:22 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:25.172 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:24 smithi165 ceph-mon[36229]: pgmap v19: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 292 op/s 2024-09-06T14:46:25.173 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:25.173 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:25.173 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:46:25.173 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:25.265 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:24 smithi052 ceph-mon[28627]: pgmap v19: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 292 op/s 2024-09-06T14:46:25.265 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:25.265 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:25.265 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:46:25.265 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:26.167 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:25 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:46:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:25 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:46:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:26 smithi165 ceph-mon[36229]: pgmap v20: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 165 op/s 2024-09-06T14:46:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:26 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:46:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:26 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:46:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:26 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:46:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:26 smithi052 ceph-mon[28627]: pgmap v20: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 165 op/s 2024-09-06T14:46:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:26 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi165.hcexoi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-06T14:46:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:26 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-06T14:46:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:26 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:46:28.208 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:27 smithi165 ceph-mon[36229]: Upgrade: Updating mgr.smithi165.hcexoi 2024-09-06T14:46:28.208 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:27 smithi165 ceph-mon[36229]: Deploying daemon mgr.smithi165.hcexoi on smithi165 2024-09-06T14:46:28.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:27 smithi052 ceph-mon[28627]: Upgrade: Updating mgr.smithi165.hcexoi 2024-09-06T14:46:28.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:27 smithi052 ceph-mon[28627]: Deploying daemon mgr.smithi165.hcexoi on smithi165 2024-09-06T14:46:29.040 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:28 smithi165 ceph-mon[36229]: pgmap v21: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 165 op/s 2024-09-06T14:46:29.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:28 smithi052 ceph-mon[28627]: pgmap v21: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 165 op/s 2024-09-06T14:46:30.546 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-06T14:46:30.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-06T14:46:30.879 DEBUG:teuthology.parallel:result is None 2024-09-06T14:46:30.879 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-06T14:46:30.912 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-06T14:46:30.912 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-06T14:46:30.948 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-06T14:46:30.949 DEBUG:teuthology.parallel:result is None 2024-09-06T14:46:31.191 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:30 smithi165 ceph-mon[36229]: pgmap v22: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-09-06T14:46:31.191 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:30 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:31.191 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:30 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:31.191 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:30 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:31.191 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:30 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:31.191 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:30 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:31.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:30 smithi052 ceph-mon[28627]: pgmap v22: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-09-06T14:46:31.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:30 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:31.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:30 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:31.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:30 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:31.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:30 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:31.196 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:30 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:33.275 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:32 smithi052 ceph-mon[28627]: pgmap v23: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1020 KiB/s rd, 1.0 MiB/s wr, 131 op/s 2024-09-06T14:46:33.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:32 smithi165 ceph-mon[36229]: pgmap v23: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1020 KiB/s rd, 1.0 MiB/s wr, 131 op/s 2024-09-06T14:46:34.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:34 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:34.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:34 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:34.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:34 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:34.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:34 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:34.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:34 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:34.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:34 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:34.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:34 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:34.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:34 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:35.314 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:35 smithi165 ceph-mon[36229]: pgmap v24: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-09-06T14:46:35.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:35 smithi052 ceph-mon[28627]: pgmap v24: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-09-06T14:46:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:36 smithi165 ceph-mon[36229]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:46:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:36 smithi165 ceph-mon[36229]: Standby manager daemon smithi165.hcexoi restarted 2024-09-06T14:46:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:36 smithi165 ceph-mon[36229]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:46:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:36 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:46:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:36 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:46:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:36 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:46:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:36 smithi165 ceph-mon[36229]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:46:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:36 smithi052 ceph-mon[28627]: Failed to load ceph-mgr modules: volumes 2024-09-06T14:46:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:36 smithi052 ceph-mon[28627]: Standby manager daemon smithi165.hcexoi restarted 2024-09-06T14:46:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:36 smithi052 ceph-mon[28627]: Standby manager daemon smithi165.hcexoi started 2024-09-06T14:46:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:36 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/crt"}]: dispatch 2024-09-06T14:46:36.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:36 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-06T14:46:36.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:36 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi165.hcexoi/key"}]: dispatch 2024-09-06T14:46:36.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:36 smithi052 ceph-mon[28627]: from='mgr.? 172.21.15.165:0/3411989014' entity='mgr.smithi165.hcexoi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-06T14:46:37.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:37 smithi165 ceph-mon[36229]: pgmap v25: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 834 KiB/s rd, 839 KiB/s wr, 144 op/s 2024-09-06T14:46:37.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:37 smithi165 ceph-mon[36229]: mgrmap e32: smithi052.vsthpq(active, since 44s), standbys: smithi165.hcexoi 2024-09-06T14:46:37.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:37 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:37.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:37 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:37.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:37 smithi052 ceph-mon[28627]: pgmap v25: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 834 KiB/s rd, 839 KiB/s wr, 144 op/s 2024-09-06T14:46:37.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:37 smithi052 ceph-mon[28627]: mgrmap e32: smithi052.vsthpq(active, since 44s), standbys: smithi165.hcexoi 2024-09-06T14:46:37.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:37 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:37.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:37 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all mgr 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.vsthpq"}]: dispatch 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.vsthpq"}]': finished 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.hcexoi"}]: dispatch 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.hcexoi"}]': finished 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all rgw 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all rbd-mirror 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-06T14:46:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all iscsi 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all nfs 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all nvmeof 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: pgmap v26: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 834 KiB/s rd, 839 KiB/s wr, 144 op/s 2024-09-06T14:46:38.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all mgr 2024-09-06T14:46:38.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.vsthpq"}]: dispatch 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi052.vsthpq"}]': finished 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.hcexoi"}]: dispatch 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi165.hcexoi"}]': finished 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all rgw 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all rbd-mirror 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all iscsi 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all nfs 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all nvmeof 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:38.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: pgmap v26: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 834 KiB/s rd, 839 KiB/s wr, 144 op/s 2024-09-06T14:46:38.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:39 smithi165 ceph-mon[36229]: Upgrade: Updating node-exporter.smithi052 (1/2) 2024-09-06T14:46:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:39 smithi165 ceph-mon[36229]: Deploying daemon node-exporter.smithi052 on smithi052 2024-09-06T14:46:39.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:39 smithi052 ceph-mon[28627]: Upgrade: Updating node-exporter.smithi052 (1/2) 2024-09-06T14:46:39.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:39 smithi052 ceph-mon[28627]: Deploying daemon node-exporter.smithi052 on smithi052 2024-09-06T14:46:40.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:40 smithi165 ceph-mon[36229]: pgmap v27: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 848 KiB/s rd, 852 KiB/s wr, 148 op/s 2024-09-06T14:46:40.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:40 smithi052 ceph-mon[28627]: pgmap v27: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 848 KiB/s rd, 852 KiB/s wr, 148 op/s 2024-09-06T14:46:42.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:42 smithi052 ceph-mon[28627]: pgmap v28: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 443 KiB/s rd, 356 KiB/s wr, 74 op/s 2024-09-06T14:46:43.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:42 smithi165 ceph-mon[36229]: pgmap v28: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 443 KiB/s rd, 356 KiB/s wr, 74 op/s 2024-09-06T14:46:45.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/3705395088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f581001e0 msgr2=0x7f1f581025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/3705395088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f581001e0 0x7f1f581025f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009c20 tx=0x7f1f4802a970 comp rx=0 tx=0).stop 2024-09-06T14:46:45.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/3705395088 shutdown_connections 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/3705395088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f58102b30 0x7f1f58104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/3705395088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f581001e0 0x7f1f581025f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/3705395088 >> 172.21.15.52:0/3705395088 conn(0x7f1f580fc010 msgr2=0x7f1f580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/3705395088 shutdown_connections 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/3705395088 wait complete. 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.216+0000 7f1f5fc3c640 1 Processor -- start 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5fc3c640 1 -- start start 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5fc3c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f581001e0 0x7f1f5819da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5fc3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f58102b30 0x7f1f5819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5fc3c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58110d70 con 0x7f1f58102b30 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5fc3c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58110bf0 con 0x7f1f581001e0 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d1d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f58102b30 0x7f1f5819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d1d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f58102b30 0x7f1f5819dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47592/0 (socket says 172.21.15.52:47592) 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d1d7640 1 -- 172.21.15.52:0/2134714000 learned_addr learned my addr 172.21.15.52:0/2134714000 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d9d8640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f581001e0 0x7f1f5819da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d1d7640 1 -- 172.21.15.52:0/2134714000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f581001e0 msgr2=0x7f1f5819da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d1d7640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f581001e0 0x7f1f5819da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d1d7640 1 -- 172.21.15.52:0/2134714000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5819e5c0 con 0x7f1f58102b30 2024-09-06T14:46:45.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.217+0000 7f1f5d1d7640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f58102b30 0x7f1f5819dfd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c8a0 tx=0x7f1f4c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:45.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.218+0000 7f1f56ffd640 1 -- 172.21.15.52:0/2134714000 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f4c0079b0 con 0x7f1f58102b30 2024-09-06T14:46:45.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.218+0000 7f1f56ffd640 1 -- 172.21.15.52:0/2134714000 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f4c007b50 con 0x7f1f58102b30 2024-09-06T14:46:45.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.218+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f581a3030 con 0x7f1f58102b30 2024-09-06T14:46:45.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.218+0000 7f1f56ffd640 1 -- 172.21.15.52:0/2134714000 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f4c018700 con 0x7f1f58102b30 2024-09-06T14:46:45.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.218+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581a3610 con 0x7f1f58102b30 2024-09-06T14:46:45.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.219+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f581005e0 con 0x7f1f58102b30 2024-09-06T14:46:45.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.220+0000 7f1f56ffd640 1 -- 172.21.15.52:0/2134714000 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1f4c007d00 con 0x7f1f58102b30 2024-09-06T14:46:45.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.220+0000 7f1f56ffd640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f400774b0 0x7f1f40079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.220+0000 7f1f56ffd640 1 -- 172.21.15.52:0/2134714000 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f1f4c099710 con 0x7f1f58102b30 2024-09-06T14:46:45.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.220+0000 7f1f5d9d8640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f400774b0 0x7f1f40079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.221+0000 7f1f5d9d8640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f400774b0 0x7f1f40079970 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1f48000f80 tx=0x7f1f4803c040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:45.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.225+0000 7f1f56ffd640 1 -- 172.21.15.52:0/2134714000 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f1f4c014030 con 0x7f1f58102b30 2024-09-06T14:46:45.315 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:44 smithi165 ceph-mon[36229]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 444 KiB/s rd, 356 KiB/s wr, 77 op/s 2024-09-06T14:46:45.315 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:44 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:45.315 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:44 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:45.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:44 smithi052 ceph-mon[28627]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 444 KiB/s rd, 356 KiB/s wr, 77 op/s 2024-09-06T14:46:45.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:44 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:45.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:44 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:45.400 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.402+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1f58103510 con 0x7f1f400774b0 2024-09-06T14:46:45.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.403+0000 7f1f56ffd640 1 -- 172.21.15.52:0/2134714000 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f1f58103510 con 0x7f1f400774b0 2024-09-06T14:46:45.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f400774b0 msgr2=0x7f1f40079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f400774b0 0x7f1f40079970 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1f48000f80 tx=0x7f1f4803c040 comp rx=0 tx=0).stop 2024-09-06T14:46:45.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f58102b30 msgr2=0x7f1f5819dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f58102b30 0x7f1f5819dfd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00c8a0 tx=0x7f1f4c00cd60 comp rx=0 tx=0).stop 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 shutdown_connections 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f58102b30 0x7f1f5819dfd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f400774b0 0x7f1f40079970 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 --2- 172.21.15.52:0/2134714000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f581001e0 0x7f1f5819da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 >> 172.21.15.52:0/2134714000 conn(0x7f1f580fc010 msgr2=0x7f1f580fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 shutdown_connections 2024-09-06T14:46:45.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.405+0000 7f1f5fc3c640 1 -- 172.21.15.52:0/2134714000 wait complete. 2024-09-06T14:46:45.411 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:46:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 -- 172.21.15.52:0/2354508443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 msgr2=0x7f5ce41021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/2354508443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce41021f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009c20 tx=0x7f5ce002a970 comp rx=0 tx=0).stop 2024-09-06T14:46:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 -- 172.21.15.52:0/2354508443 shutdown_connections 2024-09-06T14:46:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/2354508443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ce4100b30 0x7f5ce4100fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/2354508443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce41021f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 -- 172.21.15.52:0/2354508443 >> 172.21.15.52:0/2354508443 conn(0x7f5ce40fb770 msgr2=0x7f5ce40fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:45.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 -- 172.21.15.52:0/2354508443 shutdown_connections 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.488+0000 7f5cec5dc640 1 -- 172.21.15.52:0/2354508443 wait complete. 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5cec5dc640 1 Processor -- start 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5cec5dc640 1 -- start start 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5cec5dc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ce4100b30 0x7f5ce4197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5cec5dc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce4197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5cec5dc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4109680 con 0x7f5ce4101df0 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5cec5dc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4109500 con 0x7f5ce4100b30 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5ce9b77640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce4197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5ce9b77640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce4197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47610/0 (socket says 172.21.15.52:47610) 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5ce9b77640 1 -- 172.21.15.52:0/847619903 learned_addr learned my addr 172.21.15.52:0/847619903 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:45.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.489+0000 7f5cea378640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ce4100b30 0x7f5ce4197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5ce9b77640 1 -- 172.21.15.52:0/847619903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ce4100b30 msgr2=0x7f5ce4197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5ce9b77640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ce4100b30 0x7f5ce4197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5ce9b77640 1 -- 172.21.15.52:0/847619903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce4198110 con 0x7f5ce4101df0 2024-09-06T14:46:45.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5ce9b77640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce4197a90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400d8d0 tx=0x7f5cd400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:45.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5cdb7fe640 1 -- 172.21.15.52:0/847619903 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cd4017070 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5cdb7fe640 1 -- 172.21.15.52:0/847619903 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5cd4010460 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce419cb50 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5cdb7fe640 1 -- 172.21.15.52:0/847619903 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5cd400f5f0 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.490+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce419d160 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.491+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce4100fb0 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.492+0000 7f5cdb7fe640 1 -- 172.21.15.52:0/847619903 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5cd4009a30 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.492+0000 7f5cdb7fe640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5cd0077460 0x7f5cd0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.492+0000 7f5cdb7fe640 1 -- 172.21.15.52:0/847619903 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f5cd4099410 con 0x7f5ce4101df0 2024-09-06T14:46:45.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.492+0000 7f5cea378640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5cd0077460 0x7f5cd0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.493+0000 7f5cea378640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5cd0077460 0x7f5cd0079920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0000f80 tx=0x7f5ce003c040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:45.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.497+0000 7f5cdb7fe640 1 -- 172.21.15.52:0/847619903 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f5cd40666b0 con 0x7f5ce4101df0 2024-09-06T14:46:45.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.674+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ce41001e0 con 0x7f5cd0077460 2024-09-06T14:46:45.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.675+0000 7f5cdb7fe640 1 -- 172.21.15.52:0/847619903 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f5ce41001e0 con 0x7f5cd0077460 2024-09-06T14:46:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5cd0077460 msgr2=0x7f5cd0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5cd0077460 0x7f5cd0079920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0000f80 tx=0x7f5ce003c040 comp rx=0 tx=0).stop 2024-09-06T14:46:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 msgr2=0x7f5ce4197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce4197a90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400d8d0 tx=0x7f5cd400dd90 comp rx=0 tx=0).stop 2024-09-06T14:46:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 shutdown_connections 2024-09-06T14:46:45.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5ce4101df0 0x7f5ce4197a90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5cd0077460 0x7f5cd0079920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 --2- 172.21.15.52:0/847619903 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5ce4100b30 0x7f5ce4197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 >> 172.21.15.52:0/847619903 conn(0x7f5ce40fb770 msgr2=0x7f5ce40ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 shutdown_connections 2024-09-06T14:46:45.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.677+0000 7f5cec5dc640 1 -- 172.21.15.52:0/847619903 wait complete. 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 -- 172.21.15.52:0/2245191896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 msgr2=0x7f1eb41047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2245191896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41047e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40098b0 tx=0x7f1ea402a4d0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 -- 172.21.15.52:0/2245191896 shutdown_connections 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2245191896 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eb4104d20 0x7f1eb4107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2245191896 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41047e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 -- 172.21.15.52:0/2245191896 >> 172.21.15.52:0/2245191896 conn(0x7f1eb40fc010 msgr2=0x7f1eb40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 -- 172.21.15.52:0/2245191896 shutdown_connections 2024-09-06T14:46:45.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.760+0000 7f1eba99f640 1 -- 172.21.15.52:0/2245191896 wait complete. 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.761+0000 7f1eba99f640 1 Processor -- start 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.761+0000 7f1eba99f640 1 -- start start 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.761+0000 7f1eba99f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.761+0000 7f1eba99f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eb4104d20 0x7f1eb4197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eba99f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb410a7c0 con 0x7f1eb41023f0 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eba99f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb410a640 con 0x7f1eb4104d20 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47618/0 (socket says 172.21.15.52:47618) 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb3fff640 1 -- 172.21.15.52:0/2981315103 learned_addr learned my addr 172.21.15.52:0/2981315103 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb37fe640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eb4104d20 0x7f1eb4197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb3fff640 1 -- 172.21.15.52:0/2981315103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eb4104d20 msgr2=0x7f1eb4197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb3fff640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eb4104d20 0x7f1eb4197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb3fff640 1 -- 172.21.15.52:0/2981315103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb41980a0 con 0x7f1eb41023f0 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb3fff640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41974e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40099d0 tx=0x7f1ea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb17fa640 1 -- 172.21.15.52:0/2981315103 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea403f070 con 0x7f1eb41023f0 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb419ca80 con 0x7f1eb41023f0 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb17fa640 1 -- 172.21.15.52:0/2981315103 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ea4004a40 con 0x7f1eb41023f0 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eb17fa640 1 -- 172.21.15.52:0/2981315103 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ea4035030 con 0x7f1eb41023f0 2024-09-06T14:46:45.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.762+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb419d010 con 0x7f1eb41023f0 2024-09-06T14:46:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.764+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb41027d0 con 0x7f1eb41023f0 2024-09-06T14:46:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.764+0000 7f1eb17fa640 1 -- 172.21.15.52:0/2981315103 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1ea4042070 con 0x7f1eb41023f0 2024-09-06T14:46:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.764+0000 7f1eb17fa640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e9c0774b0 0x7f1e9c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:45.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.765+0000 7f1eb17fa640 1 -- 172.21.15.52:0/2981315103 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f1ea40ba0c0 con 0x7f1eb41023f0 2024-09-06T14:46:45.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.765+0000 7f1eb37fe640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e9c0774b0 0x7f1e9c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:45.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.765+0000 7f1eb37fe640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e9c0774b0 0x7f1e9c079970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4198990 tx=0x7f1ea800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:45.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.769+0000 7f1eb17fa640 1 -- 172.21.15.52:0/2981315103 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f1ea40873e0 con 0x7f1eb41023f0 2024-09-06T14:46:45.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.939+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1eb4105680 con 0x7f1e9c0774b0 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.949+0000 7f1eb17fa640 1 -- 172.21.15.52:0/2981315103 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f1eb4105680 con 0x7f1e9c0774b0 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (8m) 8s ago 10m 24.5M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (117s) 8s ago 10m 8539k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (87s) 12s ago 9m 8493k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (10m) 8s ago 10m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (9m) 12s ago 9m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:46:45.947 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (8m) 8s ago 9m 82.2M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (4m) 8s ago 4m 121M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (4m) 8s ago 4m 154M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (4m) 12s ago 4m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (4m) 12s ago 4m 26.4M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (81s) 8s ago 11m 500M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (16s) 12s ago 9m 69.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (11m) 8s ago 11m 57.5M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (9m) 12s ago 9m 43.8M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 starting - - - - 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (9m) 12s ago 9m 15.0M - 1.5.0 0da6a335fe13 b457c6963621 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (8m) 8s ago 8m 195M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (7m) 8s ago 7m 218M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:46:45.948 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (7m) 8s ago 7m 181M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:46:45.949 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (6m) 12s ago 6m 233M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:46:45.949 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (6m) 12s ago 6m 208M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:46:45.949 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (5m) 12s ago 5m 183M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:46:45.949 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (21s) 8s ago 9m 42.1M - 2.43.0 a07b618ecd1d da83e012d18a 2024-09-06T14:46:45.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.951+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e9c0774b0 msgr2=0x7f1e9c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.951+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e9c0774b0 0x7f1e9c079970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4198990 tx=0x7f1ea800b390 comp rx=0 tx=0).stop 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.951+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 msgr2=0x7f1eb41974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.951+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41974e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40099d0 tx=0x7f1ea40046c0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.952+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 shutdown_connections 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.952+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e9c0774b0 0x7f1e9c079970 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.952+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1eb4104d20 0x7f1eb4197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.952+0000 7f1eba99f640 1 --2- 172.21.15.52:0/2981315103 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1eb41023f0 0x7f1eb41974e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.952+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 >> 172.21.15.52:0/2981315103 conn(0x7f1eb40fc010 msgr2=0x7f1eb40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.952+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 shutdown_connections 2024-09-06T14:46:45.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:45.952+0000 7f1eba99f640 1 -- 172.21.15.52:0/2981315103 wait complete. 2024-09-06T14:46:46.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 -- 172.21.15.52:0/2836690906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090100860 msgr2=0x7fa090100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 --2- 172.21.15.52:0/2836690906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090100860 0x7fa090100c60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa080009c20 tx=0x7fa08002a970 comp rx=0 tx=0).stop 2024-09-06T14:46:46.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 -- 172.21.15.52:0/2836690906 shutdown_connections 2024-09-06T14:46:46.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 --2- 172.21.15.52:0/2836690906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa090101a60 0x7fa090101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 --2- 172.21.15.52:0/2836690906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090100860 0x7fa090100c60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 -- 172.21.15.52:0/2836690906 >> 172.21.15.52:0/2836690906 conn(0x7fa0900fc010 msgr2=0x7fa0900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:46.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 -- 172.21.15.52:0/2836690906 shutdown_connections 2024-09-06T14:46:46.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 -- 172.21.15.52:0/2836690906 wait complete. 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.034+0000 7fa094cc0640 1 Processor -- start 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa094cc0640 1 -- start start 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa094cc0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa090100860 0x7fa090104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa094cc0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090101a60 0x7fa090102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa094cc0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa090109680 con 0x7fa090101a60 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa094cc0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa090109500 con 0x7fa090100860 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090101a60 0x7fa090102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090101a60 0x7fa090102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47622/0 (socket says 172.21.15.52:47622) 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08dd9b640 1 -- 172.21.15.52:0/1421142147 learned_addr learned my addr 172.21.15.52:0/1421142147 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:46.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08e59c640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa090100860 0x7fa090104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08dd9b640 1 -- 172.21.15.52:0/1421142147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa090100860 msgr2=0x7fa090104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08dd9b640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa090100860 0x7fa090104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08dd9b640 1 -- 172.21.15.52:0/1421142147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa090103380 con 0x7fa090101a60 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.035+0000 7fa08dd9b640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090101a60 0x7fa090102e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa07800d8d0 tx=0x7fa07800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.036+0000 7fa0877fe640 1 -- 172.21.15.52:0/1421142147 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa078017070 con 0x7fa090101a60 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.036+0000 7fa0877fe640 1 -- 172.21.15.52:0/1421142147 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa078010460 con 0x7fa090101a60 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.036+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa090103670 con 0x7fa090101a60 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.036+0000 7fa0877fe640 1 -- 172.21.15.52:0/1421142147 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa07800f5f0 con 0x7fa090101a60 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.036+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa090103c80 con 0x7fa090101a60 2024-09-06T14:46:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.037+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa090100c60 con 0x7fa090101a60 2024-09-06T14:46:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.037+0000 7fa0877fe640 1 -- 172.21.15.52:0/1421142147 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa078009a30 con 0x7fa090101a60 2024-09-06T14:46:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.038+0000 7fa0877fe640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa07c077460 0x7fa07c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.038+0000 7fa0877fe640 1 -- 172.21.15.52:0/1421142147 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fa078099410 con 0x7fa090101a60 2024-09-06T14:46:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.038+0000 7fa08e59c640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa07c077460 0x7fa07c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:46.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.039+0000 7fa08e59c640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa07c077460 0x7fa07c079920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa080000f80 tx=0x7fa08003c040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:46.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.042+0000 7fa0877fe640 1 -- 172.21.15.52:0/1421142147 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fa0780666b0 con 0x7fa090101a60 2024-09-06T14:46:46.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.261+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa09019f640 con 0x7fa090101a60 2024-09-06T14:46:46.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.262+0000 7fa0877fe640 1 -- 172.21.15.52:0/1421142147 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fa07806b0d0 con 0x7fa090101a60 2024-09-06T14:46:46.259 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:46:46.259 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:46:46.259 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:46:46.259 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:46.259 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:46:46.259 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 12, 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:46:46.260 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:46:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.263+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa07c077460 msgr2=0x7fa07c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.263+0000 7fa094cc0640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa07c077460 0x7fa07c079920 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa080000f80 tx=0x7fa08003c040 comp rx=0 tx=0).stop 2024-09-06T14:46:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.263+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090101a60 msgr2=0x7fa090102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.263+0000 7fa094cc0640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090101a60 0x7fa090102e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa07800d8d0 tx=0x7fa07800dd90 comp rx=0 tx=0).stop 2024-09-06T14:46:46.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.264+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 shutdown_connections 2024-09-06T14:46:46.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.264+0000 7fa094cc0640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa090101a60 0x7fa090102e40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.264+0000 7fa094cc0640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa07c077460 0x7fa07c079920 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.264+0000 7fa094cc0640 1 --2- 172.21.15.52:0/1421142147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa090100860 0x7fa090104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.264+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 >> 172.21.15.52:0/1421142147 conn(0x7fa0900fc010 msgr2=0x7fa090069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:46.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.264+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 shutdown_connections 2024-09-06T14:46:46.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.264+0000 7fa094cc0640 1 -- 172.21.15.52:0/1421142147 wait complete. 2024-09-06T14:46:46.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.347+0000 7f26cfc51640 1 -- 172.21.15.52:0/1888838657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 msgr2=0x7f26c8104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.347+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1888838657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8104880 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f26c4009880 tx=0x7f26c402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.347+0000 7f26cfc51640 1 -- 172.21.15.52:0/1888838657 shutdown_connections 2024-09-06T14:46:46.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.347+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1888838657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c8104dc0 0x7f26c81071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.347+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1888838657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8104880 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.347+0000 7f26cfc51640 1 -- 172.21.15.52:0/1888838657 >> 172.21.15.52:0/1888838657 conn(0x7f26c80fc010 msgr2=0x7f26c80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 -- 172.21.15.52:0/1888838657 shutdown_connections 2024-09-06T14:46:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 -- 172.21.15.52:0/1888838657 wait complete. 2024-09-06T14:46:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 Processor -- start 2024-09-06T14:46:46.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 -- start start 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c8104dc0 0x7f26c8197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26c810a7b0 con 0x7f26c8102490 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.348+0000 7f26cfc51640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26c810a630 con 0x7f26c8104dc0 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd9ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd9ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47642/0 (socket says 172.21.15.52:47642) 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd9ed640 1 -- 172.21.15.52:0/1471585313 learned_addr learned my addr 172.21.15.52:0/1471585313 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd1ec640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c8104dc0 0x7f26c8197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd9ed640 1 -- 172.21.15.52:0/1471585313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c8104dc0 msgr2=0x7f26c8197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd9ed640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c8104dc0 0x7f26c8197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd9ed640 1 -- 172.21.15.52:0/1471585313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c81980d0 con 0x7f26c8102490 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cd9ed640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8197510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f26c4006010 tx=0x7f26c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26beffd640 1 -- 172.21.15.52:0/1471585313 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26c403f070 con 0x7f26c8102490 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c819cab0 con 0x7f26c8102490 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26beffd640 1 -- 172.21.15.52:0/1471585313 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26c4004ac0 con 0x7f26c8102490 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26beffd640 1 -- 172.21.15.52:0/1471585313 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26c4035030 con 0x7f26c8102490 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.349+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c819d040 con 0x7f26c8102490 2024-09-06T14:46:46.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.350+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c8102870 con 0x7f26c8102490 2024-09-06T14:46:46.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.351+0000 7f26beffd640 1 -- 172.21.15.52:0/1471585313 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f26c4042070 con 0x7f26c8102490 2024-09-06T14:46:46.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.352+0000 7f26beffd640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26b40774b0 0x7f26b4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:46:46.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.352+0000 7f26beffd640 1 -- 172.21.15.52:0/1471585313 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f26c40ba130 con 0x7f26c8102490 2024-09-06T14:46:46.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.352+0000 7f26cd1ec640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26b40774b0 0x7f26b4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:46:46.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.352+0000 7f26cd1ec640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26b40774b0 0x7f26b4079970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f26b8005fd0 tx=0x7f26b8005c70 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:46:46.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.356+0000 7f26beffd640 1 -- 172.21.15.52:0/1471585313 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f26c40832e0 con 0x7f26c8102490 2024-09-06T14:46:46.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.533+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f26c8105860 con 0x7f26b40774b0 2024-09-06T14:46:46.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.534+0000 7f26beffd640 1 -- 172.21.15.52:0/1471585313 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f26c8105860 con 0x7f26b40774b0 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr" 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "2/2 daemons upgraded", 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:46:46.532 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26b40774b0 msgr2=0x7f26b4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26b40774b0 0x7f26b4079970 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f26b8005fd0 tx=0x7f26b8005c70 comp rx=0 tx=0).stop 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 msgr2=0x7f26c8197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8197510 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f26c4006010 tx=0x7f26c40046c0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 shutdown_connections 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26b40774b0 0x7f26b4079970 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26c8104dc0 0x7f26c8197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 --2- 172.21.15.52:0/1471585313 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26c8102490 0x7f26c8197510 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 >> 172.21.15.52:0/1471585313 conn(0x7f26c80fc010 msgr2=0x7f26c80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 shutdown_connections 2024-09-06T14:46:46.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:46:46.536+0000 7f26cfc51640 1 -- 172.21.15.52:0/1471585313 wait complete. 2024-09-06T14:46:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:46 smithi165 ceph-mon[36229]: Upgrade: Updating node-exporter.smithi165 (2/2) 2024-09-06T14:46:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:46 smithi165 ceph-mon[36229]: Deploying daemon node-exporter.smithi165 on smithi165 2024-09-06T14:46:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:46 smithi165 ceph-mon[36229]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:46 smithi165 ceph-mon[36229]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-09-06T14:46:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:46 smithi165 ceph-mon[36229]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:46 smithi165 ceph-mon[36229]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:47.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:46 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1421142147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:46 smithi052 ceph-mon[28627]: Upgrade: Updating node-exporter.smithi165 (2/2) 2024-09-06T14:46:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:46 smithi052 ceph-mon[28627]: Deploying daemon node-exporter.smithi165 on smithi165 2024-09-06T14:46:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:46 smithi052 ceph-mon[28627]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:46 smithi052 ceph-mon[28627]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-09-06T14:46:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:46 smithi052 ceph-mon[28627]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:47.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:46 smithi052 ceph-mon[28627]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:47.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:46 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1421142147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:46:48.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:47 smithi052 ceph-mon[28627]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:48.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:47 smithi165 ceph-mon[36229]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:46:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:48 smithi165 ceph-mon[36229]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-09-06T14:46:49.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:48 smithi052 ceph-mon[28627]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-09-06T14:46:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:50 smithi052 ceph-mon[28627]: pgmap v32: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-06T14:46:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:50 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:50 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:50 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:50 smithi165 ceph-mon[36229]: pgmap v32: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-09-06T14:46:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:50 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:50 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:50 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:46:53.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:52 smithi165 ceph-mon[36229]: pgmap v33: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:46:53.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:52 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:53.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:52 smithi052 ceph-mon[28627]: pgmap v33: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:46:53.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:52 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:46:54.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:54 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:54.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:54 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:54.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:54 smithi052 ceph-mon[28627]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:46:54.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:54 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:54.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:54 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:54.689 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:54 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:54.689 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:54 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:54.689 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:54 smithi165 ceph-mon[36229]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:46:54.689 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:54 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:54.689 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:54 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.782 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:56 smithi165 ceph-mon[36229]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:46:56.782 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:56 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.783 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:56 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.783 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:56 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.783 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:56 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.869 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:56 smithi052 ceph-mon[28627]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:46:56.869 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:56 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.869 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:56 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.869 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:56 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:56.869 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:56 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:58.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:58 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:58.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:58 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:58.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:46:58 smithi052 ceph-mon[28627]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:46:58.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:58 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:58.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:58 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:46:58.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:46:58 smithi165 ceph-mon[36229]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:00.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:00 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:00.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:00.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:47:00.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:47:00.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:00.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:00 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:02.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:02 smithi052 ceph-mon[28627]: Upgrade: Updating prometheus.smithi052 2024-09-06T14:47:02.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:02 smithi052 ceph-mon[28627]: Deploying daemon prometheus.smithi052 on smithi052 2024-09-06T14:47:02.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:02 smithi052 ceph-mon[28627]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:02 smithi165 ceph-mon[36229]: Upgrade: Updating prometheus.smithi052 2024-09-06T14:47:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:02 smithi165 ceph-mon[36229]: Deploying daemon prometheus.smithi052 on smithi052 2024-09-06T14:47:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:02 smithi165 ceph-mon[36229]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:04.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:04 smithi052 ceph-mon[28627]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:05.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:04 smithi165 ceph-mon[36229]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:07.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:06 smithi165 ceph-mon[36229]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:07.120 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:06 smithi052 ceph-mon[28627]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:08.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:07 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:08.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:07 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:08.931 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:08 smithi052 ceph-mon[28627]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:09.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:08 smithi165 ceph-mon[36229]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:10.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:10 smithi052 ceph-mon[28627]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:11.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:10 smithi165 ceph-mon[36229]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:12.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:12 smithi052 ceph-mon[28627]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:13.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:12 smithi165 ceph-mon[36229]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:14.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:14 smithi052 ceph-mon[28627]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:15.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:14 smithi165 ceph-mon[36229]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:16.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 -- 172.21.15.52:0/141581246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08101960 msgr2=0x7f1d08101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/141581246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08101960 0x7f1d08101d60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009880 tx=0x7f1cfc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 -- 172.21.15.52:0/141581246 shutdown_connections 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/141581246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d08102b60 0x7f1d08102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/141581246 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08101960 0x7f1d08101d60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 -- 172.21.15.52:0/141581246 >> 172.21.15.52:0/141581246 conn(0x7f1d080fd0f0 msgr2=0x7f1d080ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 -- 172.21.15.52:0/141581246 shutdown_connections 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.622+0000 7f1d0eedc640 1 -- 172.21.15.52:0/141581246 wait complete. 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d0eedc640 1 Processor -- start 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d0eedc640 1 -- start start 2024-09-06T14:47:16.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d0eedc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d08101960 0x7f1d08197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d0eedc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08102b60 0x7f1d08197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d0eedc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0810a7a0 con 0x7f1d08102b60 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d0eedc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0810a620 con 0x7f1d08101960 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d07fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08102b60 0x7f1d08197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d07fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08102b60 0x7f1d08197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35564/0 (socket says 172.21.15.52:35564) 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d07fff640 1 -- 172.21.15.52:0/2673614872 learned_addr learned my addr 172.21.15.52:0/2673614872 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.623+0000 7f1d0cc78640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d08101960 0x7f1d08197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d07fff640 1 -- 172.21.15.52:0/2673614872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d08101960 msgr2=0x7f1d08197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d07fff640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d08101960 0x7f1d08197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d07fff640 1 -- 172.21.15.52:0/2673614872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d081980c0 con 0x7f1d08102b60 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d07fff640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08102b60 0x7f1d08197a40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400e970 tx=0x7f1cf400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:16.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d05ffb640 1 -- 172.21.15.52:0/2673614872 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf400cac0 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d05ffb640 1 -- 172.21.15.52:0/2673614872 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cf40054e0 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0819cb00 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d05ffb640 1 -- 172.21.15.52:0/2673614872 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf4010430 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.624+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0819d090 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.625+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d08101d60 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.626+0000 7f1d05ffb640 1 -- 172.21.15.52:0/2673614872 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1cf4004f00 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.626+0000 7f1d05ffb640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1cf80774f0 0x7f1cf80799b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.626+0000 7f1d05ffb640 1 -- 172.21.15.52:0/2673614872 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f1cf4099c60 con 0x7f1d08102b60 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.626+0000 7f1d0cc78640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1cf80774f0 0x7f1cf80799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:16.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.627+0000 7f1d0cc78640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1cf80774f0 0x7f1cf80799b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009230 tx=0x7f1cfc0058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:16.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.630+0000 7f1d05ffb640 1 -- 172.21.15.52:0/2673614872 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f1cf4062d70 con 0x7f1d08102b60 2024-09-06T14:47:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:16 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:16 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:16 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:16 smithi165 ceph-mon[36229]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:16 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:16 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.828+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1d08062630 con 0x7f1cf80774f0 2024-09-06T14:47:16.825 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:16 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.825 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:16 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.826 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:16 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:16.826 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:16 smithi052 ceph-mon[28627]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:16.826 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:16 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.826 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:16 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.829+0000 7f1d05ffb640 1 -- 172.21.15.52:0/2673614872 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f1d08062630 con 0x7f1cf80774f0 2024-09-06T14:47:16.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1cf80774f0 msgr2=0x7f1cf80799b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:16.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1cf80774f0 0x7f1cf80799b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009230 tx=0x7f1cfc0058d0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08102b60 msgr2=0x7f1d08197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08102b60 0x7f1d08197a40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400e970 tx=0x7f1cf400ed70 comp rx=0 tx=0).stop 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 shutdown_connections 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d08102b60 0x7f1d08197a40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1cf80774f0 0x7f1cf80799b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 --2- 172.21.15.52:0/2673614872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d08101960 0x7f1d08197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 >> 172.21.15.52:0/2673614872 conn(0x7f1d080fd0f0 msgr2=0x7f1d08106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 shutdown_connections 2024-09-06T14:47:16.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.831+0000 7f1d0eedc640 1 -- 172.21.15.52:0/2673614872 wait complete. 2024-09-06T14:47:16.837 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:47:16.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.915+0000 7f50719a1640 1 -- 172.21.15.52:0/3431662816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 msgr2=0x7f506c101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:16.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.915+0000 7f50719a1640 1 --2- 172.21.15.52:0/3431662816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c101c40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5060009880 tx=0x7f506002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.915+0000 7f50719a1640 1 -- 172.21.15.52:0/3431662816 shutdown_connections 2024-09-06T14:47:16.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.915+0000 7f50719a1640 1 --2- 172.21.15.52:0/3431662816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f506c102a40 0x7f506c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.915+0000 7f50719a1640 1 --2- 172.21.15.52:0/3431662816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c101c40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.915+0000 7f50719a1640 1 -- 172.21.15.52:0/3431662816 >> 172.21.15.52:0/3431662816 conn(0x7f506c0fcfd0 msgr2=0x7f506c0ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.916+0000 7f50719a1640 1 -- 172.21.15.52:0/3431662816 shutdown_connections 2024-09-06T14:47:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.916+0000 7f50719a1640 1 -- 172.21.15.52:0/3431662816 wait complete. 2024-09-06T14:47:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.916+0000 7f50719a1640 1 Processor -- start 2024-09-06T14:47:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.916+0000 7f50719a1640 1 -- start start 2024-09-06T14:47:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.916+0000 7f50719a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f50719a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f506c102a40 0x7f506c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f50719a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10a680 con 0x7f506c101840 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f50719a1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f506c10a500 con 0x7f506c102a40 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f507099f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f507099f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35592/0 (socket says 172.21.15.52:35592) 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f507099f640 1 -- 172.21.15.52:0/1414568677 learned_addr learned my addr 172.21.15.52:0/1414568677 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f506bfff640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f506c102a40 0x7f506c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f507099f640 1 -- 172.21.15.52:0/1414568677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f506c102a40 msgr2=0x7f506c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f507099f640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f506c102a40 0x7f506c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f507099f640 1 -- 172.21.15.52:0/1414568677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506c074b20 con 0x7f506c101840 2024-09-06T14:47:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f507099f640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c075f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5060006010 tx=0x7f50600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f5069ffb640 1 -- 172.21.15.52:0/1414568677 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f506003f070 con 0x7f506c101840 2024-09-06T14:47:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c074db0 con 0x7f506c101840 2024-09-06T14:47:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f5069ffb640 1 -- 172.21.15.52:0/1414568677 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5060004a50 con 0x7f506c101840 2024-09-06T14:47:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.917+0000 7f5069ffb640 1 -- 172.21.15.52:0/1414568677 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5060035030 con 0x7f506c101840 2024-09-06T14:47:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.918+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c0752e0 con 0x7f506c101840 2024-09-06T14:47:16.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.918+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506c101c40 con 0x7f506c101840 2024-09-06T14:47:16.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.919+0000 7f5069ffb640 1 -- 172.21.15.52:0/1414568677 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5060042070 con 0x7f506c101840 2024-09-06T14:47:16.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.920+0000 7f5069ffb640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f505c077460 0x7f505c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:16.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.920+0000 7f5069ffb640 1 -- 172.21.15.52:0/1414568677 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f50600ba410 con 0x7f506c101840 2024-09-06T14:47:16.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.920+0000 7f506bfff640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f505c077460 0x7f505c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:16.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.920+0000 7f506bfff640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f505c077460 0x7f505c079920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5058005fd0 tx=0x7f5058005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:16.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:16.924+0000 7f5069ffb640 1 -- 172.21.15.52:0/1414568677 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f5060004c00 con 0x7f506c101840 2024-09-06T14:47:17.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.102+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f506c062630 con 0x7f505c077460 2024-09-06T14:47:17.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.104+0000 7f5069ffb640 1 -- 172.21.15.52:0/1414568677 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f506c062630 con 0x7f505c077460 2024-09-06T14:47:17.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f505c077460 msgr2=0x7f505c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f505c077460 0x7f505c079920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5058005fd0 tx=0x7f5058005850 comp rx=0 tx=0).stop 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 msgr2=0x7f506c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c075f20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5060006010 tx=0x7f50600045e0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 shutdown_connections 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f505c077460 0x7f505c079920 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f506c102a40 0x7f506c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 --2- 172.21.15.52:0/1414568677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f506c101840 0x7f506c075f20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 >> 172.21.15.52:0/1414568677 conn(0x7f506c0fcfd0 msgr2=0x7f506c105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:17.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 shutdown_connections 2024-09-06T14:47:17.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.106+0000 7f50719a1640 1 -- 172.21.15.52:0/1414568677 wait complete. 2024-09-06T14:47:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.193+0000 7f4d9c44b640 1 -- 172.21.15.52:0/1973263154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94102f80 msgr2=0x7f4d94103380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.193+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/1973263154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94102f80 0x7f4d94103380 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4d90009880 tx=0x7f4d9002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.193+0000 7f4d9c44b640 1 -- 172.21.15.52:0/1973263154 shutdown_connections 2024-09-06T14:47:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.193+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/1973263154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d94103950 0x7f4d940ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.193+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/1973263154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94102f80 0x7f4d94103380 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.193+0000 7f4d9c44b640 1 -- 172.21.15.52:0/1973263154 >> 172.21.15.52:0/1973263154 conn(0x7f4d940fb770 msgr2=0x7f4d940fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.193+0000 7f4d9c44b640 1 -- 172.21.15.52:0/1973263154 shutdown_connections 2024-09-06T14:47:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d9c44b640 1 -- 172.21.15.52:0/1973263154 wait complete. 2024-09-06T14:47:17.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d9c44b640 1 Processor -- start 2024-09-06T14:47:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d9c44b640 1 -- start start 2024-09-06T14:47:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d9c44b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d94102f80 0x7f4d941974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d9c44b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94103950 0x7f4d94197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d9c44b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9410a7a0 con 0x7f4d94103950 2024-09-06T14:47:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d9c44b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9410a620 con 0x7f4d94102f80 2024-09-06T14:47:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d999e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94103950 0x7f4d94197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d999e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94103950 0x7f4d94197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35596/0 (socket says 172.21.15.52:35596) 2024-09-06T14:47:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.194+0000 7f4d999e6640 1 -- 172.21.15.52:0/3252220476 learned_addr learned my addr 172.21.15.52:0/3252220476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d9a1e7640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d94102f80 0x7f4d941974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d999e6640 1 -- 172.21.15.52:0/3252220476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d94102f80 msgr2=0x7f4d941974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d999e6640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d94102f80 0x7f4d941974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d999e6640 1 -- 172.21.15.52:0/3252220476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d941980a0 con 0x7f4d94103950 2024-09-06T14:47:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d9a1e7640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d94102f80 0x7f4d941974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:47:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d999e6640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94103950 0x7f4d94197a20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400d6f0 tx=0x7f4d8400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d8b7fe640 1 -- 172.21.15.52:0/3252220476 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d84017070 con 0x7f4d94103950 2024-09-06T14:47:17.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d8b7fe640 1 -- 172.21.15.52:0/3252220476 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d8400de00 con 0x7f4d94103950 2024-09-06T14:47:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9419cae0 con 0x7f4d94103950 2024-09-06T14:47:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d8b7fe640 1 -- 172.21.15.52:0/3252220476 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d84003bc0 con 0x7f4d94103950 2024-09-06T14:47:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.195+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9419d070 con 0x7f4d94103950 2024-09-06T14:47:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.196+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d94103380 con 0x7f4d94103950 2024-09-06T14:47:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.197+0000 7f4d8b7fe640 1 -- 172.21.15.52:0/3252220476 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4d84009a30 con 0x7f4d94103950 2024-09-06T14:47:17.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.197+0000 7f4d8b7fe640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d800774b0 0x7f4d80079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.197+0000 7f4d8b7fe640 1 -- 172.21.15.52:0/3252220476 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f4d84099140 con 0x7f4d94103950 2024-09-06T14:47:17.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.198+0000 7f4d9a1e7640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d800774b0 0x7f4d80079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.198+0000 7f4d9a1e7640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d800774b0 0x7f4d80079970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4d90000c00 tx=0x7f4d90005a20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:17.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.202+0000 7f4d8b7fe640 1 -- 172.21.15.52:0/3252220476 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f4d84062250 con 0x7f4d94103950 2024-09-06T14:47:17.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.373+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4d94062630 con 0x7f4d800774b0 2024-09-06T14:47:17.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.382+0000 7f4d8b7fe640 1 -- 172.21.15.52:0/3252220476 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4d94062630 con 0x7f4d800774b0 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (9m) 21s ago 10m 24.5M - 0.25.0 c8568f914cd2 aeeb40e09110 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (2m) 21s ago 10m 8560k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (118s) 23s ago 9m 8522k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (10m) 21s ago 10m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (9m) 23s ago 9m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (8m) 21s ago 10m 79.1M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:47:17.380 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (5m) 21s ago 5m 88.8M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (5m) 21s ago 5m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (5m) 23s ago 5m 26.6M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (5m) 23s ago 5m 26.2M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (112s) 21s ago 11m 506M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (47s) 23s ago 9m 454M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (11m) 21s ago 11m 58.2M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (9m) 23s ago 9m 42.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (33s) 21s ago 10m 7776k - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (27s) 23s ago 9m 3649k - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (8m) 21s ago 8m 195M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (8m) 21s ago 8m 216M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (7m) 21s ago 7m 181M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:47:17.381 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (7m) 23s ago 7m 237M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (6m) 23s ago 6m 208M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (6m) 23s ago 6m 183M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 starting - - - - 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.384+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d800774b0 msgr2=0x7f4d80079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.384+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d800774b0 0x7f4d80079970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4d90000c00 tx=0x7f4d90005a20 comp rx=0 tx=0).stop 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.384+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94103950 msgr2=0x7f4d94197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.384+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94103950 0x7f4d94197a20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400d6f0 tx=0x7f4d8400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.384+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 shutdown_connections 2024-09-06T14:47:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.384+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d94103950 0x7f4d94197a20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.384+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d800774b0 0x7f4d80079970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.385+0000 7f4d9c44b640 1 --2- 172.21.15.52:0/3252220476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d94102f80 0x7f4d941974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.385+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 >> 172.21.15.52:0/3252220476 conn(0x7f4d940fb770 msgr2=0x7f4d941061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.385+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 shutdown_connections 2024-09-06T14:47:17.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.385+0000 7f4d9c44b640 1 -- 172.21.15.52:0/3252220476 wait complete. 2024-09-06T14:47:17.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 -- 172.21.15.52:0/4250226419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c101a60 msgr2=0x7fd67c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 --2- 172.21.15.52:0/4250226419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c101a60 0x7fd67c101ee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009880 tx=0x7fd66c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 -- 172.21.15.52:0/4250226419 shutdown_connections 2024-09-06T14:47:17.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 --2- 172.21.15.52:0/4250226419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c101a60 0x7fd67c101ee0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 --2- 172.21.15.52:0/4250226419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd67c100860 0x7fd67c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 -- 172.21.15.52:0/4250226419 >> 172.21.15.52:0/4250226419 conn(0x7fd67c0fc010 msgr2=0x7fd67c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 -- 172.21.15.52:0/4250226419 shutdown_connections 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 -- 172.21.15.52:0/4250226419 wait complete. 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 Processor -- start 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.471+0000 7fd68372c640 1 -- start start 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd68372c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c100860 0x7fd67c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd68372c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd67c101a60 0x7fd67c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd68372c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c109680 con 0x7fd67c100860 2024-09-06T14:47:17.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd68372c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c109500 con 0x7fd67c101a60 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6814c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c100860 0x7fd67c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6814c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c100860 0x7fd67c104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35616/0 (socket says 172.21.15.52:35616) 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6814c8640 1 -- 172.21.15.52:0/1375789996 learned_addr learned my addr 172.21.15.52:0/1375789996 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6814c8640 1 -- 172.21.15.52:0/1375789996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd67c101a60 msgr2=0x7fd67c102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6814c8640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd67c101a60 0x7fd67c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6814c8640 1 -- 172.21.15.52:0/1375789996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c103380 con 0x7fd67c100860 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6814c8640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c100860 0x7fd67c104780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd67800d6f0 tx=0x7fd67800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:17.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6727fc640 1 -- 172.21.15.52:0/1375789996 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd678017070 con 0x7fd67c100860 2024-09-06T14:47:17.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c103670 con 0x7fd67c100860 2024-09-06T14:47:17.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6727fc640 1 -- 172.21.15.52:0/1375789996 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd67800de00 con 0x7fd67c100860 2024-09-06T14:47:17.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd6727fc640 1 -- 172.21.15.52:0/1375789996 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd678003bc0 con 0x7fd67c100860 2024-09-06T14:47:17.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.472+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c103c00 con 0x7fd67c100860 2024-09-06T14:47:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.474+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c100c60 con 0x7fd67c100860 2024-09-06T14:47:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.474+0000 7fd6727fc640 1 -- 172.21.15.52:0/1375789996 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd678003e70 con 0x7fd67c100860 2024-09-06T14:47:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.475+0000 7fd6727fc640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd668077460 0x7fd668079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.475+0000 7fd6727fc640 1 -- 172.21.15.52:0/1375789996 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fd6780991c0 con 0x7fd67c100860 2024-09-06T14:47:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.475+0000 7fd680cc7640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd668077460 0x7fd668079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.476+0000 7fd680cc7640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd668077460 0x7fd668079920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd66c02a9c0 tx=0x7fd66c000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.479+0000 7fd6727fc640 1 -- 172.21.15.52:0/1375789996 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fd6780622f0 con 0x7fd67c100860 2024-09-06T14:47:17.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:17 smithi052 ceph-mon[28627]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.740+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd67c19f6e0 con 0x7fd67c100860 2024-09-06T14:47:17.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.741+0000 7fd6727fc640 1 -- 172.21.15.52:0/1375789996 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fd678066460 con 0x7fd67c100860 2024-09-06T14:47:17.738 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:47:17.738 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:47:17.738 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:47:17.739 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 12, 2024-09-06T14:47:17.740 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:47:17.740 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:47:17.740 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd668077460 msgr2=0x7fd668079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd668077460 0x7fd668079920 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd66c02a9c0 tx=0x7fd66c000bc0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c100860 msgr2=0x7fd67c104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c100860 0x7fd67c104780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd67800d6f0 tx=0x7fd67800dbb0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 shutdown_connections 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd668077460 0x7fd668079920 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd67c101a60 0x7fd67c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 --2- 172.21.15.52:0/1375789996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd67c100860 0x7fd67c104780 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 >> 172.21.15.52:0/1375789996 conn(0x7fd67c0fc010 msgr2=0x7fd67c069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:17.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 shutdown_connections 2024-09-06T14:47:17.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.743+0000 7fd68372c640 1 -- 172.21.15.52:0/1375789996 wait complete. 2024-09-06T14:47:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:17 smithi165 ceph-mon[36229]: from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 -- 172.21.15.52:0/2374015007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 msgr2=0x7f4f68102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 --2- 172.21.15.52:0/2374015007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f68102fe0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009880 tx=0x7f4f5802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 -- 172.21.15.52:0/2374015007 shutdown_connections 2024-09-06T14:47:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 --2- 172.21.15.52:0/2374015007 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f68102fe0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 --2- 172.21.15.52:0/2374015007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f68101960 0x7f4f68101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 -- 172.21.15.52:0/2374015007 >> 172.21.15.52:0/2374015007 conn(0x7f4f680fd0f0 msgr2=0x7f4f680ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:17.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 -- 172.21.15.52:0/2374015007 shutdown_connections 2024-09-06T14:47:17.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.828+0000 7f4f70229640 1 -- 172.21.15.52:0/2374015007 wait complete. 2024-09-06T14:47:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f70229640 1 Processor -- start 2024-09-06T14:47:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f70229640 1 -- start start 2024-09-06T14:47:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f70229640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f68101960 0x7f4f68075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f70229640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f680745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f70229640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810a820 con 0x7f4f68102b60 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f70229640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810a6a0 con 0x7f4f68101960 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6d7c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f680745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6d7c4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f680745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35638/0 (socket says 172.21.15.52:35638) 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6d7c4640 1 -- 172.21.15.52:0/3860437654 learned_addr learned my addr 172.21.15.52:0/3860437654 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6dfc5640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f68101960 0x7f4f68075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6d7c4640 1 -- 172.21.15.52:0/3860437654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f68101960 msgr2=0x7f4f68075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6d7c4640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f68101960 0x7f4f68075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6d7c4640 1 -- 172.21.15.52:0/3860437654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f68074b20 con 0x7f4f68102b60 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.829+0000 7f4f6d7c4640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f680745e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f58006010 tx=0x7f4f580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.830+0000 7f4f5effd640 1 -- 172.21.15.52:0/3860437654 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f5803f070 con 0x7f4f68102b60 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.830+0000 7f4f5effd640 1 -- 172.21.15.52:0/3860437654 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f580044d0 con 0x7f4f68102b60 2024-09-06T14:47:17.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.830+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f68074db0 con 0x7f4f68102b60 2024-09-06T14:47:17.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.830+0000 7f4f5effd640 1 -- 172.21.15.52:0/3860437654 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f58035030 con 0x7f4f68102b60 2024-09-06T14:47:17.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.830+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f68075360 con 0x7f4f68102b60 2024-09-06T14:47:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.831+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f68101d40 con 0x7f4f68102b60 2024-09-06T14:47:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.832+0000 7f4f5effd640 1 -- 172.21.15.52:0/3860437654 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4f58042070 con 0x7f4f68102b60 2024-09-06T14:47:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.832+0000 7f4f5effd640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4f54077460 0x7f4f54079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.832+0000 7f4f5effd640 1 -- 172.21.15.52:0/3860437654 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f4f580ba3b0 con 0x7f4f68102b60 2024-09-06T14:47:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.832+0000 7f4f6dfc5640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4f54077460 0x7f4f54079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:17.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.833+0000 7f4f6dfc5640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4f54077460 0x7f4f54079920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f681029c0 tx=0x7f4f64008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:17.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:17.836+0000 7f4f5effd640 1 -- 172.21.15.52:0/3860437654 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f4f580834e0 con 0x7f4f68102b60 2024-09-06T14:47:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.023+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4f68062630 con 0x7f4f54077460 2024-09-06T14:47:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.024+0000 7f4f5effd640 1 -- 172.21.15.52:0/3860437654 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f4f68062630 con 0x7f4f54077460 2024-09-06T14:47:18.021 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:47:18.021 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:47:18.021 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:47:18.021 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:47:18.021 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:47:18.022 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr" 2024-09-06T14:47:18.022 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:47:18.022 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "2/2 daemons upgraded", 2024-09-06T14:47:18.022 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-06T14:47:18.022 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:47:18.022 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:47:18.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4f54077460 msgr2=0x7f4f54079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:18.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4f54077460 0x7f4f54079920 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f681029c0 tx=0x7f4f64008040 comp rx=0 tx=0).stop 2024-09-06T14:47:18.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 msgr2=0x7f4f680745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:18.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f680745e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f58006010 tx=0x7f4f580048f0 comp rx=0 tx=0).stop 2024-09-06T14:47:18.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 shutdown_connections 2024-09-06T14:47:18.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4f68102b60 0x7f4f680745e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:18.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4f54077460 0x7f4f54079920 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:18.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 --2- 172.21.15.52:0/3860437654 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4f68101960 0x7f4f68075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:18.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 >> 172.21.15.52:0/3860437654 conn(0x7f4f680fd0f0 msgr2=0x7f4f68106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:18.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 shutdown_connections 2024-09-06T14:47:18.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:18.026+0000 7f4f70229640 1 -- 172.21.15.52:0/3860437654 wait complete. 2024-09-06T14:47:18.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:18 smithi165 ceph-mon[36229]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:18.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:18 smithi165 ceph-mon[36229]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:18.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:18 smithi165 ceph-mon[36229]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:18.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:18 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1375789996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:18.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:18 smithi165 ceph-mon[36229]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:18.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:18 smithi052 ceph-mon[28627]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:18.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:18 smithi052 ceph-mon[28627]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:18.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:18 smithi052 ceph-mon[28627]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:18.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:18 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1375789996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:18.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:18 smithi052 ceph-mon[28627]: from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:21.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:20 smithi165 ceph-mon[36229]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:21.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:20 smithi052 ceph-mon[28627]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:21.987 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:21 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:21.987 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:21 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:21.987 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:21 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:21.987 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:21 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:21 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:21 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:21 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:22.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:21 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:22.816 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:22 smithi052 ceph-mon[28627]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:22.817 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:22 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:22 smithi165 ceph-mon[36229]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:22 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:47:24.847 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.848 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:24 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:24.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:24.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:24.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:24 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:25 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:47:26.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:25 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-06T14:47:26.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:26 smithi052 ceph-mon[28627]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:26.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:26 smithi052 ceph-mon[28627]: Upgrade: Updating alertmanager.smithi052 2024-09-06T14:47:26.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:26 smithi052 ceph-mon[28627]: Deploying daemon alertmanager.smithi052 on smithi052 2024-09-06T14:47:27.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:26 smithi165 ceph-mon[36229]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:26 smithi165 ceph-mon[36229]: Upgrade: Updating alertmanager.smithi052 2024-09-06T14:47:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:26 smithi165 ceph-mon[36229]: Deploying daemon alertmanager.smithi052 on smithi052 2024-09-06T14:47:29.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:28 smithi165 ceph-mon[36229]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:29.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:28 smithi052 ceph-mon[28627]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:30.992 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:30 smithi052 ceph-mon[28627]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:31.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:30 smithi165 ceph-mon[36229]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:33.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:32 smithi165 ceph-mon[36229]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:33.091 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:32 smithi052 ceph-mon[28627]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:34.759 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:34 smithi052 ceph-mon[28627]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:35.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:34 smithi165 ceph-mon[36229]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:36.286 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:36.287 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:36.287 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:36.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:37.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:37 smithi052 ceph-mon[28627]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:37.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:37 smithi165 ceph-mon[36229]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:38.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:38 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:38.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:38 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:39.300 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:39 smithi052 ceph-mon[28627]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:39.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:39 smithi165 ceph-mon[36229]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:41.289 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:40 smithi052 ceph-mon[28627]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:41.289 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:40 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:41.290 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:40 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:41.290 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:40 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:41.290 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:40 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:41.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:40 smithi165 ceph-mon[36229]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:41.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:40 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:41.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:40 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:41.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:40 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:41.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:40 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:43.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:42 smithi165 ceph-mon[36229]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:43.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:42 smithi052 ceph-mon[28627]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:45 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:45.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:45.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:45 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:46.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:46 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:47:46.350 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:46 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-06T14:47:47.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:47 smithi165 ceph-mon[36229]: Upgrade: Updating grafana.smithi052 2024-09-06T14:47:47.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:47 smithi165 ceph-mon[36229]: Deploying daemon grafana.smithi052 on smithi052 2024-09-06T14:47:47.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:47 smithi165 ceph-mon[36229]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:47 smithi052 ceph-mon[28627]: Upgrade: Updating grafana.smithi052 2024-09-06T14:47:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:47 smithi052 ceph-mon[28627]: Deploying daemon grafana.smithi052 on smithi052 2024-09-06T14:47:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:47 smithi052 ceph-mon[28627]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:48.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.146+0000 7fe557ab1640 1 -- 172.21.15.52:0/1866335986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 msgr2=0x7fe5501047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.146+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1866335986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe5501047e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098b0 tx=0x7fe54c02a4d0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.146+0000 7fe557ab1640 1 -- 172.21.15.52:0/1866335986 shutdown_connections 2024-09-06T14:47:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.146+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1866335986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe550104d20 0x7fe550107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.146+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1866335986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe5501047e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.146+0000 7fe557ab1640 1 -- 172.21.15.52:0/1866335986 >> 172.21.15.52:0/1866335986 conn(0x7fe5500fc010 msgr2=0x7fe5500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.147+0000 7fe557ab1640 1 -- 172.21.15.52:0/1866335986 shutdown_connections 2024-09-06T14:47:48.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.147+0000 7fe557ab1640 1 -- 172.21.15.52:0/1866335986 wait complete. 2024-09-06T14:47:48.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.147+0000 7fe557ab1640 1 Processor -- start 2024-09-06T14:47:48.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.147+0000 7fe557ab1640 1 -- start start 2024-09-06T14:47:48.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe557ab1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe550197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe557ab1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe550104d20 0x7fe550197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe557ab1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe55010a7e0 con 0x7fe5501023f0 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe557ab1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe55010a660 con 0x7fe550104d20 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55584d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe550197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55584d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe550197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48476/0 (socket says 172.21.15.52:48476) 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55584d640 1 -- 172.21.15.52:0/1008591042 learned_addr learned my addr 172.21.15.52:0/1008591042 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55504c640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe550104d20 0x7fe550197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55584d640 1 -- 172.21.15.52:0/1008591042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe550104d20 msgr2=0x7fe550197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55584d640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe550104d20 0x7fe550197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55584d640 1 -- 172.21.15.52:0/1008591042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5501980c0 con 0x7fe5501023f0 2024-09-06T14:47:48.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55504c640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe550104d20 0x7fe550197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.148+0000 7fe55584d640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe550197500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009880 tx=0x7fe54c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.149+0000 7fe546ffd640 1 -- 172.21.15.52:0/1008591042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe54c03f070 con 0x7fe5501023f0 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.149+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55019caa0 con 0x7fe5501023f0 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.149+0000 7fe546ffd640 1 -- 172.21.15.52:0/1008591042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe54c004a50 con 0x7fe5501023f0 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.149+0000 7fe546ffd640 1 -- 172.21.15.52:0/1008591042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe54c035030 con 0x7fe5501023f0 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.149+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55019d030 con 0x7fe5501023f0 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.150+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5501027d0 con 0x7fe5501023f0 2024-09-06T14:47:48.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.151+0000 7fe546ffd640 1 -- 172.21.15.52:0/1008591042 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe54c042070 con 0x7fe5501023f0 2024-09-06T14:47:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.151+0000 7fe546ffd640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe53c0774b0 0x7fe53c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.152+0000 7fe546ffd640 1 -- 172.21.15.52:0/1008591042 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fe54c0ba170 con 0x7fe5501023f0 2024-09-06T14:47:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.152+0000 7fe55504c640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe53c0774b0 0x7fe53c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.152+0000 7fe55504c640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe53c0774b0 0x7fe53c079970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5400058c0 tx=0x7fe540005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:48.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.158+0000 7fe546ffd640 1 -- 172.21.15.52:0/1008591042 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fe54c083320 con 0x7fe5501023f0 2024-09-06T14:47:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.447+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe550105680 con 0x7fe53c0774b0 2024-09-06T14:47:48.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.449+0000 7fe546ffd640 1 -- 172.21.15.52:0/1008591042 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fe550105680 con 0x7fe53c0774b0 2024-09-06T14:47:48.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe53c0774b0 msgr2=0x7fe53c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe53c0774b0 0x7fe53c079970 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe5400058c0 tx=0x7fe540005850 comp rx=0 tx=0).stop 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 msgr2=0x7fe550197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe550197500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009880 tx=0x7fe54c0045c0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 shutdown_connections 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe53c0774b0 0x7fe53c079970 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe550104d20 0x7fe550197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 --2- 172.21.15.52:0/1008591042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5501023f0 0x7fe550197500 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 >> 172.21.15.52:0/1008591042 conn(0x7fe5500fc010 msgr2=0x7fe5500fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.451+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 shutdown_connections 2024-09-06T14:47:48.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.452+0000 7fe557ab1640 1 -- 172.21.15.52:0/1008591042 wait complete. 2024-09-06T14:47:48.457 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 -- 172.21.15.52:0/3027655359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a4104d20 msgr2=0x7f19a4107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 --2- 172.21.15.52:0/3027655359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a4104d20 0x7f19a4107110 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f19980098b0 tx=0x7f199802a4d0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 -- 172.21.15.52:0/3027655359 shutdown_connections 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 --2- 172.21.15.52:0/3027655359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a4104d20 0x7f19a4107110 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 --2- 172.21.15.52:0/3027655359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a41023f0 0x7f19a41047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 -- 172.21.15.52:0/3027655359 >> 172.21.15.52:0/3027655359 conn(0x7f19a40fc010 msgr2=0x7f19a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 -- 172.21.15.52:0/3027655359 shutdown_connections 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.535+0000 7f19a9d57640 1 -- 172.21.15.52:0/3027655359 wait complete. 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a9d57640 1 Processor -- start 2024-09-06T14:47:48.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a9d57640 1 -- start start 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a9d57640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a41023f0 0x7f19a41975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a9d57640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4104d20 0x7f19a4197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a9d57640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19a410a810 con 0x7f19a41023f0 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a9d57640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19a410a690 con 0x7f19a4104d20 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a41023f0 0x7f19a41975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a41023f0 0x7f19a41975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48492/0 (socket says 172.21.15.52:48492) 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.536+0000 7f19a37fe640 1 -- 172.21.15.52:0/2169587068 learned_addr learned my addr 172.21.15.52:0/2169587068 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a2ffd640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4104d20 0x7f19a4197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a37fe640 1 -- 172.21.15.52:0/2169587068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4104d20 msgr2=0x7f19a4197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a37fe640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4104d20 0x7f19a4197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a37fe640 1 -- 172.21.15.52:0/2169587068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a4198190 con 0x7f19a41023f0 2024-09-06T14:47:48.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a37fe640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a41023f0 0x7f19a41975d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f199400b420 tx=0x7f199400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a0ff9640 1 -- 172.21.15.52:0/2169587068 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1994011630 con 0x7f19a41023f0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a419cbd0 con 0x7f19a41023f0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a0ff9640 1 -- 172.21.15.52:0/2169587068 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1994016070 con 0x7f19a41023f0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a419d130 con 0x7f19a41023f0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.537+0000 7f19a0ff9640 1 -- 172.21.15.52:0/2169587068 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1994010d40 con 0x7f19a41023f0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.538+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a410b020 con 0x7f19a41023f0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.539+0000 7f19a0ff9640 1 -- 172.21.15.52:0/2169587068 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f199401b460 con 0x7f19a41023f0 2024-09-06T14:47:48.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.539+0000 7f19a0ff9640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f198c077460 0x7f198c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.539+0000 7f19a0ff9640 1 -- 172.21.15.52:0/2169587068 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f1994098d80 con 0x7f19a41023f0 2024-09-06T14:47:48.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.539+0000 7f19a2ffd640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f198c077460 0x7f198c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.540+0000 7f19a2ffd640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f198c077460 0x7f198c079920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1998006010 tx=0x7f1998009580 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:48.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.543+0000 7f19a0ff9640 1 -- 172.21.15.52:0/2169587068 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f19a410b020 con 0x7f19a41023f0 2024-09-06T14:47:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.720+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f19a4105760 con 0x7f198c077460 2024-09-06T14:47:48.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.721+0000 7f19a0ff9640 1 -- 172.21.15.52:0/2169587068 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f19a4105760 con 0x7f198c077460 2024-09-06T14:47:48.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f198c077460 msgr2=0x7f198c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f198c077460 0x7f198c079920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1998006010 tx=0x7f1998009580 comp rx=0 tx=0).stop 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a41023f0 msgr2=0x7f19a41975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a41023f0 0x7f19a41975d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f199400b420 tx=0x7f199400b8e0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 shutdown_connections 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f198c077460 0x7f198c079920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19a4104d20 0x7f19a4197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 --2- 172.21.15.52:0/2169587068 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19a41023f0 0x7f19a41975d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 >> 172.21.15.52:0/2169587068 conn(0x7f19a40fc010 msgr2=0x7f19a40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 shutdown_connections 2024-09-06T14:47:48.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.723+0000 7f19a9d57640 1 -- 172.21.15.52:0/2169587068 wait complete. 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 -- 172.21.15.52:0/1448920165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb14100040 msgr2=0x7fbb14107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 --2- 172.21.15.52:0/1448920165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb14100040 0x7fbb14107070 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009c20 tx=0x7fbb0802a970 comp rx=0 tx=0).stop 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 -- 172.21.15.52:0/1448920165 shutdown_connections 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 --2- 172.21.15.52:0/1448920165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb14100040 0x7fbb14107070 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 --2- 172.21.15.52:0/1448920165 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb140ff700 0x7fbb140ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 -- 172.21.15.52:0/1448920165 >> 172.21.15.52:0/1448920165 conn(0x7fbb140fb350 msgr2=0x7fbb140fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 -- 172.21.15.52:0/1448920165 shutdown_connections 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.806+0000 7fbb1c682640 1 -- 172.21.15.52:0/1448920165 wait complete. 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1c682640 1 Processor -- start 2024-09-06T14:47:48.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1c682640 1 -- start start 2024-09-06T14:47:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1c682640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb140ff700 0x7fbb141974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1c682640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb14100040 0x7fbb14197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1c682640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1410a7c0 con 0x7fbb140ff700 2024-09-06T14:47:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1c682640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1410a640 con 0x7fbb14100040 2024-09-06T14:47:48.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1a41e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb140ff700 0x7fbb141974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1a41e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb140ff700 0x7fbb141974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48506/0 (socket says 172.21.15.52:48506) 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1a41e640 1 -- 172.21.15.52:0/760424796 learned_addr learned my addr 172.21.15.52:0/760424796 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb19c1d640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb14100040 0x7fbb14197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1a41e640 1 -- 172.21.15.52:0/760424796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb14100040 msgr2=0x7fbb14197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1a41e640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb14100040 0x7fbb14197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb1a41e640 1 -- 172.21.15.52:0/760424796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb141980b0 con 0x7fbb140ff700 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.807+0000 7fbb19c1d640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb14100040 0x7fbb14197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.808+0000 7fbb1a41e640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb140ff700 0x7fbb141974f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00d6f0 tx=0x7fbb0c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.808+0000 7fbb137fe640 1 -- 172.21.15.52:0/760424796 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb0c017070 con 0x7fbb140ff700 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.808+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1419caf0 con 0x7fbb140ff700 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.808+0000 7fbb137fe640 1 -- 172.21.15.52:0/760424796 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb0c00de00 con 0x7fbb140ff700 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.808+0000 7fbb137fe640 1 -- 172.21.15.52:0/760424796 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbb0c004bb0 con 0x7fbb140ff700 2024-09-06T14:47:48.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.808+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1419d050 con 0x7fbb140ff700 2024-09-06T14:47:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.809+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb140ffb00 con 0x7fbb140ff700 2024-09-06T14:47:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.810+0000 7fbb137fe640 1 -- 172.21.15.52:0/760424796 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbb0c004e60 con 0x7fbb140ff700 2024-09-06T14:47:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.810+0000 7fbb137fe640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbafc077470 0x7fbafc079930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.810+0000 7fbb137fe640 1 -- 172.21.15.52:0/760424796 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fbb0c099240 con 0x7fbb140ff700 2024-09-06T14:47:48.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.810+0000 7fbb19c1d640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbafc077470 0x7fbafc079930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:48.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.811+0000 7fbb19c1d640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbafc077470 0x7fbafc079930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb0802f900 tx=0x7fbb0802f3c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:48.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.814+0000 7fbb137fe640 1 -- 172.21.15.52:0/760424796 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fbb0c062370 con 0x7fbb140ff700 2024-09-06T14:47:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:48.989+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbb14106940 con 0x7fbafc077470 2024-09-06T14:47:48.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.000+0000 7fbb137fe640 1 -- 172.21.15.52:0/760424796 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbb14106940 con 0x7fbafc077470 2024-09-06T14:47:48.997 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:47:48.997 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (14s) 9s ago 11m 17.5M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (3m) 9s ago 11m 8619k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (2m) 55s ago 10m 8522k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (11m) 9s ago 11m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (10m) 55s ago 10m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (9m) 9s ago 10m 78.8M - 9.4.12 2bacad6d85d8 c6d20de6f39f 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (5m) 9s ago 5m 88.8M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (5m) 9s ago 5m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (5m) 55s ago 5m 26.6M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (5m) 55s ago 5m 26.2M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:47:48.998 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (2m) 9s ago 12m 509M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (79s) 55s ago 10m 454M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (12m) 9s ago 12m 58.4M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (10m) 55s ago 10m 42.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (65s) 9s ago 11m 9219k - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (59s) 55s ago 10m 3649k - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (9m) 9s ago 9m 195M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (8m) 9s ago 8m 217M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (8m) 9s ago 8m 182M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (7m) 55s ago 7m 237M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (7m) 55s ago 7m 208M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (6m) 55s ago 6m 183M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:47:48.999 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (35s) 9s ago 10m 41.9M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:47:49.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbafc077470 msgr2=0x7fbafc079930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbafc077470 0x7fbafc079930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbb0802f900 tx=0x7fbb0802f3c0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb140ff700 msgr2=0x7fbb141974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb140ff700 0x7fbb141974f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00d6f0 tx=0x7fbb0c00dbb0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 shutdown_connections 2024-09-06T14:47:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbafc077470 0x7fbafc079930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb14100040 0x7fbb14197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 --2- 172.21.15.52:0/760424796 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbb140ff700 0x7fbb141974f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 >> 172.21.15.52:0/760424796 conn(0x7fbb140fb350 msgr2=0x7fbb141051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 shutdown_connections 2024-09-06T14:47:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.002+0000 7fbb1c682640 1 -- 172.21.15.52:0/760424796 wait complete. 2024-09-06T14:47:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 -- 172.21.15.52:0/282746680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4100860 msgr2=0x7fcef4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/282746680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4100860 0x7fcef4100c60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009880 tx=0x7fcef002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 -- 172.21.15.52:0/282746680 shutdown_connections 2024-09-06T14:47:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/282746680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcef4101a60 0x7fcef4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/282746680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4100860 0x7fcef4100c60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 -- 172.21.15.52:0/282746680 >> 172.21.15.52:0/282746680 conn(0x7fcef40fc010 msgr2=0x7fcef40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:49.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 -- 172.21.15.52:0/282746680 shutdown_connections 2024-09-06T14:47:49.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.087+0000 7fcefc1a6640 1 -- 172.21.15.52:0/282746680 wait complete. 2024-09-06T14:47:49.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.088+0000 7fcefc1a6640 1 Processor -- start 2024-09-06T14:47:49.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.088+0000 7fcefc1a6640 1 -- start start 2024-09-06T14:47:49.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.088+0000 7fcefc1a6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcef4100860 0x7fcef4196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:49.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.088+0000 7fcefc1a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4101a60 0x7fcef4196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:49.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.088+0000 7fcefc1a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcef4109700 con 0x7fcef4101a60 2024-09-06T14:47:49.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.088+0000 7fcefc1a6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcef4109580 con 0x7fcef4100860 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.088+0000 7fcef9741640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4101a60 0x7fcef4196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcef9741640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4101a60 0x7fcef4196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48520/0 (socket says 172.21.15.52:48520) 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcef9741640 1 -- 172.21.15.52:0/946026802 learned_addr learned my addr 172.21.15.52:0/946026802 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcef9f42640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcef4100860 0x7fcef4196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcef9741640 1 -- 172.21.15.52:0/946026802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcef4100860 msgr2=0x7fcef4196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcef9741640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcef4100860 0x7fcef4196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcef9741640 1 -- 172.21.15.52:0/946026802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef4196fd0 con 0x7fcef4101a60 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcef9741640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4101a60 0x7fcef4196950 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcee400b420 tx=0x7fcee400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fceeaffd640 1 -- 172.21.15.52:0/946026802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcee4011630 con 0x7fcef4101a60 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fceeaffd640 1 -- 172.21.15.52:0/946026802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcee4016070 con 0x7fcef4101a60 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef419ba10 con 0x7fcef4101a60 2024-09-06T14:47:49.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fceeaffd640 1 -- 172.21.15.52:0/946026802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcee4010d40 con 0x7fcef4101a60 2024-09-06T14:47:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.089+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef419c020 con 0x7fcef4101a60 2024-09-06T14:47:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.090+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef4100c60 con 0x7fcef4101a60 2024-09-06T14:47:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.091+0000 7fceeaffd640 1 -- 172.21.15.52:0/946026802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fcee401b460 con 0x7fcef4101a60 2024-09-06T14:47:49.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.092+0000 7fceeaffd640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcee0077460 0x7fcee0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.092+0000 7fceeaffd640 1 -- 172.21.15.52:0/946026802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fcee4098d80 con 0x7fcef4101a60 2024-09-06T14:47:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.092+0000 7fcef9f42640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcee0077460 0x7fcee0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:49.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.092+0000 7fcef9f42640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcee0077460 0x7fcee0079920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000c00 tx=0x7fcef0005a20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:49.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.096+0000 7fceeaffd640 1 -- 172.21.15.52:0/946026802 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fcee4061eb0 con 0x7fcef4101a60 2024-09-06T14:47:49.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.320+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcef4062df0 con 0x7fcef4101a60 2024-09-06T14:47:49.318 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:49 smithi052 ceph-mon[28627]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:49.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.321+0000 7fceeaffd640 1 -- 172.21.15.52:0/946026802 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fcee40682f0 con 0x7fcef4101a60 2024-09-06T14:47:49.319 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:47:49.319 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:47:49.319 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:47:49.320 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:49.320 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:47:49.320 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:47:49.320 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:49.320 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:47:49.320 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:47:49.321 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:49.321 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:47:49.321 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:47:49.321 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:47:49.322 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:47:49.322 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 12, 2024-09-06T14:47:49.322 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:47:49.322 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:47:49.322 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:47:49.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:49 smithi165 ceph-mon[36229]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcee0077460 msgr2=0x7fcee0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcee0077460 0x7fcee0079920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000c00 tx=0x7fcef0005a20 comp rx=0 tx=0).stop 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4101a60 msgr2=0x7fcef4196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4101a60 0x7fcef4196950 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcee400b420 tx=0x7fcee400b8e0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 shutdown_connections 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcef4101a60 0x7fcef4196950 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcee0077460 0x7fcee0079920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 --2- 172.21.15.52:0/946026802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcef4100860 0x7fcef4196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 >> 172.21.15.52:0/946026802 conn(0x7fcef40fc010 msgr2=0x7fcef4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:49.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 shutdown_connections 2024-09-06T14:47:49.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.323+0000 7fcefc1a6640 1 -- 172.21.15.52:0/946026802 wait complete. 2024-09-06T14:47:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 -- 172.21.15.52:0/2270193871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 msgr2=0x7f9a48101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/2270193871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48101d60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009880 tx=0x7f9a3802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 -- 172.21.15.52:0/2270193871 shutdown_connections 2024-09-06T14:47:49.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/2270193871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a48102b60 0x7f9a48102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/2270193871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48101d60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 -- 172.21.15.52:0/2270193871 >> 172.21.15.52:0/2270193871 conn(0x7f9a480fd0f0 msgr2=0x7f9a480ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 -- 172.21.15.52:0/2270193871 shutdown_connections 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 -- 172.21.15.52:0/2270193871 wait complete. 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.407+0000 7f9a4deb2640 1 Processor -- start 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a4deb2640 1 -- start start 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a4deb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a4deb2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a48102b60 0x7f9a48197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a4deb2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4810a800 con 0x7f9a48101960 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a4deb2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4810a680 con 0x7f9a48102b60 2024-09-06T14:47:49.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a477fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a477fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48538/0 (socket says 172.21.15.52:48538) 2024-09-06T14:47:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a477fe640 1 -- 172.21.15.52:0/3401543546 learned_addr learned my addr 172.21.15.52:0/3401543546 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:47:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a46ffd640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a48102b60 0x7f9a48197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a477fe640 1 -- 172.21.15.52:0/3401543546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a48102b60 msgr2=0x7f9a48197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a477fe640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a48102b60 0x7f9a48197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.408+0000 7f9a477fe640 1 -- 172.21.15.52:0/3401543546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a481980d0 con 0x7f9a48101960 2024-09-06T14:47:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.409+0000 7f9a477fe640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48197510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9a38006010 tx=0x7f9a380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.409+0000 7f9a44ff9640 1 -- 172.21.15.52:0/3401543546 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a3803f070 con 0x7f9a48101960 2024-09-06T14:47:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.409+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4819cab0 con 0x7f9a48101960 2024-09-06T14:47:49.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.409+0000 7f9a44ff9640 1 -- 172.21.15.52:0/3401543546 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a380044d0 con 0x7f9a48101960 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.409+0000 7f9a44ff9640 1 -- 172.21.15.52:0/3401543546 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a38035030 con 0x7f9a48101960 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.409+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4819d040 con 0x7f9a48101960 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.410+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a48101d60 con 0x7f9a48101960 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.411+0000 7f9a44ff9640 1 -- 172.21.15.52:0/3401543546 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9a38042070 con 0x7f9a48101960 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.411+0000 7f9a44ff9640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a30077460 0x7f9a30079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.411+0000 7f9a44ff9640 1 -- 172.21.15.52:0/3401543546 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f9a380ba290 con 0x7f9a48101960 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.411+0000 7f9a46ffd640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a30077460 0x7f9a30079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:47:49.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.412+0000 7f9a46ffd640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a30077460 0x7f9a30079920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a481989c0 tx=0x7f9a3c008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:47:49.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.415+0000 7f9a44ff9640 1 -- 172.21.15.52:0/3401543546 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f9a380833c0 con 0x7f9a48101960 2024-09-06T14:47:49.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.591+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9a480626f0 con 0x7f9a30077460 2024-09-06T14:47:49.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.592+0000 7f9a44ff9640 1 -- 172.21.15.52:0/3401543546 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f9a480626f0 con 0x7f9a30077460 2024-09-06T14:47:49.589 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:47:49.589 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:47:49.589 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:47:49.589 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-06T14:47:49.589 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:47:49.589 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr" 2024-09-06T14:47:49.590 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:47:49.590 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "2/2 daemons upgraded", 2024-09-06T14:47:49.590 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading grafana daemons", 2024-09-06T14:47:49.590 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:47:49.590 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:47:49.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a30077460 msgr2=0x7f9a30079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a30077460 0x7f9a30079920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a481989c0 tx=0x7f9a3c008040 comp rx=0 tx=0).stop 2024-09-06T14:47:49.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 msgr2=0x7f9a48197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:47:49.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48197510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9a38006010 tx=0x7f9a380048f0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 shutdown_connections 2024-09-06T14:47:49.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a30077460 0x7f9a30079920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a48102b60 0x7f9a48197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 --2- 172.21.15.52:0/3401543546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a48101960 0x7f9a48197510 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:47:49.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 >> 172.21.15.52:0/3401543546 conn(0x7f9a480fd0f0 msgr2=0x7f9a48105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:47:49.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 shutdown_connections 2024-09-06T14:47:49.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:47:49.594+0000 7f9a4deb2640 1 -- 172.21.15.52:0/3401543546 wait complete. 2024-09-06T14:47:50.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:50 smithi165 ceph-mon[36229]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:50.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:50 smithi165 ceph-mon[36229]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:50.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:50 smithi165 ceph-mon[36229]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:50.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:50 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/946026802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:50.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:50 smithi052 ceph-mon[28627]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:50.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:50 smithi052 ceph-mon[28627]: from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:50.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:50 smithi052 ceph-mon[28627]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:50.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:50 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/946026802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:47:51.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:51 smithi165 ceph-mon[36229]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:51.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:51 smithi165 ceph-mon[36229]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:51.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:51 smithi052 ceph-mon[28627]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:51.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:51 smithi052 ceph-mon[28627]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:47:53.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:53 smithi165 ceph-mon[36229]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:53.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:53 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:53.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:53 smithi052 ceph-mon[28627]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:53.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:53 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:47:55.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:55 smithi052 ceph-mon[28627]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:55.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:55 smithi165 ceph-mon[36229]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:47:57.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:57 smithi052 ceph-mon[28627]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:57.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:57 smithi165 ceph-mon[36229]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:59.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:58 smithi052 ceph-mon[28627]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:59.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:58 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:59.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:58 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:59.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:47:58 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:47:59.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:58 smithi165 ceph-mon[36229]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:47:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:58 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:58 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:47:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:47:58 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:01.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:00 smithi052 ceph-mon[28627]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:01.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:00 smithi165 ceph-mon[36229]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:03.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:02 smithi052 ceph-mon[28627]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:03.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:02 smithi165 ceph-mon[36229]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:04.781 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:04 smithi052 ceph-mon[28627]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:04.781 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:04 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:04.781 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:04 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:04.781 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:04 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:04.781 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:04 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:05.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:04 smithi165 ceph-mon[36229]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:05.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:04 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:05.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:04 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:05.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:04 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:05.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:04 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:06 smithi052 ceph-mon[28627]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:07.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:06 smithi165 ceph-mon[36229]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:08.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: Upgrade: Finalizing container_image settings 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-06T14:48:08.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.827 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: Upgrade: Complete! 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:08.828 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:08.829 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:08.829 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:08 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: Upgrade: Finalizing container_image settings 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-06T14:48:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: Upgrade: Complete! 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:08.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:08.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:08.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:08 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:11.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:10 smithi165 ceph-mon[36229]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:10 smithi052 ceph-mon[28627]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:12.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:12 smithi052 ceph-mon[28627]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:12.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:12 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:13.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:12 smithi165 ceph-mon[36229]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:13.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:12 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:15.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:14 smithi165 ceph-mon[36229]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:15.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:14 smithi052 ceph-mon[28627]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:17.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:16 smithi165 ceph-mon[36229]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:17.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:16 smithi052 ceph-mon[28627]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:19.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:18 smithi165 ceph-mon[36229]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:19.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:18 smithi052 ceph-mon[28627]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:19.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 -- 172.21.15.52:0/1996164104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810100860 msgr2=0x7f7810100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:19.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 --2- 172.21.15.52:0/1996164104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810100860 0x7f7810100c60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f780c009880 tx=0x7f780c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 -- 172.21.15.52:0/1996164104 shutdown_connections 2024-09-06T14:48:19.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 --2- 172.21.15.52:0/1996164104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7810101a60 0x7f7810101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 --2- 172.21.15.52:0/1996164104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810100860 0x7f7810100c60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 -- 172.21.15.52:0/1996164104 >> 172.21.15.52:0/1996164104 conn(0x7f78100fc010 msgr2=0x7f78100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:19.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 -- 172.21.15.52:0/1996164104 shutdown_connections 2024-09-06T14:48:19.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.691+0000 7f781728a640 1 -- 172.21.15.52:0/1996164104 wait complete. 2024-09-06T14:48:19.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f781728a640 1 Processor -- start 2024-09-06T14:48:19.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f781728a640 1 -- start start 2024-09-06T14:48:19.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f781728a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7810100860 0x7f7810197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:19.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f781728a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810101a60 0x7f7810197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:19.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f781728a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f78101096a0 con 0x7f7810101a60 2024-09-06T14:48:19.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f781728a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7810109520 con 0x7f7810100860 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f7814825640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810101a60 0x7f7810197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f7814825640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810101a60 0x7f7810197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50662/0 (socket says 172.21.15.52:50662) 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f7814825640 1 -- 172.21.15.52:0/2483848138 learned_addr learned my addr 172.21.15.52:0/2483848138 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f7815026640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7810100860 0x7f7810197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f7814825640 1 -- 172.21.15.52:0/2483848138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7810100860 msgr2=0x7f7810197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f7814825640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7810100860 0x7f7810197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.692+0000 7f7814825640 1 -- 172.21.15.52:0/2483848138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78101980d0 con 0x7f7810101a60 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.693+0000 7f7814825640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810101a60 0x7f7810197a50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f780000d6f0 tx=0x7f780000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.693+0000 7f78067fc640 1 -- 172.21.15.52:0/2483848138 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7800017070 con 0x7f7810101a60 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.693+0000 7f78067fc640 1 -- 172.21.15.52:0/2483848138 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f780000de00 con 0x7f7810101a60 2024-09-06T14:48:19.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.693+0000 7f78067fc640 1 -- 172.21.15.52:0/2483848138 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7800004bb0 con 0x7f7810101a60 2024-09-06T14:48:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.693+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781019cb10 con 0x7f7810101a60 2024-09-06T14:48:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.693+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f781019d0a0 con 0x7f7810101a60 2024-09-06T14:48:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.694+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7810100c60 con 0x7f7810101a60 2024-09-06T14:48:19.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.695+0000 7f78067fc640 1 -- 172.21.15.52:0/2483848138 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7800004e60 con 0x7f7810101a60 2024-09-06T14:48:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.695+0000 7f78067fc640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77fc077460 0x7f77fc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.695+0000 7f78067fc640 1 -- 172.21.15.52:0/2483848138 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f7800099240 con 0x7f7810101a60 2024-09-06T14:48:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.695+0000 7f7815026640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77fc077460 0x7f77fc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:19.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.696+0000 7f7815026640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77fc077460 0x7f77fc079920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f780c000c00 tx=0x7f780c005a20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:19.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.699+0000 7f78067fc640 1 -- 172.21.15.52:0/2483848138 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f7800062370 con 0x7f7810101a60 2024-09-06T14:48:19.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.878+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f781006a8f0 con 0x7f77fc077460 2024-09-06T14:48:19.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.879+0000 7f78067fc640 1 -- 172.21.15.52:0/2483848138 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f781006a8f0 con 0x7f77fc077460 2024-09-06T14:48:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77fc077460 msgr2=0x7f77fc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77fc077460 0x7f77fc079920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f780c000c00 tx=0x7f780c005a20 comp rx=0 tx=0).stop 2024-09-06T14:48:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810101a60 msgr2=0x7f7810197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810101a60 0x7f7810197a50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f780000d6f0 tx=0x7f780000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 shutdown_connections 2024-09-06T14:48:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7810101a60 0x7f7810197a50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77fc077460 0x7f77fc079920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 --2- 172.21.15.52:0/2483848138 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7810100860 0x7f7810197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 >> 172.21.15.52:0/2483848138 conn(0x7f78100fc010 msgr2=0x7f781006a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 shutdown_connections 2024-09-06T14:48:19.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:19.881+0000 7f781728a640 1 -- 172.21.15.52:0/2483848138 wait complete. 2024-09-06T14:48:20.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-06T14:48:20.807 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:20.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:20 smithi052 ceph-mon[28627]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:20.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:20 smithi052 ceph-mon[28627]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:21.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:20 smithi165 ceph-mon[36229]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:21.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:20 smithi165 ceph-mon[36229]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:21.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.305+0000 7f1673ec2640 1 -- 172.21.15.52:0/1116719435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 msgr2=0x7f166c100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.305+0000 7f1673ec2640 1 --2- 172.21.15.52:0/1116719435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c100c70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f165c009880 tx=0x7f165c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 -- 172.21.15.52:0/1116719435 shutdown_connections 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 --2- 172.21.15.52:0/1116719435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c100c70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 --2- 172.21.15.52:0/1116719435 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c106810 0x7f166c106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 -- 172.21.15.52:0/1116719435 >> 172.21.15.52:0/1116719435 conn(0x7f166c0fc510 msgr2=0x7f166c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 -- 172.21.15.52:0/1116719435 shutdown_connections 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 -- 172.21.15.52:0/1116719435 wait complete. 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 Processor -- start 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 -- start start 2024-09-06T14:48:21.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c106810 0x7f166c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.306+0000 7f1673ec2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f166c10dd40 con 0x7f166c100810 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1673ec2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f166c10dbc0 con 0x7f166c106810 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1671c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1671c5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55474/0 (socket says 172.21.15.52:55474) 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1671c5e640 1 -- 172.21.15.52:0/2042253811 learned_addr learned my addr 172.21.15.52:0/2042253811 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f167145d640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c106810 0x7f166c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1671c5e640 1 -- 172.21.15.52:0/2042253811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c106810 msgr2=0x7f166c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1671c5e640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c106810 0x7f166c198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1671c5e640 1 -- 172.21.15.52:0/2042253811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c199380 con 0x7f166c100810 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1671c5e640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c198840 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f166800b420 tx=0x7f166800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:21.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1662ffd640 1 -- 172.21.15.52:0/2042253811 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1668011630 con 0x7f166c100810 2024-09-06T14:48:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1662ffd640 1 -- 172.21.15.52:0/2042253811 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1668016070 con 0x7f166c100810 2024-09-06T14:48:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c199670 con 0x7f166c100810 2024-09-06T14:48:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1662ffd640 1 -- 172.21.15.52:0/2042253811 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1668010d40 con 0x7f166c100810 2024-09-06T14:48:21.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.307+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c1a1c70 con 0x7f166c100810 2024-09-06T14:48:21.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.309+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c101f50 con 0x7f166c100810 2024-09-06T14:48:21.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.309+0000 7f1662ffd640 1 -- 172.21.15.52:0/2042253811 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f166801b460 con 0x7f166c100810 2024-09-06T14:48:21.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.310+0000 7f1662ffd640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1658077460 0x7f1658079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:21.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.310+0000 7f1662ffd640 1 -- 172.21.15.52:0/2042253811 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f1668098d70 con 0x7f166c100810 2024-09-06T14:48:21.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.310+0000 7f167145d640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1658077460 0x7f1658079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:21.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.310+0000 7f167145d640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1658077460 0x7f1658079920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f165c031460 tx=0x7f165c009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:21.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.314+0000 7f1662ffd640 1 -- 172.21.15.52:0/2042253811 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f166c199670 con 0x7f166c100810 2024-09-06T14:48:21.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.531+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f166c108da0 con 0x7f166c100810 2024-09-06T14:48:21.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.531+0000 7f1662ffd640 1 -- 172.21.15.52:0/2042253811 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f1668021250 con 0x7f166c100810 2024-09-06T14:48:21.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1658077460 msgr2=0x7f1658079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:21.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1658077460 0x7f1658079920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f165c031460 tx=0x7f165c009560 comp rx=0 tx=0).stop 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 msgr2=0x7f166c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c198840 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f166800b420 tx=0x7f166800b8e0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 shutdown_connections 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1658077460 0x7f1658079920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f166c106810 0x7f166c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 --2- 172.21.15.52:0/2042253811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f166c100810 0x7f166c198840 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 >> 172.21.15.52:0/2042253811 conn(0x7f166c0fc510 msgr2=0x7f166c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 shutdown_connections 2024-09-06T14:48:21.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:21.533+0000 7f1673ec2640 1 -- 172.21.15.52:0/2042253811 wait complete. 2024-09-06T14:48:21.539 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:48:21.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:21 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/2042253811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:21 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/2042253811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:22 smithi165 ceph-mon[36229]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:22 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:22 smithi052 ceph-mon[28627]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:22 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:25.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:24 smithi165 ceph-mon[36229]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:25.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:24 smithi052 ceph-mon[28627]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:25.846 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-06T14:48:26.113 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:26.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1460919613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c0100d70 msgr2=0x7f84c01065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:26.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1460919613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c0100d70 0x7f84c01065c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009880 tx=0x7f84ac02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1460919613 shutdown_connections 2024-09-06T14:48:26.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1460919613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c0100d70 0x7f84c01065c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1460919613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84c01003c0 0x7f84c01007a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1460919613 >> 172.21.15.52:0/1460919613 conn(0x7f84c00771e0 msgr2=0x7f84c00775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1460919613 shutdown_connections 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.631+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1460919613 wait complete. 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c6bf0640 1 Processor -- start 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c6bf0640 1 -- start start 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c6bf0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c01003c0 0x7f84c019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c6bf0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84c0100d70 0x7f84c019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c6bf0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f84c010edf0 con 0x7f84c01003c0 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c6bf0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f84c010ec70 con 0x7f84c0100d70 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c498c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c01003c0 0x7f84c019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:26.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c498c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c01003c0 0x7f84c019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55496/0 (socket says 172.21.15.52:55496) 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c498c640 1 -- 172.21.15.52:0/1224601934 learned_addr learned my addr 172.21.15.52:0/1224601934 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84bffff640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84c0100d70 0x7f84c019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.632+0000 7f84c498c640 1 -- 172.21.15.52:0/1224601934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84c0100d70 msgr2=0x7f84c019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84c498c640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84c0100d70 0x7f84c019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84c498c640 1 -- 172.21.15.52:0/1224601934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0197800 con 0x7f84c01003c0 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84bffff640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84c0100d70 0x7f84c019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84c498c640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c01003c0 0x7f84c019d680 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f84b400d6f0 tx=0x7f84b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84bdffb640 1 -- 172.21.15.52:0/1224601934 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84b4017070 con 0x7f84c01003c0 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c0197af0 con 0x7f84c01003c0 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84bdffb640 1 -- 172.21.15.52:0/1224601934 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84b400de00 con 0x7f84c01003c0 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84bdffb640 1 -- 172.21.15.52:0/1224601934 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84b4004bb0 con 0x7f84c01003c0 2024-09-06T14:48:26.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.633+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c0198050 con 0x7f84c01003c0 2024-09-06T14:48:26.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.634+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c0069d90 con 0x7f84c01003c0 2024-09-06T14:48:26.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.635+0000 7f84bdffb640 1 -- 172.21.15.52:0/1224601934 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f84b4004e60 con 0x7f84c01003c0 2024-09-06T14:48:26.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.635+0000 7f84bdffb640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84b0077460 0x7f84b0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:26.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.636+0000 7f84bdffb640 1 -- 172.21.15.52:0/1224601934 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f84b4099310 con 0x7f84c01003c0 2024-09-06T14:48:26.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.636+0000 7f84bffff640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84b0077460 0x7f84b0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:26.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.636+0000 7f84bffff640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84b0077460 0x7f84b0079920 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000c00 tx=0x7f84ac031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:26.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.640+0000 7f84bdffb640 1 -- 172.21.15.52:0/1224601934 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f84b40623a0 con 0x7f84c01003c0 2024-09-06T14:48:26.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.860+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f84c0109ea0 con 0x7f84c01003c0 2024-09-06T14:48:26.857 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:26 smithi052 ceph-mon[28627]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:26.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.860+0000 7f84bdffb640 1 -- 172.21.15.52:0/1224601934 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f84b4066510 con 0x7f84c01003c0 2024-09-06T14:48:26.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84b0077460 msgr2=0x7f84b0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84b0077460 0x7f84b0079920 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f84ac000c00 tx=0x7f84ac031400 comp rx=0 tx=0).stop 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c01003c0 msgr2=0x7f84c019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c01003c0 0x7f84c019d680 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f84b400d6f0 tx=0x7f84b400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 shutdown_connections 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84b0077460 0x7f84b0079920 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f84c0100d70 0x7f84c019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 --2- 172.21.15.52:0/1224601934 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f84c01003c0 0x7f84c019d680 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 >> 172.21.15.52:0/1224601934 conn(0x7f84c00771e0 msgr2=0x7f84c00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 shutdown_connections 2024-09-06T14:48:26.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:26.862+0000 7f84c6bf0640 1 -- 172.21.15.52:0/1224601934 wait complete. 2024-09-06T14:48:26.868 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)" 2024-09-06T14:48:27.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:26 smithi165 ceph-mon[36229]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:27.491 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-06T14:48:27.730 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:27 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/1224601934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:27.754 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:28.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:27 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/1224601934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:28.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 -- 172.21.15.52:0/903440262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8101960 msgr2=0x7f59b8101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/903440262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8101960 0x7f59b8101dc0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f59a8009880 tx=0x7f59a802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 -- 172.21.15.52:0/903440262 shutdown_connections 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/903440262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8101960 0x7f59b8101dc0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/903440262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59b8107960 0x7f59b8107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 -- 172.21.15.52:0/903440262 >> 172.21.15.52:0/903440262 conn(0x7f59b80fd680 msgr2=0x7f59b80ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 -- 172.21.15.52:0/903440262 shutdown_connections 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 -- 172.21.15.52:0/903440262 wait complete. 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 Processor -- start 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.215+0000 7f59bf9ce640 1 -- start start 2024-09-06T14:48:28.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bf9ce640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59b8101960 0x7f59b819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bf9ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8107960 0x7f59b819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bf9ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59b810ee90 con 0x7f59b8107960 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bf9ce640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59b810ed10 con 0x7f59b8101960 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bcf69640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8107960 0x7f59b819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bcf69640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8107960 0x7f59b819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55522/0 (socket says 172.21.15.52:55522) 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bcf69640 1 -- 172.21.15.52:0/3691187887 learned_addr learned my addr 172.21.15.52:0/3691187887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bd76a640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59b8101960 0x7f59b819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bcf69640 1 -- 172.21.15.52:0/3691187887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59b8101960 msgr2=0x7f59b819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bcf69640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59b8101960 0x7f59b819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bcf69640 1 -- 172.21.15.52:0/3691187887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b8197880 con 0x7f59b8107960 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.216+0000 7f59bcf69640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8107960 0x7f59b819dc00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f59a8031460 tx=0x7f59a80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:28.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.217+0000 7f59ae7fc640 1 -- 172.21.15.52:0/3691187887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59a803f070 con 0x7f59b8107960 2024-09-06T14:48:28.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.217+0000 7f59ae7fc640 1 -- 172.21.15.52:0/3691187887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59a8004cf0 con 0x7f59b8107960 2024-09-06T14:48:28.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.217+0000 7f59ae7fc640 1 -- 172.21.15.52:0/3691187887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59a8035030 con 0x7f59b8107960 2024-09-06T14:48:28.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.217+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b8197b10 con 0x7f59b8107960 2024-09-06T14:48:28.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.217+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b8198040 con 0x7f59b8107960 2024-09-06T14:48:28.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.218+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b81030a0 con 0x7f59b8107960 2024-09-06T14:48:28.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.219+0000 7f59ae7fc640 1 -- 172.21.15.52:0/3691187887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f59a8042070 con 0x7f59b8107960 2024-09-06T14:48:28.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.219+0000 7f59ae7fc640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59a40774b0 0x7f59a4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:28.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.220+0000 7f59ae7fc640 1 -- 172.21.15.52:0/3691187887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f59a80ba7b0 con 0x7f59b8107960 2024-09-06T14:48:28.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.220+0000 7f59bd76a640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59a40774b0 0x7f59a4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:28.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.220+0000 7f59bd76a640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59a40774b0 0x7f59a4079970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59b81989c0 tx=0x7f59b4008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:28.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.223+0000 7f59ae7fc640 1 -- 172.21.15.52:0/3691187887 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f59a80838c0 con 0x7f59b8107960 2024-09-06T14:48:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.446+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f59b8109ef0 con 0x7f59b8107960 2024-09-06T14:48:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.447+0000 7f59ae7fc640 1 -- 172.21.15.52:0/3691187887 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f59a8087a30 con 0x7f59b8107960 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59a40774b0 msgr2=0x7f59a4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59a40774b0 0x7f59a4079970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59b81989c0 tx=0x7f59b4008040 comp rx=0 tx=0).stop 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8107960 msgr2=0x7f59b819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8107960 0x7f59b819dc00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f59a8031460 tx=0x7f59a80048f0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 shutdown_connections 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59b8107960 0x7f59b819dc00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59a40774b0 0x7f59a4079970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 --2- 172.21.15.52:0/3691187887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59b8101960 0x7f59b819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:28.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 >> 172.21.15.52:0/3691187887 conn(0x7f59b80fd680 msgr2=0x7f59b80fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:28.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 shutdown_connections 2024-09-06T14:48:28.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:28.450+0000 7f59bf9ce640 1 -- 172.21.15.52:0/3691187887 wait complete. 2024-09-06T14:48:28.459 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:48:28.906 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:28 smithi052 ceph-mon[28627]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:28.906 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:28 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3691187887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:29.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:28 smithi165 ceph-mon[36229]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:29.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:28 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3691187887' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:29.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-06T14:48:29.356 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 -- 172.21.15.52:0/3350399947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 msgr2=0x7f880c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 --2- 172.21.15.52:0/3350399947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c106bd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009880 tx=0x7f87fc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 -- 172.21.15.52:0/3350399947 shutdown_connections 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 --2- 172.21.15.52:0/3350399947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f880c1007f0 0x7f880c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 --2- 172.21.15.52:0/3350399947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c106bd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 -- 172.21.15.52:0/3350399947 >> 172.21.15.52:0/3350399947 conn(0x7f880c0fc550 msgr2=0x7f880c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 -- 172.21.15.52:0/3350399947 shutdown_connections 2024-09-06T14:48:29.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.827+0000 7f88108d9640 1 -- 172.21.15.52:0/3350399947 wait complete. 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f88108d9640 1 Processor -- start 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f88108d9640 1 -- start start 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f88108d9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f880c1007f0 0x7f880c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f88108d9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f88108d9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f880c10dd20 con 0x7f880c1067f0 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f88108d9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f880c10dba0 con 0x7f880c1007f0 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f8809d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f8809d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55546/0 (socket says 172.21.15.52:55546) 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.828+0000 7f8809d9b640 1 -- 172.21.15.52:0/2412695105 learned_addr learned my addr 172.21.15.52:0/2412695105 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f880a59c640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f880c1007f0 0x7f880c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:29.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f8809d9b640 1 -- 172.21.15.52:0/2412695105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f880c1007f0 msgr2=0x7f880c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f8809d9b640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f880c1007f0 0x7f880c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f8809d9b640 1 -- 172.21.15.52:0/2412695105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c197800 con 0x7f880c1067f0 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f8809d9b640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c19dbc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f880000b420 tx=0x7f880000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f87fb7fe640 1 -- 172.21.15.52:0/2412695105 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8800011630 con 0x7f880c1067f0 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f87fb7fe640 1 -- 172.21.15.52:0/2412695105 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8800016070 con 0x7f880c1067f0 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880c197af0 con 0x7f880c1067f0 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f87fb7fe640 1 -- 172.21.15.52:0/2412695105 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8800010d40 con 0x7f880c1067f0 2024-09-06T14:48:29.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.829+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880c198080 con 0x7f880c1067f0 2024-09-06T14:48:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.830+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f880c101f30 con 0x7f880c1067f0 2024-09-06T14:48:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.831+0000 7f87fb7fe640 1 -- 172.21.15.52:0/2412695105 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f880001b460 con 0x7f880c1067f0 2024-09-06T14:48:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.831+0000 7f87fb7fe640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87f40774b0 0x7f87f4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.832+0000 7f87fb7fe640 1 -- 172.21.15.52:0/2412695105 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f8800098cf0 con 0x7f880c1067f0 2024-09-06T14:48:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.832+0000 7f880a59c640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87f40774b0 0x7f87f4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:29.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.832+0000 7f880a59c640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87f40774b0 0x7f87f4079970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0096c0 tx=0x7f87fc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:29.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:29.836+0000 7f87fb7fe640 1 -- 172.21.15.52:0/2412695105 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f880009d070 con 0x7f880c1067f0 2024-09-06T14:48:30.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:30.013+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "target": ["mon-mgr", ""]}) -- 0x7f880c198390 con 0x7f87f40774b0 2024-09-06T14:48:31.052 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:30 smithi052 ceph-mon[28627]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:31.052 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:30 smithi052 ceph-mon[28627]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:31.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:30 smithi165 ceph-mon[36229]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:31.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:30 smithi165 ceph-mon[36229]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:32.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.029+0000 7f87fb7fe640 1 -- 172.21.15.52:0/2412695105 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f880c198390 con 0x7f87f40774b0 2024-09-06T14:48:32.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.031+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87f40774b0 msgr2=0x7f87f4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:32.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.031+0000 7f88108d9640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87f40774b0 0x7f87f4079970 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0096c0 tx=0x7f87fc031400 comp rx=0 tx=0).stop 2024-09-06T14:48:32.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 msgr2=0x7f880c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:32.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c19dbc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f880000b420 tx=0x7f880000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:48:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 shutdown_connections 2024-09-06T14:48:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f880c1067f0 0x7f880c19dbc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87f40774b0 0x7f87f4079970 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 --2- 172.21.15.52:0/2412695105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f880c1007f0 0x7f880c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 >> 172.21.15.52:0/2412695105 conn(0x7f880c0fc550 msgr2=0x7f880c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 shutdown_connections 2024-09-06T14:48:32.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:32.032+0000 7f88108d9640 1 -- 172.21.15.52:0/2412695105 wait complete. 2024-09-06T14:48:32.038 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:48:32.655 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph orch ps' 2024-09-06T14:48:32.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:32 smithi052 ceph-mon[28627]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:32.924 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:32.954 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:32 smithi165 ceph-mon[36229]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.369+0000 7faab963b640 1 -- 172.21.15.52:0/3389736571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4102b70 msgr2=0x7faab4102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.369+0000 7faab963b640 1 --2- 172.21.15.52:0/3389736571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4102b70 0x7faab4102f50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faaac009c20 tx=0x7faaac02aa00 comp rx=0 tx=0).stop 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 -- 172.21.15.52:0/3389736571 shutdown_connections 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 --2- 172.21.15.52:0/3389736571 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faab4103490 0x7faab410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 --2- 172.21.15.52:0/3389736571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4102b70 0x7faab4102f50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 -- 172.21.15.52:0/3389736571 >> 172.21.15.52:0/3389736571 conn(0x7faab40fc550 msgr2=0x7faab40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 -- 172.21.15.52:0/3389736571 shutdown_connections 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 -- 172.21.15.52:0/3389736571 wait complete. 2024-09-06T14:48:33.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 Processor -- start 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.370+0000 7faab963b640 1 -- start start 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab963b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faab4102b70 0x7faab419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab963b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4103490 0x7faab419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab963b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faab410edc0 con 0x7faab4103490 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab963b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faab410ec40 con 0x7faab4102b70 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4103490 0x7faab419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4103490 0x7faab419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51872/0 (socket says 172.21.15.52:51872) 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab27fc640 1 -- 172.21.15.52:0/3492301901 learned_addr learned my addr 172.21.15.52:0/3492301901 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab2ffd640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faab4102b70 0x7faab419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab27fc640 1 -- 172.21.15.52:0/3492301901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faab4102b70 msgr2=0x7faab419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab27fc640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faab4102b70 0x7faab419f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:33.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab27fc640 1 -- 172.21.15.52:0/3492301901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab4199970 con 0x7faab4103490 2024-09-06T14:48:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab27fc640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4103490 0x7faab419fcf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00d8d0 tx=0x7faa9c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faaabfff640 1 -- 172.21.15.52:0/3492301901 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa9c017030 con 0x7faab4103490 2024-09-06T14:48:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faaabfff640 1 -- 172.21.15.52:0/3492301901 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa9c004020 con 0x7faab4103490 2024-09-06T14:48:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.371+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab4199c60 con 0x7faab4103490 2024-09-06T14:48:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.372+0000 7faaabfff640 1 -- 172.21.15.52:0/3492301901 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa9c0047a0 con 0x7faab4103490 2024-09-06T14:48:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.372+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab419a1f0 con 0x7faab4103490 2024-09-06T14:48:33.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.373+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faab406a4c0 con 0x7faab4103490 2024-09-06T14:48:33.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.373+0000 7faaabfff640 1 -- 172.21.15.52:0/3492301901 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7faa9c0041d0 con 0x7faab4103490 2024-09-06T14:48:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.374+0000 7faaabfff640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faaa0077460 0x7faaa0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.374+0000 7faaabfff640 1 -- 172.21.15.52:0/3492301901 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7faa9c018070 con 0x7faab4103490 2024-09-06T14:48:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.374+0000 7faab2ffd640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faaa0077460 0x7faaa0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.374+0000 7faab2ffd640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faaa0077460 0x7faaa0079920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faaac006010 tx=0x7faaac009820 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:33.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.378+0000 7faaabfff640 1 -- 172.21.15.52:0/3492301901 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7faa9c062550 con 0x7faab4103490 2024-09-06T14:48:33.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.545+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7faab419aea0 con 0x7faaa0077460 2024-09-06T14:48:33.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.555+0000 7faaabfff640 1 -- 172.21.15.52:0/3492301901 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7faab419aea0 con 0x7faaa0077460 2024-09-06T14:48:33.552 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:48:33.552 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (59s) 29s ago 11m 17.7M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:48:33.552 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (3m) 29s ago 12m 8652k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:48:33.552 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (3m) 100s ago 11m 8522k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (12m) 29s ago 12m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (11m) 100s ago 11m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (36s) 29s ago 11m 47.1M - c8b91775d855 af78eb451b94 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (6m) 29s ago 6m 88.8M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (6m) 29s ago 6m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (6m) 100s ago 6m 26.6M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (6m) 100s ago 6m 26.2M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (3m) 29s ago 13m 517M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (2m) 100s ago 11m 454M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:48:33.553 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (13m) 29s ago 13m 59.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (10m) 100s ago 10m 42.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (110s) 29s ago 11m 10.5M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (103s) 100s ago 11m 3649k - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (9m) 29s ago 9m 195M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (9m) 29s ago 9m 219M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (9m) 29s ago 9m 183M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (8m) 100s ago 8m 237M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (8m) 100s ago 8m 208M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (7m) 100s ago 7m 183M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:48:33.554 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (80s) 29s ago 11m 43.6M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:48:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faaa0077460 msgr2=0x7faaa0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faaa0077460 0x7faaa0079920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faaac006010 tx=0x7faaac009820 comp rx=0 tx=0).stop 2024-09-06T14:48:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4103490 msgr2=0x7faab419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4103490 0x7faab419fcf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00d8d0 tx=0x7faa9c00dd90 comp rx=0 tx=0).stop 2024-09-06T14:48:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 shutdown_connections 2024-09-06T14:48:33.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faab4103490 0x7faab419fcf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faaa0077460 0x7faaa0079920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 --2- 172.21.15.52:0/3492301901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faab4102b70 0x7faab419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 >> 172.21.15.52:0/3492301901 conn(0x7faab40fc550 msgr2=0x7faab4100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 shutdown_connections 2024-09-06T14:48:33.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:33.557+0000 7faab963b640 1 -- 172.21.15.52:0/3492301901 wait complete. 2024-09-06T14:48:34.210 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-06T14:48:34.211 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:48:34.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-06T14:48:34.467 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:34.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:34 smithi052 ceph-mon[28627]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:34.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:34 smithi052 ceph-mon[28627]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 -- 172.21.15.52:0/1873553227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 msgr2=0x7f0b1c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 --2- 172.21.15.52:0/1873553227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c100710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009880 tx=0x7f0b0c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 -- 172.21.15.52:0/1873553227 shutdown_connections 2024-09-06T14:48:35.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 --2- 172.21.15.52:0/1873553227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b1c100ce0 0x7f0b1c1065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 --2- 172.21.15.52:0/1873553227 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c100710 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 -- 172.21.15.52:0/1873553227 >> 172.21.15.52:0/1873553227 conn(0x7f0b1c077270 msgr2=0x7f0b1c077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 -- 172.21.15.52:0/1873553227 shutdown_connections 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 -- 172.21.15.52:0/1873553227 wait complete. 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 Processor -- start 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.013+0000 7f0b228a7640 1 -- start start 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b228a7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b228a7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b1c100ce0 0x7f0b1c19dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b228a7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c10ee70 con 0x7f0b1c100330 2024-09-06T14:48:35.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b228a7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c10ecf0 con 0x7f0b1c100ce0 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51882/0 (socket says 172.21.15.52:51882) 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1bfff640 1 -- 172.21.15.52:0/340171541 learned_addr learned my addr 172.21.15.52:0/340171541 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1b7fe640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b1c100ce0 0x7f0b1c19dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1bfff640 1 -- 172.21.15.52:0/340171541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b1c100ce0 msgr2=0x7f0b1c19dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1bfff640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b1c100ce0 0x7f0b1c19dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1bfff640 1 -- 172.21.15.52:0/340171541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c1978a0 con 0x7f0b1c100330 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b1bfff640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c19d6e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c031460 tx=0x7f0b0c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.014+0000 7f0b197fa640 1 -- 172.21.15.52:0/340171541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c03f070 con 0x7f0b1c100330 2024-09-06T14:48:35.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.015+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1c197b30 con 0x7f0b1c100330 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.015+0000 7f0b197fa640 1 -- 172.21.15.52:0/340171541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b0c004cf0 con 0x7f0b1c100330 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.015+0000 7f0b197fa640 1 -- 172.21.15.52:0/340171541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c035030 con 0x7f0b1c100330 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.015+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1c198060 con 0x7f0b1c100330 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.016+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b1c069e00 con 0x7f0b1c100330 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.016+0000 7f0b197fa640 1 -- 172.21.15.52:0/340171541 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0b0c042070 con 0x7f0b1c100330 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.017+0000 7f0b197fa640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b04077460 0x7f0b04079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.017+0000 7f0b197fa640 1 -- 172.21.15.52:0/340171541 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f0b0c0ba110 con 0x7f0b1c100330 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.017+0000 7f0b1b7fe640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b04077460 0x7f0b04079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.017+0000 7f0b1b7fe640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b04077460 0x7f0b04079920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0ffca0 tx=0x7f0b10008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:35.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.021+0000 7f0b197fa640 1 -- 172.21.15.52:0/340171541 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f0b0c083240 con 0x7f0b1c100330 2024-09-06T14:48:35.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:34 smithi165 ceph-mon[36229]: from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:35.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:34 smithi165 ceph-mon[36229]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:35.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.180+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f0b1c198dd0 con 0x7f0b1c100330 2024-09-06T14:48:35.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.184+0000 7f0b197fa640 1 -- 172.21.15.52:0/340171541 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v66)=0 v66) ==== 125+0+0 (secure 0 0 0) 0x7f0b0c0873b0 con 0x7f0b1c100330 2024-09-06T14:48:35.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b04077460 msgr2=0x7f0b04079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:35.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b04077460 0x7f0b04079920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0ffca0 tx=0x7f0b10008040 comp rx=0 tx=0).stop 2024-09-06T14:48:35.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 msgr2=0x7f0b1c19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:35.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c19d6e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c031460 tx=0x7f0b0c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 shutdown_connections 2024-09-06T14:48:35.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b04077460 0x7f0b04079920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b1c100ce0 0x7f0b1c19dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 --2- 172.21.15.52:0/340171541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b1c100330 0x7f0b1c19d6e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 >> 172.21.15.52:0/340171541 conn(0x7f0b1c077270 msgr2=0x7f0b1c0fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 shutdown_connections 2024-09-06T14:48:35.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:35.186+0000 7f0b228a7640 1 -- 172.21.15.52:0/340171541 wait complete. 2024-09-06T14:48:35.809 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-06T14:48:35.809 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:48:35.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-06T14:48:36.063 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:36.568 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/340171541' entity='client.admin' 2024-09-06T14:48:36.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:36.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:36.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:36.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:36.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:36.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:36.569 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:36 smithi052 ceph-mon[28627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/340171541' entity='client.admin' 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:36.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:36 smithi165 ceph-mon[36229]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:36.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 -- 172.21.15.52:0/1774683248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac100650 msgr2=0x7f2aac100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:36.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 --2- 172.21.15.52:0/1774683248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac100650 0x7f2aac100a30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009880 tx=0x7f2aa002a490 comp rx=0 tx=0).stop 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 -- 172.21.15.52:0/1774683248 shutdown_connections 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 --2- 172.21.15.52:0/1774683248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac101000 0x7f2aac10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 --2- 172.21.15.52:0/1774683248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac100650 0x7f2aac100a30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 -- 172.21.15.52:0/1774683248 >> 172.21.15.52:0/1774683248 conn(0x7f2aac0fc520 msgr2=0x7f2aac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 -- 172.21.15.52:0/1774683248 shutdown_connections 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 -- 172.21.15.52:0/1774683248 wait complete. 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 Processor -- start 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.657+0000 7f2ab32de640 1 -- start start 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab32de640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac100650 0x7f2aac19f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab32de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac101000 0x7f2aac19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:36.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab32de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac110f90 con 0x7f2aac101000 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab32de640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac110e10 con 0x7f2aac100650 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab0879640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac101000 0x7f2aac19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab0879640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac101000 0x7f2aac19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51906/0 (socket says 172.21.15.52:51906) 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab0879640 1 -- 172.21.15.52:0/4054357673 learned_addr learned my addr 172.21.15.52:0/4054357673 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab107a640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac100650 0x7f2aac19f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab0879640 1 -- 172.21.15.52:0/4054357673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac100650 msgr2=0x7f2aac19f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab0879640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac100650 0x7f2aac19f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab0879640 1 -- 172.21.15.52:0/4054357673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac1a03b0 con 0x7f2aac101000 2024-09-06T14:48:36.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab0879640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac101000 0x7f2aac19fd00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c8a0 tx=0x7f2aa800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2a9e7fc640 1 -- 172.21.15.52:0/4054357673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2aa80079b0 con 0x7f2aac101000 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac199aa0 con 0x7f2aac101000 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2a9e7fc640 1 -- 172.21.15.52:0/4054357673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2aa8007b50 con 0x7f2aac101000 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2a9e7fc640 1 -- 172.21.15.52:0/4054357673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2aa8018700 con 0x7f2aac101000 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.658+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac19a000 con 0x7f2aac101000 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.659+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac06aa90 con 0x7f2aac101000 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.660+0000 7f2a9e7fc640 1 -- 172.21.15.52:0/4054357673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2aa8007d00 con 0x7f2aac101000 2024-09-06T14:48:36.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.660+0000 7f2a9e7fc640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a98077460 0x7f2a98079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:36.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.660+0000 7f2a9e7fc640 1 -- 172.21.15.52:0/4054357673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f2aa80998b0 con 0x7f2aac101000 2024-09-06T14:48:36.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.661+0000 7f2ab107a640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a98077460 0x7f2a98079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:36.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.661+0000 7f2ab107a640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a98077460 0x7f2a98079920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0000c00 tx=0x7f2aa0004120 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:36.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.665+0000 7f2a9e7fc640 1 -- 172.21.15.52:0/4054357673 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f2aa8014030 con 0x7f2aac101000 2024-09-06T14:48:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.827+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f2aac19aeb0 con 0x7f2aac101000 2024-09-06T14:48:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.827+0000 7f2a9e7fc640 1 -- 172.21.15.52:0/4054357673 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v66)=0 v66) ==== 155+0+0 (secure 0 0 0) 0x7f2aa80629e0 con 0x7f2aac101000 2024-09-06T14:48:36.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a98077460 msgr2=0x7f2a98079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a98077460 0x7f2a98079920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0000c00 tx=0x7f2aa0004120 comp rx=0 tx=0).stop 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac101000 msgr2=0x7f2aac19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac101000 0x7f2aac19fd00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2aa800c8a0 tx=0x7f2aa800cd60 comp rx=0 tx=0).stop 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 shutdown_connections 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2aac101000 0x7f2aac19fd00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a98077460 0x7f2a98079920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 --2- 172.21.15.52:0/4054357673 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2aac100650 0x7f2aac19f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:36.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 >> 172.21.15.52:0/4054357673 conn(0x7f2aac0fc520 msgr2=0x7f2aac0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:36.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 shutdown_connections 2024-09-06T14:48:36.828 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:36.829+0000 7f2ab32de640 1 -- 172.21.15.52:0/4054357673 wait complete. 2024-09-06T14:48:37.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-06T14:48:37.676 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:37.925 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:37 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:38.049 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:37 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:38.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 -- 172.21.15.52:0/3440344377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 msgr2=0x7fde00101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:38.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3440344377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde00101d60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009880 tx=0x7fddf002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 -- 172.21.15.52:0/3440344377 shutdown_connections 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3440344377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde00101d60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3440344377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde00107900 0x7fde00107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 -- 172.21.15.52:0/3440344377 >> 172.21.15.52:0/3440344377 conn(0x7fde000fd600 msgr2=0x7fde000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 -- 172.21.15.52:0/3440344377 shutdown_connections 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.282+0000 7fde07d7a640 1 -- 172.21.15.52:0/3440344377 wait complete. 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde07d7a640 1 Processor -- start 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde07d7a640 1 -- start start 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde07d7a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde0019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde07d7a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde00107900 0x7fde0019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:38.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde07d7a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fde0010ee30 con 0x7fde00101900 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde07d7a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fde0010ecb0 con 0x7fde00107900 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde05b16640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde0019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde05b16640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde0019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51932/0 (socket says 172.21.15.52:51932) 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde05b16640 1 -- 172.21.15.52:0/3054869745 learned_addr learned my addr 172.21.15.52:0/3054869745 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde05b16640 1 -- 172.21.15.52:0/3054869745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde00107900 msgr2=0x7fde0019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde05b16640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde00107900 0x7fde0019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.283+0000 7fde05b16640 1 -- 172.21.15.52:0/3054869745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde00197880 con 0x7fde00101900 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.284+0000 7fde05b16640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde0019d6c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00b420 tx=0x7fddfc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.284+0000 7fddf6ffd640 1 -- 172.21.15.52:0/3054869745 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fddfc011630 con 0x7fde00101900 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.284+0000 7fddf6ffd640 1 -- 172.21.15.52:0/3054869745 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fddfc016070 con 0x7fde00101900 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.284+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde00197b70 con 0x7fde00101900 2024-09-06T14:48:38.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.284+0000 7fddf6ffd640 1 -- 172.21.15.52:0/3054869745 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fddfc010d40 con 0x7fde00101900 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.284+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde00198100 con 0x7fde00101900 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.285+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde00103040 con 0x7fde00101900 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.285+0000 7fddf6ffd640 1 -- 172.21.15.52:0/3054869745 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fddfc01b460 con 0x7fde00101900 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.286+0000 7fddf6ffd640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fddec077460 0x7fddec079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.286+0000 7fddf6ffd640 1 -- 172.21.15.52:0/3054869745 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fddfc098dd0 con 0x7fde00101900 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.286+0000 7fde05315640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fddec077460 0x7fddec079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.286+0000 7fde05315640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fddec077460 0x7fddec079920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fddf00096c0 tx=0x7fddf0000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:38.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.290+0000 7fddf6ffd640 1 -- 172.21.15.52:0/3054869745 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fddfc061e60 con 0x7fde00101900 2024-09-06T14:48:38.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.447+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fde00198db0 con 0x7fde00101900 2024-09-06T14:48:38.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.448+0000 7fddf6ffd640 1 -- 172.21.15.52:0/3054869745 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v66)=0 v66) ==== 163+0+0 (secure 0 0 0) 0x7fddfc065fd0 con 0x7fde00101900 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fddec077460 msgr2=0x7fddec079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fddec077460 0x7fddec079920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fddf00096c0 tx=0x7fddf0000bc0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 msgr2=0x7fde0019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde0019d6c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00b420 tx=0x7fddfc00b8e0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 shutdown_connections 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fddec077460 0x7fddec079920 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde00107900 0x7fde0019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 --2- 172.21.15.52:0/3054869745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde00101900 0x7fde0019d6c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:38.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 >> 172.21.15.52:0/3054869745 conn(0x7fde000fd600 msgr2=0x7fde000fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 shutdown_connections 2024-09-06T14:48:38.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:38.450+0000 7fde07d7a640 1 -- 172.21.15.52:0/3054869745 wait complete. 2024-09-06T14:48:38.739 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:38 smithi052 ceph-mon[28627]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:39.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-06T14:48:39.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:38 smithi165 ceph-mon[36229]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:39.288 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:39.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 -- 172.21.15.52:0/533996593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4101900 msgr2=0x7efda4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:39.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 --2- 172.21.15.52:0/533996593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4101900 0x7efda4101d60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009880 tx=0x7efd8c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 -- 172.21.15.52:0/533996593 shutdown_connections 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 --2- 172.21.15.52:0/533996593 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4101900 0x7efda4101d60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 --2- 172.21.15.52:0/533996593 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4107900 0x7efda4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 -- 172.21.15.52:0/533996593 >> 172.21.15.52:0/533996593 conn(0x7efda40fd600 msgr2=0x7efda40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 -- 172.21.15.52:0/533996593 shutdown_connections 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.925+0000 7efdaa81a640 1 -- 172.21.15.52:0/533996593 wait complete. 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efdaa81a640 1 Processor -- start 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efdaa81a640 1 -- start start 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efdaa81a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101900 0x7efda419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efdaa81a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4107900 0x7efda419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efdaa81a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efda410ee30 con 0x7efda4107900 2024-09-06T14:48:39.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efdaa81a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efda410ecb0 con 0x7efda4101900 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efd9bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4107900 0x7efda419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efd9bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4107900 0x7efda419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51956/0 (socket says 172.21.15.52:51956) 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efd9bfff640 1 -- 172.21.15.52:0/670977256 learned_addr learned my addr 172.21.15.52:0/670977256 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.926+0000 7efda3fff640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101900 0x7efda419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efd9bfff640 1 -- 172.21.15.52:0/670977256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101900 msgr2=0x7efda419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efd9bfff640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101900 0x7efda419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efd9bfff640 1 -- 172.21.15.52:0/670977256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda4197880 con 0x7efda4107900 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efda3fff640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101900 0x7efda419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efd9bfff640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4107900 0x7efda419dc00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efd8c031460 tx=0x7efd8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efda1ffb640 1 -- 172.21.15.52:0/670977256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd8c03f070 con 0x7efda4107900 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efda1ffb640 1 -- 172.21.15.52:0/670977256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd8c004cf0 con 0x7efda4107900 2024-09-06T14:48:39.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda4197b10 con 0x7efda4107900 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efda1ffb640 1 -- 172.21.15.52:0/670977256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd8c035030 con 0x7efda4107900 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.927+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda4198040 con 0x7efda4107900 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.928+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda4103040 con 0x7efda4107900 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.929+0000 7efda1ffb640 1 -- 172.21.15.52:0/670977256 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7efd8c042070 con 0x7efda4107900 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.929+0000 7efda1ffb640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7efd90077460 0x7efd90079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.929+0000 7efda1ffb640 1 -- 172.21.15.52:0/670977256 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7efd8c0ba110 con 0x7efda4107900 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.929+0000 7efda3fff640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7efd90077460 0x7efd90079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.930+0000 7efda3fff640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7efd90077460 0x7efd90079920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efda41989c0 tx=0x7efd94008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:39.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:39.933+0000 7efda1ffb640 1 -- 172.21.15.52:0/670977256 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7efd8c083240 con 0x7efda4107900 2024-09-06T14:48:40.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.092+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7efda4198db0 con 0x7efda4107900 2024-09-06T14:48:40.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.092+0000 7efda1ffb640 1 -- 172.21.15.52:0/670977256 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v66)=0 v66) ==== 135+0+0 (secure 0 0 0) 0x7efd8c0873b0 con 0x7efda4107900 2024-09-06T14:48:40.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7efd90077460 msgr2=0x7efd90079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:40.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7efd90077460 0x7efd90079920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efda41989c0 tx=0x7efd94008040 comp rx=0 tx=0).stop 2024-09-06T14:48:40.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4107900 msgr2=0x7efda419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:40.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4107900 0x7efda419dc00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efd8c031460 tx=0x7efd8c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:48:40.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 shutdown_connections 2024-09-06T14:48:40.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efda4107900 0x7efda419dc00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:40.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7efd90077460 0x7efd90079920 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:40.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 --2- 172.21.15.52:0/670977256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efda4101900 0x7efda419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:40.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.094+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 >> 172.21.15.52:0/670977256 conn(0x7efda40fd600 msgr2=0x7efda40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:40.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.095+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 shutdown_connections 2024-09-06T14:48:40.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:40.095+0000 7efdaa81a640 1 -- 172.21.15.52:0/670977256 wait complete. 2024-09-06T14:48:40.756 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:40 smithi052 ceph-mon[28627]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:40.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-06T14:48:41.038 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:41.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:40 smithi165 ceph-mon[36229]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 -- 172.21.15.52:0/451291407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 msgr2=0x7f1298106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 --2- 172.21.15.52:0/451291407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f1298106bd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1294009880 tx=0x7f129402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 -- 172.21.15.52:0/451291407 shutdown_connections 2024-09-06T14:48:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 --2- 172.21.15.52:0/451291407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12981007f0 0x7f1298100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 --2- 172.21.15.52:0/451291407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f1298106bd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 -- 172.21.15.52:0/451291407 >> 172.21.15.52:0/451291407 conn(0x7f12980fc550 msgr2=0x7f12980fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:41.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 -- 172.21.15.52:0/451291407 shutdown_connections 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 -- 172.21.15.52:0/451291407 wait complete. 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 Processor -- start 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.623+0000 7f129fafe640 1 -- start start 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129fafe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12981007f0 0x7f129819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129fafe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f129819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129fafe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f129810dd20 con 0x7f12981067f0 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129fafe640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f129810dba0 con 0x7f12981007f0 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d099640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f129819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:41.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d099640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f129819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55854/0 (socket says 172.21.15.52:55854) 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d099640 1 -- 172.21.15.52:0/3031410174 learned_addr learned my addr 172.21.15.52:0/3031410174 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d89a640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12981007f0 0x7f129819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d099640 1 -- 172.21.15.52:0/3031410174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12981007f0 msgr2=0x7f129819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d099640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12981007f0 0x7f129819c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d099640 1 -- 172.21.15.52:0/3031410174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1298196830 con 0x7f12981067f0 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129d099640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f129819cbf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f128800b420 tx=0x7f128800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f128effd640 1 -- 172.21.15.52:0/3031410174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1288011630 con 0x7f12981067f0 2024-09-06T14:48:41.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f128effd640 1 -- 172.21.15.52:0/3031410174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1288016070 con 0x7f12981067f0 2024-09-06T14:48:41.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f128effd640 1 -- 172.21.15.52:0/3031410174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1288010d40 con 0x7f12981067f0 2024-09-06T14:48:41.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.624+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1298196b20 con 0x7f12981067f0 2024-09-06T14:48:41.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.625+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12981970b0 con 0x7f12981067f0 2024-09-06T14:48:41.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.626+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1298101f30 con 0x7f12981067f0 2024-09-06T14:48:41.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.626+0000 7f128effd640 1 -- 172.21.15.52:0/3031410174 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f128801b460 con 0x7f12981067f0 2024-09-06T14:48:41.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.627+0000 7f128effd640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1284077460 0x7f1284079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:41.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.627+0000 7f128effd640 1 -- 172.21.15.52:0/3031410174 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f1288098d70 con 0x7f12981067f0 2024-09-06T14:48:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.627+0000 7f129d89a640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1284077460 0x7f1284079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:41.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.627+0000 7f129d89a640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1284077460 0x7f1284079920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1294031460 tx=0x7f1294009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:41.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.631+0000 7f128effd640 1 -- 172.21.15.52:0/3031410174 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f1288021250 con 0x7f12981067f0 2024-09-06T14:48:41.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.807+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "target": ["mon-mgr", ""]}) -- 0x7f12981973c0 con 0x7f1284077460 2024-09-06T14:48:41.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.812+0000 7f128effd640 1 -- 172.21.15.52:0/3031410174 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f12981973c0 con 0x7f1284077460 2024-09-06T14:48:41.811 INFO:teuthology.orchestra.run.smithi052.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:48:41.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1284077460 msgr2=0x7f1284079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:41.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1284077460 0x7f1284079920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1294031460 tx=0x7f1294009560 comp rx=0 tx=0).stop 2024-09-06T14:48:41.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 msgr2=0x7f129819cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:41.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f129819cbf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f128800b420 tx=0x7f128800b8e0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 shutdown_connections 2024-09-06T14:48:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f12981067f0 0x7f129819cbf0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1284077460 0x7f1284079920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 --2- 172.21.15.52:0/3031410174 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12981007f0 0x7f129819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 >> 172.21.15.52:0/3031410174 conn(0x7f12980fc550 msgr2=0x7f12980fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 shutdown_connections 2024-09-06T14:48:41.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:41.815+0000 7f129fafe640 1 -- 172.21.15.52:0/3031410174 wait complete. 2024-09-06T14:48:42.504 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-06T14:48:42.505 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T14:48:42.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-06T14:48:42.799 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T14:48:43.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:43.169 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:42 smithi165 ceph-mon[36229]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:48:43.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:43.171 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:42 smithi052 ceph-mon[28627]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 2024-09-06T14:48:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 -- 172.21.15.52:0/626083678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc1001d0 msgr2=0x7ff0dc100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 --2- 172.21.15.52:0/626083678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc1001d0 0x7ff0dc100630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009880 tx=0x7ff0d002a530 comp rx=0 tx=0).stop 2024-09-06T14:48:43.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 -- 172.21.15.52:0/626083678 shutdown_connections 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 --2- 172.21.15.52:0/626083678 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc1001d0 0x7ff0dc100630 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 --2- 172.21.15.52:0/626083678 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0dc107b00 0x7ff0dc107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 -- 172.21.15.52:0/626083678 >> 172.21.15.52:0/626083678 conn(0x7ff0dc0771e0 msgr2=0x7ff0dc0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 -- 172.21.15.52:0/626083678 shutdown_connections 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.425+0000 7ff0e242b640 1 -- 172.21.15.52:0/626083678 wait complete. 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0e242b640 1 Processor -- start 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0e242b640 1 -- start start 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0e242b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0dc1001d0 0x7ff0dc19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0e242b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc107b00 0x7ff0dc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0e242b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc10ee40 con 0x7ff0dc107b00 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0e242b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc10ecc0 con 0x7ff0dc1001d0 2024-09-06T14:48:43.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc107b00 0x7ff0dc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0db7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc107b00 0x7ff0dc19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55884/0 (socket says 172.21.15.52:55884) 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0db7fe640 1 -- 172.21.15.52:0/1032158209 learned_addr learned my addr 172.21.15.52:0/1032158209 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.426+0000 7ff0dbfff640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0dc1001d0 0x7ff0dc19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0dbfff640 1 -- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc107b00 msgr2=0x7ff0dc19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0dbfff640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc107b00 0x7ff0dc19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0dbfff640 1 -- 172.21.15.52:0/1032158209 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc1999a0 con 0x7ff0dc1001d0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0db7fe640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc107b00 0x7ff0dc19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0dbfff640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0dc1001d0 0x7ff0dc19f7e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00e970 tx=0x7ff0cc00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0d97fa640 1 -- 172.21.15.52:0/1032158209 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0cc00cac0 con 0x7ff0dc1001d0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc199c90 con 0x7ff0dc1001d0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0d97fa640 1 -- 172.21.15.52:0/1032158209 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0cc00cc60 con 0x7ff0dc1001d0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0d97fa640 1 -- 172.21.15.52:0/1032158209 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0cc0047a0 con 0x7ff0dc1001d0 2024-09-06T14:48:43.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.427+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc19a1f0 con 0x7ff0dc1001d0 2024-09-06T14:48:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.428+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc0697e0 con 0x7ff0dc1001d0 2024-09-06T14:48:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.429+0000 7ff0d97fa640 1 -- 172.21.15.52:0/1032158209 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff0cc004a90 con 0x7ff0dc1001d0 2024-09-06T14:48:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.430+0000 7ff0d97fa640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff0c4077460 0x7ff0c4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.430+0000 7ff0d97fa640 1 -- 172.21.15.52:0/1032158209 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7ff0cc099a30 con 0x7ff0dc1001d0 2024-09-06T14:48:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.430+0000 7ff0db7fe640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff0c4077460 0x7ff0c4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.430+0000 7ff0db7fe640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff0c4077460 0x7ff0c4079920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc19b190 tx=0x7ff0d00058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.434+0000 7ff0d97fa640 1 -- 172.21.15.52:0/1032158209 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7ff0cc062b60 con 0x7ff0dc1001d0 2024-09-06T14:48:43.618 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.620+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff0dc19aed0 con 0x7ff0c4077460 2024-09-06T14:48:43.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.621+0000 7ff0d97fa640 1 -- 172.21.15.52:0/1032158209 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7ff0dc19aed0 con 0x7ff0c4077460 2024-09-06T14:48:43.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff0c4077460 msgr2=0x7ff0c4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff0c4077460 0x7ff0c4079920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc19b190 tx=0x7ff0d00058d0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0dc1001d0 msgr2=0x7ff0dc19f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0dc1001d0 0x7ff0dc19f7e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00e970 tx=0x7ff0cc00ee30 comp rx=0 tx=0).stop 2024-09-06T14:48:43.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 shutdown_connections 2024-09-06T14:48:43.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0dc107b00 0x7ff0dc19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff0c4077460 0x7ff0c4079920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 --2- 172.21.15.52:0/1032158209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0dc1001d0 0x7ff0dc19f7e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 >> 172.21.15.52:0/1032158209 conn(0x7ff0dc0771e0 msgr2=0x7ff0dc0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:43.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 shutdown_connections 2024-09-06T14:48:43.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.623+0000 7ff0e242b640 1 -- 172.21.15.52:0/1032158209 wait complete. 2024-09-06T14:48:43.630 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:48:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.707+0000 7f9f6004e640 1 -- 172.21.15.52:0/2748449966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58102b50 msgr2=0x7f9f58102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.707+0000 7f9f6004e640 1 --2- 172.21.15.52:0/2748449966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58102b50 0x7f9f58102f30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f50009880 tx=0x7f9f5002a530 comp rx=0 tx=0).stop 2024-09-06T14:48:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 -- 172.21.15.52:0/2748449966 shutdown_connections 2024-09-06T14:48:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 --2- 172.21.15.52:0/2748449966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f58103470 0x7f9f5810b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 --2- 172.21.15.52:0/2748449966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58102b50 0x7f9f58102f30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 -- 172.21.15.52:0/2748449966 >> 172.21.15.52:0/2748449966 conn(0x7f9f580fc550 msgr2=0x7f9f580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:43.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 -- 172.21.15.52:0/2748449966 shutdown_connections 2024-09-06T14:48:43.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 -- 172.21.15.52:0/2748449966 wait complete. 2024-09-06T14:48:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 Processor -- start 2024-09-06T14:48:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.708+0000 7f9f6004e640 1 -- start start 2024-09-06T14:48:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f6004e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f58102b50 0x7f9f5819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f6004e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58103470 0x7f9f5819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f6004e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5810edc0 con 0x7f9f58103470 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f6004e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5810ec40 con 0x7f9f58102b50 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5d5e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58103470 0x7f9f5819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5d5e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58103470 0x7f9f5819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55914/0 (socket says 172.21.15.52:55914) 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5d5e9640 1 -- 172.21.15.52:0/1208445286 learned_addr learned my addr 172.21.15.52:0/1208445286 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5ddea640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f58102b50 0x7f9f5819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5d5e9640 1 -- 172.21.15.52:0/1208445286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f58102b50 msgr2=0x7f9f5819f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5d5e9640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f58102b50 0x7f9f5819f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5d5e9640 1 -- 172.21.15.52:0/1208445286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f581a03d0 con 0x7f9f58103470 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.709+0000 7f9f5d5e9640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58103470 0x7f9f5819fd20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c8a0 tx=0x7f9f4c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.710+0000 7f9f56ffd640 1 -- 172.21.15.52:0/1208445286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f4c0079b0 con 0x7f9f58103470 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.710+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f58199ac0 con 0x7f9f58103470 2024-09-06T14:48:43.709 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.710+0000 7f9f56ffd640 1 -- 172.21.15.52:0/1208445286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f4c007b50 con 0x7f9f58103470 2024-09-06T14:48:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.710+0000 7f9f56ffd640 1 -- 172.21.15.52:0/1208445286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f4c018700 con 0x7f9f58103470 2024-09-06T14:48:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.710+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5819a020 con 0x7f9f58103470 2024-09-06T14:48:43.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.711+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5806a4e0 con 0x7f9f58103470 2024-09-06T14:48:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.712+0000 7f9f56ffd640 1 -- 172.21.15.52:0/1208445286 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9f4c007d00 con 0x7f9f58103470 2024-09-06T14:48:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.712+0000 7f9f56ffd640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f40077460 0x7f9f40079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.712+0000 7f9f56ffd640 1 -- 172.21.15.52:0/1208445286 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f9f4c0998b0 con 0x7f9f58103470 2024-09-06T14:48:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.712+0000 7f9f5ddea640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f40077460 0x7f9f40079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.713+0000 7f9f5ddea640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f40077460 0x7f9f40079920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f50000c00 tx=0x7f9f50004120 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:43.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.716+0000 7f9f56ffd640 1 -- 172.21.15.52:0/1208445286 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f9f4c014030 con 0x7f9f58103470 2024-09-06T14:48:43.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.897+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9f5819afe0 con 0x7f9f40077460 2024-09-06T14:48:43.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.898+0000 7f9f56ffd640 1 -- 172.21.15.52:0/1208445286 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f9f5819afe0 con 0x7f9f40077460 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f40077460 msgr2=0x7f9f40079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f40077460 0x7f9f40079920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f50000c00 tx=0x7f9f50004120 comp rx=0 tx=0).stop 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58103470 msgr2=0x7f9f5819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58103470 0x7f9f5819fd20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00c8a0 tx=0x7f9f4c00cd60 comp rx=0 tx=0).stop 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 shutdown_connections 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f58103470 0x7f9f5819fd20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f40077460 0x7f9f40079920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.899+0000 7f9f6004e640 1 --2- 172.21.15.52:0/1208445286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f58102b50 0x7f9f5819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.900+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 >> 172.21.15.52:0/1208445286 conn(0x7f9f580fc550 msgr2=0x7f9f58100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:43.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.900+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 shutdown_connections 2024-09-06T14:48:43.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.900+0000 7f9f6004e640 1 -- 172.21.15.52:0/1208445286 wait complete. 2024-09-06T14:48:43.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.984+0000 7f2c1d884640 1 -- 172.21.15.52:0/1960632922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 msgr2=0x7f2c18101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.984+0000 7f2c1d884640 1 --2- 172.21.15.52:0/1960632922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c18101d70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009880 tx=0x7f2c0002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.985+0000 7f2c1d884640 1 -- 172.21.15.52:0/1960632922 shutdown_connections 2024-09-06T14:48:43.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.985+0000 7f2c1d884640 1 --2- 172.21.15.52:0/1960632922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c18101d70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.985+0000 7f2c1d884640 1 --2- 172.21.15.52:0/1960632922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2c18107910 0x7f2c18107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.985+0000 7f2c1d884640 1 -- 172.21.15.52:0/1960632922 >> 172.21.15.52:0/1960632922 conn(0x7f2c180fd610 msgr2=0x7f2c180ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:43.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.985+0000 7f2c1d884640 1 -- 172.21.15.52:0/1960632922 shutdown_connections 2024-09-06T14:48:43.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.985+0000 7f2c1d884640 1 -- 172.21.15.52:0/1960632922 wait complete. 2024-09-06T14:48:43.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.985+0000 7f2c1d884640 1 Processor -- start 2024-09-06T14:48:43.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c1d884640 1 -- start start 2024-09-06T14:48:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c1d884640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c1d884640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2c18107910 0x7f2c18074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c1d884640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1810edc0 con 0x7f2c18101910 2024-09-06T14:48:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c1d884640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1810ec40 con 0x7f2c18107910 2024-09-06T14:48:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c16ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c16ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55942/0 (socket says 172.21.15.52:55942) 2024-09-06T14:48:43.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c16ffd640 1 -- 172.21.15.52:0/333987273 learned_addr learned my addr 172.21.15.52:0/333987273 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c16ffd640 1 -- 172.21.15.52:0/333987273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2c18107910 msgr2=0x7f2c18074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c16ffd640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2c18107910 0x7f2c18074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c16ffd640 1 -- 172.21.15.52:0/333987273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c18074f70 con 0x7f2c18101910 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c16ffd640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c180744f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c810 tx=0x7f2c1000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.986+0000 7f2c1c882640 1 -- 172.21.15.52:0/333987273 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c10004020 con 0x7f2c18101910 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.987+0000 7f2c1c882640 1 -- 172.21.15.52:0/333987273 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c100041c0 con 0x7f2c18101910 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.987+0000 7f2c1c882640 1 -- 172.21.15.52:0/333987273 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c100047a0 con 0x7f2c18101910 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.987+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c18075260 con 0x7f2c18101910 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.987+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c181a3e30 con 0x7f2c18101910 2024-09-06T14:48:43.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.988+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c18103050 con 0x7f2c18101910 2024-09-06T14:48:43.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.988+0000 7f2c1c882640 1 -- 172.21.15.52:0/333987273 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2c100079b0 con 0x7f2c18101910 2024-09-06T14:48:43.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.989+0000 7f2c1c882640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2c04077460 0x7f2c04079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:43.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.989+0000 7f2c167fc640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2c04077460 0x7f2c04079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:43.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.989+0000 7f2c1c882640 1 -- 172.21.15.52:0/333987273 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f2c10099510 con 0x7f2c18101910 2024-09-06T14:48:43.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.990+0000 7f2c167fc640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2c04077460 0x7f2c04079920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c000096c0 tx=0x7f2c00000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:43.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:43.993+0000 7f2c1c882640 1 -- 172.21.15.52:0/333987273 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f2c10014030 con 0x7f2c18101910 2024-09-06T14:48:44.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.165+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2c18062630 con 0x7f2c04077460 2024-09-06T14:48:44.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.175+0000 7f2c1c882640 1 -- 172.21.15.52:0/333987273 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f2c18062630 con 0x7f2c04077460 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (69s) 40s ago 11m 17.7M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (3m) 40s ago 12m 8652k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (3m) 110s ago 11m 8522k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (12m) 40s ago 12m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (11m) 110s ago 11m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (46s) 40s ago 11m 47.1M - c8b91775d855 af78eb451b94 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (6m) 40s ago 6m 88.8M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (6m) 40s ago 6m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (6m) 110s ago 6m 26.6M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:48:44.174 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (6m) 110s ago 6m 26.2M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (3m) 40s ago 13m 517M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (2m) 110s ago 11m 454M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (13m) 40s ago 13m 59.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 c729266bcb69 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (11m) 110s ago 11m 42.0M 2048M 19.1.1-268-g635ed4cf b6db46a449e5 660a5200375f 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (2m) 40s ago 12m 10.5M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (114s) 110s ago 11m 3649k - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (10m) 40s ago 10m 195M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (9m) 40s ago 9m 219M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (9m) 40s ago 9m 183M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (8m) 110s ago 8m 237M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (8m) 110s ago 8m 208M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (7m) 110s ago 7m 183M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:48:44.175 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (90s) 40s ago 11m 43.6M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:48:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2c04077460 msgr2=0x7f2c04079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2c04077460 0x7f2c04079920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c000096c0 tx=0x7f2c00000bc0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 msgr2=0x7f2c180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c180744f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000c810 tx=0x7f2c1000ccd0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 shutdown_connections 2024-09-06T14:48:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2c04077460 0x7f2c04079920 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2c18107910 0x7f2c18074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 --2- 172.21.15.52:0/333987273 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c18101910 0x7f2c180744f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 >> 172.21.15.52:0/333987273 conn(0x7f2c180fd610 msgr2=0x7f2c180fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 shutdown_connections 2024-09-06T14:48:44.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.177+0000 7f2c1d884640 1 -- 172.21.15.52:0/333987273 wait complete. 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.259+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3860558157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0107900 msgr2=0x7fe3b0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.259+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3860558157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0107900 0x7fe3b0107ce0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009880 tx=0x7fe3a002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.259+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3860558157 shutdown_connections 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.259+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3860558157 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0101900 0x7fe3b0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.259+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3860558157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0107900 0x7fe3b0107ce0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.259+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3860558157 >> 172.21.15.52:0/3860558157 conn(0x7fe3b00fd600 msgr2=0x7fe3b00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.260+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3860558157 shutdown_connections 2024-09-06T14:48:44.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.260+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3860558157 wait complete. 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.260+0000 7fe3b4bb6640 1 Processor -- start 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.260+0000 7fe3b4bb6640 1 -- start start 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3b4bb6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0101900 0x7fe3b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3b4bb6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0107900 0x7fe3b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3b4bb6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b010edb0 con 0x7fe3b0101900 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3b4bb6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b010ec30 con 0x7fe3b0107900 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3ae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0101900 0x7fe3b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3ae59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0101900 0x7fe3b00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55960/0 (socket says 172.21.15.52:55960) 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3ae59c640 1 -- 172.21.15.52:0/3781697514 learned_addr learned my addr 172.21.15.52:0/3781697514 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3add9b640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0107900 0x7fe3b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3ae59c640 1 -- 172.21.15.52:0/3781697514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0107900 msgr2=0x7fe3b0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3ae59c640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0107900 0x7fe3b0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3ae59c640 1 -- 172.21.15.52:0/3781697514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b0074f70 con 0x7fe3b0101900 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3add9b640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0107900 0x7fe3b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.261+0000 7fe3ae59c640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0101900 0x7fe3b00744f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0031460 tx=0x7fe3a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.262+0000 7fe39f7fe640 1 -- 172.21.15.52:0/3781697514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3a003f070 con 0x7fe3b0101900 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.262+0000 7fe39f7fe640 1 -- 172.21.15.52:0/3781697514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3a0004cf0 con 0x7fe3b0101900 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.262+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b0075200 con 0x7fe3b0101900 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.262+0000 7fe39f7fe640 1 -- 172.21.15.52:0/3781697514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3a0035030 con 0x7fe3b0101900 2024-09-06T14:48:44.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.262+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b01a3d30 con 0x7fe3b0101900 2024-09-06T14:48:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.263+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b0103040 con 0x7fe3b0101900 2024-09-06T14:48:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.263+0000 7fe39f7fe640 1 -- 172.21.15.52:0/3781697514 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe3a0042070 con 0x7fe3b0101900 2024-09-06T14:48:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.264+0000 7fe39f7fe640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe398077460 0x7fe398079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.264+0000 7fe39f7fe640 1 -- 172.21.15.52:0/3781697514 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fe3a00ba060 con 0x7fe3b0101900 2024-09-06T14:48:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.264+0000 7fe3add9b640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe398077460 0x7fe398079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.264+0000 7fe3add9b640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe398077460 0x7fe398079920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0075f80 tx=0x7fe3a4005d90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:44.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.268+0000 7fe39f7fe640 1 -- 172.21.15.52:0/3781697514 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7fe3a0083190 con 0x7fe3b0101900 2024-09-06T14:48:44.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.489+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe3b0104b10 con 0x7fe3b0101900 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.490+0000 7fe39f7fe640 1 -- 172.21.15.52:0/3781697514 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fe3a0087300 con 0x7fe3b0101900 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:48:44.488 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 12, 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:48:44.489 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:48:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe398077460 msgr2=0x7fe398079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe398077460 0x7fe398079920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0075f80 tx=0x7fe3a4005d90 comp rx=0 tx=0).stop 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0101900 msgr2=0x7fe3b00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0101900 0x7fe3b00744f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0031460 tx=0x7fe3a00048f0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 shutdown_connections 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe398077460 0x7fe398079920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3b0107900 0x7fe3b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 --2- 172.21.15.52:0/3781697514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3b0101900 0x7fe3b00744f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 >> 172.21.15.52:0/3781697514 conn(0x7fe3b00fd600 msgr2=0x7fe3b00ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 shutdown_connections 2024-09-06T14:48:44.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.492+0000 7fe3b4bb6640 1 -- 172.21.15.52:0/3781697514 wait complete. 2024-09-06T14:48:44.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.574+0000 7f2474dd2640 1 -- 172.21.15.52:0/1698180649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 msgr2=0x7f247010b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.574+0000 7f2474dd2640 1 --2- 172.21.15.52:0/1698180649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247010b940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2464009880 tx=0x7f246402a530 comp rx=0 tx=0).stop 2024-09-06T14:48:44.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.575+0000 7f2474dd2640 1 -- 172.21.15.52:0/1698180649 shutdown_connections 2024-09-06T14:48:44.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.575+0000 7f2474dd2640 1 --2- 172.21.15.52:0/1698180649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247010b940 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.575+0000 7f2474dd2640 1 --2- 172.21.15.52:0/1698180649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2470102b30 0x7f2470102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.575+0000 7f2474dd2640 1 -- 172.21.15.52:0/1698180649 >> 172.21.15.52:0/1698180649 conn(0x7f24700fc550 msgr2=0x7f24700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:44.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.575+0000 7f2474dd2640 1 -- 172.21.15.52:0/1698180649 shutdown_connections 2024-09-06T14:48:44.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.575+0000 7f2474dd2640 1 -- 172.21.15.52:0/1698180649 wait complete. 2024-09-06T14:48:44.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f2474dd2640 1 Processor -- start 2024-09-06T14:48:44.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f2474dd2640 1 -- start start 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f2474dd2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2470102b30 0x7f247019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f2474dd2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f2474dd2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f247010ede0 con 0x7f2470103450 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f2474dd2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f247010ec60 con 0x7f2470102b30 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f246dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f246dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55978/0 (socket says 172.21.15.52:55978) 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f246dd9b640 1 -- 172.21.15.52:0/3861027816 learned_addr learned my addr 172.21.15.52:0/3861027816 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:44.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f246e59c640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2470102b30 0x7f247019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f246dd9b640 1 -- 172.21.15.52:0/3861027816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2470102b30 msgr2=0x7f247019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f246dd9b640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2470102b30 0x7f247019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.576+0000 7f246dd9b640 1 -- 172.21.15.52:0/3861027816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24701977b0 con 0x7f2470103450 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.577+0000 7f246dd9b640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247019db70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2464004f90 tx=0x7f24640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.577+0000 7f245f7fe640 1 -- 172.21.15.52:0/3861027816 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f246403f070 con 0x7f2470103450 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.577+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2470197a40 con 0x7f2470103450 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.577+0000 7f245f7fe640 1 -- 172.21.15.52:0/3861027816 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2464004c70 con 0x7f2470103450 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.577+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2470197f70 con 0x7f2470103450 2024-09-06T14:48:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.577+0000 7f245f7fe640 1 -- 172.21.15.52:0/3861027816 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2464035030 con 0x7f2470103450 2024-09-06T14:48:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.578+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247006a500 con 0x7f2470103450 2024-09-06T14:48:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.579+0000 7f245f7fe640 1 -- 172.21.15.52:0/3861027816 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2464042070 con 0x7f2470103450 2024-09-06T14:48:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.579+0000 7f245f7fe640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24580774b0 0x7f2458079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.579+0000 7f245f7fe640 1 -- 172.21.15.52:0/3861027816 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f24640b9e80 con 0x7f2470103450 2024-09-06T14:48:44.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.579+0000 7f246e59c640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24580774b0 0x7f2458079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.580+0000 7f246e59c640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24580774b0 0x7f2458079970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2460005fd0 tx=0x7f2460009680 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:44.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.583+0000 7f245f7fe640 1 -- 172.21.15.52:0/3861027816 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f24640871a0 con 0x7f2470103450 2024-09-06T14:48:44.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.768+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2470198ce0 con 0x7f2470103450 2024-09-06T14:48:44.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.769+0000 7f245f7fe640 1 -- 172.21.15.52:0/3861027816 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7f246408bbc0 con 0x7f2470103450 2024-09-06T14:48:44.767 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:48:44.767 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:48:44.767 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:48:44.767 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:48:44.767 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:48:44.768 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:48:44.769 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:44.770 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:44.771 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:44.771 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:48:44.771 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:48:44.771 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:48:44.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.770+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24580774b0 msgr2=0x7f2458079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.770+0000 7f2474dd2640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24580774b0 0x7f2458079970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2460005fd0 tx=0x7f2460009680 comp rx=0 tx=0).stop 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.770+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 msgr2=0x7f247019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.770+0000 7f2474dd2640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247019db70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2464004f90 tx=0x7f24640048f0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.771+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 shutdown_connections 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.771+0000 7f2474dd2640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2470103450 0x7f247019db70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.771+0000 7f2474dd2640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24580774b0 0x7f2458079970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.771+0000 7f2474dd2640 1 --2- 172.21.15.52:0/3861027816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2470102b30 0x7f247019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.771+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 >> 172.21.15.52:0/3861027816 conn(0x7f24700fc550 msgr2=0x7f2470103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.771+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 shutdown_connections 2024-09-06T14:48:44.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.771+0000 7f2474dd2640 1 -- 172.21.15.52:0/3861027816 wait complete. 2024-09-06T14:48:44.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 -- 172.21.15.52:0/4171561189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec107960 msgr2=0x7facec107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 --2- 172.21.15.52:0/4171561189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec107960 0x7facec107d40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7facdc009880 tx=0x7facdc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 -- 172.21.15.52:0/4171561189 shutdown_connections 2024-09-06T14:48:44.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 --2- 172.21.15.52:0/4171561189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facec101960 0x7facec101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 --2- 172.21.15.52:0/4171561189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec107960 0x7facec107d40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 -- 172.21.15.52:0/4171561189 >> 172.21.15.52:0/4171561189 conn(0x7facec0fd680 msgr2=0x7facec0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 -- 172.21.15.52:0/4171561189 shutdown_connections 2024-09-06T14:48:44.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.861+0000 7facf1d5a640 1 -- 172.21.15.52:0/4171561189 wait complete. 2024-09-06T14:48:44.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:44.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:44.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:44.860 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3781697514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:44.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/3861027816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-06T14:48:44.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:44.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:44.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:44.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:44.861 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:44 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7facf1d5a640 1 Processor -- start 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7facf1d5a640 1 -- start start 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7facf1d5a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec101960 0x7facec19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7facf1d5a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facec107960 0x7facec19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7facf1d5a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7facec10ee90 con 0x7facec101960 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7facf1d5a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7facec10ed10 con 0x7facec107960 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7faceb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec101960 0x7facec19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7faceb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec101960 0x7facec19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55988/0 (socket says 172.21.15.52:55988) 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.862+0000 7faceb7fe640 1 -- 172.21.15.52:0/3633899650 learned_addr learned my addr 172.21.15.52:0/3633899650 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7faceaffd640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facec107960 0x7facec19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7faceb7fe640 1 -- 172.21.15.52:0/3633899650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facec107960 msgr2=0x7facec19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7faceb7fe640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facec107960 0x7facec19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7faceb7fe640 1 -- 172.21.15.52:0/3633899650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec197880 con 0x7facec101960 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7faceb7fe640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec101960 0x7facec19d6c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7facdc031460 tx=0x7facdc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7face8ff9640 1 -- 172.21.15.52:0/3633899650 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facdc03f070 con 0x7facec101960 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec197b10 con 0x7facec101960 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7face8ff9640 1 -- 172.21.15.52:0/3633899650 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facdc004cf0 con 0x7facec101960 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7face8ff9640 1 -- 172.21.15.52:0/3633899650 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facdc035030 con 0x7facec101960 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.863+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec198040 con 0x7facec101960 2024-09-06T14:48:44.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.865+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd8005290 con 0x7facec101960 2024-09-06T14:48:44.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.865+0000 7face8ff9640 1 -- 172.21.15.52:0/3633899650 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7facdc042070 con 0x7facec101960 2024-09-06T14:48:44.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.866+0000 7face8ff9640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facd4077460 0x7facd4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:44.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.866+0000 7face8ff9640 1 -- 172.21.15.52:0/3633899650 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7facdc0b9fc0 con 0x7facec101960 2024-09-06T14:48:44.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.866+0000 7faceaffd640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facd4077460 0x7facd4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:44.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.866+0000 7faceaffd640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facd4077460 0x7facd4079920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facec0ffc80 tx=0x7face0009110 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:44.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:44.870+0000 7face8ff9640 1 -- 172.21.15.52:0/3633899650 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7facdc0830f0 con 0x7facec101960 2024-09-06T14:48:45.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.047+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7facd8000bc0 con 0x7facd4077460 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.049+0000 7face8ff9640 1 -- 172.21.15.52:0/3633899650 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7facd8000bc0 con 0x7facd4077460 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr" 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "2/23 daemons upgraded", 2024-09-06T14:48:45.047 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mon daemons", 2024-09-06T14:48:45.048 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:48:45.048 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:48:45.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facd4077460 msgr2=0x7facd4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facd4077460 0x7facd4079920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7facec0ffc80 tx=0x7face0009110 comp rx=0 tx=0).stop 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec101960 msgr2=0x7facec19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec101960 0x7facec19d6c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7facdc031460 tx=0x7facdc0048f0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 shutdown_connections 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facd4077460 0x7facd4079920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facec107960 0x7facec19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 --2- 172.21.15.52:0/3633899650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facec101960 0x7facec19d6c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.051+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 >> 172.21.15.52:0/3633899650 conn(0x7facec0fd680 msgr2=0x7facec0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.052+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 shutdown_connections 2024-09-06T14:48:45.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.052+0000 7facf1d5a640 1 -- 172.21.15.52:0/3633899650 wait complete. 2024-09-06T14:48:45.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='client.24561 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3781697514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/3861027816' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:45.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:44 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.141+0000 7f6727dc7640 1 -- 172.21.15.52:0/3937815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720101900 msgr2=0x7f6720101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.141+0000 7f6727dc7640 1 --2- 172.21.15.52:0/3937815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720101900 0x7f6720101d60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6714009880 tx=0x7f671402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 -- 172.21.15.52:0/3937815 shutdown_connections 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 --2- 172.21.15.52:0/3937815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720101900 0x7f6720101d60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 --2- 172.21.15.52:0/3937815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6720107900 0x7f6720107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 -- 172.21.15.52:0/3937815 >> 172.21.15.52:0/3937815 conn(0x7f67200fd5e0 msgr2=0x7f67200ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 -- 172.21.15.52:0/3937815 shutdown_connections 2024-09-06T14:48:45.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 -- 172.21.15.52:0/3937815 wait complete. 2024-09-06T14:48:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 Processor -- start 2024-09-06T14:48:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 -- start start 2024-09-06T14:48:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6720101900 0x7f67200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720107900 0x7f6720074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f672010edb0 con 0x7f6720107900 2024-09-06T14:48:45.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.142+0000 7f6727dc7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f672010ec30 con 0x7f6720101900 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725362640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720107900 0x7f6720074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725362640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720107900 0x7f6720074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55996/0 (socket says 172.21.15.52:55996) 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725362640 1 -- 172.21.15.52:0/368017578 learned_addr learned my addr 172.21.15.52:0/368017578 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725b63640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6720101900 0x7f67200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725362640 1 -- 172.21.15.52:0/368017578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6720101900 msgr2=0x7f67200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725362640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6720101900 0x7f67200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725362640 1 -- 172.21.15.52:0/368017578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6720074f70 con 0x7f6720107900 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725b63640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6720101900 0x7f67200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6725362640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720107900 0x7f6720074a30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6714031460 tx=0x7f67140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f671effd640 1 -- 172.21.15.52:0/368017578 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f671403f070 con 0x7f6720107900 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f671effd640 1 -- 172.21.15.52:0/368017578 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6714004cf0 con 0x7f6720107900 2024-09-06T14:48:45.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6720075200 con 0x7f6720107900 2024-09-06T14:48:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f671effd640 1 -- 172.21.15.52:0/368017578 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6714035030 con 0x7f6720107900 2024-09-06T14:48:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.143+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67201a3dc0 con 0x7f6720107900 2024-09-06T14:48:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.144+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6720103040 con 0x7f6720107900 2024-09-06T14:48:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.145+0000 7f671effd640 1 -- 172.21.15.52:0/368017578 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6714042070 con 0x7f6720107900 2024-09-06T14:48:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.146+0000 7f671effd640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f67080774b0 0x7f6708079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:48:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.146+0000 7f671effd640 1 -- 172.21.15.52:0/368017578 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f67140b9ff0 con 0x7f6720107900 2024-09-06T14:48:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.146+0000 7f6725b63640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f67080774b0 0x7f6708079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:48:45.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.146+0000 7f6725b63640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f67080774b0 0x7f6708079970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6710005c40 tx=0x7f671000a430 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:48:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.150+0000 7f671effd640 1 -- 172.21.15.52:0/368017578 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+178607 (secure 0 0 0) 0x7f67140831a0 con 0x7f6720107900 2024-09-06T14:48:45.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.374+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f672002d7c0 con 0x7f6720107900 2024-09-06T14:48:45.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.374+0000 7f671effd640 1 -- 172.21.15.52:0/368017578 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+433 (secure 0 0 0) 0x7f6714087310 con 0x7f6720107900 2024-09-06T14:48:45.372 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:45.373 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:48:45.373 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:48:45.373 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:45.373 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f67080774b0 msgr2=0x7f6708079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f67080774b0 0x7f6708079970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6710005c40 tx=0x7f671000a430 comp rx=0 tx=0).stop 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720107900 msgr2=0x7f6720074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720107900 0x7f6720074a30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6714031460 tx=0x7f67140048f0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 shutdown_connections 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6720107900 0x7f6720074a30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f67080774b0 0x7f6708079970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 --2- 172.21.15.52:0/368017578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6720101900 0x7f67200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 >> 172.21.15.52:0/368017578 conn(0x7f67200fd5e0 msgr2=0x7f67200fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.376+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 shutdown_connections 2024-09-06T14:48:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:48:45.377+0000 7f6727dc7640 1 -- 172.21.15.52:0/368017578 wait complete. 2024-09-06T14:48:46.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:45 smithi165 ceph-mon[36229]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:45 smithi165 ceph-mon[36229]: Upgrade: Target is version 19.3.0-4704-g8b38c33c (squid) 2024-09-06T14:48:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:45 smithi165 ceph-mon[36229]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30'] 2024-09-06T14:48:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:45 smithi165 ceph-mon[36229]: Upgrade: Setting container_image for all mgr 2024-09-06T14:48:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:45 smithi165 ceph-mon[36229]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:45 smithi165 ceph-mon[36229]: from='client.? 172.21.15.52:0/368017578' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-06T14:48:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:45 smithi052 ceph-mon[28627]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:45 smithi052 ceph-mon[28627]: Upgrade: Target is version 19.3.0-4704-g8b38c33c (squid) 2024-09-06T14:48:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:45 smithi052 ceph-mon[28627]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30'] 2024-09-06T14:48:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:45 smithi052 ceph-mon[28627]: Upgrade: Setting container_image for all mgr 2024-09-06T14:48:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:45 smithi052 ceph-mon[28627]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:48:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:45 smithi052 ceph-mon[28627]: from='client.? 172.21.15.52:0/368017578' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-06T14:48:47.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:46 smithi165 ceph-mon[36229]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:46 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:46 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:48:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:46 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:48:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:46 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:46 smithi052 ceph-mon[28627]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:46 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:46 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:48:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:46 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:48:47.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:46 smithi052 ceph-mon[28627]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:48:47.917 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:47 smithi052 ceph-mon[28627]: Upgrade: Updating mon.smithi052 2024-09-06T14:48:47.917 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:47 smithi052 ceph-mon[28627]: Deploying daemon mon.smithi052 on smithi052 2024-09-06T14:48:48.239 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:47 smithi165 ceph-mon[36229]: Upgrade: Updating mon.smithi052 2024-09-06T14:48:48.240 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:47 smithi165 ceph-mon[36229]: Deploying daemon mon.smithi052 on smithi052 2024-09-06T14:48:48.564 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:48 smithi052 systemd[1]: Stopping Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:48:48.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:48 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[28623]: 2024-09-06T14:48:48.566+0000 7ff38c4a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi052 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:48:48.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:48 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[28623]: 2024-09-06T14:48:48.566+0000 7ff38c4a2640 -1 mon.smithi052@0(leader) e2 *** Got Signal Terminated *** 2024-09-06T14:48:48.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:48 smithi052 podman[112746]: 2024-09-06 14:48:48.597692249 +0000 UTC m=+0.228985196 container died c729266bcb69489487eff41e9b530bd7f16c335f80f5fe930ce126991b6cdf71 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-635ed4c, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-06T14:48:49.198 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 podman[112746]: 2024-09-06 14:48:49.000269854 +0000 UTC m=+0.631562812 container cleanup c729266bcb69489487eff41e9b530bd7f16c335f80f5fe930ce126991b6cdf71 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-635ed4c, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-06T14:48:49.198 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 bash[112746]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052 2024-09-06T14:48:49.611 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 podman[112759]: 2024-09-06 14:48:49.201696889 +0000 UTC m=+0.599124943 container remove c729266bcb69489487eff41e9b530bd7f16c335f80f5fe930ce126991b6cdf71 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-635ed4c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-06T14:48:49.664 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service: Deactivated successfully. 2024-09-06T14:48:49.664 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 systemd[1]: Stopped Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:48:49.664 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service: Consumed 13.379s CPU time. 2024-09-06T14:48:49.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 systemd[1]: Starting Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:48:49.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 podman[112898]: 2024-09-06 14:48:49.727330417 +0000 UTC m=+0.016223189 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:48:49.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:49 smithi052 podman[112898]: 2024-09-06 14:48:49.866249864 +0000 UTC m=+0.155142625 container create 2a986cec59f7a194416fe5635e36a3900d9e51fa874d3f9e5673fa7c16aa34e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-06T14:48:50.119 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 podman[112898]: 2024-09-06 14:48:50.098039238 +0000 UTC m=+0.386931999 container init 2a986cec59f7a194416fe5635e36a3900d9e51fa874d3f9e5673fa7c16aa34e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:48:50.119 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 podman[112898]: 2024-09-06 14:48:50.101464117 +0000 UTC m=+0.390356888 container start 2a986cec59f7a194416fe5635e36a3900d9e51fa874d3f9e5673fa7c16aa34e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=) 2024-09-06T14:48:50.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: set uid:gid to 167:167 (ceph:ceph) 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev), process ceph-mon, pid 2 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: pidfile_write: ignore empty --pid-file 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: load: jerasure load: lrc 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: RocksDB version: 7.9.2 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Git sha 0 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Compile date 2024-09-04 13:52:53 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: DB SUMMARY 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: DB Session ID: WG9Z7LNO4A7FX9EWC7IF 2024-09-06T14:48:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: CURRENT file: CURRENT 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: IDENTITY file: IDENTITY 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1518 Bytes 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi052/store.db dir, Total Num: 1, files: 000032.sst 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi052/store.db: 000030.log size: 2152746 ; 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.error_if_exists: 0 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.create_if_missing: 0 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.paranoid_checks: 1 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.env: 0x556b006d3160 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.fs: PosixFileSystem 2024-09-06T14:48:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.info_log: 0x556b02537a60 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_file_opening_threads: 16 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.statistics: (nil) 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.use_fsync: 0 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_log_file_size: 0 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.keep_log_file_num: 1000 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.recycle_log_file_num: 0 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.allow_fallocate: 1 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.allow_mmap_reads: 0 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.allow_mmap_writes: 0 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.use_direct_reads: 0 2024-09-06T14:48:50.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-06T14:48:50.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.create_missing_column_families: 0 2024-09-06T14:48:50.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.db_log_dir: 2024-09-06T14:48:50.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.wal_dir: 2024-09-06T14:48:50.379 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-06T14:48:50.379 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-06T14:48:50.379 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-06T14:48:50.379 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-06T14:48:50.379 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-06T14:48:50.379 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.advise_random_on_open: 1 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.db_write_buffer_size: 0 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.write_buffer_manager: 0x556b0253ae60 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.rate_limiter: (nil) 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.wal_recovery_mode: 2 2024-09-06T14:48:50.380 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.enable_thread_tracking: 0 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.enable_pipelined_write: 0 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.unordered_write: 0 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.row_cache: None 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.wal_filter: None 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.allow_ingest_behind: 0 2024-09-06T14:48:50.381 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.two_write_queues: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.manual_wal_flush: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.wal_compression: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.atomic_flush: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.log_readahead_size: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.best_efforts_recovery: 0 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-06T14:48:50.382 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.allow_data_in_errors: 0 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.db_host_id: __hostname__ 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_background_jobs: 2 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_background_compactions: -1 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_subcompactions: 1 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_total_wal_size: 0 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-06T14:48:50.383 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_open_files: -1 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bytes_per_sync: 0 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_readahead_size: 0 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_background_flushes: -1 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Compression algorithms supported: 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kZSTD supported: 0 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kXpressCompression supported: 0 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kBZip2Compression supported: 0 2024-09-06T14:48:50.384 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kLZ4Compression supported: 1 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kZlibCompression supported: 1 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kLZ4HCCompression supported: 1 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: kSnappyCompression supported: 1 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000015 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.merge_operator: 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_filter: None 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_filter_factory: None 2024-09-06T14:48:50.385 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.sst_partitioner_factory: None 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556b025376e0) 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks: 1 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: pin_top_level_index_and_filter: 1 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_type: 0 2024-09-06T14:48:50.386 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_index_type: 0 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_shortening: 1 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: checksum: 4 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: no_block_cache: 0 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache: 0x556b0252a850 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_name: BinnedLRUCache 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_options: 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: capacity : 536870912 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: num_shard_bits : 4 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: strict_capacity_limit : 0 2024-09-06T14:48:50.387 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: high_pri_pool_ratio: 0.000 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_cache_compressed: (nil) 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: persistent_cache: (nil) 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size: 4096 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_size_deviation: 10 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_restart_interval: 16 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: index_block_restart_interval: 1 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: metadata_block_size: 4096 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: partition_filters: 0 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: use_delta_encoding: 1 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: filter_policy: bloomfilter 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: whole_key_filtering: 1 2024-09-06T14:48:50.388 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: verify_compression: 0 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: read_amp_bytes_per_bit: 0 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: format_version: 5 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_index_compression: 1 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: block_align: 0 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_auto_readahead_size: 262144 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: prepopulate_block_cache: 0 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: initial_auto_readahead_size: 8192 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: num_file_reads_for_auto_readahead: 2 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.write_buffer_size: 33554432 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_write_buffer_number: 2 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression: NoCompression 2024-09-06T14:48:50.389 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression: Disabled 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.prefix_extractor: nullptr 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.num_levels: 7 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-06T14:48:50.390 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.level: 32767 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.strategy: 0 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.enabled: false 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-06T14:48:50.391 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.target_file_size_base: 67108864 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-06T14:48:50.392 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.arena_block_size: 1048576 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.disable_auto_compactions: 0 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-06T14:48:50.393 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.inplace_update_support: 0 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-06T14:48:50.394 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.bloom_locality: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.max_successive_merges: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.paranoid_file_checks: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.force_consistency_checks: 1 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.report_bg_io_stats: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.ttl: 2592000 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-06T14:48:50.395 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.enable_blob_files: false 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.min_blob_size: 0 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.blob_file_size: 268435456 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.blob_file_starting_level: 0 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi052/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12078, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-06T14:48:50.396 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a3eb0917-611d-460b-a246-16eb9ad84046 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725634130128255, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725634130135333, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1852617, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12079, "largest_seqno": 13747, "table_properties": {"data_size": 1844721, "index_size": 4998, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1861, "raw_key_size": 17234, "raw_average_key_size": 23, "raw_value_size": 1828802, "raw_average_value_size": 2471, "num_data_blocks": 229, "num_entries": 740, "num_filter_entries": 740, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725634130, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a3eb0917-611d-460b-a246-16eb9ad84046", "db_session_id": "WG9Z7LNO4A7FX9EWC7IF", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725634130135443, "job": 1, "event": "recovery_finished"} 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi052/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556b0255ae00 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: DB pointer 0x556b0265a000 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-06T14:48:50.397 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** DB Stats ** 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-06T14:48:50.398 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: L0 1/0 1.77 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 481.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: L6 1/0 7.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Sum 2/0 8.88 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 481.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 481.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** Compaction Stats [default] ** 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T14:48:50.399 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 481.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-06T14:48:50.400 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Cumulative compaction: 0.00 GB write, 185.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Interval compaction: 0.00 GB write, 185.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Block cache BinnedLRUCache@0x556b0252a850#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-06T14:48:50.401 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: starting mon.smithi052 rank 0 at public addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] at bind addrs [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi052 fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???) e2 preinit fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???).mds e19 new map 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???).mds e19 print_map 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: e19 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: legacy client fscid: 1 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: Filesystem 'cephfs' (1) 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: fs_name cephfs 2024-09-06T14:48:50.402 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: epoch 19 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: tableserver 0 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: root 0 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: session_timeout 60 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: session_autoclose 300 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_file_size 1099511627776 2024-09-06T14:48:50.403 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_xattr_size 65536 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: required_client_features {} 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: last_failure 0 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: last_failure_osd_epoch 46 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: max_mds 2 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: in 0,1 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: up {0=14584,1=24277} 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: failed 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: damaged 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: stopped 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: data_pools [3] 2024-09-06T14:48:50.404 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: metadata_pool 2 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: inline_data enabled 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: balancer 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: bal_rank_mask -1 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: standby_count_wanted 1 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:50.405 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: [mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout: 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 ceph-mon[112917]: mon.smithi052@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 bash[112898]: 2a986cec59f7a194416fe5635e36a3900d9e51fa874d3f9e5673fa7c16aa34e6 2024-09-06T14:48:50.406 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:50 smithi052 systemd[1]: Started Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:48:53.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:48:53.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:48:53.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:53.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:53.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:53.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: mon.smithi052 calling monitor election 2024-09-06T14:48:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: mon.smithi052 is new leader, mons smithi052,smithi165 in quorum (ranks 0,1) 2024-09-06T14:48:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: monmap epoch 2 2024-09-06T14:48:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:48:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: last_changed 2024-09-06T14:37:35.973434+0000 2024-09-06T14:48:53.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:48:53.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: min_mon_release 19 (squid) 2024-09-06T14:48:53.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: election_strategy: 1 2024-09-06T14:48:53.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:48:53.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-06T14:48:53.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:48:53.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: osdmap e48: 6 total, 6 up, 6 in 2024-09-06T14:48:53.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: mgrmap e32: smithi052.vsthpq(active, since 3m), standbys: smithi165.hcexoi 2024-09-06T14:48:53.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:53.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:48:53.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:48:53.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:53.578 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:53.578 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='' 2024-09-06T14:48:53.578 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:53.578 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:53 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:53.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi052"}]: dispatch 2024-09-06T14:48:53.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "mon metadata", "id": "smithi165"}]: dispatch 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: mon.smithi052 calling monitor election 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: mon.smithi052 is new leader, mons smithi052,smithi165 in quorum (ranks 0,1) 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: monmap epoch 2 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: last_changed 2024-09-06T14:37:35.973434+0000 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:48:53.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: min_mon_release 19 (squid) 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: election_strategy: 1 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: osdmap e48: 6 total, 6 up, 6 in 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: mgrmap e32: smithi052.vsthpq(active, since 3m), standbys: smithi165.hcexoi 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:48:53.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:53.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:48:53.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='' 2024-09-06T14:48:53.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:53.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:48:54.475 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:54 smithi165 ceph-mon[36229]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:54.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:54 smithi052 ceph-mon[112917]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:48:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:56 smithi052 ceph-mon[112917]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:57.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:56 smithi165 ceph-mon[36229]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:59.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:58 smithi052 ceph-mon[112917]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:59.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:58 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:59.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:58 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:59.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:58 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:59.251 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:48:58 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:59.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:58 smithi165 ceph-mon[36229]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:48:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:58 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:58 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:58 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:48:59.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:48:58 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:01.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:00 smithi052 ceph-mon[112917]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:01.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:00 smithi165 ceph-mon[36229]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:49:03.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:02 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-06T14:49:03.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:03.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:03.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:03.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:49:03.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-06T14:49:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-06T14:49:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "versions"}]: dispatch 2024-09-06T14:49:03.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-06T14:49:04.990 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:04 smithi165 ceph-mon[36229]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:04.990 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:04 smithi165 ceph-mon[36229]: Upgrade: Updating mon.smithi165 2024-09-06T14:49:04.990 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:04 smithi165 ceph-mon[36229]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:04.990 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:04 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:49:04.990 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:04 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:49:04.990 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:04 smithi165 ceph-mon[36229]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:49:04.990 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:04 smithi165 ceph-mon[36229]: Deploying daemon mon.smithi165 on smithi165 2024-09-06T14:49:05.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:04 smithi052 ceph-mon[112917]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:05.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:04 smithi052 ceph-mon[112917]: Upgrade: Updating mon.smithi165 2024-09-06T14:49:05.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:04 smithi052 ceph-mon[112917]: from='mgr.14764 ' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:05.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-06T14:49:05.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-06T14:49:05.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-06T14:49:05.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:04 smithi052 ceph-mon[112917]: Deploying daemon mon.smithi165 on smithi165 2024-09-06T14:49:05.528 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:05 smithi165 systemd[1]: Stopping Ceph mon.smithi165 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:49:05.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:05 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165[36220]: 2024-09-06T14:49:05.531+0000 7feef92f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi165 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:49:05.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:05 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165[36220]: 2024-09-06T14:49:05.531+0000 7feef92f3640 -1 mon.smithi165@1(peon) e2 *** Got Signal Terminated *** 2024-09-06T14:49:05.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:05 smithi165 podman[82765]: 2024-09-06 14:49:05.633964027 +0000 UTC m=+0.211443064 container died 660a5200375f1d9b7ca51b52aa73d123437296e179288b2c0e056b230eaa4a0d (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-635ed4c, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:49:06.278 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:05 smithi165 podman[82765]: 2024-09-06 14:49:05.980934115 +0000 UTC m=+0.558413155 container cleanup 660a5200375f1d9b7ca51b52aa73d123437296e179288b2c0e056b230eaa4a0d (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-635ed4c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-06T14:49:06.278 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:05 smithi165 bash[82765]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165 2024-09-06T14:49:06.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:06 smithi165 podman[82777]: 2024-09-06 14:49:06.282024731 +0000 UTC m=+0.643157448 container remove 660a5200375f1d9b7ca51b52aa73d123437296e179288b2c0e056b230eaa4a0d (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-635ed4c, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-06T14:49:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:06 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi165.service: Deactivated successfully. 2024-09-06T14:49:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:06 smithi165 systemd[1]: Stopped Ceph mon.smithi165 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:49:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:06 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi165.service: Consumed 7.029s CPU time. 2024-09-06T14:49:06.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:06 smithi165 systemd[1]: Starting Ceph mon.smithi165 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:49:06.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:06 smithi165 podman[82906]: 2024-09-06 14:49:06.764657745 +0000 UTC m=+0.016086153 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:49:06.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:06 smithi165 podman[82906]: 2024-09-06 14:49:06.866442563 +0000 UTC m=+0.117871020 container create d1730548ae8d96a8c90ea78e86f082a3543efe4949203796fe0dcba909c69c94 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:49:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 podman[82906]: 2024-09-06 14:49:07.060603011 +0000 UTC m=+0.312031420 container init d1730548ae8d96a8c90ea78e86f082a3543efe4949203796fe0dcba909c69c94 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T14:49:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 podman[82906]: 2024-09-06 14:49:07.063845999 +0000 UTC m=+0.315274408 container start d1730548ae8d96a8c90ea78e86f082a3543efe4949203796fe0dcba909c69c94 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-06T14:49:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: set uid:gid to 167:167 (ceph:ceph) 2024-09-06T14:49:07.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev), process ceph-mon, pid 2 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: pidfile_write: ignore empty --pid-file 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: load: jerasure load: lrc 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: RocksDB version: 7.9.2 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Git sha 0 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Compile date 2024-09-04 13:52:53 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: DB SUMMARY 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: DB Session ID: 0WM0UCHWMBX4FZNXXSQ0 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: CURRENT file: CURRENT 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: IDENTITY file: IDENTITY 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1411 Bytes 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi165/store.db dir, Total Num: 1, files: 000027.sst 2024-09-06T14:49:07.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi165/store.db: 000025.log size: 3795608 ; 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.error_if_exists: 0 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.create_if_missing: 0 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.paranoid_checks: 1 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.env: 0x55ba5cd9d160 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.fs: PosixFileSystem 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.info_log: 0x55ba5e101a60 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_file_opening_threads: 16 2024-09-06T14:49:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.statistics: (nil) 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.use_fsync: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_log_file_size: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.keep_log_file_num: 1000 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.recycle_log_file_num: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.allow_fallocate: 1 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.allow_mmap_reads: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.allow_mmap_writes: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.use_direct_reads: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-06T14:49:07.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.create_missing_column_families: 0 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.db_log_dir: 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.wal_dir: 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.advise_random_on_open: 1 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.db_write_buffer_size: 0 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.write_buffer_manager: 0x55ba5e104e60 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-06T14:49:07.327 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.rate_limiter: (nil) 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.wal_recovery_mode: 2 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.enable_thread_tracking: 0 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.enable_pipelined_write: 0 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.unordered_write: 0 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-06T14:49:07.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.row_cache: None 2024-09-06T14:49:07.329 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.wal_filter: None 2024-09-06T14:49:07.330 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-06T14:49:07.479 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.allow_ingest_behind: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.two_write_queues: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.manual_wal_flush: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.wal_compression: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.atomic_flush: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-06T14:49:07.480 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.log_readahead_size: 0 2024-09-06T14:49:07.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-06T14:49:07.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.best_efforts_recovery: 0 2024-09-06T14:49:07.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-06T14:49:07.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-06T14:49:07.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.allow_data_in_errors: 0 2024-09-06T14:49:07.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.db_host_id: __hostname__ 2024-09-06T14:49:07.481 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-06T14:49:07.482 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_background_jobs: 2 2024-09-06T14:49:07.482 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_background_compactions: -1 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_subcompactions: 1 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_total_wal_size: 0 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-06T14:49:07.483 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_open_files: -1 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bytes_per_sync: 0 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_readahead_size: 0 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_background_flushes: -1 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Compression algorithms supported: 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kZSTD supported: 0 2024-09-06T14:49:07.484 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kXpressCompression supported: 0 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kBZip2Compression supported: 0 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kLZ4Compression supported: 1 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kZlibCompression supported: 1 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kLZ4HCCompression supported: 1 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: kSnappyCompression supported: 1 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi165/store.db/MANIFEST-000010 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.merge_operator: 2024-09-06T14:49:07.485 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_filter: None 2024-09-06T14:49:07.486 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_filter_factory: None 2024-09-06T14:49:07.486 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.sst_partitioner_factory: None 2024-09-06T14:49:07.486 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-06T14:49:07.486 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-06T14:49:07.486 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ba5e1016e0) 2024-09-06T14:49:07.486 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: cache_index_and_filter_blocks: 1 2024-09-06T14:49:07.486 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-06T14:49:07.488 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-06T14:49:07.488 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: pin_top_level_index_and_filter: 1 2024-09-06T14:49:07.488 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: index_type: 0 2024-09-06T14:49:07.488 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: data_block_index_type: 0 2024-09-06T14:49:07.488 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: index_shortening: 1 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: checksum: 4 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: no_block_cache: 0 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache: 0x55ba5e0f4850 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache_name: BinnedLRUCache 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache_options: 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: capacity : 536870912 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: num_shard_bits : 4 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: strict_capacity_limit : 0 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: high_pri_pool_ratio: 0.000 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_cache_compressed: (nil) 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: persistent_cache: (nil) 2024-09-06T14:49:07.489 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_size: 4096 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_size_deviation: 10 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_restart_interval: 16 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: index_block_restart_interval: 1 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: metadata_block_size: 4096 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: partition_filters: 0 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: use_delta_encoding: 1 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: filter_policy: bloomfilter 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: whole_key_filtering: 1 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: verify_compression: 0 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: read_amp_bytes_per_bit: 0 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: format_version: 5 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: enable_index_compression: 1 2024-09-06T14:49:07.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: block_align: 0 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_auto_readahead_size: 262144 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: prepopulate_block_cache: 0 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: initial_auto_readahead_size: 8192 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: num_file_reads_for_auto_readahead: 2 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.write_buffer_size: 33554432 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_write_buffer_number: 2 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression: NoCompression 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression: Disabled 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.prefix_extractor: nullptr 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.num_levels: 7 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-06T14:49:07.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-06T14:49:07.492 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-06T14:49:07.493 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-06T14:49:07.493 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-06T14:49:07.493 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-06T14:49:07.493 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.level: 32767 2024-09-06T14:49:07.493 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.strategy: 0 2024-09-06T14:49:07.493 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.enabled: false 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-06T14:49:07.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.target_file_size_base: 67108864 2024-09-06T14:49:07.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-06T14:49:07.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-06T14:49:07.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-06T14:49:07.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-06T14:49:07.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-06T14:49:07.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-06T14:49:07.496 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-06T14:49:07.496 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-06T14:49:07.496 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-06T14:49:07.496 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-06T14:49:07.496 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-06T14:49:07.496 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-06T14:49:07.496 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.arena_block_size: 1048576 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.disable_auto_compactions: 0 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-06T14:49:07.497 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.inplace_update_support: 0 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.bloom_locality: 0 2024-09-06T14:49:07.498 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.max_successive_merges: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.paranoid_file_checks: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.force_consistency_checks: 1 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.report_bg_io_stats: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.ttl: 2592000 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.enable_blob_files: false 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.min_blob_size: 0 2024-09-06T14:49:07.499 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.blob_file_size: 268435456 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.blob_file_starting_level: 0 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi165/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12268, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 110b242c-4b99-4fb1-afa4-ed3853842d44 2024-09-06T14:49:07.500 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725634147092105, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725634147101395, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2165396, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12273, "largest_seqno": 14401, "table_properties": {"data_size": 2156417, "index_size": 5757, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2181, "raw_key_size": 19907, "raw_average_key_size": 23, "raw_value_size": 2138106, "raw_average_value_size": 2509, "num_data_blocks": 264, "num_entries": 852, "num_filter_entries": 852, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725634147, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "110b242c-4b99-4fb1-afa4-ed3853842d44", "db_session_id": "0WM0UCHWMBX4FZNXXSQ0", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725634147101507, "job": 1, "event": "recovery_finished"} 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi165/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ba5e124e00 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: DB pointer 0x55ba5e224000 2024-09-06T14:49:07.501 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** DB Stats ** 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-06T14:49:07.502 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** Compaction Stats [default] ** 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: L0 1/0 2.07 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 552.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: L6 1/0 7.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Sum 2/0 9.18 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 552.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 552.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.503 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** Compaction Stats [default] ** 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 552.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-06T14:49:07.504 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Cumulative compaction: 0.00 GB write, 148.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Interval compaction: 0.00 GB write, 148.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Block cache BinnedLRUCache@0x55ba5e0f4850#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: starting mon.smithi165 rank 1 at public addrs [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] at bind addrs [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi165 fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???) e2 preinit fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???).mds e19 new map 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???).mds e19 print_map 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: e19 2024-09-06T14:49:07.505 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: legacy client fscid: 1 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: Filesystem 'cephfs' (1) 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: fs_name cephfs 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: epoch 19 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:49:07.506 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: tableserver 0 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: root 0 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: session_timeout 60 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: session_autoclose 300 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_file_size 1099511627776 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_xattr_size 65536 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: required_client_features {} 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: last_failure 0 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: last_failure_osd_epoch 46 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: max_mds 2 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: in 0,1 2024-09-06T14:49:07.507 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: up {0=14584,1=24277} 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: failed 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: damaged 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: stopped 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: data_pools [3] 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: metadata_pool 2 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: inline_data enabled 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: balancer 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: bal_rank_mask -1 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: standby_count_wanted 1 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:07.508 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: [mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout: 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 ceph-mon[82925]: mon.smithi165@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 bash[82906]: d1730548ae8d96a8c90ea78e86f082a3543efe4949203796fe0dcba909c69c94 2024-09-06T14:49:07.509 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:07 smithi165 systemd[1]: Started Ceph mon.smithi165 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: mon.smithi165 calling monitor election 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: mon.smithi052 calling monitor election 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: mon.smithi052 is new leader, mons smithi052,smithi165 in quorum (ranks 0,1) 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: monmap epoch 2 2024-09-06T14:49:09.997 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: last_changed 2024-09-06T14:37:35.973434+0000 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: min_mon_release 19 (squid) 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: election_strategy: 1 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: osdmap e48: 6 total, 6 up, 6 in 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: mgrmap e32: smithi052.vsthpq(active, since 3m), standbys: smithi165.hcexoi 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:49:09.998 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:09.999 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:09.999 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:09.999 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:09.999 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-06T14:49:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:10.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: mon.smithi165 calling monitor election 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: mon.smithi052 calling monitor election 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: mon.smithi052 is new leader, mons smithi052,smithi165 in quorum (ranks 0,1) 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: monmap epoch 2 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: last_changed 2024-09-06T14:37:35.973434+0000 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: created 2024-09-06T14:35:08.459770+0000 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: min_mon_release 19 (squid) 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: election_strategy: 1 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: 0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.smithi052 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.smithi165 2024-09-06T14:49:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2 up:standby-replay 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: osdmap e48: 6 total, 6 up, 6 in 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: mgrmap e32: smithi052.vsthpq(active, since 3m), standbys: smithi165.hcexoi 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:10.991 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:10 smithi165 ceph-mon[82925]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:10 smithi052 ceph-mon[112917]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:12.787 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:12.787 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:12.787 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:12 smithi165 ceph-mon[82925]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:12.787 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:12.787 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:12.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:12.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:12.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:12 smithi052 ceph-mon[112917]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:12.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:12.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:15.006 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:14 smithi165 ceph-mon[82925]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:15.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:14 smithi052 ceph-mon[112917]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 -- 172.21.15.52:0/482149736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1007f0 msgr2=0x7fbafc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 --2- 172.21.15.52:0/482149736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1007f0 0x7fbafc100c50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009880 tx=0x7fbaf002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 -- 172.21.15.52:0/482149736 shutdown_connections 2024-09-06T14:49:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 --2- 172.21.15.52:0/482149736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1007f0 0x7fbafc100c50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 --2- 172.21.15.52:0/482149736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc1067f0 0x7fbafc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 -- 172.21.15.52:0/482149736 >> 172.21.15.52:0/482149736 conn(0x7fbafc0fc550 msgr2=0x7fbafc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:15.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 -- 172.21.15.52:0/482149736 shutdown_connections 2024-09-06T14:49:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.472+0000 7fbb0247c640 1 -- 172.21.15.52:0/482149736 wait complete. 2024-09-06T14:49:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbb0247c640 1 Processor -- start 2024-09-06T14:49:15.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbb0247c640 1 -- start start 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbb0247c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc1007f0 0x7fbafc19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbb0247c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1067f0 0x7fbafc19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbb0247c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc10dcc0 con 0x7fbafc1067f0 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbb0247c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc10db40 con 0x7fbafc1007f0 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1067f0 0x7fbafc19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbafb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1067f0 0x7fbafc19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56552/0 (socket says 172.21.15.52:56552) 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbafb7fe640 1 -- 172.21.15.52:0/1800672778 learned_addr learned my addr 172.21.15.52:0/1800672778 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.473+0000 7fbafbfff640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc1007f0 0x7fbafc19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbafb7fe640 1 -- 172.21.15.52:0/1800672778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc1007f0 msgr2=0x7fbafc19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbafb7fe640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc1007f0 0x7fbafc19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbafb7fe640 1 -- 172.21.15.52:0/1800672778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc199a10 con 0x7fbafc1067f0 2024-09-06T14:49:15.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbafbfff640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc1007f0 0x7fbafc19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:49:15.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbafb7fe640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1067f0 0x7fbafc19fd90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0031460 tx=0x7fbaf0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:15.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbaf97fa640 1 -- 172.21.15.52:0/1800672778 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaf003f070 con 0x7fbafc1067f0 2024-09-06T14:49:15.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc199ca0 con 0x7fbafc1067f0 2024-09-06T14:49:15.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbaf97fa640 1 -- 172.21.15.52:0/1800672778 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbaf0004a90 con 0x7fbafc1067f0 2024-09-06T14:49:15.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbaf97fa640 1 -- 172.21.15.52:0/1800672778 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbaf0035030 con 0x7fbafc1067f0 2024-09-06T14:49:15.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.474+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc19a1d0 con 0x7fbafc1067f0 2024-09-06T14:49:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.475+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc101f30 con 0x7fbafc1067f0 2024-09-06T14:49:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.477+0000 7fbaf97fa640 1 -- 172.21.15.52:0/1800672778 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbaf0042070 con 0x7fbafc1067f0 2024-09-06T14:49:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.477+0000 7fbaf97fa640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbae4077460 0x7fbae4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.477+0000 7fbaf97fa640 1 -- 172.21.15.52:0/1800672778 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7fbaf00ba790 con 0x7fbafc1067f0 2024-09-06T14:49:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.477+0000 7fbafbfff640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbae4077460 0x7fbae4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:15.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.478+0000 7fbafbfff640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbae4077460 0x7fbae4079920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbafc19ab50 tx=0x7fbaec005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:15.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.480+0000 7fbaf97fa640 1 -- 172.21.15.52:0/1800672778 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbaf00838a0 con 0x7fbafc1067f0 2024-09-06T14:49:15.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.662+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbafc19b040 con 0x7fbae4077460 2024-09-06T14:49:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.663+0000 7fbaf97fa640 1 -- 172.21.15.52:0/1800672778 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fbaec011c40 con 0x7fbae4077460 2024-09-06T14:49:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbae4077460 msgr2=0x7fbae4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbae4077460 0x7fbae4079920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbafc19ab50 tx=0x7fbaec005f90 comp rx=0 tx=0).stop 2024-09-06T14:49:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1067f0 msgr2=0x7fbafc19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1067f0 0x7fbafc19fd90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0031460 tx=0x7fbaf0004530 comp rx=0 tx=0).stop 2024-09-06T14:49:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 shutdown_connections 2024-09-06T14:49:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbafc1067f0 0x7fbafc19fd90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbae4077460 0x7fbae4079920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 --2- 172.21.15.52:0/1800672778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbafc1007f0 0x7fbafc19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 >> 172.21.15.52:0/1800672778 conn(0x7fbafc0fc550 msgr2=0x7fbafc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 shutdown_connections 2024-09-06T14:49:15.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.665+0000 7fbb0247c640 1 -- 172.21.15.52:0/1800672778 wait complete. 2024-09-06T14:49:15.674 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.757+0000 7f79a1193640 1 -- 172.21.15.52:0/4161202270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c1003c0 msgr2=0x7f799c1007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.757+0000 7f79a1193640 1 --2- 172.21.15.52:0/4161202270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c1003c0 0x7f799c1007a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f798c009880 tx=0x7f798c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.757+0000 7f79a1193640 1 -- 172.21.15.52:0/4161202270 shutdown_connections 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.757+0000 7f79a1193640 1 --2- 172.21.15.52:0/4161202270 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f799c100d70 0x7f799c1065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.757+0000 7f79a1193640 1 --2- 172.21.15.52:0/4161202270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c1003c0 0x7f799c1007a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.757+0000 7f79a1193640 1 -- 172.21.15.52:0/4161202270 >> 172.21.15.52:0/4161202270 conn(0x7f799c077150 msgr2=0x7f799c077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.758+0000 7f79a1193640 1 -- 172.21.15.52:0/4161202270 shutdown_connections 2024-09-06T14:49:15.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.758+0000 7f79a1193640 1 -- 172.21.15.52:0/4161202270 wait complete. 2024-09-06T14:49:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.758+0000 7f79a1193640 1 Processor -- start 2024-09-06T14:49:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f79a1193640 1 -- start start 2024-09-06T14:49:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f79a1193640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f799c1003c0 0x7f799c19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f79a1193640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c100d70 0x7f799c19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f79a1193640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f799c10ede0 con 0x7f799c100d70 2024-09-06T14:49:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f79a1193640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f799c10ec60 con 0x7f799c1003c0 2024-09-06T14:49:15.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f799a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c100d70 0x7f799c19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f799a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c100d70 0x7f799c19db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56568/0 (socket says 172.21.15.52:56568) 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f799a59c640 1 -- 172.21.15.52:0/3298063696 learned_addr learned my addr 172.21.15.52:0/3298063696 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f799ad9d640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f799c1003c0 0x7f799c19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f799a59c640 1 -- 172.21.15.52:0/3298063696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f799c1003c0 msgr2=0x7f799c19d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f799a59c640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f799c1003c0 0x7f799c19d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.759+0000 7f799a59c640 1 -- 172.21.15.52:0/3298063696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c197790 con 0x7f799c100d70 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.760+0000 7f799a59c640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c100d70 0x7f799c19db50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f799000e970 tx=0x7f799000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.760+0000 7f7983fff640 1 -- 172.21.15.52:0/3298063696 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f799000cac0 con 0x7f799c100d70 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.760+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799c197a80 con 0x7f799c100d70 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.760+0000 7f7983fff640 1 -- 172.21.15.52:0/3298063696 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79900054e0 con 0x7f799c100d70 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.760+0000 7f7983fff640 1 -- 172.21.15.52:0/3298063696 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7990010430 con 0x7f799c100d70 2024-09-06T14:49:15.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.760+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799c198010 con 0x7f799c100d70 2024-09-06T14:49:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.761+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799c069d90 con 0x7f799c100d70 2024-09-06T14:49:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.762+0000 7f7983fff640 1 -- 172.21.15.52:0/3298063696 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f79900106e0 con 0x7f799c100d70 2024-09-06T14:49:15.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.762+0000 7f7983fff640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7984077460 0x7f7984079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.763+0000 7f7983fff640 1 -- 172.21.15.52:0/3298063696 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f7990099cd0 con 0x7f799c100d70 2024-09-06T14:49:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.763+0000 7f799ad9d640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7984077460 0x7f7984079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:15.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.763+0000 7f799ad9d640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7984077460 0x7f7984079920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f798c0096c0 tx=0x7f798c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:15.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.767+0000 7f7983fff640 1 -- 172.21.15.52:0/3298063696 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7990062e00 con 0x7f799c100d70 2024-09-06T14:49:15.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.957+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f799c198380 con 0x7f7984077460 2024-09-06T14:49:15.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.959+0000 7f7983fff640 1 -- 172.21.15.52:0/3298063696 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f799c198380 con 0x7f7984077460 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.960+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7984077460 msgr2=0x7f7984079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.960+0000 7f79a1193640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7984077460 0x7f7984079920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f798c0096c0 tx=0x7f798c031400 comp rx=0 tx=0).stop 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.960+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c100d70 msgr2=0x7f799c19db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c100d70 0x7f799c19db50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f799000e970 tx=0x7f799000ee30 comp rx=0 tx=0).stop 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 shutdown_connections 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f799c100d70 0x7f799c19db50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7984077460 0x7f7984079920 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 --2- 172.21.15.52:0/3298063696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f799c1003c0 0x7f799c19d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 >> 172.21.15.52:0/3298063696 conn(0x7f799c077150 msgr2=0x7f799c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 shutdown_connections 2024-09-06T14:49:15.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:15.961+0000 7f79a1193640 1 -- 172.21.15.52:0/3298063696 wait complete. 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 -- 172.21.15.52:0/1652938195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 msgr2=0x7f319c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 --2- 172.21.15.52:0/1652938195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c100c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3184009880 tx=0x7f318402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 -- 172.21.15.52:0/1652938195 shutdown_connections 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 --2- 172.21.15.52:0/1652938195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c100c50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 --2- 172.21.15.52:0/1652938195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f319c1067f0 0x7f319c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 -- 172.21.15.52:0/1652938195 >> 172.21.15.52:0/1652938195 conn(0x7f319c0fc550 msgr2=0x7f319c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 -- 172.21.15.52:0/1652938195 shutdown_connections 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.047+0000 7f31a18ca640 1 -- 172.21.15.52:0/1652938195 wait complete. 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f31a18ca640 1 Processor -- start 2024-09-06T14:49:16.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f31a18ca640 1 -- start start 2024-09-06T14:49:16.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f31a18ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f31a18ca640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f319c1067f0 0x7f319c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f31a18ca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f319c10dca0 con 0x7f319c1007f0 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f31a18ca640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f319c10db20 con 0x7f319c1067f0 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f319affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f319affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56590/0 (socket says 172.21.15.52:56590) 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f319affd640 1 -- 172.21.15.52:0/72663982 learned_addr learned my addr 172.21.15.52:0/72663982 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.048+0000 7f3193fff640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f319c1067f0 0x7f319c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f319affd640 1 -- 172.21.15.52:0/72663982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f319c1067f0 msgr2=0x7f319c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f319affd640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f319c1067f0 0x7f319c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f319affd640 1 -- 172.21.15.52:0/72663982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c0fd700 con 0x7f319c1007f0 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f319affd640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c0fcc80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f318c00d8d0 tx=0x7f318c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f31a08c8640 1 -- 172.21.15.52:0/72663982 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f318c017070 con 0x7f319c1007f0 2024-09-06T14:49:16.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f31a08c8640 1 -- 172.21.15.52:0/72663982 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f318c010460 con 0x7f319c1007f0 2024-09-06T14:49:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f31a08c8640 1 -- 172.21.15.52:0/72663982 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f318c00f5f0 con 0x7f319c1007f0 2024-09-06T14:49:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319c0fd9f0 con 0x7f319c1007f0 2024-09-06T14:49:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.049+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319c1a3e00 con 0x7f319c1007f0 2024-09-06T14:49:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.050+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319c101f30 con 0x7f319c1007f0 2024-09-06T14:49:16.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.051+0000 7f31a08c8640 1 -- 172.21.15.52:0/72663982 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f318c009a30 con 0x7f319c1007f0 2024-09-06T14:49:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.052+0000 7f31a08c8640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3188077460 0x7f3188079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.052+0000 7f31a08c8640 1 -- 172.21.15.52:0/72663982 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f318c099430 con 0x7f319c1007f0 2024-09-06T14:49:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.052+0000 7f3193fff640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3188077460 0x7f3188079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.052+0000 7f3193fff640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3188077460 0x7f3188079920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f319c0fe710 tx=0x7f3184031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.056+0000 7f31a08c8640 1 -- 172.21.15.52:0/72663982 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f318c0666d0 con 0x7f319c1007f0 2024-09-06T14:49:16.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.225+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f319c062630 con 0x7f3188077460 2024-09-06T14:49:16.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.234+0000 7f31a08c8640 1 -- 172.21.15.52:0/72663982 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f319c062630 con 0x7f3188077460 2024-09-06T14:49:16.233 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:49:16.233 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (101s) 18s ago 12m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:49:16.233 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (4m) 18s ago 12m 8724k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:49:16.233 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (3m) 4s ago 11m 8707k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:49:16.233 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (12m) 18s ago 12m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 39fef43a8f03 2024-09-06T14:49:16.233 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (11m) 4s ago 11m 6899k - 19.1.1-268-g635ed4cf b6db46a449e5 21cde668ca6e 2024-09-06T14:49:16.234 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (78s) 18s ago 12m 75.3M - c8b91775d855 af78eb451b94 2024-09-06T14:49:16.234 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (7m) 18s ago 7m 89.1M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:49:16.234 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (7m) 18s ago 7m 146M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:49:16.234 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (7m) 4s ago 7m 26.8M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:49:16.234 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (7m) 4s ago 7m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:49:16.234 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (3m) 18s ago 13m 518M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:49:16.235 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (2m) 4s ago 11m 456M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:49:16.235 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (26s) 18s ago 13m 23.6M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:49:16.235 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (9s) 4s ago 11m 19.3M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:49:16.235 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (2m) 18s ago 12m 10.2M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:49:16.235 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (2m) 4s ago 11m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:49:16.236 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (10m) 18s ago 10m 198M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 ec82c4ded29e 2024-09-06T14:49:16.236 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (10m) 18s ago 10m 219M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:49:16.236 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (9m) 18s ago 9m 184M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:49:16.236 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (9m) 4s ago 9m 238M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:49:16.236 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (8m) 4s ago 8m 210M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:49:16.236 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (8m) 4s ago 8m 185M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:49:16.237 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (2m) 18s ago 12m 47.9M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:49:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3188077460 msgr2=0x7f3188079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3188077460 0x7f3188079920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f319c0fe710 tx=0x7f3184031400 comp rx=0 tx=0).stop 2024-09-06T14:49:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 msgr2=0x7f319c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c0fcc80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f318c00d8d0 tx=0x7f318c00dd90 comp rx=0 tx=0).stop 2024-09-06T14:49:16.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 shutdown_connections 2024-09-06T14:49:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3188077460 0x7f3188079920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f319c1067f0 0x7f319c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 --2- 172.21.15.52:0/72663982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f319c1007f0 0x7f319c0fcc80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 >> 172.21.15.52:0/72663982 conn(0x7f319c0fc550 msgr2=0x7f319c069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 shutdown_connections 2024-09-06T14:49:16.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.237+0000 7f31a18ca640 1 -- 172.21.15.52:0/72663982 wait complete. 2024-09-06T14:49:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 -- 172.21.15.52:0/575079100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 msgr2=0x7f3864101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 --2- 172.21.15.52:0/575079100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 0x7f3864101d60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3854009880 tx=0x7f385402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 -- 172.21.15.52:0/575079100 shutdown_connections 2024-09-06T14:49:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 --2- 172.21.15.52:0/575079100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 0x7f3864101d60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 --2- 172.21.15.52:0/575079100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 0x7f3864107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 -- 172.21.15.52:0/575079100 >> 172.21.15.52:0/575079100 conn(0x7f38640fd5e0 msgr2=0x7f38640ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:16.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 -- 172.21.15.52:0/575079100 shutdown_connections 2024-09-06T14:49:16.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.321+0000 7f386bd63640 1 -- 172.21.15.52:0/575079100 wait complete. 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f386bd63640 1 Processor -- start 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f386bd63640 1 -- start start 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f386bd63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 0x7f38640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f386bd63640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 0x7f3864074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f386bd63640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f386410edb0 con 0x7f3864101900 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f386bd63640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f386410ec30 con 0x7f3864107900 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f38692fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 0x7f3864074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f3869aff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 0x7f38640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f38692fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 0x7f3864074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:55844/0 (socket says 172.21.15.52:55844) 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.322+0000 7f38692fe640 1 -- 172.21.15.52:0/1722657476 learned_addr learned my addr 172.21.15.52:0/1722657476 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f38692fe640 1 -- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 msgr2=0x7f38640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f38692fe640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 0x7f38640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f38692fe640 1 -- 172.21.15.52:0/1722657476 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3864074f70 con 0x7f3864107900 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f38692fe640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 0x7f3864074a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3854031460 tx=0x7f38540045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f385affd640 1 -- 172.21.15.52:0/1722657476 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f385403f070 con 0x7f3864107900 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f385affd640 1 -- 172.21.15.52:0/1722657476 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38540035f0 con 0x7f3864107900 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3864075200 con 0x7f3864107900 2024-09-06T14:49:16.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f385affd640 1 -- 172.21.15.52:0/1722657476 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3854035030 con 0x7f3864107900 2024-09-06T14:49:16.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.323+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38641a3d20 con 0x7f3864107900 2024-09-06T14:49:16.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.324+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3864103040 con 0x7f3864107900 2024-09-06T14:49:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.325+0000 7f385affd640 1 -- 172.21.15.52:0/1722657476 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3854042070 con 0x7f3864107900 2024-09-06T14:49:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.325+0000 7f385affd640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3850077460 0x7f3850079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.325+0000 7f385affd640 1 -- 172.21.15.52:0/1722657476 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f38540b9fb0 con 0x7f3864107900 2024-09-06T14:49:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.325+0000 7f3869aff640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3850077460 0x7f3850079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.326+0000 7f3869aff640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3850077460 0x7f3850079920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3860005d00 tx=0x7f386000b410 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.330+0000 7f385affd640 1 -- 172.21.15.52:0/1722657476 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f38540871b0 con 0x7f3864107900 2024-09-06T14:49:16.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.556+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3864109e90 con 0x7f3864107900 2024-09-06T14:49:16.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.557+0000 7f385affd640 1 -- 172.21.15.52:0/1722657476 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f385408bbd0 con 0x7f3864107900 2024-09-06T14:49:16.555 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:49:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:49:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:49:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:16.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:49:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:49:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:49:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6 2024-09-06T14:49:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:16.556 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:49:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:49:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:49:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 10, 2024-09-06T14:49:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:49:16.557 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:49:16.558 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:49:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3850077460 msgr2=0x7f3850079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3850077460 0x7f3850079920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3860005d00 tx=0x7f386000b410 comp rx=0 tx=0).stop 2024-09-06T14:49:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 msgr2=0x7f3864074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 0x7f3864074a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3854031460 tx=0x7f38540045e0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 shutdown_connections 2024-09-06T14:49:16.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3850077460 0x7f3850079920 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3864107900 0x7f3864074a30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 --2- 172.21.15.52:0/1722657476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3864101900 0x7f38640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.559+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 >> 172.21.15.52:0/1722657476 conn(0x7f38640fd5e0 msgr2=0x7f38640fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:16.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.560+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 shutdown_connections 2024-09-06T14:49:16.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.560+0000 7f386bd63640 1 -- 172.21.15.52:0/1722657476 wait complete. 2024-09-06T14:49:16.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:16.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:49:16.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:16.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:16.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:16.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all mon 2024-09-06T14:49:16.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"} : dispatch 2024-09-06T14:49:16.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"}]': finished 2024-09-06T14:49:16.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"} : dispatch 2024-09-06T14:49:16.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"}]': finished 2024-09-06T14:49:16.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:16.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:16.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:16 smithi052 ceph-mon[112917]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:16.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 -- 172.21.15.52:0/3653522382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100330 msgr2=0x7f9070100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 --2- 172.21.15.52:0/3653522382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100330 0x7f9070100710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f906000a990 tx=0x7f906002b7d0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 -- 172.21.15.52:0/3653522382 shutdown_connections 2024-09-06T14:49:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 --2- 172.21.15.52:0/3653522382 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9070100ce0 0x7f9070104c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 --2- 172.21.15.52:0/3653522382 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100330 0x7f9070100710 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 -- 172.21.15.52:0/3653522382 >> 172.21.15.52:0/3653522382 conn(0x7f9070077270 msgr2=0x7f9070077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 -- 172.21.15.52:0/3653522382 shutdown_connections 2024-09-06T14:49:16.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.644+0000 7f9074a62640 1 -- 172.21.15.52:0/3653522382 wait complete. 2024-09-06T14:49:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f9074a62640 1 Processor -- start 2024-09-06T14:49:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f9074a62640 1 -- start start 2024-09-06T14:49:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f9074a62640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9070100330 0x7f907019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f9074a62640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100ce0 0x7f907019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f9074a62640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f907010cb80 con 0x7f9070100ce0 2024-09-06T14:49:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f9074a62640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f907010ca00 con 0x7f9070100330 2024-09-06T14:49:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f906dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100ce0 0x7f907019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f906dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100ce0 0x7f907019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56624/0 (socket says 172.21.15.52:56624) 2024-09-06T14:49:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f906dd9b640 1 -- 172.21.15.52:0/2858428079 learned_addr learned my addr 172.21.15.52:0/2858428079 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f906e59c640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9070100330 0x7f907019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f906dd9b640 1 -- 172.21.15.52:0/2858428079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9070100330 msgr2=0x7f907019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.645+0000 7f906dd9b640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9070100330 0x7f907019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.646+0000 7f906dd9b640 1 -- 172.21.15.52:0/2858428079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90701977b0 con 0x7f9070100ce0 2024-09-06T14:49:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.646+0000 7f906dd9b640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100ce0 0x7f907019db70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f906400c8f0 tx=0x7f906400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.646+0000 7f905f7fe640 1 -- 172.21.15.52:0/2858428079 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9064014070 con 0x7f9070100ce0 2024-09-06T14:49:16.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.646+0000 7f905f7fe640 1 -- 172.21.15.52:0/2858428079 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9064007c60 con 0x7f9070100ce0 2024-09-06T14:49:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.646+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9070197aa0 con 0x7f9070100ce0 2024-09-06T14:49:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.646+0000 7f905f7fe640 1 -- 172.21.15.52:0/2858428079 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9064003c30 con 0x7f9070100ce0 2024-09-06T14:49:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.646+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9070198030 con 0x7f9070100ce0 2024-09-06T14:49:16.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.647+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9070101700 con 0x7f9070100ce0 2024-09-06T14:49:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.648+0000 7f905f7fe640 1 -- 172.21.15.52:0/2858428079 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9064017070 con 0x7f9070100ce0 2024-09-06T14:49:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.648+0000 7f905f7fe640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f90580774b0 0x7f9058079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.649+0000 7f905f7fe640 1 -- 172.21.15.52:0/2858428079 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f9064099250 con 0x7f9070100ce0 2024-09-06T14:49:16.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.649+0000 7f906e59c640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f90580774b0 0x7f9058079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.649+0000 7f906e59c640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f90580774b0 0x7f9058079970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f906000a340 tx=0x7f9060005fd0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.653+0000 7f905f7fe640 1 -- 172.21.15.52:0/2858428079 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9064066570 con 0x7f9070100ce0 2024-09-06T14:49:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:16.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:49:16.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:16.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:16.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:16.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all mon 2024-09-06T14:49:16.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:16.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"} : dispatch 2024-09-06T14:49:16.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi052"}]': finished 2024-09-06T14:49:16.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"} : dispatch 2024-09-06T14:49:16.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi165"}]': finished 2024-09-06T14:49:16.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:16.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:16.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:16 smithi165 ceph-mon[82925]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.841+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f907010a530 con 0x7f9070100ce0 2024-09-06T14:49:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.841+0000 7f905f7fe640 1 -- 172.21.15.52:0/2858428079 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7f906406af90 con 0x7f9070100ce0 2024-09-06T14:49:16.839 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:49:16.839 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:49:16.839 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:49:16.839 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:49:16.840 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:49:16.840 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:49:16.840 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:49:16.841 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:49:16.841 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:49:16.841 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:49:16.841 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:49:16.841 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:49:16.841 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:49:16.841 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:49:16.842 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:49:16.842 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:49:16.842 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:49:16.842 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:49:16.842 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:49:16.842 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:49:16.842 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:49:16.843 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:49:16.843 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:49:16.843 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:49:16.843 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:49:16.843 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:49:16.843 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:49:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:49:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:49:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:49:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:49:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:49:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:49:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:49:16.845 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:49:16.845 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:16.845 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:16.845 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:16.845 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:16.845 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:49:16.845 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:49:16.847 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:49:16.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f90580774b0 msgr2=0x7f9058079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f90580774b0 0x7f9058079970 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f906000a340 tx=0x7f9060005fd0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100ce0 msgr2=0x7f907019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100ce0 0x7f907019db70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f906400c8f0 tx=0x7f906400cdb0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 shutdown_connections 2024-09-06T14:49:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9070100ce0 0x7f907019db70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f90580774b0 0x7f9058079970 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 --2- 172.21.15.52:0/2858428079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9070100330 0x7f907019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.843+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 >> 172.21.15.52:0/2858428079 conn(0x7f9070077270 msgr2=0x7f9070103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.844+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 shutdown_connections 2024-09-06T14:49:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.844+0000 7f9074a62640 1 -- 172.21.15.52:0/2858428079 wait complete. 2024-09-06T14:49:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 -- 172.21.15.52:0/3982871308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 msgr2=0x7f2704100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 --2- 172.21.15.52:0/3982871308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f2704100c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009880 tx=0x7f26f802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 -- 172.21.15.52:0/3982871308 shutdown_connections 2024-09-06T14:49:16.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 --2- 172.21.15.52:0/3982871308 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f2704100c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 --2- 172.21.15.52:0/3982871308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2704106800 0x7f2704106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 -- 172.21.15.52:0/3982871308 >> 172.21.15.52:0/3982871308 conn(0x7f27040fc520 msgr2=0x7f27040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 -- 172.21.15.52:0/3982871308 shutdown_connections 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.927+0000 7f2709d44640 1 -- 172.21.15.52:0/3982871308 wait complete. 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f2709d44640 1 Processor -- start 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f2709d44640 1 -- start start 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f2709d44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f270419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f2709d44640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2704106800 0x7f270419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f2709d44640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f270410dcd0 con 0x7f2704100800 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f2709d44640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f270410db50 con 0x7f2704106800 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f27037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f270419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f27037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f270419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56638/0 (socket says 172.21.15.52:56638) 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.928+0000 7f27037fe640 1 -- 172.21.15.52:0/830303515 learned_addr learned my addr 172.21.15.52:0/830303515 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f2702ffd640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2704106800 0x7f270419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f27037fe640 1 -- 172.21.15.52:0/830303515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2704106800 msgr2=0x7f270419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f27037fe640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2704106800 0x7f270419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f27037fe640 1 -- 172.21.15.52:0/830303515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2704199a20 con 0x7f2704100800 2024-09-06T14:49:16.930 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f2702ffd640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2704106800 0x7f270419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f27037fe640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f270419f860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26f400d6f0 tx=0x7f26f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f2700ff9640 1 -- 172.21.15.52:0/830303515 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26f4017070 con 0x7f2704100800 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2704199d10 con 0x7f2704100800 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f2700ff9640 1 -- 172.21.15.52:0/830303515 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26f400de00 con 0x7f2704100800 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f2700ff9640 1 -- 172.21.15.52:0/830303515 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26f4004bb0 con 0x7f2704100800 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.929+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f270419a2a0 con 0x7f2704100800 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.930+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2704101f40 con 0x7f2704100800 2024-09-06T14:49:16.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.931+0000 7f2700ff9640 1 -- 172.21.15.52:0/830303515 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f26f4004e60 con 0x7f2704100800 2024-09-06T14:49:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.931+0000 7f2700ff9640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26ec077460 0x7f26ec079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.932+0000 7f2702ffd640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26ec077460 0x7f26ec079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.932+0000 7f2700ff9640 1 -- 172.21.15.52:0/830303515 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f26f4099270 con 0x7f2704100800 2024-09-06T14:49:16.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.932+0000 7f2702ffd640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26ec077460 0x7f26ec079920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f26f8031460 tx=0x7f26f80041a0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:16.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:16.935+0000 7f2700ff9640 1 -- 172.21.15.52:0/830303515 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f26f40623a0 con 0x7f2704100800 2024-09-06T14:49:17.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.119+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f270419a550 con 0x7f26ec077460 2024-09-06T14:49:17.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.121+0000 7f2700ff9640 1 -- 172.21.15.52:0/830303515 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f270419a550 con 0x7f26ec077460 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mon" 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "4/23 daemons upgraded", 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading crash daemons", 2024-09-06T14:49:17.118 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:49:17.119 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:49:17.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26ec077460 msgr2=0x7f26ec079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:17.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26ec077460 0x7f26ec079920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f26f8031460 tx=0x7f26f80041a0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 msgr2=0x7f270419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:17.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f270419f860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f26f400d6f0 tx=0x7f26f400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 shutdown_connections 2024-09-06T14:49:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f26ec077460 0x7f26ec079920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2704106800 0x7f270419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 --2- 172.21.15.52:0/830303515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2704100800 0x7f270419f860 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 >> 172.21.15.52:0/830303515 conn(0x7f27040fc520 msgr2=0x7f270406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 shutdown_connections 2024-09-06T14:49:17.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.123+0000 7f2709d44640 1 -- 172.21.15.52:0/830303515 wait complete. 2024-09-06T14:49:17.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.207+0000 7f99538ed640 1 -- 172.21.15.52:0/2636808802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c1033d0 msgr2=0x7f994c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:17.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.207+0000 7f99538ed640 1 --2- 172.21.15.52:0/2636808802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c1033d0 0x7f994c10b8c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9940009880 tx=0x7f994002a530 comp rx=0 tx=0).stop 2024-09-06T14:49:17.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.208+0000 7f99538ed640 1 -- 172.21.15.52:0/2636808802 shutdown_connections 2024-09-06T14:49:17.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.208+0000 7f99538ed640 1 --2- 172.21.15.52:0/2636808802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c1033d0 0x7f994c10b8c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.208+0000 7f99538ed640 1 --2- 172.21.15.52:0/2636808802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c102ab0 0x7f994c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.208+0000 7f99538ed640 1 -- 172.21.15.52:0/2636808802 >> 172.21.15.52:0/2636808802 conn(0x7f994c0fc550 msgr2=0x7f994c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.208+0000 7f99538ed640 1 -- 172.21.15.52:0/2636808802 shutdown_connections 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.208+0000 7f99538ed640 1 -- 172.21.15.52:0/2636808802 wait complete. 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.208+0000 7f99538ed640 1 Processor -- start 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f99538ed640 1 -- start start 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f99538ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c102ab0 0x7f994c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f99538ed640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c1033d0 0x7f994c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f99538ed640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f994c10edc0 con 0x7f994c102ab0 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f99538ed640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f994c10ec40 con 0x7f994c1033d0 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9951689640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c102ab0 0x7f994c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9951689640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c102ab0 0x7f994c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56656/0 (socket says 172.21.15.52:56656) 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9951689640 1 -- 172.21.15.52:0/3505605265 learned_addr learned my addr 172.21.15.52:0/3505605265 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9950e88640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c1033d0 0x7f994c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:17.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9951689640 1 -- 172.21.15.52:0/3505605265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c1033d0 msgr2=0x7f994c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:17.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9951689640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c1033d0 0x7f994c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9951689640 1 -- 172.21.15.52:0/3505605265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c1999c0 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.209+0000 7f9951689640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c102ab0 0x7f994c19f800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f994800d8d0 tx=0x7f994800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.210+0000 7f993e7fc640 1 -- 172.21.15.52:0/3505605265 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9948017030 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.210+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c199cb0 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.210+0000 7f993e7fc640 1 -- 172.21.15.52:0/3505605265 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9948004020 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.210+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c19a210 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.210+0000 7f993e7fc640 1 -- 172.21.15.52:0/3505605265 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99480047a0 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.211+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9930005290 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.211+0000 7f993e7fc640 1 -- 172.21.15.52:0/3505605265 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f99480041d0 con 0x7f994c102ab0 2024-09-06T14:49:17.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.212+0000 7f993e7fc640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f99380774b0 0x7f9938079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.212+0000 7f993e7fc640 1 -- 172.21.15.52:0/3505605265 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6027+0+0 (secure 0 0 0) 0x7f9948018070 con 0x7f994c102ab0 2024-09-06T14:49:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.212+0000 7f9950e88640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f99380774b0 0x7f9938079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:17.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.213+0000 7f9950e88640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f99380774b0 0x7f9938079970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f994c19b1b0 tx=0x7f9940031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:17.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.216+0000 7f993e7fc640 1 -- 172.21.15.52:0/3505605265 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f99480624c0 con 0x7f994c102ab0 2024-09-06T14:49:17.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.437+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9930005580 con 0x7f994c102ab0 2024-09-06T14:49:17.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.437+0000 7f993e7fc640 1 -- 172.21.15.52:0/3505605265 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+433 (secure 0 0 0) 0x7f9948066630 con 0x7f994c102ab0 2024-09-06T14:49:17.434 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:17.434 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:49:17.434 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:49:17.435 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:17.435 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f99380774b0 msgr2=0x7f9938079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f99380774b0 0x7f9938079970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f994c19b1b0 tx=0x7f9940031400 comp rx=0 tx=0).stop 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c102ab0 msgr2=0x7f994c19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c102ab0 0x7f994c19f800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f994800d8d0 tx=0x7f994800dd90 comp rx=0 tx=0).stop 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 shutdown_connections 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f99380774b0 0x7f9938079970 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c1033d0 0x7f994c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 --2- 172.21.15.52:0/3505605265 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c102ab0 0x7f994c19f800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:17.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 >> 172.21.15.52:0/3505605265 conn(0x7f994c0fc550 msgr2=0x7f994c100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:17.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 shutdown_connections 2024-09-06T14:49:17.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:17.439+0000 7f99538ed640 1 -- 172.21.15.52:0/3505605265 wait complete. 2024-09-06T14:49:17.765 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:17.765 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1722657476' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:17.765 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2858428079' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:49:17.765 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: Upgrade: Updating crash.smithi052 (1/2) 2024-09-06T14:49:17.765 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:17.766 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-06T14:49:17.766 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:17.766 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: Deploying daemon crash.smithi052 on smithi052 2024-09-06T14:49:17.766 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:17 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3505605265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:49:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1722657476' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2858428079' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:49:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: Upgrade: Updating crash.smithi052 (1/2) 2024-09-06T14:49:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi052", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-06T14:49:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:17.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: Deploying daemon crash.smithi052 on smithi052 2024-09-06T14:49:17.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:17 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3505605265' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:49:18.688 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:18 smithi052 ceph-mon[112917]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:18.688 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:18 smithi052 ceph-mon[112917]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:18.805 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:18 smithi165 ceph-mon[82925]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:18.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:18 smithi165 ceph-mon[82925]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:49:20.903 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:20 smithi165 ceph-mon[82925]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:20.903 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:20 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:20.903 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:20 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:21.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:20 smithi052 ceph-mon[112917]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:21.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:20 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:21.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:20 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:22.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:21 smithi165 ceph-mon[82925]: from='client.34128 -' entity='client.crash.smithi052' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:22.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:21 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:22.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:21 smithi165 ceph-mon[82925]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:49:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:21 smithi052 ceph-mon[112917]: from='client.34128 -' entity='client.crash.smithi052' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:21 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:21 smithi052 ceph-mon[112917]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:49:23.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH) 2024-09-06T14:49:23.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: Upgrade: Updating crash.smithi165 (2/2) 2024-09-06T14:49:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-06T14:49:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: Deploying daemon crash.smithi165 on smithi165 2024-09-06T14:49:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: Health check failed: 1 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH) 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: Upgrade: Updating crash.smithi165 (2/2) 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi165", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: Deploying daemon crash.smithi165 on smithi165 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:23.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:23.968 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:23 smithi165 ceph-mon[82925]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:49:24.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:23 smithi052 ceph-mon[112917]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:49:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:25 smithi052 ceph-mon[112917]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:49:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:25 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:25 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:25 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:25 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:25.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:25 smithi165 ceph-mon[82925]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:49:25.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:25 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:25.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:25 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:25.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:25 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:25.900 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:25 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:26 smithi165 ceph-mon[82925]: from='client.44129 -' entity='client.crash.smithi165' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:26 smithi165 ceph-mon[82925]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 6 op/s 2024-09-06T14:49:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:26 smithi165 ceph-mon[82925]: from='client.44133 -' entity='client.crash.smithi165' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:26 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:26 smithi165 ceph-mon[82925]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 7 op/s 2024-09-06T14:49:27.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:26 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:27.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:26 smithi052 ceph-mon[112917]: from='client.44129 -' entity='client.crash.smithi165' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:26 smithi052 ceph-mon[112917]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 6 op/s 2024-09-06T14:49:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:26 smithi052 ceph-mon[112917]: from='client.44133 -' entity='client.crash.smithi165' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:26 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:26 smithi052 ceph-mon[112917]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 7 op/s 2024-09-06T14:49:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:26 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:28.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:27 smithi052 ceph-mon[112917]: from='client.44137 -' entity='client.crash.smithi165' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:28.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:27 smithi052 ceph-mon[112917]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 4 op/s 2024-09-06T14:49:28.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:27 smithi165 ceph-mon[82925]: from='client.44137 -' entity='client.crash.smithi165' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:28.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:27 smithi165 ceph-mon[82925]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 4 op/s 2024-09-06T14:49:29.512 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:29 smithi165 ceph-mon[82925]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 8 op/s 2024-09-06T14:49:29.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:29.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:29.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:29.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:29.593 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:29 smithi052 ceph-mon[112917]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 8 op/s 2024-09-06T14:49:29.593 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:29.593 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:29.593 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:29.593 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:30.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:30 smithi165 ceph-mon[82925]: Health check update: 4 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH) 2024-09-06T14:49:30.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:30.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:30.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:30 smithi052 ceph-mon[112917]: Health check update: 4 mgr modules have recently crashed (RECENT_MGR_MODULE_CRASH) 2024-09-06T14:49:30.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:30.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:31.956 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:31 smithi165 ceph-mon[82925]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 8 op/s 2024-09-06T14:49:31.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:31 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:31.957 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:31 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:32.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:31 smithi052 ceph-mon[112917]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 8 op/s 2024-09-06T14:49:32.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:31 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:32.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:31 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:33.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:32 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:33.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:32 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:33.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:32 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:33.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:32 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:34.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:34 smithi165 ceph-mon[82925]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 4 op/s 2024-09-06T14:49:34.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:34 smithi052 ceph-mon[112917]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 4 op/s 2024-09-06T14:49:35.321 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.344 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.344 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 7 op/s 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all crash 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"} : dispatch 2024-09-06T14:49:35.345 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"}]': finished 2024-09-06T14:49:35.346 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"} : dispatch 2024-09-06T14:49:35.346 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"}]': finished 2024-09-06T14:49:35.346 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-06T14:49:35.346 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-06T14:49:35.346 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:35 smithi052 ceph-mon[112917]: Upgrade: osd.0 is safe to restart 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 7 op/s 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:35.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all crash 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"} : dispatch 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi052"}]': finished 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"} : dispatch 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi165"}]': finished 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-06T14:49:35.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:35 smithi165 ceph-mon[82925]: Upgrade: osd.0 is safe to restart 2024-09-06T14:49:36.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:36 smithi165 ceph-mon[82925]: Upgrade: Updating osd.0 2024-09-06T14:49:36.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:36.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T14:49:36.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:36.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:36 smithi165 ceph-mon[82925]: Deploying daemon osd.0 on smithi052 2024-09-06T14:49:37.071 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:36 smithi052 ceph-mon[112917]: Upgrade: Updating osd.0 2024-09-06T14:49:37.071 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:37.071 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-06T14:49:37.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:37.072 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:36 smithi052 ceph-mon[112917]: Deploying daemon osd.0 on smithi052 2024-09-06T14:49:38.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:37 smithi165 ceph-mon[82925]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 5 op/s 2024-09-06T14:49:38.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:38.117 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:37 smithi052 ceph-mon[112917]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 5 op/s 2024-09-06T14:49:38.117 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:38.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:38 smithi052 systemd[1]: Stopping Ceph osd.0 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:49:39.373 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:38 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[50108]: 2024-09-06T14:49:38.945+0000 7f7a3b368640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:49:39.373 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:38 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[50108]: 2024-09-06T14:49:38.945+0000 7f7a3b368640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-06T14:49:39.373 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:38 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[50108]: 2024-09-06T14:49:38.945+0000 7f7a3b368640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T14:49:40.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:39 smithi165 ceph-mon[82925]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:40.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:39 smithi165 ceph-mon[82925]: osd.0 marked itself down and dead 2024-09-06T14:49:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:39 smithi052 ceph-mon[112917]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:49:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:39 smithi052 ceph-mon[112917]: osd.0 marked itself down and dead 2024-09-06T14:49:40.544 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:40 smithi052 podman[121715]: 2024-09-06 14:49:40.285291494 +0000 UTC m=+1.486942802 container died ec82c4ded29e04608143a32b2009ee9c4cd560796f66ede72095e38dcd522102 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-635ed4c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T14:49:40.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:40 smithi052 ceph-mon[112917]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:49:40.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:40 smithi052 ceph-mon[112917]: osdmap e49: 6 total, 5 up, 6 in 2024-09-06T14:49:40.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:40 smithi052 podman[121715]: 2024-09-06 14:49:40.646751083 +0000 UTC m=+1.848402380 container cleanup ec82c4ded29e04608143a32b2009ee9c4cd560796f66ede72095e38dcd522102 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-635ed4c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-06T14:49:40.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:40 smithi052 bash[121715]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0 2024-09-06T14:49:41.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:40 smithi165 ceph-mon[82925]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:49:41.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:40 smithi165 ceph-mon[82925]: osdmap e49: 6 total, 5 up, 6 in 2024-09-06T14:49:41.234 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:40 smithi052 podman[121730]: 2024-09-06 14:49:40.923377813 +0000 UTC m=+0.639060287 container remove ec82c4ded29e04608143a32b2009ee9c4cd560796f66ede72095e38dcd522102 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-635ed4c) 2024-09-06T14:49:41.498 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:41 smithi052 podman[121820]: 2024-09-06 14:49:41.141411502 +0000 UTC m=+0.015858061 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:49:41.498 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:41 smithi052 podman[121820]: 2024-09-06 14:49:41.274650664 +0000 UTC m=+0.149097254 container create 1113366ab7d08a2425d03145030417871951ae83a2c6726e4f14abad67873f6e (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T14:49:41.499 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:41 smithi052 podman[121820]: 2024-09-06 14:49:41.502153211 +0000 UTC m=+0.376599756 container init 1113366ab7d08a2425d03145030417871951ae83a2c6726e4f14abad67873f6e (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:49:41.807 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:41 smithi052 ceph-mon[112917]: pgmap v121: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s 2024-09-06T14:49:41.807 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:41 smithi052 ceph-mon[112917]: osdmap e50: 6 total, 5 up, 6 in 2024-09-06T14:49:41.808 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:41 smithi052 podman[121820]: 2024-09-06 14:49:41.505420743 +0000 UTC m=+0.379867294 container start 1113366ab7d08a2425d03145030417871951ae83a2c6726e4f14abad67873f6e (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T14:49:41.808 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:41 smithi052 podman[121820]: 2024-09-06 14:49:41.811167836 +0000 UTC m=+0.685614381 container attach 1113366ab7d08a2425d03145030417871951ae83a2c6726e4f14abad67873f6e (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:49:42.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:41 smithi165 ceph-mon[82925]: pgmap v121: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s 2024-09-06T14:49:42.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:41 smithi165 ceph-mon[82925]: osdmap e50: 6 total, 5 up, 6 in 2024-09-06T14:49:42.119 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:41 smithi052 podman[121820]: 2024-09-06 14:49:41.811430982 +0000 UTC m=+0.685877526 container died 1113366ab7d08a2425d03145030417871951ae83a2c6726e4f14abad67873f6e (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-06T14:49:42.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:42 smithi052 podman[121843]: 2024-09-06 14:49:42.490377477 +0000 UTC m=+0.792682319 container remove 1113366ab7d08a2425d03145030417871951ae83a2c6726e4f14abad67873f6e (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:49:42.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:42 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-06T14:49:42.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:42 smithi052 systemd[1]: Stopped Ceph osd.0 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:49:42.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:42 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.0.service: Consumed 52.144s CPU time. 2024-09-06T14:49:42.873 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:42 smithi052 systemd[1]: Starting Ceph osd.0 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:49:43.210 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:42 smithi052 podman[121940]: 2024-09-06 14:49:42.85185986 +0000 UTC m=+0.016285810 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:49:43.210 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:42 smithi052 podman[121940]: 2024-09-06 14:49:42.96689257 +0000 UTC m=+0.131318509 container create 30173368aa57d8455d21d38f4711736e333cf548fefbb29b63c131d666cc35d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:49:43.210 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:43 smithi052 podman[121940]: 2024-09-06 14:49:43.178094654 +0000 UTC m=+0.342520595 container init 30173368aa57d8455d21d38f4711736e333cf548fefbb29b63c131d666cc35d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-06T14:49:43.210 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:43 smithi052 podman[121940]: 2024-09-06 14:49:43.181599258 +0000 UTC m=+0.346025199 container start 30173368aa57d8455d21d38f4711736e333cf548fefbb29b63c131d666cc35d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-09-06T14:49:43.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:43 smithi052 podman[121940]: 2024-09-06 14:49:43.270043044 +0000 UTC m=+0.434468999 container attach 30173368aa57d8455d21d38f4711736e333cf548fefbb29b63c131d666cc35d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-06T14:49:43.694 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:43 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:49:43.694 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:43 smithi052 bash[121940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:49:43.694 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:43 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:49:43.694 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:43 smithi052 bash[121940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:49:44.061 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:43 smithi052 ceph-mon[112917]: pgmap v123: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:49:44.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:43 smithi165 ceph-mon[82925]: pgmap v123: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:49:44.347 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-06T14:49:44.347 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 bash[121940]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-06T14:49:44.347 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-06T14:49:44.347 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 bash[121940]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-06T14:49:44.347 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-06T14:49:44.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 bash[121940]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-06T14:49:44.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-06T14:49:44.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 bash[121940]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-06T14:49:44.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-06T14:49:44.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 bash[121940]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-06T14:49:44.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-06T14:49:44.623 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 bash[121940]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-06T14:49:44.624 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate[121955]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-06T14:49:44.624 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 bash[121940]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-06T14:49:44.624 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 podman[121940]: 2024-09-06 14:49:44.378328754 +0000 UTC m=+1.542754695 container died 30173368aa57d8455d21d38f4711736e333cf548fefbb29b63c131d666cc35d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-06T14:49:44.979 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:44 smithi052 ceph-mon[112917]: Health check failed: Degraded data redundancy: 66/339 objects degraded (19.469%), 20 pgs degraded (PG_DEGRADED) 2024-09-06T14:49:45.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:44 smithi165 ceph-mon[82925]: Health check failed: Degraded data redundancy: 66/339 objects degraded (19.469%), 20 pgs degraded (PG_DEGRADED) 2024-09-06T14:49:45.329 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:44 smithi052 podman[122097]: 2024-09-06 14:49:44.983028181 +0000 UTC m=+0.599133625 container remove 30173368aa57d8455d21d38f4711736e333cf548fefbb29b63c131d666cc35d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:49:45.329 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:45 smithi052 podman[122154]: 2024-09-06 14:49:45.09201326 +0000 UTC m=+0.016356739 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:49:45.329 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:45 smithi052 podman[122154]: 2024-09-06 14:49:45.217631552 +0000 UTC m=+0.141975032 container create a2f3778f51c7acdf4bc46fb037dac99cac25e9e52b5e6fa75e0209167c1f53e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-06T14:49:45.774 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:45 smithi052 podman[122154]: 2024-09-06 14:49:45.445443218 +0000 UTC m=+0.369786697 container init a2f3778f51c7acdf4bc46fb037dac99cac25e9e52b5e6fa75e0209167c1f53e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-06T14:49:45.774 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:45 smithi052 podman[122154]: 2024-09-06 14:49:45.448730919 +0000 UTC m=+0.373074400 container start a2f3778f51c7acdf4bc46fb037dac99cac25e9e52b5e6fa75e0209167c1f53e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-06T14:49:45.774 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:45 smithi052 ceph-osd[122172]: -- 172.21.15.52:0/3737308565 <== mon.0 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563e0c8861e0 con 0x563e0c818000 2024-09-06T14:49:45.774 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:45 smithi052 bash[122154]: a2f3778f51c7acdf4bc46fb037dac99cac25e9e52b5e6fa75e0209167c1f53e8 2024-09-06T14:49:45.774 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:45 smithi052 systemd[1]: Started Ceph osd.0 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:49:46.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:45 smithi165 ceph-mon[82925]: pgmap v124: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:46.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:45 smithi052 ceph-mon[112917]: pgmap v124: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:46.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:47.373 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:47 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[122168]: 2024-09-06T14:49:47.097+0000 7f02e9944640 -1 Falling back to public interface 2024-09-06T14:49:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 -- 172.21.15.52:0/3458538287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 msgr2=0x7f7df4106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/3458538287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df4106a80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009880 tx=0x7f7de402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 -- 172.21.15.52:0/3458538287 shutdown_connections 2024-09-06T14:49:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/3458538287 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7df4100610 0x7f7df4100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/3458538287 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df4106a80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 -- 172.21.15.52:0/3458538287 >> 172.21.15.52:0/3458538287 conn(0x7f7df40fc310 msgr2=0x7f7df40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:47.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 -- 172.21.15.52:0/3458538287 shutdown_connections 2024-09-06T14:49:47.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 -- 172.21.15.52:0/3458538287 wait complete. 2024-09-06T14:49:47.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.538+0000 7f7df8ba2640 1 Processor -- start 2024-09-06T14:49:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df8ba2640 1 -- start start 2024-09-06T14:49:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df8ba2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7df4100610 0x7f7df410b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df8ba2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df410bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df8ba2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7df410ebd0 con 0x7f7df41066a0 2024-09-06T14:49:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df8ba2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7df410ea50 con 0x7f7df4100610 2024-09-06T14:49:47.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df410bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df410bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59500/0 (socket says 172.21.15.52:59500) 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df2ffd640 1 -- 172.21.15.52:0/2970519736 learned_addr learned my addr 172.21.15.52:0/2970519736 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df37fe640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7df4100610 0x7f7df410b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df2ffd640 1 -- 172.21.15.52:0/2970519736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7df4100610 msgr2=0x7f7df410b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df2ffd640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7df4100610 0x7f7df410b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df2ffd640 1 -- 172.21.15.52:0/2970519736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df410c020 con 0x7f7df41066a0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.539+0000 7f7df2ffd640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df410bae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c810 tx=0x7f7ddc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.540+0000 7f7df0ff9640 1 -- 172.21.15.52:0/2970519736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ddc004020 con 0x7f7df41066a0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.540+0000 7f7df0ff9640 1 -- 172.21.15.52:0/2970519736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ddc0041c0 con 0x7f7df41066a0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.540+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df410c310 con 0x7f7df41066a0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.540+0000 7f7df0ff9640 1 -- 172.21.15.52:0/2970519736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ddc0047a0 con 0x7f7df41066a0 2024-09-06T14:49:47.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.540+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df41a3be0 con 0x7f7df41066a0 2024-09-06T14:49:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.541+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df4101d50 con 0x7f7df41066a0 2024-09-06T14:49:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.541+0000 7f7df0ff9640 1 -- 172.21.15.52:0/2970519736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7ddc0079b0 con 0x7f7df41066a0 2024-09-06T14:49:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.542+0000 7f7df0ff9640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7de00774b0 0x7f7de0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.542+0000 7f7df37fe640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7de00774b0 0x7f7de0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:47.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.542+0000 7f7df0ff9640 1 -- 172.21.15.52:0/2970519736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6027+0+0 (secure 0 0 0) 0x7f7ddc099430 con 0x7f7df41066a0 2024-09-06T14:49:47.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.543+0000 7f7df37fe640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7de00774b0 0x7f7de0079970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7de4031460 tx=0x7f7de4005bd0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:47.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.546+0000 7f7df0ff9640 1 -- 172.21.15.52:0/2970519736 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7ddc014030 con 0x7f7df41066a0 2024-09-06T14:49:47.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.727+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7df4108bf0 con 0x7f7de00774b0 2024-09-06T14:49:47.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.729+0000 7f7df0ff9640 1 -- 172.21.15.52:0/2970519736 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f7de4004340 con 0x7f7de00774b0 2024-09-06T14:49:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7de00774b0 msgr2=0x7f7de0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7de00774b0 0x7f7de0079970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7de4031460 tx=0x7f7de4005bd0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 msgr2=0x7f7df410bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:47.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df410bae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c810 tx=0x7f7ddc00ccd0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 shutdown_connections 2024-09-06T14:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7df41066a0 0x7f7df410bae0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7de00774b0 0x7f7de0079970 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 --2- 172.21.15.52:0/2970519736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7df4100610 0x7f7df410b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 >> 172.21.15.52:0/2970519736 conn(0x7f7df40fc310 msgr2=0x7f7df40fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 shutdown_connections 2024-09-06T14:49:47.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.731+0000 7f7df8ba2640 1 -- 172.21.15.52:0/2970519736 wait complete. 2024-09-06T14:49:47.738 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:49:47.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.819+0000 7fac36f6c640 1 -- 172.21.15.52:0/489167139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 msgr2=0x7fac30100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:47.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.819+0000 7fac36f6c640 1 --2- 172.21.15.52:0/489167139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac30100220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fac20009880 tx=0x7fac2002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.819+0000 7fac36f6c640 1 -- 172.21.15.52:0/489167139 shutdown_connections 2024-09-06T14:49:47.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.819+0000 7fac36f6c640 1 --2- 172.21.15.52:0/489167139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac30100220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.819+0000 7fac36f6c640 1 --2- 172.21.15.52:0/489167139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301069a0 0x7fac30106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.819+0000 7fac36f6c640 1 -- 172.21.15.52:0/489167139 >> 172.21.15.52:0/489167139 conn(0x7fac300fbc90 msgr2=0x7fac300fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:47.817 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:47 smithi052 ceph-mon[112917]: pgmap v125: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:47.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 -- 172.21.15.52:0/489167139 shutdown_connections 2024-09-06T14:49:47.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 -- 172.21.15.52:0/489167139 wait complete. 2024-09-06T14:49:47.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 Processor -- start 2024-09-06T14:49:47.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 -- start start 2024-09-06T14:49:47.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac3019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301069a0 0x7fac3019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010ef40 con 0x7fac300ffdc0 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac36f6c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010edc0 con 0x7fac301069a0 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.820+0000 7fac34d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac3019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac34d08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac3019d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59520/0 (socket says 172.21.15.52:59520) 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac34d08640 1 -- 172.21.15.52:0/4017662099 learned_addr learned my addr 172.21.15.52:0/4017662099 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac27fff640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301069a0 0x7fac3019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac34d08640 1 -- 172.21.15.52:0/4017662099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301069a0 msgr2=0x7fac3019dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac34d08640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301069a0 0x7fac3019dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac34d08640 1 -- 172.21.15.52:0/4017662099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac301978d0 con 0x7fac300ffdc0 2024-09-06T14:49:47.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac27fff640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301069a0 0x7fac3019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:49:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac34d08640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac3019d710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00d6f0 tx=0x7fac2c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac25ffb640 1 -- 172.21.15.52:0/4017662099 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac2c017070 con 0x7fac300ffdc0 2024-09-06T14:49:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac25ffb640 1 -- 172.21.15.52:0/4017662099 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac2c00de00 con 0x7fac300ffdc0 2024-09-06T14:49:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac30197bc0 con 0x7fac300ffdc0 2024-09-06T14:49:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac25ffb640 1 -- 172.21.15.52:0/4017662099 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac2c004bb0 con 0x7fac300ffdc0 2024-09-06T14:49:47.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.821+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac30198010 con 0x7fac300ffdc0 2024-09-06T14:49:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.823+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac30100220 con 0x7fac300ffdc0 2024-09-06T14:49:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.823+0000 7fac25ffb640 1 -- 172.21.15.52:0/4017662099 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fac2c009a30 con 0x7fac300ffdc0 2024-09-06T14:49:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.824+0000 7fac25ffb640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac180774b0 0x7fac18079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.824+0000 7fac25ffb640 1 -- 172.21.15.52:0/4017662099 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6027+0+0 (secure 0 0 0) 0x7fac2c0991f0 con 0x7fac300ffdc0 2024-09-06T14:49:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.824+0000 7fac27fff640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac180774b0 0x7fac18079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:47.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.824+0000 7fac27fff640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac180774b0 0x7fac18079970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac20031460 tx=0x7fac200095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:47.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:47.828+0000 7fac25ffb640 1 -- 172.21.15.52:0/4017662099 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fac2c062300 con 0x7fac300ffdc0 2024-09-06T14:49:48.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.010+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac30198370 con 0x7fac180774b0 2024-09-06T14:49:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.011+0000 7fac25ffb640 1 -- 172.21.15.52:0/4017662099 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fac30198370 con 0x7fac180774b0 2024-09-06T14:49:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac180774b0 msgr2=0x7fac18079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac180774b0 0x7fac18079970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac20031460 tx=0x7fac200095f0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 msgr2=0x7fac3019d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac3019d710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00d6f0 tx=0x7fac2c00dbb0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 shutdown_connections 2024-09-06T14:49:48.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac180774b0 0x7fac18079970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301069a0 0x7fac3019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 --2- 172.21.15.52:0/4017662099 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac300ffdc0 0x7fac3019d710 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 >> 172.21.15.52:0/4017662099 conn(0x7fac300fbc90 msgr2=0x7fac300fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 shutdown_connections 2024-09-06T14:49:48.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.013+0000 7fac36f6c640 1 -- 172.21.15.52:0/4017662099 wait complete. 2024-09-06T14:49:48.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:47 smithi165 ceph-mon[82925]: pgmap v125: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:48.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 -- 172.21.15.52:0/2101197215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 msgr2=0x7f76d4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2101197215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d4100c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009880 tx=0x7f76c402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 -- 172.21.15.52:0/2101197215 shutdown_connections 2024-09-06T14:49:48.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2101197215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d4100c50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2101197215 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d41067f0 0x7f76d4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 -- 172.21.15.52:0/2101197215 >> 172.21.15.52:0/2101197215 conn(0x7f76d40fc550 msgr2=0x7f76d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 -- 172.21.15.52:0/2101197215 shutdown_connections 2024-09-06T14:49:48.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 -- 172.21.15.52:0/2101197215 wait complete. 2024-09-06T14:49:48.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 Processor -- start 2024-09-06T14:49:48.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.097+0000 7f76dbddf640 1 -- start start 2024-09-06T14:49:48.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76dbddf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76dbddf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d41067f0 0x7f76d419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76dbddf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410dca0 con 0x7f76d41007f0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76dbddf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410db20 con 0x7f76d41067f0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d9b7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d9b7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59538/0 (socket says 172.21.15.52:59538) 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d9b7b640 1 -- 172.21.15.52:0/2317839841 learned_addr learned my addr 172.21.15.52:0/2317839841 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d937a640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d41067f0 0x7f76d419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d9b7b640 1 -- 172.21.15.52:0/2317839841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d41067f0 msgr2=0x7f76d419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d9b7b640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d41067f0 0x7f76d419db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d9b7b640 1 -- 172.21.15.52:0/2317839841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d4197780 con 0x7f76d41007f0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76d9b7b640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d419d600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c8a0 tx=0x7f76d000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76caffd640 1 -- 172.21.15.52:0/2317839841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76d00079b0 con 0x7f76d41007f0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76caffd640 1 -- 172.21.15.52:0/2317839841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76d0007b50 con 0x7f76d41007f0 2024-09-06T14:49:48.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76caffd640 1 -- 172.21.15.52:0/2317839841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76d0018700 con 0x7f76d41007f0 2024-09-06T14:49:48.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.098+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d4197a70 con 0x7f76d41007f0 2024-09-06T14:49:48.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.099+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d4198000 con 0x7f76d41007f0 2024-09-06T14:49:48.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.099+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d4101f30 con 0x7f76d41007f0 2024-09-06T14:49:48.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.100+0000 7f76caffd640 1 -- 172.21.15.52:0/2317839841 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f76d0007d00 con 0x7f76d41007f0 2024-09-06T14:49:48.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.101+0000 7f76caffd640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76c0077460 0x7f76c0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.101+0000 7f76caffd640 1 -- 172.21.15.52:0/2317839841 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6027+0+0 (secure 0 0 0) 0x7f76d0099890 con 0x7f76d41007f0 2024-09-06T14:49:48.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.101+0000 7f76d937a640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76c0077460 0x7f76c0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.101+0000 7f76d937a640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76c0077460 0x7f76c0079920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76c4031460 tx=0x7f76c4009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:48.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.105+0000 7f76caffd640 1 -- 172.21.15.52:0/2317839841 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f76d0014030 con 0x7f76d41007f0 2024-09-06T14:49:48.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.280+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f76d4198370 con 0x7f76c0077460 2024-09-06T14:49:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.292+0000 7f76caffd640 1 -- 172.21.15.52:0/2317839841 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f76d4198370 con 0x7f76c0077460 2024-09-06T14:49:48.289 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (2m) 18s ago 13m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (4m) 18s ago 13m 8766k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (4m) 20s ago 12m 8728k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (28s) 18s ago 13m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (23s) 20s ago 12m 14.3M - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (110s) 18s ago 12m 78.2M - c8b91775d855 af78eb451b94 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (7m) 18s ago 7m 89.0M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (7m) 18s ago 7m 146M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (7m) 20s ago 7m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (7m) 20s ago 7m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (4m) 18s ago 14m 518M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (3m) 20s ago 12m 456M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:49:48.290 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (58s) 18s ago 14m 36.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (41s) 20s ago 12m 26.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (3m) 18s ago 13m 10.1M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (2m) 20s ago 12m 11.9M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 starting - - - 1217M 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (10m) 18s ago 10m 219M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (10m) 18s ago 10m 184M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (9m) 20s ago 9m 239M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (9m) 20s ago 9m 209M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (8m) 20s ago 8m 186M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:49:48.291 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (2m) 18s ago 12m 50.0M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:49:48.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76c0077460 msgr2=0x7f76c0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76c0077460 0x7f76c0079920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76c4031460 tx=0x7f76c4009560 comp rx=0 tx=0).stop 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 msgr2=0x7f76d419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d419d600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c8a0 tx=0x7f76d000cd60 comp rx=0 tx=0).stop 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 shutdown_connections 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76c0077460 0x7f76c0079920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f76d41067f0 0x7f76d419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 --2- 172.21.15.52:0/2317839841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76d41007f0 0x7f76d419d600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 >> 172.21.15.52:0/2317839841 conn(0x7f76d40fc550 msgr2=0x7f76d4069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 shutdown_connections 2024-09-06T14:49:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.294+0000 7f76dbddf640 1 -- 172.21.15.52:0/2317839841 wait complete. 2024-09-06T14:49:48.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 -- 172.21.15.52:0/350182554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100ce0 msgr2=0x7f31281065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 --2- 172.21.15.52:0/350182554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100ce0 0x7f31281065a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3114009880 tx=0x7f311402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 -- 172.21.15.52:0/350182554 shutdown_connections 2024-09-06T14:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 --2- 172.21.15.52:0/350182554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100ce0 0x7f31281065a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 --2- 172.21.15.52:0/350182554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3128100330 0x7f3128100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 -- 172.21.15.52:0/350182554 >> 172.21.15.52:0/350182554 conn(0x7f3128077270 msgr2=0x7f3128077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 -- 172.21.15.52:0/350182554 shutdown_connections 2024-09-06T14:49:48.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.383+0000 7f312f208640 1 -- 172.21.15.52:0/350182554 wait complete. 2024-09-06T14:49:48.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312f208640 1 Processor -- start 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312f208640 1 -- start start 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312f208640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100330 0x7f312819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312f208640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3128100ce0 0x7f312819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312f208640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f312810edf0 con 0x7f3128100330 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312f208640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f312810ec70 con 0x7f3128100ce0 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312cfa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100330 0x7f312819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312cfa4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100330 0x7f312819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59562/0 (socket says 172.21.15.52:59562) 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.384+0000 7f312cfa4640 1 -- 172.21.15.52:0/18506358 learned_addr learned my addr 172.21.15.52:0/18506358 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f3127fff640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3128100ce0 0x7f312819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f312cfa4640 1 -- 172.21.15.52:0/18506358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3128100ce0 msgr2=0x7f312819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f312cfa4640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3128100ce0 0x7f312819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f312cfa4640 1 -- 172.21.15.52:0/18506358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3128197820 con 0x7f3128100330 2024-09-06T14:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f312cfa4640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100330 0x7f312819d6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f311c00c8f0 tx=0x7f311c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f3125ffb640 1 -- 172.21.15.52:0/18506358 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f311c0079b0 con 0x7f3128100330 2024-09-06T14:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3128197b10 con 0x7f3128100330 2024-09-06T14:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f3125ffb640 1 -- 172.21.15.52:0/18506358 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f311c0054e0 con 0x7f3128100330 2024-09-06T14:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f3125ffb640 1 -- 172.21.15.52:0/18506358 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f311c004dd0 con 0x7f3128100330 2024-09-06T14:49:48.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.385+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31281980a0 con 0x7f3128100330 2024-09-06T14:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.386+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3128069e00 con 0x7f3128100330 2024-09-06T14:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.387+0000 7f3125ffb640 1 -- 172.21.15.52:0/18506358 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f311c005020 con 0x7f3128100330 2024-09-06T14:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.387+0000 7f3125ffb640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f31180773f0 0x7f31180798b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.387+0000 7f3125ffb640 1 -- 172.21.15.52:0/18506358 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6027+0+0 (secure 0 0 0) 0x7f311c099610 con 0x7f3128100330 2024-09-06T14:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.387+0000 7f3127fff640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f31180773f0 0x7f31180798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.388+0000 7f3127fff640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f31180773f0 0x7f31180798b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3114000c00 tx=0x7f3114031420 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:48.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.391+0000 7f3125ffb640 1 -- 172.21.15.52:0/18506358 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f311c014030 con 0x7f3128100330 2024-09-06T14:49:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.627+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3128109e80 con 0x7f3128100330 2024-09-06T14:49:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.628+0000 7f3125ffb640 1 -- 172.21.15.52:0/18506358 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f311c097e20 con 0x7f3128100330 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 5 2024-09-06T14:49:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 9, 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:49:48.626 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f31180773f0 msgr2=0x7f31180798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f31180773f0 0x7f31180798b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3114000c00 tx=0x7f3114031420 comp rx=0 tx=0).stop 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100330 msgr2=0x7f312819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100330 0x7f312819d6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f311c00c8f0 tx=0x7f311c00cdb0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 shutdown_connections 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f31180773f0 0x7f31180798b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3128100ce0 0x7f312819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 --2- 172.21.15.52:0/18506358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3128100330 0x7f312819d6a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 >> 172.21.15.52:0/18506358 conn(0x7f3128077270 msgr2=0x7f31280fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 shutdown_connections 2024-09-06T14:49:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.630+0000 7f312f208640 1 -- 172.21.15.52:0/18506358 wait complete. 2024-09-06T14:49:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 -- 172.21.15.52:0/3996662082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 msgr2=0x7f787c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 --2- 172.21.15.52:0/3996662082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c102e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f786c009880 tx=0x7f786c02a530 comp rx=0 tx=0).stop 2024-09-06T14:49:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 -- 172.21.15.52:0/3996662082 shutdown_connections 2024-09-06T14:49:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 --2- 172.21.15.52:0/3996662082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f787c1033d0 0x7f787c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 --2- 172.21.15.52:0/3996662082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c102e90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 -- 172.21.15.52:0/3996662082 >> 172.21.15.52:0/3996662082 conn(0x7f787c0fc550 msgr2=0x7f787c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 -- 172.21.15.52:0/3996662082 shutdown_connections 2024-09-06T14:49:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.715+0000 7f7880fc9640 1 -- 172.21.15.52:0/3996662082 wait complete. 2024-09-06T14:49:48.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.716+0000 7f7880fc9640 1 Processor -- start 2024-09-06T14:49:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.717+0000 7f7880fc9640 1 -- start start 2024-09-06T14:49:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.717+0000 7f7880fc9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.717+0000 7f7880fc9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f787c1033d0 0x7f787c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.717+0000 7f7880fc9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f787c10edc0 con 0x7f787c102ab0 2024-09-06T14:49:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.717+0000 7f7880fc9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f787c10ec40 con 0x7f787c1033d0 2024-09-06T14:49:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f787a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f787a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59574/0 (socket says 172.21.15.52:59574) 2024-09-06T14:49:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f787a59c640 1 -- 172.21.15.52:0/1900619779 learned_addr learned my addr 172.21.15.52:0/1900619779 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f7879d9b640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f787c1033d0 0x7f787c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f787a59c640 1 -- 172.21.15.52:0/1900619779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f787c1033d0 msgr2=0x7f787c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f787a59c640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f787c1033d0 0x7f787c19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f787a59c640 1 -- 172.21.15.52:0/1900619779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c1977b0 con 0x7f787c102ab0 2024-09-06T14:49:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.718+0000 7f787a59c640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c19d630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f786c031460 tx=0x7f786c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.719+0000 7f786b7fe640 1 -- 172.21.15.52:0/1900619779 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f786c03f070 con 0x7f787c102ab0 2024-09-06T14:49:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.719+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c197a40 con 0x7f787c102ab0 2024-09-06T14:49:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.719+0000 7f786b7fe640 1 -- 172.21.15.52:0/1900619779 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f786c0035f0 con 0x7f787c102ab0 2024-09-06T14:49:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.719+0000 7f786b7fe640 1 -- 172.21.15.52:0/1900619779 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f786c035030 con 0x7f787c102ab0 2024-09-06T14:49:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.719+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c197f70 con 0x7f787c102ab0 2024-09-06T14:49:48.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.720+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c06a580 con 0x7f787c102ab0 2024-09-06T14:49:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.720+0000 7f786b7fe640 1 -- 172.21.15.52:0/1900619779 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f786c042070 con 0x7f787c102ab0 2024-09-06T14:49:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.721+0000 7f786b7fe640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7864077460 0x7f7864079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.721+0000 7f786b7fe640 1 -- 172.21.15.52:0/1900619779 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6027+0+0 (secure 0 0 0) 0x7f786c0b9f40 con 0x7f787c102ab0 2024-09-06T14:49:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.721+0000 7f7879d9b640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7864077460 0x7f7864079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.722+0000 7f7879d9b640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7864077460 0x7f7864079920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f787c0ff010 tx=0x7f787000b360 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:48.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.725+0000 7f786b7fe640 1 -- 172.21.15.52:0/1900619779 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f786c0871e0 con 0x7f787c102ab0 2024-09-06T14:49:48.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.911+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f787c105f80 con 0x7f787c102ab0 2024-09-06T14:49:48.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.912+0000 7f786b7fe640 1 -- 172.21.15.52:0/1900619779 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7f786c08bc00 con 0x7f787c102ab0 2024-09-06T14:49:48.909 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:49:48.909 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:49:48.909 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:49:48.909 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:49:48.909 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:49:48.909 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:49:48.910 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:49:48.911 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:49:48.912 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7864077460 msgr2=0x7f7864079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7864077460 0x7f7864079920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f787c0ff010 tx=0x7f787000b360 comp rx=0 tx=0).stop 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 msgr2=0x7f787c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c19d630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f786c031460 tx=0x7f786c0045e0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 shutdown_connections 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7864077460 0x7f7864079920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f787c1033d0 0x7f787c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 --2- 172.21.15.52:0/1900619779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f787c102ab0 0x7f787c19d630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 >> 172.21.15.52:0/1900619779 conn(0x7f787c0fc550 msgr2=0x7f787c108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 shutdown_connections 2024-09-06T14:49:48.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.914+0000 7f7880fc9640 1 -- 172.21.15.52:0/1900619779 wait complete. 2024-09-06T14:49:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 -- 172.21.15.52:0/1635508114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 msgr2=0x7f436810b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 --2- 172.21.15.52:0/1635508114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436810b980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f435c009880 tx=0x7f435c02a530 comp rx=0 tx=0).stop 2024-09-06T14:49:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 -- 172.21.15.52:0/1635508114 shutdown_connections 2024-09-06T14:49:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 --2- 172.21.15.52:0/1635508114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436810b980 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 --2- 172.21.15.52:0/1635508114 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4368102b70 0x7f4368102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 -- 172.21.15.52:0/1635508114 >> 172.21.15.52:0/1635508114 conn(0x7f43680fc510 msgr2=0x7f43680fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 -- 172.21.15.52:0/1635508114 shutdown_connections 2024-09-06T14:49:48.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.998+0000 7f436df1e640 1 -- 172.21.15.52:0/1635508114 wait complete. 2024-09-06T14:49:48.996 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:48 smithi052 ceph-mon[112917]: from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:48.997 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:48 smithi052 ceph-mon[112917]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:48.997 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:48 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/18506358' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.999+0000 7f436df1e640 1 Processor -- start 2024-09-06T14:49:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:48.999+0000 7f436df1e640 1 -- start start 2024-09-06T14:49:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f436df1e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4368102b70 0x7f436819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f436df1e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f436df1e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f436810ee60 con 0x7f4368103490 2024-09-06T14:49:48.998 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f436df1e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f436810ece0 con 0x7f4368102b70 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4366ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4366ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59588/0 (socket says 172.21.15.52:59588) 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4366ffd640 1 -- 172.21.15.52:0/3102509981 learned_addr learned my addr 172.21.15.52:0/3102509981 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f43677fe640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4368102b70 0x7f436819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4366ffd640 1 -- 172.21.15.52:0/3102509981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4368102b70 msgr2=0x7f436819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4366ffd640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4368102b70 0x7f436819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4366ffd640 1 -- 172.21.15.52:0/3102509981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4368197850 con 0x7f4368103490 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4366ffd640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436819dc10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f435c004f90 tx=0x7f435c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.000+0000 7f4364ff9640 1 -- 172.21.15.52:0/3102509981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f435c03f070 con 0x7f4368103490 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.001+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4368197ae0 con 0x7f4368103490 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.001+0000 7f4364ff9640 1 -- 172.21.15.52:0/3102509981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f435c004cf0 con 0x7f4368103490 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.001+0000 7f4364ff9640 1 -- 172.21.15.52:0/3102509981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f435c035030 con 0x7f4368103490 2024-09-06T14:49:48.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.001+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4368198010 con 0x7f4368103490 2024-09-06T14:49:49.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.002+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f436806ad00 con 0x7f4368103490 2024-09-06T14:49:49.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.002+0000 7f4364ff9640 1 -- 172.21.15.52:0/3102509981 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f435c042070 con 0x7f4368103490 2024-09-06T14:49:49.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.003+0000 7f4364ff9640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4350077460 0x7f4350079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.003+0000 7f43677fe640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4350077460 0x7f4350079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.003+0000 7f4364ff9640 1 -- 172.21.15.52:0/3102509981 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6027+0+0 (secure 0 0 0) 0x7f435c0ba100 con 0x7f4368103490 2024-09-06T14:49:49.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.003+0000 7f43677fe640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4350077460 0x7f4350079920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4358009890 tx=0x7f4358008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:49.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.008+0000 7f4364ff9640 1 -- 172.21.15.52:0/3102509981 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f435c083230 con 0x7f4368103490 2024-09-06T14:49:49.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:48 smithi165 ceph-mon[82925]: from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:48 smithi165 ceph-mon[82925]: from='client.34146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:48 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/18506358' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:49.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.190+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f43681982c0 con 0x7f4350077460 2024-09-06T14:49:49.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.191+0000 7f4364ff9640 1 -- 172.21.15.52:0/3102509981 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f43681982c0 con 0x7f4350077460 2024-09-06T14:49:49.188 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:49:49.189 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:49:49.189 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "6/23 daemons upgraded", 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading osd daemons", 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:49:49.190 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:49:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4350077460 msgr2=0x7f4350079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4350077460 0x7f4350079920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4358009890 tx=0x7f4358008040 comp rx=0 tx=0).stop 2024-09-06T14:49:49.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 msgr2=0x7f436819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436819dc10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f435c004f90 tx=0x7f435c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 shutdown_connections 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4368103490 0x7f436819dc10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4350077460 0x7f4350079920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 --2- 172.21.15.52:0/3102509981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4368102b70 0x7f436819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 >> 172.21.15.52:0/3102509981 conn(0x7f43680fc510 msgr2=0x7f4368103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 shutdown_connections 2024-09-06T14:49:49.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.194+0000 7f436df1e640 1 -- 172.21.15.52:0/3102509981 wait complete. 2024-09-06T14:49:49.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/1991240557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641007f0 msgr2=0x7f9f64100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:49.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/1991240557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641007f0 0x7f9f64100c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009880 tx=0x7f9f4c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/1991240557 shutdown_connections 2024-09-06T14:49:49.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/1991240557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641007f0 0x7f9f64100c50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/1991240557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f641067f0 0x7f9f64106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/1991240557 >> 172.21.15.52:0/1991240557 conn(0x7f9f640fc550 msgr2=0x7f9f640fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:49.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/1991240557 shutdown_connections 2024-09-06T14:49:49.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.280+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/1991240557 wait complete. 2024-09-06T14:49:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f6a2c6640 1 Processor -- start 2024-09-06T14:49:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f6a2c6640 1 -- start start 2024-09-06T14:49:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f6a2c6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f641007f0 0x7f9f641987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:49.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f6a2c6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641067f0 0x7f9f64198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f6a2c6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6410dcc0 con 0x7f9f641067f0 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f6a2c6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6410db40 con 0x7f9f641007f0 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641067f0 0x7f9f64198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f5bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641067f0 0x7f9f64198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59608/0 (socket says 172.21.15.52:59608) 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.281+0000 7f9f5bfff640 1 -- 172.21.15.52:0/800982324 learned_addr learned my addr 172.21.15.52:0/800982324 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f63fff640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f641007f0 0x7f9f641987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f5bfff640 1 -- 172.21.15.52:0/800982324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f641007f0 msgr2=0x7f9f641987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f5bfff640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f641007f0 0x7f9f641987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f5bfff640 1 -- 172.21.15.52:0/800982324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f64199340 con 0x7f9f641067f0 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f63fff640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f641007f0 0x7f9f641987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f5bfff640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641067f0 0x7f9f64198cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c031460 tx=0x7f9f4c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f61ffb640 1 -- 172.21.15.52:0/800982324 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f4c03f070 con 0x7f9f641067f0 2024-09-06T14:49:49.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f641995d0 con 0x7f9f641067f0 2024-09-06T14:49:49.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f61ffb640 1 -- 172.21.15.52:0/800982324 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f4c0044d0 con 0x7f9f641067f0 2024-09-06T14:49:49.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f61ffb640 1 -- 172.21.15.52:0/800982324 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f4c035030 con 0x7f9f641067f0 2024-09-06T14:49:49.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.282+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f641a1b80 con 0x7f9f641067f0 2024-09-06T14:49:49.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.283+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f64101f30 con 0x7f9f641067f0 2024-09-06T14:49:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.284+0000 7f9f61ffb640 1 -- 172.21.15.52:0/800982324 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9f4c042070 con 0x7f9f641067f0 2024-09-06T14:49:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.284+0000 7f9f61ffb640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f50077460 0x7f9f50079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:49:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.285+0000 7f9f61ffb640 1 -- 172.21.15.52:0/800982324 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6027+0+0 (secure 0 0 0) 0x7f9f4c0ba160 con 0x7f9f641067f0 2024-09-06T14:49:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.285+0000 7f9f63fff640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f50077460 0x7f9f50079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:49:49.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.285+0000 7f9f63fff640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f50077460 0x7f9f50079920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f540058c0 tx=0x7f9f54005d30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:49:49.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.289+0000 7f9f61ffb640 1 -- 172.21.15.52:0/800982324 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9f4c083290 con 0x7f9f641067f0 2024-09-06T14:49:49.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.514+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f9f6406a2d0 con 0x7f9f641067f0 2024-09-06T14:49:49.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.515+0000 7f9f61ffb640 1 -- 172.21.15.52:0/800982324 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+2353 (secure 0 0 0) 0x7f9f4c004cf0 con 0x7f9f641067f0 2024-09-06T14:49:49.512 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1 osds down; Degraded data redundancy: 66/339 objects degraded (19.469%), 20 pgs degraded; 4 mgr modules have recently crashed 2024-09-06T14:49:49.512 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:49:49.512 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:49:49.512 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:49.512 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:49:49.512 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: osd.0 (root=default,host=smithi052) is down 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 66/339 objects degraded (19.469%), 20 pgs degraded 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-06T14:49:49.513 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:49:49.514 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:49:49.515 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:49:49.515 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:49:49.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.516+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f50077460 msgr2=0x7f9f50079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:49.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f50077460 0x7f9f50079920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f540058c0 tx=0x7f9f54005d30 comp rx=0 tx=0).stop 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641067f0 msgr2=0x7f9f64198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641067f0 0x7f9f64198cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c031460 tx=0x7f9f4c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 shutdown_connections 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f641067f0 0x7f9f64198cf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f50077460 0x7f9f50079920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 --2- 172.21.15.52:0/800982324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f641007f0 0x7f9f641987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 >> 172.21.15.52:0/800982324 conn(0x7f9f640fc550 msgr2=0x7f9f640fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:49:49.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 shutdown_connections 2024-09-06T14:49:49.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:49:49.517+0000 7f9f6a2c6640 1 -- 172.21.15.52:0/800982324 wait complete. 2024-09-06T14:49:50.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:49 smithi165 ceph-mon[82925]: pgmap v126: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 6 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:50.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:49 smithi165 ceph-mon[82925]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:50.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:49 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1900619779' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:49:50.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:49 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/800982324' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:49:50.092 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:49 smithi052 ceph-mon[112917]: pgmap v126: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 6 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:50.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:49 smithi052 ceph-mon[112917]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:50.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:49 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1900619779' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:49:50.093 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:49 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/800982324' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:49:51.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:50 smithi165 ceph-mon[82925]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:51.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:50 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:51.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:50 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:50 smithi052 ceph-mon[112917]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:49:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:50 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:50 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:52.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:51 smithi165 ceph-mon[82925]: pgmap v127: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:52.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:51 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:52.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:51 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:52.115 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:51 smithi052 ceph-mon[112917]: pgmap v127: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:52.115 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:51 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:52.115 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:51 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:52.116 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:51 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[122168]: 2024-09-06T14:49:51.945+0000 7f02e9944640 -1 osd.0 48 log_to_monitors true 2024-09-06T14:49:53.045 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:52 smithi052 ceph-mon[112917]: from='osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T14:49:53.045 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:53.045 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:53.046 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 14:49:52 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[122168]: 2024-09-06T14:49:52.811+0000 7f02e16ee640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:49:53.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:52 smithi165 ceph-mon[82925]: from='osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-06T14:49:53.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:53.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:49:54.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:53 smithi165 ceph-mon[82925]: pgmap v128: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:53 smithi165 ceph-mon[82925]: from='osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T14:49:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:53 smithi165 ceph-mon[82925]: osdmap e51: 6 total, 5 up, 6 in 2024-09-06T14:49:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:53 smithi165 ceph-mon[82925]: from='osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-06T14:49:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:53 smithi052 ceph-mon[112917]: pgmap v128: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:53 smithi052 ceph-mon[112917]: from='osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-06T14:49:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:53 smithi052 ceph-mon[112917]: osdmap e51: 6 total, 5 up, 6 in 2024-09-06T14:49:54.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:53 smithi052 ceph-mon[112917]: from='osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-06T14:49:54.920 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:54 smithi052 ceph-mon[112917]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:49:54.920 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:54 smithi052 ceph-mon[112917]: osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443] boot 2024-09-06T14:49:54.920 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:54 smithi052 ceph-mon[112917]: osdmap e52: 6 total, 6 up, 6 in 2024-09-06T14:49:54.920 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:54 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T14:49:54.920 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:54 smithi052 ceph-mon[112917]: osdmap e53: 6 total, 6 up, 6 in 2024-09-06T14:49:55.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:54 smithi165 ceph-mon[82925]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:49:55.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:54 smithi165 ceph-mon[82925]: osd.0 [v2:172.21.15.52:6802/1441925443,v1:172.21.15.52:6803/1441925443] boot 2024-09-06T14:49:55.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:54 smithi165 ceph-mon[82925]: osdmap e52: 6 total, 6 up, 6 in 2024-09-06T14:49:55.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:54 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-06T14:49:55.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:54 smithi165 ceph-mon[82925]: osdmap e53: 6 total, 6 up, 6 in 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: pgmap v131: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:56.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:56.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:56.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:56.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-06T14:49:56.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-06T14:49:56.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:55 smithi165 ceph-mon[82925]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-06T14:49:56.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: pgmap v131: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:56.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:56.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:56.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:49:56.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:49:56.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:49:56.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:49:56.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:56.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:56.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:49:56.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-06T14:49:56.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-06T14:49:56.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:55 smithi052 ceph-mon[112917]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-06T14:49:58.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:57 smithi052 ceph-mon[112917]: pgmap v133: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:58.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:57 smithi165 ceph-mon[82925]: pgmap v133: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 66/339 objects degraded (19.469%) 2024-09-06T14:49:59.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:49:59 smithi165 ceph-mon[82925]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 66/339 objects degraded (19.469%), 20 pgs degraded) 2024-09-06T14:49:59.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:49:59 smithi052 ceph-mon[112917]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 66/339 objects degraded (19.469%), 20 pgs degraded) 2024-09-06T14:50:00.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: pgmap v134: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 8 op/s 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: [WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:50:00.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: pgmap v134: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 8 op/s 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: [WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:50:00.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:50:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:50:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:50:00.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:50:02.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:02 smithi165 ceph-mon[82925]: pgmap v135: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-06T14:50:02.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:02 smithi052 ceph-mon[112917]: pgmap v135: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-06T14:50:04.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:04 smithi165 ceph-mon[82925]: pgmap v136: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 978 B/s rd, 2 op/s 2024-09-06T14:50:04.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:04 smithi052 ceph-mon[112917]: pgmap v136: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 978 B/s rd, 2 op/s 2024-09-06T14:50:06.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:06 smithi165 ceph-mon[82925]: pgmap v137: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:50:06.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:06 smithi052 ceph-mon[112917]: pgmap v137: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:50:08.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:08 smithi165 ceph-mon[82925]: pgmap v138: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:50:08.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:08.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:08.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:08.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:08 smithi052 ceph-mon[112917]: pgmap v138: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:50:08.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:08.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:08.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:10.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:10 smithi165 ceph-mon[82925]: pgmap v139: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 6 op/s 2024-09-06T14:50:10.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:10 smithi052 ceph-mon[112917]: pgmap v139: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 6 op/s 2024-09-06T14:50:11.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:11 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-06T14:50:11.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:11 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-06T14:50:12.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:12 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-06T14:50:12.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:12 smithi052 ceph-mon[112917]: Upgrade: osd.1 is safe to restart 2024-09-06T14:50:12.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:12 smithi052 ceph-mon[112917]: pgmap v140: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:50:12.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:12.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T14:50:12.262 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:50:12.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:12 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-06T14:50:12.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:12 smithi165 ceph-mon[82925]: Upgrade: osd.1 is safe to restart 2024-09-06T14:50:12.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:12 smithi165 ceph-mon[82925]: pgmap v140: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:50:12.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:12.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-06T14:50:12.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:50:13.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:13 smithi052 ceph-mon[112917]: Upgrade: Updating osd.1 2024-09-06T14:50:13.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:13 smithi052 ceph-mon[112917]: Deploying daemon osd.1 on smithi052 2024-09-06T14:50:13.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:13 smithi165 ceph-mon[82925]: Upgrade: Updating osd.1 2024-09-06T14:50:13.352 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:13 smithi165 ceph-mon[82925]: Deploying daemon osd.1 on smithi052 2024-09-06T14:50:14.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:14 smithi052 ceph-mon[112917]: pgmap v141: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:50:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:14 smithi165 ceph-mon[82925]: pgmap v141: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:50:14.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:14 smithi052 systemd[1]: Stopping Ceph osd.1 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:50:15.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:15 smithi165 ceph-mon[82925]: osd.1 marked itself down and dead 2024-09-06T14:50:15.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:15 smithi052 ceph-mon[112917]: osd.1 marked itself down and dead 2024-09-06T14:50:15.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:14 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[57376]: 2024-09-06T14:50:14.922+0000 7efedcc9d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:50:15.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:14 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[57376]: 2024-09-06T14:50:14.922+0000 7efedcc9d640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-06T14:50:15.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:14 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[57376]: 2024-09-06T14:50:14.922+0000 7efedcc9d640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T14:50:15.805 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:15 smithi052 podman[127547]: 2024-09-06 14:50:15.515797677 +0000 UTC m=+0.718200851 container died 160aaa4687db3985566c095e795fdb744be2164bd132d645c474162cd6dd5f43 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-635ed4c, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-06T14:50:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:16 smithi052 ceph-mon[112917]: pgmap v142: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:50:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:16 smithi052 ceph-mon[112917]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:50:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:16 smithi052 ceph-mon[112917]: osdmap e54: 6 total, 5 up, 6 in 2024-09-06T14:50:16.123 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:15 smithi052 podman[127547]: 2024-09-06 14:50:15.915282105 +0000 UTC m=+1.117685278 container cleanup 160aaa4687db3985566c095e795fdb744be2164bd132d645c474162cd6dd5f43 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-635ed4c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-06T14:50:16.123 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:15 smithi052 bash[127547]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1 2024-09-06T14:50:16.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:16 smithi165 ceph-mon[82925]: pgmap v142: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-06T14:50:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:16 smithi165 ceph-mon[82925]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:50:16.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:16 smithi165 ceph-mon[82925]: osdmap e54: 6 total, 5 up, 6 in 2024-09-06T14:50:16.541 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:16 smithi052 podman[127562]: 2024-09-06 14:50:16.175327378 +0000 UTC m=+0.654091399 container remove 160aaa4687db3985566c095e795fdb744be2164bd132d645c474162cd6dd5f43 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-635ed4c, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:50:16.826 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:16 smithi052 podman[127650]: 2024-09-06 14:50:16.445136927 +0000 UTC m=+0.016378929 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:50:16.826 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:16 smithi052 podman[127650]: 2024-09-06 14:50:16.559657053 +0000 UTC m=+0.130899045 container create 1ee4d8ba98fc9ff2a8a7a93bf1b5fdbabb2827933f428e94e46e9824db8a8ab3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-06T14:50:16.826 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:16 smithi052 podman[127650]: 2024-09-06 14:50:16.829499186 +0000 UTC m=+0.400741189 container init 1ee4d8ba98fc9ff2a8a7a93bf1b5fdbabb2827933f428e94e46e9824db8a8ab3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-06T14:50:17.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:17 smithi052 ceph-mon[112917]: osdmap e55: 6 total, 5 up, 6 in 2024-09-06T14:50:17.123 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:16 smithi052 podman[127650]: 2024-09-06 14:50:16.833160324 +0000 UTC m=+0.404402326 container start 1ee4d8ba98fc9ff2a8a7a93bf1b5fdbabb2827933f428e94e46e9824db8a8ab3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:50:17.123 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:16 smithi052 podman[127650]: 2024-09-06 14:50:16.929422449 +0000 UTC m=+0.500664460 container attach 1ee4d8ba98fc9ff2a8a7a93bf1b5fdbabb2827933f428e94e46e9824db8a8ab3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-06T14:50:17.123 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:17 smithi052 podman[127650]: 2024-09-06 14:50:17.024375733 +0000 UTC m=+0.595617739 container died 1ee4d8ba98fc9ff2a8a7a93bf1b5fdbabb2827933f428e94e46e9824db8a8ab3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-06T14:50:17.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:17 smithi165 ceph-mon[82925]: osdmap e55: 6 total, 5 up, 6 in 2024-09-06T14:50:17.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:17 smithi052 podman[127674]: 2024-09-06 14:50:17.616704499 +0000 UTC m=+0.583141756 container remove 1ee4d8ba98fc9ff2a8a7a93bf1b5fdbabb2827933f428e94e46e9824db8a8ab3 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:50:17.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:17 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-06T14:50:17.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:17 smithi052 systemd[1]: Stopped Ceph osd.1 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:50:17.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:17 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.1.service: Consumed 59.736s CPU time. 2024-09-06T14:50:17.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:17 smithi052 systemd[1]: Starting Ceph osd.1 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:50:18.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:18 smithi165 ceph-mon[82925]: pgmap v145: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:50:18.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:18 smithi052 ceph-mon[112917]: pgmap v145: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:50:18.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 podman[127774]: 2024-09-06 14:50:17.969615995 +0000 UTC m=+0.016393121 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:50:18.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 podman[127774]: 2024-09-06 14:50:18.076410747 +0000 UTC m=+0.123187862 container create 737f66d7e383d7921f77127463da3a975df4159404cfb85835c65f559f9092d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T14:50:18.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 podman[127774]: 2024-09-06 14:50:18.304869621 +0000 UTC m=+0.351646741 container init 737f66d7e383d7921f77127463da3a975df4159404cfb85835c65f559f9092d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-06T14:50:18.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 podman[127774]: 2024-09-06 14:50:18.308609589 +0000 UTC m=+0.355386702 container start 737f66d7e383d7921f77127463da3a975df4159404cfb85835c65f559f9092d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-06T14:50:18.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 podman[127774]: 2024-09-06 14:50:18.379403707 +0000 UTC m=+0.426180835 container attach 737f66d7e383d7921f77127463da3a975df4159404cfb85835c65f559f9092d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-06T14:50:18.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:18.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 bash[127774]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:18.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:18.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:18 smithi052 bash[127774]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:19.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-mon[112917]: pgmap v146: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:19.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-mon[112917]: Health check failed: Degraded data redundancy: 50/339 objects degraded (14.749%), 15 pgs degraded (PG_DEGRADED) 2024-09-06T14:50:19.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-06T14:50:19.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 bash[127774]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-06T14:50:19.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-06T14:50:19.373 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 bash[127774]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-06T14:50:19.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:19 smithi165 ceph-mon[82925]: pgmap v146: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:19.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:19 smithi165 ceph-mon[82925]: Health check failed: Degraded data redundancy: 50/339 objects degraded (14.749%), 15 pgs degraded (PG_DEGRADED) 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 -- 172.21.15.52:0/700426015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 msgr2=0x7fe724106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/700426015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724106bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe720009880 tx=0x7fe72002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 -- 172.21.15.52:0/700426015 shutdown_connections 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/700426015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7241007f0 0x7fe724100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/700426015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724106bd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 -- 172.21.15.52:0/700426015 >> 172.21.15.52:0/700426015 conn(0x7fe7240fc550 msgr2=0x7fe7240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 -- 172.21.15.52:0/700426015 shutdown_connections 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 -- 172.21.15.52:0/700426015 wait complete. 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 Processor -- start 2024-09-06T14:50:19.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.605+0000 7fe72bd2e640 1 -- start start 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe72bd2e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7241007f0 0x7fe7241023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe72bd2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe72bd2e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe72410dd20 con 0x7fe7241067f0 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe72bd2e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe72410dba0 con 0x7fe7241007f0 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe7292c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe7292c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724102900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57532/0 (socket says 172.21.15.52:57532) 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe7292c9640 1 -- 172.21.15.52:0/1493558184 learned_addr learned my addr 172.21.15.52:0/1493558184 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe729aca640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7241007f0 0x7fe7241023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe7292c9640 1 -- 172.21.15.52:0/1493558184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7241007f0 msgr2=0x7fe7241023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe7292c9640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7241007f0 0x7fe7241023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe7292c9640 1 -- 172.21.15.52:0/1493558184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe724102e40 con 0x7fe7241067f0 2024-09-06T14:50:19.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe7292c9640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724102900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b420 tx=0x7fe71400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe71affd640 1 -- 172.21.15.52:0/1493558184 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe714011630 con 0x7fe7241067f0 2024-09-06T14:50:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe71affd640 1 -- 172.21.15.52:0/1493558184 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe714016070 con 0x7fe7241067f0 2024-09-06T14:50:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe71affd640 1 -- 172.21.15.52:0/1493558184 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe714010d40 con 0x7fe7241067f0 2024-09-06T14:50:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.606+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe724103130 con 0x7fe7241067f0 2024-09-06T14:50:19.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.607+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7241a3f80 con 0x7fe7241067f0 2024-09-06T14:50:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.608+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe724101f30 con 0x7fe7241067f0 2024-09-06T14:50:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.608+0000 7fe71affd640 1 -- 172.21.15.52:0/1493558184 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe71401b460 con 0x7fe7241067f0 2024-09-06T14:50:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.609+0000 7fe71affd640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe710077460 0x7fe710079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.609+0000 7fe71affd640 1 -- 172.21.15.52:0/1493558184 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6027+0+0 (secure 0 0 0) 0x7fe714098dc0 con 0x7fe7241067f0 2024-09-06T14:50:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.609+0000 7fe729aca640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe710077460 0x7fe710079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:19.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.609+0000 7fe729aca640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe710077460 0x7fe710079920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7200096c0 tx=0x7fe720000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:19.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.613+0000 7fe71affd640 1 -- 172.21.15.52:0/1493558184 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe714021250 con 0x7fe7241067f0 2024-09-06T14:50:19.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.793+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe7240fcd20 con 0x7fe710077460 2024-09-06T14:50:19.791 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-06T14:50:19.791 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 bash[127774]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-06T14:50:19.791 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-06T14:50:19.791 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 bash[127774]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-06T14:50:19.792 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-06T14:50:19.792 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 bash[127774]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-06T14:50:19.792 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-06T14:50:19.792 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 bash[127774]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-06T14:50:19.792 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate[127790]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-06T14:50:19.792 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 bash[127774]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-06T14:50:19.792 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:19 smithi052 podman[127774]: 2024-09-06 14:50:19.498858392 +0000 UTC m=+1.545635517 container died 737f66d7e383d7921f77127463da3a975df4159404cfb85835c65f559f9092d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-06T14:50:19.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.795+0000 7fe71affd640 1 -- 172.21.15.52:0/1493558184 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fe7240fcd20 con 0x7fe710077460 2024-09-06T14:50:19.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.796+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe710077460 msgr2=0x7fe710079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.796+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe710077460 0x7fe710079920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe7200096c0 tx=0x7fe720000bc0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.796+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 msgr2=0x7fe724102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.796+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724102900 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b420 tx=0x7fe71400b8e0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.797+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 shutdown_connections 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.797+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7241067f0 0x7fe724102900 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.797+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe710077460 0x7fe710079920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.797+0000 7fe72bd2e640 1 --2- 172.21.15.52:0/1493558184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7241007f0 0x7fe7241023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.797+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 >> 172.21.15.52:0/1493558184 conn(0x7fe7240fc550 msgr2=0x7fe7241046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.797+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 shutdown_connections 2024-09-06T14:50:19.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.797+0000 7fe72bd2e640 1 -- 172.21.15.52:0/1493558184 wait complete. 2024-09-06T14:50:19.802 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.884+0000 7f0142c44640 1 -- 172.21.15.52:0/892744902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 msgr2=0x7f013c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.884+0000 7f0142c44640 1 --2- 172.21.15.52:0/892744902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c100c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0128009880 tx=0x7f012802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.884+0000 7f0142c44640 1 -- 172.21.15.52:0/892744902 shutdown_connections 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.884+0000 7f0142c44640 1 --2- 172.21.15.52:0/892744902 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c100c50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.884+0000 7f0142c44640 1 --2- 172.21.15.52:0/892744902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c1067f0 0x7f013c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.884+0000 7f0142c44640 1 -- 172.21.15.52:0/892744902 >> 172.21.15.52:0/892744902 conn(0x7f013c0fc550 msgr2=0x7f013c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.885+0000 7f0142c44640 1 -- 172.21.15.52:0/892744902 shutdown_connections 2024-09-06T14:50:19.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.885+0000 7f0142c44640 1 -- 172.21.15.52:0/892744902 wait complete. 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.885+0000 7f0142c44640 1 Processor -- start 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.885+0000 7f0142c44640 1 -- start start 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f0142c44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f0142c44640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c1067f0 0x7f013c19dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f0142c44640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f013c06aa80 con 0x7f013c1007f0 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f0142c44640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f013c06a900 con 0x7f013c1067f0 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f01409e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f01409e0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57558/0 (socket says 172.21.15.52:57558) 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f01409e0640 1 -- 172.21.15.52:0/1102164768 learned_addr learned my addr 172.21.15.52:0/1102164768 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f013bfff640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c1067f0 0x7f013c19dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:19.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f01409e0640 1 -- 172.21.15.52:0/1102164768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c1067f0 msgr2=0x7f013c19dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f01409e0640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c1067f0 0x7f013c19dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f01409e0640 1 -- 172.21.15.52:0/1102164768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c1978b0 con 0x7f013c1007f0 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.886+0000 7f01409e0640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c19d6f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f013000b420 tx=0x7f013000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.887+0000 7f0139ffb640 1 -- 172.21.15.52:0/1102164768 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0130011630 con 0x7f013c1007f0 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.887+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c197ba0 con 0x7f013c1007f0 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.887+0000 7f0139ffb640 1 -- 172.21.15.52:0/1102164768 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0130016070 con 0x7f013c1007f0 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.887+0000 7f0139ffb640 1 -- 172.21.15.52:0/1102164768 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0130010d40 con 0x7f013c1007f0 2024-09-06T14:50:19.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.887+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c198130 con 0x7f013c1007f0 2024-09-06T14:50:19.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.888+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013c101f30 con 0x7f013c1007f0 2024-09-06T14:50:19.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.888+0000 7f0139ffb640 1 -- 172.21.15.52:0/1102164768 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f013001b460 con 0x7f013c1007f0 2024-09-06T14:50:19.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.889+0000 7f0139ffb640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f012c0774b0 0x7f012c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:19.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.889+0000 7f0139ffb640 1 -- 172.21.15.52:0/1102164768 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6027+0+0 (secure 0 0 0) 0x7f0130098cf0 con 0x7f013c1007f0 2024-09-06T14:50:19.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.889+0000 7f013bfff640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f012c0774b0 0x7f012c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:19.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.890+0000 7f013bfff640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f012c0774b0 0x7f012c079970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0128031460 tx=0x7f0128009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:19.893+0000 7f0139ffb640 1 -- 172.21.15.52:0/1102164768 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f013009d070 con 0x7f013c1007f0 2024-09-06T14:50:20.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.070+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f013c198de0 con 0x7f012c0774b0 2024-09-06T14:50:20.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.072+0000 7f0139ffb640 1 -- 172.21.15.52:0/1102164768 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f013c198de0 con 0x7f012c0774b0 2024-09-06T14:50:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.073+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f012c0774b0 msgr2=0x7f012c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.073+0000 7f0142c44640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f012c0774b0 0x7f012c079970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0128031460 tx=0x7f0128009560 comp rx=0 tx=0).stop 2024-09-06T14:50:20.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.073+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 msgr2=0x7f013c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.073+0000 7f0142c44640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c19d6f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f013000b420 tx=0x7f013000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.074+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 shutdown_connections 2024-09-06T14:50:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.074+0000 7f0142c44640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f012c0774b0 0x7f012c079970 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.074+0000 7f0142c44640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f013c1067f0 0x7f013c19dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.074+0000 7f0142c44640 1 --2- 172.21.15.52:0/1102164768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f013c1007f0 0x7f013c19d6f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.074+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 >> 172.21.15.52:0/1102164768 conn(0x7f013c0fc550 msgr2=0x7f013c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:20.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.074+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 shutdown_connections 2024-09-06T14:50:20.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.074+0000 7f0142c44640 1 -- 172.21.15.52:0/1102164768 wait complete. 2024-09-06T14:50:20.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 -- 172.21.15.52:0/4221590762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8100800 msgr2=0x7f59f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 --2- 172.21.15.52:0/4221590762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8100800 0x7f59f8100c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f59e8009880 tx=0x7f59e802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 -- 172.21.15.52:0/4221590762 shutdown_connections 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 --2- 172.21.15.52:0/4221590762 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8100800 0x7f59f8100c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 --2- 172.21.15.52:0/4221590762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8106800 0x7f59f8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 -- 172.21.15.52:0/4221590762 >> 172.21.15.52:0/4221590762 conn(0x7f59f80fc520 msgr2=0x7f59f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 -- 172.21.15.52:0/4221590762 shutdown_connections 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.158+0000 7f59ffe90640 1 -- 172.21.15.52:0/4221590762 wait complete. 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59ffe90640 1 Processor -- start 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59ffe90640 1 -- start start 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59ffe90640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8100800 0x7f59f80fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59ffe90640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8106800 0x7f59f80fd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59ffe90640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59f810dcb0 con 0x7f59f8106800 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59ffe90640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59f810db30 con 0x7f59f8100800 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59fd42b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8106800 0x7f59f80fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59fd42b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8106800 0x7f59f80fd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57582/0 (socket says 172.21.15.52:57582) 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59fd42b640 1 -- 172.21.15.52:0/3451754804 learned_addr learned my addr 172.21.15.52:0/3451754804 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59fdc2c640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8100800 0x7f59f80fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59fd42b640 1 -- 172.21.15.52:0/3451754804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8100800 msgr2=0x7f59f80fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59fd42b640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8100800 0x7f59f80fcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.159+0000 7f59fd42b640 1 -- 172.21.15.52:0/3451754804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f80fd6b0 con 0x7f59f8106800 2024-09-06T14:50:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.160+0000 7f59fd42b640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8106800 0x7f59f80fd170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59e8031460 tx=0x7f59e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.160+0000 7f59eeffd640 1 -- 172.21.15.52:0/3451754804 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59e803f070 con 0x7f59f8106800 2024-09-06T14:50:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.160+0000 7f59eeffd640 1 -- 172.21.15.52:0/3451754804 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59e8004cf0 con 0x7f59f8106800 2024-09-06T14:50:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.160+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f80fd940 con 0x7f59f8106800 2024-09-06T14:50:20.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.160+0000 7f59eeffd640 1 -- 172.21.15.52:0/3451754804 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59e8035030 con 0x7f59f8106800 2024-09-06T14:50:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.160+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f81a3d60 con 0x7f59f8106800 2024-09-06T14:50:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.161+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59f8101f40 con 0x7f59f8106800 2024-09-06T14:50:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.161+0000 7f59eeffd640 1 -- 172.21.15.52:0/3451754804 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f59e8042070 con 0x7f59f8106800 2024-09-06T14:50:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.162+0000 7f59eeffd640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59e40774b0 0x7f59e4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.162+0000 7f59eeffd640 1 -- 172.21.15.52:0/3451754804 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6027+0+0 (secure 0 0 0) 0x7f59e80b9f60 con 0x7f59f8106800 2024-09-06T14:50:20.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.162+0000 7f59fdc2c640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59e40774b0 0x7f59e4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.162+0000 7f59fdc2c640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59e40774b0 0x7f59e4079970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59f4005e10 tx=0x7f59f4005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:20.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.166+0000 7f59eeffd640 1 -- 172.21.15.52:0/3451754804 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f59e8083110 con 0x7f59f8106800 2024-09-06T14:50:20.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:20 smithi165 ceph-mon[82925]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:20.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:20 smithi165 ceph-mon[82925]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:20.346 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.349+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f59f8062630 con 0x7f59e40774b0 2024-09-06T14:50:20.346 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:20 smithi052 ceph-mon[112917]: from='client.34172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:20.347 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:20 smithi052 ceph-mon[112917]: from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:20.347 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 podman[127926]: 2024-09-06 14:50:20.192751766 +0000 UTC m=+0.683224072 container remove 737f66d7e383d7921f77127463da3a975df4159404cfb85835c65f559f9092d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-activate, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-06T14:50:20.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.360+0000 7f59eeffd640 1 -- 172.21.15.52:0/3451754804 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f59f8062630 con 0x7f59e40774b0 2024-09-06T14:50:20.357 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (2m) 29s ago 13m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (5m) 29s ago 13m 8791k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (5m) 52s ago 13m 8728k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (60s) 29s ago 13m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (55s) 52s ago 12m 14.3M - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (2m) 29s ago 13m 79.9M - c8b91775d855 af78eb451b94 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (8m) 29s ago 8m 88.7M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (8m) 29s ago 8m 146M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (8m) 52s ago 8m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (8m) 52s ago 8m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (4m) 29s ago 14m 518M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (3m) 52s ago 12m 456M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:50:20.358 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (90s) 29s ago 14m 37.7M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (73s) 52s ago 12m 26.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (3m) 29s ago 13m 10.3M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (3m) 52s ago 12m 11.9M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (35s) 29s ago 11m 12.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (11m) 29s ago 11m 219M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 160aaa4687db 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (10m) 29s ago 10m 184M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (10m) 52s ago 10m 239M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (9m) 52s ago 9m 209M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (9m) 52s ago 9m 186M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:50:20.359 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (3m) 29s ago 13m 50.0M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:50:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59e40774b0 msgr2=0x7f59e4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59e40774b0 0x7f59e4079970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f59f4005e10 tx=0x7f59f4005da0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8106800 msgr2=0x7f59f80fd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8106800 0x7f59f80fd170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f59e8031460 tx=0x7f59e80048f0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 shutdown_connections 2024-09-06T14:50:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59f8106800 0x7f59f80fd170 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59e40774b0 0x7f59e4079970 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 --2- 172.21.15.52:0/3451754804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59f8100800 0x7f59f80fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 >> 172.21.15.52:0/3451754804 conn(0x7f59f80fc520 msgr2=0x7f59f806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 shutdown_connections 2024-09-06T14:50:20.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.362+0000 7f59ffe90640 1 -- 172.21.15.52:0/3451754804 wait complete. 2024-09-06T14:50:20.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.444+0000 7f0766eff640 1 -- 172.21.15.52:0/2856406620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760100800 msgr2=0x7f0760100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.444+0000 7f0766eff640 1 --2- 172.21.15.52:0/2856406620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760100800 0x7f0760100c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0748009880 tx=0x7f074802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.444+0000 7f0766eff640 1 -- 172.21.15.52:0/2856406620 shutdown_connections 2024-09-06T14:50:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.444+0000 7f0766eff640 1 --2- 172.21.15.52:0/2856406620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760100800 0x7f0760100c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.444+0000 7f0766eff640 1 --2- 172.21.15.52:0/2856406620 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0760106800 0x7f0760106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.444+0000 7f0766eff640 1 -- 172.21.15.52:0/2856406620 >> 172.21.15.52:0/2856406620 conn(0x7f07600fc520 msgr2=0x7f07600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 -- 172.21.15.52:0/2856406620 shutdown_connections 2024-09-06T14:50:20.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 -- 172.21.15.52:0/2856406620 wait complete. 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 Processor -- start 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 -- start start 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0760100800 0x7f07600fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760106800 0x7f07600fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f076010dcb0 con 0x7f0760106800 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.445+0000 7f0766eff640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f076010db30 con 0x7f0760100800 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760106800 0x7f07600fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760106800 0x7f07600fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45094/0 (socket says 172.21.15.52:45094) 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075ffff640 1 -- 172.21.15.52:0/4013802901 learned_addr learned my addr 172.21.15.52:0/4013802901 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f0764c9b640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0760100800 0x7f07600fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075ffff640 1 -- 172.21.15.52:0/4013802901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0760100800 msgr2=0x7f07600fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075ffff640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0760100800 0x7f07600fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075ffff640 1 -- 172.21.15.52:0/4013802901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07600fd690 con 0x7f0760106800 2024-09-06T14:50:20.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075ffff640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760106800 0x7f07600fd150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0748031460 tx=0x7f07480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:20.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075dffb640 1 -- 172.21.15.52:0/4013802901 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f074803f070 con 0x7f0760106800 2024-09-06T14:50:20.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075dffb640 1 -- 172.21.15.52:0/4013802901 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07480035f0 con 0x7f0760106800 2024-09-06T14:50:20.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f075dffb640 1 -- 172.21.15.52:0/4013802901 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0748035030 con 0x7f0760106800 2024-09-06T14:50:20.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.446+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07600fd920 con 0x7f0760106800 2024-09-06T14:50:20.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.447+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07601a3db0 con 0x7f0760106800 2024-09-06T14:50:20.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.447+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0760101f40 con 0x7f0760106800 2024-09-06T14:50:20.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.448+0000 7f075dffb640 1 -- 172.21.15.52:0/4013802901 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0748042070 con 0x7f0760106800 2024-09-06T14:50:20.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.448+0000 7f075dffb640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f074c0774b0 0x7f074c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.449+0000 7f075dffb640 1 -- 172.21.15.52:0/4013802901 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6027+0+0 (secure 0 0 0) 0x7f07480b9e40 con 0x7f0760106800 2024-09-06T14:50:20.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.449+0000 7f0764c9b640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f074c0774b0 0x7f074c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.449+0000 7f0764c9b640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f074c0774b0 0x7f074c079970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0750005fd0 tx=0x7f0750009680 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:20.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.454+0000 7f075dffb640 1 -- 172.21.15.52:0/4013802901 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0748087160 con 0x7f0760106800 2024-09-06T14:50:20.601 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 podman[128053]: 2024-09-06 14:50:20.306430752 +0000 UTC m=+0.018865316 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:50:20.602 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 podman[128053]: 2024-09-06 14:50:20.450241566 +0000 UTC m=+0.162676116 container create 05161933d9e13ea4f92b540e231192afde56297646ff460b22311e9d8fe88950 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:50:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.677+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0760109da0 con 0x7f0760106800 2024-09-06T14:50:20.674 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.677+0000 7f075dffb640 1 -- 172.21.15.52:0/4013802901 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f074808bb80 con 0x7f0760106800 2024-09-06T14:50:20.675 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:50:20.675 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:50:20.675 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:50:20.675 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:20.675 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:50:20.675 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4, 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:50:20.676 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:20.677 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:50:20.677 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 8, 2024-09-06T14:50:20.677 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 5 2024-09-06T14:50:20.677 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:50:20.677 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:50:20.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f074c0774b0 msgr2=0x7f074c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f074c0774b0 0x7f074c079970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0750005fd0 tx=0x7f0750009680 comp rx=0 tx=0).stop 2024-09-06T14:50:20.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760106800 msgr2=0x7f07600fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760106800 0x7f07600fd150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0748031460 tx=0x7f07480045e0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 shutdown_connections 2024-09-06T14:50:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0760106800 0x7f07600fd150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f074c0774b0 0x7f074c079970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 --2- 172.21.15.52:0/4013802901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0760100800 0x7f07600fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 >> 172.21.15.52:0/4013802901 conn(0x7f07600fc520 msgr2=0x7f076006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 shutdown_connections 2024-09-06T14:50:20.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.679+0000 7f0766eff640 1 -- 172.21.15.52:0/4013802901 wait complete. 2024-09-06T14:50:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 -- 172.21.15.52:0/2357228444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0102b10 msgr2=0x7f7ba0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 --2- 172.21.15.52:0/2357228444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0102b10 0x7f7ba0102ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c0098b0 tx=0x7f7b9c02a560 comp rx=0 tx=0).stop 2024-09-06T14:50:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 -- 172.21.15.52:0/2357228444 shutdown_connections 2024-09-06T14:50:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 --2- 172.21.15.52:0/2357228444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba0103430 0x7f7ba010b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 --2- 172.21.15.52:0/2357228444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0102b10 0x7f7ba0102ef0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 -- 172.21.15.52:0/2357228444 >> 172.21.15.52:0/2357228444 conn(0x7f7ba00fc550 msgr2=0x7f7ba00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:20.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 -- 172.21.15.52:0/2357228444 shutdown_connections 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.764+0000 7f7ba7771640 1 -- 172.21.15.52:0/2357228444 wait complete. 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba7771640 1 Processor -- start 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba7771640 1 -- start start 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba7771640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba0102b10 0x7f7ba019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba7771640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0103430 0x7f7ba019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba7771640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba010edc0 con 0x7f7ba0103430 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba7771640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba010ec40 con 0x7f7ba0102b10 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba4d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0103430 0x7f7ba019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba4d0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0103430 0x7f7ba019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45118/0 (socket says 172.21.15.52:45118) 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba4d0c640 1 -- 172.21.15.52:0/3396969109 learned_addr learned my addr 172.21.15.52:0/3396969109 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba550d640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba0102b10 0x7f7ba019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba4d0c640 1 -- 172.21.15.52:0/3396969109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba0102b10 msgr2=0x7f7ba019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.765+0000 7f7ba4d0c640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba0102b10 0x7f7ba019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.766+0000 7f7ba4d0c640 1 -- 172.21.15.52:0/3396969109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba01977d0 con 0x7f7ba0103430 2024-09-06T14:50:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.766+0000 7f7ba4d0c640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0103430 0x7f7ba019db90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400d8d0 tx=0x7f7b9400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:20.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.766+0000 7f7b927fc640 1 -- 172.21.15.52:0/3396969109 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b94017070 con 0x7f7ba0103430 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.766+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba0197ac0 con 0x7f7ba0103430 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.766+0000 7f7b927fc640 1 -- 172.21.15.52:0/3396969109 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b94010460 con 0x7f7ba0103430 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.766+0000 7f7b927fc640 1 -- 172.21.15.52:0/3396969109 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b9400f5f0 con 0x7f7ba0103430 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.766+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba0198050 con 0x7f7ba0103430 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.767+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba006a520 con 0x7f7ba0103430 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.768+0000 7f7b927fc640 1 -- 172.21.15.52:0/3396969109 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7b94009a30 con 0x7f7ba0103430 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.768+0000 7f7b927fc640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7b8c077460 0x7f7b8c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:20.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.768+0000 7f7b927fc640 1 -- 172.21.15.52:0/3396969109 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6027+0+0 (secure 0 0 0) 0x7f7b940994d0 con 0x7f7ba0103430 2024-09-06T14:50:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.768+0000 7f7ba550d640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7b8c077460 0x7f7b8c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:20.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.769+0000 7f7ba550d640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7b8c077460 0x7f7b8c079920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c000c00 tx=0x7f7b9c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:20.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.772+0000 7f7b927fc640 1 -- 172.21.15.52:0/3396969109 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7b94062600 con 0x7f7ba0103430 2024-09-06T14:50:20.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.967+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7ba0104f60 con 0x7f7ba0103430 2024-09-06T14:50:20.965 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 podman[128053]: 2024-09-06 14:50:20.731014999 +0000 UTC m=+0.443449559 container init 05161933d9e13ea4f92b540e231192afde56297646ff460b22311e9d8fe88950 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-06T14:50:20.965 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 podman[128053]: 2024-09-06 14:50:20.73434999 +0000 UTC m=+0.446784542 container start 05161933d9e13ea4f92b540e231192afde56297646ff460b22311e9d8fe88950 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-06T14:50:20.965 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 ceph-osd[128097]: -- 172.21.15.52:0/3019817915 <== mon.0 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629c2e041e0 con 0x5629c1fa5c00 2024-09-06T14:50:20.965 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 bash[128053]: 05161933d9e13ea4f92b540e231192afde56297646ff460b22311e9d8fe88950 2024-09-06T14:50:20.965 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:20 smithi052 systemd[1]: Started Ceph osd.1 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.968+0000 7f7b927fc640 1 -- 172.21.15.52:0/3396969109 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7f7b94066770 con 0x7f7ba0103430 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:50:20.966 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:50:20.967 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:50:20.968 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:50:20.969 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:50:20.970 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:50:20.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7b8c077460 msgr2=0x7f7b8c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7b8c077460 0x7f7b8c079920 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c000c00 tx=0x7f7b9c031400 comp rx=0 tx=0).stop 2024-09-06T14:50:20.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0103430 msgr2=0x7f7ba019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:20.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0103430 0x7f7ba019db90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400d8d0 tx=0x7f7b9400dd90 comp rx=0 tx=0).stop 2024-09-06T14:50:20.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 shutdown_connections 2024-09-06T14:50:20.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ba0103430 0x7f7ba019db90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7b8c077460 0x7f7b8c079920 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 --2- 172.21.15.52:0/3396969109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ba0102b10 0x7f7ba019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:20.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 >> 172.21.15.52:0/3396969109 conn(0x7f7ba00fc550 msgr2=0x7f7ba0107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:20.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 shutdown_connections 2024-09-06T14:50:20.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:20.971+0000 7f7ba7771640 1 -- 172.21.15.52:0/3396969109 wait complete. 2024-09-06T14:50:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.059+0000 7f0b618f4640 1 -- 172.21.15.52:0/578821245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1067f0 msgr2=0x7f0b5c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.059+0000 7f0b618f4640 1 --2- 172.21.15.52:0/578821245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1067f0 0x7f0b5c106bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009880 tx=0x7f0b4c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 -- 172.21.15.52:0/578821245 shutdown_connections 2024-09-06T14:50:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 --2- 172.21.15.52:0/578821245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b5c1007f0 0x7f0b5c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 --2- 172.21.15.52:0/578821245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1067f0 0x7f0b5c106bd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 -- 172.21.15.52:0/578821245 >> 172.21.15.52:0/578821245 conn(0x7f0b5c0fc550 msgr2=0x7f0b5c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 -- 172.21.15.52:0/578821245 shutdown_connections 2024-09-06T14:50:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 -- 172.21.15.52:0/578821245 wait complete. 2024-09-06T14:50:21.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 Processor -- start 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.060+0000 7f0b618f4640 1 -- start start 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b618f4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1007f0 0x7f0b5c0fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b618f4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b5c1067f0 0x7f0b5c0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b618f4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c10dcc0 con 0x7f0b5c1007f0 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b618f4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c10db40 con 0x7f0b5c1067f0 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1007f0 0x7f0b5c0fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1007f0 0x7f0b5c0fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45138/0 (socket says 172.21.15.52:45138) 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5affd640 1 -- 172.21.15.52:0/701046030 learned_addr learned my addr 172.21.15.52:0/701046030 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5a7fc640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b5c1067f0 0x7f0b5c0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:21.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5affd640 1 -- 172.21.15.52:0/701046030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b5c1067f0 msgr2=0x7f0b5c0fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5affd640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b5c1067f0 0x7f0b5c0fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5affd640 1 -- 172.21.15.52:0/701046030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c0fd770 con 0x7f0b5c1007f0 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.061+0000 7f0b5affd640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1007f0 0x7f0b5c0fccf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c031460 tx=0x7f0b4c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.062+0000 7f0b608f2640 1 -- 172.21.15.52:0/701046030 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b4c03f070 con 0x7f0b5c1007f0 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.062+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c0fda00 con 0x7f0b5c1007f0 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.062+0000 7f0b608f2640 1 -- 172.21.15.52:0/701046030 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b4c0035f0 con 0x7f0b5c1007f0 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.062+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c1a3d70 con 0x7f0b5c1007f0 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.062+0000 7f0b608f2640 1 -- 172.21.15.52:0/701046030 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b4c035030 con 0x7f0b5c1007f0 2024-09-06T14:50:21.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.063+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5c101f30 con 0x7f0b5c1007f0 2024-09-06T14:50:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.063+0000 7f0b608f2640 1 -- 172.21.15.52:0/701046030 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0b4c042070 con 0x7f0b5c1007f0 2024-09-06T14:50:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.064+0000 7f0b608f2640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b440774b0 0x7f0b44079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.064+0000 7f0b5a7fc640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b440774b0 0x7f0b44079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.064+0000 7f0b608f2640 1 -- 172.21.15.52:0/701046030 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6027+0+0 (secure 0 0 0) 0x7f0b4c0b9ee0 con 0x7f0b5c1007f0 2024-09-06T14:50:21.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.065+0000 7f0b5a7fc640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b440774b0 0x7f0b44079970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005fd0 tx=0x7f0b50005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:21.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.068+0000 7f0b608f2640 1 -- 172.21.15.52:0/701046030 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0b4c083090 con 0x7f0b5c1007f0 2024-09-06T14:50:21.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.266+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0b5c062630 con 0x7f0b440774b0 2024-09-06T14:50:21.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:21 smithi052 ceph-mon[112917]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:21.263 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:21 smithi052 ceph-mon[112917]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:21.264 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:21 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4013802901' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:21.264 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:21 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:21.264 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:21 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:21.264 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:21 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:50:21.264 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:21 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3396969109' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:50:21.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.267+0000 7f0b608f2640 1 -- 172.21.15.52:0/701046030 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f0b5c062630 con 0x7f0b440774b0 2024-09-06T14:50:21.265 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:50:21.265 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:50:21.266 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:50:21.266 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:50:21.266 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:50:21.266 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:50:21.266 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:50:21.266 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:50:21.267 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:50:21.267 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "7/23 daemons upgraded", 2024-09-06T14:50:21.267 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading osd daemons", 2024-09-06T14:50:21.267 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:50:21.267 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:50:21.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b440774b0 msgr2=0x7f0b44079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b440774b0 0x7f0b44079970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0b50005fd0 tx=0x7f0b50005850 comp rx=0 tx=0).stop 2024-09-06T14:50:21.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1007f0 msgr2=0x7f0b5c0fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1007f0 0x7f0b5c0fccf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c031460 tx=0x7f0b4c0045e0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 shutdown_connections 2024-09-06T14:50:21.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b440774b0 0x7f0b44079970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b5c1067f0 0x7f0b5c0fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 --2- 172.21.15.52:0/701046030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b5c1007f0 0x7f0b5c0fccf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 >> 172.21.15.52:0/701046030 conn(0x7f0b5c0fc550 msgr2=0x7f0b5c069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:21.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 shutdown_connections 2024-09-06T14:50:21.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.269+0000 7f0b618f4640 1 -- 172.21.15.52:0/701046030 wait complete. 2024-09-06T14:50:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 -- 172.21.15.52:0/4102155184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26741033e0 msgr2=0x7f267410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 --2- 172.21.15.52:0/4102155184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26741033e0 0x7f267410b8d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f265c009880 tx=0x7f265c02a530 comp rx=0 tx=0).stop 2024-09-06T14:50:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 -- 172.21.15.52:0/4102155184 shutdown_connections 2024-09-06T14:50:21.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 --2- 172.21.15.52:0/4102155184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26741033e0 0x7f267410b8d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 --2- 172.21.15.52:0/4102155184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2674102ac0 0x7f2674102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 -- 172.21.15.52:0/4102155184 >> 172.21.15.52:0/4102155184 conn(0x7f26740fc520 msgr2=0x7f26740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 -- 172.21.15.52:0/4102155184 shutdown_connections 2024-09-06T14:50:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 -- 172.21.15.52:0/4102155184 wait complete. 2024-09-06T14:50:21.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.359+0000 7f2679628640 1 Processor -- start 2024-09-06T14:50:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2679628640 1 -- start start 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2679628640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2674102ac0 0x7f267419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2679628640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26741033e0 0x7f267419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2679628640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f267410edf0 con 0x7f2674102ac0 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2679628640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f267410ec70 con 0x7f26741033e0 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2674102ac0 0x7f267419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2674102ac0 0x7f267419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45162/0 (socket says 172.21.15.52:45162) 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2672ffd640 1 -- 172.21.15.52:0/2391788807 learned_addr learned my addr 172.21.15.52:0/2391788807 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f266a7fc640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26741033e0 0x7f267419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2672ffd640 1 -- 172.21.15.52:0/2391788807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26741033e0 msgr2=0x7f267419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2672ffd640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26741033e0 0x7f267419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2672ffd640 1 -- 172.21.15.52:0/2391788807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2674197800 con 0x7f2674102ac0 2024-09-06T14:50:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.360+0000 7f2672ffd640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2674102ac0 0x7f267419d680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f266400d6f0 tx=0x7f266400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.361+0000 7f2670ff9640 1 -- 172.21.15.52:0/2391788807 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2664017070 con 0x7f2674102ac0 2024-09-06T14:50:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.361+0000 7f2670ff9640 1 -- 172.21.15.52:0/2391788807 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f266400de00 con 0x7f2674102ac0 2024-09-06T14:50:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.361+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2674197af0 con 0x7f2674102ac0 2024-09-06T14:50:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.361+0000 7f2670ff9640 1 -- 172.21.15.52:0/2391788807 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2664004bb0 con 0x7f2674102ac0 2024-09-06T14:50:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.361+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2674198050 con 0x7f2674102ac0 2024-09-06T14:50:21.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.362+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267406aa90 con 0x7f2674102ac0 2024-09-06T14:50:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.362+0000 7f2670ff9640 1 -- 172.21.15.52:0/2391788807 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2664004e60 con 0x7f2674102ac0 2024-09-06T14:50:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.363+0000 7f2670ff9640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2660077460 0x7f2660079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.363+0000 7f2670ff9640 1 -- 172.21.15.52:0/2391788807 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6027+0+0 (secure 0 0 0) 0x7f2664099270 con 0x7f2674102ac0 2024-09-06T14:50:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.363+0000 7f266a7fc640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2660077460 0x7f2660079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.363+0000 7f266a7fc640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2660077460 0x7f2660079920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2674198b50 tx=0x7f265c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.367+0000 7f2670ff9640 1 -- 172.21.15.52:0/2391788807 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f26640623a0 con 0x7f2674102ac0 2024-09-06T14:50:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:21 smithi165 ceph-mon[82925]: pgmap v147: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:21 smithi165 ceph-mon[82925]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:21 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4013802901' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:21 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:21 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:21 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:50:21.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:21 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3396969109' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:50:21.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.588+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2674105f60 con 0x7f2674102ac0 2024-09-06T14:50:21.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.588+0000 7f2670ff9640 1 -- 172.21.15.52:0/2391788807 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+2074 (secure 0 0 0) 0x7f2664066510 con 0x7f2674102ac0 2024-09-06T14:50:21.589 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1 osds down; Degraded data redundancy: 50/339 objects degraded (14.749%), 15 pgs degraded; 4 mgr modules have recently crashed 2024-09-06T14:50:21.589 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:50:21.589 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: osd.1 (root=default,host=smithi052) is down 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 50/339 objects degraded (14.749%), 15 pgs degraded 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-06T14:50:21.590 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-06T14:50:21.591 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-06T14:50:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-06T14:50:21.592 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:50:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:50:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:50:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:50:21.592 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:50:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.590+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2660077460 msgr2=0x7f2660079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.590+0000 7f2679628640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2660077460 0x7f2660079920 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2674198b50 tx=0x7f265c031400 comp rx=0 tx=0).stop 2024-09-06T14:50:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.590+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2674102ac0 msgr2=0x7f267419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.590+0000 7f2679628640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2674102ac0 0x7f267419d680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f266400d6f0 tx=0x7f266400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.591+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 shutdown_connections 2024-09-06T14:50:21.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.591+0000 7f2679628640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2660077460 0x7f2660079920 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.591+0000 7f2679628640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26741033e0 0x7f267419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.591+0000 7f2679628640 1 --2- 172.21.15.52:0/2391788807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2674102ac0 0x7f267419d680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.591+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 >> 172.21.15.52:0/2391788807 conn(0x7f26740fc520 msgr2=0x7f2674108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.591+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 shutdown_connections 2024-09-06T14:50:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:21.591+0000 7f2679628640 1 -- 172.21.15.52:0/2391788807 wait complete. 2024-09-06T14:50:22.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:22 smithi052 ceph-mon[112917]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:22.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:22 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2391788807' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:50:22.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:22 smithi165 ceph-mon[82925]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:22.608 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:22 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2391788807' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:50:22.873 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:22 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[128090]: 2024-09-06T14:50:22.377+0000 7fa952412640 -1 Falling back to public interface 2024-09-06T14:50:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:23 smithi052 ceph-mon[112917]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:24.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:23 smithi165 ceph-mon[82925]: pgmap v148: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:24.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:24.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:25.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:25 smithi052 ceph-mon[112917]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:26.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:25 smithi165 ceph-mon[82925]: pgmap v149: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:27.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:26 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:27.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:26 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:27.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:26 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:27.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:26 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:27.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:26 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:26 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:26 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:27.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:26 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:28.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:27 smithi052 ceph-mon[112917]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:28.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:27 smithi165 ceph-mon[82925]: pgmap v150: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:28.481 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:28 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[128090]: 2024-09-06T14:50:28.338+0000 7fa952412640 -1 osd.1 53 log_to_monitors true 2024-09-06T14:50:29.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:28 smithi052 ceph-mon[112917]: from='osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T14:50:29.123 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 14:50:28 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[128090]: 2024-09-06T14:50:28.865+0000 7fa94a1bc640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:50:29.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:28 smithi165 ceph-mon[82925]: from='osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-06T14:50:30.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:30.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: from='osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T14:50:30.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: osdmap e56: 6 total, 5 up, 6 in 2024-09-06T14:50:30.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: from='osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-06T14:50:30.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:30.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:30.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:50:30.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:50:30.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:30.132 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: pgmap v151: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 50/339 objects degraded (14.749%) 2024-09-06T14:50:30.132 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: from='osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-06T14:50:30.132 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: osdmap e56: 6 total, 5 up, 6 in 2024-09-06T14:50:30.133 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: from='osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-06T14:50:30.133 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:30.133 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:30.133 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:50:30.133 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:50:30.133 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:31.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:50:31.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788] boot 2024-09-06T14:50:31.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: osdmap e57: 6 total, 6 up, 6 in 2024-09-06T14:50:31.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-06T14:50:31.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:30 smithi052 ceph-mon[112917]: osdmap e58: 6 total, 6 up, 6 in 2024-09-06T14:50:31.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:50:31.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: osd.1 [v2:172.21.15.52:6810/2935808788,v1:172.21.15.52:6811/2935808788] boot 2024-09-06T14:50:31.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: osdmap e57: 6 total, 6 up, 6 in 2024-09-06T14:50:31.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-06T14:50:31.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:50:31.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:31.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:31.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:31.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-06T14:50:31.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-06T14:50:31.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-06T14:50:31.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:30 smithi165 ceph-mon[82925]: osdmap e58: 6 total, 6 up, 6 in 2024-09-06T14:50:32.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:31 smithi052 ceph-mon[112917]: pgmap v154: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 50/339 objects degraded (14.749%) 2024-09-06T14:50:32.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:31 smithi165 ceph-mon[82925]: pgmap v154: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 50/339 objects degraded (14.749%) 2024-09-06T14:50:34.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:33 smithi052 ceph-mon[112917]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 50/339 objects degraded (14.749%) 2024-09-06T14:50:34.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:33 smithi165 ceph-mon[82925]: pgmap v156: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 50/339 objects degraded (14.749%) 2024-09-06T14:50:35.227 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:34 smithi165 ceph-mon[82925]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/339 objects degraded (14.749%), 15 pgs degraded) 2024-09-06T14:50:35.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:34 smithi052 ceph-mon[112917]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 50/339 objects degraded (14.749%), 15 pgs degraded) 2024-09-06T14:50:36.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:35 smithi165 ceph-mon[82925]: pgmap v157: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:50:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:35 smithi052 ceph-mon[112917]: pgmap v157: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:50:38.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:37 smithi165 ceph-mon[82925]: pgmap v158: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 978 B/s rd, 3 op/s 2024-09-06T14:50:38.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:38.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:38.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:37 smithi052 ceph-mon[112917]: pgmap v158: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 978 B/s rd, 3 op/s 2024-09-06T14:50:38.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:38.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:40.188 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:39 smithi052 ceph-mon[112917]: pgmap v159: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s 2024-09-06T14:50:40.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:39 smithi165 ceph-mon[82925]: pgmap v159: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s 2024-09-06T14:50:42.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:41 smithi165 ceph-mon[82925]: pgmap v160: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s 2024-09-06T14:50:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:41 smithi052 ceph-mon[112917]: pgmap v160: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s 2024-09-06T14:50:44.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:43 smithi165 ceph-mon[82925]: pgmap v161: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 4 op/s 2024-09-06T14:50:44.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:43 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:44.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:43 smithi052 ceph-mon[112917]: pgmap v161: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 4 op/s 2024-09-06T14:50:44.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:43 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:45.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:45 smithi165 ceph-mon[82925]: pgmap v162: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 6 op/s 2024-09-06T14:50:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-06T14:50:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:45 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-06T14:50:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:45 smithi165 ceph-mon[82925]: Upgrade: osd.2 is safe to restart 2024-09-06T14:50:45.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:45 smithi052 ceph-mon[112917]: pgmap v162: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 6 op/s 2024-09-06T14:50:45.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-06T14:50:45.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:45 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-06T14:50:45.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:45 smithi052 ceph-mon[112917]: Upgrade: osd.2 is safe to restart 2024-09-06T14:50:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:47 smithi165 ceph-mon[82925]: pgmap v163: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:50:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:47 smithi165 ceph-mon[82925]: Upgrade: Updating osd.2 2024-09-06T14:50:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T14:50:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:50:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:47 smithi165 ceph-mon[82925]: Deploying daemon osd.2 on smithi052 2024-09-06T14:50:47.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:47 smithi052 ceph-mon[112917]: pgmap v163: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:50:47.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:47 smithi052 ceph-mon[112917]: Upgrade: Updating osd.2 2024-09-06T14:50:47.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:47.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-06T14:50:47.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:50:47.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:47 smithi052 ceph-mon[112917]: Deploying daemon osd.2 on smithi052 2024-09-06T14:50:49.699 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:49 smithi052 ceph-mon[112917]: pgmap v164: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-06T14:50:49.699 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:49 smithi052 systemd[1]: Stopping Ceph osd.2 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:50:50.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:49 smithi165 ceph-mon[82925]: pgmap v164: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-06T14:50:50.123 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:49 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[65048]: 2024-09-06T14:50:49.701+0000 7f8057467640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:50:50.123 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:49 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[65048]: 2024-09-06T14:50:49.701+0000 7f8057467640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-06T14:50:50.123 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:49 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[65048]: 2024-09-06T14:50:49.701+0000 7f8057467640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T14:50:50.694 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:50 smithi052 ceph-mon[112917]: osd.2 marked itself down and dead 2024-09-06T14:50:50.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:50 smithi165 ceph-mon[82925]: osd.2 marked itself down and dead 2024-09-06T14:50:51.372 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:51 smithi052 podman[133242]: 2024-09-06 14:50:51.086059906 +0000 UTC m=+1.490608244 container died cbf070f4d03bd6e329da1fbdce56af1164524d14ca71db78f397b6ab1a00e920 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-635ed4c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-06T14:50:51.678 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:51 smithi052 ceph-mon[112917]: pgmap v165: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s 2024-09-06T14:50:51.678 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:51 smithi052 ceph-mon[112917]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:50:51.678 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:51 smithi052 ceph-mon[112917]: osdmap e59: 6 total, 5 up, 6 in 2024-09-06T14:50:51.678 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:51 smithi052 podman[133242]: 2024-09-06 14:50:51.486009961 +0000 UTC m=+1.890558298 container cleanup cbf070f4d03bd6e329da1fbdce56af1164524d14ca71db78f397b6ab1a00e920 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-635ed4c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-06T14:50:51.679 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:51 smithi052 bash[133242]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 -- 172.21.15.52:0/1243845917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 msgr2=0x7fb33c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 --2- 172.21.15.52:0/1243845917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c107ce0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb334009c20 tx=0x7fb33402a970 comp rx=0 tx=0).stop 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 -- 172.21.15.52:0/1243845917 shutdown_connections 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 --2- 172.21.15.52:0/1243845917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb33c101900 0x7fb33c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 --2- 172.21.15.52:0/1243845917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c107ce0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 -- 172.21.15.52:0/1243845917 >> 172.21.15.52:0/1243845917 conn(0x7fb33c0fd600 msgr2=0x7fb33c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 -- 172.21.15.52:0/1243845917 shutdown_connections 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.680+0000 7fb343c7b640 1 -- 172.21.15.52:0/1243845917 wait complete. 2024-09-06T14:50:51.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb343c7b640 1 Processor -- start 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb343c7b640 1 -- start start 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb343c7b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb33c101900 0x7fb33c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb343c7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb343c7b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c10edd0 con 0x7fb33c107900 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb343c7b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb33c10ec50 con 0x7fb33c101900 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb341216640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb341216640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36082/0 (socket says 172.21.15.52:36082) 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb341216640 1 -- 172.21.15.52:0/3455184353 learned_addr learned my addr 172.21.15.52:0/3455184353 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.681+0000 7fb341a17640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb33c101900 0x7fb33c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb341216640 1 -- 172.21.15.52:0/3455184353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb33c101900 msgr2=0x7fb33c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb341216640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb33c101900 0x7fb33c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb341216640 1 -- 172.21.15.52:0/3455184353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33c197840 con 0x7fb33c107900 2024-09-06T14:50:51.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb341216640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c19dc00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb33000d6f0 tx=0x7fb33000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:51.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb33affd640 1 -- 172.21.15.52:0/3455184353 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb330017070 con 0x7fb33c107900 2024-09-06T14:50:51.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb33affd640 1 -- 172.21.15.52:0/3455184353 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb33000de00 con 0x7fb33c107900 2024-09-06T14:50:51.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb33affd640 1 -- 172.21.15.52:0/3455184353 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb330004bb0 con 0x7fb33c107900 2024-09-06T14:50:51.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33c197b30 con 0x7fb33c107900 2024-09-06T14:50:51.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.682+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb33c1980c0 con 0x7fb33c107900 2024-09-06T14:50:51.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.683+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb33c103040 con 0x7fb33c107900 2024-09-06T14:50:51.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.684+0000 7fb33affd640 1 -- 172.21.15.52:0/3455184353 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb330009a30 con 0x7fb33c107900 2024-09-06T14:50:51.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.684+0000 7fb33affd640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb3240774b0 0x7fb324079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:51.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.684+0000 7fb33affd640 1 -- 172.21.15.52:0/3455184353 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6027+0+0 (secure 0 0 0) 0x7fb330099100 con 0x7fb33c107900 2024-09-06T14:50:51.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.684+0000 7fb341a17640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb3240774b0 0x7fb324079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:51.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.685+0000 7fb341a17640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb3240774b0 0x7fb324079970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb334009430 tx=0x7fb33403c040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:51.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.688+0000 7fb33affd640 1 -- 172.21.15.52:0/3455184353 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb3300663c0 con 0x7fb33c107900 2024-09-06T14:50:51.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.877+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb33c198430 con 0x7fb3240774b0 2024-09-06T14:50:51.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.878+0000 7fb33affd640 1 -- 172.21.15.52:0/3455184353 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fb33c198430 con 0x7fb3240774b0 2024-09-06T14:50:51.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.880+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb3240774b0 msgr2=0x7fb324079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.880+0000 7fb343c7b640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb3240774b0 0x7fb324079970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb334009430 tx=0x7fb33403c040 comp rx=0 tx=0).stop 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.880+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 msgr2=0x7fb33c19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c19dc00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb33000d6f0 tx=0x7fb33000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 shutdown_connections 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb33c107900 0x7fb33c19dc00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb3240774b0 0x7fb324079970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 --2- 172.21.15.52:0/3455184353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb33c101900 0x7fb33c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 >> 172.21.15.52:0/3455184353 conn(0x7fb33c0fd600 msgr2=0x7fb33c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 shutdown_connections 2024-09-06T14:50:51.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.881+0000 7fb343c7b640 1 -- 172.21.15.52:0/3455184353 wait complete. 2024-09-06T14:50:51.889 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:50:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 -- 172.21.15.52:0/1065871132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84100800 msgr2=0x7fac84100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 --2- 172.21.15.52:0/1065871132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84100800 0x7fac84100c60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac78009880 tx=0x7fac7802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 -- 172.21.15.52:0/1065871132 shutdown_connections 2024-09-06T14:50:51.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 --2- 172.21.15.52:0/1065871132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84100800 0x7fac84100c60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 --2- 172.21.15.52:0/1065871132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac84106800 0x7fac84106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 -- 172.21.15.52:0/1065871132 >> 172.21.15.52:0/1065871132 conn(0x7fac840fc520 msgr2=0x7fac840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:51.974 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:51 smithi052 podman[133268]: 2024-09-06 14:50:51.704175735 +0000 UTC m=+0.613566120 container remove cbf070f4d03bd6e329da1fbdce56af1164524d14ca71db78f397b6ab1a00e920 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-635ed4c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 -- 172.21.15.52:0/1065871132 shutdown_connections 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.976+0000 7fac8a348640 1 -- 172.21.15.52:0/1065871132 wait complete. 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.977+0000 7fac8a348640 1 Processor -- start 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.977+0000 7fac8a348640 1 -- start start 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac8a348640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac84100800 0x7fac8419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac8a348640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84106800 0x7fac8419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac8a348640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fac8410dcd0 con 0x7fac84106800 2024-09-06T14:50:51.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac8a348640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac8410db50 con 0x7fac84100800 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84106800 0x7fac8419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac837fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84106800 0x7fac8419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36100/0 (socket says 172.21.15.52:36100) 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac837fe640 1 -- 172.21.15.52:0/3295894081 learned_addr learned my addr 172.21.15.52:0/3295894081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac83fff640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac84100800 0x7fac8419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac837fe640 1 -- 172.21.15.52:0/3295894081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac84100800 msgr2=0x7fac8419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac837fe640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac84100800 0x7fac8419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac837fe640 1 -- 172.21.15.52:0/3295894081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac841977f0 con 0x7fac84106800 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac837fe640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84106800 0x7fac8419dbb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac78031460 tx=0x7fac780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac817fa640 1 -- 172.21.15.52:0/3295894081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac7803f070 con 0x7fac84106800 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac817fa640 1 -- 172.21.15.52:0/3295894081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac78004cf0 con 0x7fac84106800 2024-09-06T14:50:51.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.978+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac84197a80 con 0x7fac84106800 2024-09-06T14:50:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.979+0000 7fac817fa640 1 -- 172.21.15.52:0/3295894081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac78035030 con 0x7fac84106800 2024-09-06T14:50:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.979+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac84197fb0 con 0x7fac84106800 2024-09-06T14:50:51.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.980+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac84101f40 con 0x7fac84106800 2024-09-06T14:50:51.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.980+0000 7fac817fa640 1 -- 172.21.15.52:0/3295894081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fac78042070 con 0x7fac84106800 2024-09-06T14:50:51.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.981+0000 7fac817fa640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac6c077460 0x7fac6c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:51.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.981+0000 7fac83fff640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac6c077460 0x7fac6c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:51.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.981+0000 7fac817fa640 1 -- 172.21.15.52:0/3295894081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6027+0+0 (secure 0 0 0) 0x7fac780ba060 con 0x7fac84106800 2024-09-06T14:50:51.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.981+0000 7fac83fff640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac6c077460 0x7fac6c079920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fac74005fd0 tx=0x7fac74005e20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:51.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:51.985+0000 7fac817fa640 1 -- 172.21.15.52:0/3295894081 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fac78083190 con 0x7fac84106800 2024-09-06T14:50:52.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:51 smithi165 ceph-mon[82925]: pgmap v165: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s 2024-09-06T14:50:52.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:51 smithi165 ceph-mon[82925]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:50:52.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:51 smithi165 ceph-mon[82925]: osdmap e59: 6 total, 5 up, 6 in 2024-09-06T14:50:52.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.169+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac84198320 con 0x7fac6c077460 2024-09-06T14:50:52.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.170+0000 7fac817fa640 1 -- 172.21.15.52:0/3295894081 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fac84198320 con 0x7fac6c077460 2024-09-06T14:50:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac6c077460 msgr2=0x7fac6c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac6c077460 0x7fac6c079920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fac74005fd0 tx=0x7fac74005e20 comp rx=0 tx=0).stop 2024-09-06T14:50:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84106800 msgr2=0x7fac8419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84106800 0x7fac8419dbb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fac78031460 tx=0x7fac780048f0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 shutdown_connections 2024-09-06T14:50:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac84106800 0x7fac8419dbb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac6c077460 0x7fac6c079920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 --2- 172.21.15.52:0/3295894081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac84100800 0x7fac8419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 >> 172.21.15.52:0/3295894081 conn(0x7fac840fc520 msgr2=0x7fac8406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 shutdown_connections 2024-09-06T14:50:52.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.172+0000 7fac8a348640 1 -- 172.21.15.52:0/3295894081 wait complete. 2024-09-06T14:50:52.233 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:52 smithi052 podman[133385]: 2024-09-06 14:50:51.954603681 +0000 UTC m=+0.016762837 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:50:52.233 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:52 smithi052 podman[133385]: 2024-09-06 14:50:52.114164992 +0000 UTC m=+0.176324139 container create 3fe06553d826940d3dad715a1e02874a6296a93b415ef076c751d1fc8ee98b01 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS) 2024-09-06T14:50:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 -- 172.21.15.52:0/1089054790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620107900 msgr2=0x7f0620107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 --2- 172.21.15.52:0/1089054790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620107900 0x7f0620107ce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0610009880 tx=0x7f061002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 -- 172.21.15.52:0/1089054790 shutdown_connections 2024-09-06T14:50:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 --2- 172.21.15.52:0/1089054790 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0620101900 0x7f0620101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 --2- 172.21.15.52:0/1089054790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620107900 0x7f0620107ce0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 -- 172.21.15.52:0/1089054790 >> 172.21.15.52:0/1089054790 conn(0x7f06200fd600 msgr2=0x7f06200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 -- 172.21.15.52:0/1089054790 shutdown_connections 2024-09-06T14:50:52.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.259+0000 7f0625e28640 1 -- 172.21.15.52:0/1089054790 wait complete. 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.260+0000 7f0625e28640 1 Processor -- start 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.260+0000 7f0625e28640 1 -- start start 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.260+0000 7f0625e28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620101900 0x7f062019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.260+0000 7f0625e28640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0620107900 0x7f062019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.260+0000 7f0625e28640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f062010edb0 con 0x7f0620101900 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.260+0000 7f0625e28640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f062010ec30 con 0x7f0620107900 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620101900 0x7f062019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620101900 0x7f062019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36116/0 (socket says 172.21.15.52:36116) 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061f7fe640 1 -- 172.21.15.52:0/374383084 learned_addr learned my addr 172.21.15.52:0/374383084 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:52.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061effd640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0620107900 0x7f062019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061f7fe640 1 -- 172.21.15.52:0/374383084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0620107900 msgr2=0x7f062019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061f7fe640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0620107900 0x7f062019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061f7fe640 1 -- 172.21.15.52:0/374383084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06201977c0 con 0x7f0620101900 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061f7fe640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620101900 0x7f062019d640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0610031460 tx=0x7f06100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061cff9640 1 -- 172.21.15.52:0/374383084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f061003f070 con 0x7f0620101900 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061cff9640 1 -- 172.21.15.52:0/374383084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06100035f0 con 0x7f0620101900 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.261+0000 7f061cff9640 1 -- 172.21.15.52:0/374383084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0610035030 con 0x7f0620101900 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.262+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0620197a50 con 0x7f0620101900 2024-09-06T14:50:52.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.262+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0620197f80 con 0x7f0620101900 2024-09-06T14:50:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.263+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0620103040 con 0x7f0620101900 2024-09-06T14:50:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.263+0000 7f061cff9640 1 -- 172.21.15.52:0/374383084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0610042070 con 0x7f0620101900 2024-09-06T14:50:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.264+0000 7f061cff9640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06080774b0 0x7f0608079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.264+0000 7f061cff9640 1 -- 172.21.15.52:0/374383084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6027+0+0 (secure 0 0 0) 0x7f06100b9e40 con 0x7f0620101900 2024-09-06T14:50:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.264+0000 7f061effd640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06080774b0 0x7f0608079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.264+0000 7f061effd640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06080774b0 0x7f0608079970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0620100e00 tx=0x7f061400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:52.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.268+0000 7f061cff9640 1 -- 172.21.15.52:0/374383084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0610087160 con 0x7f0620101900 2024-09-06T14:50:52.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.450+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0620198230 con 0x7f06080774b0 2024-09-06T14:50:52.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.467+0000 7f061cff9640 1 -- 172.21.15.52:0/374383084 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0620198230 con 0x7f06080774b0 2024-09-06T14:50:52.464 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (3m) 26s ago 14m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (6m) 26s ago 14m 8862k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (5m) 84s ago 13m 8728k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (92s) 26s ago 14m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (87s) 84s ago 13m 14.3M - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (2m) 26s ago 13m 81.2M - c8b91775d855 af78eb451b94 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (9m) 26s ago 9m 88.7M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (8m) 26s ago 8m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (8m) 84s ago 8m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (8m) 84s ago 8m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (5m) 26s ago 15m 520M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:50:52.465 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (4m) 84s ago 13m 456M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (2m) 26s ago 15m 40.1M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (105s) 84s ago 13m 26.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (4m) 26s ago 14m 10.4M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (4m) 84s ago 13m 11.9M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (67s) 26s ago 12m 81.2M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (32s) 26s ago 11m 12.2M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (11m) 26s ago 11m 184M 1217M 19.1.1-268-g635ed4cf b6db46a449e5 cbf070f4d03b 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (10m) 84s ago 10m 239M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (10m) 84s ago 10m 209M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (10m) 84s ago 10m 186M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:50:52.466 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (3m) 26s ago 13m 54.4M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:50:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.469+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06080774b0 msgr2=0x7f0608079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.469+0000 7f0625e28640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06080774b0 0x7f0608079970 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0620100e00 tx=0x7f061400b390 comp rx=0 tx=0).stop 2024-09-06T14:50:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.469+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620101900 msgr2=0x7f062019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.469+0000 7f0625e28640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620101900 0x7f062019d640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0610031460 tx=0x7f06100045e0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.470+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 shutdown_connections 2024-09-06T14:50:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.470+0000 7f0625e28640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06080774b0 0x7f0608079970 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.470+0000 7f0625e28640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0620107900 0x7f062019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.470+0000 7f0625e28640 1 --2- 172.21.15.52:0/374383084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0620101900 0x7f062019d640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.470+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 >> 172.21.15.52:0/374383084 conn(0x7f06200fd600 msgr2=0x7f06200ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.470+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 shutdown_connections 2024-09-06T14:50:52.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.470+0000 7f0625e28640 1 -- 172.21.15.52:0/374383084 wait complete. 2024-09-06T14:50:52.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 -- 172.21.15.52:0/594548243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 msgr2=0x7f5378107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 --2- 172.21.15.52:0/594548243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f5378107ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f536c009880 tx=0x7f536c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.565 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:52 smithi052 podman[133385]: 2024-09-06 14:50:52.358726716 +0000 UTC m=+0.420885863 container init 3fe06553d826940d3dad715a1e02874a6296a93b415ef076c751d1fc8ee98b01 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-06T14:50:52.566 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:52 smithi052 podman[133385]: 2024-09-06 14:50:52.362486265 +0000 UTC m=+0.424645411 container start 3fe06553d826940d3dad715a1e02874a6296a93b415ef076c751d1fc8ee98b01 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-06T14:50:52.566 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:52 smithi052 podman[133385]: 2024-09-06 14:50:52.45039149 +0000 UTC m=+0.512550645 container attach 3fe06553d826940d3dad715a1e02874a6296a93b415ef076c751d1fc8ee98b01 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-06T14:50:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 -- 172.21.15.52:0/594548243 shutdown_connections 2024-09-06T14:50:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 --2- 172.21.15.52:0/594548243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5378101900 0x7f5378101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 --2- 172.21.15.52:0/594548243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f5378107ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 -- 172.21.15.52:0/594548243 >> 172.21.15.52:0/594548243 conn(0x7f53780fd620 msgr2=0x7f53780ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 -- 172.21.15.52:0/594548243 shutdown_connections 2024-09-06T14:50:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.554+0000 7f537ef70640 1 -- 172.21.15.52:0/594548243 wait complete. 2024-09-06T14:50:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f537ef70640 1 Processor -- start 2024-09-06T14:50:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f537ef70640 1 -- start start 2024-09-06T14:50:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f537ef70640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5378101900 0x7f537819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f537ef70640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f537819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f537ef70640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f537810edd0 con 0x7f5378107900 2024-09-06T14:50:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f537ef70640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f537810ec50 con 0x7f5378101900 2024-09-06T14:50:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f5377fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f537819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f5377fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f537819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36136/0 (socket says 172.21.15.52:36136) 2024-09-06T14:50:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f5377fff640 1 -- 172.21.15.52:0/3056446170 learned_addr learned my addr 172.21.15.52:0/3056446170 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:52.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f537cd0c640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5378101900 0x7f537819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f5377fff640 1 -- 172.21.15.52:0/3056446170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5378101900 msgr2=0x7f537819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.555+0000 7f5377fff640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5378101900 0x7f537819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.556+0000 7f5377fff640 1 -- 172.21.15.52:0/3056446170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5378199a50 con 0x7f5378107900 2024-09-06T14:50:52.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.556+0000 7f5377fff640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f537819fdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f536400d6f0 tx=0x7f536400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:52.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.556+0000 7f5375ffb640 1 -- 172.21.15.52:0/3056446170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5364017070 con 0x7f5378107900 2024-09-06T14:50:52.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.556+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5378199d40 con 0x7f5378107900 2024-09-06T14:50:52.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.556+0000 7f5375ffb640 1 -- 172.21.15.52:0/3056446170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f536400de00 con 0x7f5378107900 2024-09-06T14:50:52.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.556+0000 7f5375ffb640 1 -- 172.21.15.52:0/3056446170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5364004bb0 con 0x7f5378107900 2024-09-06T14:50:52.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.557+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537819a2d0 con 0x7f5378107900 2024-09-06T14:50:52.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.558+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5378103040 con 0x7f5378107900 2024-09-06T14:50:52.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.559+0000 7f5375ffb640 1 -- 172.21.15.52:0/3056446170 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5364009a30 con 0x7f5378107900 2024-09-06T14:50:52.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.559+0000 7f5375ffb640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f53680774b0 0x7f5368079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.559+0000 7f5375ffb640 1 -- 172.21.15.52:0/3056446170 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6027+0+0 (secure 0 0 0) 0x7f5364099150 con 0x7f5378107900 2024-09-06T14:50:52.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.559+0000 7f537cd0c640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f53680774b0 0x7f5368079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.560+0000 7f537cd0c640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f53680774b0 0x7f5368079970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f536c000c00 tx=0x7f536c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:52.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.563+0000 7f5375ffb640 1 -- 172.21.15.52:0/3056446170 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5364062300 con 0x7f5378107900 2024-09-06T14:50:52.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.795+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5378101d60 con 0x7f5378107900 2024-09-06T14:50:52.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.795+0000 7f5375ffb640 1 -- 172.21.15.52:0/3056446170 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f5364066470 con 0x7f5378107900 2024-09-06T14:50:52.792 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:50:52.792 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:50:52.792 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:50:52.793 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:52.793 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:50:52.793 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:50:52.793 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:52.793 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:50:52.793 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 3, 2024-09-06T14:50:52.793 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:50:52.794 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:52.794 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:50:52.794 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:50:52.794 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:50:52.794 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:50:52.794 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 7, 2024-09-06T14:50:52.795 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:50:52.795 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:50:52.795 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:50:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f53680774b0 msgr2=0x7f5368079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f53680774b0 0x7f5368079970 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f536c000c00 tx=0x7f536c031400 comp rx=0 tx=0).stop 2024-09-06T14:50:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 msgr2=0x7f537819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f537819fdd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f536400d6f0 tx=0x7f536400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 shutdown_connections 2024-09-06T14:50:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5378107900 0x7f537819fdd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f53680774b0 0x7f5368079970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 --2- 172.21.15.52:0/3056446170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5378101900 0x7f537819f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 >> 172.21.15.52:0/3056446170 conn(0x7f53780fd620 msgr2=0x7f5378074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 shutdown_connections 2024-09-06T14:50:52.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.797+0000 7f537ef70640 1 -- 172.21.15.52:0/3056446170 wait complete. 2024-09-06T14:50:52.873 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:52 smithi052 podman[133385]: 2024-09-06 14:50:52.574232716 +0000 UTC m=+0.636391862 container died 3fe06553d826940d3dad715a1e02874a6296a93b415ef076c751d1fc8ee98b01 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0) 2024-09-06T14:50:52.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: osdmap e60: 6 total, 5 up, 6 in 2024-09-06T14:50:52.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:52.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]} : dispatch 2024-09-06T14:50:52.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 5]} : dispatch 2024-09-06T14:50:52.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]} : dispatch 2024-09-06T14:50:52.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 1]} : dispatch 2024-09-06T14:50:52.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]} : dispatch 2024-09-06T14:50:52.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 2]} : dispatch 2024-09-06T14:50:52.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 2]} : dispatch 2024-09-06T14:50:52.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 2]} : dispatch 2024-09-06T14:50:52.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]} : dispatch 2024-09-06T14:50:52.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]} : dispatch 2024-09-06T14:50:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.882+0000 7f6cda9a1640 1 -- 172.21.15.52:0/2016760195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4103250 msgr2=0x7f6cd410b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.882+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/2016760195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4103250 0x7f6cd410b740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40098b0 tx=0x7f6cc402a560 comp rx=0 tx=0).stop 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 -- 172.21.15.52:0/2016760195 shutdown_connections 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/2016760195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4103250 0x7f6cd410b740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/2016760195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cd4102930 0x7f6cd4102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 -- 172.21.15.52:0/2016760195 >> 172.21.15.52:0/2016760195 conn(0x7f6cd40fc310 msgr2=0x7f6cd40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 -- 172.21.15.52:0/2016760195 shutdown_connections 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 -- 172.21.15.52:0/2016760195 wait complete. 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 Processor -- start 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 -- start start 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4102930 0x7f6cd419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cd4103250 0x7f6cd419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd410ec60 con 0x7f6cd4102930 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.883+0000 7f6cda9a1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd410eae0 con 0x7f6cd4103250 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd999f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4102930 0x7f6cd419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd999f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4102930 0x7f6cd419d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36160/0 (socket says 172.21.15.52:36160) 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd999f640 1 -- 172.21.15.52:0/3530153425 learned_addr learned my addr 172.21.15.52:0/3530153425 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd919e640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cd4103250 0x7f6cd419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd999f640 1 -- 172.21.15.52:0/3530153425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cd4103250 msgr2=0x7f6cd419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd999f640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cd4103250 0x7f6cd419db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd999f640 1 -- 172.21.15.52:0/3530153425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd41976b0 con 0x7f6cd4102930 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd919e640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cd4103250 0x7f6cd419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cd999f640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4102930 0x7f6cd419d5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000b420 tx=0x7f6cd000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:52.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6ccaffd640 1 -- 172.21.15.52:0/3530153425 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cd0011630 con 0x7f6cd4102930 2024-09-06T14:50:52.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd41979a0 con 0x7f6cd4102930 2024-09-06T14:50:52.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6ccaffd640 1 -- 172.21.15.52:0/3530153425 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6cd0016070 con 0x7f6cd4102930 2024-09-06T14:50:52.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6ccaffd640 1 -- 172.21.15.52:0/3530153425 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6cd0010d40 con 0x7f6cd4102930 2024-09-06T14:50:52.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.884+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd4197f00 con 0x7f6cd4102930 2024-09-06T14:50:52.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.885+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb8005290 con 0x7f6cd4102930 2024-09-06T14:50:52.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.886+0000 7f6ccaffd640 1 -- 172.21.15.52:0/3530153425 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6cd001b460 con 0x7f6cd4102930 2024-09-06T14:50:52.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.886+0000 7f6ccaffd640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6cc0077460 0x7f6cc0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:52.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.887+0000 7f6ccaffd640 1 -- 172.21.15.52:0/3530153425 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6317+0+0 (secure 0 0 0) 0x7f6cd0098da0 con 0x7f6cd4102930 2024-09-06T14:50:52.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.887+0000 7f6cd919e640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6cc0077460 0x7f6cc0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:52.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.887+0000 7f6cd919e640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6cc0077460 0x7f6cc0079920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4000c00 tx=0x7f6cc4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:52.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:52.890+0000 7f6ccaffd640 1 -- 172.21.15.52:0/3530153425 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6cd0061db0 con 0x7f6cd4102930 2024-09-06T14:50:53.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: osdmap e60: 6 total, 5 up, 6 in 2024-09-06T14:50:53.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:53.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]} : dispatch 2024-09-06T14:50:53.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 5]} : dispatch 2024-09-06T14:50:53.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]} : dispatch 2024-09-06T14:50:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 1]} : dispatch 2024-09-06T14:50:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]} : dispatch 2024-09-06T14:50:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 2]} : dispatch 2024-09-06T14:50:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 2]} : dispatch 2024-09-06T14:50:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 2]} : dispatch 2024-09-06T14:50:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]} : dispatch 2024-09-06T14:50:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]} : dispatch 2024-09-06T14:50:53.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.076+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6cb8005d90 con 0x7f6cd4102930 2024-09-06T14:50:53.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.077+0000 7f6ccaffd640 1 -- 172.21.15.52:0/3530153425 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7f6cd0065f20 con 0x7f6cd4102930 2024-09-06T14:50:53.075 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:50:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:50:53.077 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:50:53.078 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:50:53.078 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:50:53.078 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:50:53.078 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:50:53.078 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:50:53.078 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:50:53.078 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:50:53.079 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:50:53.080 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:53.080 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:53.080 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:53.080 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:50:53.080 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:50:53.080 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.078+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6cc0077460 msgr2=0x7f6cc0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.078+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6cc0077460 0x7f6cc0079920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4000c00 tx=0x7f6cc4031400 comp rx=0 tx=0).stop 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.078+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4102930 msgr2=0x7f6cd419d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.078+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4102930 0x7f6cd419d5e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cd000b420 tx=0x7f6cd000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.079+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 shutdown_connections 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.079+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6cc0077460 0x7f6cc0079920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.079+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6cd4103250 0x7f6cd419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.079+0000 7f6cda9a1640 1 --2- 172.21.15.52:0/3530153425 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6cd4102930 0x7f6cd419d5e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.079+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 >> 172.21.15.52:0/3530153425 conn(0x7f6cd40fc310 msgr2=0x7f6cd4103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.079+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 shutdown_connections 2024-09-06T14:50:53.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.079+0000 7f6cda9a1640 1 -- 172.21.15.52:0/3530153425 wait complete. 2024-09-06T14:50:53.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/2970123004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0102ab0 msgr2=0x7f2cf0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 --2- 172.21.15.52:0/2970123004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0102ab0 0x7f2cf0102e90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009880 tx=0x7f2ce802a530 comp rx=0 tx=0).stop 2024-09-06T14:50:53.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/2970123004 shutdown_connections 2024-09-06T14:50:53.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 --2- 172.21.15.52:0/2970123004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cf01033d0 0x7f2cf010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 --2- 172.21.15.52:0/2970123004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf0102ab0 0x7f2cf0102e90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/2970123004 >> 172.21.15.52:0/2970123004 conn(0x7f2cf00fc550 msgr2=0x7f2cf00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:53.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/2970123004 shutdown_connections 2024-09-06T14:50:53.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.163+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/2970123004 wait complete. 2024-09-06T14:50:53.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cf4f0e640 1 Processor -- start 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cf4f0e640 1 -- start start 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cf4f0e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cf0102ab0 0x7f2cf0100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cf4f0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf01033d0 0x7f2cf0100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cf4f0e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf010edc0 con 0x7f2cf01033d0 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cf4f0e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf010ec40 con 0x7f2cf0102ab0 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cedd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf01033d0 0x7f2cf0100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cedd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf01033d0 0x7f2cf0100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36168/0 (socket says 172.21.15.52:36168) 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cedd9b640 1 -- 172.21.15.52:0/1900714852 learned_addr learned my addr 172.21.15.52:0/1900714852 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:53.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cee59c640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cf0102ab0 0x7f2cf0100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cedd9b640 1 -- 172.21.15.52:0/1900714852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cf0102ab0 msgr2=0x7f2cf0100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cedd9b640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cf0102ab0 0x7f2cf0100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.164+0000 7f2cedd9b640 1 -- 172.21.15.52:0/1900714852 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf0101190 con 0x7f2cf01033d0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.165+0000 7f2cedd9b640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf01033d0 0x7f2cf0100c50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800e970 tx=0x7f2cd800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.165+0000 7f2ce77fe640 1 -- 172.21.15.52:0/1900714852 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cd8009590 con 0x7f2cf01033d0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.165+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/1900714852 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf0101480 con 0x7f2cf01033d0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.165+0000 7f2ce77fe640 1 -- 172.21.15.52:0/1900714852 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cd8010430 con 0x7f2cf01033d0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.165+0000 7f2ce77fe640 1 -- 172.21.15.52:0/1900714852 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cd8018630 con 0x7f2cf01033d0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.165+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/1900714852 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf01a3e30 con 0x7f2cf01033d0 2024-09-06T14:50:53.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.166+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/1900714852 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf006a580 con 0x7f2cf01033d0 2024-09-06T14:50:53.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.166+0000 7f2ce77fe640 1 -- 172.21.15.52:0/1900714852 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2cd80105e0 con 0x7f2cf01033d0 2024-09-06T14:50:53.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.167+0000 7f2ce77fe640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2cdc077460 0x7f2cdc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:53.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.167+0000 7f2ce77fe640 1 -- 172.21.15.52:0/1900714852 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6317+0+0 (secure 0 0 0) 0x7f2cd8099d70 con 0x7f2cf01033d0 2024-09-06T14:50:53.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.167+0000 7f2cee59c640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2cdc077460 0x7f2cdc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:53.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.168+0000 7f2cee59c640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2cdc077460 0x7f2cdc079920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80096c0 tx=0x7f2ce8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:53.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.171+0000 7f2ce77fe640 1 -- 172.21.15.52:0/1900714852 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f2cd8062d80 con 0x7f2cf01033d0 2024-09-06T14:50:53.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.355+0000 7f2cf4f0e640 1 -- 172.21.15.52:0/1900714852 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2cf0062630 con 0x7f2cdc077460 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:50:53.355 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:50:53.356 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "8/23 daemons upgraded", 2024-09-06T14:50:53.356 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading osd daemons", 2024-09-06T14:50:53.356 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:50:53.356 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:50:53.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.357+0000 7f2ce77fe640 1 -- 172.21.15.52:0/1900714852 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2cf0062630 con 0x7f2cdc077460 2024-09-06T14:50:53.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 -- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2cdc077460 msgr2=0x7f2cdc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2cdc077460 0x7f2cdc079920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80096c0 tx=0x7f2ce8031400 comp rx=0 tx=0).stop 2024-09-06T14:50:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 -- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf01033d0 msgr2=0x7f2cf0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf01033d0 0x7f2cf0100c50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800e970 tx=0x7f2cd800ee30 comp rx=0 tx=0).stop 2024-09-06T14:50:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 -- 172.21.15.52:0/1900714852 shutdown_connections 2024-09-06T14:50:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cf01033d0 0x7f2cf0100c50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2cdc077460 0x7f2cdc079920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 --2- 172.21.15.52:0/1900714852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cf0102ab0 0x7f2cf0100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 -- 172.21.15.52:0/1900714852 >> 172.21.15.52:0/1900714852 conn(0x7f2cf00fc550 msgr2=0x7f2cf0108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 -- 172.21.15.52:0/1900714852 shutdown_connections 2024-09-06T14:50:53.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.364+0000 7f2ce57fa640 1 -- 172.21.15.52:0/1900714852 wait complete. 2024-09-06T14:50:53.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 -- 172.21.15.52:0/1429825927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498102ad0 msgr2=0x7fe498102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 --2- 172.21.15.52:0/1429825927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498102ad0 0x7fe498102eb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe488009880 tx=0x7fe48802a530 comp rx=0 tx=0).stop 2024-09-06T14:50:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 -- 172.21.15.52:0/1429825927 shutdown_connections 2024-09-06T14:50:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 --2- 172.21.15.52:0/1429825927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe4981033f0 0x7fe49810b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 --2- 172.21.15.52:0/1429825927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe498102ad0 0x7fe498102eb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 -- 172.21.15.52:0/1429825927 >> 172.21.15.52:0/1429825927 conn(0x7fe4980fc510 msgr2=0x7fe4980fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 -- 172.21.15.52:0/1429825927 shutdown_connections 2024-09-06T14:50:53.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.450+0000 7fe49cf23640 1 -- 172.21.15.52:0/1429825927 wait complete. 2024-09-06T14:50:53.448 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 podman[133470]: 2024-09-06 14:50:53.289238292 +0000 UTC m=+0.709425354 container remove 3fe06553d826940d3dad715a1e02874a6296a93b415ef076c751d1fc8ee98b01 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-06T14:50:53.448 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-06T14:50:53.449 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 systemd[1]: Stopped Ceph osd.2 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:50:53.449 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.2.service: Consumed 49.276s CPU time. 2024-09-06T14:50:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.451+0000 7fe49cf23640 1 Processor -- start 2024-09-06T14:50:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.451+0000 7fe49cf23640 1 -- start start 2024-09-06T14:50:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe49cf23640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe498102ad0 0x7fe498100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe49cf23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4981033f0 0x7fe498100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe49cf23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe49810ee00 con 0x7fe4981033f0 2024-09-06T14:50:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe49cf23640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe49810ec80 con 0x7fe498102ad0 2024-09-06T14:50:53.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4981033f0 0x7fe498100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe495d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4981033f0 0x7fe498100c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36186/0 (socket says 172.21.15.52:36186) 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe495d9b640 1 -- 172.21.15.52:0/2071054293 learned_addr learned my addr 172.21.15.52:0/2071054293 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe49659c640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe498102ad0 0x7fe498100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe495d9b640 1 -- 172.21.15.52:0/2071054293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe498102ad0 msgr2=0x7fe498100730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe495d9b640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe498102ad0 0x7fe498100730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe495d9b640 1 -- 172.21.15.52:0/2071054293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4981011b0 con 0x7fe4981033f0 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe49659c640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe498102ad0 0x7fe498100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe495d9b640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4981033f0 0x7fe498100c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00e970 tx=0x7fe48c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.452+0000 7fe4877fe640 1 -- 172.21.15.52:0/2071054293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe48c00cac0 con 0x7fe4981033f0 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.453+0000 7fe4877fe640 1 -- 172.21.15.52:0/2071054293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe48c0054e0 con 0x7fe4981033f0 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.453+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4981014a0 con 0x7fe4981033f0 2024-09-06T14:50:53.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.453+0000 7fe4877fe640 1 -- 172.21.15.52:0/2071054293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe48c004dd0 con 0x7fe4981033f0 2024-09-06T14:50:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.453+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4981a3e90 con 0x7fe4981033f0 2024-09-06T14:50:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.454+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe49806ada0 con 0x7fe4981033f0 2024-09-06T14:50:53.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.454+0000 7fe4877fe640 1 -- 172.21.15.52:0/2071054293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe48c005020 con 0x7fe4981033f0 2024-09-06T14:50:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.455+0000 7fe4877fe640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe480077460 0x7fe480079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:50:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.455+0000 7fe4877fe640 1 -- 172.21.15.52:0/2071054293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6317+0+0 (secure 0 0 0) 0x7fe48c099d20 con 0x7fe4981033f0 2024-09-06T14:50:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.455+0000 7fe49659c640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe480077460 0x7fe480079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:50:53.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.456+0000 7fe49659c640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe480077460 0x7fe480079920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe488000c00 tx=0x7fe488031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:50:53.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.459+0000 7fe4877fe640 1 -- 172.21.15.52:0/2071054293 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe48c062db0 con 0x7fe4981033f0 2024-09-06T14:50:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.689+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe498101c60 con 0x7fe4981033f0 2024-09-06T14:50:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.689+0000 7fe4877fe640 1 -- 172.21.15.52:0/2071054293 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1070 (secure 0 0 0) 0x7fe48c066f20 con 0x7fe4981033f0 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 1 osds down; 4 mgr modules have recently crashed 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout: osd.2 (root=default,host=smithi052) is down 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:50:53.687 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:50:53.688 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe480077460 msgr2=0x7fe480079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe480077460 0x7fe480079920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe488000c00 tx=0x7fe488031400 comp rx=0 tx=0).stop 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4981033f0 msgr2=0x7fe498100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4981033f0 0x7fe498100c70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe48c00e970 tx=0x7fe48c00ee30 comp rx=0 tx=0).stop 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 shutdown_connections 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4981033f0 0x7fe498100c70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe480077460 0x7fe480079920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 --2- 172.21.15.52:0/2071054293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe498102ad0 0x7fe498100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 >> 172.21.15.52:0/2071054293 conn(0x7fe4980fc510 msgr2=0x7fe498108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 shutdown_connections 2024-09-06T14:50:53.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:50:53.692+0000 7fe49cf23640 1 -- 172.21.15.52:0/2071054293 wait complete. 2024-09-06T14:50:53.734 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 systemd[1]: Starting Ceph osd.2 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:50:53.735 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:53.735 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: pgmap v168: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:50:53.735 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:53.735 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]}]': finished 2024-09-06T14:50:53.736 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 5]}]': finished 2024-09-06T14:50:53.736 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]}]': finished 2024-09-06T14:50:53.736 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 1]}]': finished 2024-09-06T14:50:53.736 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]': finished 2024-09-06T14:50:53.736 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 2]}]': finished 2024-09-06T14:50:53.737 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 2]}]': finished 2024-09-06T14:50:53.737 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 2]}]': finished 2024-09-06T14:50:53.737 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]': finished 2024-09-06T14:50:53.737 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]}]': finished 2024-09-06T14:50:53.737 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: osdmap e61: 6 total, 5 up, 6 in 2024-09-06T14:50:53.737 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:53.738 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:53.738 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3056446170' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:53.738 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:53 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3530153425' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:50:53.985 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 podman[133634]: 2024-09-06 14:50:53.64135797 +0000 UTC m=+0.016868523 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:50:53.985 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 podman[133634]: 2024-09-06 14:50:53.782925079 +0000 UTC m=+0.158435612 container create 8fbdee70824580c1d6b1e5a1ce11d5e7ee2d45702b79ede00142161ca7db0d95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-06T14:50:53.985 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 podman[133634]: 2024-09-06 14:50:53.98573108 +0000 UTC m=+0.361241614 container init 8fbdee70824580c1d6b1e5a1ce11d5e7ee2d45702b79ede00142161ca7db0d95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-06T14:50:53.986 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:53 smithi052 podman[133634]: 2024-09-06 14:50:53.988984344 +0000 UTC m=+0.364494887 container start 8fbdee70824580c1d6b1e5a1ce11d5e7ee2d45702b79ede00142161ca7db0d95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: pgmap v168: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]}]': finished 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 5]}]': finished 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [3, 2]}]': finished 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [0, 1]}]': finished 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]': finished 2024-09-06T14:50:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [0, 2]}]': finished 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.a", "id": [3, 2]}]': finished 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [1, 2]}]': finished 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 2]}]': finished 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 0]}]': finished 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: osdmap e61: 6 total, 5 up, 6 in 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3056446170' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:50:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:53 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3530153425' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:50:54.373 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 podman[133634]: 2024-09-06 14:50:54.069090712 +0000 UTC m=+0.444601257 container attach 8fbdee70824580c1d6b1e5a1ce11d5e7ee2d45702b79ede00142161ca7db0d95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-06T14:50:54.373 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:54.373 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 bash[133634]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:54.374 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:54.374 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 bash[133634]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:50:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-mon[112917]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-mon[112917]: osdmap e62: 6 total, 5 up, 6 in 2024-09-06T14:50:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2071054293' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:50:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-mon[112917]: osdmap e63: 6 total, 5 up, 6 in 2024-09-06T14:50:54.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:54 smithi165 ceph-mon[82925]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:50:54.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:54 smithi165 ceph-mon[82925]: osdmap e62: 6 total, 5 up, 6 in 2024-09-06T14:50:54.973 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:54 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2071054293' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:50:54.974 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:54 smithi165 ceph-mon[82925]: osdmap e63: 6 total, 5 up, 6 in 2024-09-06T14:50:55.162 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-06T14:50:55.163 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 bash[133634]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-06T14:50:55.163 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-06T14:50:55.163 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:54 smithi052 bash[133634]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-06T14:50:55.475 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-06T14:50:55.475 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 bash[133634]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-06T14:50:55.475 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-06T14:50:55.475 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 bash[133634]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-06T14:50:55.475 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-06T14:50:55.476 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 bash[133634]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-06T14:50:55.476 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-06T14:50:55.476 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 bash[133634]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-06T14:50:55.476 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate[133652]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-06T14:50:55.476 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 bash[133634]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-06T14:50:55.476 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 podman[133634]: 2024-09-06 14:50:55.197981837 +0000 UTC m=+1.573492382 container died 8fbdee70824580c1d6b1e5a1ce11d5e7ee2d45702b79ede00142161ca7db0d95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:50:55.836 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-mon[112917]: pgmap v171: 65 pgs: 13 active+undersized, 2 remapped+peering, 4 unknown, 3 peering, 11 active+undersized+degraded, 32 active+clean; 272 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-09-06T14:50:55.837 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-mon[112917]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-06T14:50:55.837 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-mon[112917]: Health check failed: Degraded data redundancy: 40/330 objects degraded (12.121%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:50:55.837 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:55 smithi052 ceph-mon[112917]: osdmap e64: 6 total, 5 up, 6 in 2024-09-06T14:50:56.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:55 smithi165 ceph-mon[82925]: pgmap v171: 65 pgs: 13 active+undersized, 2 remapped+peering, 4 unknown, 3 peering, 11 active+undersized+degraded, 32 active+clean; 272 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-09-06T14:50:56.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:55 smithi165 ceph-mon[82925]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-06T14:50:56.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:55 smithi165 ceph-mon[82925]: Health check failed: Degraded data redundancy: 40/330 objects degraded (12.121%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:50:56.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:55 smithi165 ceph-mon[82925]: osdmap e64: 6 total, 5 up, 6 in 2024-09-06T14:50:56.123 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:55 smithi052 podman[133788]: 2024-09-06 14:50:55.840271235 +0000 UTC m=+0.636176461 container remove 8fbdee70824580c1d6b1e5a1ce11d5e7ee2d45702b79ede00142161ca7db0d95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-06T14:50:56.123 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:56 smithi052 podman[133847]: 2024-09-06 14:50:56.033082975 +0000 UTC m=+0.101239556 container create b669d4c32bf679c0b02a32c759db6667812a8493954f45dc420144b68a56ceba (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD) 2024-09-06T14:50:56.123 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:56 smithi052 podman[133847]: 2024-09-06 14:50:55.947824822 +0000 UTC m=+0.015981419 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:50:56.524 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:56 smithi052 podman[133847]: 2024-09-06 14:50:56.261105764 +0000 UTC m=+0.329262363 container init b669d4c32bf679c0b02a32c759db6667812a8493954f45dc420144b68a56ceba (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS) 2024-09-06T14:50:56.524 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:56 smithi052 podman[133847]: 2024-09-06 14:50:56.264397159 +0000 UTC m=+0.332553740 container start b669d4c32bf679c0b02a32c759db6667812a8493954f45dc420144b68a56ceba (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-06T14:50:56.524 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:56 smithi052 ceph-osd[133866]: -- 172.21.15.52:0/2148391166 <== mon.0 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f0fe5ae1e0 con 0x55f0fe53e000 2024-09-06T14:50:56.872 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:56 smithi052 bash[133847]: b669d4c32bf679c0b02a32c759db6667812a8493954f45dc420144b68a56ceba 2024-09-06T14:50:56.873 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:56 smithi052 systemd[1]: Started Ceph osd.2 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:50:57.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:57 smithi165 ceph-mon[82925]: osdmap e65: 6 total, 5 up, 6 in 2024-09-06T14:50:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:57 smithi165 ceph-mon[82925]: pgmap v175: 65 pgs: 13 active+undersized, 2 remapped+peering, 4 unknown, 3 peering, 11 active+undersized+degraded, 32 active+clean; 272 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-09-06T14:50:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:57.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:50:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:57 smithi052 ceph-mon[112917]: osdmap e65: 6 total, 5 up, 6 in 2024-09-06T14:50:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:57 smithi052 ceph-mon[112917]: pgmap v175: 65 pgs: 13 active+undersized, 2 remapped+peering, 4 unknown, 3 peering, 11 active+undersized+degraded, 32 active+clean; 272 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-09-06T14:50:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:50:57.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:50:58.218 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:50:57 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[133862]: 2024-09-06T14:50:57.887+0000 7f5e6bd96640 -1 Falling back to public interface 2024-09-06T14:50:58.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:58 smithi165 ceph-mon[82925]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-06T14:50:58.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:58 smithi052 ceph-mon[112917]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-06T14:50:59.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:50:59 smithi165 ceph-mon[82925]: pgmap v176: 65 pgs: 9 active+clean+remapped, 13 active+undersized, 1 remapped+peering, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 66 MiB/s wr, 307 op/s; 40/339 objects degraded (11.799%); 14/339 objects misplaced (4.130%); 1.7 MiB/s, 52 objects/s recovering 2024-09-06T14:50:59.605 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:50:59 smithi052 ceph-mon[112917]: pgmap v176: 65 pgs: 9 active+clean+remapped, 13 active+undersized, 1 remapped+peering, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 66 MiB/s wr, 307 op/s; 40/339 objects degraded (11.799%); 14/339 objects misplaced (4.130%); 1.7 MiB/s, 52 objects/s recovering 2024-09-06T14:51:00.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:00 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 40/339 objects degraded (11.799%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:00.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:00 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 40/339 objects degraded (11.799%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:01.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:01 smithi165 ceph-mon[82925]: pgmap v177: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 685 KiB/s rd, 737 KiB/s wr, 113 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%); 1.3 MiB/s, 40 objects/s recovering 2024-09-06T14:51:01.622 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:01 smithi052 ceph-mon[112917]: pgmap v177: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 685 KiB/s rd, 737 KiB/s wr, 113 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%); 1.3 MiB/s, 40 objects/s recovering 2024-09-06T14:51:02.452 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:51:02 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[133862]: 2024-09-06T14:51:02.200+0000 7f5e6bd96640 -1 osd.2 58 log_to_monitors true 2024-09-06T14:51:02.707 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.707 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.707 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.707 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:02 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.707 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:02 smithi052 ceph-mon[112917]: from='osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T14:51:02.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:02 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:02 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:02 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:02 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:02.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:02 smithi165 ceph-mon[82925]: from='osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-06T14:51:03.453 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 14:51:03 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[133862]: 2024-09-06T14:51:03.178+0000 7f5e5fb38640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:51:03.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:03 smithi052 ceph-mon[112917]: pgmap v178: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 542 KiB/s rd, 583 KiB/s wr, 89 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%); 1.1 MiB/s, 31 objects/s recovering 2024-09-06T14:51:03.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:03 smithi052 ceph-mon[112917]: from='osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T14:51:03.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:03 smithi052 ceph-mon[112917]: osdmap e66: 6 total, 5 up, 6 in 2024-09-06T14:51:03.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:03 smithi052 ceph-mon[112917]: from='osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-06T14:51:03.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:03 smithi165 ceph-mon[82925]: pgmap v178: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 542 KiB/s rd, 583 KiB/s wr, 89 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%); 1.1 MiB/s, 31 objects/s recovering 2024-09-06T14:51:03.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:03 smithi165 ceph-mon[82925]: from='osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-06T14:51:03.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:03 smithi165 ceph-mon[82925]: osdmap e66: 6 total, 5 up, 6 in 2024-09-06T14:51:03.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:03 smithi165 ceph-mon[82925]: from='osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-06T14:51:04.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:04 smithi052 ceph-mon[112917]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:51:04.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:04 smithi052 ceph-mon[112917]: osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972] boot 2024-09-06T14:51:04.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:04 smithi052 ceph-mon[112917]: osdmap e67: 6 total, 6 up, 6 in 2024-09-06T14:51:04.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T14:51:04.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:04 smithi165 ceph-mon[82925]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:51:04.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:04 smithi165 ceph-mon[82925]: osd.2 [v2:172.21.15.52:6818/3597426972,v1:172.21.15.52:6819/3597426972] boot 2024-09-06T14:51:04.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:04 smithi165 ceph-mon[82925]: osdmap e67: 6 total, 6 up, 6 in 2024-09-06T14:51:04.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:04 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-06T14:51:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:05 smithi052 ceph-mon[112917]: pgmap v181: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 515 KiB/s rd, 553 KiB/s wr, 88 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%); 1024 KiB/s, 30 objects/s recovering 2024-09-06T14:51:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:05 smithi052 ceph-mon[112917]: osdmap e68: 6 total, 6 up, 6 in 2024-09-06T14:51:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:05.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:51:05.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:05.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:05 smithi165 ceph-mon[82925]: pgmap v181: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 515 KiB/s rd, 553 KiB/s wr, 88 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%); 1024 KiB/s, 30 objects/s recovering 2024-09-06T14:51:05.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:05 smithi165 ceph-mon[82925]: osdmap e68: 6 total, 6 up, 6 in 2024-09-06T14:51:05.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:05.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:05.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:05.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:51:05.806 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:06.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:51:06.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:06.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:06.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:06.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-06T14:51:06.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-06T14:51:06.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-09-06T14:51:06.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:06 smithi165 ceph-mon[82925]: osdmap e69: 6 total, 6 up, 6 in 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-09-06T14:51:06.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:06 smithi052 ceph-mon[112917]: osdmap e69: 6 total, 6 up, 6 in 2024-09-06T14:51:07.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:07 smithi052 ceph-mon[112917]: pgmap v184: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%) 2024-09-06T14:51:07.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:07 smithi052 ceph-mon[112917]: osdmap e70: 6 total, 6 up, 6 in 2024-09-06T14:51:07.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:07 smithi165 ceph-mon[82925]: pgmap v184: 65 pgs: 10 active+clean+remapped, 13 active+undersized, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 7 op/s; 40/339 objects degraded (11.799%); 17/339 objects misplaced (5.015%) 2024-09-06T14:51:07.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:07 smithi165 ceph-mon[82925]: osdmap e70: 6 total, 6 up, 6 in 2024-09-06T14:51:08.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:08.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:08.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:08 smithi052 ceph-mon[112917]: osdmap e71: 6 total, 6 up, 6 in 2024-09-06T14:51:09.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:09.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:09.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:08 smithi165 ceph-mon[82925]: osdmap e71: 6 total, 6 up, 6 in 2024-09-06T14:51:09.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:09 smithi052 ceph-mon[112917]: pgmap v187: 65 pgs: 1 active+undersized+remapped, 5 peering, 1 active+clean+remapped, 2 active+undersized, 1 active+undersized+degraded, 55 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/339 objects degraded (1.180%); 3/339 objects misplaced (0.885%); 7.0 MiB/s, 125 objects/s recovering 2024-09-06T14:51:09.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:09 smithi052 ceph-mon[112917]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-06T14:51:09.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:09 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 4/339 objects degraded (1.180%), 1 pg degraded (PG_DEGRADED) 2024-09-06T14:51:09.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:09 smithi052 ceph-mon[112917]: osdmap e72: 6 total, 6 up, 6 in 2024-09-06T14:51:10.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:09 smithi165 ceph-mon[82925]: pgmap v187: 65 pgs: 1 active+undersized+remapped, 5 peering, 1 active+clean+remapped, 2 active+undersized, 1 active+undersized+degraded, 55 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 4/339 objects degraded (1.180%); 3/339 objects misplaced (0.885%); 7.0 MiB/s, 125 objects/s recovering 2024-09-06T14:51:10.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:09 smithi165 ceph-mon[82925]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-06T14:51:10.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:09 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 4/339 objects degraded (1.180%), 1 pg degraded (PG_DEGRADED) 2024-09-06T14:51:10.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:09 smithi165 ceph-mon[82925]: osdmap e72: 6 total, 6 up, 6 in 2024-09-06T14:51:10.901 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:10 smithi165 ceph-mon[82925]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/339 objects degraded (1.180%), 1 pg degraded) 2024-09-06T14:51:11.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:10 smithi052 ceph-mon[112917]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/339 objects degraded (1.180%), 1 pg degraded) 2024-09-06T14:51:12.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:11 smithi165 ceph-mon[82925]: pgmap v189: 65 pgs: 1 active+undersized+remapped, 5 peering, 59 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s, 128 objects/s recovering 2024-09-06T14:51:12.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:11 smithi052 ceph-mon[112917]: pgmap v189: 65 pgs: 1 active+undersized+remapped, 5 peering, 59 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.0 MiB/s, 128 objects/s recovering 2024-09-06T14:51:14.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:13 smithi165 ceph-mon[82925]: pgmap v190: 65 pgs: 1 active+undersized+remapped, 5 peering, 59 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s, 86 objects/s recovering 2024-09-06T14:51:14.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:13 smithi052 ceph-mon[112917]: pgmap v190: 65 pgs: 1 active+undersized+remapped, 5 peering, 59 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 5.3 MiB/s, 86 objects/s recovering 2024-09-06T14:51:15.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:14 smithi165 ceph-mon[82925]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-06T14:51:15.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:14 smithi052 ceph-mon[112917]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-06T14:51:15.996 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:15 smithi165 ceph-mon[82925]: pgmap v191: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 4.6 MiB/s, 42 objects/s recovering 2024-09-06T14:51:16.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:15 smithi052 ceph-mon[112917]: pgmap v191: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 4.6 MiB/s, 42 objects/s recovering 2024-09-06T14:51:18.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:17 smithi165 ceph-mon[82925]: pgmap v192: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1022 B/s rd, 3 op/s; 511 KiB/s, 0 objects/s recovering 2024-09-06T14:51:18.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:17 smithi052 ceph-mon[112917]: pgmap v192: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1022 B/s rd, 3 op/s; 511 KiB/s, 0 objects/s recovering 2024-09-06T14:51:20.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:19 smithi165 ceph-mon[82925]: pgmap v193: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 4 op/s; 410 KiB/s, 0 objects/s recovering 2024-09-06T14:51:20.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:19 smithi052 ceph-mon[112917]: pgmap v193: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 4 op/s; 410 KiB/s, 0 objects/s recovering 2024-09-06T14:51:20.971 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:20 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-06T14:51:21.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:20 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-06T14:51:21.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:21 smithi165 ceph-mon[82925]: pgmap v194: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 5 op/s 2024-09-06T14:51:21.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:21 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-06T14:51:21.962 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:21 smithi165 ceph-mon[82925]: Upgrade: osd.3 is safe to restart 2024-09-06T14:51:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:21 smithi052 ceph-mon[112917]: pgmap v194: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 5 op/s 2024-09-06T14:51:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:21 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-06T14:51:22.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:21 smithi052 ceph-mon[112917]: Upgrade: osd.3 is safe to restart 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: Upgrade: Updating osd.3 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: Deploying daemon osd.3 on smithi165 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:23.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: Upgrade: Updating osd.3 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: Deploying daemon osd.3 on smithi165 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 -- 172.21.15.52:0/2457030741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860107900 msgr2=0x7fa860107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 --2- 172.21.15.52:0/2457030741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860107900 0x7fa860107ce0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009880 tx=0x7fa85c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 -- 172.21.15.52:0/2457030741 shutdown_connections 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 --2- 172.21.15.52:0/2457030741 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa860101900 0x7fa860101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 --2- 172.21.15.52:0/2457030741 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860107900 0x7fa860107ce0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 -- 172.21.15.52:0/2457030741 >> 172.21.15.52:0/2457030741 conn(0x7fa8600fd600 msgr2=0x7fa8600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 -- 172.21.15.52:0/2457030741 shutdown_connections 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 -- 172.21.15.52:0/2457030741 wait complete. 2024-09-06T14:51:23.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 Processor -- start 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.790+0000 7fa868387640 1 -- start start 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa868387640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860101900 0x7fa86019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa868387640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa860107900 0x7fa86019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa868387640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa86010edd0 con 0x7fa860101900 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa868387640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa86010ec50 con 0x7fa860107900 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa866123640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860101900 0x7fa86019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa866123640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860101900 0x7fa86019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52368/0 (socket says 172.21.15.52:52368) 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa866123640 1 -- 172.21.15.52:0/1351072967 learned_addr learned my addr 172.21.15.52:0/1351072967 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa865922640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa860107900 0x7fa86019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa866123640 1 -- 172.21.15.52:0/1351072967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa860107900 msgr2=0x7fa86019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa866123640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa860107900 0x7fa86019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.790 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa866123640 1 -- 172.21.15.52:0/1351072967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8601977c0 con 0x7fa860101900 2024-09-06T14:51:23.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.791+0000 7fa866123640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860101900 0x7fa86019d640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa85c031460 tx=0x7fa85c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:23.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.792+0000 7fa8577fe640 1 -- 172.21.15.52:0/1351072967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa85c03f070 con 0x7fa860101900 2024-09-06T14:51:23.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.792+0000 7fa8577fe640 1 -- 172.21.15.52:0/1351072967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa85c0035f0 con 0x7fa860101900 2024-09-06T14:51:23.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.792+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa860197a50 con 0x7fa860101900 2024-09-06T14:51:23.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.792+0000 7fa8577fe640 1 -- 172.21.15.52:0/1351072967 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa85c035030 con 0x7fa860101900 2024-09-06T14:51:23.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.792+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa860197f80 con 0x7fa860101900 2024-09-06T14:51:23.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.793+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa860103040 con 0x7fa860101900 2024-09-06T14:51:23.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.794+0000 7fa8577fe640 1 -- 172.21.15.52:0/1351072967 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa85c042070 con 0x7fa860101900 2024-09-06T14:51:23.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.794+0000 7fa8577fe640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa84c077460 0x7fa84c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:23.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.794+0000 7fa8577fe640 1 -- 172.21.15.52:0/1351072967 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6317+0+0 (secure 0 0 0) 0x7fa85c0ba0b0 con 0x7fa860101900 2024-09-06T14:51:23.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.794+0000 7fa865922640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa84c077460 0x7fa84c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:23.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.795+0000 7fa865922640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa84c077460 0x7fa84c079920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8600ffbf0 tx=0x7fa85000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:23.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.798+0000 7fa8577fe640 1 -- 172.21.15.52:0/1351072967 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa85c087190 con 0x7fa860101900 2024-09-06T14:51:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.977+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa8601982f0 con 0x7fa84c077460 2024-09-06T14:51:23.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.978+0000 7fa8577fe640 1 -- 172.21.15.52:0/1351072967 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fa8601982f0 con 0x7fa84c077460 2024-09-06T14:51:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa84c077460 msgr2=0x7fa84c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa84c077460 0x7fa84c079920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8600ffbf0 tx=0x7fa85000b390 comp rx=0 tx=0).stop 2024-09-06T14:51:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860101900 msgr2=0x7fa86019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860101900 0x7fa86019d640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa85c031460 tx=0x7fa85c0045e0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 shutdown_connections 2024-09-06T14:51:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa84c077460 0x7fa84c079920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa860107900 0x7fa86019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 --2- 172.21.15.52:0/1351072967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa860101900 0x7fa86019d640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 >> 172.21.15.52:0/1351072967 conn(0x7fa8600fd600 msgr2=0x7fa8600fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 shutdown_connections 2024-09-06T14:51:23.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:23.980+0000 7fa868387640 1 -- 172.21.15.52:0/1351072967 wait complete. 2024-09-06T14:51:23.986 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:51:24.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.064+0000 7ff552fcb640 1 -- 172.21.15.52:0/2563406248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c101900 msgr2=0x7ff54c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.064+0000 7ff552fcb640 1 --2- 172.21.15.52:0/2563406248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c101900 0x7ff54c101d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff534009880 tx=0x7ff53402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 -- 172.21.15.52:0/2563406248 shutdown_connections 2024-09-06T14:51:24.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 --2- 172.21.15.52:0/2563406248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c101900 0x7ff54c101d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 --2- 172.21.15.52:0/2563406248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff54c107900 0x7ff54c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 -- 172.21.15.52:0/2563406248 >> 172.21.15.52:0/2563406248 conn(0x7ff54c0fd620 msgr2=0x7ff54c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:24.063 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:24 smithi052 ceph-mon[112917]: pgmap v195: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 4 op/s 2024-09-06T14:51:24.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 -- 172.21.15.52:0/2563406248 shutdown_connections 2024-09-06T14:51:24.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 -- 172.21.15.52:0/2563406248 wait complete. 2024-09-06T14:51:24.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 Processor -- start 2024-09-06T14:51:24.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 -- start start 2024-09-06T14:51:24.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.065+0000 7ff552fcb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff54c101900 0x7ff54c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff552fcb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c107900 0x7ff54c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff552fcb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c10edd0 con 0x7ff54c107900 2024-09-06T14:51:24.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff552fcb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff54c10ec50 con 0x7ff54c101900 2024-09-06T14:51:24.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff54bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c107900 0x7ff54c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff54bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c107900 0x7ff54c19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52374/0 (socket says 172.21.15.52:52374) 2024-09-06T14:51:24.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff54bfff640 1 -- 172.21.15.52:0/3538116749 learned_addr learned my addr 172.21.15.52:0/3538116749 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:24.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff550d67640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff54c101900 0x7ff54c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff54bfff640 1 -- 172.21.15.52:0/3538116749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff54c101900 msgr2=0x7ff54c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff54bfff640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff54c101900 0x7ff54c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff54bfff640 1 -- 172.21.15.52:0/3538116749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c199a10 con 0x7ff54c107900 2024-09-06T14:51:24.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff550d67640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff54c101900 0x7ff54c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:51:24.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff54bfff640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c107900 0x7ff54c19fd90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff534031460 tx=0x7ff534004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff549ffb640 1 -- 172.21.15.52:0/3538116749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff53403f070 con 0x7ff54c107900 2024-09-06T14:51:24.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff549ffb640 1 -- 172.21.15.52:0/3538116749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5340035f0 con 0x7ff54c107900 2024-09-06T14:51:24.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff549ffb640 1 -- 172.21.15.52:0/3538116749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff534035030 con 0x7ff54c107900 2024-09-06T14:51:24.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.066+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff54c199ca0 con 0x7ff54c107900 2024-09-06T14:51:24.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.067+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff54c19a1d0 con 0x7ff54c107900 2024-09-06T14:51:24.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.068+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff54c103040 con 0x7ff54c107900 2024-09-06T14:51:24.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.068+0000 7ff549ffb640 1 -- 172.21.15.52:0/3538116749 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff534042070 con 0x7ff54c107900 2024-09-06T14:51:24.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.069+0000 7ff549ffb640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5380774b0 0x7ff538079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.069+0000 7ff550d67640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5380774b0 0x7ff538079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.069+0000 7ff549ffb640 1 -- 172.21.15.52:0/3538116749 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6317+0+0 (secure 0 0 0) 0x7ff5340b9fe0 con 0x7ff54c107900 2024-09-06T14:51:24.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.069+0000 7ff550d67640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5380774b0 0x7ff538079970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff54c19ab50 tx=0x7ff544005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.073+0000 7ff549ffb640 1 -- 172.21.15.52:0/3538116749 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff534083070 con 0x7ff54c107900 2024-09-06T14:51:24.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.251+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff54c19a480 con 0x7ff5380774b0 2024-09-06T14:51:24.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.252+0000 7ff549ffb640 1 -- 172.21.15.52:0/3538116749 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff54c19a480 con 0x7ff5380774b0 2024-09-06T14:51:24.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5380774b0 msgr2=0x7ff538079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5380774b0 0x7ff538079970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff54c19ab50 tx=0x7ff544005f90 comp rx=0 tx=0).stop 2024-09-06T14:51:24.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c107900 msgr2=0x7ff54c19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c107900 0x7ff54c19fd90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff534031460 tx=0x7ff534004530 comp rx=0 tx=0).stop 2024-09-06T14:51:24.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 shutdown_connections 2024-09-06T14:51:24.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff54c107900 0x7ff54c19fd90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff5380774b0 0x7ff538079970 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 --2- 172.21.15.52:0/3538116749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff54c101900 0x7ff54c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 >> 172.21.15.52:0/3538116749 conn(0x7ff54c0fd620 msgr2=0x7ff54c0fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 shutdown_connections 2024-09-06T14:51:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.254+0000 7ff552fcb640 1 -- 172.21.15.52:0/3538116749 wait complete. 2024-09-06T14:51:24.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:24 smithi165 ceph-mon[82925]: pgmap v195: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 4 op/s 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 -- 172.21.15.52:0/2503797218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 msgr2=0x7f37b8102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 --2- 172.21.15.52:0/2503797218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b8102f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f37b40098b0 tx=0x7f37b402a560 comp rx=0 tx=0).stop 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 -- 172.21.15.52:0/2503797218 shutdown_connections 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 --2- 172.21.15.52:0/2503797218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37b8103440 0x7f37b810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 --2- 172.21.15.52:0/2503797218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b8102f00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 -- 172.21.15.52:0/2503797218 >> 172.21.15.52:0/2503797218 conn(0x7f37b80fc520 msgr2=0x7f37b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 -- 172.21.15.52:0/2503797218 shutdown_connections 2024-09-06T14:51:24.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.337+0000 7f37bf430640 1 -- 172.21.15.52:0/2503797218 wait complete. 2024-09-06T14:51:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bf430640 1 Processor -- start 2024-09-06T14:51:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bf430640 1 -- start start 2024-09-06T14:51:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bf430640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bf430640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37b8103440 0x7f37b819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bf430640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37b810edd0 con 0x7f37b8102b20 2024-09-06T14:51:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bf430640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37b810ec50 con 0x7f37b8103440 2024-09-06T14:51:24.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bd1cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bd1cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52392/0 (socket says 172.21.15.52:52392) 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bd1cc640 1 -- 172.21.15.52:0/1454987589 learned_addr learned my addr 172.21.15.52:0/1454987589 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bd1cc640 1 -- 172.21.15.52:0/1454987589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37b8103440 msgr2=0x7f37b819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bc9cb640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37b8103440 0x7f37b819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bd1cc640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37b8103440 0x7f37b819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bd1cc640 1 -- 172.21.15.52:0/1454987589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b8197800 con 0x7f37b8102b20 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.338+0000 7f37bd1cc640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b819d680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37b4031460 tx=0x7f37b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.339+0000 7f37aa7fc640 1 -- 172.21.15.52:0/1454987589 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37b403f070 con 0x7f37b8102b20 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.339+0000 7f37aa7fc640 1 -- 172.21.15.52:0/1454987589 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37b40044d0 con 0x7f37b8102b20 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.339+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b8197a90 con 0x7f37b8102b20 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.339+0000 7f37aa7fc640 1 -- 172.21.15.52:0/1454987589 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37b4035030 con 0x7f37b8102b20 2024-09-06T14:51:24.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.339+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b8197fc0 con 0x7f37b8102b20 2024-09-06T14:51:24.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.340+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b806aa30 con 0x7f37b8102b20 2024-09-06T14:51:24.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.341+0000 7f37aa7fc640 1 -- 172.21.15.52:0/1454987589 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f37b4042070 con 0x7f37b8102b20 2024-09-06T14:51:24.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.341+0000 7f37aa7fc640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37a4077460 0x7f37a4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.341+0000 7f37aa7fc640 1 -- 172.21.15.52:0/1454987589 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6317+0+0 (secure 0 0 0) 0x7f37b40ba180 con 0x7f37b8102b20 2024-09-06T14:51:24.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.341+0000 7f37bc9cb640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37a4077460 0x7f37a4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.342+0000 7f37bc9cb640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37a4077460 0x7f37a4079920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37b8108960 tx=0x7f37ac005c60 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.345+0000 7f37aa7fc640 1 -- 172.21.15.52:0/1454987589 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f37b4083190 con 0x7f37b8102b20 2024-09-06T14:51:24.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.513+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f37b8198330 con 0x7f37a4077460 2024-09-06T14:51:24.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.523+0000 7f37aa7fc640 1 -- 172.21.15.52:0/1454987589 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f37b8198330 con 0x7f37a4077460 2024-09-06T14:51:24.521 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:51:24.521 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (3m) 23s ago 14m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:51:24.521 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (6m) 23s ago 14m 8921k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:51:24.521 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (6m) 116s ago 14m 8728k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:51:24.522 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (2m) 23s ago 14m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:51:24.522 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (119s) 116s ago 14m 14.3M - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:51:24.522 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (3m) 23s ago 14m 79.1M - c8b91775d855 af78eb451b94 2024-09-06T14:51:24.522 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (9m) 23s ago 9m 88.7M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:51:24.522 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (9m) 23s ago 9m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:51:24.522 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (9m) 116s ago 9m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:51:24.523 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (9m) 116s ago 9m 26.5M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:51:24.523 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (5m) 23s ago 15m 521M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:51:24.523 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (4m) 116s ago 13m 456M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:51:24.523 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (2m) 23s ago 16m 41.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:51:24.523 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (2m) 116s ago 13m 26.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:51:24.523 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (4m) 23s ago 14m 10.6M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:51:24.524 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (4m) 116s ago 13m 11.9M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:51:24.524 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (99s) 23s ago 12m 90.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:51:24.524 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (64s) 23s ago 12m 97.7M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:51:24.524 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (28s) 23s ago 11m 12.2M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:51:24.524 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (11m) 116s ago 11m 239M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 e2a333e62407 2024-09-06T14:51:24.525 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (11m) 116s ago 11m 209M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:51:24.525 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (10m) 116s ago 10m 186M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:51:24.525 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (4m) 23s ago 14m 58.7M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:51:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37a4077460 msgr2=0x7f37a4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37a4077460 0x7f37a4079920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f37b8108960 tx=0x7f37ac005c60 comp rx=0 tx=0).stop 2024-09-06T14:51:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 msgr2=0x7f37b819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b819d680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f37b4031460 tx=0x7f37b40048f0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 shutdown_connections 2024-09-06T14:51:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37a4077460 0x7f37a4079920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37b8103440 0x7f37b819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 --2- 172.21.15.52:0/1454987589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37b8102b20 0x7f37b819d680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 >> 172.21.15.52:0/1454987589 conn(0x7f37b80fc520 msgr2=0x7f37b8103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 shutdown_connections 2024-09-06T14:51:24.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.525+0000 7f37bf430640 1 -- 172.21.15.52:0/1454987589 wait complete. 2024-09-06T14:51:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.606+0000 7fb4714b2640 1 -- 172.21.15.52:0/957285753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074620 msgr2=0x7fb46c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.606+0000 7fb4714b2640 1 --2- 172.21.15.52:0/957285753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074620 0x7fb46c074a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009c20 tx=0x7fb45c02aa00 comp rx=0 tx=0).stop 2024-09-06T14:51:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 -- 172.21.15.52:0/957285753 shutdown_connections 2024-09-06T14:51:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 --2- 172.21.15.52:0/957285753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c074f40 0x7fb46c10dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 --2- 172.21.15.52:0/957285753 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074620 0x7fb46c074a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 -- 172.21.15.52:0/957285753 >> 172.21.15.52:0/957285753 conn(0x7fb46c0fd600 msgr2=0x7fb46c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:24.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 -- 172.21.15.52:0/957285753 shutdown_connections 2024-09-06T14:51:24.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 -- 172.21.15.52:0/957285753 wait complete. 2024-09-06T14:51:24.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 Processor -- start 2024-09-06T14:51:24.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.607+0000 7fb4714b2640 1 -- start start 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb4714b2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c074620 0x7fb46c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb4714b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074f40 0x7fb46c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb4714b2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c110ff0 con 0x7fb46c074f40 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb4714b2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c110e70 con 0x7fb46c074620 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074f40 0x7fb46c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46a7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074f40 0x7fb46c19fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52398/0 (socket says 172.21.15.52:52398) 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46a7fc640 1 -- 172.21.15.52:0/3256919773 learned_addr learned my addr 172.21.15.52:0/3256919773 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46affd640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c074620 0x7fb46c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46a7fc640 1 -- 172.21.15.52:0/3256919773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c074620 msgr2=0x7fb46c19f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46a7fc640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c074620 0x7fb46c19f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46a7fc640 1 -- 172.21.15.52:0/3256919773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c199a00 con 0x7fb46c074f40 2024-09-06T14:51:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.608+0000 7fb46a7fc640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074f40 0x7fb46c19fd80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb46000d6f0 tx=0x7fb46000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.609+0000 7fb453fff640 1 -- 172.21.15.52:0/3256919773 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb460017070 con 0x7fb46c074f40 2024-09-06T14:51:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.609+0000 7fb453fff640 1 -- 172.21.15.52:0/3256919773 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb46000de00 con 0x7fb46c074f40 2024-09-06T14:51:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.609+0000 7fb4714b2640 1 -- 172.21.15.52:0/3256919773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c199cf0 con 0x7fb46c074f40 2024-09-06T14:51:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.609+0000 7fb453fff640 1 -- 172.21.15.52:0/3256919773 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb460004bb0 con 0x7fb46c074f40 2024-09-06T14:51:24.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.609+0000 7fb4714b2640 1 -- 172.21.15.52:0/3256919773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c19a280 con 0x7fb46c074f40 2024-09-06T14:51:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.610+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46c075cd0 con 0x7fb46c074f40 2024-09-06T14:51:24.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.611+0000 7fb453fff640 1 -- 172.21.15.52:0/3256919773 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb460004e60 con 0x7fb46c074f40 2024-09-06T14:51:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.611+0000 7fb453fff640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.611+0000 7fb453fff640 1 -- 172.21.15.52:0/3256919773 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6317+0+0 (secure 0 0 0) 0x7fb4600992e0 con 0x7fb46c074f40 2024-09-06T14:51:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.611+0000 7fb46affd640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.612+0000 7fb46affd640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009430 tx=0x7fb45c03a040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.616+0000 7fb453fff640 1 -- 172.21.15.52:0/3256919773 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb460066460 con 0x7fb46c074f40 2024-09-06T14:51:24.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.839+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb46c074a00 con 0x7fb46c074f40 2024-09-06T14:51:24.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.839+0000 7fb453fff640 1 -- 172.21.15.52:0/3256919773 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fb46006ae80 con 0x7fb46c074f40 2024-09-06T14:51:24.836 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:51:24.836 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 3, 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 3 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:24.837 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:51:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 7, 2024-09-06T14:51:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 7 2024-09-06T14:51:24.838 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:51:24.838 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.841+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 msgr2=0x7fb454079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.841+0000 7fb451ffb640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009430 tx=0x7fb45c03a040 comp rx=0 tx=0).stop 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.841+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074f40 msgr2=0x7fb46c19fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.841+0000 7fb451ffb640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074f40 0x7fb46c19fd80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb46000d6f0 tx=0x7fb46000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.842+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 shutdown_connections 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.842+0000 7fb451ffb640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c074f40 0x7fb46c19fd80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.842+0000 7fb451ffb640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.842+0000 7fb451ffb640 1 --2- 172.21.15.52:0/3256919773 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c074620 0x7fb46c19f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.842+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 >> 172.21.15.52:0/3256919773 conn(0x7fb46c0fd600 msgr2=0x7fb46c10b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.842+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 shutdown_connections 2024-09-06T14:51:24.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.842+0000 7fb451ffb640 1 -- 172.21.15.52:0/3256919773 wait complete. 2024-09-06T14:51:24.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.924+0000 7fa8936d4640 1 -- 172.21.15.52:0/3491194476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c102b70 msgr2=0x7fa88c102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.924+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3491194476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c102b70 0x7fa88c102f50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa888009880 tx=0x7fa88802a530 comp rx=0 tx=0).stop 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 -- 172.21.15.52:0/3491194476 shutdown_connections 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3491194476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa88c103490 0x7fa88c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3491194476 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c102b70 0x7fa88c102f50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 -- 172.21.15.52:0/3491194476 >> 172.21.15.52:0/3491194476 conn(0x7fa88c0fc550 msgr2=0x7fa88c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 -- 172.21.15.52:0/3491194476 shutdown_connections 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 -- 172.21.15.52:0/3491194476 wait complete. 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 Processor -- start 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 -- start start 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa88c102b70 0x7fa88c19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c103490 0x7fa88c19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c10ee40 con 0x7fa88c103490 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.925+0000 7fa8936d4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c10ecc0 con 0x7fa88c102b70 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa890c6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c103490 0x7fa88c19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa890c6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c103490 0x7fa88c19dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52412/0 (socket says 172.21.15.52:52412) 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa890c6f640 1 -- 172.21.15.52:0/3327354906 learned_addr learned my addr 172.21.15.52:0/3327354906 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa891470640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa88c102b70 0x7fa88c19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa890c6f640 1 -- 172.21.15.52:0/3327354906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa88c102b70 msgr2=0x7fa88c19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa890c6f640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa88c102b70 0x7fa88c19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa890c6f640 1 -- 172.21.15.52:0/3327354906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88c1978d0 con 0x7fa88c103490 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa890c6f640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c103490 0x7fa88c19dc50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00b420 tx=0x7fa87c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa8827fc640 1 -- 172.21.15.52:0/3327354906 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa87c011630 con 0x7fa88c103490 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa8827fc640 1 -- 172.21.15.52:0/3327354906 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa87c016070 con 0x7fa88c103490 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa8827fc640 1 -- 172.21.15.52:0/3327354906 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa87c010d40 con 0x7fa88c103490 2024-09-06T14:51:24.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88c197bc0 con 0x7fa88c103490 2024-09-06T14:51:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.926+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa88c198150 con 0x7fa88c103490 2024-09-06T14:51:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.927+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa88c06a4c0 con 0x7fa88c103490 2024-09-06T14:51:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.928+0000 7fa8827fc640 1 -- 172.21.15.52:0/3327354906 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa87c01b460 con 0x7fa88c103490 2024-09-06T14:51:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.928+0000 7fa8827fc640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa878077460 0x7fa878079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.928+0000 7fa8827fc640 1 -- 172.21.15.52:0/3327354906 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6317+0+0 (secure 0 0 0) 0x7fa87c098ec0 con 0x7fa88c103490 2024-09-06T14:51:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.929+0000 7fa891470640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa878077460 0x7fa878079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:24.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.929+0000 7fa891470640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa878077460 0x7fa878079920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa888000c00 tx=0x7fa888004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:24.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:24.932+0000 7fa8827fc640 1 -- 172.21.15.52:0/3327354906 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa87c061e30 con 0x7fa88c103490 2024-09-06T14:51:25.009 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:24 smithi165 systemd[1]: Stopping Ceph osd.3 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:51:25.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.119+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa88c104fc0 con 0x7fa88c103490 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.120+0000 7fa8827fc640 1 -- 172.21.15.52:0/3327354906 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7fa87c065fa0 con 0x7fa88c103490 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:51:25.117 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:51:25.118 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:51:25.119 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:51:25.120 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa878077460 msgr2=0x7fa878079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa878077460 0x7fa878079920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa888000c00 tx=0x7fa888004f30 comp rx=0 tx=0).stop 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c103490 msgr2=0x7fa88c19dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c103490 0x7fa88c19dc50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00b420 tx=0x7fa87c00b8e0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 shutdown_connections 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa88c103490 0x7fa88c19dc50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa878077460 0x7fa878079920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 --2- 172.21.15.52:0/3327354906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa88c102b70 0x7fa88c19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 >> 172.21.15.52:0/3327354906 conn(0x7fa88c0fc550 msgr2=0x7fa88c107e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 shutdown_connections 2024-09-06T14:51:25.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.122+0000 7fa8936d4640 1 -- 172.21.15.52:0/3327354906 wait complete. 2024-09-06T14:51:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 -- 172.21.15.52:0/645227952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41067f0 msgr2=0x7f19d4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/645227952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41067f0 0x7f19d4106bd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009880 tx=0x7f19d002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 -- 172.21.15.52:0/645227952 shutdown_connections 2024-09-06T14:51:25.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/645227952 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d41007f0 0x7f19d4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/645227952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41067f0 0x7f19d4106bd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 -- 172.21.15.52:0/645227952 >> 172.21.15.52:0/645227952 conn(0x7f19d40fc550 msgr2=0x7f19d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:25.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:25 smithi052 ceph-mon[112917]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:25.204 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:25 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3256919773' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:25.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 -- 172.21.15.52:0/645227952 shutdown_connections 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.206+0000 7f19dbbd5640 1 -- 172.21.15.52:0/645227952 wait complete. 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19dbbd5640 1 Processor -- start 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19dbbd5640 1 -- start start 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19dbbd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41007f0 0x7f19d419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19dbbd5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d41067f0 0x7f19d419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19dbbd5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19d410dcc0 con 0x7f19d41007f0 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19dbbd5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f19d410db40 con 0x7f19d41067f0 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19d9971640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41007f0 0x7f19d419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:25.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19d9971640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41007f0 0x7f19d419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52430/0 (socket says 172.21.15.52:52430) 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19d9971640 1 -- 172.21.15.52:0/2204541222 learned_addr learned my addr 172.21.15.52:0/2204541222 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.207+0000 7f19d9170640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d41067f0 0x7f19d419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19d9971640 1 -- 172.21.15.52:0/2204541222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d41067f0 msgr2=0x7f19d419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19d9971640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d41067f0 0x7f19d419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19d9971640 1 -- 172.21.15.52:0/2204541222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d41966d0 con 0x7f19d41007f0 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19d9971640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41007f0 0x7f19d419c600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19d0031460 tx=0x7f19d00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19caffd640 1 -- 172.21.15.52:0/2204541222 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19d0035070 con 0x7f19d41007f0 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19caffd640 1 -- 172.21.15.52:0/2204541222 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19d0004a90 con 0x7f19d41007f0 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19caffd640 1 -- 172.21.15.52:0/2204541222 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19d0031810 con 0x7f19d41007f0 2024-09-06T14:51:25.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d4196960 con 0x7f19d41007f0 2024-09-06T14:51:25.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.208+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d4196e60 con 0x7f19d41007f0 2024-09-06T14:51:25.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.210+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d4101f30 con 0x7f19d41007f0 2024-09-06T14:51:25.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.211+0000 7f19caffd640 1 -- 172.21.15.52:0/2204541222 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f19d0031ac0 con 0x7f19d41007f0 2024-09-06T14:51:25.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.211+0000 7f19caffd640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f19c00774b0 0x7f19c0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:25.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.212+0000 7f19caffd640 1 -- 172.21.15.52:0/2204541222 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6317+0+0 (secure 0 0 0) 0x7f19d003e070 con 0x7f19d41007f0 2024-09-06T14:51:25.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.212+0000 7f19d9170640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f19c00774b0 0x7f19c0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:25.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.212+0000 7f19d9170640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f19c00774b0 0x7f19c0079970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f19d4197f20 tx=0x7f19c400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:25.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.216+0000 7f19caffd640 1 -- 172.21.15.52:0/2204541222 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f19d0084bc0 con 0x7f19d41007f0 2024-09-06T14:51:25.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:25 smithi165 ceph-mon[82925]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:25.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:25 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3256919773' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:25.322 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:25 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[42111]: 2024-09-06T14:51:25.179+0000 7fe336b09640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:51:25.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:25 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[42111]: 2024-09-06T14:51:25.179+0000 7fe336b09640 -1 osd.3 72 *** Got signal Terminated *** 2024-09-06T14:51:25.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:25 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[42111]: 2024-09-06T14:51:25.179+0000 7fe336b09640 -1 osd.3 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T14:51:25.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.395+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f19d41971d0 con 0x7f19c00774b0 2024-09-06T14:51:25.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.396+0000 7f19caffd640 1 -- 172.21.15.52:0/2204541222 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f19d41971d0 con 0x7f19c00774b0 2024-09-06T14:51:25.393 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:51:25.393 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:51:25.393 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:51:25.393 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "9/23 daemons upgraded", 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading osd daemons", 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:51:25.394 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:51:25.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.398+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f19c00774b0 msgr2=0x7f19c0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.398+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f19c00774b0 0x7f19c0079970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f19d4197f20 tx=0x7f19c400b390 comp rx=0 tx=0).stop 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41007f0 msgr2=0x7f19d419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41007f0 0x7f19d419c600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19d0031460 tx=0x7f19d00045e0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 shutdown_connections 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f19c00774b0 0x7f19c0079970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f19d41067f0 0x7f19d419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 --2- 172.21.15.52:0/2204541222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f19d41007f0 0x7f19d419c600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 >> 172.21.15.52:0/2204541222 conn(0x7f19d40fc550 msgr2=0x7f19d40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 shutdown_connections 2024-09-06T14:51:25.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.399+0000 7f19dbbd5640 1 -- 172.21.15.52:0/2204541222 wait complete. 2024-09-06T14:51:25.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 -- 172.21.15.52:0/651444842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 msgr2=0x7f641c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 --2- 172.21.15.52:0/651444842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c106be0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f640c009880 tx=0x7f640c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 -- 172.21.15.52:0/651444842 shutdown_connections 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 --2- 172.21.15.52:0/651444842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f641c100800 0x7f641c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 --2- 172.21.15.52:0/651444842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c106be0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 -- 172.21.15.52:0/651444842 >> 172.21.15.52:0/651444842 conn(0x7f641c0fc520 msgr2=0x7f641c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 -- 172.21.15.52:0/651444842 shutdown_connections 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.481+0000 7f64225c7640 1 -- 172.21.15.52:0/651444842 wait complete. 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f64225c7640 1 Processor -- start 2024-09-06T14:51:25.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f64225c7640 1 -- start start 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f64225c7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f641c100800 0x7f641c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f64225c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f64225c7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f641c10dcd0 con 0x7f641c106800 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f64225c7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f641c10db50 con 0x7f641c100800 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f641b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f641b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52450/0 (socket says 172.21.15.52:52450) 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f641b7fe640 1 -- 172.21.15.52:0/3145819920 learned_addr learned my addr 172.21.15.52:0/3145819920 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.482+0000 7f641bfff640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f641c100800 0x7f641c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:25.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f641b7fe640 1 -- 172.21.15.52:0/3145819920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f641c100800 msgr2=0x7f641c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f641b7fe640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f641c100800 0x7f641c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f641b7fe640 1 -- 172.21.15.52:0/3145819920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c1999e0 con 0x7f641c106800 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f641b7fe640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c19fd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f641000d6f0 tx=0x7f641000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f64197fa640 1 -- 172.21.15.52:0/3145819920 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6410017070 con 0x7f641c106800 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c199cd0 con 0x7f641c106800 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f64197fa640 1 -- 172.21.15.52:0/3145819920 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f641000de00 con 0x7f641c106800 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f64197fa640 1 -- 172.21.15.52:0/3145819920 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6410004bb0 con 0x7f641c106800 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.483+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c19a260 con 0x7f641c106800 2024-09-06T14:51:25.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.484+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641c101f40 con 0x7f641c106800 2024-09-06T14:51:25.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.485+0000 7f64197fa640 1 -- 172.21.15.52:0/3145819920 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6410004e60 con 0x7f641c106800 2024-09-06T14:51:25.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.485+0000 7f64197fa640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6404077460 0x7f6404079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:25.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.485+0000 7f64197fa640 1 -- 172.21.15.52:0/3145819920 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6317+0+0 (secure 0 0 0) 0x7f64100992e0 con 0x7f641c106800 2024-09-06T14:51:25.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.485+0000 7f641bfff640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6404077460 0x7f6404079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:25.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.486+0000 7f641bfff640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6404077460 0x7f6404079920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f640c000c00 tx=0x7f640c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:25.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.489+0000 7f64197fa640 1 -- 172.21.15.52:0/3145819920 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6410066460 con 0x7f641c106800 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.709+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f641c19af40 con 0x7f641c106800 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.709+0000 7f64197fa640 1 -- 172.21.15.52:0/3145819920 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+981 (secure 0 0 0) 0x7f641006ae80 con 0x7f641c106800 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:51:25.706 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:51:25.707 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:51:25.707 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:51:25.707 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:51:25.707 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:51:25.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6404077460 msgr2=0x7f6404079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6404077460 0x7f6404079920 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f640c000c00 tx=0x7f640c031400 comp rx=0 tx=0).stop 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 msgr2=0x7f641c19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c19fd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f641000d6f0 tx=0x7f641000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 shutdown_connections 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f641c106800 0x7f641c19fd60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6404077460 0x7f6404079920 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 --2- 172.21.15.52:0/3145819920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f641c100800 0x7f641c19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 >> 172.21.15.52:0/3145819920 conn(0x7f641c0fc520 msgr2=0x7f641c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 shutdown_connections 2024-09-06T14:51:25.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:25.711+0000 7f64225c7640 1 -- 172.21.15.52:0/3145819920 wait complete. 2024-09-06T14:51:26.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:26 smithi165 ceph-mon[82925]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 7 op/s 2024-09-06T14:51:26.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:26 smithi165 ceph-mon[82925]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:26.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:26 smithi165 ceph-mon[82925]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:26.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:26 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3327354906' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:51:26.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:26 smithi165 ceph-mon[82925]: osd.3 marked itself down and dead 2024-09-06T14:51:26.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:26 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3145819920' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:51:26.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:26 smithi052 ceph-mon[112917]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 7 op/s 2024-09-06T14:51:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:26 smithi052 ceph-mon[112917]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:26 smithi052 ceph-mon[112917]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:26 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3327354906' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:51:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:26 smithi052 ceph-mon[112917]: osd.3 marked itself down and dead 2024-09-06T14:51:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:26 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3145819920' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:51:26.910 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:26 smithi165 podman[90956]: 2024-09-06 14:51:26.615155798 +0000 UTC m=+1.552971541 container died e2a333e62407ca3d53b7581087866f326b819cbf205de81401d2c3f5e236180b (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-635ed4c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-06T14:51:27.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:27 smithi165 ceph-mon[82925]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:27.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:27 smithi165 ceph-mon[82925]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:51:27.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:27 smithi165 ceph-mon[82925]: osdmap e73: 6 total, 5 up, 6 in 2024-09-06T14:51:27.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:27 smithi165 podman[90956]: 2024-09-06 14:51:27.104486984 +0000 UTC m=+2.042302726 container cleanup e2a333e62407ca3d53b7581087866f326b819cbf205de81401d2c3f5e236180b (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-635ed4c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-06T14:51:27.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:27 smithi165 bash[90956]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3 2024-09-06T14:51:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:27 smithi052 ceph-mon[112917]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:27 smithi052 ceph-mon[112917]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:51:27.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:27 smithi052 ceph-mon[112917]: osdmap e73: 6 total, 5 up, 6 in 2024-09-06T14:51:27.678 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:27 smithi165 podman[90981]: 2024-09-06 14:51:27.372787411 +0000 UTC m=+0.754424500 container remove e2a333e62407ca3d53b7581087866f326b819cbf205de81401d2c3f5e236180b (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, RELEASE=squid-635ed4c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-06T14:51:27.939 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:27 smithi165 podman[91070]: 2024-09-06 14:51:27.5850959 +0000 UTC m=+0.015612916 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:51:27.939 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:27 smithi165 podman[91070]: 2024-09-06 14:51:27.703080904 +0000 UTC m=+0.133597925 container create 12cc81b03dedd640b57fb0f8b839c5e1d91eeb4c1e8a487494faae8f24f3eafd (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T14:51:27.939 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:27 smithi165 podman[91070]: 2024-09-06 14:51:27.943323285 +0000 UTC m=+0.373840301 container init 12cc81b03dedd640b57fb0f8b839c5e1d91eeb4c1e8a487494faae8f24f3eafd (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-06T14:51:28.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:28 smithi165 ceph-mon[82925]: pgmap v198: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s 2024-09-06T14:51:28.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:28 smithi165 ceph-mon[82925]: osdmap e74: 6 total, 5 up, 6 in 2024-09-06T14:51:28.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:27 smithi165 podman[91070]: 2024-09-06 14:51:27.946609801 +0000 UTC m=+0.377126827 container start 12cc81b03dedd640b57fb0f8b839c5e1d91eeb4c1e8a487494faae8f24f3eafd (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-06T14:51:28.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:28 smithi165 podman[91070]: 2024-09-06 14:51:28.026411083 +0000 UTC m=+0.456928117 container attach 12cc81b03dedd640b57fb0f8b839c5e1d91eeb4c1e8a487494faae8f24f3eafd (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-06T14:51:28.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:28 smithi165 podman[91070]: 2024-09-06 14:51:28.13514411 +0000 UTC m=+0.565661127 container died 12cc81b03dedd640b57fb0f8b839c5e1d91eeb4c1e8a487494faae8f24f3eafd (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-06T14:51:28.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:28 smithi052 ceph-mon[112917]: pgmap v198: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s 2024-09-06T14:51:28.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:28 smithi052 ceph-mon[112917]: osdmap e74: 6 total, 5 up, 6 in 2024-09-06T14:51:29.068 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:28 smithi165 podman[91094]: 2024-09-06 14:51:28.790176387 +0000 UTC m=+0.644492371 container remove 12cc81b03dedd640b57fb0f8b839c5e1d91eeb4c1e8a487494faae8f24f3eafd (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-06T14:51:29.068 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:28 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-06T14:51:29.068 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:28 smithi165 systemd[1]: Stopped Ceph osd.3 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:51:29.068 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:28 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.3.service: Consumed 1min 4.349s CPU time. 2024-09-06T14:51:29.068 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 systemd[1]: Starting Ceph osd.3 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:51:29.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:29 smithi165 ceph-mon[82925]: Health check failed: Degraded data redundancy: 41/339 objects degraded (12.094%), 10 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:29.322 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 podman[91194]: 2024-09-06 14:51:29.127854376 +0000 UTC m=+0.016261489 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:51:29.323 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 podman[91194]: 2024-09-06 14:51:29.231531875 +0000 UTC m=+0.119939031 container create 93c30aebdbcb678f00161001edf3f14af773f8a001ab61591ec1cfcfc3bfa47c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-06T14:51:29.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:29 smithi052 ceph-mon[112917]: Health check failed: Degraded data redundancy: 41/339 objects degraded (12.094%), 10 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:29.663 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 podman[91194]: 2024-09-06 14:51:29.534527947 +0000 UTC m=+0.422935057 container init 93c30aebdbcb678f00161001edf3f14af773f8a001ab61591ec1cfcfc3bfa47c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-06T14:51:29.663 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 podman[91194]: 2024-09-06 14:51:29.538964861 +0000 UTC m=+0.427371973 container start 93c30aebdbcb678f00161001edf3f14af773f8a001ab61591ec1cfcfc3bfa47c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-06T14:51:29.663 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 podman[91194]: 2024-09-06 14:51:29.617764471 +0000 UTC m=+0.506171584 container attach 93c30aebdbcb678f00161001edf3f14af773f8a001ab61591ec1cfcfc3bfa47c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:51:30.066 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-mon[82925]: pgmap v200: 65 pgs: 15 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/339 objects degraded (12.094%) 2024-09-06T14:51:30.066 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:51:30.067 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 bash[91194]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:51:30.067 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:51:30.067 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:29 smithi165 bash[91194]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:51:30.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:30 smithi052 ceph-mon[112917]: pgmap v200: 65 pgs: 15 active+undersized, 2 stale+active+clean, 10 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 41/339 objects degraded (12.094%) 2024-09-06T14:51:30.677 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-06T14:51:30.677 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 bash[91194]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-06T14:51:30.677 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-06T14:51:30.677 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 bash[91194]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-06T14:51:31.000 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-06T14:51:31.000 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 bash[91194]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-06T14:51:31.000 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-06T14:51:31.000 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 bash[91194]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-06T14:51:31.000 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-06T14:51:31.001 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 bash[91194]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-06T14:51:31.001 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-06T14:51:31.001 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 bash[91194]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-06T14:51:31.001 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate[91208]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-06T14:51:31.001 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 bash[91194]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-06T14:51:31.001 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:30 smithi165 podman[91194]: 2024-09-06 14:51:30.709943847 +0000 UTC m=+1.598350958 container died 93c30aebdbcb678f00161001edf3f14af773f8a001ab61591ec1cfcfc3bfa47c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T14:51:31.526 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:31 smithi165 podman[91340]: 2024-09-06 14:51:31.321558484 +0000 UTC m=+0.601298147 container remove 93c30aebdbcb678f00161001edf3f14af773f8a001ab61591ec1cfcfc3bfa47c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:51:31.788 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:31 smithi165 podman[91396]: 2024-09-06 14:51:31.432818838 +0000 UTC m=+0.016026383 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:51:31.788 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:31 smithi165 podman[91396]: 2024-09-06 14:51:31.564432686 +0000 UTC m=+0.147640220 container create cc36f08fa3aec44c37b8578eaf2c5131a73bb29f02c8f696b0aaaead76c2d730 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T14:51:31.788 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:31 smithi165 podman[91396]: 2024-09-06 14:51:31.766605871 +0000 UTC m=+0.349813406 container init cc36f08fa3aec44c37b8578eaf2c5131a73bb29f02c8f696b0aaaead76c2d730 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-06T14:51:31.789 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:31 smithi165 podman[91396]: 2024-09-06 14:51:31.770446095 +0000 UTC m=+0.353653631 container start cc36f08fa3aec44c37b8578eaf2c5131a73bb29f02c8f696b0aaaead76c2d730 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-06T14:51:32.069 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:31 smithi165 ceph-osd[91415]: -- 172.21.15.165:0/4236414238 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5620000021e0 con 0x561fff1a3c00 2024-09-06T14:51:32.069 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:32 smithi165 bash[91396]: cc36f08fa3aec44c37b8578eaf2c5131a73bb29f02c8f696b0aaaead76c2d730 2024-09-06T14:51:32.069 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:32 smithi165 systemd[1]: Started Ceph osd.3 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:51:32.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:32 smithi165 ceph-mon[82925]: pgmap v201: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:32.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:32 smithi052 ceph-mon[112917]: pgmap v201: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:33.170 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:33 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:33.171 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:33 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:33.171 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:33 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:51:33.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:33 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:33.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:33 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:33.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:33 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:51:33.531 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:33 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[91411]: 2024-09-06T14:51:33.172+0000 7f7c7eb35640 -1 Falling back to public interface 2024-09-06T14:51:34.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:34 smithi052 ceph-mon[112917]: pgmap v202: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:34.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:34 smithi165 ceph-mon[82925]: pgmap v202: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:35.915 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:35 smithi165 ceph-mon[82925]: pgmap v203: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:35.915 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:35.915 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:35.915 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:35 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 61/339 objects degraded (17.994%), 16 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:35.915 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:35.915 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:35 smithi052 ceph-mon[112917]: pgmap v203: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:35 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 61/339 objects degraded (17.994%), 16 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:36.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:38.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:37 smithi052 ceph-mon[112917]: pgmap v204: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:38.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:38.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:38.212 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:37 smithi165 ceph-mon[82925]: pgmap v204: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:38.212 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:38.212 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:39.322 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:38 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[91411]: 2024-09-06T14:51:38.913+0000 7f7c7eb35640 -1 osd.3 72 log_to_monitors true 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: pgmap v205: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='osd.3 [v2:172.21.15.165:6800/2551967157,v1:172.21.15.165:6801/2551967157]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:51:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-06T14:51:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-06T14:51:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:39 smithi052 ceph-mon[112917]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-06T14:51:40.322 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[91411]: 2024-09-06T14:51:39.892+0000 7f7c768df640 -1 osd.3 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: pgmap v205: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 61/339 objects degraded (17.994%) 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='osd.3 [v2:172.21.15.165:6800/2551967157,v1:172.21.15.165:6801/2551967157]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:40.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:40.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:40.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-06T14:51:40.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-06T14:51:40.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:39 smithi165 ceph-mon[82925]: Upgrade: unsafe to stop osd(s) at this time (14 PGs are or would become offline) 2024-09-06T14:51:41.298 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:40 smithi052 ceph-mon[112917]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T14:51:41.298 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:40 smithi052 ceph-mon[112917]: from='osd.3 [v2:172.21.15.165:6800/2551967157,v1:172.21.15.165:6801/2551967157]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:51:41.298 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:40 smithi052 ceph-mon[112917]: osdmap e75: 6 total, 5 up, 6 in 2024-09-06T14:51:41.298 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:40 smithi052 ceph-mon[112917]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:51:41.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:40 smithi165 ceph-mon[82925]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-06T14:51:41.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:40 smithi165 ceph-mon[82925]: from='osd.3 [v2:172.21.15.165:6800/2551967157,v1:172.21.15.165:6801/2551967157]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:51:41.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:40 smithi165 ceph-mon[82925]: osdmap e75: 6 total, 5 up, 6 in 2024-09-06T14:51:41.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:40 smithi165 ceph-mon[82925]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:51:42.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:41 smithi165 ceph-mon[82925]: pgmap v207: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s; 61/339 objects degraded (17.994%) 2024-09-06T14:51:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:41 smithi165 ceph-mon[82925]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:51:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:41 smithi165 ceph-mon[82925]: osd.3 [v2:172.21.15.165:6800/2551967157,v1:172.21.15.165:6801/2551967157] boot 2024-09-06T14:51:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:41 smithi165 ceph-mon[82925]: osdmap e76: 6 total, 6 up, 6 in 2024-09-06T14:51:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:41 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T14:51:42.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:41 smithi165 ceph-mon[82925]: osdmap e77: 6 total, 6 up, 6 in 2024-09-06T14:51:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:41 smithi052 ceph-mon[112917]: pgmap v207: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s; 61/339 objects degraded (17.994%) 2024-09-06T14:51:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:41 smithi052 ceph-mon[112917]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:51:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:41 smithi052 ceph-mon[112917]: osd.3 [v2:172.21.15.165:6800/2551967157,v1:172.21.15.165:6801/2551967157] boot 2024-09-06T14:51:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:41 smithi052 ceph-mon[112917]: osdmap e76: 6 total, 6 up, 6 in 2024-09-06T14:51:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:41 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-06T14:51:42.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:41 smithi052 ceph-mon[112917]: osdmap e77: 6 total, 6 up, 6 in 2024-09-06T14:51:44.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:43 smithi165 ceph-mon[82925]: pgmap v210: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 61/339 objects degraded (17.994%) 2024-09-06T14:51:44.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:43 smithi052 ceph-mon[112917]: pgmap v210: 65 pgs: 17 active+undersized, 16 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 61/339 objects degraded (17.994%) 2024-09-06T14:51:45.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:44 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 33/339 objects degraded (9.735%), 8 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:45.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:44 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 33/339 objects degraded (9.735%), 8 pgs degraded (PG_DEGRADED) 2024-09-06T14:51:46.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:45 smithi052 ceph-mon[112917]: pgmap v211: 65 pgs: 5 active+undersized, 8 active+undersized+degraded, 52 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 4 op/s; 33/339 objects degraded (9.735%) 2024-09-06T14:51:46.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:45 smithi165 ceph-mon[82925]: pgmap v211: 65 pgs: 5 active+undersized, 8 active+undersized+degraded, 52 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 4 op/s; 33/339 objects degraded (9.735%) 2024-09-06T14:51:47.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:46 smithi165 ceph-mon[82925]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/339 objects degraded (9.735%), 8 pgs degraded) 2024-09-06T14:51:47.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:46 smithi052 ceph-mon[112917]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/339 objects degraded (9.735%), 8 pgs degraded) 2024-09-06T14:51:48.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:47 smithi165 ceph-mon[82925]: pgmap v212: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:51:48.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:47 smithi052 ceph-mon[112917]: pgmap v212: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:51:50.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:49 smithi165 ceph-mon[82925]: pgmap v213: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-06T14:51:50.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:49 smithi052 ceph-mon[112917]: pgmap v213: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 4 op/s 2024-09-06T14:51:52.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:52 smithi165 ceph-mon[82925]: pgmap v214: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 6 op/s 2024-09-06T14:51:52.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:52 smithi052 ceph-mon[112917]: pgmap v214: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 6 op/s 2024-09-06T14:51:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:53 smithi052 ceph-mon[112917]: pgmap v215: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 5 op/s 2024-09-06T14:51:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:54.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:53 smithi165 ceph-mon[82925]: pgmap v215: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 5 op/s 2024-09-06T14:51:54.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:54.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:51:54.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:54.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:54 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-06T14:51:54.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:54 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-06T14:51:54.725 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:54 smithi165 ceph-mon[82925]: Upgrade: osd.4 is safe to restart 2024-09-06T14:51:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:54 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-06T14:51:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:54 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-06T14:51:54.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:54 smithi052 ceph-mon[112917]: Upgrade: osd.4 is safe to restart 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 -- 172.21.15.52:0/1773843936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 msgr2=0x7f85d0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 --2- 172.21.15.52:0/1773843936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 0x7f85d0101d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009880 tx=0x7f85c002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 -- 172.21.15.52:0/1773843936 shutdown_connections 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 --2- 172.21.15.52:0/1773843936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 0x7f85d0101d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 --2- 172.21.15.52:0/1773843936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85d0107900 0x7f85d0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 -- 172.21.15.52:0/1773843936 >> 172.21.15.52:0/1773843936 conn(0x7f85d00fd600 msgr2=0x7f85d00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 -- 172.21.15.52:0/1773843936 shutdown_connections 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.807+0000 7f85d76b9640 1 -- 172.21.15.52:0/1773843936 wait complete. 2024-09-06T14:51:55.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d76b9640 1 Processor -- start 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d76b9640 1 -- start start 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d76b9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 0x7f85d019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d76b9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85d0107900 0x7f85d019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d76b9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010edb0 con 0x7f85d0101900 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d76b9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f85d010ec30 con 0x7f85d0107900 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d4c54640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85d0107900 0x7f85d019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d4c54640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85d0107900 0x7f85d019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.52:56600/0 (socket says 172.21.15.52:56600) 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d4c54640 1 -- 172.21.15.52:0/3212095755 learned_addr learned my addr 172.21.15.52:0/3212095755 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.808+0000 7f85d5455640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 0x7f85d019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85d5455640 1 -- 172.21.15.52:0/3212095755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85d0107900 msgr2=0x7f85d019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85d5455640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85d0107900 0x7f85d019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85d5455640 1 -- 172.21.15.52:0/3212095755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d01977d0 con 0x7f85d0101900 2024-09-06T14:51:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85d5455640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 0x7f85d019d650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc00dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85c67fc640 1 -- 172.21.15.52:0/3212095755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85cc00be30 con 0x7f85d0101900 2024-09-06T14:51:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85c67fc640 1 -- 172.21.15.52:0/3212095755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85cc004030 con 0x7f85d0101900 2024-09-06T14:51:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d0197ac0 con 0x7f85d0101900 2024-09-06T14:51:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85c67fc640 1 -- 172.21.15.52:0/3212095755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85cc003cd0 con 0x7f85d0101900 2024-09-06T14:51:55.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.809+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d0198020 con 0x7f85d0101900 2024-09-06T14:51:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.810+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d0103040 con 0x7f85d0101900 2024-09-06T14:51:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.811+0000 7f85c67fc640 1 -- 172.21.15.52:0/3212095755 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f85cc0041e0 con 0x7f85d0101900 2024-09-06T14:51:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.811+0000 7f85c67fc640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f85bc077460 0x7f85bc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.811+0000 7f85c67fc640 1 -- 172.21.15.52:0/3212095755 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6317+0+0 (secure 0 0 0) 0x7f85cc099020 con 0x7f85d0101900 2024-09-06T14:51:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.811+0000 7f85d4c54640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f85bc077460 0x7f85bc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:55.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.812+0000 7f85d4c54640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f85bc077460 0x7f85bc079920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85d0198b20 tx=0x7f85c00058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:55.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.816+0000 7f85c67fc640 1 -- 172.21.15.52:0/3212095755 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f85cc017020 con 0x7f85d0101900 2024-09-06T14:51:55.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:55 smithi165 ceph-mon[82925]: pgmap v216: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 6 op/s 2024-09-06T14:51:55.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:55.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T14:51:55.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:55 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:55.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:55 smithi052 ceph-mon[112917]: pgmap v216: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 6 op/s 2024-09-06T14:51:55.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:51:55.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-06T14:51:55.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:55 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:51:55.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.996+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f85d01982d0 con 0x7f85bc077460 2024-09-06T14:51:55.993 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.997+0000 7f85c67fc640 1 -- 172.21.15.52:0/3212095755 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f85d01982d0 con 0x7f85bc077460 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f85bc077460 msgr2=0x7f85bc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f85bc077460 0x7f85bc079920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85d0198b20 tx=0x7f85c00058d0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 msgr2=0x7f85d019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 0x7f85d019d650 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005fd0 tx=0x7f85cc00dd60 comp rx=0 tx=0).stop 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 shutdown_connections 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f85bc077460 0x7f85bc079920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f85d0107900 0x7f85d019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.996 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 --2- 172.21.15.52:0/3212095755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f85d0101900 0x7f85d019d650 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:55.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 >> 172.21.15.52:0/3212095755 conn(0x7f85d00fd600 msgr2=0x7f85d00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:55.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 shutdown_connections 2024-09-06T14:51:55.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:55.999+0000 7f85d76b9640 1 -- 172.21.15.52:0/3212095755 wait complete. 2024-09-06T14:51:56.005 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:51:56.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.083+0000 7f889894b640 1 -- 172.21.15.52:0/2679487912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894100800 msgr2=0x7f8894100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.083+0000 7f889894b640 1 --2- 172.21.15.52:0/2679487912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894100800 0x7f8894100c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f887c009880 tx=0x7f887c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.083+0000 7f889894b640 1 -- 172.21.15.52:0/2679487912 shutdown_connections 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.083+0000 7f889894b640 1 --2- 172.21.15.52:0/2679487912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894100800 0x7f8894100c60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.083+0000 7f889894b640 1 --2- 172.21.15.52:0/2679487912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8894106800 0x7f8894106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.083+0000 7f889894b640 1 -- 172.21.15.52:0/2679487912 >> 172.21.15.52:0/2679487912 conn(0x7f88940fc520 msgr2=0x7f88940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.083+0000 7f889894b640 1 -- 172.21.15.52:0/2679487912 shutdown_connections 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.084+0000 7f889894b640 1 -- 172.21.15.52:0/2679487912 wait complete. 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.084+0000 7f889894b640 1 Processor -- start 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.084+0000 7f889894b640 1 -- start start 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.084+0000 7f889894b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8894100800 0x7f889419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.084+0000 7f889894b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894106800 0x7f889419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.084+0000 7f889894b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f889410dcd0 con 0x7f8894106800 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.084+0000 7f889894b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f889410db50 con 0x7f8894100800 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f8891d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894106800 0x7f889419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f8891d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894106800 0x7f889419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46708/0 (socket says 172.21.15.52:46708) 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f8891d9b640 1 -- 172.21.15.52:0/1043639109 learned_addr learned my addr 172.21.15.52:0/1043639109 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f889259c640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8894100800 0x7f889419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f8891d9b640 1 -- 172.21.15.52:0/1043639109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8894100800 msgr2=0x7f889419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f8891d9b640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8894100800 0x7f889419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f8891d9b640 1 -- 172.21.15.52:0/1043639109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88941977f0 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f8891d9b640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894106800 0x7f889419dbb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f887c031460 tx=0x7f887c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f888b7fe640 1 -- 172.21.15.52:0/1043639109 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f887c03f070 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f888b7fe640 1 -- 172.21.15.52:0/1043639109 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f887c0035f0 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8894197a80 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f888b7fe640 1 -- 172.21.15.52:0/1043639109 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f887c035030 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.085+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8894197fb0 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.086+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8894101f40 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.087+0000 7f888b7fe640 1 -- 172.21.15.52:0/1043639109 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f887c042070 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.088+0000 7f888b7fe640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8880077460 0x7f8880079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.088+0000 7f888b7fe640 1 -- 172.21.15.52:0/1043639109 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6317+0+0 (secure 0 0 0) 0x7f887c0ba010 con 0x7f8894106800 2024-09-06T14:51:56.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.088+0000 7f889259c640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8880077460 0x7f8880079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.088+0000 7f889259c640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8880077460 0x7f8880079920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8884005fd0 tx=0x7f8884009680 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.092+0000 7f888b7fe640 1 -- 172.21.15.52:0/1043639109 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f887c087190 con 0x7f8894106800 2024-09-06T14:51:56.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.270+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8894198260 con 0x7f8880077460 2024-09-06T14:51:56.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.272+0000 7f888b7fe640 1 -- 172.21.15.52:0/1043639109 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f8894198260 con 0x7f8880077460 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.273+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8880077460 msgr2=0x7f8880079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8880077460 0x7f8880079920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8884005fd0 tx=0x7f8884009680 comp rx=0 tx=0).stop 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894106800 msgr2=0x7f889419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894106800 0x7f889419dbb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f887c031460 tx=0x7f887c0045e0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 shutdown_connections 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8894106800 0x7f889419dbb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8880077460 0x7f8880079920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 --2- 172.21.15.52:0/1043639109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8894100800 0x7f889419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 >> 172.21.15.52:0/1043639109 conn(0x7f88940fc520 msgr2=0x7f889406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 shutdown_connections 2024-09-06T14:51:56.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.274+0000 7f889894b640 1 -- 172.21.15.52:0/1043639109 wait complete. 2024-09-06T14:51:56.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 -- 172.21.15.52:0/2520272450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238107900 msgr2=0x7f1238107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2520272450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238107900 0x7f1238107ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1228009880 tx=0x7f122802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 -- 172.21.15.52:0/2520272450 shutdown_connections 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2520272450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1238101900 0x7f1238101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2520272450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238107900 0x7f1238107ce0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 -- 172.21.15.52:0/2520272450 >> 172.21.15.52:0/2520272450 conn(0x7f12380fd600 msgr2=0x7f12380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 -- 172.21.15.52:0/2520272450 shutdown_connections 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.357+0000 7f123e0b6640 1 -- 172.21.15.52:0/2520272450 wait complete. 2024-09-06T14:51:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.358+0000 7f123e0b6640 1 Processor -- start 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.358+0000 7f123e0b6640 1 -- start start 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.358+0000 7f123e0b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238101900 0x7f123819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.358+0000 7f123e0b6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1238107900 0x7f123819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.358+0000 7f123e0b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f123810edd0 con 0x7f1238101900 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.358+0000 7f123e0b6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f123810ec50 con 0x7f1238107900 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.358+0000 7f12377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238101900 0x7f123819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f12377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238101900 0x7f123819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46722/0 (socket says 172.21.15.52:46722) 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f12377fe640 1 -- 172.21.15.52:0/2245113726 learned_addr learned my addr 172.21.15.52:0/2245113726 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f1236ffd640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1238107900 0x7f123819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.357 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f12377fe640 1 -- 172.21.15.52:0/2245113726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1238107900 msgr2=0x7f123819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f12377fe640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1238107900 0x7f123819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f12377fe640 1 -- 172.21.15.52:0/2245113726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12381977a0 con 0x7f1238101900 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f12377fe640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238101900 0x7f123819d620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1228031460 tx=0x7f12280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f1234ff9640 1 -- 172.21.15.52:0/2245113726 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f122803f070 con 0x7f1238101900 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1238197a30 con 0x7f1238101900 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f1234ff9640 1 -- 172.21.15.52:0/2245113726 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12280035f0 con 0x7f1238101900 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f1234ff9640 1 -- 172.21.15.52:0/2245113726 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1228035030 con 0x7f1238101900 2024-09-06T14:51:56.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.359+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1238197f60 con 0x7f1238101900 2024-09-06T14:51:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.360+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1238103040 con 0x7f1238101900 2024-09-06T14:51:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.361+0000 7f1234ff9640 1 -- 172.21.15.52:0/2245113726 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1228042070 con 0x7f1238101900 2024-09-06T14:51:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.361+0000 7f1234ff9640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1220077460 0x7f1220079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.361+0000 7f1234ff9640 1 -- 172.21.15.52:0/2245113726 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6317+0+0 (secure 0 0 0) 0x7f12280ba060 con 0x7f1238101900 2024-09-06T14:51:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.361+0000 7f1236ffd640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1220077460 0x7f1220079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.359 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.362+0000 7f1236ffd640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1220077460 0x7f1220079920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12380ffc20 tx=0x7f122c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.365+0000 7f1234ff9640 1 -- 172.21.15.52:0/2245113726 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f12280871e0 con 0x7f1238101900 2024-09-06T14:51:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.533+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f12381982d0 con 0x7f1220077460 2024-09-06T14:51:56.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.543+0000 7f1234ff9640 1 -- 172.21.15.52:0/2245113726 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f12381982d0 con 0x7f1220077460 2024-09-06T14:51:56.539 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (4m) 55s ago 15m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (7m) 55s ago 15m 8921k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (6m) 21s ago 14m 8925k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (2m) 55s ago 15m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (2m) 21s ago 14m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (3m) 55s ago 15m 79.1M - c8b91775d855 af78eb451b94 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (10m) 55s ago 10m 88.7M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (10m) 55s ago 9m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (10m) 21s ago 10m 26.8M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (9m) 21s ago 9m 26.6M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:51:56.540 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (6m) 55s ago 16m 521M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (5m) 21s ago 14m 457M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (3m) 55s ago 16m 41.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (2m) 21s ago 14m 35.2M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (5m) 55s ago 15m 10.6M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (5m) 21s ago 14m 11.6M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (2m) 55s ago 13m 90.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (96s) 55s ago 12m 97.7M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (60s) 55s ago 12m 12.2M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (25s) 21s ago 11m 14.3M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (11m) 21s ago 11m 220M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 9e2d65f5cb49 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (11m) 21s ago 11m 194M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:51:56.541 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (4m) 55s ago 14m 58.7M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:51:56.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1220077460 msgr2=0x7f1220079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1220077460 0x7f1220079920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f12380ffc20 tx=0x7f122c00b390 comp rx=0 tx=0).stop 2024-09-06T14:51:56.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238101900 msgr2=0x7f123819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238101900 0x7f123819d620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1228031460 tx=0x7f12280045e0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.542 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 shutdown_connections 2024-09-06T14:51:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1220077460 0x7f1220079920 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1238107900 0x7f123819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 --2- 172.21.15.52:0/2245113726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1238101900 0x7f123819d620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.544+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 >> 172.21.15.52:0/2245113726 conn(0x7f12380fd600 msgr2=0x7f12380fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.545+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 shutdown_connections 2024-09-06T14:51:56.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.545+0000 7f123e0b6640 1 -- 172.21.15.52:0/2245113726 wait complete. 2024-09-06T14:51:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.627+0000 7f208a9ab640 1 -- 172.21.15.52:0/2442903969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 msgr2=0x7f2084102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.627+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2442903969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f2084102e90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2074009880 tx=0x7f207402a530 comp rx=0 tx=0).stop 2024-09-06T14:51:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.627+0000 7f208a9ab640 1 -- 172.21.15.52:0/2442903969 shutdown_connections 2024-09-06T14:51:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.627+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2442903969 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20841033d0 0x7f208410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.627+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2442903969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f2084102e90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.627+0000 7f208a9ab640 1 -- 172.21.15.52:0/2442903969 >> 172.21.15.52:0/2442903969 conn(0x7f20840fc550 msgr2=0x7f20840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.627+0000 7f208a9ab640 1 -- 172.21.15.52:0/2442903969 shutdown_connections 2024-09-06T14:51:56.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.628+0000 7f208a9ab640 1 -- 172.21.15.52:0/2442903969 wait complete. 2024-09-06T14:51:56.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.628+0000 7f208a9ab640 1 Processor -- start 2024-09-06T14:51:56.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.628+0000 7f208a9ab640 1 -- start start 2024-09-06T14:51:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f208a9ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f208419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f208a9ab640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20841033d0 0x7f208419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f208a9ab640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f208410ede0 con 0x7f2084102ab0 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f208a9ab640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f208410ec60 con 0x7f20841033d0 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f2083fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f208419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f2083fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f208419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46728/0 (socket says 172.21.15.52:46728) 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f2083fff640 1 -- 172.21.15.52:0/2311894615 learned_addr learned my addr 172.21.15.52:0/2311894615 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f20837fe640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20841033d0 0x7f208419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f20837fe640 1 -- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 msgr2=0x7f208419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f20837fe640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f208419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f20837fe640 1 -- 172.21.15.52:0/2311894615 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20841977b0 con 0x7f20841033d0 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.629+0000 7f2083fff640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f208419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.630+0000 7f20837fe640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20841033d0 0x7f208419db70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f207800e740 tx=0x7f207800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.630+0000 7f20817fa640 1 -- 172.21.15.52:0/2311894615 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f207800ee50 con 0x7f20841033d0 2024-09-06T14:51:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.630+0000 7f20817fa640 1 -- 172.21.15.52:0/2311894615 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2078004030 con 0x7f20841033d0 2024-09-06T14:51:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.630+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2084197aa0 con 0x7f20841033d0 2024-09-06T14:51:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.630+0000 7f20817fa640 1 -- 172.21.15.52:0/2311894615 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20780047a0 con 0x7f20841033d0 2024-09-06T14:51:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.630+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2084198030 con 0x7f20841033d0 2024-09-06T14:51:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.631+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208406a580 con 0x7f20841033d0 2024-09-06T14:51:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.631+0000 7f20817fa640 1 -- 172.21.15.52:0/2311894615 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f20780041e0 con 0x7f20841033d0 2024-09-06T14:51:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.632+0000 7f20817fa640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f206c077460 0x7f206c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.632+0000 7f2083fff640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f206c077460 0x7f206c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.632+0000 7f20817fa640 1 -- 172.21.15.52:0/2311894615 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6317+0+0 (secure 0 0 0) 0x7f2078099b50 con 0x7f20841033d0 2024-09-06T14:51:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.633+0000 7f2083fff640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f206c077460 0x7f206c079920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2074009230 tx=0x7f20740058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.636+0000 7f20817fa640 1 -- 172.21.15.52:0/2311894615 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f2078062ac0 con 0x7f20841033d0 2024-09-06T14:51:56.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.858+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2084198340 con 0x7f20841033d0 2024-09-06T14:51:56.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:56 smithi052 ceph-mon[112917]: Upgrade: Updating osd.4 2024-09-06T14:51:56.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:56 smithi052 ceph-mon[112917]: Deploying daemon osd.4 on smithi165 2024-09-06T14:51:56.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:56 smithi052 ceph-mon[112917]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:56.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.859+0000 7f20817fa640 1 -- 172.21.15.52:0/2311894615 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f2078066c30 con 0x7f20841033d0 2024-09-06T14:51:56.856 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 2, 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:51:56.857 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:51:56.858 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:51:56.858 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 6, 2024-09-06T14:51:56.858 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 8 2024-09-06T14:51:56.858 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:51:56.858 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:51:56.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.861+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f206c077460 msgr2=0x7f206c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.861+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f206c077460 0x7f206c079920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2074009230 tx=0x7f20740058d0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.861+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20841033d0 msgr2=0x7f208419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.861+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20841033d0 0x7f208419db70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f207800e740 tx=0x7f207800ec00 comp rx=0 tx=0).stop 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.862+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 shutdown_connections 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.862+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f206c077460 0x7f206c079920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.862+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f20841033d0 0x7f208419db70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.862+0000 7f208a9ab640 1 --2- 172.21.15.52:0/2311894615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2084102ab0 0x7f208419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.862+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 >> 172.21.15.52:0/2311894615 conn(0x7f20840fc550 msgr2=0x7f208410aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.862+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 shutdown_connections 2024-09-06T14:51:56.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.862+0000 7f208a9ab640 1 -- 172.21.15.52:0/2311894615 wait complete. 2024-09-06T14:51:56.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 -- 172.21.15.52:0/1523021815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc508100a90 msgr2=0x7fc5081065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 --2- 172.21.15.52:0/1523021815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc508100a90 0x7fc5081065d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8009880 tx=0x7fc4f802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 -- 172.21.15.52:0/1523021815 shutdown_connections 2024-09-06T14:51:56.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 --2- 172.21.15.52:0/1523021815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc508100a90 0x7fc5081065d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 --2- 172.21.15.52:0/1523021815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc5081000e0 0x7fc5081004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 -- 172.21.15.52:0/1523021815 >> 172.21.15.52:0/1523021815 conn(0x7fc5080fbc90 msgr2=0x7fc5080fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 -- 172.21.15.52:0/1523021815 shutdown_connections 2024-09-06T14:51:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.945+0000 7fc50f618640 1 -- 172.21.15.52:0/1523021815 wait complete. 2024-09-06T14:51:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50f618640 1 Processor -- start 2024-09-06T14:51:56.943 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50f618640 1 -- start start 2024-09-06T14:51:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50f618640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5081000e0 0x7fc50819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50f618640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc508100a90 0x7fc50819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.944 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50f618640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810eeb0 con 0x7fc5081000e0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50f618640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810ed30 con 0x7fc508100a90 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50d3b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5081000e0 0x7fc50819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50d3b4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5081000e0 0x7fc50819d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46746/0 (socket says 172.21.15.52:46746) 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50d3b4640 1 -- 172.21.15.52:0/2786824237 learned_addr learned my addr 172.21.15.52:0/2786824237 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50cbb3640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc508100a90 0x7fc50819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50d3b4640 1 -- 172.21.15.52:0/2786824237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc508100a90 msgr2=0x7fc50819dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50d3b4640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc508100a90 0x7fc50819dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50d3b4640 1 -- 172.21.15.52:0/2786824237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc508197900 con 0x7fc5081000e0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.946+0000 7fc50d3b4640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5081000e0 0x7fc50819d740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc50400b420 tx=0x7fc50400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.947+0000 7fc4fe7fc640 1 -- 172.21.15.52:0/2786824237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc504011630 con 0x7fc5081000e0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.947+0000 7fc4fe7fc640 1 -- 172.21.15.52:0/2786824237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc504016070 con 0x7fc5081000e0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.947+0000 7fc4fe7fc640 1 -- 172.21.15.52:0/2786824237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc504010d40 con 0x7fc5081000e0 2024-09-06T14:51:56.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.947+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc508197bf0 con 0x7fc5081000e0 2024-09-06T14:51:56.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.947+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc508198150 con 0x7fc5081000e0 2024-09-06T14:51:56.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.948+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5081031a0 con 0x7fc5081000e0 2024-09-06T14:51:56.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.949+0000 7fc4fe7fc640 1 -- 172.21.15.52:0/2786824237 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc50401b460 con 0x7fc5081000e0 2024-09-06T14:51:56.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.950+0000 7fc4fe7fc640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc4f4077460 0x7fc4f4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:56.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.950+0000 7fc4fe7fc640 1 -- 172.21.15.52:0/2786824237 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6317+0+0 (secure 0 0 0) 0x7fc504098e90 con 0x7fc5081000e0 2024-09-06T14:51:56.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.952+0000 7fc50cbb3640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc4f4077460 0x7fc4f4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:56.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.952+0000 7fc50cbb3640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc4f4077460 0x7fc4f4079920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5081990f0 tx=0x7fc4f8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:56.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:56.956+0000 7fc4fe7fc640 1 -- 172.21.15.52:0/2786824237 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc504021250 con 0x7fc5081000e0 2024-09-06T14:51:57.052 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:56 smithi165 ceph-mon[82925]: Upgrade: Updating osd.4 2024-09-06T14:51:57.053 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:56 smithi165 ceph-mon[82925]: Deploying daemon osd.4 on smithi165 2024-09-06T14:51:57.053 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:56 smithi165 ceph-mon[82925]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:57.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.139+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc508198e30 con 0x7fc5081000e0 2024-09-06T14:51:57.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.140+0000 7fc4fe7fc640 1 -- 172.21.15.52:0/2786824237 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7fc504061ea0 con 0x7fc5081000e0 2024-09-06T14:51:57.137 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:51:57.137 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:51:57.137 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:51:57.137 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:51:57.138 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:51:57.139 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:51:57.140 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:57.141 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:57.141 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:57.141 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:51:57.141 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:51:57.141 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:51:57.142 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:51:57.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc4f4077460 msgr2=0x7fc4f4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc4f4077460 0x7fc4f4079920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc5081990f0 tx=0x7fc4f8031400 comp rx=0 tx=0).stop 2024-09-06T14:51:57.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5081000e0 msgr2=0x7fc50819d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5081000e0 0x7fc50819d740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc50400b420 tx=0x7fc50400b8e0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 shutdown_connections 2024-09-06T14:51:57.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc4f4077460 0x7fc4f4079920 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc508100a90 0x7fc50819dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 --2- 172.21.15.52:0/2786824237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5081000e0 0x7fc50819d740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 >> 172.21.15.52:0/2786824237 conn(0x7fc5080fbc90 msgr2=0x7fc5080fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:57.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 shutdown_connections 2024-09-06T14:51:57.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.142+0000 7fc50f618640 1 -- 172.21.15.52:0/2786824237 wait complete. 2024-09-06T14:51:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.225+0000 7fa557717640 1 -- 172.21.15.52:0/110893923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501067f0 msgr2=0x7fa550106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.225+0000 7fa557717640 1 --2- 172.21.15.52:0/110893923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501067f0 0x7fa550106bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009880 tx=0x7fa54c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 -- 172.21.15.52:0/110893923 shutdown_connections 2024-09-06T14:51:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 --2- 172.21.15.52:0/110893923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5501007f0 0x7fa550100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 --2- 172.21.15.52:0/110893923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501067f0 0x7fa550106bd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.223 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 -- 172.21.15.52:0/110893923 >> 172.21.15.52:0/110893923 conn(0x7fa5500fc550 msgr2=0x7fa5500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:57.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 -- 172.21.15.52:0/110893923 shutdown_connections 2024-09-06T14:51:57.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 -- 172.21.15.52:0/110893923 wait complete. 2024-09-06T14:51:57.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 Processor -- start 2024-09-06T14:51:57.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.226+0000 7fa557717640 1 -- start start 2024-09-06T14:51:57.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa557717640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501007f0 0x7fa55019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:57.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa557717640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5501067f0 0x7fa55019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:57.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa557717640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa55010dca0 con 0x7fa5501007f0 2024-09-06T14:51:57.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa557717640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa55010db20 con 0x7fa5501067f0 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5554b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501007f0 0x7fa55019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5554b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501007f0 0x7fa55019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46770/0 (socket says 172.21.15.52:46770) 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5554b3640 1 -- 172.21.15.52:0/1850772249 learned_addr learned my addr 172.21.15.52:0/1850772249 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa554cb2640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5501067f0 0x7fa55019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5554b3640 1 -- 172.21.15.52:0/1850772249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5501067f0 msgr2=0x7fa55019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5554b3640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5501067f0 0x7fa55019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5554b3640 1 -- 172.21.15.52:0/1850772249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa550197750 con 0x7fa5501007f0 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5554b3640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501007f0 0x7fa55019d680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa54c031460 tx=0x7fa54c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5467fc640 1 -- 172.21.15.52:0/1850772249 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa54c03f070 con 0x7fa5501007f0 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5467fc640 1 -- 172.21.15.52:0/1850772249 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa54c004cf0 con 0x7fa5501007f0 2024-09-06T14:51:57.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5501979e0 con 0x7fa5501007f0 2024-09-06T14:51:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa5467fc640 1 -- 172.21.15.52:0/1850772249 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa54c035030 con 0x7fa5501007f0 2024-09-06T14:51:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.227+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa550197f10 con 0x7fa5501007f0 2024-09-06T14:51:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.229+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa550101f30 con 0x7fa5501007f0 2024-09-06T14:51:57.227 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.229+0000 7fa5467fc640 1 -- 172.21.15.52:0/1850772249 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa54c042070 con 0x7fa5501007f0 2024-09-06T14:51:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.229+0000 7fa5467fc640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa53c0774b0 0x7fa53c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.230+0000 7fa5467fc640 1 -- 172.21.15.52:0/1850772249 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6317+0+0 (secure 0 0 0) 0x7fa54c0ba0a0 con 0x7fa5501007f0 2024-09-06T14:51:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.230+0000 7fa554cb2640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa53c0774b0 0x7fa53c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:57.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.230+0000 7fa554cb2640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa53c0774b0 0x7fa53c079970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa550198fa0 tx=0x7fa54000a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:57.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.234+0000 7fa5467fc640 1 -- 172.21.15.52:0/1850772249 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa54c083090 con 0x7fa5501007f0 2024-09-06T14:51:57.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.414+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa550198c80 con 0x7fa53c0774b0 2024-09-06T14:51:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.416+0000 7fa5467fc640 1 -- 172.21.15.52:0/1850772249 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fa550198c80 con 0x7fa53c0774b0 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:51:57.413 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "10/23 daemons upgraded", 2024-09-06T14:51:57.414 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading osd daemons", 2024-09-06T14:51:57.414 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:51:57.414 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:51:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa53c0774b0 msgr2=0x7fa53c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa53c0774b0 0x7fa53c079970 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa550198fa0 tx=0x7fa54000a2d0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501007f0 msgr2=0x7fa55019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501007f0 0x7fa55019d680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa54c031460 tx=0x7fa54c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 shutdown_connections 2024-09-06T14:51:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa53c0774b0 0x7fa53c079970 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa5501067f0 0x7fa55019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 --2- 172.21.15.52:0/1850772249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5501007f0 0x7fa55019d680 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 >> 172.21.15.52:0/1850772249 conn(0x7fa5500fc550 msgr2=0x7fa550069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.418+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 shutdown_connections 2024-09-06T14:51:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.419+0000 7fa557717640 1 -- 172.21.15.52:0/1850772249 wait complete. 2024-09-06T14:51:57.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 -- 172.21.15.52:0/471034199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec106800 msgr2=0x7f38ec106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 --2- 172.21.15.52:0/471034199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec106800 0x7f38ec106be0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38dc009880 tx=0x7f38dc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 -- 172.21.15.52:0/471034199 shutdown_connections 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 --2- 172.21.15.52:0/471034199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec100800 0x7f38ec100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 --2- 172.21.15.52:0/471034199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec106800 0x7f38ec106be0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 -- 172.21.15.52:0/471034199 >> 172.21.15.52:0/471034199 conn(0x7f38ec0fc520 msgr2=0x7f38ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 -- 172.21.15.52:0/471034199 shutdown_connections 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.502+0000 7f38f1044640 1 -- 172.21.15.52:0/471034199 wait complete. 2024-09-06T14:51:57.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38f1044640 1 Processor -- start 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38f1044640 1 -- start start 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38f1044640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec100800 0x7f38ec19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38f1044640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec106800 0x7f38ec19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38f1044640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec10dcd0 con 0x7f38ec100800 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38f1044640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec10db50 con 0x7f38ec106800 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec100800 0x7f38ec19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38ead9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec100800 0x7f38ec19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46778/0 (socket says 172.21.15.52:46778) 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.503+0000 7f38ead9d640 1 -- 172.21.15.52:0/1980512043 learned_addr learned my addr 172.21.15.52:0/1980512043 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:51:57.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38ea59c640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec106800 0x7f38ec19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38ead9d640 1 -- 172.21.15.52:0/1980512043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec106800 msgr2=0x7f38ec19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38ead9d640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec106800 0x7f38ec19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38ead9d640 1 -- 172.21.15.52:0/1980512043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec1977c0 con 0x7f38ec100800 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38ead9d640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec100800 0x7f38ec19d640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38dc031460 tx=0x7f38dc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38d3fff640 1 -- 172.21.15.52:0/1980512043 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38dc03f070 con 0x7f38ec100800 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38d3fff640 1 -- 172.21.15.52:0/1980512043 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38dc0035f0 con 0x7f38ec100800 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38ec197a50 con 0x7f38ec100800 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38d3fff640 1 -- 172.21.15.52:0/1980512043 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f38dc035030 con 0x7f38ec100800 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.504+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38ec197f80 con 0x7f38ec100800 2024-09-06T14:51:57.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.505+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38ec101f40 con 0x7f38ec100800 2024-09-06T14:51:57.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.506+0000 7f38d3fff640 1 -- 172.21.15.52:0/1980512043 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f38dc042070 con 0x7f38ec100800 2024-09-06T14:51:57.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.506+0000 7f38d3fff640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f38d4077460 0x7f38d4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:51:57.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.506+0000 7f38d3fff640 1 -- 172.21.15.52:0/1980512043 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6317+0+0 (secure 0 0 0) 0x7f38dc0ba010 con 0x7f38ec100800 2024-09-06T14:51:57.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.506+0000 7f38ea59c640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f38d4077460 0x7f38d4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:51:57.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.507+0000 7f38ea59c640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f38d4077460 0x7f38d4079920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f38ec104f50 tx=0x7f38e000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:51:57.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.510+0000 7f38d3fff640 1 -- 172.21.15.52:0/1980512043 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f38dc087190 con 0x7f38ec100800 2024-09-06T14:51:57.647 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:57 smithi165 ceph-mon[82925]: pgmap v217: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s 2024-09-06T14:51:57.647 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:57 smithi165 ceph-mon[82925]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:57.647 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:57 smithi165 ceph-mon[82925]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:57.647 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:57 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2311894615' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:57.648 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:57 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2786824237' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:51:57.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.733+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f38ec109d80 con 0x7f38ec100800 2024-09-06T14:51:57.730 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:57 smithi052 ceph-mon[112917]: pgmap v217: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s 2024-09-06T14:51:57.730 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:57 smithi052 ceph-mon[112917]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:57.731 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:57 smithi052 ceph-mon[112917]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:57.731 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:57 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2311894615' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:51:57.731 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:57 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2786824237' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:51:57.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.733+0000 7f38d3fff640 1 -- 172.21.15.52:0/1980512043 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+981 (secure 0 0 0) 0x7f38dc08bbb0 con 0x7f38ec100800 2024-09-06T14:51:57.731 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:51:57.731 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:51:57.731 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:51:57.732 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:51:57.732 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:51:57.732 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:51:57.732 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:51:57.732 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:51:57.732 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:51:57.732 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f38d4077460 msgr2=0x7f38d4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f38d4077460 0x7f38d4079920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f38ec104f50 tx=0x7f38e000b390 comp rx=0 tx=0).stop 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec100800 msgr2=0x7f38ec19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec100800 0x7f38ec19d640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38dc031460 tx=0x7f38dc0045e0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 shutdown_connections 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f38d4077460 0x7f38d4079920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38ec106800 0x7f38ec19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 --2- 172.21.15.52:0/1980512043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38ec100800 0x7f38ec19d640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.735+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 >> 172.21.15.52:0/1980512043 conn(0x7f38ec0fc520 msgr2=0x7f38ec06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.736+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 shutdown_connections 2024-09-06T14:51:57.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:51:57.736+0000 7f38f1044640 1 -- 172.21.15.52:0/1980512043 wait complete. 2024-09-06T14:51:58.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:58 smithi052 ceph-mon[112917]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:58.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:58 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1980512043' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:51:58.948 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:58 smithi165 ceph-mon[82925]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:51:58.948 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:58 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1980512043' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:51:58.949 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:51:58 smithi165 systemd[1]: Stopping Ceph osd.4 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:51:59.322 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:51:58 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[48835]: 2024-09-06T14:51:58.951+0000 7f8ce46cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:51:59.322 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:51:58 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[48835]: 2024-09-06T14:51:58.951+0000 7f8ce46cb640 -1 osd.4 77 *** Got signal Terminated *** 2024-09-06T14:51:59.323 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:51:58 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[48835]: 2024-09-06T14:51:58.951+0000 7f8ce46cb640 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T14:51:59.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:59 smithi052 ceph-mon[112917]: pgmap v218: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s 2024-09-06T14:51:59.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:51:59 smithi052 ceph-mon[112917]: osd.4 marked itself down and dead 2024-09-06T14:52:00.021 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:59 smithi165 ceph-mon[82925]: pgmap v218: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s 2024-09-06T14:52:00.021 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:51:59 smithi165 ceph-mon[82925]: osd.4 marked itself down and dead 2024-09-06T14:52:00.280 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:00 smithi165 podman[96291]: 2024-09-06 14:52:00.024639394 +0000 UTC m=+1.192731478 container died 9e2d65f5cb49d794ecc1d65d3be20a239d8e8af2365798fa507c4a8e7f324914 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-635ed4c) 2024-09-06T14:52:00.572 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:00 smithi165 podman[96291]: 2024-09-06 14:52:00.375444481 +0000 UTC m=+1.543536562 container cleanup 9e2d65f5cb49d794ecc1d65d3be20a239d8e8af2365798fa507c4a8e7f324914 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-635ed4c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-06T14:52:00.572 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:00 smithi165 bash[96291]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4 2024-09-06T14:52:00.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:00 smithi052 ceph-mon[112917]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:52:00.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:00 smithi052 ceph-mon[112917]: osdmap e78: 6 total, 5 up, 6 in 2024-09-06T14:52:00.985 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:00 smithi165 ceph-mon[82925]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:52:00.985 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:00 smithi165 ceph-mon[82925]: osdmap e78: 6 total, 5 up, 6 in 2024-09-06T14:52:00.986 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:00 smithi165 podman[96308]: 2024-09-06 14:52:00.668448131 +0000 UTC m=+0.646154664 container remove 9e2d65f5cb49d794ecc1d65d3be20a239d8e8af2365798fa507c4a8e7f324914 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-635ed4c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-06T14:52:01.251 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:00 smithi165 podman[96395]: 2024-09-06 14:52:00.89185196 +0000 UTC m=+0.015928577 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:52:01.251 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:01 smithi165 podman[96395]: 2024-09-06 14:52:01.010990244 +0000 UTC m=+0.135066850 container create c296a54e5d41fe56be092319e284f808e8953227ff35cd8b2f87917cf13cc329 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-06T14:52:01.251 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:01 smithi165 podman[96395]: 2024-09-06 14:52:01.25538307 +0000 UTC m=+0.379459676 container init c296a54e5d41fe56be092319e284f808e8953227ff35cd8b2f87917cf13cc329 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-06T14:52:01.573 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:01 smithi165 podman[96395]: 2024-09-06 14:52:01.258739787 +0000 UTC m=+0.382816394 container start c296a54e5d41fe56be092319e284f808e8953227ff35cd8b2f87917cf13cc329 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-06T14:52:01.573 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:01 smithi165 podman[96395]: 2024-09-06 14:52:01.355113639 +0000 UTC m=+0.479190245 container attach c296a54e5d41fe56be092319e284f808e8953227ff35cd8b2f87917cf13cc329 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-06T14:52:01.573 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:01 smithi165 podman[96395]: 2024-09-06 14:52:01.448246674 +0000 UTC m=+0.572323289 container died c296a54e5d41fe56be092319e284f808e8953227ff35cd8b2f87917cf13cc329 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-06T14:52:01.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:01 smithi052 ceph-mon[112917]: pgmap v220: 65 pgs: 9 peering, 5 stale+active+clean, 51 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:52:01.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:01 smithi052 ceph-mon[112917]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-06T14:52:01.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:01 smithi052 ceph-mon[112917]: osdmap e79: 6 total, 5 up, 6 in 2024-09-06T14:52:02.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:01 smithi165 ceph-mon[82925]: pgmap v220: 65 pgs: 9 peering, 5 stale+active+clean, 51 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:52:02.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:01 smithi165 ceph-mon[82925]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-06T14:52:02.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:01 smithi165 ceph-mon[82925]: osdmap e79: 6 total, 5 up, 6 in 2024-09-06T14:52:02.514 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 podman[96419]: 2024-09-06 14:52:02.085809758 +0000 UTC m=+0.631810960 container remove c296a54e5d41fe56be092319e284f808e8953227ff35cd8b2f87917cf13cc329 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-06T14:52:02.514 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-06T14:52:02.515 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 systemd[1]: Stopped Ceph osd.4 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:52:02.515 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.4.service: Consumed 54.099s CPU time. 2024-09-06T14:52:02.515 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 systemd[1]: Starting Ceph osd.4 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:52:02.817 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 podman[96518]: 2024-09-06 14:52:02.420685505 +0000 UTC m=+0.015941489 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:52:02.817 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 podman[96518]: 2024-09-06 14:52:02.555735784 +0000 UTC m=+0.150991768 container create 88ea9e1cb48126aedd6c6954217ecb9bc40f3b06094398947d2f1d5e2176865a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:52:02.817 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 podman[96518]: 2024-09-06 14:52:02.820920692 +0000 UTC m=+0.416176677 container init 88ea9e1cb48126aedd6c6954217ecb9bc40f3b06094398947d2f1d5e2176865a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-06T14:52:03.072 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 podman[96518]: 2024-09-06 14:52:02.824370134 +0000 UTC m=+0.419626119 container start 88ea9e1cb48126aedd6c6954217ecb9bc40f3b06094398947d2f1d5e2176865a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:52:03.073 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 podman[96518]: 2024-09-06 14:52:02.904252687 +0000 UTC m=+0.499508679 container attach 88ea9e1cb48126aedd6c6954217ecb9bc40f3b06094398947d2f1d5e2176865a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-06T14:52:03.073 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:03.073 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 bash[96518]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:03.073 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:03.073 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:02 smithi165 bash[96518]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:03.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:03 smithi052 ceph-mon[112917]: pgmap v222: 65 pgs: 9 peering, 5 stale+active+clean, 51 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:52:03.983 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-mon[82925]: pgmap v222: 65 pgs: 9 peering, 5 stale+active+clean, 51 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:52:03.983 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-06T14:52:03.983 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 bash[96518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-06T14:52:03.983 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-06T14:52:03.984 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 bash[96518]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-06T14:52:04.304 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-06T14:52:04.304 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 bash[96518]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-06T14:52:04.304 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-06T14:52:04.304 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 bash[96518]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-06T14:52:04.304 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-06T14:52:04.305 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 bash[96518]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-06T14:52:04.305 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-06T14:52:04.305 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 bash[96518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-06T14:52:04.305 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate[96533]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-06T14:52:04.305 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:03 smithi165 bash[96518]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-06T14:52:04.305 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:04 smithi165 podman[96518]: 2024-09-06 14:52:04.014489238 +0000 UTC m=+1.609745231 container died 88ea9e1cb48126aedd6c6954217ecb9bc40f3b06094398947d2f1d5e2176865a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-06T14:52:04.862 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:04 smithi165 ceph-mon[82925]: Health check failed: Degraded data redundancy: 32/339 objects degraded (9.440%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:04.863 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:04 smithi165 podman[96676]: 2024-09-06 14:52:04.615994914 +0000 UTC m=+0.595676143 container remove 88ea9e1cb48126aedd6c6954217ecb9bc40f3b06094398947d2f1d5e2176865a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux ) 2024-09-06T14:52:04.863 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:04 smithi165 podman[96738]: 2024-09-06 14:52:04.733588154 +0000 UTC m=+0.015797810 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:52:04.863 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:04 smithi165 podman[96738]: 2024-09-06 14:52:04.866837395 +0000 UTC m=+0.149047045 container create 81f6b343a244b87c33adb43608bfe531d2bee72e21ca272c9057da417125cdf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-06T14:52:05.115 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:05 smithi165 podman[96738]: 2024-09-06 14:52:05.094501535 +0000 UTC m=+0.376711186 container init 81f6b343a244b87c33adb43608bfe531d2bee72e21ca272c9057da417125cdf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-06T14:52:05.115 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:05 smithi165 podman[96738]: 2024-09-06 14:52:05.097712388 +0000 UTC m=+0.379922038 container start 81f6b343a244b87c33adb43608bfe531d2bee72e21ca272c9057da417125cdf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-06T14:52:05.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:04 smithi052 ceph-mon[112917]: Health check failed: Degraded data redundancy: 32/339 objects degraded (9.440%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:05.572 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:05 smithi165 ceph-osd[96757]: -- 172.21.15.165:0/3391934088 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564a1c1ce1e0 con 0x564a1c15e000 2024-09-06T14:52:05.572 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:05 smithi165 bash[96738]: 81f6b343a244b87c33adb43608bfe531d2bee72e21ca272c9057da417125cdf5 2024-09-06T14:52:05.572 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:05 smithi165 systemd[1]: Started Ceph osd.4 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:52:05.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:05 smithi052 ceph-mon[112917]: pgmap v223: 65 pgs: 13 active+undersized, 9 peering, 11 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 5 op/s; 32/339 objects degraded (9.440%) 2024-09-06T14:52:05.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:05.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:05.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:05 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:05.987 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:05 smithi165 ceph-mon[82925]: pgmap v223: 65 pgs: 13 active+undersized, 9 peering, 11 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 5 op/s; 32/339 objects degraded (9.440%) 2024-09-06T14:52:05.987 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:05.988 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:05.988 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:05 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:06.988 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:06 smithi165 ceph-mon[82925]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-06T14:52:07.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:06 smithi052 ceph-mon[112917]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-06T14:52:07.322 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:06 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T14:52:06.991+0000 7ff9658c2640 -1 Falling back to public interface 2024-09-06T14:52:08.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:07 smithi165 ceph-mon[82925]: pgmap v224: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:08.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:08.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:08.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:07 smithi052 ceph-mon[112917]: pgmap v224: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:08.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:08.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:09.429 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:09.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:09.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:09 smithi165 ceph-mon[82925]: pgmap v225: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:09.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:09.430 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:09 smithi052 ceph-mon[112917]: pgmap v225: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:10.482 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:10 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 55/339 objects degraded (16.224%), 15 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:10.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:10 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 55/339 objects degraded (16.224%), 15 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:11.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:11 smithi165 ceph-mon[82925]: pgmap v226: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:11.622 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:11 smithi052 ceph-mon[112917]: pgmap v226: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:13.007 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:12 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T14:52:12.748+0000 7ff9658c2640 -1 osd.4 77 log_to_monitors true 2024-09-06T14:52:13.322 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T14:52:13.050+0000 7ff959664640 -1 osd.4 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:52:13.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='osd.4 [v2:172.21.15.165:6808/3623848760,v1:172.21.15.165:6809/3623848760]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T14:52:13.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:13 smithi165 ceph-mon[82925]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T14:52:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:52:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:13.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:13.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:13.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:13.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-06T14:52:13.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='osd.4 [v2:172.21.15.165:6808/3623848760,v1:172.21.15.165:6809/3623848760]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T14:52:13.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:13 smithi052 ceph-mon[112917]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-06T14:52:14.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:14 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-06T14:52:14.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:14 smithi165 ceph-mon[82925]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-06T14:52:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:14 smithi165 ceph-mon[82925]: pgmap v227: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:14 smithi165 ceph-mon[82925]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T14:52:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:14 smithi165 ceph-mon[82925]: osdmap e80: 6 total, 5 up, 6 in 2024-09-06T14:52:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:14 smithi165 ceph-mon[82925]: from='osd.4 [v2:172.21.15.165:6808/3623848760,v1:172.21.15.165:6809/3623848760]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:14.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:14 smithi165 ceph-mon[82925]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:14 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-06T14:52:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:14 smithi052 ceph-mon[112917]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-06T14:52:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:14 smithi052 ceph-mon[112917]: pgmap v227: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:14 smithi052 ceph-mon[112917]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-06T14:52:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:14 smithi052 ceph-mon[112917]: osdmap e80: 6 total, 5 up, 6 in 2024-09-06T14:52:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:14 smithi052 ceph-mon[112917]: from='osd.4 [v2:172.21.15.165:6808/3623848760,v1:172.21.15.165:6809/3623848760]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:14.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:14 smithi052 ceph-mon[112917]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:15.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:15 smithi165 ceph-mon[82925]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:52:15.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:15 smithi165 ceph-mon[82925]: osd.4 [v2:172.21.15.165:6808/3623848760,v1:172.21.15.165:6809/3623848760] boot 2024-09-06T14:52:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:15 smithi165 ceph-mon[82925]: osdmap e81: 6 total, 6 up, 6 in 2024-09-06T14:52:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:15 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T14:52:15.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:15 smithi165 ceph-mon[82925]: osdmap e82: 6 total, 6 up, 6 in 2024-09-06T14:52:15.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:15 smithi052 ceph-mon[112917]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:52:15.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:15 smithi052 ceph-mon[112917]: osd.4 [v2:172.21.15.165:6808/3623848760,v1:172.21.15.165:6809/3623848760] boot 2024-09-06T14:52:15.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:15 smithi052 ceph-mon[112917]: osdmap e81: 6 total, 6 up, 6 in 2024-09-06T14:52:15.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:15 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-06T14:52:15.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:15 smithi052 ceph-mon[112917]: osdmap e82: 6 total, 6 up, 6 in 2024-09-06T14:52:16.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:16 smithi165 ceph-mon[82925]: pgmap v230: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 6 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:16.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:16 smithi052 ceph-mon[112917]: pgmap v230: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 6 op/s; 55/339 objects degraded (16.224%) 2024-09-06T14:52:17.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:17 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 32/339 objects degraded (9.440%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:17.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:17 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 32/339 objects degraded (9.440%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:18.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:18 smithi052 ceph-mon[112917]: pgmap v232: 65 pgs: 8 peering, 14 active+undersized, 11 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 4 op/s; 32/339 objects degraded (9.440%) 2024-09-06T14:52:18.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:18 smithi165 ceph-mon[82925]: pgmap v232: 65 pgs: 8 peering, 14 active+undersized, 11 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 4 op/s; 32/339 objects degraded (9.440%) 2024-09-06T14:52:20.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:20 smithi052 ceph-mon[112917]: pgmap v233: 65 pgs: 8 peering, 2 active+undersized, 4 active+undersized+degraded, 51 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 5 op/s; 10/339 objects degraded (2.950%) 2024-09-06T14:52:20.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:20 smithi165 ceph-mon[82925]: pgmap v233: 65 pgs: 8 peering, 2 active+undersized, 4 active+undersized+degraded, 51 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 5 op/s; 10/339 objects degraded (2.950%) 2024-09-06T14:52:21.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:21 smithi165 ceph-mon[82925]: pgmap v234: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 6 op/s 2024-09-06T14:52:21.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:21 smithi165 ceph-mon[82925]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/339 objects degraded (2.950%), 4 pgs degraded) 2024-09-06T14:52:21.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:21 smithi052 ceph-mon[112917]: pgmap v234: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 6 op/s 2024-09-06T14:52:21.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:21 smithi052 ceph-mon[112917]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/339 objects degraded (2.950%), 4 pgs degraded) 2024-09-06T14:52:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:23 smithi052 ceph-mon[112917]: pgmap v235: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:52:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:24.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:23 smithi165 ceph-mon[82925]: pgmap v235: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-09-06T14:52:24.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:24.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:25.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:25 smithi052 ceph-mon[112917]: pgmap v236: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:52:26.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:25 smithi165 ceph-mon[82925]: pgmap v236: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:52:27.817 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:27 smithi165 ceph-mon[82925]: pgmap v237: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:52:27.817 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:27 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-06T14:52:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 -- 172.21.15.52:0/4126356412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480101900 msgr2=0x7f8480101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 --2- 172.21.15.52:0/4126356412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480101900 0x7f8480101d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8474009880 tx=0x7f847402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:52:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 -- 172.21.15.52:0/4126356412 shutdown_connections 2024-09-06T14:52:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 --2- 172.21.15.52:0/4126356412 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480101900 0x7f8480101d60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 --2- 172.21.15.52:0/4126356412 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8480107900 0x7f8480107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:27.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 -- 172.21.15.52:0/4126356412 >> 172.21.15.52:0/4126356412 conn(0x7f84800fd600 msgr2=0x7f84800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:27.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 -- 172.21.15.52:0/4126356412 shutdown_connections 2024-09-06T14:52:27.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.832+0000 7f848837d640 1 -- 172.21.15.52:0/4126356412 wait complete. 2024-09-06T14:52:27.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f848837d640 1 Processor -- start 2024-09-06T14:52:27.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f848837d640 1 -- start start 2024-09-06T14:52:27.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f848837d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8480101900 0x7f848019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:27.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f848837d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480107900 0x7f848019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:27.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f848837d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f848010edd0 con 0x7f8480107900 2024-09-06T14:52:27.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f848837d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f848010ec50 con 0x7f8480101900 2024-09-06T14:52:27.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f8485918640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480107900 0x7f848019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:27.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f8485918640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480107900 0x7f848019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36886/0 (socket says 172.21.15.52:36886) 2024-09-06T14:52:27.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f8485918640 1 -- 172.21.15.52:0/3537269225 learned_addr learned my addr 172.21.15.52:0/3537269225 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:27.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.833+0000 7f8486119640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8480101900 0x7f848019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:27.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f8485918640 1 -- 172.21.15.52:0/3537269225 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8480101900 msgr2=0x7f848019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:27.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f8485918640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8480101900 0x7f848019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:27.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f8485918640 1 -- 172.21.15.52:0/3537269225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84801977a0 con 0x7f8480107900 2024-09-06T14:52:27.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f8485918640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480107900 0x7f848019db60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8474031460 tx=0x7f84740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:27.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f847f7fe640 1 -- 172.21.15.52:0/3537269225 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f847403f070 con 0x7f8480107900 2024-09-06T14:52:27.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f847f7fe640 1 -- 172.21.15.52:0/3537269225 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84740035f0 con 0x7f8480107900 2024-09-06T14:52:27.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8480197a30 con 0x7f8480107900 2024-09-06T14:52:27.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f847f7fe640 1 -- 172.21.15.52:0/3537269225 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8474035030 con 0x7f8480107900 2024-09-06T14:52:27.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.834+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8480197f60 con 0x7f8480107900 2024-09-06T14:52:27.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.835+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8480103040 con 0x7f8480107900 2024-09-06T14:52:27.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.836+0000 7f847f7fe640 1 -- 172.21.15.52:0/3537269225 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8474042070 con 0x7f8480107900 2024-09-06T14:52:27.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.836+0000 7f847f7fe640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84680774b0 0x7f8468079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:27.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.837+0000 7f847f7fe640 1 -- 172.21.15.52:0/3537269225 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6317+0+0 (secure 0 0 0) 0x7f84740b9f60 con 0x7f8480107900 2024-09-06T14:52:27.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.837+0000 7f8486119640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84680774b0 0x7f8468079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:27.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.837+0000 7f8486119640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84680774b0 0x7f8468079970 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8478005fd0 tx=0x7f847800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:27.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:27.841+0000 7f847f7fe640 1 -- 172.21.15.52:0/3537269225 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8474087160 con 0x7f8480107900 2024-09-06T14:52:27.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:27 smithi052 ceph-mon[112917]: pgmap v237: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 5 op/s 2024-09-06T14:52:27.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:27 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-06T14:52:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.018+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f84801982d0 con 0x7f84680774b0 2024-09-06T14:52:28.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.020+0000 7f847f7fe640 1 -- 172.21.15.52:0/3537269225 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f84801982d0 con 0x7f84680774b0 2024-09-06T14:52:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84680774b0 msgr2=0x7f8468079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84680774b0 0x7f8468079970 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8478005fd0 tx=0x7f847800b390 comp rx=0 tx=0).stop 2024-09-06T14:52:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480107900 msgr2=0x7f848019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480107900 0x7f848019db60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8474031460 tx=0x7f84740045e0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 shutdown_connections 2024-09-06T14:52:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8480107900 0x7f848019db60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f84680774b0 0x7f8468079970 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 --2- 172.21.15.52:0/3537269225 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8480101900 0x7f848019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.021+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 >> 172.21.15.52:0/3537269225 conn(0x7f84800fd600 msgr2=0x7f84800fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.022+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 shutdown_connections 2024-09-06T14:52:28.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.022+0000 7f848837d640 1 -- 172.21.15.52:0/3537269225 wait complete. 2024-09-06T14:52:28.028 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:52:28.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.105+0000 7fe097c28640 1 -- 172.21.15.52:0/262708870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 msgr2=0x7fe090106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.105+0000 7fe097c28640 1 --2- 172.21.15.52:0/262708870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe090106bd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009880 tx=0x7fe08c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.105+0000 7fe097c28640 1 -- 172.21.15.52:0/262708870 shutdown_connections 2024-09-06T14:52:28.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.105+0000 7fe097c28640 1 --2- 172.21.15.52:0/262708870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0901007f0 0x7fe090100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.105+0000 7fe097c28640 1 --2- 172.21.15.52:0/262708870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe090106bd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.105+0000 7fe097c28640 1 -- 172.21.15.52:0/262708870 >> 172.21.15.52:0/262708870 conn(0x7fe0900fc550 msgr2=0x7fe0900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 -- 172.21.15.52:0/262708870 shutdown_connections 2024-09-06T14:52:28.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 -- 172.21.15.52:0/262708870 wait complete. 2024-09-06T14:52:28.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 Processor -- start 2024-09-06T14:52:28.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 -- start start 2024-09-06T14:52:28.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0901007f0 0x7fe09019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe09019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe09010dcc0 con 0x7fe0901067f0 2024-09-06T14:52:28.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.106+0000 7fe097c28640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe09010db40 con 0x7fe0901007f0 2024-09-06T14:52:28.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0951c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe09019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0951c3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe09019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36896/0 (socket says 172.21.15.52:36896) 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0951c3640 1 -- 172.21.15.52:0/1774274981 learned_addr learned my addr 172.21.15.52:0/1774274981 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0959c4640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0901007f0 0x7fe09019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0951c3640 1 -- 172.21.15.52:0/1774274981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0901007f0 msgr2=0x7fe09019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0951c3640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0901007f0 0x7fe09019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0951c3640 1 -- 172.21.15.52:0/1774274981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0901977b0 con 0x7fe0901067f0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe0951c3640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe09019db70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe08000d6f0 tx=0x7fe08000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe086ffd640 1 -- 172.21.15.52:0/1774274981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe080017070 con 0x7fe0901067f0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe090197aa0 con 0x7fe0901067f0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe086ffd640 1 -- 172.21.15.52:0/1774274981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe08000de00 con 0x7fe0901067f0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe086ffd640 1 -- 172.21.15.52:0/1774274981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe080004bb0 con 0x7fe0901067f0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.107+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe090198030 con 0x7fe0901067f0 2024-09-06T14:52:28.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.108+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe090101f30 con 0x7fe0901067f0 2024-09-06T14:52:28.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.109+0000 7fe086ffd640 1 -- 172.21.15.52:0/1774274981 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe080004e60 con 0x7fe0901067f0 2024-09-06T14:52:28.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.109+0000 7fe086ffd640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe07c077460 0x7fe07c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.110+0000 7fe086ffd640 1 -- 172.21.15.52:0/1774274981 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6317+0+0 (secure 0 0 0) 0x7fe080099380 con 0x7fe0901067f0 2024-09-06T14:52:28.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.110+0000 7fe0959c4640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe07c077460 0x7fe07c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.110+0000 7fe0959c4640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe07c077460 0x7fe07c079920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0096c0 tx=0x7fe08c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.114+0000 7fe086ffd640 1 -- 172.21.15.52:0/1774274981 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe080066460 con 0x7fe0901067f0 2024-09-06T14:52:28.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.293+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe0901982e0 con 0x7fe07c077460 2024-09-06T14:52:28.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.294+0000 7fe086ffd640 1 -- 172.21.15.52:0/1774274981 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fe0901982e0 con 0x7fe07c077460 2024-09-06T14:52:28.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe07c077460 msgr2=0x7fe07c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe07c077460 0x7fe07c079920 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0096c0 tx=0x7fe08c031400 comp rx=0 tx=0).stop 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 msgr2=0x7fe09019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe09019db70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe08000d6f0 tx=0x7fe08000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 shutdown_connections 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0901067f0 0x7fe09019db70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe07c077460 0x7fe07c079920 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 --2- 172.21.15.52:0/1774274981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0901007f0 0x7fe09019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 >> 172.21.15.52:0/1774274981 conn(0x7fe0900fc550 msgr2=0x7fe090069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 shutdown_connections 2024-09-06T14:52:28.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.297+0000 7fe097c28640 1 -- 172.21.15.52:0/1774274981 wait complete. 2024-09-06T14:52:28.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 -- 172.21.15.52:0/2599849960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 msgr2=0x7f5fc810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 --2- 172.21.15.52:0/2599849960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc810b8d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009880 tx=0x7f5fb802a530 comp rx=0 tx=0).stop 2024-09-06T14:52:28.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 -- 172.21.15.52:0/2599849960 shutdown_connections 2024-09-06T14:52:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 --2- 172.21.15.52:0/2599849960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc810b8d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 --2- 172.21.15.52:0/2599849960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fc8102ac0 0x7f5fc8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 -- 172.21.15.52:0/2599849960 >> 172.21.15.52:0/2599849960 conn(0x7f5fc80fc520 msgr2=0x7f5fc80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 -- 172.21.15.52:0/2599849960 shutdown_connections 2024-09-06T14:52:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.380+0000 7f5fd0645640 1 -- 172.21.15.52:0/2599849960 wait complete. 2024-09-06T14:52:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fd0645640 1 Processor -- start 2024-09-06T14:52:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fd0645640 1 -- start start 2024-09-06T14:52:28.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fd0645640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fc8102ac0 0x7f5fc819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fd0645640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fd0645640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810edf0 con 0x7f5fc81033e0 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fd0645640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc810ec70 con 0x7f5fc8102ac0 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fcdbe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fcdbe0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc819fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36908/0 (socket says 172.21.15.52:36908) 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fcdbe0640 1 -- 172.21.15.52:0/1176104380 learned_addr learned my addr 172.21.15.52:0/1176104380 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fce3e1640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fc8102ac0 0x7f5fc819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fcdbe0640 1 -- 172.21.15.52:0/1176104380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fc8102ac0 msgr2=0x7f5fc819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fcdbe0640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fc8102ac0 0x7f5fc819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.381+0000 7f5fcdbe0640 1 -- 172.21.15.52:0/1176104380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc81999e0 con 0x7f5fc81033e0 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.382+0000 7f5fcdbe0640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc819fd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8031460 tx=0x7f5fb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.382+0000 7f5fbf7fe640 1 -- 172.21.15.52:0/1176104380 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fb803f070 con 0x7f5fc81033e0 2024-09-06T14:52:28.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.382+0000 7f5fbf7fe640 1 -- 172.21.15.52:0/1176104380 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fb8004ac0 con 0x7f5fc81033e0 2024-09-06T14:52:28.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.382+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc8199c70 con 0x7f5fc81033e0 2024-09-06T14:52:28.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.382+0000 7f5fbf7fe640 1 -- 172.21.15.52:0/1176104380 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fb8035030 con 0x7f5fc81033e0 2024-09-06T14:52:28.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.382+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc819a1a0 con 0x7f5fc81033e0 2024-09-06T14:52:28.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.383+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc806aa90 con 0x7f5fc81033e0 2024-09-06T14:52:28.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.383+0000 7f5fbf7fe640 1 -- 172.21.15.52:0/1176104380 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5fb8042070 con 0x7f5fc81033e0 2024-09-06T14:52:28.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.384+0000 7f5fbf7fe640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5fb4077460 0x7f5fb4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.384+0000 7f5fbf7fe640 1 -- 172.21.15.52:0/1176104380 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6317+0+0 (secure 0 0 0) 0x7f5fb80ba110 con 0x7f5fc81033e0 2024-09-06T14:52:28.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.384+0000 7f5fce3e1640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5fb4077460 0x7f5fb4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.384+0000 7f5fce3e1640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5fb4077460 0x7f5fb4079920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4005fd0 tx=0x7f5fc4005e20 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.388+0000 7f5fbf7fe640 1 -- 172.21.15.52:0/1176104380 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5fb8083120 con 0x7f5fc81033e0 2024-09-06T14:52:28.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.556+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5fc819af10 con 0x7f5fb4077460 2024-09-06T14:52:28.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.565+0000 7f5fbf7fe640 1 -- 172.21.15.52:0/1176104380 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5fc819af10 con 0x7f5fb4077460 2024-09-06T14:52:28.563 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (4m) 87s ago 15m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (7m) 87s ago 15m 8921k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (7m) 20s ago 15m 8963k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (3m) 87s ago 15m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (3m) 20s ago 15m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (4m) 87s ago 15m 79.1M - c8b91775d855 af78eb451b94 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (10m) 87s ago 10m 88.7M - 19.1.1-268-g635ed4cf b6db46a449e5 e325a3f509b5 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (10m) 87s ago 10m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (10m) 20s ago 10m 26.8M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (10m) 20s ago 10m 26.3M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:52:28.564 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (7m) 87s ago 17m 521M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (5m) 20s ago 14m 457M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (3m) 87s ago 17m 41.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (3m) 20s ago 14m 36.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (5m) 87s ago 15m 10.6M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (5m) 20s ago 15m 11.6M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (2m) 87s ago 13m 90.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (2m) 87s ago 13m 97.7M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (92s) 87s ago 12m 12.2M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (57s) 20s ago 12m 90.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (23s) 20s ago 12m 12.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (11m) 20s ago 11m 195M 2240M 19.1.1-268-g635ed4cf b6db46a449e5 007b77ec1fd9 2024-09-06T14:52:28.565 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (5m) 87s ago 15m 58.7M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:52:28.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5fb4077460 msgr2=0x7f5fb4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5fb4077460 0x7f5fb4079920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4005fd0 tx=0x7f5fc4005e20 comp rx=0 tx=0).stop 2024-09-06T14:52:28.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 msgr2=0x7f5fc819fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc819fd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8031460 tx=0x7f5fb80046c0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 shutdown_connections 2024-09-06T14:52:28.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5fc81033e0 0x7f5fc819fd60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5fb4077460 0x7f5fb4079920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 --2- 172.21.15.52:0/1176104380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5fc8102ac0 0x7f5fc819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 >> 172.21.15.52:0/1176104380 conn(0x7f5fc80fc520 msgr2=0x7f5fc8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 shutdown_connections 2024-09-06T14:52:28.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.568+0000 7f5fd0645640 1 -- 172.21.15.52:0/1176104380 wait complete. 2024-09-06T14:52:28.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 -- 172.21.15.52:0/329277930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201007f0 msgr2=0x7f3820100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 --2- 172.21.15.52:0/329277930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201007f0 0x7f3820100c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3808009880 tx=0x7f380802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 -- 172.21.15.52:0/329277930 shutdown_connections 2024-09-06T14:52:28.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 --2- 172.21.15.52:0/329277930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201007f0 0x7f3820100c50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 --2- 172.21.15.52:0/329277930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38201067f0 0x7f3820106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 -- 172.21.15.52:0/329277930 >> 172.21.15.52:0/329277930 conn(0x7f38200fc550 msgr2=0x7f38200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 -- 172.21.15.52:0/329277930 shutdown_connections 2024-09-06T14:52:28.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 -- 172.21.15.52:0/329277930 wait complete. 2024-09-06T14:52:28.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.651+0000 7f382612f640 1 Processor -- start 2024-09-06T14:52:28.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f382612f640 1 -- start start 2024-09-06T14:52:28.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f382612f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38201007f0 0x7f382019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f382612f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201067f0 0x7f382019cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f382612f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f382010dcc0 con 0x7f38201067f0 2024-09-06T14:52:28.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f382612f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f382010db40 con 0x7f38201007f0 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f3816ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201067f0 0x7f382019cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f3816ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201067f0 0x7f382019cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36940/0 (socket says 172.21.15.52:36940) 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f3816ffd640 1 -- 172.21.15.52:0/1789520411 learned_addr learned my addr 172.21.15.52:0/1789520411 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f381f7fe640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38201007f0 0x7f382019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f3816ffd640 1 -- 172.21.15.52:0/1789520411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38201007f0 msgr2=0x7f382019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f3816ffd640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38201007f0 0x7f382019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f3816ffd640 1 -- 172.21.15.52:0/1789520411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38201966b0 con 0x7f38201067f0 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.652+0000 7f381f7fe640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38201007f0 0x7f382019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.653+0000 7f3816ffd640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201067f0 0x7f382019cb20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3808031460 tx=0x7f3808004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.653+0000 7f381d7fa640 1 -- 172.21.15.52:0/1789520411 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f380803f070 con 0x7f38201067f0 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.653+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3820196940 con 0x7f38201067f0 2024-09-06T14:52:28.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.653+0000 7f381d7fa640 1 -- 172.21.15.52:0/1789520411 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f38080035f0 con 0x7f38201067f0 2024-09-06T14:52:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.653+0000 7f381d7fa640 1 -- 172.21.15.52:0/1789520411 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3808035030 con 0x7f38201067f0 2024-09-06T14:52:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.653+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3820196e40 con 0x7f38201067f0 2024-09-06T14:52:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.654+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3820101f30 con 0x7f38201067f0 2024-09-06T14:52:28.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.655+0000 7f381d7fa640 1 -- 172.21.15.52:0/1789520411 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3808042070 con 0x7f38201067f0 2024-09-06T14:52:28.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.655+0000 7f381d7fa640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f380c077460 0x7f380c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.655+0000 7f381d7fa640 1 -- 172.21.15.52:0/1789520411 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6317+0+0 (secure 0 0 0) 0x7f38080b9fe0 con 0x7f38201067f0 2024-09-06T14:52:28.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.655+0000 7f381f7fe640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f380c077460 0x7f380c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.656+0000 7f381f7fe640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f380c077460 0x7f380c079920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3810009fc0 tx=0x7f3810005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.659+0000 7f381d7fa640 1 -- 172.21.15.52:0/1789520411 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3808087160 con 0x7f38201067f0 2024-09-06T14:52:28.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:28 smithi165 ceph-mon[82925]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-06T14:52:28.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:28 smithi165 ceph-mon[82925]: Upgrade: osd.5 is safe to restart 2024-09-06T14:52:28.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:28 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:28.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:28 smithi165 ceph-mon[82925]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:28.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:28 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:28.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:28 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T14:52:28.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:28 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:28.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:28 smithi052 ceph-mon[112917]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-06T14:52:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:28 smithi052 ceph-mon[112917]: Upgrade: osd.5 is safe to restart 2024-09-06T14:52:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:28 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:28 smithi052 ceph-mon[112917]: from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:28 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:28 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-06T14:52:28.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:28 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.880+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3820197be0 con 0x7f38201067f0 2024-09-06T14:52:28.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.881+0000 7f381d7fa640 1 -- 172.21.15.52:0/1789520411 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f380808bb80 con 0x7f38201067f0 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 1, 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 5 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:52:28.879 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 4 2024-09-06T14:52:28.880 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:52:28.880 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:52:28.880 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 5, 2024-09-06T14:52:28.880 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 9 2024-09-06T14:52:28.880 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:52:28.880 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f380c077460 msgr2=0x7f380c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f380c077460 0x7f380c079920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3810009fc0 tx=0x7f3810005f90 comp rx=0 tx=0).stop 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201067f0 msgr2=0x7f382019cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201067f0 0x7f382019cb20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3808031460 tx=0x7f3808004530 comp rx=0 tx=0).stop 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 shutdown_connections 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38201067f0 0x7f382019cb20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f380c077460 0x7f380c079920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 --2- 172.21.15.52:0/1789520411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f38201007f0 0x7f382019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 >> 172.21.15.52:0/1789520411 conn(0x7f38200fc550 msgr2=0x7f38200fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 shutdown_connections 2024-09-06T14:52:28.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.883+0000 7f382612f640 1 -- 172.21.15.52:0/1789520411 wait complete. 2024-09-06T14:52:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.967+0000 7fa32083b640 1 -- 172.21.15.52:0/2943121825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c102ab0 msgr2=0x7fa31c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.967+0000 7fa32083b640 1 --2- 172.21.15.52:0/2943121825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c102ab0 0x7fa31c102e90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa314009880 tx=0x7fa31402a530 comp rx=0 tx=0).stop 2024-09-06T14:52:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.967+0000 7fa32083b640 1 -- 172.21.15.52:0/2943121825 shutdown_connections 2024-09-06T14:52:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.967+0000 7fa32083b640 1 --2- 172.21.15.52:0/2943121825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31c1033d0 0x7fa31c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.967+0000 7fa32083b640 1 --2- 172.21.15.52:0/2943121825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c102ab0 0x7fa31c102e90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.967+0000 7fa32083b640 1 -- 172.21.15.52:0/2943121825 >> 172.21.15.52:0/2943121825 conn(0x7fa31c0fc550 msgr2=0x7fa31c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.968+0000 7fa32083b640 1 -- 172.21.15.52:0/2943121825 shutdown_connections 2024-09-06T14:52:28.966 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.968+0000 7fa32083b640 1 -- 172.21.15.52:0/2943121825 wait complete. 2024-09-06T14:52:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.968+0000 7fa32083b640 1 Processor -- start 2024-09-06T14:52:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.968+0000 7fa32083b640 1 -- start start 2024-09-06T14:52:28.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa32083b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31c102ab0 0x7fa31c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa32083b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c1033d0 0x7fa31c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa32083b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c10ede0 con 0x7fa31c1033d0 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa32083b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa31c10ec60 con 0x7fa31c102ab0 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa319d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c1033d0 0x7fa31c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa319d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c1033d0 0x7fa31c19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36958/0 (socket says 172.21.15.52:36958) 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa31a59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31c102ab0 0x7fa31c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa319d9b640 1 -- 172.21.15.52:0/1607765272 learned_addr learned my addr 172.21.15.52:0/1607765272 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa319d9b640 1 -- 172.21.15.52:0/1607765272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31c102ab0 msgr2=0x7fa31c19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa319d9b640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31c102ab0 0x7fa31c19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa319d9b640 1 -- 172.21.15.52:0/1607765272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31c1977b0 con 0x7fa31c1033d0 2024-09-06T14:52:28.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa31a59c640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31c102ab0 0x7fa31c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T14:52:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa319d9b640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c1033d0 0x7fa31c19db70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa30400d6d0 tx=0x7fa30400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa3137fe640 1 -- 172.21.15.52:0/1607765272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa304017070 con 0x7fa31c1033d0 2024-09-06T14:52:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa3137fe640 1 -- 172.21.15.52:0/1607765272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3040054e0 con 0x7fa31c1033d0 2024-09-06T14:52:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31c197aa0 con 0x7fa31c1033d0 2024-09-06T14:52:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.969+0000 7fa3137fe640 1 -- 172.21.15.52:0/1607765272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa304004ae0 con 0x7fa31c1033d0 2024-09-06T14:52:28.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.970+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31c198030 con 0x7fa31c1033d0 2024-09-06T14:52:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.971+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa31c06a580 con 0x7fa31c1033d0 2024-09-06T14:52:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.971+0000 7fa3137fe640 1 -- 172.21.15.52:0/1607765272 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa304004de0 con 0x7fa31c1033d0 2024-09-06T14:52:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.972+0000 7fa3137fe640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa308077460 0x7fa308079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.972+0000 7fa3137fe640 1 -- 172.21.15.52:0/1607765272 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6317+0+0 (secure 0 0 0) 0x7fa3040992a0 con 0x7fa31c1033d0 2024-09-06T14:52:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.972+0000 7fa31a59c640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa308077460 0x7fa308079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:28.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.972+0000 7fa31a59c640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa308077460 0x7fa308079920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3140096c0 tx=0x7fa314031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:28.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:28.976+0000 7fa3137fe640 1 -- 172.21.15.52:0/1607765272 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa304066420 con 0x7fa31c1033d0 2024-09-06T14:52:29.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.158+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa31c1982e0 con 0x7fa31c1033d0 2024-09-06T14:52:29.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.159+0000 7fa3137fe640 1 -- 172.21.15.52:0/1607765272 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2044 (secure 0 0 0) 0x7fa30406ae40 con 0x7fa31c1033d0 2024-09-06T14:52:29.157 INFO:teuthology.orchestra.run.smithi052.stdout:e19 2024-09-06T14:52:29.157 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:42:05:098083+0000 2024-09-06T14:52:29.157 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:52:29.157 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 19 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:42:05.098067+0000 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:52:29.158 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 46 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=14584,1=24277} 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:52:29.159 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 14584 members: 24277,14584 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{0:14584} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.52:6828/1318417598,v1:172.21.15.52:6829/1318417598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:14600} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/125679698,v1:172.21.15.52:6827/125679698] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{1:24277} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.165:6824/3417309574,v1:172.21.15.165:6825/3417309574] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:24287} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.165:6826/373761611,v1:172.21.15.165:6827/373761611] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:52:29.160 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:52:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 19 2024-09-06T14:52:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa308077460 msgr2=0x7fa308079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa308077460 0x7fa308079920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3140096c0 tx=0x7fa314031400 comp rx=0 tx=0).stop 2024-09-06T14:52:29.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c1033d0 msgr2=0x7fa31c19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c1033d0 0x7fa31c19db70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa30400d6d0 tx=0x7fa30400db90 comp rx=0 tx=0).stop 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 shutdown_connections 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa31c1033d0 0x7fa31c19db70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa308077460 0x7fa308079920 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 --2- 172.21.15.52:0/1607765272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa31c102ab0 0x7fa31c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 >> 172.21.15.52:0/1607765272 conn(0x7fa31c0fc550 msgr2=0x7fa31c10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 shutdown_connections 2024-09-06T14:52:29.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.162+0000 7fa32083b640 1 -- 172.21.15.52:0/1607765272 wait complete. 2024-09-06T14:52:29.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 -- 172.21.15.52:0/1400556106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 msgr2=0x7f79c8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 --2- 172.21.15.52:0/1400556106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c8107ce0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f79b8009880 tx=0x7f79b802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 -- 172.21.15.52:0/1400556106 shutdown_connections 2024-09-06T14:52:29.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 --2- 172.21.15.52:0/1400556106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c8101900 0x7f79c8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 --2- 172.21.15.52:0/1400556106 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c8107ce0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 -- 172.21.15.52:0/1400556106 >> 172.21.15.52:0/1400556106 conn(0x7f79c80fd600 msgr2=0x7f79c80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:29.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 -- 172.21.15.52:0/1400556106 shutdown_connections 2024-09-06T14:52:29.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.248+0000 7f79cd567640 1 -- 172.21.15.52:0/1400556106 wait complete. 2024-09-06T14:52:29.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79cd567640 1 Processor -- start 2024-09-06T14:52:29.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79cd567640 1 -- start start 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79cd567640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c8101900 0x7f79c819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79cd567640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79cd567640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f79c810edd0 con 0x7f79c8107900 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79cd567640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79c810ec50 con 0x7f79c8101900 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36968/0 (socket says 172.21.15.52:36968) 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79bffff640 1 -- 172.21.15.52:0/3661447982 learned_addr learned my addr 172.21.15.52:0/3661447982 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79c6ffd640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c8101900 0x7f79c819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79bffff640 1 -- 172.21.15.52:0/3661447982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c8101900 msgr2=0x7f79c819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79bffff640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c8101900 0x7f79c819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79bffff640 1 -- 172.21.15.52:0/3661447982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c8197840 con 0x7f79c8107900 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.249+0000 7f79c6ffd640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c8101900 0x7f79c819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.250+0000 7f79bffff640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c819dc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79b000d6f0 tx=0x7f79b000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.250+0000 7f79c4ff9640 1 -- 172.21.15.52:0/3661447982 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79b0017070 con 0x7f79c8107900 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.250+0000 7f79c4ff9640 1 -- 172.21.15.52:0/3661447982 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79b000de00 con 0x7f79c8107900 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.250+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c8197b30 con 0x7f79c8107900 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.250+0000 7f79c4ff9640 1 -- 172.21.15.52:0/3661447982 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79b0004bb0 con 0x7f79c8107900 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.250+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c81980c0 con 0x7f79c8107900 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.251+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c8103040 con 0x7f79c8107900 2024-09-06T14:52:29.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.251+0000 7f79c4ff9640 1 -- 172.21.15.52:0/3661447982 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f79b0009a30 con 0x7f79c8107900 2024-09-06T14:52:29.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.252+0000 7f79c4ff9640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79b40774b0 0x7f79b4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:29.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.252+0000 7f79c4ff9640 1 -- 172.21.15.52:0/3661447982 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6317+0+0 (secure 0 0 0) 0x7f79b0099270 con 0x7f79c8107900 2024-09-06T14:52:29.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.252+0000 7f79c6ffd640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79b40774b0 0x7f79b4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:29.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.252+0000 7f79c6ffd640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79b40774b0 0x7f79b4079970 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79b8006010 tx=0x7f79b80095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:29.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.256+0000 7f79c4ff9640 1 -- 172.21.15.52:0/3661447982 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f79b0062300 con 0x7f79c8107900 2024-09-06T14:52:29.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.432+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f79c8198370 con 0x7f79b40774b0 2024-09-06T14:52:29.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.434+0000 7f79c4ff9640 1 -- 172.21.15.52:0/3661447982 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f79c8198370 con 0x7f79b40774b0 2024-09-06T14:52:29.431 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:52:29.431 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "11/23 daemons upgraded", 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading osd daemons", 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:52:29.432 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:52:29.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79b40774b0 msgr2=0x7f79b4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79b40774b0 0x7f79b4079970 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f79b8006010 tx=0x7f79b80095f0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 msgr2=0x7f79c819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c819dc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79b000d6f0 tx=0x7f79b000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 shutdown_connections 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79c8107900 0x7f79c819dc00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79b40774b0 0x7f79b4079970 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 --2- 172.21.15.52:0/3661447982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79c8101900 0x7f79c819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.435+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 >> 172.21.15.52:0/3661447982 conn(0x7f79c80fd600 msgr2=0x7f79c80fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.436+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 shutdown_connections 2024-09-06T14:52:29.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.436+0000 7f79cd567640 1 -- 172.21.15.52:0/3661447982 wait complete. 2024-09-06T14:52:29.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 -- 172.21.15.52:0/4187487030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 msgr2=0x7fecd8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 --2- 172.21.15.52:0/4187487030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd8106be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009880 tx=0x7fecc802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 -- 172.21.15.52:0/4187487030 shutdown_connections 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 --2- 172.21.15.52:0/4187487030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecd8100800 0x7fecd8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 --2- 172.21.15.52:0/4187487030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd8106be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 -- 172.21.15.52:0/4187487030 >> 172.21.15.52:0/4187487030 conn(0x7fecd80fc520 msgr2=0x7fecd80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 -- 172.21.15.52:0/4187487030 shutdown_connections 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.518+0000 7fecddd2f640 1 -- 172.21.15.52:0/4187487030 wait complete. 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.519+0000 7fecddd2f640 1 Processor -- start 2024-09-06T14:52:29.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.519+0000 7fecddd2f640 1 -- start start 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.519+0000 7fecddd2f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecd8100800 0x7fecd819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.519+0000 7fecddd2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.519+0000 7fecddd2f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fecd810dcb0 con 0x7fecd8106800 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.519+0000 7fecddd2f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecd810db30 con 0x7fecd8100800 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.519+0000 7fecd6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36994/0 (socket says 172.21.15.52:36994) 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd6ffd640 1 -- 172.21.15.52:0/384430128 learned_addr learned my addr 172.21.15.52:0/384430128 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd77fe640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecd8100800 0x7fecd819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd6ffd640 1 -- 172.21.15.52:0/384430128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecd8100800 msgr2=0x7fecd819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd6ffd640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecd8100800 0x7fecd819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd6ffd640 1 -- 172.21.15.52:0/384430128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd81977e0 con 0x7fecd8106800 2024-09-06T14:52:29.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd6ffd640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd819dba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d8d0 tx=0x7feccc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:29.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd4ff9640 1 -- 172.21.15.52:0/384430128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feccc017030 con 0x7fecd8106800 2024-09-06T14:52:29.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd4ff9640 1 -- 172.21.15.52:0/384430128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feccc004020 con 0x7fecd8106800 2024-09-06T14:52:29.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd8197ad0 con 0x7fecd8106800 2024-09-06T14:52:29.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecd4ff9640 1 -- 172.21.15.52:0/384430128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feccc0047a0 con 0x7fecd8106800 2024-09-06T14:52:29.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.520+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd8198060 con 0x7fecd8106800 2024-09-06T14:52:29.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.521+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd8101f40 con 0x7fecd8106800 2024-09-06T14:52:29.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.522+0000 7fecd4ff9640 1 -- 172.21.15.52:0/384430128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7feccc0041d0 con 0x7fecd8106800 2024-09-06T14:52:29.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.522+0000 7fecd4ff9640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fecc0077460 0x7fecc0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:29.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.523+0000 7fecd4ff9640 1 -- 172.21.15.52:0/384430128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6317+0+0 (secure 0 0 0) 0x7feccc018070 con 0x7fecd8106800 2024-09-06T14:52:29.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.523+0000 7fecd77fe640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fecc0077460 0x7fecc0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:29.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.523+0000 7fecd77fe640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fecc0077460 0x7fecc0079920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fecc80096c0 tx=0x7fecc8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:29.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.527+0000 7fecd4ff9640 1 -- 172.21.15.52:0/384430128 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7feccc062490 con 0x7fecd8106800 2024-09-06T14:52:29.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.745+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fecd8198370 con 0x7fecd8106800 2024-09-06T14:52:29.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:29 smithi052 ceph-mon[112917]: pgmap v238: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s 2024-09-06T14:52:29.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:29 smithi052 ceph-mon[112917]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:29.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:29 smithi052 ceph-mon[112917]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:29.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:29 smithi052 ceph-mon[112917]: Upgrade: Updating osd.5 2024-09-06T14:52:29.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:29 smithi052 ceph-mon[112917]: Deploying daemon osd.5 on smithi165 2024-09-06T14:52:29.743 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:29 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1789520411' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:29.744 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:29 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1607765272' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:52:29.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.745+0000 7fecd4ff9640 1 -- 172.21.15.52:0/384430128 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+981 (secure 0 0 0) 0x7feccc066600 con 0x7fecd8106800 2024-09-06T14:52:29.744 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:52:29.744 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:52:29.744 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:52:29.744 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:52:29.744 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:52:29.745 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:52:29.745 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:52:29.745 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:52:29.745 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:52:29.745 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:52:29.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.747+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fecc0077460 msgr2=0x7fecc0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.747+0000 7fecddd2f640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fecc0077460 0x7fecc0079920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fecc80096c0 tx=0x7fecc8031400 comp rx=0 tx=0).stop 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.747+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 msgr2=0x7fecd819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.747+0000 7fecddd2f640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd819dba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d8d0 tx=0x7feccc00dd90 comp rx=0 tx=0).stop 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.748+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 shutdown_connections 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.748+0000 7fecddd2f640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecd8106800 0x7fecd819dba0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.748+0000 7fecddd2f640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fecc0077460 0x7fecc0079920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.748+0000 7fecddd2f640 1 --2- 172.21.15.52:0/384430128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecd8100800 0x7fecd819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.748+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 >> 172.21.15.52:0/384430128 conn(0x7fecd80fc520 msgr2=0x7fecd806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.748+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 shutdown_connections 2024-09-06T14:52:29.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:29.748+0000 7fecddd2f640 1 -- 172.21.15.52:0/384430128 wait complete. 2024-09-06T14:52:29.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:29 smithi165 ceph-mon[82925]: pgmap v238: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 5 op/s 2024-09-06T14:52:29.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:29 smithi165 ceph-mon[82925]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:29.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:29 smithi165 ceph-mon[82925]: from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:29.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:29 smithi165 ceph-mon[82925]: Upgrade: Updating osd.5 2024-09-06T14:52:29.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:29 smithi165 ceph-mon[82925]: Deploying daemon osd.5 on smithi165 2024-09-06T14:52:29.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:29 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1789520411' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:29.978 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:29 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1607765272' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:52:30.901 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:30 smithi165 ceph-mon[82925]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:30.901 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:30 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/384430128' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:52:31.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:30 smithi052 ceph-mon[112917]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:52:31.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:30 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/384430128' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:52:31.815 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:31 smithi165 ceph-mon[82925]: pgmap v239: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 6 op/s 2024-09-06T14:52:31.815 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:31 smithi165 systemd[1]: Stopping Ceph osd.5 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:52:32.072 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:31 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[55621]: 2024-09-06T14:52:31.818+0000 7f7d32ca2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T14:52:32.072 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:31 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[55621]: 2024-09-06T14:52:31.818+0000 7f7d32ca2640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-06T14:52:32.072 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:31 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[55621]: 2024-09-06T14:52:31.818+0000 7f7d32ca2640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T14:52:32.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:31 smithi052 ceph-mon[112917]: pgmap v239: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 6 op/s 2024-09-06T14:52:33.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:32 smithi165 ceph-mon[82925]: osd.5 marked itself down and dead 2024-09-06T14:52:33.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:32 smithi052 ceph-mon[112917]: osd.5 marked itself down and dead 2024-09-06T14:52:33.515 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:33 smithi165 podman[101650]: 2024-09-06 14:52:33.229627984 +0000 UTC m=+1.521665429 container died 007b77ec1fd9cb42b91da77beea58a988979e4c54585b1892a04eee332b86662 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-635ed4c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-06T14:52:33.807 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:33 smithi165 ceph-mon[82925]: pgmap v240: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:52:33.807 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:33 smithi165 ceph-mon[82925]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:52:33.807 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:33 smithi165 ceph-mon[82925]: osdmap e83: 6 total, 5 up, 6 in 2024-09-06T14:52:33.807 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:33 smithi165 podman[101650]: 2024-09-06 14:52:33.609426859 +0000 UTC m=+1.901464314 container cleanup 007b77ec1fd9cb42b91da77beea58a988979e4c54585b1892a04eee332b86662 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-635ed4c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-06T14:52:33.807 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:33 smithi165 bash[101650]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5 2024-09-06T14:52:34.024 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:33 smithi052 ceph-mon[112917]: pgmap v240: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-06T14:52:34.024 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:33 smithi052 ceph-mon[112917]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-06T14:52:34.024 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:33 smithi052 ceph-mon[112917]: osdmap e83: 6 total, 5 up, 6 in 2024-09-06T14:52:34.072 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:33 smithi165 podman[101665]: 2024-09-06 14:52:33.810725979 +0000 UTC m=+0.575209567 container remove 007b77ec1fd9cb42b91da77beea58a988979e4c54585b1892a04eee332b86662 (image=quay.ceph.io/ceph-ci/ceph@sha256:086492fb6d37fd30af014405a56925645b24df1370b1c5452663d747c429f3c0, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-635ed4c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-06T14:52:34.510 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:34 smithi165 podman[101750]: 2024-09-06 14:52:34.127012072 +0000 UTC m=+0.016182117 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:52:34.510 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:34 smithi165 podman[101750]: 2024-09-06 14:52:34.236542569 +0000 UTC m=+0.125712608 container create c9aa811ced118aff7a2c2a665421d2a2fea81d18c1ad9a5172444464e339b75a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T14:52:34.510 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:34 smithi165 podman[101750]: 2024-09-06 14:52:34.514169288 +0000 UTC m=+0.403339320 container init c9aa811ced118aff7a2c2a665421d2a2fea81d18c1ad9a5172444464e339b75a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-06T14:52:34.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:34 smithi165 ceph-mon[82925]: osdmap e84: 6 total, 5 up, 6 in 2024-09-06T14:52:34.823 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:34 smithi165 podman[101750]: 2024-09-06 14:52:34.51774457 +0000 UTC m=+0.406914605 container start c9aa811ced118aff7a2c2a665421d2a2fea81d18c1ad9a5172444464e339b75a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-06T14:52:34.823 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:34 smithi165 podman[101750]: 2024-09-06 14:52:34.613961112 +0000 UTC m=+0.503131169 container attach c9aa811ced118aff7a2c2a665421d2a2fea81d18c1ad9a5172444464e339b75a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-06T14:52:34.823 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:34 smithi165 podman[101750]: 2024-09-06 14:52:34.70978041 +0000 UTC m=+0.598950457 container died c9aa811ced118aff7a2c2a665421d2a2fea81d18c1ad9a5172444464e339b75a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True) 2024-09-06T14:52:35.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:34 smithi052 ceph-mon[112917]: osdmap e84: 6 total, 5 up, 6 in 2024-09-06T14:52:35.686 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:35 smithi165 podman[101773]: 2024-09-06 14:52:35.367536528 +0000 UTC m=+0.652324839 container remove c9aa811ced118aff7a2c2a665421d2a2fea81d18c1ad9a5172444464e339b75a (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-06T14:52:35.686 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:35 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-06T14:52:35.687 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:35 smithi165 systemd[1]: Stopped Ceph osd.5 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:52:35.687 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:35 smithi165 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.5.service: Consumed 51.785s CPU time. 2024-09-06T14:52:35.687 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:35 smithi165 systemd[1]: Starting Ceph osd.5 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T14:52:35.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:35 smithi052 ceph-mon[112917]: pgmap v243: 65 pgs: 1 active+undersized, 17 peering, 3 stale+active+clean, 2 active+undersized+degraded, 42 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6/339 objects degraded (1.770%) 2024-09-06T14:52:35.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:35 smithi052 ceph-mon[112917]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-06T14:52:35.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:35 smithi052 ceph-mon[112917]: Health check failed: Degraded data redundancy: 6/339 objects degraded (1.770%), 2 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:35.939 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:35 smithi165 ceph-mon[82925]: pgmap v243: 65 pgs: 1 active+undersized, 17 peering, 3 stale+active+clean, 2 active+undersized+degraded, 42 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6/339 objects degraded (1.770%) 2024-09-06T14:52:35.939 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:35 smithi165 ceph-mon[82925]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-06T14:52:35.939 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:35 smithi165 ceph-mon[82925]: Health check failed: Degraded data redundancy: 6/339 objects degraded (1.770%), 2 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:35.939 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:35 smithi165 podman[101872]: 2024-09-06 14:52:35.705775576 +0000 UTC m=+0.016401959 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:52:35.939 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:35 smithi165 podman[101872]: 2024-09-06 14:52:35.810285146 +0000 UTC m=+0.120911523 container create 90db5f43110a2fc5e3ad7da2585ad8d86fb3495a273c5397751a57e04d29aae0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T14:52:36.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 podman[101872]: 2024-09-06 14:52:36.054176952 +0000 UTC m=+0.364803329 container init 90db5f43110a2fc5e3ad7da2585ad8d86fb3495a273c5397751a57e04d29aae0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-06T14:52:36.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 podman[101872]: 2024-09-06 14:52:36.057391458 +0000 UTC m=+0.368017835 container start 90db5f43110a2fc5e3ad7da2585ad8d86fb3495a273c5397751a57e04d29aae0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-06T14:52:36.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 podman[101872]: 2024-09-06 14:52:36.145851394 +0000 UTC m=+0.456477794 container attach 90db5f43110a2fc5e3ad7da2585ad8d86fb3495a273c5397751a57e04d29aae0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-06T14:52:36.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:36.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 bash[101872]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:36.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:36.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 bash[101872]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-06T14:52:37.198 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-06T14:52:37.198 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 bash[101872]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-06T14:52:37.198 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-06T14:52:37.198 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:36 smithi165 bash[101872]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-06T14:52:37.572 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-06T14:52:37.573 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 bash[101872]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-06T14:52:37.573 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-06T14:52:37.573 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 bash[101872]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-06T14:52:37.573 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-06T14:52:37.573 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 bash[101872]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-06T14:52:37.574 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-06T14:52:37.574 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 bash[101872]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-06T14:52:37.574 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate[101887]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-06T14:52:37.574 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 bash[101872]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-06T14:52:37.574 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 podman[101872]: 2024-09-06 14:52:37.230013214 +0000 UTC m=+1.540639601 container died 90db5f43110a2fc5e3ad7da2585ad8d86fb3495a273c5397751a57e04d29aae0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-06T14:52:37.916 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-mon[82925]: pgmap v244: 65 pgs: 5 active+undersized, 17 peering, 7 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/339 objects degraded (9.735%) 2024-09-06T14:52:37.917 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:37.917 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:38.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:37 smithi052 ceph-mon[112917]: pgmap v244: 65 pgs: 5 active+undersized, 17 peering, 7 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/339 objects degraded (9.735%) 2024-09-06T14:52:38.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:38.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:38.271 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:37 smithi165 podman[102033]: 2024-09-06 14:52:37.920810481 +0000 UTC m=+0.684960622 container remove 90db5f43110a2fc5e3ad7da2585ad8d86fb3495a273c5397751a57e04d29aae0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True) 2024-09-06T14:52:38.271 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:38 smithi165 podman[102092]: 2024-09-06 14:52:38.03062985 +0000 UTC m=+0.016252513 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T14:52:38.272 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:38 smithi165 podman[102092]: 2024-09-06 14:52:38.158934345 +0000 UTC m=+0.144557004 container create 04da38e02cd880560530fab63b2d44eec34e4fec6e68950108a8ef04555bb38c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T14:52:38.634 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:38 smithi165 podman[102092]: 2024-09-06 14:52:38.386660249 +0000 UTC m=+0.372282913 container init 04da38e02cd880560530fab63b2d44eec34e4fec6e68950108a8ef04555bb38c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T14:52:38.634 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:38 smithi165 podman[102092]: 2024-09-06 14:52:38.389968804 +0000 UTC m=+0.375591461 container start 04da38e02cd880560530fab63b2d44eec34e4fec6e68950108a8ef04555bb38c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-06T14:52:38.634 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:38 smithi165 ceph-osd[102111]: -- 172.21.15.165:0/743257644 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eba51c81e0 con 0x55eba459a000 2024-09-06T14:52:38.634 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:38 smithi165 bash[102092]: 04da38e02cd880560530fab63b2d44eec34e4fec6e68950108a8ef04555bb38c 2024-09-06T14:52:39.072 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:38 smithi165 systemd[1]: Started Ceph osd.5 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T14:52:39.946 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:39 smithi165 ceph-mon[82925]: pgmap v245: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/339 objects degraded (16.519%) 2024-09-06T14:52:39.947 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:39.947 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:39.947 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:39 smithi165 ceph-mon[82925]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-06T14:52:39.947 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:39 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:39 smithi052 ceph-mon[112917]: pgmap v245: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/339 objects degraded (16.519%) 2024-09-06T14:52:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:39 smithi052 ceph-mon[112917]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-06T14:52:40.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:39 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:40.322 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:40 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T14:52:40.038+0000 7f7c65c65640 -1 Falling back to public interface 2024-09-06T14:52:40.899 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:40 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 56/339 objects degraded (16.519%), 15 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:41.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:40 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 56/339 objects degraded (16.519%), 15 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:41.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:41 smithi165 ceph-mon[82925]: pgmap v246: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/339 objects degraded (16.519%) 2024-09-06T14:52:41.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:41 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:41.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:41 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:42.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:41 smithi052 ceph-mon[112917]: pgmap v246: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/339 objects degraded (16.519%) 2024-09-06T14:52:42.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:41 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:42.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:41 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:43.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:43 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:43.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:43 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:43.490 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:43 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:43.491 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:43 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:44.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:44 smithi165 ceph-mon[82925]: pgmap v247: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/339 objects degraded (16.519%) 2024-09-06T14:52:44.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:44 smithi052 ceph-mon[112917]: pgmap v247: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 56/339 objects degraded (16.519%) 2024-09-06T14:52:45.273 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:45 smithi165 ceph-mon[82925]: pgmap v248: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 5 op/s; 56/339 objects degraded (16.519%) 2024-09-06T14:52:45.273 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:45 smithi165 ceph-mon[82925]: from='osd.5 [v2:172.21.15.165:6816/551651537,v1:172.21.15.165:6817/551651537]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T14:52:45.273 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:45 smithi165 ceph-mon[82925]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T14:52:45.273 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:45 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T14:52:45.089+0000 7f7c65c65640 -1 osd.5 82 log_to_monitors true 2024-09-06T14:52:45.274 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 14:52:45 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T14:52:45.177+0000 7f7c5da0f640 -1 osd.5 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-06T14:52:45.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:45 smithi052 ceph-mon[112917]: pgmap v248: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 5 op/s; 56/339 objects degraded (16.519%) 2024-09-06T14:52:45.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:45 smithi052 ceph-mon[112917]: from='osd.5 [v2:172.21.15.165:6816/551651537,v1:172.21.15.165:6817/551651537]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T14:52:45.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:45 smithi052 ceph-mon[112917]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-06T14:52:46.512 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: osdmap e85: 6 total, 5 up, 6 in 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='osd.5 [v2:172.21.15.165:6816/551651537,v1:172.21.15.165:6817/551651537]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.513 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all osd 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-06T14:52:46.514 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-06T14:52:46.515 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-06T14:52:46.515 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-06T14:52:46.515 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-06T14:52:46.515 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.515 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-06T14:52:46.515 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:46 smithi165 ceph-mon[82925]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:52:46.522 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-06T14:52:46.522 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: osdmap e85: 6 total, 5 up, 6 in 2024-09-06T14:52:46.522 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='osd.5 [v2:172.21.15.165:6816/551651537,v1:172.21.15.165:6817/551651537]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:46.523 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all osd 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-06T14:52:46.524 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-06T14:52:46.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-06T14:52:46.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:46.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-06T14:52:46.525 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-mon[112917]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-06T14:52:46.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:46 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:52:46.620+0000 7f5055901640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: osd.5 [v2:172.21.15.165:6816/551651537,v1:172.21.15.165:6817/551651537] boot 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: osdmap e86: 6 total, 6 up, 6 in 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: pgmap v251: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 6 op/s; 56/339 objects degraded (16.519%) 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:47.303 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-06T14:52:47.304 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-06T14:52:47.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: osdmap e87: 6 total, 6 up, 6 in 2024-09-06T14:52:47.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.165:6826/3987199510,v1:172.21.15.165:6827/3987199510] up:boot 2024-09-06T14:52:47.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6826/2488952568,v1:172.21.15.52:6827/2488952568] up:boot 2024-09-06T14:52:47.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-06T14:52:47.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T14:52:47.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"} : dispatch 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: osd.5 [v2:172.21.15.165:6816/551651537,v1:172.21.15.165:6817/551651537] boot 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: osdmap e86: 6 total, 6 up, 6 in 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: pgmap v251: 65 pgs: 14 active+undersized, 15 active+undersized+degraded, 36 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 6 op/s; 56/339 objects degraded (16.519%) 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: fsmap cephfs:2 {0=cephfs.smithi052.eqtxfx=up:active,1=cephfs.smithi165.nmjcsh=up:active} 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:47.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-06T14:52:47.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: osdmap e87: 6 total, 6 up, 6 in 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.165:6826/3987199510,v1:172.21.15.165:6827/3987199510] up:boot 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6826/2488952568,v1:172.21.15.52:6827/2488952568] up:boot 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T14:52:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"} : dispatch 2024-09-06T14:52:48.805 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.165:6824/3871572907,v1:172.21.15.165:6825/3871572907] up:boot 2024-09-06T14:52:48.805 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6828/3913146670,v1:172.21.15.52:6829/3913146670] up:boot 2024-09-06T14:52:48.805 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:52:48.805 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"} : dispatch 2024-09-06T14:52:48.805 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"} : dispatch 2024-09-06T14:52:48.805 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:48.805 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dfprfm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:52:48.806 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.165:6824/3871572907,v1:172.21.15.165:6825/3871572907] up:boot 2024-09-06T14:52:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6828/3913146670,v1:172.21.15.52:6829/3913146670] up:boot 2024-09-06T14:52:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:52:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"} : dispatch 2024-09-06T14:52:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"} : dispatch 2024-09-06T14:52:49.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:49.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.dfprfm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:52:49.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:52:49.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:49 smithi052 ceph-mon[112917]: Upgrade: Updating mds.cephfs.smithi052.dfprfm 2024-09-06T14:52:49.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:49 smithi052 ceph-mon[112917]: Deploying daemon mds.cephfs.smithi052.dfprfm on smithi052 2024-09-06T14:52:49.728 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:49 smithi052 ceph-mon[112917]: pgmap v253: 65 pgs: 11 active+undersized, 11 active+undersized+degraded, 43 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s; 46/339 objects degraded (13.569%) 2024-09-06T14:52:49.729 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:49 smithi052 ceph-mon[112917]: Health check update: Degraded data redundancy: 46/339 objects degraded (13.569%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:50.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:49 smithi165 ceph-mon[82925]: Upgrade: Updating mds.cephfs.smithi052.dfprfm 2024-09-06T14:52:50.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:49 smithi165 ceph-mon[82925]: Deploying daemon mds.cephfs.smithi052.dfprfm on smithi052 2024-09-06T14:52:50.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:49 smithi165 ceph-mon[82925]: pgmap v253: 65 pgs: 11 active+undersized, 11 active+undersized+degraded, 43 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 5 op/s; 46/339 objects degraded (13.569%) 2024-09-06T14:52:50.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:49 smithi165 ceph-mon[82925]: Health check update: Degraded data redundancy: 46/339 objects degraded (13.569%), 11 pgs degraded (PG_DEGRADED) 2024-09-06T14:52:51.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:50 smithi165 ceph-mon[82925]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/339 objects degraded (13.569%), 11 pgs degraded) 2024-09-06T14:52:51.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:50 smithi165 ceph-mon[82925]: osdmap e88: 6 total, 6 up, 6 in 2024-09-06T14:52:51.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:50 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:52:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:50 smithi052 ceph-mon[112917]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/339 objects degraded (13.569%), 11 pgs degraded) 2024-09-06T14:52:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:50 smithi052 ceph-mon[112917]: osdmap e88: 6 total, 6 up, 6 in 2024-09-06T14:52:51.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:50 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:52:52.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:51 smithi165 ceph-mon[82925]: pgmap v254: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-06T14:52:52.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:51 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T14:52:52.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:51 smithi052 ceph-mon[112917]: pgmap v254: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-09-06T14:52:52.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:51 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T14:52:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:53 smithi052 ceph-mon[112917]: pgmap v256: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:52:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:54.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:53 smithi165 ceph-mon[82925]: pgmap v256: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:52:54.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:52:55.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:55 smithi052 ceph-mon[112917]: pgmap v257: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:52:55.874 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:55 smithi165 ceph-mon[82925]: pgmap v257: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:52:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:56 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:boot 2024-09-06T14:52:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:56 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:52:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:56 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T14:52:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:56 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:56 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:56.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:56 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:56.895 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:56 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:boot 2024-09-06T14:52:56.895 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:56 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:52:56.895 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:56 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T14:52:56.895 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:56 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:56.895 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:56 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:56.895 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:56 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:52:57.854 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:57 smithi052 ceph-mon[112917]: pgmap v258: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:52:58.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:57 smithi165 ceph-mon[82925]: pgmap v258: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:52:58.872 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:58 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:59.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:58 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:52:59.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 -- 172.21.15.52:0/2784358884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 msgr2=0x7f04ec100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 --2- 172.21.15.52:0/2784358884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec100c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009880 tx=0x7f04e802a530 comp rx=0 tx=0).stop 2024-09-06T14:52:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 -- 172.21.15.52:0/2784358884 shutdown_connections 2024-09-06T14:52:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 --2- 172.21.15.52:0/2784358884 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ec1011c0 0x7f04ec105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 --2- 172.21.15.52:0/2784358884 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec100c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 -- 172.21.15.52:0/2784358884 >> 172.21.15.52:0/2784358884 conn(0x7f04ec0fc4d0 msgr2=0x7f04ec0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:52:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 -- 172.21.15.52:0/2784358884 shutdown_connections 2024-09-06T14:52:59.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.843+0000 7f04f3df1640 1 -- 172.21.15.52:0/2784358884 wait complete. 2024-09-06T14:52:59.841 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:52:59 smithi052 ceph-mon[112917]: pgmap v259: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:52:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f3df1640 1 Processor -- start 2024-09-06T14:52:59.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f3df1640 1 -- start start 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f3df1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f3df1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ec1011c0 0x7f04ec19e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f3df1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec1153e0 con 0x7f04ec1008a0 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f3df1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04ec115260 con 0x7f04ec1011c0 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f1b8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f1b8d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec19e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44828/0 (socket says 172.21.15.52:44828) 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f1b8d640 1 -- 172.21.15.52:0/1152424561 learned_addr learned my addr 172.21.15.52:0/1152424561 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f138c640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ec1011c0 0x7f04ec19e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f1b8d640 1 -- 172.21.15.52:0/1152424561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ec1011c0 msgr2=0x7f04ec19e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f1b8d640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ec1011c0 0x7f04ec19e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:52:59.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.844+0000 7f04f1b8d640 1 -- 172.21.15.52:0/1152424561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ec1a28d0 con 0x7f04ec1008a0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.845+0000 7f04f1b8d640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec19e000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04e8031460 tx=0x7f04e8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.845+0000 7f04deffd640 1 -- 172.21.15.52:0/1152424561 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04e803f070 con 0x7f04ec1008a0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.845+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ec1a2b60 con 0x7f04ec1008a0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.845+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ec1a3090 con 0x7f04ec1008a0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.845+0000 7f04deffd640 1 -- 172.21.15.52:0/1152424561 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04e8004a90 con 0x7f04ec1008a0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.845+0000 7f04deffd640 1 -- 172.21.15.52:0/1152424561 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04e8035030 con 0x7f04ec1008a0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.846+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ec06ada0 con 0x7f04ec1008a0 2024-09-06T14:52:59.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.847+0000 7f04deffd640 1 -- 172.21.15.52:0/1152424561 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f04e8042070 con 0x7f04ec1008a0 2024-09-06T14:52:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.847+0000 7f04deffd640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f04d80774b0 0x7f04d8079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:52:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.847+0000 7f04deffd640 1 -- 172.21.15.52:0/1152424561 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6489+0+0 (secure 0 0 0) 0x7f04e80ba230 con 0x7f04ec1008a0 2024-09-06T14:52:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.847+0000 7f04f138c640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f04d80774b0 0x7f04d8079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:52:59.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.848+0000 7f04f138c640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f04d80774b0 0x7f04d8079970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f04ec1124e0 tx=0x7f04e0005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:52:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:52:59.854+0000 7f04deffd640 1 -- 172.21.15.52:0/1152424561 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f04e8083210 con 0x7f04ec1008a0 2024-09-06T14:53:00.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.034+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f04ec1a3340 con 0x7f04d80774b0 2024-09-06T14:53:00.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.035+0000 7f04deffd640 1 -- 172.21.15.52:0/1152424561 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f04ec1a3340 con 0x7f04d80774b0 2024-09-06T14:53:00.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f04d80774b0 msgr2=0x7f04d8079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f04d80774b0 0x7f04d8079970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f04ec1124e0 tx=0x7f04e0005f90 comp rx=0 tx=0).stop 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 msgr2=0x7f04ec19e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec19e000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f04e8031460 tx=0x7f04e8004530 comp rx=0 tx=0).stop 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 shutdown_connections 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f04d80774b0 0x7f04d8079970 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04ec1011c0 0x7f04ec19e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 --2- 172.21.15.52:0/1152424561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f04ec1008a0 0x7f04ec19e000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 >> 172.21.15.52:0/1152424561 conn(0x7f04ec0fc4d0 msgr2=0x7f04ec112bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.037+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 shutdown_connections 2024-09-06T14:53:00.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.038+0000 7f04f3df1640 1 -- 172.21.15.52:0/1152424561 wait complete. 2024-09-06T14:53:00.043 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:53:00.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:52:59 smithi165 ceph-mon[82925]: pgmap v259: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:00.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 -- 172.21.15.52:0/4277837670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294102ab0 msgr2=0x7f3294102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 --2- 172.21.15.52:0/4277837670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294102ab0 0x7f3294102e90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f327c009880 tx=0x7f327c02a530 comp rx=0 tx=0).stop 2024-09-06T14:53:00.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 -- 172.21.15.52:0/4277837670 shutdown_connections 2024-09-06T14:53:00.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 --2- 172.21.15.52:0/4277837670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32941033d0 0x7f329410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 --2- 172.21.15.52:0/4277837670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294102ab0 0x7f3294102e90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 -- 172.21.15.52:0/4277837670 >> 172.21.15.52:0/4277837670 conn(0x7f32940fc550 msgr2=0x7f32940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:00.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 -- 172.21.15.52:0/4277837670 shutdown_connections 2024-09-06T14:53:00.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.126+0000 7f329a256640 1 -- 172.21.15.52:0/4277837670 wait complete. 2024-09-06T14:53:00.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f329a256640 1 Processor -- start 2024-09-06T14:53:00.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f329a256640 1 -- start start 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f329a256640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32941033d0 0x7f3294100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f329a256640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294100c50 0x7f32941010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f329a256640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f329410edc0 con 0x7f3294100c50 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f329a256640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f329410ec40 con 0x7f32941033d0 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f3292ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294100c50 0x7f32941010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f3292ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294100c50 0x7f32941010b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44840/0 (socket says 172.21.15.52:44840) 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f3292ffd640 1 -- 172.21.15.52:0/1870751097 learned_addr learned my addr 172.21.15.52:0/1870751097 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f32937fe640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32941033d0 0x7f3294100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.127+0000 7f3292ffd640 1 -- 172.21.15.52:0/1870751097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32941033d0 msgr2=0x7f3294100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f3292ffd640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32941033d0 0x7f3294100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f3292ffd640 1 -- 172.21.15.52:0/1870751097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3294102600 con 0x7f3294100c50 2024-09-06T14:53:00.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f3292ffd640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294100c50 0x7f32941010b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f328400c920 tx=0x7f328400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:00.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f3290ff9640 1 -- 172.21.15.52:0/1870751097 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32840079b0 con 0x7f3294100c50 2024-09-06T14:53:00.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f3290ff9640 1 -- 172.21.15.52:0/1870751097 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3284007b50 con 0x7f3294100c50 2024-09-06T14:53:00.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32941a3e70 con 0x7f3294100c50 2024-09-06T14:53:00.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f3290ff9640 1 -- 172.21.15.52:0/1870751097 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3284018630 con 0x7f3294100c50 2024-09-06T14:53:00.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.128+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32941a43d0 con 0x7f3294100c50 2024-09-06T14:53:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.129+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329406a580 con 0x7f3294100c50 2024-09-06T14:53:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.130+0000 7f3290ff9640 1 -- 172.21.15.52:0/1870751097 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f328400f450 con 0x7f3294100c50 2024-09-06T14:53:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.130+0000 7f3290ff9640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3280077460 0x7f3280079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.130+0000 7f3290ff9640 1 -- 172.21.15.52:0/1870751097 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6489+0+0 (secure 0 0 0) 0x7f32840999d0 con 0x7f3294100c50 2024-09-06T14:53:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.130+0000 7f32937fe640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3280077460 0x7f3280079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.131+0000 7f32937fe640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3280077460 0x7f3280079920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f327c009230 tx=0x7f327c009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:00.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.134+0000 7f3290ff9640 1 -- 172.21.15.52:0/1870751097 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3284014030 con 0x7f3294100c50 2024-09-06T14:53:00.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.317+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3294062630 con 0x7f3280077460 2024-09-06T14:53:00.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.318+0000 7f3290ff9640 1 -- 172.21.15.52:0/1870751097 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3294062630 con 0x7f3280077460 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3280077460 msgr2=0x7f3280079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3280077460 0x7f3280079920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f327c009230 tx=0x7f327c009560 comp rx=0 tx=0).stop 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294100c50 msgr2=0x7f32941010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294100c50 0x7f32941010b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f328400c920 tx=0x7f328400cde0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 shutdown_connections 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3294100c50 0x7f32941010b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3280077460 0x7f3280079920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 --2- 172.21.15.52:0/1870751097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32941033d0 0x7f3294100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 >> 172.21.15.52:0/1870751097 conn(0x7f32940fc550 msgr2=0x7f3294103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:00.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 shutdown_connections 2024-09-06T14:53:00.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.320+0000 7f329a256640 1 -- 172.21.15.52:0/1870751097 wait complete. 2024-09-06T14:53:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 -- 172.21.15.52:0/802837096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8107910 msgr2=0x7fe2e8107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/802837096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8107910 0x7fe2e8107cf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009880 tx=0x7fe2d802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 -- 172.21.15.52:0/802837096 shutdown_connections 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/802837096 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2e8101910 0x7fe2e8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/802837096 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8107910 0x7fe2e8107cf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 -- 172.21.15.52:0/802837096 >> 172.21.15.52:0/802837096 conn(0x7fe2e80fd630 msgr2=0x7fe2e80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 -- 172.21.15.52:0/802837096 shutdown_connections 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 -- 172.21.15.52:0/802837096 wait complete. 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.404+0000 7fe2ee45c640 1 Processor -- start 2024-09-06T14:53:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2ee45c640 1 -- start start 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2ee45c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8101910 0x7fe2e819f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2ee45c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2e8107910 0x7fe2e819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2ee45c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e810edc0 con 0x7fe2e8101910 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2ee45c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e810ec40 con 0x7fe2e8107910 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8101910 0x7fe2e819f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8101910 0x7fe2e819f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51938/0 (socket says 172.21.15.52:51938) 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e7fff640 1 -- 172.21.15.52:0/2566589266 learned_addr learned my addr 172.21.15.52:0/2566589266 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e77fe640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2e8107910 0x7fe2e819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e7fff640 1 -- 172.21.15.52:0/2566589266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2e8107910 msgr2=0x7fe2e819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e7fff640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2e8107910 0x7fe2e819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e7fff640 1 -- 172.21.15.52:0/2566589266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e81a03b0 con 0x7fe2e8101910 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.405+0000 7fe2e77fe640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2e8107910 0x7fe2e819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.406+0000 7fe2e7fff640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8101910 0x7fe2e819f7c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8031460 tx=0x7fe2d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.406+0000 7fe2e57fa640 1 -- 172.21.15.52:0/2566589266 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2d803f070 con 0x7fe2e8101910 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.406+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e8199a40 con 0x7fe2e8101910 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.406+0000 7fe2e57fa640 1 -- 172.21.15.52:0/2566589266 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2d80044d0 con 0x7fe2e8101910 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.406+0000 7fe2e57fa640 1 -- 172.21.15.52:0/2566589266 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2d8035030 con 0x7fe2e8101910 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.406+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e8199f40 con 0x7fe2e8101910 2024-09-06T14:53:00.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.407+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e8103050 con 0x7fe2e8101910 2024-09-06T14:53:00.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.408+0000 7fe2e57fa640 1 -- 172.21.15.52:0/2566589266 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe2d8042070 con 0x7fe2e8101910 2024-09-06T14:53:00.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.408+0000 7fe2e57fa640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe2d00774b0 0x7fe2d0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.408+0000 7fe2e57fa640 1 -- 172.21.15.52:0/2566589266 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6489+0+0 (secure 0 0 0) 0x7fe2d80ba230 con 0x7fe2e8101910 2024-09-06T14:53:00.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.408+0000 7fe2e77fe640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe2d00774b0 0x7fe2d0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.409+0000 7fe2e77fe640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe2d00774b0 0x7fe2d0079970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8100090 tx=0x7fe2dc00a5c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:00.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.412+0000 7fe2e57fa640 1 -- 172.21.15.52:0/2566589266 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe2d8083210 con 0x7fe2e8101910 2024-09-06T14:53:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.581+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe2e819a2b0 con 0x7fe2d00774b0 2024-09-06T14:53:00.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.592+0000 7fe2e57fa640 1 -- 172.21.15.52:0/2566589266 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe2e819a2b0 con 0x7fe2d00774b0 2024-09-06T14:53:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:53:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (5m) 119s ago 16m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:53:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (8m) 119s ago 16m 8921k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:53:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (7m) 19s ago 15m 9084k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (3m) 119s ago 16m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (3m) 19s ago 15m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (5m) 119s ago 16m 79.1M - c8b91775d855 af78eb451b94 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 starting - - - - 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (11m) 119s ago 11m 145M - 19.1.1-268-g635ed4cf b6db46a449e5 5fc06b7e6ff2 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (11m) 19s ago 11m 26.8M - 19.1.1-268-g635ed4cf b6db46a449e5 8596711d4240 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (11m) 19s ago 11m 26.7M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (7m) 119s ago 17m 521M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (6m) 19s ago 15m 457M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:53:00.590 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (4m) 119s ago 17m 41.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (3m) 19s ago 15m 36.6M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (6m) 119s ago 16m 10.6M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 19s ago 15m 11.4M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (3m) 119s ago 14m 90.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (2m) 119s ago 13m 97.7M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (2m) 119s ago 13m 12.2M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (89s) 19s ago 13m 91.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (55s) 19s ago 12m 84.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (22s) 19s ago 12m 14.4M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:53:00.591 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (5m) 119s ago 15m 58.7M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:53:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe2d00774b0 msgr2=0x7fe2d0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe2d00774b0 0x7fe2d0079970 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8100090 tx=0x7fe2dc00a5c0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8101910 msgr2=0x7fe2e819f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8101910 0x7fe2e819f7c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8031460 tx=0x7fe2d80048f0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 shutdown_connections 2024-09-06T14:53:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe2d00774b0 0x7fe2d0079970 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe2e8107910 0x7fe2e819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 --2- 172.21.15.52:0/2566589266 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe2e8101910 0x7fe2e819f7c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 >> 172.21.15.52:0/2566589266 conn(0x7fe2e80fd630 msgr2=0x7fe2e80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 shutdown_connections 2024-09-06T14:53:00.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.594+0000 7fe2ee45c640 1 -- 172.21.15.52:0/2566589266 wait complete. 2024-09-06T14:53:00.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 -- 172.21.15.52:0/2778277057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 msgr2=0x7fdac4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 --2- 172.21.15.52:0/2778277057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac4107ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009880 tx=0x7fdab402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 -- 172.21.15.52:0/2778277057 shutdown_connections 2024-09-06T14:53:00.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 --2- 172.21.15.52:0/2778277057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac4101900 0x7fdac4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 --2- 172.21.15.52:0/2778277057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac4107ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 -- 172.21.15.52:0/2778277057 >> 172.21.15.52:0/2778277057 conn(0x7fdac40fd5e0 msgr2=0x7fdac40ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:00.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 -- 172.21.15.52:0/2778277057 shutdown_connections 2024-09-06T14:53:00.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 -- 172.21.15.52:0/2778277057 wait complete. 2024-09-06T14:53:00.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 Processor -- start 2024-09-06T14:53:00.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.693+0000 7fdaca875640 1 -- start start 2024-09-06T14:53:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdaca875640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac4101900 0x7fdac419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdaca875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdaca875640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdac410edb0 con 0x7fdac4107900 2024-09-06T14:53:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdaca875640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdac410ec30 con 0x7fdac4101900 2024-09-06T14:53:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdac37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdac37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51958/0 (socket says 172.21.15.52:51958) 2024-09-06T14:53:00.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdac37fe640 1 -- 172.21.15.52:0/1052041834 learned_addr learned my addr 172.21.15.52:0/1052041834 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdac3fff640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac4101900 0x7fdac419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdac37fe640 1 -- 172.21.15.52:0/1052041834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac4101900 msgr2=0x7fdac419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdac37fe640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac4101900 0x7fdac419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.694+0000 7fdac37fe640 1 -- 172.21.15.52:0/1052041834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac41977a0 con 0x7fdac4107900 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.695+0000 7fdac37fe640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac419db60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdab800c8a0 tx=0x7fdab800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.695+0000 7fdac17fa640 1 -- 172.21.15.52:0/1052041834 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab80079b0 con 0x7fdac4107900 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.695+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac4197a90 con 0x7fdac4107900 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.695+0000 7fdac17fa640 1 -- 172.21.15.52:0/1052041834 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdab8007b50 con 0x7fdac4107900 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.695+0000 7fdac17fa640 1 -- 172.21.15.52:0/1052041834 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab8018700 con 0x7fdac4107900 2024-09-06T14:53:00.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.695+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac4198020 con 0x7fdac4107900 2024-09-06T14:53:00.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.696+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac4103040 con 0x7fdac4107900 2024-09-06T14:53:00.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.697+0000 7fdac17fa640 1 -- 172.21.15.52:0/1052041834 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fdab8007d00 con 0x7fdac4107900 2024-09-06T14:53:00.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.697+0000 7fdac17fa640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdaac077460 0x7fdaac079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:00.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.698+0000 7fdac3fff640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdaac077460 0x7fdaac079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:00.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.698+0000 7fdac17fa640 1 -- 172.21.15.52:0/1052041834 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6489+0+0 (secure 0 0 0) 0x7fdab80999f0 con 0x7fdac4107900 2024-09-06T14:53:00.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.698+0000 7fdac3fff640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdaac077460 0x7fdaac079920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdab4000c00 tx=0x7fdab4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:00.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.702+0000 7fdac17fa640 1 -- 172.21.15.52:0/1052041834 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fdab8014030 con 0x7fdac4107900 2024-09-06T14:53:00.953 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:00 smithi052 ceph-mon[112917]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:00.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.956+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdac4198d00 con 0x7fdac4107900 2024-09-06T14:53:00.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.957+0000 7fdac17fa640 1 -- 172.21.15.52:0/1052041834 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fdac4198d00 con 0x7fdac4107900 2024-09-06T14:53:00.954 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:53:00.954 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:53:00.954 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:53:00.954 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:00.954 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 3, 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 1 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 3, 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 11 2024-09-06T14:53:00.955 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:53:00.956 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:53:00.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdaac077460 msgr2=0x7fdaac079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdaac077460 0x7fdaac079920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdab4000c00 tx=0x7fdab4031400 comp rx=0 tx=0).stop 2024-09-06T14:53:00.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 msgr2=0x7fdac419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:00.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac419db60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdab800c8a0 tx=0x7fdab800cd60 comp rx=0 tx=0).stop 2024-09-06T14:53:00.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 shutdown_connections 2024-09-06T14:53:00.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdac4107900 0x7fdac419db60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdaac077460 0x7fdaac079920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 --2- 172.21.15.52:0/1052041834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdac4101900 0x7fdac419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:00.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 >> 172.21.15.52:0/1052041834 conn(0x7fdac40fd5e0 msgr2=0x7fdac40feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:00.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 shutdown_connections 2024-09-06T14:53:00.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:00.959+0000 7fdaca875640 1 -- 172.21.15.52:0/1052041834 wait complete. 2024-09-06T14:53:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.043+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3626941525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4101900 msgr2=0x7f4ea4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.043+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3626941525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4101900 0x7f4ea4101d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c009880 tx=0x7f4e8c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3626941525 shutdown_connections 2024-09-06T14:53:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3626941525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4101900 0x7f4ea4101d60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3626941525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea4107900 0x7f4ea4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3626941525 >> 172.21.15.52:0/3626941525 conn(0x7f4ea40fd5e0 msgr2=0x7f4ea40ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3626941525 shutdown_connections 2024-09-06T14:53:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3626941525 wait complete. 2024-09-06T14:53:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 Processor -- start 2024-09-06T14:53:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.044+0000 7f4ea8e89640 1 -- start start 2024-09-06T14:53:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea8e89640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea4101900 0x7f4ea419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea8e89640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4107900 0x7f4ea419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea8e89640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea410edb0 con 0x7f4ea4107900 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea8e89640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea410ec30 con 0x7f4ea4101900 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4107900 0x7f4ea419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4107900 0x7f4ea419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51978/0 (socket says 172.21.15.52:51978) 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea1d9b640 1 -- 172.21.15.52:0/3297090889 learned_addr learned my addr 172.21.15.52:0/3297090889 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea259c640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea4101900 0x7f4ea419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea1d9b640 1 -- 172.21.15.52:0/3297090889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea4101900 msgr2=0x7f4ea419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea1d9b640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea4101900 0x7f4ea419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea1d9b640 1 -- 172.21.15.52:0/3297090889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea41999b0 con 0x7f4ea4107900 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea259c640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea4101900 0x7f4ea419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:53:01.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.045+0000 7f4ea1d9b640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4107900 0x7f4ea419fd30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c031460 tx=0x7f4e8c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.046+0000 7f4e9b7fe640 1 -- 172.21.15.52:0/3297090889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c03f070 con 0x7f4ea4107900 2024-09-06T14:53:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.046+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea4199c40 con 0x7f4ea4107900 2024-09-06T14:53:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.046+0000 7f4e9b7fe640 1 -- 172.21.15.52:0/3297090889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e8c004cf0 con 0x7f4ea4107900 2024-09-06T14:53:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.046+0000 7f4e9b7fe640 1 -- 172.21.15.52:0/3297090889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e8c035030 con 0x7f4ea4107900 2024-09-06T14:53:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.046+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea419a170 con 0x7f4ea4107900 2024-09-06T14:53:01.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.047+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea4103040 con 0x7f4ea4107900 2024-09-06T14:53:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.047+0000 7f4e9b7fe640 1 -- 172.21.15.52:0/3297090889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4e8c042070 con 0x7f4ea4107900 2024-09-06T14:53:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.048+0000 7f4e9b7fe640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4e90077460 0x7f4e90079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.048+0000 7f4e9b7fe640 1 -- 172.21.15.52:0/3297090889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6489+0+0 (secure 0 0 0) 0x7f4e8c0ba290 con 0x7f4ea4107900 2024-09-06T14:53:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.048+0000 7f4ea259c640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4e90077460 0x7f4e90079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.049+0000 7f4ea259c640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4e90077460 0x7f4e90079920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e940058c0 tx=0x7f4e94005d50 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:01.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.052+0000 7f4e9b7fe640 1 -- 172.21.15.52:0/3297090889 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4e8c083190 con 0x7f4ea4107900 2024-09-06T14:53:01.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:00 smithi165 ceph-mon[82925]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.241+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4ea419afc0 con 0x7f4ea4107900 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.242+0000 7f4e9b7fe640 1 -- 172.21.15.52:0/3297090889 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+2002 (secure 0 0 0) 0x7f4ea419afc0 con 0x7f4ea4107900 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stdout:e24 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:52:55:604062+0000 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:53:01.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:53:01.240 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:53:01.241 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34338} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3913146670,v1:172.21.15.52:6829/3913146670] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/3987199510,v1:172.21.15.165:6827/3987199510] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:01.242 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3871572907,v1:172.21.15.165:6825/3871572907] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-06T14:53:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4e90077460 msgr2=0x7f4e90079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4e90077460 0x7f4e90079920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e940058c0 tx=0x7f4e94005d50 comp rx=0 tx=0).stop 2024-09-06T14:53:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4107900 msgr2=0x7f4ea419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4107900 0x7f4ea419fd30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c031460 tx=0x7f4e8c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 shutdown_connections 2024-09-06T14:53:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ea4107900 0x7f4ea419fd30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4e90077460 0x7f4e90079920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 --2- 172.21.15.52:0/3297090889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4ea4101900 0x7f4ea419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 >> 172.21.15.52:0/3297090889 conn(0x7f4ea40fd5e0 msgr2=0x7f4ea4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 shutdown_connections 2024-09-06T14:53:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.244+0000 7f4ea8e89640 1 -- 172.21.15.52:0/3297090889 wait complete. 2024-09-06T14:53:01.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 -- 172.21.15.52:0/3879731605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398101900 msgr2=0x7f0398101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 --2- 172.21.15.52:0/3879731605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398101900 0x7f0398101d60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f038c009880 tx=0x7f038c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 -- 172.21.15.52:0/3879731605 shutdown_connections 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 --2- 172.21.15.52:0/3879731605 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398101900 0x7f0398101d60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 --2- 172.21.15.52:0/3879731605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0398107900 0x7f0398107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 -- 172.21.15.52:0/3879731605 >> 172.21.15.52:0/3879731605 conn(0x7f03980fd600 msgr2=0x7f03980ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 -- 172.21.15.52:0/3879731605 shutdown_connections 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.330+0000 7f039d9b3640 1 -- 172.21.15.52:0/3879731605 wait complete. 2024-09-06T14:53:01.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.331+0000 7f039d9b3640 1 Processor -- start 2024-09-06T14:53:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.331+0000 7f039d9b3640 1 -- start start 2024-09-06T14:53:01.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.331+0000 7f039d9b3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0398101900 0x7f039819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.331+0000 7f039d9b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398107900 0x7f039819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.331+0000 7f039d9b3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f039810edd0 con 0x7f0398107900 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.331+0000 7f039d9b3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f039810ec50 con 0x7f0398101900 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.331+0000 7f03967fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398107900 0x7f039819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f03967fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398107900 0x7f039819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51994/0 (socket says 172.21.15.52:51994) 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f03967fc640 1 -- 172.21.15.52:0/819127173 learned_addr learned my addr 172.21.15.52:0/819127173 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f0396ffd640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0398101900 0x7f039819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f03967fc640 1 -- 172.21.15.52:0/819127173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0398101900 msgr2=0x7f039819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f03967fc640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0398101900 0x7f039819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f03967fc640 1 -- 172.21.15.52:0/819127173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03981977a0 con 0x7f0398107900 2024-09-06T14:53:01.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f0396ffd640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0398101900 0x7f039819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:53:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f03967fc640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398107900 0x7f039819db60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f038c031460 tx=0x7f038c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f039c9b1640 1 -- 172.21.15.52:0/819127173 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f038c03f070 con 0x7f0398107900 2024-09-06T14:53:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0398197a30 con 0x7f0398107900 2024-09-06T14:53:01.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f039c9b1640 1 -- 172.21.15.52:0/819127173 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f038c004a90 con 0x7f0398107900 2024-09-06T14:53:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f039c9b1640 1 -- 172.21.15.52:0/819127173 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f038c035030 con 0x7f0398107900 2024-09-06T14:53:01.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.332+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0398197f60 con 0x7f0398107900 2024-09-06T14:53:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.333+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0398103040 con 0x7f0398107900 2024-09-06T14:53:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.334+0000 7f039c9b1640 1 -- 172.21.15.52:0/819127173 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f038c042070 con 0x7f0398107900 2024-09-06T14:53:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.334+0000 7f039c9b1640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0380077460 0x7f0380079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.335+0000 7f039c9b1640 1 -- 172.21.15.52:0/819127173 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6489+0+0 (secure 0 0 0) 0x7f038c0ba360 con 0x7f0398107900 2024-09-06T14:53:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.335+0000 7f0396ffd640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0380077460 0x7f0380079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.335+0000 7f0396ffd640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0380077460 0x7f0380079920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0388009c20 tx=0x7f0388005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:01.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.338+0000 7f039c9b1640 1 -- 172.21.15.52:0/819127173 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f038c083220 con 0x7f0398107900 2024-09-06T14:53:01.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.518+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0398198210 con 0x7f0380077460 2024-09-06T14:53:01.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.519+0000 7f039c9b1640 1 -- 172.21.15.52:0/819127173 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0398198210 con 0x7f0380077460 2024-09-06T14:53:01.516 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:53:01.516 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:53:01.516 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "13/23 daemons upgraded", 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:53:01.517 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:53:01.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.522+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0380077460 msgr2=0x7f0380079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.522+0000 7f039d9b3640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0380077460 0x7f0380079920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0388009c20 tx=0x7f0388005f90 comp rx=0 tx=0).stop 2024-09-06T14:53:01.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.522+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398107900 msgr2=0x7f039819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.522+0000 7f039d9b3640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398107900 0x7f039819db60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f038c031460 tx=0x7f038c004530 comp rx=0 tx=0).stop 2024-09-06T14:53:01.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.523+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 shutdown_connections 2024-09-06T14:53:01.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.523+0000 7f039d9b3640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0398107900 0x7f039819db60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.523+0000 7f039d9b3640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0380077460 0x7f0380079920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.523+0000 7f039d9b3640 1 --2- 172.21.15.52:0/819127173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0398101900 0x7f039819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.523+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 >> 172.21.15.52:0/819127173 conn(0x7f03980fd600 msgr2=0x7f03980fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:01.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.523+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 shutdown_connections 2024-09-06T14:53:01.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.523+0000 7f039d9b3640 1 -- 172.21.15.52:0/819127173 wait complete. 2024-09-06T14:53:01.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.608+0000 7fcd08275640 1 -- 172.21.15.52:0/502963857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 msgr2=0x7fcd00100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.608+0000 7fcd08275640 1 --2- 172.21.15.52:0/502963857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd00100c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009880 tx=0x7fccfc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.609+0000 7fcd08275640 1 -- 172.21.15.52:0/502963857 shutdown_connections 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.609+0000 7fcd08275640 1 --2- 172.21.15.52:0/502963857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd00100c50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.609+0000 7fcd08275640 1 --2- 172.21.15.52:0/502963857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd001067f0 0x7fcd00106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.609+0000 7fcd08275640 1 -- 172.21.15.52:0/502963857 >> 172.21.15.52:0/502963857 conn(0x7fcd000fc550 msgr2=0x7fcd000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.609+0000 7fcd08275640 1 -- 172.21.15.52:0/502963857 shutdown_connections 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.609+0000 7fcd08275640 1 -- 172.21.15.52:0/502963857 wait complete. 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd08275640 1 Processor -- start 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd08275640 1 -- start start 2024-09-06T14:53:01.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd08275640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd0019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd08275640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd001067f0 0x7fcd0019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd08275640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0010dcc0 con 0x7fcd001007f0 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd08275640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0010db40 con 0x7fcd001067f0 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd06011640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd0019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd06011640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd0019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52006/0 (socket says 172.21.15.52:52006) 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd06011640 1 -- 172.21.15.52:0/3575320612 learned_addr learned my addr 172.21.15.52:0/3575320612 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd05810640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd001067f0 0x7fcd0019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd06011640 1 -- 172.21.15.52:0/3575320612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd001067f0 msgr2=0x7fcd0019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd06011640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd001067f0 0x7fcd0019dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.610+0000 7fcd06011640 1 -- 172.21.15.52:0/3575320612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd001977e0 con 0x7fcd001007f0 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.611+0000 7fcd06011640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd0019d660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fccf400d6f0 tx=0x7fccf400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:01.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.611+0000 7fccf37fe640 1 -- 172.21.15.52:0/3575320612 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccf4017070 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.611+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd00197ad0 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.611+0000 7fccf37fe640 1 -- 172.21.15.52:0/3575320612 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccf400de00 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.611+0000 7fccf37fe640 1 -- 172.21.15.52:0/3575320612 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccf4004bb0 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.611+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd00198030 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.612+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd00101f30 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.613+0000 7fccf37fe640 1 -- 172.21.15.52:0/3575320612 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fccf4009a30 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.613+0000 7fccf37fe640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccec0774b0 0x7fccec079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.613+0000 7fccf37fe640 1 -- 172.21.15.52:0/3575320612 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 6489+0+0 (secure 0 0 0) 0x7fccf4099270 con 0x7fcd001007f0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.613+0000 7fcd05810640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccec0774b0 0x7fccec079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:01.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.614+0000 7fcd05810640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccec0774b0 0x7fccec079970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd00198b30 tx=0x7fccfc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:01.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.617+0000 7fccf37fe640 1 -- 172.21.15.52:0/3575320612 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fccf40663c0 con 0x7fcd001007f0 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: pgmap v260: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1052041834' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3297090889' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:53:01.824 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:01.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.858+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcd00109d70 con 0x7fcd001007f0 2024-09-06T14:53:01.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.858+0000 7fccf37fe640 1 -- 172.21.15.52:0/3575320612 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7fccf406ade0 con 0x7fcd001007f0 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:53:01.856 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:53:01.857 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:53:01.857 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:53:01.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccec0774b0 msgr2=0x7fccec079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccec0774b0 0x7fccec079970 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd00198b30 tx=0x7fccfc031400 comp rx=0 tx=0).stop 2024-09-06T14:53:01.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 msgr2=0x7fcd0019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd0019d660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fccf400d6f0 tx=0x7fccf400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 shutdown_connections 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccec0774b0 0x7fccec079970 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd001067f0 0x7fcd0019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 --2- 172.21.15.52:0/3575320612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd001007f0 0x7fcd0019d660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 >> 172.21.15.52:0/3575320612 conn(0x7fcd000fc550 msgr2=0x7fcd00069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.860+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 shutdown_connections 2024-09-06T14:53:01.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:01.861+0000 7fcd08275640 1 -- 172.21.15.52:0/3575320612 wait complete. 2024-09-06T14:53:02.122 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: pgmap v260: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1052041834' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3297090889' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:02.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:03.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:02 smithi165 ceph-mon[82925]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:03.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:02 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3575320612' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:53:03.112 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:02 smithi052 ceph-mon[112917]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:03.112 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:02 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3575320612' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:53:04.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:03 smithi052 ceph-mon[112917]: pgmap v261: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:04.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:03 smithi165 ceph-mon[82925]: pgmap v261: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:06.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: pgmap v262: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:06.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:06.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:06.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:06 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:06.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: pgmap v262: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:06.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:06 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:07.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:07 smithi165 ceph-mon[82925]: pgmap v263: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:07 smithi165 ceph-mon[82925]: Upgrade: Updating mds.cephfs.smithi052.eqtxfx 2024-09-06T14:53:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.eqtxfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:53:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:07 smithi165 ceph-mon[82925]: Deploying daemon mds.cephfs.smithi052.eqtxfx on smithi052 2024-09-06T14:53:07.842 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:07 smithi052 ceph-mon[112917]: pgmap v263: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:07.843 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:07 smithi052 ceph-mon[112917]: Upgrade: Updating mds.cephfs.smithi052.eqtxfx 2024-09-06T14:53:07.843 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:07.843 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi052.eqtxfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:53:07.843 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:07.843 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:07 smithi052 ceph-mon[112917]: Deploying daemon mds.cephfs.smithi052.eqtxfx on smithi052 2024-09-06T14:53:08.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:08.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:09.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:09 smithi165 ceph-mon[82925]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:09.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:09 smithi165 ceph-mon[82925]: osdmap e89: 6 total, 6 up, 6 in 2024-09-06T14:53:09.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:09 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:53:09.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:09 smithi052 ceph-mon[112917]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:09.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:09 smithi052 ceph-mon[112917]: osdmap e89: 6 total, 6 up, 6 in 2024-09-06T14:53:09.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:09 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:53:11.852 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:11 smithi052 ceph-mon[112917]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:12.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:11 smithi165 ceph-mon[82925]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:13.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:13 smithi165 ceph-mon[82925]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:13 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:boot 2024-09-06T14:53:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:13 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:53:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"} : dispatch 2024-09-06T14:53:13.604 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:13 smithi052 ceph-mon[112917]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:13.604 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:13.604 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:13.604 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:13.604 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:13 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:boot 2024-09-06T14:53:13.605 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:13 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:53:13.605 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi052.eqtxfx"} : dispatch 2024-09-06T14:53:15.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:15 smithi052 ceph-mon[112917]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:15.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:15 smithi165 ceph-mon[82925]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:17.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:17 smithi165 ceph-mon[82925]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:17.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:17 smithi052 ceph-mon[112917]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:18.691 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:18 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:18.692 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:18 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:18.692 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:18 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:18.692 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:18 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:18.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:18 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:18.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:18 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:18.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:18 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:18.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:18 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:20.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:20 smithi165 ceph-mon[82925]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:20.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:20 smithi052 ceph-mon[112917]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:22.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:22.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:22.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:22.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:22.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:53:22.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:22.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:22.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:22.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:22.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:22.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:22.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:22.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:23.340 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:23.340 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:23.340 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.nmjcsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:53:23.340 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.nmjcsh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:53:23.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:24.344 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:24 smithi165 ceph-mon[82925]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:24.344 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:24 smithi165 ceph-mon[82925]: Upgrade: Updating mds.cephfs.smithi165.nmjcsh 2024-09-06T14:53:24.344 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:24 smithi165 ceph-mon[82925]: Deploying daemon mds.cephfs.smithi165.nmjcsh on smithi165 2024-09-06T14:53:24.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:24 smithi052 ceph-mon[112917]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:24.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:24 smithi052 ceph-mon[112917]: Upgrade: Updating mds.cephfs.smithi165.nmjcsh 2024-09-06T14:53:24.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:24 smithi052 ceph-mon[112917]: Deploying daemon mds.cephfs.smithi165.nmjcsh on smithi165 2024-09-06T14:53:26.341 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:26 smithi165 ceph-mon[82925]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:26.341 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:26 smithi165 ceph-mon[82925]: osdmap e90: 6 total, 6 up, 6 in 2024-09-06T14:53:26.341 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:26 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:53:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:26 smithi052 ceph-mon[112917]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:26 smithi052 ceph-mon[112917]: osdmap e90: 6 total, 6 up, 6 in 2024-09-06T14:53:26.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:26 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:53:28.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:28 smithi165 ceph-mon[82925]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:28.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:28 smithi052 ceph-mon[112917]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:29 smithi165 ceph-mon[82925]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:29 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] up:boot 2024-09-06T14:53:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:29 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:53:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:29 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"} : dispatch 2024-09-06T14:53:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:29 smithi052 ceph-mon[112917]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:29 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] up:boot 2024-09-06T14:53:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:29 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:53:29.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:29 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.nmjcsh"} : dispatch 2024-09-06T14:53:31.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 -- 172.21.15.52:0/4035629685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c1033e0 msgr2=0x7f831c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:31.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 --2- 172.21.15.52:0/4035629685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c1033e0 0x7f831c10b8d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8310009880 tx=0x7f831002a530 comp rx=0 tx=0).stop 2024-09-06T14:53:31.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 -- 172.21.15.52:0/4035629685 shutdown_connections 2024-09-06T14:53:31.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 --2- 172.21.15.52:0/4035629685 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c1033e0 0x7f831c10b8d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:31.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 --2- 172.21.15.52:0/4035629685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f831c102ac0 0x7f831c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:31.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 -- 172.21.15.52:0/4035629685 >> 172.21.15.52:0/4035629685 conn(0x7f831c0fc520 msgr2=0x7f831c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:31.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 -- 172.21.15.52:0/4035629685 shutdown_connections 2024-09-06T14:53:31.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.958+0000 7f83209af640 1 -- 172.21.15.52:0/4035629685 wait complete. 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.959+0000 7f83209af640 1 Processor -- start 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.959+0000 7f83209af640 1 -- start start 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.959+0000 7f83209af640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c102ac0 0x7f831c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.959+0000 7f83209af640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f831c1033e0 0x7f831c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.959+0000 7f83209af640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f831c10edf0 con 0x7f831c102ac0 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.959+0000 7f83209af640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f831c10ec70 con 0x7f831c1033e0 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.959+0000 7f831a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c102ac0 0x7f831c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f831a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c102ac0 0x7f831c19f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55942/0 (socket says 172.21.15.52:55942) 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f831a59c640 1 -- 172.21.15.52:0/2801564862 learned_addr learned my addr 172.21.15.52:0/2801564862 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f8319d9b640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f831c1033e0 0x7f831c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:31.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f831a59c640 1 -- 172.21.15.52:0/2801564862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f831c1033e0 msgr2=0x7f831c19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f831a59c640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f831c1033e0 0x7f831c19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f831a59c640 1 -- 172.21.15.52:0/2801564862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c199ab0 con 0x7f831c102ac0 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f8319d9b640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f831c1033e0 0x7f831c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f831a59c640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c102ac0 0x7f831c19f8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f830c00e970 tx=0x7f830c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f830b7fe640 1 -- 172.21.15.52:0/2801564862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f830c00cac0 con 0x7f831c102ac0 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f830b7fe640 1 -- 172.21.15.52:0/2801564862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f830c0054e0 con 0x7f831c102ac0 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831c199da0 con 0x7f831c102ac0 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f830b7fe640 1 -- 172.21.15.52:0/2801564862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f830c010430 con 0x7f831c102ac0 2024-09-06T14:53:31.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.960+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831c19a300 con 0x7f831c102ac0 2024-09-06T14:53:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.961+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831c06aa90 con 0x7f831c102ac0 2024-09-06T14:53:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.962+0000 7f830b7fe640 1 -- 172.21.15.52:0/2801564862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f830c004e80 con 0x7f831c102ac0 2024-09-06T14:53:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.962+0000 7f830b7fe640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8304077460 0x7f8304079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.963+0000 7f830b7fe640 1 -- 172.21.15.52:0/2801564862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6489+0+0 (secure 0 0 0) 0x7f830c099f30 con 0x7f831c102ac0 2024-09-06T14:53:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.963+0000 7f8319d9b640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8304077460 0x7f8304079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:31.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.963+0000 7f8319d9b640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8304077460 0x7f8304079920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f831c19b2a0 tx=0x7f8310031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:31.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:31.967+0000 7f830b7fe640 1 -- 172.21.15.52:0/2801564862 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f830c062df0 con 0x7f831c102ac0 2024-09-06T14:53:32.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.144+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f831c19afe0 con 0x7f8304077460 2024-09-06T14:53:32.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.145+0000 7f830b7fe640 1 -- 172.21.15.52:0/2801564862 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f831c19afe0 con 0x7f8304077460 2024-09-06T14:53:32.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8304077460 msgr2=0x7f8304079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8304077460 0x7f8304079920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f831c19b2a0 tx=0x7f8310031400 comp rx=0 tx=0).stop 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c102ac0 msgr2=0x7f831c19f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c102ac0 0x7f831c19f8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f830c00e970 tx=0x7f830c00ed70 comp rx=0 tx=0).stop 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 shutdown_connections 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8304077460 0x7f8304079920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f831c1033e0 0x7f831c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 --2- 172.21.15.52:0/2801564862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f831c102ac0 0x7f831c19f8f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 >> 172.21.15.52:0/2801564862 conn(0x7f831c0fc520 msgr2=0x7f831c100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:32.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 shutdown_connections 2024-09-06T14:53:32.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.147+0000 7f83209af640 1 -- 172.21.15.52:0/2801564862 wait complete. 2024-09-06T14:53:32.153 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:53:32.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 -- 172.21.15.52:0/3104352988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4101900 msgr2=0x7f80d4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 --2- 172.21.15.52:0/3104352988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4101900 0x7f80d4101d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009880 tx=0x7f80c802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 -- 172.21.15.52:0/3104352988 shutdown_connections 2024-09-06T14:53:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 --2- 172.21.15.52:0/3104352988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4101900 0x7f80d4101d60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 --2- 172.21.15.52:0/3104352988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80d4107900 0x7f80d4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 -- 172.21.15.52:0/3104352988 >> 172.21.15.52:0/3104352988 conn(0x7f80d40fd600 msgr2=0x7f80d40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:32.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:32 smithi052 ceph-mon[112917]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:32.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:32 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:32 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.230 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:32 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.230 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:32 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 -- 172.21.15.52:0/3104352988 shutdown_connections 2024-09-06T14:53:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.231+0000 7f80d8a55640 1 -- 172.21.15.52:0/3104352988 wait complete. 2024-09-06T14:53:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d8a55640 1 Processor -- start 2024-09-06T14:53:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d8a55640 1 -- start start 2024-09-06T14:53:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d8a55640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80d4101900 0x7f80d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d8a55640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4107900 0x7f80d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d8a55640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80d410edd0 con 0x7f80d4107900 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d8a55640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f80d410ec50 con 0x7f80d4101900 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4107900 0x7f80d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4107900 0x7f80d4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55950/0 (socket says 172.21.15.52:55950) 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d1d9b640 1 -- 172.21.15.52:0/2467031152 learned_addr learned my addr 172.21.15.52:0/2467031152 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.232+0000 7f80d259c640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80d4101900 0x7f80d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80d1d9b640 1 -- 172.21.15.52:0/2467031152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80d4101900 msgr2=0x7f80d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80d1d9b640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80d4101900 0x7f80d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80d1d9b640 1 -- 172.21.15.52:0/2467031152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d4074f70 con 0x7f80d4107900 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80d1d9b640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4107900 0x7f80d4074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f80c8031460 tx=0x7f80c80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80c37fe640 1 -- 172.21.15.52:0/2467031152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80c803f070 con 0x7f80d4107900 2024-09-06T14:53:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80c37fe640 1 -- 172.21.15.52:0/2467031152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80c80035f0 con 0x7f80d4107900 2024-09-06T14:53:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d4075200 con 0x7f80d4107900 2024-09-06T14:53:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80c37fe640 1 -- 172.21.15.52:0/2467031152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80c8035030 con 0x7f80d4107900 2024-09-06T14:53:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.233+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d41a3d60 con 0x7f80d4107900 2024-09-06T14:53:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.234+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d4103040 con 0x7f80d4107900 2024-09-06T14:53:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.235+0000 7f80c37fe640 1 -- 172.21.15.52:0/2467031152 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f80c8042070 con 0x7f80d4107900 2024-09-06T14:53:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.236+0000 7f80c37fe640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f80bc077460 0x7f80bc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.236+0000 7f80c37fe640 1 -- 172.21.15.52:0/2467031152 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6489+0+0 (secure 0 0 0) 0x7f80c80ba110 con 0x7f80d4107900 2024-09-06T14:53:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.236+0000 7f80d259c640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f80bc077460 0x7f80bc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.236+0000 7f80d259c640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f80bc077460 0x7f80bc079920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80c4005fd0 tx=0x7f80c400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.240+0000 7f80c37fe640 1 -- 172.21.15.52:0/2467031152 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f80c80871e0 con 0x7f80d4107900 2024-09-06T14:53:32.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.420+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f80d4062630 con 0x7f80bc077460 2024-09-06T14:53:32.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.421+0000 7f80c37fe640 1 -- 172.21.15.52:0/2467031152 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f80d4062630 con 0x7f80bc077460 2024-09-06T14:53:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f80bc077460 msgr2=0x7f80bc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f80bc077460 0x7f80bc079920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80c4005fd0 tx=0x7f80c400b390 comp rx=0 tx=0).stop 2024-09-06T14:53:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4107900 msgr2=0x7f80d4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4107900 0x7f80d4074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f80c8031460 tx=0x7f80c80045e0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 shutdown_connections 2024-09-06T14:53:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f80d4107900 0x7f80d4074a30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f80bc077460 0x7f80bc079920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 --2- 172.21.15.52:0/2467031152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f80d4101900 0x7f80d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 >> 172.21.15.52:0/2467031152 conn(0x7f80d40fd600 msgr2=0x7f80d40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 shutdown_connections 2024-09-06T14:53:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.423+0000 7f80d8a55640 1 -- 172.21.15.52:0/2467031152 wait complete. 2024-09-06T14:53:32.464 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:32 smithi165 ceph-mon[82925]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:32.464 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:32 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.464 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:32 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.464 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:32 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.464 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:32 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2764184751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 msgr2=0x7fbe04100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2764184751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe04100c60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009880 tx=0x7fbdf802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2764184751 shutdown_connections 2024-09-06T14:53:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2764184751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe04100c60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2764184751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe04106800 0x7fbe04106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2764184751 >> 172.21.15.52:0/2764184751 conn(0x7fbe040fc520 msgr2=0x7fbe040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2764184751 shutdown_connections 2024-09-06T14:53:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.506+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2764184751 wait complete. 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe0b67a640 1 Processor -- start 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe0b67a640 1 -- start start 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe0b67a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe0419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe0b67a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe04106800 0x7fbe0419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe0b67a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0410dd30 con 0x7fbe04100800 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe0b67a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0410dbb0 con 0x7fbe04106800 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe09416640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe0419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe09416640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe0419f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55968/0 (socket says 172.21.15.52:55968) 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe09416640 1 -- 172.21.15.52:0/2880012060 learned_addr learned my addr 172.21.15.52:0/2880012060 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.507+0000 7fbe08c15640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe04106800 0x7fbe0419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbe09416640 1 -- 172.21.15.52:0/2880012060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe04106800 msgr2=0x7fbe0419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbe09416640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe04106800 0x7fbe0419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbe09416640 1 -- 172.21.15.52:0/2880012060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe04199aa0 con 0x7fbe04100800 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbe08c15640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe04106800 0x7fbe0419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbe09416640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe0419f8e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000b420 tx=0x7fbe0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbdf67fc640 1 -- 172.21.15.52:0/2880012060 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe00011630 con 0x7fbe04100800 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe04199d90 con 0x7fbe04100800 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbdf67fc640 1 -- 172.21.15.52:0/2880012060 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe00016070 con 0x7fbe04100800 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbdf67fc640 1 -- 172.21.15.52:0/2880012060 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe00010d40 con 0x7fbe04100800 2024-09-06T14:53:32.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.508+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0419a2f0 con 0x7fbe04100800 2024-09-06T14:53:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.509+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe04101f40 con 0x7fbe04100800 2024-09-06T14:53:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.510+0000 7fbdf67fc640 1 -- 172.21.15.52:0/2880012060 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbe0001b460 con 0x7fbe04100800 2024-09-06T14:53:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.510+0000 7fbdf67fc640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdf0077460 0x7fbdf0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.511+0000 7fbe08c15640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdf0077460 0x7fbdf0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.511+0000 7fbdf67fc640 1 -- 172.21.15.52:0/2880012060 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6489+0+0 (secure 0 0 0) 0x7fbe00098f90 con 0x7fbe04100800 2024-09-06T14:53:32.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.511+0000 7fbe08c15640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdf0077460 0x7fbdf0079920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe0419b290 tx=0x7fbdf8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:32.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.514+0000 7fbdf67fc640 1 -- 172.21.15.52:0/2880012060 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbe00021250 con 0x7fbe04100800 2024-09-06T14:53:32.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.683+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbe0419b070 con 0x7fbdf0077460 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.693+0000 7fbdf67fc640 1 -- 172.21.15.52:0/2880012060 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbe0419b070 con 0x7fbdf0077460 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (5m) 15s ago 16m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (8m) 15s ago 17m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (8m) 1s ago 16m 9147k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (4m) 15s ago 17m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (4m) 1s ago 16m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:53:32.690 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (5m) 15s ago 16m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (37s) 15s ago 11m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (20s) 15s ago 11m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (4s) 1s ago 11m 14.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (11m) 1s ago 11m 12.5M - 19.1.1-268-g635ed4cf b6db46a449e5 fd8f87bf4485 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (8m) 15s ago 18m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (7m) 1s ago 16m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (4m) 15s ago 18m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (4m) 1s ago 15m 38.1M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:53:32.691 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (6m) 15s ago 16m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (6m) 1s ago 16m 11.0M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (3m) 15s ago 14m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (3m) 15s ago 14m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (2m) 15s ago 13m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (2m) 1s ago 13m 92.9M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (87s) 1s ago 13m 83.7M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (54s) 1s ago 12m 81.7M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:53:32.692 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (6m) 15s ago 16m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdf0077460 msgr2=0x7fbdf0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdf0077460 0x7fbdf0079920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe0419b290 tx=0x7fbdf8031400 comp rx=0 tx=0).stop 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 msgr2=0x7fbe0419f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe0419f8e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000b420 tx=0x7fbe0000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 shutdown_connections 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdf0077460 0x7fbdf0079920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe04106800 0x7fbe0419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 --2- 172.21.15.52:0/2880012060 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe04100800 0x7fbe0419f8e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 >> 172.21.15.52:0/2880012060 conn(0x7fbe040fc520 msgr2=0x7fbe040fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:32.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 shutdown_connections 2024-09-06T14:53:32.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.695+0000 7fbe0b67a640 1 -- 172.21.15.52:0/2880012060 wait complete. 2024-09-06T14:53:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 -- 172.21.15.52:0/2454704931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 msgr2=0x7f3420106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 --2- 172.21.15.52:0/2454704931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f3420106be0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3410009880 tx=0x7f341002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 -- 172.21.15.52:0/2454704931 shutdown_connections 2024-09-06T14:53:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 --2- 172.21.15.52:0/2454704931 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3420100800 0x7f3420100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 --2- 172.21.15.52:0/2454704931 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f3420106be0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 -- 172.21.15.52:0/2454704931 >> 172.21.15.52:0/2454704931 conn(0x7f34200fc520 msgr2=0x7f34200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:32.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 -- 172.21.15.52:0/2454704931 shutdown_connections 2024-09-06T14:53:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.777+0000 7f3425c87640 1 -- 172.21.15.52:0/2454704931 wait complete. 2024-09-06T14:53:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f3425c87640 1 Processor -- start 2024-09-06T14:53:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f3425c87640 1 -- start start 2024-09-06T14:53:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f3425c87640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3420100800 0x7f342019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f3425c87640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f342019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f3425c87640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f342010dcb0 con 0x7f3420106800 2024-09-06T14:53:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f3425c87640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f342010db30 con 0x7f3420100800 2024-09-06T14:53:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f341effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f342019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f341effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f342019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55992/0 (socket says 172.21.15.52:55992) 2024-09-06T14:53:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f341effd640 1 -- 172.21.15.52:0/3706424893 learned_addr learned my addr 172.21.15.52:0/3706424893 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.778+0000 7f341f7fe640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3420100800 0x7f342019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f341effd640 1 -- 172.21.15.52:0/3706424893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3420100800 msgr2=0x7f342019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f341effd640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3420100800 0x7f342019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f341effd640 1 -- 172.21.15.52:0/3706424893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3420197840 con 0x7f3420106800 2024-09-06T14:53:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f341effd640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f342019dc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f341400c810 tx=0x7f341400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:32.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f341cff9640 1 -- 172.21.15.52:0/3706424893 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3414004020 con 0x7f3420106800 2024-09-06T14:53:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3420197b30 con 0x7f3420106800 2024-09-06T14:53:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f341cff9640 1 -- 172.21.15.52:0/3706424893 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34140041c0 con 0x7f3420106800 2024-09-06T14:53:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34201980c0 con 0x7f3420106800 2024-09-06T14:53:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.779+0000 7f341cff9640 1 -- 172.21.15.52:0/3706424893 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34140047a0 con 0x7f3420106800 2024-09-06T14:53:32.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.780+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3420101f40 con 0x7f3420106800 2024-09-06T14:53:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.781+0000 7f341cff9640 1 -- 172.21.15.52:0/3706424893 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f34140079b0 con 0x7f3420106800 2024-09-06T14:53:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.781+0000 7f341cff9640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34080774b0 0x7f3408079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.781+0000 7f341cff9640 1 -- 172.21.15.52:0/3706424893 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6489+0+0 (secure 0 0 0) 0x7f3414099590 con 0x7f3420106800 2024-09-06T14:53:32.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.781+0000 7f341f7fe640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34080774b0 0x7f3408079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.782+0000 7f341f7fe640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34080774b0 0x7f3408079970 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3410000c00 tx=0x7f3410031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:32.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:32.786+0000 7f341cff9640 1 -- 172.21.15.52:0/3706424893 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3414014030 con 0x7f3420106800 2024-09-06T14:53:33.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.005+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f34201983d0 con 0x7f3420106800 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.006+0000 7f341cff9640 1 -- 172.21.15.52:0/3706424893 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f34140666e0 con 0x7f3420106800 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:33.003 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 1, 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 3 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.1.1-268-g635ed4cf (635ed4cf3404d66f56069c438a5e3af26e0ed5be) squid (stable)": 1, 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 13 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:53:33.004 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:53:33.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34080774b0 msgr2=0x7f3408079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34080774b0 0x7f3408079970 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3410000c00 tx=0x7f3410031400 comp rx=0 tx=0).stop 2024-09-06T14:53:33.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 msgr2=0x7f342019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f342019dc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f341400c810 tx=0x7f341400ccd0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 shutdown_connections 2024-09-06T14:53:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3420106800 0x7f342019dc00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34080774b0 0x7f3408079970 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 --2- 172.21.15.52:0/3706424893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3420100800 0x7f342019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.007+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 >> 172.21.15.52:0/3706424893 conn(0x7f34200fc520 msgr2=0x7f342006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.008+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 shutdown_connections 2024-09-06T14:53:33.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.008+0000 7f3425c87640 1 -- 172.21.15.52:0/3706424893 wait complete. 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.090+0000 7f59c87b8640 1 -- 172.21.15.52:0/3835993918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074620 msgr2=0x7f59c0074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.090+0000 7f59c87b8640 1 --2- 172.21.15.52:0/3835993918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074620 0x7f59c0074a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009880 tx=0x7f59bc02a530 comp rx=0 tx=0).stop 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.090+0000 7f59c87b8640 1 -- 172.21.15.52:0/3835993918 shutdown_connections 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.090+0000 7f59c87b8640 1 --2- 172.21.15.52:0/3835993918 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59c0074f40 0x7f59c010dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.090+0000 7f59c87b8640 1 --2- 172.21.15.52:0/3835993918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074620 0x7f59c0074a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.090+0000 7f59c87b8640 1 -- 172.21.15.52:0/3835993918 >> 172.21.15.52:0/3835993918 conn(0x7f59c00fd680 msgr2=0x7f59c00ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 -- 172.21.15.52:0/3835993918 shutdown_connections 2024-09-06T14:53:33.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 -- 172.21.15.52:0/3835993918 wait complete. 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 Processor -- start 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 -- start start 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59c0074620 0x7f59c019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074f40 0x7f59c019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f59c0111060 con 0x7f59c0074f40 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.091+0000 7f59c87b8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f59c0110ee0 con 0x7f59c0074620 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c5d53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074f40 0x7f59c019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c5d53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074f40 0x7f59c019fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56014/0 (socket says 172.21.15.52:56014) 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c5d53640 1 -- 172.21.15.52:0/2751600870 learned_addr learned my addr 172.21.15.52:0/2751600870 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:33.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c6554640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59c0074620 0x7f59c019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c5d53640 1 -- 172.21.15.52:0/2751600870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59c0074620 msgr2=0x7f59c019f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c5d53640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59c0074620 0x7f59c019f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c5d53640 1 -- 172.21.15.52:0/2751600870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c0199a70 con 0x7f59c0074f40 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59c5d53640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074f40 0x7f59c019fdf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59b000e970 tx=0x7f59b000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.092+0000 7f59b77fe640 1 -- 172.21.15.52:0/2751600870 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59b000cac0 con 0x7f59c0074f40 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.093+0000 7f59b77fe640 1 -- 172.21.15.52:0/2751600870 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59b00054e0 con 0x7f59c0074f40 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.093+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c0199d60 con 0x7f59c0074f40 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.093+0000 7f59b77fe640 1 -- 172.21.15.52:0/2751600870 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59b0010430 con 0x7f59c0074f40 2024-09-06T14:53:33.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.093+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c019a2f0 con 0x7f59c0074f40 2024-09-06T14:53:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.094+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c0075cd0 con 0x7f59c0074f40 2024-09-06T14:53:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.094+0000 7f59b77fe640 1 -- 172.21.15.52:0/2751600870 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f59b0004f00 con 0x7f59c0074f40 2024-09-06T14:53:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.095+0000 7f59b77fe640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59ac077460 0x7f59ac079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.095+0000 7f59c6554640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59ac077460 0x7f59ac079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.095+0000 7f59b77fe640 1 -- 172.21.15.52:0/2751600870 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6489+0+0 (secure 0 0 0) 0x7f59b0099e50 con 0x7f59c0074f40 2024-09-06T14:53:33.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.095+0000 7f59c6554640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59ac077460 0x7f59ac079920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f59bc000c00 tx=0x7f59bc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:33.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.099+0000 7f59b77fe640 1 -- 172.21.15.52:0/2751600870 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f59b0062db0 con 0x7f59c0074f40 2024-09-06T14:53:33.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.289+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f59c019afd0 con 0x7f59c0074f40 2024-09-06T14:53:33.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.290+0000 7f59b77fe640 1 -- 172.21.15.52:0/2751600870 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+2002 (secure 0 0 0) 0x7f59b0066f20 con 0x7f59c0074f40 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:e28 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:29:088340+0000 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:53:33.288 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:53:33.289 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:33.290 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:53:33.291 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:53:33.291 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:33.291 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:33.291 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/3987199510,v1:172.21.15.165:6827/3987199510] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:33.291 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 28 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59ac077460 msgr2=0x7f59ac079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59ac077460 0x7f59ac079920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f59bc000c00 tx=0x7f59bc031400 comp rx=0 tx=0).stop 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074f40 msgr2=0x7f59c019fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074f40 0x7f59c019fdf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f59b000e970 tx=0x7f59b000ed70 comp rx=0 tx=0).stop 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 shutdown_connections 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c0074f40 0x7f59c019fdf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f59ac077460 0x7f59ac079920 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 --2- 172.21.15.52:0/2751600870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59c0074620 0x7f59c019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 >> 172.21.15.52:0/2751600870 conn(0x7f59c00fd680 msgr2=0x7f59c010d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:33.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 shutdown_connections 2024-09-06T14:53:33.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.292+0000 7f59c87b8640 1 -- 172.21.15.52:0/2751600870 wait complete. 2024-09-06T14:53:33.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:33 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3706424893' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.376+0000 7f06d208b640 1 -- 172.21.15.52:0/1197763088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102ab0 msgr2=0x7f06cc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.376+0000 7f06d208b640 1 --2- 172.21.15.52:0/1197763088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102ab0 0x7f06cc102e90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009c20 tx=0x7f06bc02aa00 comp rx=0 tx=0).stop 2024-09-06T14:53:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.377+0000 7f06d208b640 1 -- 172.21.15.52:0/1197763088 shutdown_connections 2024-09-06T14:53:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.377+0000 7f06d208b640 1 --2- 172.21.15.52:0/1197763088 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06cc1033d0 0x7f06cc10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.377+0000 7f06d208b640 1 --2- 172.21.15.52:0/1197763088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc102ab0 0x7f06cc102e90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.377+0000 7f06d208b640 1 -- 172.21.15.52:0/1197763088 >> 172.21.15.52:0/1197763088 conn(0x7f06cc0fc550 msgr2=0x7f06cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.377+0000 7f06d208b640 1 -- 172.21.15.52:0/1197763088 shutdown_connections 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.377+0000 7f06d208b640 1 -- 172.21.15.52:0/1197763088 wait complete. 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.377+0000 7f06d208b640 1 Processor -- start 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06d208b640 1 -- start start 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06d208b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06cc102ab0 0x7f06cc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06d208b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc1033d0 0x7f06cc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06d208b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc10ede0 con 0x7f06cc1033d0 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06d208b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc10ec60 con 0x7f06cc102ab0 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc1033d0 0x7f06cc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06caffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc1033d0 0x7f06cc19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56036/0 (socket says 172.21.15.52:56036) 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06caffd640 1 -- 172.21.15.52:0/3768279697 learned_addr learned my addr 172.21.15.52:0/3768279697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.378+0000 7f06cb7fe640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06cc102ab0 0x7f06cc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06caffd640 1 -- 172.21.15.52:0/3768279697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06cc102ab0 msgr2=0x7f06cc19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06caffd640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06cc102ab0 0x7f06cc19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06caffd640 1 -- 172.21.15.52:0/3768279697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc1977b0 con 0x7f06cc1033d0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06caffd640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc1033d0 0x7f06cc19db70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06b400d6d0 tx=0x7f06b400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06c8ff9640 1 -- 172.21.15.52:0/3768279697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06b4017070 con 0x7f06cc1033d0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc197aa0 con 0x7f06cc1033d0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06c8ff9640 1 -- 172.21.15.52:0/3768279697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06b40054e0 con 0x7f06cc1033d0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06c8ff9640 1 -- 172.21.15.52:0/3768279697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06b4004ae0 con 0x7f06cc1033d0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.379+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc198030 con 0x7f06cc1033d0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.380+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06cc06a580 con 0x7f06cc1033d0 2024-09-06T14:53:33.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.381+0000 7f06c8ff9640 1 -- 172.21.15.52:0/3768279697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f06b4004d90 con 0x7f06cc1033d0 2024-09-06T14:53:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.381+0000 7f06c8ff9640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06b80774b0 0x7f06b8079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.382+0000 7f06c8ff9640 1 -- 172.21.15.52:0/3768279697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6489+0+0 (secure 0 0 0) 0x7f06b4099290 con 0x7f06cc1033d0 2024-09-06T14:53:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.382+0000 7f06cb7fe640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06b80774b0 0x7f06b8079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.382+0000 7f06cb7fe640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06b80774b0 0x7f06b8079970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009430 tx=0x7f06bc03a040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:33.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.386+0000 7f06c8ff9640 1 -- 172.21.15.52:0/3768279697 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f06b40663e0 con 0x7f06cc1033d0 2024-09-06T14:53:33.476 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:33 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3706424893' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:33.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.566+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06cc1982e0 con 0x7f06b80774b0 2024-09-06T14:53:33.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.567+0000 7f06c8ff9640 1 -- 172.21.15.52:0/3768279697 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f06cc1982e0 con 0x7f06b80774b0 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "15/23 daemons upgraded", 2024-09-06T14:53:33.565 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:53:33.566 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:53:33.566 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06b80774b0 msgr2=0x7f06b8079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06b80774b0 0x7f06b8079970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009430 tx=0x7f06bc03a040 comp rx=0 tx=0).stop 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc1033d0 msgr2=0x7f06cc19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc1033d0 0x7f06cc19db70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f06b400d6d0 tx=0x7f06b400db90 comp rx=0 tx=0).stop 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 shutdown_connections 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06cc1033d0 0x7f06cc19db70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06b80774b0 0x7f06b8079970 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 --2- 172.21.15.52:0/3768279697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06cc102ab0 0x7f06cc19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 >> 172.21.15.52:0/3768279697 conn(0x7f06cc0fc550 msgr2=0x7f06cc10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 shutdown_connections 2024-09-06T14:53:33.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.570+0000 7f06d208b640 1 -- 172.21.15.52:0/3768279697 wait complete. 2024-09-06T14:53:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.652+0000 7fa51575d640 1 -- 172.21.15.52:0/351535468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 msgr2=0x7fa510107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.652+0000 7fa51575d640 1 --2- 172.21.15.52:0/351535468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa510107ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa500009880 tx=0x7fa50002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.652+0000 7fa51575d640 1 -- 172.21.15.52:0/351535468 shutdown_connections 2024-09-06T14:53:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.652+0000 7fa51575d640 1 --2- 172.21.15.52:0/351535468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa510101900 0x7fa510101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.652+0000 7fa51575d640 1 --2- 172.21.15.52:0/351535468 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa510107ce0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.652+0000 7fa51575d640 1 -- 172.21.15.52:0/351535468 >> 172.21.15.52:0/351535468 conn(0x7fa5100fd5e0 msgr2=0x7fa5100ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:33.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.652+0000 7fa51575d640 1 -- 172.21.15.52:0/351535468 shutdown_connections 2024-09-06T14:53:33.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.653+0000 7fa51575d640 1 -- 172.21.15.52:0/351535468 wait complete. 2024-09-06T14:53:33.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.653+0000 7fa51575d640 1 Processor -- start 2024-09-06T14:53:33.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.653+0000 7fa51575d640 1 -- start start 2024-09-06T14:53:33.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.653+0000 7fa51575d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa510101900 0x7fa51019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.653+0000 7fa51575d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa51019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.653+0000 7fa51575d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa51010edd0 con 0x7fa510107900 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.653+0000 7fa51575d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa51010ec50 con 0x7fa510101900 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa51019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa51019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56056/0 (socket says 172.21.15.52:56056) 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50e7fc640 1 -- 172.21.15.52:0/2206517681 learned_addr learned my addr 172.21.15.52:0/2206517681 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50effd640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa510101900 0x7fa51019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50e7fc640 1 -- 172.21.15.52:0/2206517681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa510101900 msgr2=0x7fa51019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50e7fc640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa510101900 0x7fa51019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50e7fc640 1 -- 172.21.15.52:0/2206517681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5101977c0 con 0x7fa510107900 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa50e7fc640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa51019db80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d6f0 tx=0x7fa50400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa4f7fff640 1 -- 172.21.15.52:0/2206517681 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa504017070 con 0x7fa510107900 2024-09-06T14:53:33.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa510197ab0 con 0x7fa510107900 2024-09-06T14:53:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa4f7fff640 1 -- 172.21.15.52:0/2206517681 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa50400de00 con 0x7fa510107900 2024-09-06T14:53:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.654+0000 7fa4f7fff640 1 -- 172.21.15.52:0/2206517681 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa504004bb0 con 0x7fa510107900 2024-09-06T14:53:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.655+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa510198040 con 0x7fa510107900 2024-09-06T14:53:33.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.655+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa510103040 con 0x7fa510107900 2024-09-06T14:53:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.657+0000 7fa4f7fff640 1 -- 172.21.15.52:0/2206517681 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa504004e60 con 0x7fa510107900 2024-09-06T14:53:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.657+0000 7fa4f7fff640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa4f8077460 0x7fa4f8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:53:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.657+0000 7fa4f7fff640 1 -- 172.21.15.52:0/2206517681 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6489+0+0 (secure 0 0 0) 0x7fa504099390 con 0x7fa510107900 2024-09-06T14:53:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.657+0000 7fa50effd640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa4f8077460 0x7fa4f8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:53:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.658+0000 7fa50effd640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa4f8077460 0x7fa4f8079920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5000096c0 tx=0x7fa500031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:53:33.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.661+0000 7fa4f7fff640 1 -- 172.21.15.52:0/2206517681 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa504066460 con 0x7fa510107900 2024-09-06T14:53:33.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.880+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa510109e70 con 0x7fa510107900 2024-09-06T14:53:33.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.880+0000 7fa4f7fff640 1 -- 172.21.15.52:0/2206517681 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7fa50406ae80 con 0x7fa510107900 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:53:33.878 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:53:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:53:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:53:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:53:33.879 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:53:33.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa4f8077460 msgr2=0x7fa4f8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa4f8077460 0x7fa4f8079920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5000096c0 tx=0x7fa500031400 comp rx=0 tx=0).stop 2024-09-06T14:53:33.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 msgr2=0x7fa51019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:53:33.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa51019db80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa50400d6f0 tx=0x7fa50400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 shutdown_connections 2024-09-06T14:53:33.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa510107900 0x7fa51019db80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa4f8077460 0x7fa4f8079920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.882+0000 7fa51575d640 1 --2- 172.21.15.52:0/2206517681 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa510101900 0x7fa51019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:53:33.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.883+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 >> 172.21.15.52:0/2206517681 conn(0x7fa5100fd5e0 msgr2=0x7fa5100fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:53:33.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.883+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 shutdown_connections 2024-09-06T14:53:33.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:53:33.883+0000 7fa51575d640 1 -- 172.21.15.52:0/2206517681 wait complete. 2024-09-06T14:53:34.354 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:34 smithi052 ceph-mon[112917]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:34.354 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:34 smithi052 ceph-mon[112917]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:34.354 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:34 smithi052 ceph-mon[112917]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:34.354 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:34 smithi052 ceph-mon[112917]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:34.354 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:34 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2751600870' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:53:34.354 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:34 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2206517681' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:53:34.360 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:34 smithi165 ceph-mon[82925]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:34.360 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:34 smithi165 ceph-mon[82925]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:34.360 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:34 smithi165 ceph-mon[82925]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:34.360 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:34 smithi165 ceph-mon[82925]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:34.360 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:34 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2751600870' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:53:34.360 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:34 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2206517681' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:53:35.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:35 smithi165 ceph-mon[82925]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:35.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:35.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:35.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:35.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:53:35.323 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:35 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:35.370 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:35 smithi052 ceph-mon[112917]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:53:35.371 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:35.371 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:35.371 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:35.371 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T14:53:35.371 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:35 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:36.167 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:36 smithi165 ceph-mon[82925]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:36.167 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:36.167 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:36.167 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:36.167 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:36.167 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:36 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:36 smithi052 ceph-mon[112917]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:36.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:36 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:53:37.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:37 smithi165 ceph-mon[82925]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:37 smithi165 ceph-mon[82925]: Upgrade: Updating mds.cephfs.smithi165.zpunux 2024-09-06T14:53:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.zpunux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:53:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:37 smithi165 ceph-mon[82925]: Deploying daemon mds.cephfs.smithi165.zpunux on smithi165 2024-09-06T14:53:37.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:37 smithi052 ceph-mon[112917]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:37.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:37 smithi052 ceph-mon[112917]: Upgrade: Updating mds.cephfs.smithi165.zpunux 2024-09-06T14:53:37.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:37.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi165.zpunux", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-06T14:53:37.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T14:53:37.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:37 smithi052 ceph-mon[112917]: Deploying daemon mds.cephfs.smithi165.zpunux on smithi165 2024-09-06T14:53:38.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:39.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:39 smithi165 ceph-mon[82925]: pgmap v281: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:39 smithi165 ceph-mon[82925]: osdmap e91: 6 total, 6 up, 6 in 2024-09-06T14:53:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:39 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:53:39.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:39 smithi052 ceph-mon[112917]: pgmap v281: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:39.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:39 smithi052 ceph-mon[112917]: osdmap e91: 6 total, 6 up, 6 in 2024-09-06T14:53:39.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:39 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-06T14:53:41.822 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:41 smithi165 ceph-mon[82925]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:41.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:41 smithi052 ceph-mon[112917]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:42.618 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:42 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"} : dispatch 2024-09-06T14:53:42.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:42 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"} : dispatch 2024-09-06T14:53:43.676 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:43 smithi165 ceph-mon[82925]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:43.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:43 smithi052 ceph-mon[112917]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:44 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:44 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:44 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:44 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] up:boot 2024-09-06T14:53:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:44 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:53:45.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:44 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"} : dispatch 2024-09-06T14:53:45.281 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:44 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:45.281 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:44 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:45.281 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:44 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T14:53:45.281 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:44 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] up:boot 2024-09-06T14:53:45.282 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:44 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T14:53:45.282 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:44 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "mds metadata", "who": "cephfs.smithi165.zpunux"} : dispatch 2024-09-06T14:53:46.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:45 smithi052 ceph-mon[112917]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:46.322 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:45 smithi165 ceph-mon[82925]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:48.003 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:47 smithi165 ceph-mon[82925]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:48.003 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:48.003 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:48.003 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:48.003 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:48.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:47 smithi052 ceph-mon[112917]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:48.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:48.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:48.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T14:53:50.072 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:49 smithi165 ceph-mon[82925]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:50.123 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:49 smithi052 ceph-mon[112917]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:51.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:51 smithi165 ceph-mon[82925]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:51.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:51 smithi052 ceph-mon[112917]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:53.541 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:53 smithi052 ceph-mon[112917]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:53.541 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:53.570 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:53 smithi165 ceph-mon[82925]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:53.571 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:53:55.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:55 smithi165 ceph-mon[82925]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:55.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:55 smithi052 ceph-mon[112917]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:57.572 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:57 smithi165 ceph-mon[82925]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:57.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:57 smithi052 ceph-mon[112917]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:59.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:53:59 smithi165 ceph-mon[82925]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:53:59.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:53:59 smithi052 ceph-mon[112917]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:01.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:01 smithi165 ceph-mon[82925]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:01.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:01 smithi052 ceph-mon[112917]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:03.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:03 smithi165 ceph-mon[82925]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:03.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:03 smithi052 ceph-mon[112917]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/384709807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94107900 msgr2=0x7f9f94107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/384709807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94107900 0x7f9f94107ce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009880 tx=0x7f9f9002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/384709807 shutdown_connections 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/384709807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f94101900 0x7f9f94101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/384709807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94107900 0x7f9f94107ce0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/384709807 >> 172.21.15.52:0/384709807 conn(0x7f9f940fd600 msgr2=0x7f9f940ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/384709807 shutdown_connections 2024-09-06T14:54:03.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.974+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/384709807 wait complete. 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9c2f4640 1 Processor -- start 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9c2f4640 1 -- start start 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9c2f4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94101900 0x7f9f9419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9c2f4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f94107900 0x7f9f9419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9c2f4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9410edb0 con 0x7f9f94101900 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9c2f4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9410ec30 con 0x7f9f94107900 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9a090640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94101900 0x7f9f9419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9a090640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94101900 0x7f9f9419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40172/0 (socket says 172.21.15.52:40172) 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9a090640 1 -- 172.21.15.52:0/1176802927 learned_addr learned my addr 172.21.15.52:0/1176802927 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.975+0000 7f9f9988f640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f94107900 0x7f9f9419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:03.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f9a090640 1 -- 172.21.15.52:0/1176802927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f94107900 msgr2=0x7f9f9419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f9a090640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f94107900 0x7f9f9419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f9a090640 1 -- 172.21.15.52:0/1176802927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f941977e0 con 0x7f9f94101900 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f9a090640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94101900 0x7f9f9419d660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9f90031460 tx=0x7f9f900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/1176802927 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f9003f070 con 0x7f9f94101900 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f94197a70 con 0x7f9f94101900 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/1176802927 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f900035f0 con 0x7f9f94101900 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/1176802927 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f90035030 con 0x7f9f94101900 2024-09-06T14:54:03.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.976+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f94197fa0 con 0x7f9f94101900 2024-09-06T14:54:03.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.977+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f94103040 con 0x7f9f94101900 2024-09-06T14:54:03.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.978+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/1176802927 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9f90042070 con 0x7f9f94101900 2024-09-06T14:54:03.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.978+0000 7f9f8b7fe640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f80077460 0x7f9f80079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:03.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.979+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/1176802927 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9f900ba0c0 con 0x7f9f94101900 2024-09-06T14:54:03.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.979+0000 7f9f9988f640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f80077460 0x7f9f80079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:03.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.979+0000 7f9f9988f640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f80077460 0x7f9f80079920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f94100d10 tx=0x7f9f8400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:03.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:03.983+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/1176802927 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9f90087190 con 0x7f9f94101900 2024-09-06T14:54:04.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.163+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9f94198250 con 0x7f9f80077460 2024-09-06T14:54:04.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.164+0000 7f9f8b7fe640 1 -- 172.21.15.52:0/1176802927 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9f94198250 con 0x7f9f80077460 2024-09-06T14:54:04.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f80077460 msgr2=0x7f9f80079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f80077460 0x7f9f80079920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9f94100d10 tx=0x7f9f8400b390 comp rx=0 tx=0).stop 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94101900 msgr2=0x7f9f9419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94101900 0x7f9f9419d660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9f90031460 tx=0x7f9f900045e0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 shutdown_connections 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f80077460 0x7f9f80079920 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f94107900 0x7f9f9419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 --2- 172.21.15.52:0/1176802927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f94101900 0x7f9f9419d660 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 >> 172.21.15.52:0/1176802927 conn(0x7f9f940fd600 msgr2=0x7f9f940fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 shutdown_connections 2024-09-06T14:54:04.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.166+0000 7f9f9c2f4640 1 -- 172.21.15.52:0/1176802927 wait complete. 2024-09-06T14:54:04.173 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:54:04.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 -- 172.21.15.52:0/596468998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 msgr2=0x7f4d8c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 --2- 172.21.15.52:0/596468998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c106be0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009880 tx=0x7f4d7c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 -- 172.21.15.52:0/596468998 shutdown_connections 2024-09-06T14:54:04.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 --2- 172.21.15.52:0/596468998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d8c100800 0x7f4d8c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 --2- 172.21.15.52:0/596468998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c106be0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 -- 172.21.15.52:0/596468998 >> 172.21.15.52:0/596468998 conn(0x7f4d8c0fc520 msgr2=0x7f4d8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 -- 172.21.15.52:0/596468998 shutdown_connections 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.259+0000 7f4d92d44640 1 -- 172.21.15.52:0/596468998 wait complete. 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d92d44640 1 Processor -- start 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d92d44640 1 -- start start 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d92d44640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d8c100800 0x7f4d8c19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d92d44640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d92d44640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c10edd0 con 0x7f4d8c106800 2024-09-06T14:54:04.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d92d44640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c10ec50 con 0x7f4d8c100800 2024-09-06T14:54:04.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d8bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d8bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c19fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40196/0 (socket says 172.21.15.52:40196) 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d8bfff640 1 -- 172.21.15.52:0/1315743338 learned_addr learned my addr 172.21.15.52:0/1315743338 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.260+0000 7f4d90ae0640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d8c100800 0x7f4d8c19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d8bfff640 1 -- 172.21.15.52:0/1315743338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d8c100800 msgr2=0x7f4d8c19f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d8bfff640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d8c100800 0x7f4d8c19f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d8bfff640 1 -- 172.21.15.52:0/1315743338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c1999d0 con 0x7f4d8c106800 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d8bfff640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c19fd50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400d6f0 tx=0x7f4d7400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d89ffb640 1 -- 172.21.15.52:0/1315743338 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d74017070 con 0x7f4d8c106800 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d89ffb640 1 -- 172.21.15.52:0/1315743338 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d7400de00 con 0x7f4d8c106800 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d89ffb640 1 -- 172.21.15.52:0/1315743338 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d74004bb0 con 0x7f4d8c106800 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c199cc0 con 0x7f4d8c106800 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.261+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8c19a190 con 0x7f4d8c106800 2024-09-06T14:54:04.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.262+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d8c101f40 con 0x7f4d8c106800 2024-09-06T14:54:04.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.263+0000 7f4d89ffb640 1 -- 172.21.15.52:0/1315743338 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4d74004e60 con 0x7f4d8c106800 2024-09-06T14:54:04.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.263+0000 7f4d89ffb640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d78077460 0x7f4d78079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.263+0000 7f4d89ffb640 1 -- 172.21.15.52:0/1315743338 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4d740994e0 con 0x7f4d8c106800 2024-09-06T14:54:04.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.263+0000 7f4d90ae0640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d78077460 0x7f4d78079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.264+0000 7f4d90ae0640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d78077460 0x7f4d78079920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c000c00 tx=0x7f4d7c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:04.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.269+0000 7f4d89ffb640 1 -- 172.21.15.52:0/1315743338 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4d740623a0 con 0x7f4d8c106800 2024-09-06T14:54:04.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.445+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4d8c19af00 con 0x7f4d78077460 2024-09-06T14:54:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.447+0000 7f4d89ffb640 1 -- 172.21.15.52:0/1315743338 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4d8c19af00 con 0x7f4d78077460 2024-09-06T14:54:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.448+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d78077460 msgr2=0x7f4d78079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.448+0000 7f4d92d44640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d78077460 0x7f4d78079920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c000c00 tx=0x7f4d7c031400 comp rx=0 tx=0).stop 2024-09-06T14:54:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.448+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 msgr2=0x7f4d8c19fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.448+0000 7f4d92d44640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c19fd50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400d6f0 tx=0x7f4d7400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.449+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 shutdown_connections 2024-09-06T14:54:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.449+0000 7f4d92d44640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d8c106800 0x7f4d8c19fd50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.449+0000 7f4d92d44640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d78077460 0x7f4d78079920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.449+0000 7f4d92d44640 1 --2- 172.21.15.52:0/1315743338 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d8c100800 0x7f4d8c19f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.449+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 >> 172.21.15.52:0/1315743338 conn(0x7f4d8c0fc520 msgr2=0x7f4d8c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.449+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 shutdown_connections 2024-09-06T14:54:04.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.449+0000 7f4d92d44640 1 -- 172.21.15.52:0/1315743338 wait complete. 2024-09-06T14:54:04.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 -- 172.21.15.52:0/769488558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec101900 msgr2=0x7f09ec101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 --2- 172.21.15.52:0/769488558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec101900 0x7f09ec101d60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009880 tx=0x7f09d402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 -- 172.21.15.52:0/769488558 shutdown_connections 2024-09-06T14:54:04.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 --2- 172.21.15.52:0/769488558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec101900 0x7f09ec101d60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 --2- 172.21.15.52:0/769488558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09ec107900 0x7f09ec107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 -- 172.21.15.52:0/769488558 >> 172.21.15.52:0/769488558 conn(0x7f09ec0fd5e0 msgr2=0x7f09ec0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:04.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 -- 172.21.15.52:0/769488558 shutdown_connections 2024-09-06T14:54:04.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.532+0000 7f09f16cc640 1 -- 172.21.15.52:0/769488558 wait complete. 2024-09-06T14:54:04.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.533+0000 7f09f16cc640 1 Processor -- start 2024-09-06T14:54:04.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.533+0000 7f09f16cc640 1 -- start start 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.533+0000 7f09f16cc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09ec101900 0x7f09ec19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.533+0000 7f09f16cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec107900 0x7f09ec19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.533+0000 7f09f16cc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec10edd0 con 0x7f09ec107900 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.533+0000 7f09f16cc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec10ec50 con 0x7f09ec101900 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.533+0000 7f09e27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec107900 0x7f09ec19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec107900 0x7f09ec19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40226/0 (socket says 172.21.15.52:40226) 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e27fc640 1 -- 172.21.15.52:0/460650293 learned_addr learned my addr 172.21.15.52:0/460650293 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09eaffd640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09ec101900 0x7f09ec19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e27fc640 1 -- 172.21.15.52:0/460650293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09ec101900 msgr2=0x7f09ec19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e27fc640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09ec101900 0x7f09ec19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e27fc640 1 -- 172.21.15.52:0/460650293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec1977a0 con 0x7f09ec107900 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e27fc640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec107900 0x7f09ec19db60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09d4031460 tx=0x7f09d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:04.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e8ff9640 1 -- 172.21.15.52:0/460650293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09d403f070 con 0x7f09ec107900 2024-09-06T14:54:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e8ff9640 1 -- 172.21.15.52:0/460650293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09d4004b10 con 0x7f09ec107900 2024-09-06T14:54:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec197a30 con 0x7f09ec107900 2024-09-06T14:54:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09e8ff9640 1 -- 172.21.15.52:0/460650293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09d4035030 con 0x7f09ec107900 2024-09-06T14:54:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.534+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec197f60 con 0x7f09ec107900 2024-09-06T14:54:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.536+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ec103040 con 0x7f09ec107900 2024-09-06T14:54:04.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.536+0000 7f09e8ff9640 1 -- 172.21.15.52:0/460650293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f09d4042070 con 0x7f09ec107900 2024-09-06T14:54:04.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.537+0000 7f09e8ff9640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f09d8077460 0x7f09d8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.537+0000 7f09e8ff9640 1 -- 172.21.15.52:0/460650293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f09d40ba210 con 0x7f09ec107900 2024-09-06T14:54:04.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.537+0000 7f09eaffd640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f09d8077460 0x7f09d8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.537+0000 7f09eaffd640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f09d8077460 0x7f09d8079920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f09dc005fd0 tx=0x7f09dc00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:04.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.541+0000 7f09e8ff9640 1 -- 172.21.15.52:0/460650293 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f09d40872e0 con 0x7f09ec107900 2024-09-06T14:54:04.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.707+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f09ec1982d0 con 0x7f09d8077460 2024-09-06T14:54:04.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.717+0000 7f09e8ff9640 1 -- 172.21.15.52:0/460650293 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f09ec1982d0 con 0x7f09d8077460 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (6m) 47s ago 17m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (9m) 47s ago 17m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (8m) 18s ago 16m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (4m) 47s ago 17m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (4m) 18s ago 16m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (6m) 47s ago 17m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (69s) 47s ago 12m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (52s) 47s ago 12m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (36s) 18s ago 12m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (21s) 18s ago 12m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:54:04.715 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (8m) 47s ago 18m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (7m) 18s ago 16m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (5m) 47s ago 18m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (4m) 18s ago 16m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (7m) 47s ago 17m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (7m) 18s ago 16m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (4m) 47s ago 15m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (3m) 47s ago 14m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (3m) 47s ago 14m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (2m) 18s ago 14m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (119s) 18s ago 13m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (86s) 18s ago 13m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:54:04.716 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (6m) 47s ago 17m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:54:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f09d8077460 msgr2=0x7f09d8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f09d8077460 0x7f09d8079920 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f09dc005fd0 tx=0x7f09dc00b390 comp rx=0 tx=0).stop 2024-09-06T14:54:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec107900 msgr2=0x7f09ec19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec107900 0x7f09ec19db60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09d4031460 tx=0x7f09d40045e0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 shutdown_connections 2024-09-06T14:54:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f09ec107900 0x7f09ec19db60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f09d8077460 0x7f09d8079920 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 --2- 172.21.15.52:0/460650293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f09ec101900 0x7f09ec19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 >> 172.21.15.52:0/460650293 conn(0x7f09ec0fd5e0 msgr2=0x7f09ec0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 shutdown_connections 2024-09-06T14:54:04.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.719+0000 7f09f16cc640 1 -- 172.21.15.52:0/460650293 wait complete. 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 -- 172.21.15.52:0/2987836573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 msgr2=0x7f7f60101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 --2- 172.21.15.52:0/2987836573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f60101d60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009880 tx=0x7f7f5402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 -- 172.21.15.52:0/2987836573 shutdown_connections 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 --2- 172.21.15.52:0/2987836573 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f60101d60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 --2- 172.21.15.52:0/2987836573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f60107900 0x7f7f60107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 -- 172.21.15.52:0/2987836573 >> 172.21.15.52:0/2987836573 conn(0x7f7f600fd600 msgr2=0x7f7f600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 -- 172.21.15.52:0/2987836573 shutdown_connections 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.801+0000 7f7f66399640 1 -- 172.21.15.52:0/2987836573 wait complete. 2024-09-06T14:54:04.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f66399640 1 Processor -- start 2024-09-06T14:54:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f66399640 1 -- start start 2024-09-06T14:54:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f66399640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f66399640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f60107900 0x7f7f60074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f66399640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6010ee30 con 0x7f7f60101900 2024-09-06T14:54:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f66399640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6010ecb0 con 0x7f7f60107900 2024-09-06T14:54:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f5ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f5ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40246/0 (socket says 172.21.15.52:40246) 2024-09-06T14:54:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f5ffff640 1 -- 172.21.15.52:0/669966095 learned_addr learned my addr 172.21.15.52:0/669966095 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.802+0000 7f7f5f7fe640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f60107900 0x7f7f60074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f5ffff640 1 -- 172.21.15.52:0/669966095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f60107900 msgr2=0x7f7f60074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f5ffff640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f60107900 0x7f7f60074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f5ffff640 1 -- 172.21.15.52:0/669966095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f60074f70 con 0x7f7f60101900 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f5ffff640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f600744f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000b420 tx=0x7f7f5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f5d7fa640 1 -- 172.21.15.52:0/669966095 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f50011630 con 0x7f7f60101900 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f5d7fa640 1 -- 172.21.15.52:0/669966095 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f50016070 con 0x7f7f60101900 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f5d7fa640 1 -- 172.21.15.52:0/669966095 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f50010d40 con 0x7f7f60101900 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f60075260 con 0x7f7f60101900 2024-09-06T14:54:04.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.803+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f601a3ec0 con 0x7f7f60101900 2024-09-06T14:54:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.804+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f60103040 con 0x7f7f60101900 2024-09-06T14:54:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.805+0000 7f7f5d7fa640 1 -- 172.21.15.52:0/669966095 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7f5001b460 con 0x7f7f60101900 2024-09-06T14:54:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.805+0000 7f7f5d7fa640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7f48077460 0x7f7f48079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.805+0000 7f7f5d7fa640 1 -- 172.21.15.52:0/669966095 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7f50099030 con 0x7f7f60101900 2024-09-06T14:54:04.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.805+0000 7f7f5f7fe640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7f48077460 0x7f7f48079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:04.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.806+0000 7f7f5f7fe640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7f48077460 0x7f7f48079920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f60075f80 tx=0x7f7f54031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:04.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:04.810+0000 7f7f5d7fa640 1 -- 172.21.15.52:0/669966095 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7f50021250 con 0x7f7f60101900 2024-09-06T14:54:05.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.033+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7f60109e90 con 0x7f7f60101900 2024-09-06T14:54:05.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.034+0000 7f7f5d7fa640 1 -- 172.21.15.52:0/669966095 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7f50061ef0 con 0x7f7f60101900 2024-09-06T14:54:05.031 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:54:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:54:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:54:05.031 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:54:05.032 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:54:05.033 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:54:05.033 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7f48077460 msgr2=0x7f7f48079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7f48077460 0x7f7f48079920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f60075f80 tx=0x7f7f54031400 comp rx=0 tx=0).stop 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 msgr2=0x7f7f600744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f600744f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7f5000b420 tx=0x7f7f5000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 shutdown_connections 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7f48077460 0x7f7f48079920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f60107900 0x7f7f60074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 --2- 172.21.15.52:0/669966095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f60101900 0x7f7f600744f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 >> 172.21.15.52:0/669966095 conn(0x7f7f600fd600 msgr2=0x7f7f600fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:05.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 shutdown_connections 2024-09-06T14:54:05.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.036+0000 7f7f66399640 1 -- 172.21.15.52:0/669966095 wait complete. 2024-09-06T14:54:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.118+0000 7f7942aae640 1 -- 172.21.15.52:0/2739779873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c101900 msgr2=0x7f793c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.118+0000 7f7942aae640 1 --2- 172.21.15.52:0/2739779873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c101900 0x7f793c101d60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7928009880 tx=0x7f792802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.118+0000 7f7942aae640 1 -- 172.21.15.52:0/2739779873 shutdown_connections 2024-09-06T14:54:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.118+0000 7f7942aae640 1 --2- 172.21.15.52:0/2739779873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c101900 0x7f793c101d60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.118+0000 7f7942aae640 1 --2- 172.21.15.52:0/2739779873 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c107900 0x7f793c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.118+0000 7f7942aae640 1 -- 172.21.15.52:0/2739779873 >> 172.21.15.52:0/2739779873 conn(0x7f793c0fd620 msgr2=0x7f793c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.119+0000 7f7942aae640 1 -- 172.21.15.52:0/2739779873 shutdown_connections 2024-09-06T14:54:05.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.119+0000 7f7942aae640 1 -- 172.21.15.52:0/2739779873 wait complete. 2024-09-06T14:54:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.119+0000 7f7942aae640 1 Processor -- start 2024-09-06T14:54:05.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.119+0000 7f7942aae640 1 -- start start 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f7942aae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c101900 0x7f793c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f7942aae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c107900 0x7f793c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f7942aae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f793c10edb0 con 0x7f793c107900 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f7942aae640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f793c10ec30 con 0x7f793c101900 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f793bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c107900 0x7f793c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f793bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c107900 0x7f793c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40260/0 (socket says 172.21.15.52:40260) 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f793bfff640 1 -- 172.21.15.52:0/2513461193 learned_addr learned my addr 172.21.15.52:0/2513461193 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f794084a640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c101900 0x7f793c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f793bfff640 1 -- 172.21.15.52:0/2513461193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c101900 msgr2=0x7f793c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f793bfff640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c101900 0x7f793c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f793bfff640 1 -- 172.21.15.52:0/2513461193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c1977a0 con 0x7f793c107900 2024-09-06T14:54:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.120+0000 7f793bfff640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c107900 0x7f793c19db60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7928031460 tx=0x7f79280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.121+0000 7f7939ffb640 1 -- 172.21.15.52:0/2513461193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f792803f070 con 0x7f793c107900 2024-09-06T14:54:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.121+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c197a30 con 0x7f793c107900 2024-09-06T14:54:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.121+0000 7f7939ffb640 1 -- 172.21.15.52:0/2513461193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7928004cf0 con 0x7f793c107900 2024-09-06T14:54:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.121+0000 7f7939ffb640 1 -- 172.21.15.52:0/2513461193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7928035030 con 0x7f793c107900 2024-09-06T14:54:05.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.121+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c197f60 con 0x7f793c107900 2024-09-06T14:54:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.122+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c103040 con 0x7f793c107900 2024-09-06T14:54:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.123+0000 7f7939ffb640 1 -- 172.21.15.52:0/2513461193 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7928042070 con 0x7f793c107900 2024-09-06T14:54:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.123+0000 7f7939ffb640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f792c0774b0 0x7f792c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.123+0000 7f794084a640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f792c0774b0 0x7f792c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.123+0000 7f7939ffb640 1 -- 172.21.15.52:0/2513461193 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f79280ba0f0 con 0x7f793c107900 2024-09-06T14:54:05.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.124+0000 7f794084a640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f792c0774b0 0x7f792c079970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f793000abe0 tx=0x7f793000a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:05.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.127+0000 7f7939ffb640 1 -- 172.21.15.52:0/2513461193 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f79280830d0 con 0x7f793c107900 2024-09-06T14:54:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.315+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f793c198cd0 con 0x7f793c107900 2024-09-06T14:54:05.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.315+0000 7f7939ffb640 1 -- 172.21.15.52:0/2513461193 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f7928087240 con 0x7f793c107900 2024-09-06T14:54:05.313 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:54:05.313 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:54:05.313 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:54:05.313 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:54:05.313 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:54:05.314 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:54:05.315 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:05.316 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:54:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f792c0774b0 msgr2=0x7f792c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f792c0774b0 0x7f792c079970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f793000abe0 tx=0x7f793000a2d0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c107900 msgr2=0x7f793c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c107900 0x7f793c19db60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7928031460 tx=0x7f79280048f0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 shutdown_connections 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f793c107900 0x7f793c19db60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f792c0774b0 0x7f792c079970 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 --2- 172.21.15.52:0/2513461193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f793c101900 0x7f793c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 >> 172.21.15.52:0/2513461193 conn(0x7f793c0fd620 msgr2=0x7f793c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 shutdown_connections 2024-09-06T14:54:05.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.318+0000 7f7942aae640 1 -- 172.21.15.52:0/2513461193 wait complete. 2024-09-06T14:54:05.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:05 smithi052 ceph-mon[112917]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:05.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:05 smithi052 ceph-mon[112917]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:05.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:05 smithi052 ceph-mon[112917]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:05.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:05 smithi052 ceph-mon[112917]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:05.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:05 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/669966095' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:54:05.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 -- 172.21.15.52:0/2702873098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 msgr2=0x7ff23c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 --2- 172.21.15.52:0/2702873098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c106be0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff22c009880 tx=0x7ff22c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 -- 172.21.15.52:0/2702873098 shutdown_connections 2024-09-06T14:54:05.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 --2- 172.21.15.52:0/2702873098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff23c100800 0x7ff23c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 --2- 172.21.15.52:0/2702873098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c106be0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 -- 172.21.15.52:0/2702873098 >> 172.21.15.52:0/2702873098 conn(0x7ff23c0fc520 msgr2=0x7ff23c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:05.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 -- 172.21.15.52:0/2702873098 shutdown_connections 2024-09-06T14:54:05.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.405+0000 7ff243cf8640 1 -- 172.21.15.52:0/2702873098 wait complete. 2024-09-06T14:54:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff243cf8640 1 Processor -- start 2024-09-06T14:54:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff243cf8640 1 -- start start 2024-09-06T14:54:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff243cf8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff23c100800 0x7ff23c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff243cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff243cf8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c10dcd0 con 0x7ff23c106800 2024-09-06T14:54:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff243cf8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c10db50 con 0x7ff23c100800 2024-09-06T14:54:05.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241293640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241293640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40280/0 (socket says 172.21.15.52:40280) 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241293640 1 -- 172.21.15.52:0/3340125147 learned_addr learned my addr 172.21.15.52:0/3340125147 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241a94640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff23c100800 0x7ff23c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241293640 1 -- 172.21.15.52:0/3340125147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff23c100800 msgr2=0x7ff23c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241293640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff23c100800 0x7ff23c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241293640 1 -- 172.21.15.52:0/3340125147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c1977e0 con 0x7ff23c106800 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241a94640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff23c100800 0x7ff23c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.406+0000 7ff241293640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c19dba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff23800d6f0 tx=0x7ff23800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.407+0000 7ff232ffd640 1 -- 172.21.15.52:0/3340125147 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff238017070 con 0x7ff23c106800 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.407+0000 7ff232ffd640 1 -- 172.21.15.52:0/3340125147 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff23800de00 con 0x7ff23c106800 2024-09-06T14:54:05.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.407+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23c197ad0 con 0x7ff23c106800 2024-09-06T14:54:05.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.407+0000 7ff232ffd640 1 -- 172.21.15.52:0/3340125147 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff238004bb0 con 0x7ff23c106800 2024-09-06T14:54:05.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.407+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23c198060 con 0x7ff23c106800 2024-09-06T14:54:05.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.408+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff23c101f40 con 0x7ff23c106800 2024-09-06T14:54:05.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.408+0000 7ff232ffd640 1 -- 172.21.15.52:0/3340125147 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff238009a30 con 0x7ff23c106800 2024-09-06T14:54:05.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.409+0000 7ff232ffd640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2280774b0 0x7ff228079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.409+0000 7ff232ffd640 1 -- 172.21.15.52:0/3340125147 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ff238099320 con 0x7ff23c106800 2024-09-06T14:54:05.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.409+0000 7ff241a94640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2280774b0 0x7ff228079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.409+0000 7ff241a94640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2280774b0 0x7ff228079970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff22c000c00 tx=0x7ff22c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:05.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.413+0000 7ff232ffd640 1 -- 172.21.15.52:0/3340125147 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff238062300 con 0x7ff23c106800 2024-09-06T14:54:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:05 smithi165 ceph-mon[82925]: from='client.34410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:05 smithi165 ceph-mon[82925]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:05 smithi165 ceph-mon[82925]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:05 smithi165 ceph-mon[82925]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:05.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:05 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/669966095' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:54:05.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.590+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff23c198310 con 0x7ff2280774b0 2024-09-06T14:54:05.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.592+0000 7ff232ffd640 1 -- 172.21.15.52:0/3340125147 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff23c198310 con 0x7ff2280774b0 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:54:05.590 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:54:05.591 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:54:05.591 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:54:05.591 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:54:05.591 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:54:05.591 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:54:05.591 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:54:05.591 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:54:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2280774b0 msgr2=0x7ff228079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2280774b0 0x7ff228079970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff22c000c00 tx=0x7ff22c031400 comp rx=0 tx=0).stop 2024-09-06T14:54:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 msgr2=0x7ff23c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c19dba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff23800d6f0 tx=0x7ff23800dbb0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 shutdown_connections 2024-09-06T14:54:05.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff23c106800 0x7ff23c19dba0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2280774b0 0x7ff228079970 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 --2- 172.21.15.52:0/3340125147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff23c100800 0x7ff23c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 >> 172.21.15.52:0/3340125147 conn(0x7ff23c0fc520 msgr2=0x7ff23c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:05.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 shutdown_connections 2024-09-06T14:54:05.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.594+0000 7ff243cf8640 1 -- 172.21.15.52:0/3340125147 wait complete. 2024-09-06T14:54:05.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.677+0000 7ffb2563f640 1 -- 172.21.15.52:0/276416565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20101900 msgr2=0x7ffb20101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.677+0000 7ffb2563f640 1 --2- 172.21.15.52:0/276416565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20101900 0x7ffb20101d60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009880 tx=0x7ffb1402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.677+0000 7ffb2563f640 1 -- 172.21.15.52:0/276416565 shutdown_connections 2024-09-06T14:54:05.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.677+0000 7ffb2563f640 1 --2- 172.21.15.52:0/276416565 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20101900 0x7ffb20101d60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.677+0000 7ffb2563f640 1 --2- 172.21.15.52:0/276416565 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb20107900 0x7ffb20107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.677+0000 7ffb2563f640 1 -- 172.21.15.52:0/276416565 >> 172.21.15.52:0/276416565 conn(0x7ffb200fd600 msgr2=0x7ffb200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:05.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.678+0000 7ffb2563f640 1 -- 172.21.15.52:0/276416565 shutdown_connections 2024-09-06T14:54:05.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.678+0000 7ffb2563f640 1 -- 172.21.15.52:0/276416565 wait complete. 2024-09-06T14:54:05.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.678+0000 7ffb2563f640 1 Processor -- start 2024-09-06T14:54:05.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.678+0000 7ffb2563f640 1 -- start start 2024-09-06T14:54:05.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb2563f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb20101900 0x7ffb2019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb2563f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20107900 0x7ffb2019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb2563f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2010edd0 con 0x7ffb20107900 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb2563f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2010ec50 con 0x7ffb20101900 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20107900 0x7ffb2019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20107900 0x7ffb2019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40300/0 (socket says 172.21.15.52:40300) 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1e7fc640 1 -- 172.21.15.52:0/2528112394 learned_addr learned my addr 172.21.15.52:0/2528112394 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1effd640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb20101900 0x7ffb2019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1e7fc640 1 -- 172.21.15.52:0/2528112394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb20101900 msgr2=0x7ffb2019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1e7fc640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb20101900 0x7ffb2019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1e7fc640 1 -- 172.21.15.52:0/2528112394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb20199a10 con 0x7ffb20107900 2024-09-06T14:54:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb1e7fc640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20107900 0x7ffb2019fd90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb14031460 tx=0x7ffb140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb07fff640 1 -- 172.21.15.52:0/2528112394 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb1403f070 con 0x7ffb20107900 2024-09-06T14:54:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb07fff640 1 -- 172.21.15.52:0/2528112394 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb140035f0 con 0x7ffb20107900 2024-09-06T14:54:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb07fff640 1 -- 172.21.15.52:0/2528112394 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb14035030 con 0x7ffb20107900 2024-09-06T14:54:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.679+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb20199ca0 con 0x7ffb20107900 2024-09-06T14:54:05.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.680+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2019a1d0 con 0x7ffb20107900 2024-09-06T14:54:05.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.681+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb20103040 con 0x7ffb20107900 2024-09-06T14:54:05.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.681+0000 7ffb07fff640 1 -- 172.21.15.52:0/2528112394 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ffb14042070 con 0x7ffb20107900 2024-09-06T14:54:05.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.682+0000 7ffb07fff640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb08077460 0x7ffb08079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:05.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.682+0000 7ffb07fff640 1 -- 172.21.15.52:0/2528112394 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ffb140ba0c0 con 0x7ffb20107900 2024-09-06T14:54:05.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.682+0000 7ffb1effd640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb08077460 0x7ffb08079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:05.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.683+0000 7ffb1effd640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb08077460 0x7ffb08079920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb2019ab50 tx=0x7ffb1000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:05.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.686+0000 7ffb07fff640 1 -- 172.21.15.52:0/2528112394 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ffb14087190 con 0x7ffb20107900 2024-09-06T14:54:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.910+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ffb2019af40 con 0x7ffb20107900 2024-09-06T14:54:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.911+0000 7ffb07fff640 1 -- 172.21.15.52:0/2528112394 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7ffb1408bbb0 con 0x7ffb20107900 2024-09-06T14:54:05.908 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:54:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:54:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:54:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb08077460 msgr2=0x7ffb08079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb08077460 0x7ffb08079920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb2019ab50 tx=0x7ffb1000b390 comp rx=0 tx=0).stop 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20107900 msgr2=0x7ffb2019fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20107900 0x7ffb2019fd90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb14031460 tx=0x7ffb140045e0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 shutdown_connections 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb20107900 0x7ffb2019fd90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb08077460 0x7ffb08079920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 --2- 172.21.15.52:0/2528112394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb20101900 0x7ffb2019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:05.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.913+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 >> 172.21.15.52:0/2528112394 conn(0x7ffb200fd600 msgr2=0x7ffb20074480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.914+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 shutdown_connections 2024-09-06T14:54:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:05.914+0000 7ffb2563f640 1 -- 172.21.15.52:0/2528112394 wait complete. 2024-09-06T14:54:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:06 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2513461193' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:54:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:06 smithi165 ceph-mon[82925]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:06.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:06 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2528112394' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:54:06.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:06 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2513461193' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:54:06.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:06 smithi052 ceph-mon[112917]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:06.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:06 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2528112394' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:54:07.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:07 smithi165 ceph-mon[82925]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:07.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:07 smithi052 ceph-mon[112917]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:08.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:08.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:09.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:09 smithi165 ceph-mon[82925]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:09.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:09 smithi052 ceph-mon[112917]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:11.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:11 smithi165 ceph-mon[82925]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:11.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:11 smithi052 ceph-mon[112917]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:13.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:13 smithi165 ceph-mon[82925]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:13.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:13 smithi052 ceph-mon[112917]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:15.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:15 smithi165 ceph-mon[82925]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:15.612 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:15 smithi052 ceph-mon[112917]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:17.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:17 smithi165 ceph-mon[82925]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:17.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:17 smithi052 ceph-mon[112917]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:19.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:19 smithi052 ceph-mon[112917]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:19.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:19 smithi165 ceph-mon[82925]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:21.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:21 smithi052 ceph-mon[112917]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:21 smithi165 ceph-mon[82925]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:23.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:23 smithi052 ceph-mon[112917]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:23.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:23.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:23 smithi165 ceph-mon[82925]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:23.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:25.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:25 smithi052 ceph-mon[112917]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:25.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:25 smithi165 ceph-mon[82925]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:27.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:27 smithi052 ceph-mon[112917]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:27.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:27 smithi165 ceph-mon[82925]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:29.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:29 smithi165 ceph-mon[82925]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:29.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:29 smithi052 ceph-mon[112917]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:31.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:31 smithi052 ceph-mon[112917]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:31.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:31 smithi165 ceph-mon[82925]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:33.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:33 smithi052 ceph-mon[112917]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:33.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:33 smithi165 ceph-mon[82925]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:35.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:35 smithi052 ceph-mon[112917]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:35 smithi165 ceph-mon[82925]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:36.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 -- 172.21.15.52:0/3437849829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 msgr2=0x7fd1e0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 --2- 172.21.15.52:0/3437849829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e0107ce0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009880 tx=0x7fd1dc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 -- 172.21.15.52:0/3437849829 shutdown_connections 2024-09-06T14:54:36.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 --2- 172.21.15.52:0/3437849829 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e0101900 0x7fd1e0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 --2- 172.21.15.52:0/3437849829 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e0107ce0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 -- 172.21.15.52:0/3437849829 >> 172.21.15.52:0/3437849829 conn(0x7fd1e00fd5e0 msgr2=0x7fd1e00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:36.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 -- 172.21.15.52:0/3437849829 shutdown_connections 2024-09-06T14:54:36.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.012+0000 7fd1e83be640 1 -- 172.21.15.52:0/3437849829 wait complete. 2024-09-06T14:54:36.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e83be640 1 Processor -- start 2024-09-06T14:54:36.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e83be640 1 -- start start 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e83be640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e0101900 0x7fd1e019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e83be640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e83be640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e010ee30 con 0x7fd1e0107900 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e83be640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e010ecb0 con 0x7fd1e0101900 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e5959640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e5959640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e019fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50410/0 (socket says 172.21.15.52:50410) 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e5959640 1 -- 172.21.15.52:0/2504079649 learned_addr learned my addr 172.21.15.52:0/2504079649 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.013+0000 7fd1e615a640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e0101900 0x7fd1e019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1e5959640 1 -- 172.21.15.52:0/2504079649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e0101900 msgr2=0x7fd1e019f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1e5959640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e0101900 0x7fd1e019f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1e5959640 1 -- 172.21.15.52:0/2504079649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e0199a30 con 0x7fd1e0107900 2024-09-06T14:54:36.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1e5959640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e019fdb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b420 tx=0x7fd1d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1d77fe640 1 -- 172.21.15.52:0/2504079649 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1d0011630 con 0x7fd1e0107900 2024-09-06T14:54:36.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e0199d20 con 0x7fd1e0107900 2024-09-06T14:54:36.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1d77fe640 1 -- 172.21.15.52:0/2504079649 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1d0016070 con 0x7fd1e0107900 2024-09-06T14:54:36.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1d77fe640 1 -- 172.21.15.52:0/2504079649 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1d0010d40 con 0x7fd1e0107900 2024-09-06T14:54:36.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.014+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e019a2b0 con 0x7fd1e0107900 2024-09-06T14:54:36.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.015+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e0103040 con 0x7fd1e0107900 2024-09-06T14:54:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.016+0000 7fd1d77fe640 1 -- 172.21.15.52:0/2504079649 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd1d001b460 con 0x7fd1e0107900 2024-09-06T14:54:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.016+0000 7fd1d77fe640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd1cc077460 0x7fd1cc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.017+0000 7fd1d77fe640 1 -- 172.21.15.52:0/2504079649 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd1d0098f00 con 0x7fd1e0107900 2024-09-06T14:54:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.017+0000 7fd1e615a640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd1cc077460 0x7fd1cc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.017+0000 7fd1e615a640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd1cc077460 0x7fd1cc079920 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000c00 tx=0x7fd1dc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.021+0000 7fd1d77fe640 1 -- 172.21.15.52:0/2504079649 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd1d0061dc0 con 0x7fd1e0107900 2024-09-06T14:54:36.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.199+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd1e019a5c0 con 0x7fd1cc077460 2024-09-06T14:54:36.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.200+0000 7fd1d77fe640 1 -- 172.21.15.52:0/2504079649 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd1e019a5c0 con 0x7fd1cc077460 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd1cc077460 msgr2=0x7fd1cc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd1cc077460 0x7fd1cc079920 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000c00 tx=0x7fd1dc031400 comp rx=0 tx=0).stop 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 msgr2=0x7fd1e019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e019fdb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000b420 tx=0x7fd1d000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 shutdown_connections 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd1e0107900 0x7fd1e019fdb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd1cc077460 0x7fd1cc079920 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 --2- 172.21.15.52:0/2504079649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e0101900 0x7fd1e019f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 >> 172.21.15.52:0/2504079649 conn(0x7fd1e00fd5e0 msgr2=0x7fd1e00744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 shutdown_connections 2024-09-06T14:54:36.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.202+0000 7fd1e83be640 1 -- 172.21.15.52:0/2504079649 wait complete. 2024-09-06T14:54:36.209 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:54:36.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.286+0000 7f3cdfeda640 1 -- 172.21.15.52:0/2266002993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 msgr2=0x7f3cd8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.286+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/2266002993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd8106be0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009880 tx=0x7f3cd002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 -- 172.21.15.52:0/2266002993 shutdown_connections 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/2266002993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd8100800 0x7f3cd8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/2266002993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd8106be0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 -- 172.21.15.52:0/2266002993 >> 172.21.15.52:0/2266002993 conn(0x7f3cd80fc520 msgr2=0x7f3cd80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 -- 172.21.15.52:0/2266002993 shutdown_connections 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 -- 172.21.15.52:0/2266002993 wait complete. 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 Processor -- start 2024-09-06T14:54:36.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.287+0000 7f3cdfeda640 1 -- start start 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdfeda640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd8100800 0x7f3cd80fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdfeda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd80fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdfeda640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd810dcd0 con 0x7f3cd8106800 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdfeda640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd810db50 con 0x7f3cd8100800 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdd475640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd80fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdd475640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd80fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50438/0 (socket says 172.21.15.52:50438) 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdd475640 1 -- 172.21.15.52:0/615457627 learned_addr learned my addr 172.21.15.52:0/615457627 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cddc76640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd8100800 0x7f3cd80fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdd475640 1 -- 172.21.15.52:0/615457627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd8100800 msgr2=0x7f3cd80fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdd475640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd8100800 0x7f3cd80fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdd475640 1 -- 172.21.15.52:0/615457627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd80fd680 con 0x7f3cd8106800 2024-09-06T14:54:36.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cdd475640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd80fd140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00e970 tx=0x7f3ccc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.288+0000 7f3cd6ffd640 1 -- 172.21.15.52:0/615457627 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ccc00cac0 con 0x7f3cd8106800 2024-09-06T14:54:36.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.289+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd80fd970 con 0x7f3cd8106800 2024-09-06T14:54:36.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.289+0000 7f3cd6ffd640 1 -- 172.21.15.52:0/615457627 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ccc0054e0 con 0x7f3cd8106800 2024-09-06T14:54:36.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.289+0000 7f3cd6ffd640 1 -- 172.21.15.52:0/615457627 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ccc010430 con 0x7f3cd8106800 2024-09-06T14:54:36.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.289+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd81a3e60 con 0x7f3cd8106800 2024-09-06T14:54:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.290+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd8101f40 con 0x7f3cd8106800 2024-09-06T14:54:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.290+0000 7f3cd6ffd640 1 -- 172.21.15.52:0/615457627 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3ccc004e80 con 0x7f3cd8106800 2024-09-06T14:54:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.291+0000 7f3cd6ffd640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cc0077460 0x7f3cc0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.291+0000 7f3cd6ffd640 1 -- 172.21.15.52:0/615457627 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3ccc099e70 con 0x7f3cd8106800 2024-09-06T14:54:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.291+0000 7f3cddc76640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cc0077460 0x7f3cc0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.291+0000 7f3cddc76640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cc0077460 0x7f3cc0079920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00096c0 tx=0x7f3cd0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.295+0000 7f3cd6ffd640 1 -- 172.21.15.52:0/615457627 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3ccc062dd0 con 0x7f3cd8106800 2024-09-06T14:54:36.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.477+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3cd8062630 con 0x7f3cc0077460 2024-09-06T14:54:36.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.478+0000 7f3cd6ffd640 1 -- 172.21.15.52:0/615457627 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3cd8062630 con 0x7f3cc0077460 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cc0077460 msgr2=0x7f3cc0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cc0077460 0x7f3cc0079920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00096c0 tx=0x7f3cd0031400 comp rx=0 tx=0).stop 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 msgr2=0x7f3cd80fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd80fd140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00e970 tx=0x7f3ccc00ed70 comp rx=0 tx=0).stop 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 shutdown_connections 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cd8106800 0x7f3cd80fd140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cc0077460 0x7f3cc0079920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 --2- 172.21.15.52:0/615457627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd8100800 0x7f3cd80fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 >> 172.21.15.52:0/615457627 conn(0x7f3cd80fc520 msgr2=0x7f3cd806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 shutdown_connections 2024-09-06T14:54:36.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.480+0000 7f3cdfeda640 1 -- 172.21.15.52:0/615457627 wait complete. 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.563+0000 7ff2ff383640 1 -- 172.21.15.52:0/3546531281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 msgr2=0x7ff2f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.563+0000 7ff2ff383640 1 --2- 172.21.15.52:0/3546531281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f8100c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009880 tx=0x7ff2e802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.563+0000 7ff2ff383640 1 -- 172.21.15.52:0/3546531281 shutdown_connections 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.563+0000 7ff2ff383640 1 --2- 172.21.15.52:0/3546531281 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f8100c60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.563+0000 7ff2ff383640 1 --2- 172.21.15.52:0/3546531281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2f8106800 0x7ff2f8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.563+0000 7ff2ff383640 1 -- 172.21.15.52:0/3546531281 >> 172.21.15.52:0/3546531281 conn(0x7ff2f80fc520 msgr2=0x7ff2f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.563+0000 7ff2ff383640 1 -- 172.21.15.52:0/3546531281 shutdown_connections 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2ff383640 1 -- 172.21.15.52:0/3546531281 wait complete. 2024-09-06T14:54:36.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2ff383640 1 Processor -- start 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2ff383640 1 -- start start 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2ff383640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2ff383640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2f8106800 0x7ff2f819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2ff383640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f810dcb0 con 0x7ff2f8100800 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2ff383640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f810db30 con 0x7ff2f8106800 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2fd11f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2fd11f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50460/0 (socket says 172.21.15.52:50460) 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.564+0000 7ff2fd11f640 1 -- 172.21.15.52:0/2121612824 learned_addr learned my addr 172.21.15.52:0/2121612824 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2fc91e640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2f8106800 0x7ff2f819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2fd11f640 1 -- 172.21.15.52:0/2121612824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2f8106800 msgr2=0x7ff2f819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2fd11f640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2f8106800 0x7ff2f819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2fd11f640 1 -- 172.21.15.52:0/2121612824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f81977f0 con 0x7ff2f8100800 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2fd11f640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f819d670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d8d0 tx=0x7ff2f400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2ee7fc640 1 -- 172.21.15.52:0/2121612824 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2f4017070 con 0x7ff2f8100800 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f8197ae0 con 0x7ff2f8100800 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2ee7fc640 1 -- 172.21.15.52:0/2121612824 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2f4010460 con 0x7ff2f8100800 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2ee7fc640 1 -- 172.21.15.52:0/2121612824 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2f400f5f0 con 0x7ff2f8100800 2024-09-06T14:54:36.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.565+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f8198040 con 0x7ff2f8100800 2024-09-06T14:54:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.566+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f8101f40 con 0x7ff2f8100800 2024-09-06T14:54:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.567+0000 7ff2ee7fc640 1 -- 172.21.15.52:0/2121612824 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff2f4009a30 con 0x7ff2f8100800 2024-09-06T14:54:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.567+0000 7ff2ee7fc640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2e4077460 0x7ff2e4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.568+0000 7ff2ee7fc640 1 -- 172.21.15.52:0/2121612824 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ff2f4099210 con 0x7ff2f8100800 2024-09-06T14:54:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.568+0000 7ff2fc91e640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2e4077460 0x7ff2e4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.568+0000 7ff2fc91e640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2e4077460 0x7ff2e4079920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8198b40 tx=0x7ff2e8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.572+0000 7ff2ee7fc640 1 -- 172.21.15.52:0/2121612824 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff2f4066360 con 0x7ff2f8100800 2024-09-06T14:54:36.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.741+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff2f81982f0 con 0x7ff2e4077460 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.751+0000 7ff2ee7fc640 1 -- 172.21.15.52:0/2121612824 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7ff2f81982f0 con 0x7ff2e4077460 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (7m) 79s ago 17m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (9m) 79s ago 18m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (9m) 50s ago 17m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (5m) 79s ago 18m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (5m) 50s ago 17m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (6m) 79s ago 17m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:54:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (101s) 79s ago 12m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (84s) 79s ago 12m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (68s) 50s ago 12m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (53s) 50s ago 12m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (9m) 79s ago 19m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (8m) 50s ago 17m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (5m) 79s ago 19m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (5m) 50s ago 17m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (7m) 79s ago 17m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (7m) 50s ago 17m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (4m) 79s ago 15m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:54:36.750 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (4m) 79s ago 15m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:54:36.751 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (3m) 79s ago 15m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:54:36.751 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (3m) 50s ago 14m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:54:36.751 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (2m) 50s ago 14m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:54:36.751 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (118s) 50s ago 13m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:54:36.751 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (7m) 79s ago 17m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2e4077460 msgr2=0x7ff2e4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2e4077460 0x7ff2e4079920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8198b40 tx=0x7ff2e8031400 comp rx=0 tx=0).stop 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 msgr2=0x7ff2f819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f819d670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400d8d0 tx=0x7ff2f400dd90 comp rx=0 tx=0).stop 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 shutdown_connections 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff2e4077460 0x7ff2e4079920 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2f8106800 0x7ff2f819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 --2- 172.21.15.52:0/2121612824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2f8100800 0x7ff2f819d670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.753+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 >> 172.21.15.52:0/2121612824 conn(0x7ff2f80fc520 msgr2=0x7ff2f806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:36.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.754+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 shutdown_connections 2024-09-06T14:54:36.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.754+0000 7ff2ff383640 1 -- 172.21.15.52:0/2121612824 wait complete. 2024-09-06T14:54:36.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.835+0000 7f0b70812640 1 -- 172.21.15.52:0/3100059568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 msgr2=0x7f0b6c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.835+0000 7f0b70812640 1 --2- 172.21.15.52:0/3100059568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c106bd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009c20 tx=0x7f0b5c02a970 comp rx=0 tx=0).stop 2024-09-06T14:54:36.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.835+0000 7f0b70812640 1 -- 172.21.15.52:0/3100059568 shutdown_connections 2024-09-06T14:54:36.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.836+0000 7f0b70812640 1 --2- 172.21.15.52:0/3100059568 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b6c1007f0 0x7f0b6c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.836+0000 7f0b70812640 1 --2- 172.21.15.52:0/3100059568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c106bd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.836+0000 7f0b70812640 1 -- 172.21.15.52:0/3100059568 >> 172.21.15.52:0/3100059568 conn(0x7f0b6c0fc550 msgr2=0x7f0b6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:36.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.836+0000 7f0b70812640 1 -- 172.21.15.52:0/3100059568 shutdown_connections 2024-09-06T14:54:36.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.836+0000 7f0b70812640 1 -- 172.21.15.52:0/3100059568 wait complete. 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b70812640 1 Processor -- start 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b70812640 1 -- start start 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b70812640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b6c1007f0 0x7f0b6c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b70812640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b70812640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c10dcc0 con 0x7f0b6c1067f0 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b70812640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c10db40 con 0x7f0b6c1007f0 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b69d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b69d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50480/0 (socket says 172.21.15.52:50480) 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b69d9b640 1 -- 172.21.15.52:0/791037823 learned_addr learned my addr 172.21.15.52:0/791037823 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:36.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b6a59c640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b6c1007f0 0x7f0b6c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b69d9b640 1 -- 172.21.15.52:0/791037823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b6c1007f0 msgr2=0x7f0b6c198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b69d9b640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b6c1007f0 0x7f0b6c198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.837+0000 7f0b69d9b640 1 -- 172.21.15.52:0/791037823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c199350 con 0x7f0b6c1067f0 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.838+0000 7f0b69d9b640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c198d50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000d6f0 tx=0x7f0b6000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.838+0000 7f0b5b7fe640 1 -- 172.21.15.52:0/791037823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b60017070 con 0x7f0b6c1067f0 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.838+0000 7f0b5b7fe640 1 -- 172.21.15.52:0/791037823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b6000de00 con 0x7f0b6c1067f0 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.838+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c199640 con 0x7f0b6c1067f0 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.838+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c1a1c40 con 0x7f0b6c1067f0 2024-09-06T14:54:36.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.838+0000 7f0b5b7fe640 1 -- 172.21.15.52:0/791037823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b60004bb0 con 0x7f0b6c1067f0 2024-09-06T14:54:36.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.839+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6c101f30 con 0x7f0b6c1067f0 2024-09-06T14:54:36.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.840+0000 7f0b5b7fe640 1 -- 172.21.15.52:0/791037823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0b60009a30 con 0x7f0b6c1067f0 2024-09-06T14:54:36.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.840+0000 7f0b5b7fe640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b540774b0 0x7f0b54079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:36.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.840+0000 7f0b6a59c640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b540774b0 0x7f0b54079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:36.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.840+0000 7f0b5b7fe640 1 -- 172.21.15.52:0/791037823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0b600992a0 con 0x7f0b6c1067f0 2024-09-06T14:54:36.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.841+0000 7f0b6a59c640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b540774b0 0x7f0b54079970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009430 tx=0x7f0b5c03c040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:36.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:36.845+0000 7f0b5b7fe640 1 -- 172.21.15.52:0/791037823 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0b6c199640 con 0x7f0b6c1067f0 2024-09-06T14:54:37.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.064+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0b6c108d60 con 0x7f0b6c1067f0 2024-09-06T14:54:37.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.065+0000 7f0b5b7fe640 1 -- 172.21.15.52:0/791037823 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0b600663f0 con 0x7f0b6c1067f0 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:54:37.063 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:54:37.064 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:54:37.064 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:54:37.064 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:54:37.064 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:54:37.064 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b540774b0 msgr2=0x7f0b54079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b540774b0 0x7f0b54079970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009430 tx=0x7f0b5c03c040 comp rx=0 tx=0).stop 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 msgr2=0x7f0b6c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c198d50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000d6f0 tx=0x7f0b6000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 shutdown_connections 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b6c1067f0 0x7f0b6c198d50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0b540774b0 0x7f0b54079970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 --2- 172.21.15.52:0/791037823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0b6c1007f0 0x7f0b6c198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 >> 172.21.15.52:0/791037823 conn(0x7f0b6c0fc550 msgr2=0x7f0b6c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 shutdown_connections 2024-09-06T14:54:37.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.067+0000 7f0b70812640 1 -- 172.21.15.52:0/791037823 wait complete. 2024-09-06T14:54:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 -- 172.21.15.52:0/4024227951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 msgr2=0x7f77b0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 --2- 172.21.15.52:0/4024227951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b0102e90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009c20 tx=0x7f77a002aa00 comp rx=0 tx=0).stop 2024-09-06T14:54:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 -- 172.21.15.52:0/4024227951 shutdown_connections 2024-09-06T14:54:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 --2- 172.21.15.52:0/4024227951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b01033d0 0x7f77b010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 --2- 172.21.15.52:0/4024227951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b0102e90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 -- 172.21.15.52:0/4024227951 >> 172.21.15.52:0/4024227951 conn(0x7f77b00fc550 msgr2=0x7f77b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 -- 172.21.15.52:0/4024227951 shutdown_connections 2024-09-06T14:54:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.149+0000 7f77b572e640 1 -- 172.21.15.52:0/4024227951 wait complete. 2024-09-06T14:54:37.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77b572e640 1 Processor -- start 2024-09-06T14:54:37.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77b572e640 1 -- start start 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77b572e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77b572e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b01033d0 0x7f77b019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77b572e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77b010edc0 con 0x7f77b0102ab0 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77b572e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f77b010ec40 con 0x7f77b01033d0 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77aeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77aeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50496/0 (socket says 172.21.15.52:50496) 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.150+0000 7f77aeffd640 1 -- 172.21.15.52:0/407924923 learned_addr learned my addr 172.21.15.52:0/407924923 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f77ae7fc640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b01033d0 0x7f77b019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f77aeffd640 1 -- 172.21.15.52:0/407924923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b01033d0 msgr2=0x7f77b019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f77aeffd640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b01033d0 0x7f77b019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f77aeffd640 1 -- 172.21.15.52:0/407924923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b01977b0 con 0x7f77b0102ab0 2024-09-06T14:54:37.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f77aeffd640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b019d630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77a0006010 tx=0x7f77a002ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:37.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f7797fff640 1 -- 172.21.15.52:0/407924923 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77a0047070 con 0x7f77b0102ab0 2024-09-06T14:54:37.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f7797fff640 1 -- 172.21.15.52:0/407924923 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77a0003e30 con 0x7f77b0102ab0 2024-09-06T14:54:37.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b0197a40 con 0x7f77b0102ab0 2024-09-06T14:54:37.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f7797fff640 1 -- 172.21.15.52:0/407924923 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77a0033050 con 0x7f77b0102ab0 2024-09-06T14:54:37.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.151+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b0197f70 con 0x7f77b0102ab0 2024-09-06T14:54:37.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.152+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b006a580 con 0x7f77b0102ab0 2024-09-06T14:54:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.153+0000 7f7797fff640 1 -- 172.21.15.52:0/407924923 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f77a004a070 con 0x7f77b0102ab0 2024-09-06T14:54:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.153+0000 7f7797fff640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77980774b0 0x7f7798079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.154+0000 7f7797fff640 1 -- 172.21.15.52:0/407924923 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f77a003e030 con 0x7f77b0102ab0 2024-09-06T14:54:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.154+0000 7f77ae7fc640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77980774b0 0x7f7798079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.154+0000 7f77ae7fc640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77980774b0 0x7f7798079970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ff010 tx=0x7f77a400b360 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:37.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.157+0000 7f7797fff640 1 -- 172.21.15.52:0/407924923 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f77a002ee90 con 0x7f77b0102ab0 2024-09-06T14:54:37.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.346+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f77b0105f80 con 0x7f77b0102ab0 2024-09-06T14:54:37.344 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.347+0000 7f7797fff640 1 -- 172.21.15.52:0/407924923 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f77a00877f0 con 0x7f77b0102ab0 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:54:37.345 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:54:37.346 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:37.347 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:37.348 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:54:37.348 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:54:37.348 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:37.348 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:37.348 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:37.348 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:54:37.349 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:54:37.349 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77980774b0 msgr2=0x7f7798079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77980774b0 0x7f7798079970 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f77b00ff010 tx=0x7f77a400b360 comp rx=0 tx=0).stop 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 msgr2=0x7f77b019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b019d630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77a0006010 tx=0x7f77a002ed20 comp rx=0 tx=0).stop 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 shutdown_connections 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77980774b0 0x7f7798079970 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77b01033d0 0x7f77b019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 --2- 172.21.15.52:0/407924923 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77b0102ab0 0x7f77b019d630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 >> 172.21.15.52:0/407924923 conn(0x7f77b00fc550 msgr2=0x7f77b0108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 shutdown_connections 2024-09-06T14:54:37.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.349+0000 7f77b572e640 1 -- 172.21.15.52:0/407924923 wait complete. 2024-09-06T14:54:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 -- 172.21.15.52:0/3270198300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7704102b80 msgr2=0x7f7704102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 --2- 172.21.15.52:0/3270198300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7704102b80 0x7f7704102f60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009880 tx=0x7f76f402a530 comp rx=0 tx=0).stop 2024-09-06T14:54:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 -- 172.21.15.52:0/3270198300 shutdown_connections 2024-09-06T14:54:37.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 --2- 172.21.15.52:0/3270198300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f77041034a0 0x7f770410b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 --2- 172.21.15.52:0/3270198300 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7704102b80 0x7f7704102f60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 -- 172.21.15.52:0/3270198300 >> 172.21.15.52:0/3270198300 conn(0x7f77040fc520 msgr2=0x7f77040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 -- 172.21.15.52:0/3270198300 shutdown_connections 2024-09-06T14:54:37.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.433+0000 7f770a35d640 1 -- 172.21.15.52:0/3270198300 wait complete. 2024-09-06T14:54:37.432 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:37 smithi052 ceph-mon[112917]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:37.432 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:37 smithi052 ceph-mon[112917]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:37.432 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:37 smithi052 ceph-mon[112917]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:37.432 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:37 smithi052 ceph-mon[112917]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:37.432 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:37 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/791037823' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:54:37.433 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:37 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/407924923' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:54:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.434+0000 7f770a35d640 1 Processor -- start 2024-09-06T14:54:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.434+0000 7f770a35d640 1 -- start start 2024-09-06T14:54:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f770a35d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7704102b80 0x7f770419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f770a35d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77041034a0 0x7f770419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f770a35d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f770410edd0 con 0x7f77041034a0 2024-09-06T14:54:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f770a35d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f770410ec50 con 0x7f7704102b80 2024-09-06T14:54:37.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77041034a0 0x7f770419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77041034a0 0x7f770419fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50506/0 (socket says 172.21.15.52:50506) 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77037fe640 1 -- 172.21.15.52:0/1769338994 learned_addr learned my addr 172.21.15.52:0/1769338994 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f7703fff640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7704102b80 0x7f770419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77037fe640 1 -- 172.21.15.52:0/1769338994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7704102b80 msgr2=0x7f770419f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77037fe640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7704102b80 0x7f770419f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77037fe640 1 -- 172.21.15.52:0/1769338994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7704199ad0 con 0x7f77041034a0 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77037fe640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77041034a0 0x7f770419fe50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f76f800d8d0 tx=0x7f76f800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77017fa640 1 -- 172.21.15.52:0/1769338994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76f8017030 con 0x7f77041034a0 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f77017fa640 1 -- 172.21.15.52:0/1769338994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76f8004020 con 0x7f77041034a0 2024-09-06T14:54:37.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.435+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7704199dc0 con 0x7f77041034a0 2024-09-06T14:54:37.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.436+0000 7f77017fa640 1 -- 172.21.15.52:0/1769338994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76f80047a0 con 0x7f77041034a0 2024-09-06T14:54:37.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.436+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770419a350 con 0x7f77041034a0 2024-09-06T14:54:37.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.437+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f770406a9d0 con 0x7f77041034a0 2024-09-06T14:54:37.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.437+0000 7f77017fa640 1 -- 172.21.15.52:0/1769338994 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f76f80041d0 con 0x7f77041034a0 2024-09-06T14:54:37.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.438+0000 7f77017fa640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76ec077460 0x7f76ec079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.438+0000 7f77017fa640 1 -- 172.21.15.52:0/1769338994 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f76f8018070 con 0x7f77041034a0 2024-09-06T14:54:37.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.438+0000 7f7703fff640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76ec077460 0x7f76ec079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.438+0000 7f7703fff640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76ec077460 0x7f76ec079920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76f40096c0 tx=0x7f76f4004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:37.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.442+0000 7f77017fa640 1 -- 172.21.15.52:0/1769338994 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f76f8062490 con 0x7f77041034a0 2024-09-06T14:54:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:37 smithi165 ceph-mon[82925]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:37 smithi165 ceph-mon[82925]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:37 smithi165 ceph-mon[82925]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:37 smithi165 ceph-mon[82925]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:37 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/791037823' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:54:37.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:37 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/407924923' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:54:37.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.619+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f770419afc0 con 0x7f76ec077460 2024-09-06T14:54:37.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.620+0000 7f77017fa640 1 -- 172.21.15.52:0/1769338994 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f770419afc0 con 0x7f76ec077460 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:54:37.618 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:54:37.619 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:54:37.619 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:54:37.619 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:54:37.619 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:54:37.619 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:54:37.619 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:54:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.622+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76ec077460 msgr2=0x7f76ec079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.622+0000 7f770a35d640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76ec077460 0x7f76ec079920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f76f40096c0 tx=0x7f76f4004f30 comp rx=0 tx=0).stop 2024-09-06T14:54:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.622+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77041034a0 msgr2=0x7f770419fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.622+0000 7f770a35d640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77041034a0 0x7f770419fe50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f76f800d8d0 tx=0x7f76f800dd90 comp rx=0 tx=0).stop 2024-09-06T14:54:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.623+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 shutdown_connections 2024-09-06T14:54:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.623+0000 7f770a35d640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77041034a0 0x7f770419fe50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.623+0000 7f770a35d640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f76ec077460 0x7f76ec079920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.623+0000 7f770a35d640 1 --2- 172.21.15.52:0/1769338994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7704102b80 0x7f770419f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.623+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 >> 172.21.15.52:0/1769338994 conn(0x7f77040fc520 msgr2=0x7f7704100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.623+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 shutdown_connections 2024-09-06T14:54:37.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.623+0000 7f770a35d640 1 -- 172.21.15.52:0/1769338994 wait complete. 2024-09-06T14:54:37.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 -- 172.21.15.52:0/110486420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103440 msgr2=0x7f3e5010b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 --2- 172.21.15.52:0/110486420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103440 0x7f3e5010b930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3e440098b0 tx=0x7f3e4402a560 comp rx=0 tx=0).stop 2024-09-06T14:54:37.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 -- 172.21.15.52:0/110486420 shutdown_connections 2024-09-06T14:54:37.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 --2- 172.21.15.52:0/110486420 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50103440 0x7f3e5010b930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 --2- 172.21.15.52:0/110486420 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e50102b20 0x7f3e50102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 -- 172.21.15.52:0/110486420 >> 172.21.15.52:0/110486420 conn(0x7f3e500fc520 msgr2=0x7f3e500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:37.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 -- 172.21.15.52:0/110486420 shutdown_connections 2024-09-06T14:54:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 -- 172.21.15.52:0/110486420 wait complete. 2024-09-06T14:54:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 Processor -- start 2024-09-06T14:54:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.706+0000 7f3e586cc640 1 -- start start 2024-09-06T14:54:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e586cc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50102b20 0x7f3e5019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e586cc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e50103440 0x7f3e5019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e586cc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010edd0 con 0x7f3e50102b20 2024-09-06T14:54:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e586cc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5010ec50 con 0x7f3e50103440 2024-09-06T14:54:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e56468640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50102b20 0x7f3e5019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e56468640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50102b20 0x7f3e5019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:50516/0 (socket says 172.21.15.52:50516) 2024-09-06T14:54:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e56468640 1 -- 172.21.15.52:0/3159088293 learned_addr learned my addr 172.21.15.52:0/3159088293 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:54:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e55c67640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e50103440 0x7f3e5019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e56468640 1 -- 172.21.15.52:0/3159088293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e50103440 msgr2=0x7f3e5019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e56468640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e50103440 0x7f3e5019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e56468640 1 -- 172.21.15.52:0/3159088293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e50197880 con 0x7f3e50102b20 2024-09-06T14:54:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.707+0000 7f3e56468640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50102b20 0x7f3e5019d6c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000cc60 tx=0x7f3e4000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.708+0000 7f3e4f7fe640 1 -- 172.21.15.52:0/3159088293 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e4000ad30 con 0x7f3e50102b20 2024-09-06T14:54:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.708+0000 7f3e4f7fe640 1 -- 172.21.15.52:0/3159088293 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e40005020 con 0x7f3e50102b20 2024-09-06T14:54:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.708+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e50197b70 con 0x7f3e50102b20 2024-09-06T14:54:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.708+0000 7f3e4f7fe640 1 -- 172.21.15.52:0/3159088293 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e4000f660 con 0x7f3e50102b20 2024-09-06T14:54:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.708+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e501980d0 con 0x7f3e50102b20 2024-09-06T14:54:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.709+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5006aa30 con 0x7f3e50102b20 2024-09-06T14:54:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.709+0000 7f3e4f7fe640 1 -- 172.21.15.52:0/3159088293 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3e400051d0 con 0x7f3e50102b20 2024-09-06T14:54:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.710+0000 7f3e4f7fe640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e380774b0 0x7f3e38079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:54:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.710+0000 7f3e4f7fe640 1 -- 172.21.15.52:0/3159088293 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3e40099d40 con 0x7f3e50102b20 2024-09-06T14:54:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.710+0000 7f3e55c67640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e380774b0 0x7f3e38079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:54:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.710+0000 7f3e55c67640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e380774b0 0x7f3e38079970 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000c00 tx=0x7f3e44031420 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:54:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.714+0000 7f3e4f7fe640 1 -- 172.21.15.52:0/3159088293 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3e40014030 con 0x7f3e50102b20 2024-09-06T14:54:37.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.937+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3e50198db0 con 0x7f3e50102b20 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.937+0000 7f3e4f7fe640 1 -- 172.21.15.52:0/3159088293 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f3e40062d20 con 0x7f3e50102b20 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:54:37.935 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:54:37.936 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:54:37.936 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:54:37.936 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:54:37.936 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:54:37.936 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:54:37.936 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:54:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e380774b0 msgr2=0x7f3e38079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e380774b0 0x7f3e38079970 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000c00 tx=0x7f3e44031420 comp rx=0 tx=0).stop 2024-09-06T14:54:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50102b20 msgr2=0x7f3e5019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:54:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50102b20 0x7f3e5019d6c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000cc60 tx=0x7f3e4000a620 comp rx=0 tx=0).stop 2024-09-06T14:54:37.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 shutdown_connections 2024-09-06T14:54:37.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e380774b0 0x7f3e38079970 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e50103440 0x7f3e5019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 --2- 172.21.15.52:0/3159088293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e50102b20 0x7f3e5019d6c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:54:37.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 >> 172.21.15.52:0/3159088293 conn(0x7f3e500fc520 msgr2=0x7f3e50103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:54:37.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 shutdown_connections 2024-09-06T14:54:37.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:54:37.939+0000 7f3e586cc640 1 -- 172.21.15.52:0/3159088293 wait complete. 2024-09-06T14:54:38.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:38.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:38 smithi052 ceph-mon[112917]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:38.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:38 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3159088293' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:54:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:38 smithi165 ceph-mon[82925]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:54:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:38 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3159088293' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:54:39.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:39 smithi165 ceph-mon[82925]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:39.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:39 smithi052 ceph-mon[112917]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:41.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:41 smithi052 ceph-mon[112917]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:41 smithi165 ceph-mon[82925]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:43.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:43 smithi052 ceph-mon[112917]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:43.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:43 smithi165 ceph-mon[82925]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:45.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:45 smithi052 ceph-mon[112917]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:45 smithi165 ceph-mon[82925]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:47.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:47 smithi052 ceph-mon[112917]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:47 smithi165 ceph-mon[82925]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:49.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:49 smithi052 ceph-mon[112917]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:49.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:49 smithi165 ceph-mon[82925]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:51.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:51 smithi165 ceph-mon[82925]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:51.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:51 smithi052 ceph-mon[112917]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:53 smithi165 ceph-mon[82925]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:53 smithi052 ceph-mon[112917]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:53.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:54:55.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:55 smithi052 ceph-mon[112917]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:55.724 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:55 smithi165 ceph-mon[82925]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:57.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:57 smithi165 ceph-mon[82925]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:57.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:57 smithi052 ceph-mon[112917]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:54:59 smithi165 ceph-mon[82925]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:54:59.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:54:59 smithi052 ceph-mon[112917]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:01.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:01 smithi052 ceph-mon[112917]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:01 smithi165 ceph-mon[82925]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:03.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:03 smithi165 ceph-mon[82925]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:03.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:03 smithi052 ceph-mon[112917]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:05.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:05 smithi165 ceph-mon[82925]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:05.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:05 smithi052 ceph-mon[112917]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:07.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:07 smithi052 ceph-mon[112917]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:07 smithi165 ceph-mon[82925]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:08.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/636240541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 msgr2=0x7ffbb8100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/636240541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8100a90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009880 tx=0x7ffbac02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.034 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/636240541 shutdown_connections 2024-09-06T14:55:08.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/636240541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8100a90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/636240541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbb81066a0 0x7ffbb8106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/636240541 >> 172.21.15.52:0/636240541 conn(0x7ffbb80fc310 msgr2=0x7ffbb80fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:08.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/636240541 shutdown_connections 2024-09-06T14:55:08.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.036+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/636240541 wait complete. 2024-09-06T14:55:08.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbbd1a0640 1 Processor -- start 2024-09-06T14:55:08.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbbd1a0640 1 -- start start 2024-09-06T14:55:08.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbbd1a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbbd1a0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbb81066a0 0x7ffbb8197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbbd1a0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb810db30 con 0x7ffbb8100610 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbbd1a0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb810d9b0 con 0x7ffbb81066a0 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbb7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbb7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47268/0 (socket says 172.21.15.52:47268) 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbb7fff640 1 -- 172.21.15.52:0/376667234 learned_addr learned my addr 172.21.15.52:0/376667234 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.037+0000 7ffbb77fe640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbb81066a0 0x7ffbb8197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbb7fff640 1 -- 172.21.15.52:0/376667234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbb81066a0 msgr2=0x7ffbb8197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbb7fff640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbb81066a0 0x7ffbb8197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbb7fff640 1 -- 172.21.15.52:0/376667234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb819c020 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbb7fff640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8197750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b420 tx=0x7ffba800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbb57fa640 1 -- 172.21.15.52:0/376667234 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffba8011630 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbb57fa640 1 -- 172.21.15.52:0/376667234 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffba8016070 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb819c310 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbb57fa640 1 -- 172.21.15.52:0/376667234 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffba8010d40 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.038+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb819c920 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.039+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb8101d50 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.040+0000 7ffbb57fa640 1 -- 172.21.15.52:0/376667234 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ffba801b460 con 0x7ffbb8100610 2024-09-06T14:55:08.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.040+0000 7ffbb57fa640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffba0077460 0x7ffba0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.040+0000 7ffbb57fa640 1 -- 172.21.15.52:0/376667234 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ffba8098e80 con 0x7ffbb8100610 2024-09-06T14:55:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.040+0000 7ffbb77fe640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffba0077460 0x7ffba0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.041+0000 7ffbb77fe640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffba0077460 0x7ffba0079920 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80fe790 tx=0x7ffbac031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.044+0000 7ffbb57fa640 1 -- 172.21.15.52:0/376667234 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ffba8061de0 con 0x7ffbb8100610 2024-09-06T14:55:08.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.223+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffbb819cc30 con 0x7ffba0077460 2024-09-06T14:55:08.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.225+0000 7ffbb57fa640 1 -- 172.21.15.52:0/376667234 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ffbb819cc30 con 0x7ffba0077460 2024-09-06T14:55:08.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.226+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffba0077460 msgr2=0x7ffba0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.226+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffba0077460 0x7ffba0079920 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80fe790 tx=0x7ffbac031400 comp rx=0 tx=0).stop 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.226+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 msgr2=0x7ffbb8197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.226+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8197750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffba800b420 tx=0x7ffba800b8e0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.227+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 shutdown_connections 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.227+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffba0077460 0x7ffba0079920 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.227+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffbb81066a0 0x7ffbb8197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.227+0000 7ffbbd1a0640 1 --2- 172.21.15.52:0/376667234 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbb8100610 0x7ffbb8197750 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.227+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 >> 172.21.15.52:0/376667234 conn(0x7ffbb80fc310 msgr2=0x7ffbb8069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.227+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 shutdown_connections 2024-09-06T14:55:08.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.227+0000 7ffbbd1a0640 1 -- 172.21.15.52:0/376667234 wait complete. 2024-09-06T14:55:08.233 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:55:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 -- 172.21.15.52:0/1356901073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1067f0 msgr2=0x7fb98c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 --2- 172.21.15.52:0/1356901073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1067f0 0x7fb98c106bd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb988009880 tx=0x7fb98802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 -- 172.21.15.52:0/1356901073 shutdown_connections 2024-09-06T14:55:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 --2- 172.21.15.52:0/1356901073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb98c1007f0 0x7fb98c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 --2- 172.21.15.52:0/1356901073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1067f0 0x7fb98c106bd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 -- 172.21.15.52:0/1356901073 >> 172.21.15.52:0/1356901073 conn(0x7fb98c0fc550 msgr2=0x7fb98c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:08.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 -- 172.21.15.52:0/1356901073 shutdown_connections 2024-09-06T14:55:08.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.311+0000 7fb993586640 1 -- 172.21.15.52:0/1356901073 wait complete. 2024-09-06T14:55:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb993586640 1 Processor -- start 2024-09-06T14:55:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb993586640 1 -- start start 2024-09-06T14:55:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb993586640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1007f0 0x7fb98c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb993586640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb98c1067f0 0x7fb98c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb993586640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c10dca0 con 0x7fb98c1007f0 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb993586640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c10db20 con 0x7fb98c1067f0 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb991322640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1007f0 0x7fb98c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb991322640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1007f0 0x7fb98c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47290/0 (socket says 172.21.15.52:47290) 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb991322640 1 -- 172.21.15.52:0/347278283 learned_addr learned my addr 172.21.15.52:0/347278283 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.312+0000 7fb990b21640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb98c1067f0 0x7fb98c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb991322640 1 -- 172.21.15.52:0/347278283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb98c1067f0 msgr2=0x7fb98c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb991322640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb98c1067f0 0x7fb98c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb991322640 1 -- 172.21.15.52:0/347278283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c197750 con 0x7fb98c1007f0 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb990b21640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb98c1067f0 0x7fb98c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:55:08.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb991322640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1007f0 0x7fb98c19d680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb988031460 tx=0x7fb9880048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb9827fc640 1 -- 172.21.15.52:0/347278283 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb98803f070 con 0x7fb98c1007f0 2024-09-06T14:55:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb9827fc640 1 -- 172.21.15.52:0/347278283 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb988004cf0 con 0x7fb98c1007f0 2024-09-06T14:55:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c1979e0 con 0x7fb98c1007f0 2024-09-06T14:55:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb9827fc640 1 -- 172.21.15.52:0/347278283 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb988035030 con 0x7fb98c1007f0 2024-09-06T14:55:08.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.313+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c197ee0 con 0x7fb98c1007f0 2024-09-06T14:55:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.314+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98c101f30 con 0x7fb98c1007f0 2024-09-06T14:55:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.315+0000 7fb9827fc640 1 -- 172.21.15.52:0/347278283 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb988042070 con 0x7fb98c1007f0 2024-09-06T14:55:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.315+0000 7fb9827fc640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb9780774b0 0x7fb978079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.315+0000 7fb9827fc640 1 -- 172.21.15.52:0/347278283 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fb9880ba1c0 con 0x7fb98c1007f0 2024-09-06T14:55:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.315+0000 7fb990b21640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb9780774b0 0x7fb978079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.316+0000 7fb990b21640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb9780774b0 0x7fb978079970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb98c198fa0 tx=0x7fb97c005d30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.319+0000 7fb9827fc640 1 -- 172.21.15.52:0/347278283 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb9880831a0 con 0x7fb98c1007f0 2024-09-06T14:55:08.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.496+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb98c198190 con 0x7fb9780774b0 2024-09-06T14:55:08.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.497+0000 7fb9827fc640 1 -- 172.21.15.52:0/347278283 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb98c198190 con 0x7fb9780774b0 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb9780774b0 msgr2=0x7fb978079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb9780774b0 0x7fb978079970 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb98c198fa0 tx=0x7fb97c005d30 comp rx=0 tx=0).stop 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1007f0 msgr2=0x7fb98c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1007f0 0x7fb98c19d680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb988031460 tx=0x7fb9880048f0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 shutdown_connections 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb9780774b0 0x7fb978079970 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb98c1067f0 0x7fb98c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 --2- 172.21.15.52:0/347278283 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb98c1007f0 0x7fb98c19d680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 >> 172.21.15.52:0/347278283 conn(0x7fb98c0fc550 msgr2=0x7fb98c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 shutdown_connections 2024-09-06T14:55:08.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.499+0000 7fb993586640 1 -- 172.21.15.52:0/347278283 wait complete. 2024-09-06T14:55:08.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 -- 172.21.15.52:0/1673678966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0107900 msgr2=0x7f95e0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1673678966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0107900 0x7f95e0107ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009880 tx=0x7f95d002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 -- 172.21.15.52:0/1673678966 shutdown_connections 2024-09-06T14:55:08.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1673678966 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95e0101900 0x7f95e0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1673678966 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0107900 0x7f95e0107ce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 -- 172.21.15.52:0/1673678966 >> 172.21.15.52:0/1673678966 conn(0x7f95e00fd620 msgr2=0x7f95e00ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:08.580 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 -- 172.21.15.52:0/1673678966 shutdown_connections 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.582+0000 7f95e5c27640 1 -- 172.21.15.52:0/1673678966 wait complete. 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95e5c27640 1 Processor -- start 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95e5c27640 1 -- start start 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95e5c27640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0101900 0x7f95e019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95e5c27640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95e0107900 0x7f95e019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95e5c27640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95e010ee30 con 0x7f95e0101900 2024-09-06T14:55:08.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95e5c27640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f95e010ecb0 con 0x7f95e0107900 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0101900 0x7f95e019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0101900 0x7f95e019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47318/0 (socket says 172.21.15.52:47318) 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95df7fe640 1 -- 172.21.15.52:0/1791157001 learned_addr learned my addr 172.21.15.52:0/1791157001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.583+0000 7f95d6ffd640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95e0107900 0x7f95e019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95df7fe640 1 -- 172.21.15.52:0/1791157001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95e0107900 msgr2=0x7f95e019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95df7fe640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95e0107900 0x7f95e019fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95df7fe640 1 -- 172.21.15.52:0/1791157001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e01999f0 con 0x7f95e0101900 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95df7fe640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0101900 0x7f95e019f830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f95d0031460 tx=0x7f95d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95dd7fa640 1 -- 172.21.15.52:0/1791157001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95d003f070 con 0x7f95e0101900 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e0199c80 con 0x7f95e0101900 2024-09-06T14:55:08.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e019a1b0 con 0x7f95e0101900 2024-09-06T14:55:08.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95dd7fa640 1 -- 172.21.15.52:0/1791157001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95d0004cf0 con 0x7f95e0101900 2024-09-06T14:55:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.584+0000 7f95dd7fa640 1 -- 172.21.15.52:0/1791157001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95d0035030 con 0x7f95e0101900 2024-09-06T14:55:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.585+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c0005290 con 0x7f95e0101900 2024-09-06T14:55:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.586+0000 7f95dd7fa640 1 -- 172.21.15.52:0/1791157001 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f95d0042070 con 0x7f95e0101900 2024-09-06T14:55:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.586+0000 7f95dd7fa640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f95cc0774b0 0x7f95cc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.586+0000 7f95d6ffd640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f95cc0774b0 0x7f95cc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.586+0000 7f95dd7fa640 1 -- 172.21.15.52:0/1791157001 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f95d00ba0c0 con 0x7f95e0101900 2024-09-06T14:55:08.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.587+0000 7f95d6ffd640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f95cc0774b0 0x7f95cc079970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95e0075840 tx=0x7f95c8009110 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.590+0000 7f95dd7fa640 1 -- 172.21.15.52:0/1791157001 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f95d0083000 con 0x7f95e0101900 2024-09-06T14:55:08.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.759+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f95c0000bc0 con 0x7f95cc0774b0 2024-09-06T14:55:08.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.769+0000 7f95dd7fa640 1 -- 172.21.15.52:0/1791157001 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f95c0000bc0 con 0x7f95cc0774b0 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (7m) 111s ago 18m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (10m) 111s ago 18m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (9m) 82s ago 17m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (5m) 111s ago 18m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (5m) 82s ago 17m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (7m) 111s ago 18m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (2m) 111s ago 13m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:55:08.767 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (117s) 111s ago 13m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (100s) 82s ago 13m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (85s) 82s ago 13m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (9m) 111s ago 19m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (8m) 82s ago 17m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (6m) 111s ago 19m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (6m) 82s ago 17m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (8m) 111s ago 18m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (8m) 82s ago 17m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (5m) 111s ago 16m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:55:08.768 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (4m) 111s ago 16m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:55:08.769 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (4m) 111s ago 15m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:55:08.769 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (3m) 82s ago 15m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:55:08.769 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (3m) 82s ago 14m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:55:08.769 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (2m) 82s ago 14m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:55:08.769 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (7m) 111s ago 18m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:55:08.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f95cc0774b0 msgr2=0x7f95cc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f95cc0774b0 0x7f95cc079970 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f95e0075840 tx=0x7f95c8009110 comp rx=0 tx=0).stop 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0101900 msgr2=0x7f95e019f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0101900 0x7f95e019f830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f95d0031460 tx=0x7f95d00048f0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 shutdown_connections 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f95cc0774b0 0x7f95cc079970 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f95e0107900 0x7f95e019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 --2- 172.21.15.52:0/1791157001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95e0101900 0x7f95e019f830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 >> 172.21.15.52:0/1791157001 conn(0x7f95e00fd620 msgr2=0x7f95e0074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 shutdown_connections 2024-09-06T14:55:08.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.771+0000 7f95e5c27640 1 -- 172.21.15.52:0/1791157001 wait complete. 2024-09-06T14:55:08.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.853+0000 7fe3e56fd640 1 -- 172.21.15.52:0/718770874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 msgr2=0x7fe3e010b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.853+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/718770874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e010b960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009880 tx=0x7fe3c802a530 comp rx=0 tx=0).stop 2024-09-06T14:55:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.853+0000 7fe3e56fd640 1 -- 172.21.15.52:0/718770874 shutdown_connections 2024-09-06T14:55:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.853+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/718770874 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e010b960 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.853+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/718770874 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3e0102b50 0x7fe3e0102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.853+0000 7fe3e56fd640 1 -- 172.21.15.52:0/718770874 >> 172.21.15.52:0/718770874 conn(0x7fe3e00fc550 msgr2=0x7fe3e00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:08.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.854+0000 7fe3e56fd640 1 -- 172.21.15.52:0/718770874 shutdown_connections 2024-09-06T14:55:08.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.854+0000 7fe3e56fd640 1 -- 172.21.15.52:0/718770874 wait complete. 2024-09-06T14:55:08.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.854+0000 7fe3e56fd640 1 Processor -- start 2024-09-06T14:55:08.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.854+0000 7fe3e56fd640 1 -- start start 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3e56fd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3e0102b50 0x7fe3e019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3e56fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3e56fd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e010ede0 con 0x7fe3e0103470 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3e56fd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e010ec60 con 0x7fe3e0102b50 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3de7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47332/0 (socket says 172.21.15.52:47332) 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3de7fc640 1 -- 172.21.15.52:0/166580983 learned_addr learned my addr 172.21.15.52:0/166580983 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3deffd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3e0102b50 0x7fe3e019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3de7fc640 1 -- 172.21.15.52:0/166580983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3e0102b50 msgr2=0x7fe3e019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3de7fc640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3e0102b50 0x7fe3e019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3de7fc640 1 -- 172.21.15.52:0/166580983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e01977b0 con 0x7fe3e0103470 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.855+0000 7fe3de7fc640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e019db70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8004f90 tx=0x7fe3c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.856+0000 7fe3d7fff640 1 -- 172.21.15.52:0/166580983 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3c803f070 con 0x7fe3e0103470 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.856+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e0197a40 con 0x7fe3e0103470 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.856+0000 7fe3d7fff640 1 -- 172.21.15.52:0/166580983 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3c8004c70 con 0x7fe3e0103470 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.856+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e0197f70 con 0x7fe3e0103470 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.856+0000 7fe3d7fff640 1 -- 172.21.15.52:0/166580983 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8035030 con 0x7fe3e0103470 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.857+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e006a4e0 con 0x7fe3e0103470 2024-09-06T14:55:08.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.857+0000 7fe3d7fff640 1 -- 172.21.15.52:0/166580983 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe3c8042070 con 0x7fe3e0103470 2024-09-06T14:55:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.858+0000 7fe3d7fff640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe3cc0774b0 0x7fe3cc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.858+0000 7fe3d7fff640 1 -- 172.21.15.52:0/166580983 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe3c80ba050 con 0x7fe3e0103470 2024-09-06T14:55:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.858+0000 7fe3deffd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe3cc0774b0 0x7fe3cc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:08.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.858+0000 7fe3deffd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe3cc0774b0 0x7fe3cc079970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8005fd0 tx=0x7fe3d800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:08.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:08.862+0000 7fe3d7fff640 1 -- 172.21.15.52:0/166580983 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe3c80871a0 con 0x7fe3e0103470 2024-09-06T14:55:09.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.084+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe3e0105fe0 con 0x7fe3e0103470 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.085+0000 7fe3d7fff640 1 -- 172.21.15.52:0/166580983 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe3c808bbc0 con 0x7fe3e0103470 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:09.083 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:55:09.084 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:55:09.085 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:55:09.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe3cc0774b0 msgr2=0x7fe3cc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe3cc0774b0 0x7fe3cc079970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8005fd0 tx=0x7fe3d800b390 comp rx=0 tx=0).stop 2024-09-06T14:55:09.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 msgr2=0x7fe3e019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e019db70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8004f90 tx=0x7fe3c80048f0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 shutdown_connections 2024-09-06T14:55:09.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3e0103470 0x7fe3e019db70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe3cc0774b0 0x7fe3cc079970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 --2- 172.21.15.52:0/166580983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe3e0102b50 0x7fe3e019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 >> 172.21.15.52:0/166580983 conn(0x7fe3e00fc550 msgr2=0x7fe3e0103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:09.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 shutdown_connections 2024-09-06T14:55:09.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.087+0000 7fe3e56fd640 1 -- 172.21.15.52:0/166580983 wait complete. 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/2999386900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24101900 msgr2=0x7f3d24101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/2999386900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24101900 0x7f3d24101d60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009880 tx=0x7f3d1802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/2999386900 shutdown_connections 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/2999386900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24101900 0x7f3d24101d60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/2999386900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d24107900 0x7f3d24107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/2999386900 >> 172.21.15.52:0/2999386900 conn(0x7f3d240fd600 msgr2=0x7f3d240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/2999386900 shutdown_connections 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/2999386900 wait complete. 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 Processor -- start 2024-09-06T14:55:09.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.170+0000 7f3d2a7f2640 1 -- start start 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d2a7f2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d24101900 0x7f3d2419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d2a7f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24107900 0x7f3d2419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d2a7f2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2410edb0 con 0x7f3d24107900 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d2a7f2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2410ec30 con 0x7f3d24101900 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24107900 0x7f3d2419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d237fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24107900 0x7f3d2419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47358/0 (socket says 172.21.15.52:47358) 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d237fe640 1 -- 172.21.15.52:0/3115679368 learned_addr learned my addr 172.21.15.52:0/3115679368 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d23fff640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d24101900 0x7f3d2419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d237fe640 1 -- 172.21.15.52:0/3115679368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d24101900 msgr2=0x7f3d2419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d237fe640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d24101900 0x7f3d2419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d237fe640 1 -- 172.21.15.52:0/3115679368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d24197800 con 0x7f3d24107900 2024-09-06T14:55:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.171+0000 7f3d237fe640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24107900 0x7f3d2419dbc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d18031460 tx=0x7f3d180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.172+0000 7f3d217fa640 1 -- 172.21.15.52:0/3115679368 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d1803f070 con 0x7f3d24107900 2024-09-06T14:55:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.172+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d24197a90 con 0x7f3d24107900 2024-09-06T14:55:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.172+0000 7f3d217fa640 1 -- 172.21.15.52:0/3115679368 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d18004cf0 con 0x7f3d24107900 2024-09-06T14:55:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.172+0000 7f3d217fa640 1 -- 172.21.15.52:0/3115679368 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d18035030 con 0x7f3d24107900 2024-09-06T14:55:09.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.172+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d24197fc0 con 0x7f3d24107900 2024-09-06T14:55:09.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.173+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d24103040 con 0x7f3d24107900 2024-09-06T14:55:09.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.173+0000 7f3d217fa640 1 -- 172.21.15.52:0/3115679368 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3d18042070 con 0x7f3d24107900 2024-09-06T14:55:09.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.174+0000 7f3d217fa640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d0c077460 0x7f3d0c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.174+0000 7f3d23fff640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d0c077460 0x7f3d0c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.174+0000 7f3d217fa640 1 -- 172.21.15.52:0/3115679368 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3d180ba230 con 0x7f3d24107900 2024-09-06T14:55:09.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.174+0000 7f3d23fff640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d0c077460 0x7f3d0c079920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3d14005e10 tx=0x7f3d14005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:09.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.178+0000 7f3d217fa640 1 -- 172.21.15.52:0/3115679368 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3d18083190 con 0x7f3d24107900 2024-09-06T14:55:09.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.365+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3d24109e90 con 0x7f3d24107900 2024-09-06T14:55:09.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.365+0000 7f3d217fa640 1 -- 172.21.15.52:0/3115679368 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f3d18087300 con 0x7f3d24107900 2024-09-06T14:55:09.363 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:55:09.363 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:55:09.363 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:55:09.363 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:55:09.363 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:55:09.364 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:55:09.365 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:09.366 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:09.367 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:09.367 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:55:09.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d0c077460 msgr2=0x7f3d0c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d0c077460 0x7f3d0c079920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3d14005e10 tx=0x7f3d14005da0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24107900 msgr2=0x7f3d2419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24107900 0x7f3d2419dbc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d18031460 tx=0x7f3d180048f0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 shutdown_connections 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d24107900 0x7f3d2419dbc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d0c077460 0x7f3d0c079920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 --2- 172.21.15.52:0/3115679368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d24101900 0x7f3d2419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 >> 172.21.15.52:0/3115679368 conn(0x7f3d240fd600 msgr2=0x7f3d240fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 shutdown_connections 2024-09-06T14:55:09.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.367+0000 7f3d2a7f2640 1 -- 172.21.15.52:0/3115679368 wait complete. 2024-09-06T14:55:09.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 -- 172.21.15.52:0/3414834091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 msgr2=0x7ff6c4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3414834091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c4107ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009880 tx=0x7ff6b802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 -- 172.21.15.52:0/3414834091 shutdown_connections 2024-09-06T14:55:09.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3414834091 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6c4101900 0x7ff6c4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3414834091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c4107ce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 -- 172.21.15.52:0/3414834091 >> 172.21.15.52:0/3414834091 conn(0x7ff6c40fd600 msgr2=0x7ff6c40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:09.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 -- 172.21.15.52:0/3414834091 shutdown_connections 2024-09-06T14:55:09.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.451+0000 7ff6cb223640 1 -- 172.21.15.52:0/3414834091 wait complete. 2024-09-06T14:55:09.450 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:09 smithi052 ceph-mon[112917]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:09.450 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:09 smithi052 ceph-mon[112917]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:09.450 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:09 smithi052 ceph-mon[112917]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:09.450 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:09 smithi052 ceph-mon[112917]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:09.450 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:09 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/166580983' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:55:09.450 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:09 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3115679368' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6cb223640 1 Processor -- start 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6cb223640 1 -- start start 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6cb223640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6c4101900 0x7ff6c419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6cb223640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6cb223640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c410edd0 con 0x7ff6c4107900 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6cb223640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff6c410ec50 con 0x7ff6c4101900 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6c3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47370/0 (socket says 172.21.15.52:47370) 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6c3fff640 1 -- 172.21.15.52:0/3329065943 learned_addr learned my addr 172.21.15.52:0/3329065943 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.452+0000 7ff6c8fbf640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6c4101900 0x7ff6c419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6c3fff640 1 -- 172.21.15.52:0/3329065943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6c4101900 msgr2=0x7ff6c419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6c3fff640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6c4101900 0x7ff6c419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6c3fff640 1 -- 172.21.15.52:0/3329065943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c41977c0 con 0x7ff6c4107900 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6c3fff640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c419db80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000c8f0 tx=0x7ff6b000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6c1ffb640 1 -- 172.21.15.52:0/3329065943 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff6b00079b0 con 0x7ff6c4107900 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c4197ab0 con 0x7ff6c4107900 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6c1ffb640 1 -- 172.21.15.52:0/3329065943 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6b00054e0 con 0x7ff6c4107900 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6c1ffb640 1 -- 172.21.15.52:0/3329065943 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff6b0004dd0 con 0x7ff6c4107900 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.453+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6c4198040 con 0x7ff6c4107900 2024-09-06T14:55:09.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.454+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c4103040 con 0x7ff6c4107900 2024-09-06T14:55:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.455+0000 7ff6c1ffb640 1 -- 172.21.15.52:0/3329065943 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff6b0005020 con 0x7ff6c4107900 2024-09-06T14:55:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.456+0000 7ff6c1ffb640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff6b40773f0 0x7ff6b40798b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.456+0000 7ff6c1ffb640 1 -- 172.21.15.52:0/3329065943 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ff6b0099850 con 0x7ff6c4107900 2024-09-06T14:55:09.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.456+0000 7ff6c8fbf640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff6b40773f0 0x7ff6b40798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.457+0000 7ff6c8fbf640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff6b40773f0 0x7ff6b40798b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8031460 tx=0x7ff6b8005bd0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:09.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.463+0000 7ff6c1ffb640 1 -- 172.21.15.52:0/3329065943 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff6b0014030 con 0x7ff6c4107900 2024-09-06T14:55:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.639+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff6c4198350 con 0x7ff6b40773f0 2024-09-06T14:55:09.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.640+0000 7ff6c1ffb640 1 -- 172.21.15.52:0/3329065943 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff6c4198350 con 0x7ff6b40773f0 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:55:09.638 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:55:09.639 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:55:09.639 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:55:09.639 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:55:09.639 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:55:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff6b40773f0 msgr2=0x7ff6b40798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff6b40773f0 0x7ff6b40798b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8031460 tx=0x7ff6b8005bd0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 msgr2=0x7ff6c419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c419db80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000c8f0 tx=0x7ff6b000cdb0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 shutdown_connections 2024-09-06T14:55:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6c4107900 0x7ff6c419db80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff6b40773f0 0x7ff6b40798b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 --2- 172.21.15.52:0/3329065943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff6c4101900 0x7ff6c419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 >> 172.21.15.52:0/3329065943 conn(0x7ff6c40fd600 msgr2=0x7ff6c40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 shutdown_connections 2024-09-06T14:55:09.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.642+0000 7ff6cb223640 1 -- 172.21.15.52:0/3329065943 wait complete. 2024-09-06T14:55:09.717 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:09 smithi165 ceph-mon[82925]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:09.717 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:09 smithi165 ceph-mon[82925]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:09.717 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:09 smithi165 ceph-mon[82925]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:09.717 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:09 smithi165 ceph-mon[82925]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:09.717 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:09 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/166580983' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:55:09.717 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:09 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3115679368' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:55:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 -- 172.21.15.52:0/1973661644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 msgr2=0x7f7c44102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 --2- 172.21.15.52:0/1973661644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c44102ea0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009880 tx=0x7f7c3402a530 comp rx=0 tx=0).stop 2024-09-06T14:55:09.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 -- 172.21.15.52:0/1973661644 shutdown_connections 2024-09-06T14:55:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 --2- 172.21.15.52:0/1973661644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c441033e0 0x7f7c4410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 --2- 172.21.15.52:0/1973661644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c44102ea0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 -- 172.21.15.52:0/1973661644 >> 172.21.15.52:0/1973661644 conn(0x7f7c440fc520 msgr2=0x7f7c440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 -- 172.21.15.52:0/1973661644 shutdown_connections 2024-09-06T14:55:09.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.728+0000 7f7c493cf640 1 -- 172.21.15.52:0/1973661644 wait complete. 2024-09-06T14:55:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c493cf640 1 Processor -- start 2024-09-06T14:55:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c493cf640 1 -- start start 2024-09-06T14:55:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c493cf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c4419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c493cf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c441033e0 0x7f7c4419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c493cf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4410edf0 con 0x7f7c44102ac0 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c493cf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4410ec70 con 0x7f7c441033e0 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c42ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c4419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c42ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c4419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47380/0 (socket says 172.21.15.52:47380) 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c42ffd640 1 -- 172.21.15.52:0/3999786543 learned_addr learned my addr 172.21.15.52:0/3999786543 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.729+0000 7f7c427fc640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c441033e0 0x7f7c4419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c42ffd640 1 -- 172.21.15.52:0/3999786543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c441033e0 msgr2=0x7f7c4419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c42ffd640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c441033e0 0x7f7c4419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c42ffd640 1 -- 172.21.15.52:0/3999786543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c441977e0 con 0x7f7c44102ac0 2024-09-06T14:55:09.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c42ffd640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c4419d660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c34031460 tx=0x7f7c34004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c2bfff640 1 -- 172.21.15.52:0/3999786543 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c3403f070 con 0x7f7c44102ac0 2024-09-06T14:55:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c2bfff640 1 -- 172.21.15.52:0/3999786543 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c340035f0 con 0x7f7c44102ac0 2024-09-06T14:55:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c2bfff640 1 -- 172.21.15.52:0/3999786543 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c34035030 con 0x7f7c44102ac0 2024-09-06T14:55:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c44197a70 con 0x7f7c44102ac0 2024-09-06T14:55:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.730+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c44197fa0 con 0x7f7c44102ac0 2024-09-06T14:55:09.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.731+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4406aa90 con 0x7f7c44102ac0 2024-09-06T14:55:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.732+0000 7f7c2bfff640 1 -- 172.21.15.52:0/3999786543 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7c34042070 con 0x7f7c44102ac0 2024-09-06T14:55:09.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.733+0000 7f7c2bfff640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7c2c0774b0 0x7f7c2c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.733+0000 7f7c2bfff640 1 -- 172.21.15.52:0/3999786543 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7c340b9fe0 con 0x7f7c44102ac0 2024-09-06T14:55:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.733+0000 7f7c427fc640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7c2c0774b0 0x7f7c2c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.733+0000 7f7c427fc640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7c2c0774b0 0x7f7c2c079970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c44108900 tx=0x7f7c38005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:09.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.737+0000 7f7c2bfff640 1 -- 172.21.15.52:0/3999786543 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7c34087130 con 0x7f7c44102ac0 2024-09-06T14:55:09.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.966+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7c44105f90 con 0x7f7c44102ac0 2024-09-06T14:55:09.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.967+0000 7f7c2bfff640 1 -- 172.21.15.52:0/3999786543 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f7c3408bb50 con 0x7f7c44102ac0 2024-09-06T14:55:09.965 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:55:09.965 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:55:09.965 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:55:09.966 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:55:09.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7c2c0774b0 msgr2=0x7f7c2c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7c2c0774b0 0x7f7c2c079970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c44108900 tx=0x7f7c38005f90 comp rx=0 tx=0).stop 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 msgr2=0x7f7c4419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c4419d660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c34031460 tx=0x7f7c34004530 comp rx=0 tx=0).stop 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 shutdown_connections 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7c2c0774b0 0x7f7c2c079970 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c441033e0 0x7f7c4419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 --2- 172.21.15.52:0/3999786543 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c44102ac0 0x7f7c4419d660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 >> 172.21.15.52:0/3999786543 conn(0x7f7c440fc520 msgr2=0x7f7c44108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:09.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 shutdown_connections 2024-09-06T14:55:09.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:09.969+0000 7f7c493cf640 1 -- 172.21.15.52:0/3999786543 wait complete. 2024-09-06T14:55:10.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:10 smithi052 ceph-mon[112917]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:10.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:10 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3999786543' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:55:10.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:10 smithi165 ceph-mon[82925]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:10.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:10 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3999786543' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:55:11.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:11 smithi165 ceph-mon[82925]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:11.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:11 smithi052 ceph-mon[112917]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:13.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:13 smithi052 ceph-mon[112917]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:13.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:13 smithi165 ceph-mon[82925]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:15.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:15 smithi165 ceph-mon[82925]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:15.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:15 smithi052 ceph-mon[112917]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:17 smithi165 ceph-mon[82925]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:17.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:17 smithi052 ceph-mon[112917]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:19.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:19 smithi052 ceph-mon[112917]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:19.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:19 smithi165 ceph-mon[82925]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:21 smithi165 ceph-mon[82925]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:21.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:21 smithi052 ceph-mon[112917]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:23.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:23 smithi165 ceph-mon[82925]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:23.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:23 smithi052 ceph-mon[112917]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:23.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:25.613 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:25 smithi052 ceph-mon[112917]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:25.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:25 smithi165 ceph-mon[82925]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:27.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:27 smithi165 ceph-mon[82925]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:27.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:27 smithi052 ceph-mon[112917]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:29 smithi165 ceph-mon[82925]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:29.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:29 smithi052 ceph-mon[112917]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:31.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:31 smithi052 ceph-mon[112917]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:31.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:31 smithi165 ceph-mon[82925]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:33.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:33 smithi165 ceph-mon[82925]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:33.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:33 smithi052 ceph-mon[112917]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:35 smithi165 ceph-mon[82925]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:35.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:35 smithi052 ceph-mon[112917]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:37.624 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:37 smithi052 ceph-mon[112917]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:37 smithi165 ceph-mon[82925]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:38.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:39 smithi165 ceph-mon[82925]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:39.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:39 smithi052 ceph-mon[112917]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 -- 172.21.15.52:0/676167285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 msgr2=0x7f3998106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 --2- 172.21.15.52:0/676167285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f3998106be0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3994009880 tx=0x7f399402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 -- 172.21.15.52:0/676167285 shutdown_connections 2024-09-06T14:55:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 --2- 172.21.15.52:0/676167285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3998100800 0x7f3998100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 --2- 172.21.15.52:0/676167285 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f3998106be0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 -- 172.21.15.52:0/676167285 >> 172.21.15.52:0/676167285 conn(0x7f39980fc520 msgr2=0x7f39980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:40.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 -- 172.21.15.52:0/676167285 shutdown_connections 2024-09-06T14:55:40.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 -- 172.21.15.52:0/676167285 wait complete. 2024-09-06T14:55:40.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.067+0000 7f399fa49640 1 Processor -- start 2024-09-06T14:55:40.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399fa49640 1 -- start start 2024-09-06T14:55:40.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399fa49640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3998100800 0x7f39980fcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399fa49640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f39980fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399fa49640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f399810dcd0 con 0x7f3998106800 2024-09-06T14:55:40.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399fa49640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f399810db50 con 0x7f3998100800 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399cfe4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f39980fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399cfe4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f39980fd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54770/0 (socket says 172.21.15.52:54770) 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399cfe4640 1 -- 172.21.15.52:0/1993954275 learned_addr learned my addr 172.21.15.52:0/1993954275 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399d7e5640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3998100800 0x7f39980fcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399cfe4640 1 -- 172.21.15.52:0/1993954275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3998100800 msgr2=0x7f39980fcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399cfe4640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3998100800 0x7f39980fcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.068+0000 7f399cfe4640 1 -- 172.21.15.52:0/1993954275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39980fd6e0 con 0x7f3998106800 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.069+0000 7f399cfe4640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f39980fd1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f398800d6f0 tx=0x7f398800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.069+0000 7f398e7fc640 1 -- 172.21.15.52:0/1993954275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3988017070 con 0x7f3998106800 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.069+0000 7f398e7fc640 1 -- 172.21.15.52:0/1993954275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f398800de00 con 0x7f3998106800 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.069+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39980fd9d0 con 0x7f3998106800 2024-09-06T14:55:40.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.069+0000 7f398e7fc640 1 -- 172.21.15.52:0/1993954275 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3988004bb0 con 0x7f3998106800 2024-09-06T14:55:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.069+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39981a3e60 con 0x7f3998106800 2024-09-06T14:55:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.070+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3998101f40 con 0x7f3998106800 2024-09-06T14:55:40.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.070+0000 7f398e7fc640 1 -- 172.21.15.52:0/1993954275 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3988004e60 con 0x7f3998106800 2024-09-06T14:55:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.071+0000 7f398e7fc640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3984077460 0x7f3984079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.071+0000 7f399d7e5640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3984077460 0x7f3984079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.071+0000 7f398e7fc640 1 -- 172.21.15.52:0/1993954275 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3988099370 con 0x7f3998106800 2024-09-06T14:55:40.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.072+0000 7f399d7e5640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3984077460 0x7f3984079920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39940096c0 tx=0x7f3994031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.075+0000 7f398e7fc640 1 -- 172.21.15.52:0/1993954275 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3988066440 con 0x7f3998106800 2024-09-06T14:55:40.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.260+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3998062630 con 0x7f3984077460 2024-09-06T14:55:40.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.262+0000 7f398e7fc640 1 -- 172.21.15.52:0/1993954275 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3998062630 con 0x7f3984077460 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3984077460 msgr2=0x7f3984079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3984077460 0x7f3984079920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39940096c0 tx=0x7f3994031400 comp rx=0 tx=0).stop 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 msgr2=0x7f39980fd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f39980fd1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f398800d6f0 tx=0x7f398800dbb0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 shutdown_connections 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3998106800 0x7f39980fd1a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3984077460 0x7f3984079920 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 --2- 172.21.15.52:0/1993954275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3998100800 0x7f39980fcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 >> 172.21.15.52:0/1993954275 conn(0x7f39980fc520 msgr2=0x7f399806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 shutdown_connections 2024-09-06T14:55:40.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.264+0000 7f399fa49640 1 -- 172.21.15.52:0/1993954275 wait complete. 2024-09-06T14:55:40.271 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:55:40.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 -- 172.21.15.52:0/4197328859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 msgr2=0x7f3124100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 --2- 172.21.15.52:0/4197328859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f3124100c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3118009880 tx=0x7f311802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 -- 172.21.15.52:0/4197328859 shutdown_connections 2024-09-06T14:55:40.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 --2- 172.21.15.52:0/4197328859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f3124100c50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 --2- 172.21.15.52:0/4197328859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31241067f0 0x7f3124106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 -- 172.21.15.52:0/4197328859 >> 172.21.15.52:0/4197328859 conn(0x7f31240fc550 msgr2=0x7f31240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 -- 172.21.15.52:0/4197328859 shutdown_connections 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.349+0000 7f312c027640 1 -- 172.21.15.52:0/4197328859 wait complete. 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f312c027640 1 Processor -- start 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f312c027640 1 -- start start 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f312c027640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f312419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f312c027640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31241067f0 0x7f312419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f312c027640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f312410dcc0 con 0x7f31241007f0 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f312c027640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f312410db40 con 0x7f31241067f0 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f3129dc3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f312419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f3129dc3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f312419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47620/0 (socket says 172.21.15.52:47620) 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f3129dc3640 1 -- 172.21.15.52:0/3953055479 learned_addr learned my addr 172.21.15.52:0/3953055479 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f31295c2640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31241067f0 0x7f312419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f3129dc3640 1 -- 172.21.15.52:0/3953055479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31241067f0 msgr2=0x7f312419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f3129dc3640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31241067f0 0x7f312419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.350+0000 7f3129dc3640 1 -- 172.21.15.52:0/3953055479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3124197780 con 0x7f31241007f0 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.351+0000 7f3129dc3640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f312419d600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f311400eb10 tx=0x7f311400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.351+0000 7f3122ffd640 1 -- 172.21.15.52:0/3953055479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f311400cce0 con 0x7f31241007f0 2024-09-06T14:55:40.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.351+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3124197a70 con 0x7f31241007f0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.351+0000 7f3122ffd640 1 -- 172.21.15.52:0/3953055479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3114005020 con 0x7f31241007f0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.351+0000 7f3122ffd640 1 -- 172.21.15.52:0/3953055479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3114010660 con 0x7f31241007f0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.351+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3124197fd0 con 0x7f31241007f0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.352+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3124101f30 con 0x7f31241007f0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.352+0000 7f3122ffd640 1 -- 172.21.15.52:0/3953055479 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f31140051d0 con 0x7f31241007f0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.353+0000 7f3122ffd640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f310c07b8c0 0x7f310c07dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.353+0000 7f3122ffd640 1 -- 172.21.15.52:0/3953055479 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3114099ee0 con 0x7f31241007f0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.353+0000 7f31295c2640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f310c07b8c0 0x7f310c07dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.354+0000 7f31295c2640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f310c07b8c0 0x7f310c07dd80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3124198ad0 tx=0x7f3118031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.357+0000 7f3122ffd640 1 -- 172.21.15.52:0/3953055479 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3114062ec0 con 0x7f31241007f0 2024-09-06T14:55:40.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.534+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f31241982e0 con 0x7f310c07b8c0 2024-09-06T14:55:40.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.535+0000 7f3122ffd640 1 -- 172.21.15.52:0/3953055479 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f31241982e0 con 0x7f310c07b8c0 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f310c07b8c0 msgr2=0x7f310c07dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f310c07b8c0 0x7f310c07dd80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3124198ad0 tx=0x7f3118031400 comp rx=0 tx=0).stop 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 msgr2=0x7f312419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f312419d600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f311400eb10 tx=0x7f311400c2d0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 shutdown_connections 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f310c07b8c0 0x7f310c07dd80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31241067f0 0x7f312419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 --2- 172.21.15.52:0/3953055479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f31241007f0 0x7f312419d600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 >> 172.21.15.52:0/3953055479 conn(0x7f31240fc550 msgr2=0x7f3124104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:40.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 shutdown_connections 2024-09-06T14:55:40.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.538+0000 7f312c027640 1 -- 172.21.15.52:0/3953055479 wait complete. 2024-09-06T14:55:40.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.621+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4218200695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 msgr2=0x7fbecc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.621+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4218200695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc107ce0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009c20 tx=0x7fbebc02a970 comp rx=0 tx=0).stop 2024-09-06T14:55:40.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.621+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4218200695 shutdown_connections 2024-09-06T14:55:40.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.621+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4218200695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbecc101900 0x7fbecc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.621+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4218200695 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc107ce0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.621+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4218200695 >> 172.21.15.52:0/4218200695 conn(0x7fbecc0fd600 msgr2=0x7fbecc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:40.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4218200695 shutdown_connections 2024-09-06T14:55:40.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4218200695 wait complete. 2024-09-06T14:55:40.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 Processor -- start 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 -- start start 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbecc101900 0x7fbecc19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc10edd0 con 0x7fbecc107900 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.622+0000 7fbed2b0b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc10ec50 con 0x7fbecc101900 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbecbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbecbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47642/0 (socket says 172.21.15.52:47642) 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbecbfff640 1 -- 172.21.15.52:0/4117004339 learned_addr learned my addr 172.21.15.52:0/4117004339 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:40.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbed08a7640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbecc101900 0x7fbecc19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbecbfff640 1 -- 172.21.15.52:0/4117004339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbecc101900 msgr2=0x7fbecc19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbecbfff640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbecc101900 0x7fbecc19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbecbfff640 1 -- 172.21.15.52:0/4117004339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc1977a0 con 0x7fbecc107900 2024-09-06T14:55:40.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbecbfff640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc19db60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c8f0 tx=0x7fbeb400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbec9ffb640 1 -- 172.21.15.52:0/4117004339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeb40079b0 con 0x7fbecc107900 2024-09-06T14:55:40.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbec9ffb640 1 -- 172.21.15.52:0/4117004339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbeb40054e0 con 0x7fbecc107900 2024-09-06T14:55:40.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc197a90 con 0x7fbecc107900 2024-09-06T14:55:40.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.623+0000 7fbec9ffb640 1 -- 172.21.15.52:0/4117004339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeb4004dd0 con 0x7fbecc107900 2024-09-06T14:55:40.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.624+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc198020 con 0x7fbecc107900 2024-09-06T14:55:40.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.625+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc103040 con 0x7fbecc107900 2024-09-06T14:55:40.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.625+0000 7fbec9ffb640 1 -- 172.21.15.52:0/4117004339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbeb4005000 con 0x7fbecc107900 2024-09-06T14:55:40.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.625+0000 7fbec9ffb640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbeb80773f0 0x7fbeb80798b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.626+0000 7fbec9ffb640 1 -- 172.21.15.52:0/4117004339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fbeb40997c0 con 0x7fbecc107900 2024-09-06T14:55:40.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.626+0000 7fbed08a7640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbeb80773f0 0x7fbeb80798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.626+0000 7fbed08a7640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbeb80773f0 0x7fbeb80798b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009430 tx=0x7fbebc0093a0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.629+0000 7fbec9ffb640 1 -- 172.21.15.52:0/4117004339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbeb4014030 con 0x7fbecc107900 2024-09-06T14:55:40.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.798+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbecc198330 con 0x7fbeb80773f0 2024-09-06T14:55:40.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.807+0000 7fbec9ffb640 1 -- 172.21.15.52:0/4117004339 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fbecc198330 con 0x7fbeb80773f0 2024-09-06T14:55:40.805 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:55:40.805 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (8m) 2m ago 18m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:55:40.805 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (10m) 2m ago 19m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:55:40.805 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (10m) 114s ago 18m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (6m) 2m ago 19m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (6m) 114s ago 18m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (7m) 2m ago 18m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (2m) 2m ago 13m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (2m) 2m ago 13m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (2m) 114s ago 13m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (117s) 114s ago 13m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (10m) 2m ago 20m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (9m) 114s ago 18m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (6m) 2m ago 20m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (6m) 114s ago 18m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (8m) 2m ago 19m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:55:40.806 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (8m) 114s ago 18m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:55:40.807 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (5m) 2m ago 17m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:55:40.807 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (5m) 2m ago 16m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:55:40.807 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (4m) 2m ago 16m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:55:40.807 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (4m) 114s ago 15m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:55:40.807 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (3m) 114s ago 15m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:55:40.807 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (3m) 114s ago 14m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:55:40.807 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (8m) 2m ago 18m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbeb80773f0 msgr2=0x7fbeb80798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbeb80773f0 0x7fbeb80798b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009430 tx=0x7fbebc0093a0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 msgr2=0x7fbecc19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc19db60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400c8f0 tx=0x7fbeb400cdb0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 shutdown_connections 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbecc107900 0x7fbecc19db60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbeb80773f0 0x7fbeb80798b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 --2- 172.21.15.52:0/4117004339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbecc101900 0x7fbecc19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 >> 172.21.15.52:0/4117004339 conn(0x7fbecc0fd600 msgr2=0x7fbecc0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 shutdown_connections 2024-09-06T14:55:40.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.809+0000 7fbed2b0b640 1 -- 172.21.15.52:0/4117004339 wait complete. 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 -- 172.21.15.52:0/3945429610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30100800 msgr2=0x7fda30100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 --2- 172.21.15.52:0/3945429610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30100800 0x7fda30100c60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fda20009880 tx=0x7fda2002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 -- 172.21.15.52:0/3945429610 shutdown_connections 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 --2- 172.21.15.52:0/3945429610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30100800 0x7fda30100c60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 --2- 172.21.15.52:0/3945429610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda30106800 0x7fda30106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 -- 172.21.15.52:0/3945429610 >> 172.21.15.52:0/3945429610 conn(0x7fda300fc520 msgr2=0x7fda300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 -- 172.21.15.52:0/3945429610 shutdown_connections 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.891+0000 7fda38563640 1 -- 172.21.15.52:0/3945429610 wait complete. 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.892+0000 7fda38563640 1 Processor -- start 2024-09-06T14:55:40.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.892+0000 7fda38563640 1 -- start start 2024-09-06T14:55:40.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.892+0000 7fda38563640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda30100800 0x7fda3019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.892+0000 7fda38563640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30106800 0x7fda3019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.892+0000 7fda38563640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda3010dcb0 con 0x7fda30106800 2024-09-06T14:55:40.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.892+0000 7fda38563640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda3010db30 con 0x7fda30100800 2024-09-06T14:55:40.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.892+0000 7fda35afe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30106800 0x7fda3019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda35afe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30106800 0x7fda3019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47660/0 (socket says 172.21.15.52:47660) 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda35afe640 1 -- 172.21.15.52:0/848381299 learned_addr learned my addr 172.21.15.52:0/848381299 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda362ff640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda30100800 0x7fda3019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda35afe640 1 -- 172.21.15.52:0/848381299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda30100800 msgr2=0x7fda3019f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda35afe640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda30100800 0x7fda3019f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda35afe640 1 -- 172.21.15.52:0/848381299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda301999c0 con 0x7fda30106800 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda35afe640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30106800 0x7fda3019fd40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda20031460 tx=0x7fda200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda277fe640 1 -- 172.21.15.52:0/848381299 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda2003f070 con 0x7fda30106800 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda277fe640 1 -- 172.21.15.52:0/848381299 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda200035f0 con 0x7fda30106800 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda277fe640 1 -- 172.21.15.52:0/848381299 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda20035030 con 0x7fda30106800 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda30199c50 con 0x7fda30106800 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.893+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3019a180 con 0x7fda30106800 2024-09-06T14:55:40.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.894+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda30101f40 con 0x7fda30106800 2024-09-06T14:55:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.895+0000 7fda277fe640 1 -- 172.21.15.52:0/848381299 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fda20042070 con 0x7fda30106800 2024-09-06T14:55:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.895+0000 7fda277fe640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda1c0774b0 0x7fda1c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.895+0000 7fda277fe640 1 -- 172.21.15.52:0/848381299 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fda200ba160 con 0x7fda30106800 2024-09-06T14:55:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.895+0000 7fda362ff640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda1c0774b0 0x7fda1c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:40.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.896+0000 7fda362ff640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda1c0774b0 0x7fda1c079970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda2c005fd0 tx=0x7fda2c005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:40.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:40.899+0000 7fda277fe640 1 -- 172.21.15.52:0/848381299 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fda200830a0 con 0x7fda30106800 2024-09-06T14:55:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.119+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fda3019af20 con 0x7fda30106800 2024-09-06T14:55:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.119+0000 7fda277fe640 1 -- 172.21.15.52:0/848381299 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fda20087210 con 0x7fda30106800 2024-09-06T14:55:41.117 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:55:41.118 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:55:41.119 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:55:41.119 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:55:41.119 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:55:41.119 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:55:41.119 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:55:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda1c0774b0 msgr2=0x7fda1c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda1c0774b0 0x7fda1c079970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda2c005fd0 tx=0x7fda2c005850 comp rx=0 tx=0).stop 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30106800 msgr2=0x7fda3019fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30106800 0x7fda3019fd40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fda20031460 tx=0x7fda200045e0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 shutdown_connections 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda30106800 0x7fda3019fd40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda1c0774b0 0x7fda1c079970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 --2- 172.21.15.52:0/848381299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda30100800 0x7fda3019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 >> 172.21.15.52:0/848381299 conn(0x7fda300fc520 msgr2=0x7fda3006a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.121+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 shutdown_connections 2024-09-06T14:55:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.122+0000 7fda38563640 1 -- 172.21.15.52:0/848381299 wait complete. 2024-09-06T14:55:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 -- 172.21.15.52:0/3593330658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4107900 msgr2=0x7fbcb4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 --2- 172.21.15.52:0/3593330658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4107900 0x7fbcb4107ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009880 tx=0x7fbca402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 -- 172.21.15.52:0/3593330658 shutdown_connections 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 --2- 172.21.15.52:0/3593330658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb4101900 0x7fbcb4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 --2- 172.21.15.52:0/3593330658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4107900 0x7fbcb4107ce0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 -- 172.21.15.52:0/3593330658 >> 172.21.15.52:0/3593330658 conn(0x7fbcb40fd600 msgr2=0x7fbcb40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 -- 172.21.15.52:0/3593330658 shutdown_connections 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.204+0000 7fbcba689640 1 -- 172.21.15.52:0/3593330658 wait complete. 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcba689640 1 Processor -- start 2024-09-06T14:55:41.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcba689640 1 -- start start 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcba689640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4101900 0x7fbcb419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcba689640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb4107900 0x7fbcb419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcba689640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb410edd0 con 0x7fbcb4101900 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcba689640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb410ec50 con 0x7fbcb4107900 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4101900 0x7fbcb419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4101900 0x7fbcb419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47670/0 (socket says 172.21.15.52:47670) 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.205+0000 7fbcb3fff640 1 -- 172.21.15.52:0/1179351715 learned_addr learned my addr 172.21.15.52:0/1179351715 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb37fe640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb4107900 0x7fbcb419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb3fff640 1 -- 172.21.15.52:0/1179351715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb4107900 msgr2=0x7fbcb419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb3fff640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb4107900 0x7fbcb419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb3fff640 1 -- 172.21.15.52:0/1179351715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb4197780 con 0x7fbcb4101900 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb3fff640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4101900 0x7fbcb419d600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbca4031460 tx=0x7fbca40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb17fa640 1 -- 172.21.15.52:0/1179351715 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbca403f070 con 0x7fbcb4101900 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb17fa640 1 -- 172.21.15.52:0/1179351715 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbca40035f0 con 0x7fbcb4101900 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb4197a10 con 0x7fbcb4101900 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcb17fa640 1 -- 172.21.15.52:0/1179351715 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbca4035030 con 0x7fbcb4101900 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.206+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb4197f40 con 0x7fbcb4101900 2024-09-06T14:55:41.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.207+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb4103040 con 0x7fbcb4101900 2024-09-06T14:55:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.208+0000 7fbcb17fa640 1 -- 172.21.15.52:0/1179351715 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbca4042070 con 0x7fbcb4101900 2024-09-06T14:55:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.208+0000 7fbcb17fa640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbc9c077460 0x7fbc9c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.209+0000 7fbcb17fa640 1 -- 172.21.15.52:0/1179351715 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fbca40ba0c0 con 0x7fbcb4101900 2024-09-06T14:55:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.209+0000 7fbcb37fe640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbc9c077460 0x7fbc9c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.209+0000 7fbcb37fe640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbc9c077460 0x7fbc9c079920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40ffc20 tx=0x7fbca800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:41.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.213+0000 7fbcb17fa640 1 -- 172.21.15.52:0/1179351715 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbca4087190 con 0x7fbcb4101900 2024-09-06T14:55:41.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.398+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbcb4109e70 con 0x7fbcb4101900 2024-09-06T14:55:41.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.398+0000 7fbcb17fa640 1 -- 172.21.15.52:0/1179351715 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7fbca408bbb0 con 0x7fbcb4101900 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:55:41.397 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:55:41.398 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:55:41.399 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:41.400 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:41.400 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:55:41.400 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:55:41.400 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:41.400 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:41.400 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:41.400 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.400+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbc9c077460 msgr2=0x7fbc9c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.400+0000 7fbcba689640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbc9c077460 0x7fbc9c079920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40ffc20 tx=0x7fbca800b390 comp rx=0 tx=0).stop 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4101900 msgr2=0x7fbcb419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4101900 0x7fbcb419d600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbca4031460 tx=0x7fbca40045e0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 shutdown_connections 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbc9c077460 0x7fbc9c079920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb4107900 0x7fbcb419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 --2- 172.21.15.52:0/1179351715 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb4101900 0x7fbcb419d600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 >> 172.21.15.52:0/1179351715 conn(0x7fbcb40fd600 msgr2=0x7fbcb40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:41.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 shutdown_connections 2024-09-06T14:55:41.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.401+0000 7fbcba689640 1 -- 172.21.15.52:0/1179351715 wait complete. 2024-09-06T14:55:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 -- 172.21.15.52:0/1454810326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08102b20 msgr2=0x7f7a08102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 --2- 172.21.15.52:0/1454810326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08102b20 0x7f7a08102f00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009c50 tx=0x7f79f802aa30 comp rx=0 tx=0).stop 2024-09-06T14:55:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 -- 172.21.15.52:0/1454810326 shutdown_connections 2024-09-06T14:55:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 --2- 172.21.15.52:0/1454810326 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a08103440 0x7f7a0810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 --2- 172.21.15.52:0/1454810326 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08102b20 0x7f7a08102f00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 -- 172.21.15.52:0/1454810326 >> 172.21.15.52:0/1454810326 conn(0x7f7a080fc520 msgr2=0x7f7a080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:41.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 -- 172.21.15.52:0/1454810326 shutdown_connections 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.487+0000 7f7a0d636640 1 -- 172.21.15.52:0/1454810326 wait complete. 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a0d636640 1 Processor -- start 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a0d636640 1 -- start start 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a0d636640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a08102b20 0x7f7a0819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a0d636640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08103440 0x7f7a0819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a0d636640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0810edd0 con 0x7f7a08103440 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a0d636640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0810ec50 con 0x7f7a08102b20 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a067fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08103440 0x7f7a0819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a067fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08103440 0x7f7a0819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47686/0 (socket says 172.21.15.52:47686) 2024-09-06T14:55:41.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.488+0000 7f7a067fc640 1 -- 172.21.15.52:0/3861675502 learned_addr learned my addr 172.21.15.52:0/3861675502 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f7a06ffd640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a08102b20 0x7f7a0819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f7a067fc640 1 -- 172.21.15.52:0/3861675502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a08102b20 msgr2=0x7f7a0819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f7a067fc640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a08102b20 0x7f7a0819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f7a067fc640 1 -- 172.21.15.52:0/3861675502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a08197800 con 0x7f7a08103440 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f7a067fc640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08103440 0x7f7a0819dbc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79f000d8d0 tx=0x7f79f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f79fffff640 1 -- 172.21.15.52:0/3861675502 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f0017030 con 0x7f7a08103440 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f79fffff640 1 -- 172.21.15.52:0/3861675502 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79f0004020 con 0x7f7a08103440 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a08197af0 con 0x7f7a08103440 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f79fffff640 1 -- 172.21.15.52:0/3861675502 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79f00047a0 con 0x7f7a08103440 2024-09-06T14:55:41.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.489+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a08198080 con 0x7f7a08103440 2024-09-06T14:55:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.490+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0806aa30 con 0x7f7a08103440 2024-09-06T14:55:41.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.491+0000 7f79fffff640 1 -- 172.21.15.52:0/3861675502 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f79f00041d0 con 0x7f7a08103440 2024-09-06T14:55:41.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.491+0000 7f79fffff640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79f4077460 0x7f79f4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.491+0000 7f7a06ffd640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79f4077460 0x7f79f4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.491+0000 7f79fffff640 1 -- 172.21.15.52:0/3861675502 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f79f0018070 con 0x7f7a08103440 2024-09-06T14:55:41.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.492+0000 7f7a06ffd640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79f4077460 0x7f79f4079920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009430 tx=0x7f79f803a040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:41.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.495+0000 7f79fffff640 1 -- 172.21.15.52:0/3861675502 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f79f0062490 con 0x7f7a08103440 2024-09-06T14:55:41.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.671+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7a08198390 con 0x7f79f4077460 2024-09-06T14:55:41.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.672+0000 7f79fffff640 1 -- 172.21.15.52:0/3861675502 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7a08198390 con 0x7f79f4077460 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:55:41.670 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:55:41.671 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:55:41.671 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:55:41.671 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:55:41.671 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:55:41.671 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79f4077460 msgr2=0x7f79f4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79f4077460 0x7f79f4079920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009430 tx=0x7f79f803a040 comp rx=0 tx=0).stop 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08103440 msgr2=0x7f7a0819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08103440 0x7f7a0819dbc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79f000d8d0 tx=0x7f79f000dd90 comp rx=0 tx=0).stop 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 shutdown_connections 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a08103440 0x7f7a0819dbc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f79f4077460 0x7f79f4079920 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 --2- 172.21.15.52:0/3861675502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a08102b20 0x7f7a0819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 >> 172.21.15.52:0/3861675502 conn(0x7f7a080fc520 msgr2=0x7f7a08103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 shutdown_connections 2024-09-06T14:55:41.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.674+0000 7f7a0d636640 1 -- 172.21.15.52:0/3861675502 wait complete. 2024-09-06T14:55:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 -- 172.21.15.52:0/3462543104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708100800 msgr2=0x7f5708100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3462543104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708100800 0x7f5708100c60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009880 tx=0x7f56fc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 -- 172.21.15.52:0/3462543104 shutdown_connections 2024-09-06T14:55:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3462543104 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708100800 0x7f5708100c60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3462543104 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5708106800 0x7f5708106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 -- 172.21.15.52:0/3462543104 >> 172.21.15.52:0/3462543104 conn(0x7f57080fc520 msgr2=0x7f57080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:41.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 -- 172.21.15.52:0/3462543104 shutdown_connections 2024-09-06T14:55:41.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.757+0000 7f570e0b0640 1 -- 172.21.15.52:0/3462543104 wait complete. 2024-09-06T14:55:41.756 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:41 smithi052 ceph-mon[112917]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:41.756 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:41 smithi052 ceph-mon[112917]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:41.756 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:41 smithi052 ceph-mon[112917]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:41.756 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:41 smithi052 ceph-mon[112917]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:41.757 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:41 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/848381299' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:55:41.757 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:41 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1179351715' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:55:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f570e0b0640 1 Processor -- start 2024-09-06T14:55:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f570e0b0640 1 -- start start 2024-09-06T14:55:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f570e0b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5708100800 0x7f570819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f570e0b0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708106800 0x7f570819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f570e0b0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f570810dcb0 con 0x7f5708106800 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f570e0b0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f570810db30 con 0x7f5708100800 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f5706ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708106800 0x7f570819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f5706ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708106800 0x7f570819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47716/0 (socket says 172.21.15.52:47716) 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.758+0000 7f5706ffd640 1 -- 172.21.15.52:0/3007447560 learned_addr learned my addr 172.21.15.52:0/3007447560 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f57077fe640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5708100800 0x7f570819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f5706ffd640 1 -- 172.21.15.52:0/3007447560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5708100800 msgr2=0x7f570819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f5706ffd640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5708100800 0x7f570819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f5706ffd640 1 -- 172.21.15.52:0/3007447560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57081977f0 con 0x7f5708106800 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f5706ffd640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708106800 0x7f570819dbb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f56fc031460 tx=0x7f56fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f5704ff9640 1 -- 172.21.15.52:0/3007447560 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56fc03f070 con 0x7f5708106800 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f5704ff9640 1 -- 172.21.15.52:0/3007447560 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f56fc004cf0 con 0x7f5708106800 2024-09-06T14:55:41.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5708197a80 con 0x7f5708106800 2024-09-06T14:55:41.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f5704ff9640 1 -- 172.21.15.52:0/3007447560 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f56fc035030 con 0x7f5708106800 2024-09-06T14:55:41.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.759+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5708197fb0 con 0x7f5708106800 2024-09-06T14:55:41.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.760+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5708101f40 con 0x7f5708106800 2024-09-06T14:55:41.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.761+0000 7f5704ff9640 1 -- 172.21.15.52:0/3007447560 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f56fc042070 con 0x7f5708106800 2024-09-06T14:55:41.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.762+0000 7f5704ff9640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f56f0077460 0x7f56f0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:55:41.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.762+0000 7f5704ff9640 1 -- 172.21.15.52:0/3007447560 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f56fc0ba230 con 0x7f5708106800 2024-09-06T14:55:41.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.762+0000 7f57077fe640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f56f0077460 0x7f56f0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:55:41.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.762+0000 7f57077fe640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f56f0077460 0x7f56f0079920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f56f8007350 tx=0x7f56f80072e0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:55:41.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.766+0000 7f5704ff9640 1 -- 172.21.15.52:0/3007447560 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f56fc083190 con 0x7f5708106800 2024-09-06T14:55:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:41 smithi165 ceph-mon[82925]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:41 smithi165 ceph-mon[82925]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:41.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:41 smithi165 ceph-mon[82925]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:41.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:41 smithi165 ceph-mon[82925]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:41.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:41 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/848381299' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:55:41.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:41 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1179351715' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:55:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.987+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5708198d20 con 0x7f5708106800 2024-09-06T14:55:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.988+0000 7f5704ff9640 1 -- 172.21.15.52:0/3007447560 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f56fc087300 con 0x7f5708106800 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:55:41.986 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:55:41.987 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:55:41.987 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:55:41.987 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:55:41.987 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:55:41.987 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:55:41.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f56f0077460 msgr2=0x7f56f0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f56f0077460 0x7f56f0079920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f56f8007350 tx=0x7f56f80072e0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708106800 msgr2=0x7f570819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708106800 0x7f570819dbb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f56fc031460 tx=0x7f56fc0048f0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 shutdown_connections 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5708106800 0x7f570819dbb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f56f0077460 0x7f56f0079920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 --2- 172.21.15.52:0/3007447560 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5708100800 0x7f570819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 >> 172.21.15.52:0/3007447560 conn(0x7f57080fc520 msgr2=0x7f570806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 shutdown_connections 2024-09-06T14:55:41.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:55:41.990+0000 7f570e0b0640 1 -- 172.21.15.52:0/3007447560 wait complete. 2024-09-06T14:55:42.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:42 smithi165 ceph-mon[82925]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:42.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:42 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3007447560' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:55:42.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:42 smithi052 ceph-mon[112917]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:55:42.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:42 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3007447560' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:55:43.623 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:43 smithi052 ceph-mon[112917]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:43.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:43 smithi165 ceph-mon[82925]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:45.573 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:45 smithi165 ceph-mon[82925]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:45.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:45 smithi052 ceph-mon[112917]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:47.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:47 smithi165 ceph-mon[82925]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:47.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:47 smithi052 ceph-mon[112917]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:49.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:49 smithi165 ceph-mon[82925]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:49.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:49 smithi052 ceph-mon[112917]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:51.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:51 smithi165 ceph-mon[82925]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:51.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:51 smithi052 ceph-mon[112917]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:53 smithi165 ceph-mon[82925]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:53.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:53.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:53 smithi052 ceph-mon[112917]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:53.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:55:55.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:55 smithi165 ceph-mon[82925]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:55.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:55 smithi052 ceph-mon[112917]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:57.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:57 smithi165 ceph-mon[82925]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:57.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:57 smithi052 ceph-mon[112917]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:59.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:55:59 smithi165 ceph-mon[82925]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:55:59.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:55:59 smithi052 ceph-mon[112917]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:01 smithi165 ceph-mon[82925]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:01.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:01 smithi052 ceph-mon[112917]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:03.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:03 smithi165 ceph-mon[82925]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:03.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:03 smithi052 ceph-mon[112917]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:05.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:05 smithi165 ceph-mon[82925]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:05.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:05 smithi052 ceph-mon[112917]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:07.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:07 smithi165 ceph-mon[82925]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:07.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:07 smithi052 ceph-mon[112917]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:08.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:08.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:09.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:09 smithi165 ceph-mon[82925]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:09.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:09 smithi052 ceph-mon[112917]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:11.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:11 smithi165 ceph-mon[82925]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:11.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:11 smithi052 ceph-mon[112917]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 -- 172.21.15.52:0/2534188299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 msgr2=0x7fc8a4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/2534188299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a4106be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc894009880 tx=0x7fc89402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 -- 172.21.15.52:0/2534188299 shutdown_connections 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/2534188299 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8a4100800 0x7fc8a4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/2534188299 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a4106be0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 -- 172.21.15.52:0/2534188299 >> 172.21.15.52:0/2534188299 conn(0x7fc8a40fc520 msgr2=0x7fc8a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 -- 172.21.15.52:0/2534188299 shutdown_connections 2024-09-06T14:56:12.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.085+0000 7fc8a92d9640 1 -- 172.21.15.52:0/2534188299 wait complete. 2024-09-06T14:56:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.086+0000 7fc8a92d9640 1 Processor -- start 2024-09-06T14:56:12.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.086+0000 7fc8a92d9640 1 -- start start 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a92d9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8a4100800 0x7fc8a419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a92d9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a92d9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410dcd0 con 0x7fc8a4106800 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a92d9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a410db50 con 0x7fc8a4100800 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33728/0 (socket says 172.21.15.52:33728) 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a27fc640 1 -- 172.21.15.52:0/1267667525 learned_addr learned my addr 172.21.15.52:0/1267667525 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a2ffd640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8a4100800 0x7fc8a419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a27fc640 1 -- 172.21.15.52:0/1267667525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8a4100800 msgr2=0x7fc8a419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a27fc640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8a4100800 0x7fc8a419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a27fc640 1 -- 172.21.15.52:0/1267667525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a4197800 con 0x7fc8a4106800 2024-09-06T14:56:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc8a27fc640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a419dbc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c8f0 tx=0x7fc89800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.087+0000 7fc88bfff640 1 -- 172.21.15.52:0/1267667525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8980079b0 con 0x7fc8a4106800 2024-09-06T14:56:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.088+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a4197af0 con 0x7fc8a4106800 2024-09-06T14:56:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.088+0000 7fc88bfff640 1 -- 172.21.15.52:0/1267667525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8980054e0 con 0x7fc8a4106800 2024-09-06T14:56:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.088+0000 7fc88bfff640 1 -- 172.21.15.52:0/1267667525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc898004dd0 con 0x7fc8a4106800 2024-09-06T14:56:12.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.088+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a4198080 con 0x7fc8a4106800 2024-09-06T14:56:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.089+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a4101f40 con 0x7fc8a4106800 2024-09-06T14:56:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.089+0000 7fc88bfff640 1 -- 172.21.15.52:0/1267667525 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc898005020 con 0x7fc8a4106800 2024-09-06T14:56:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.090+0000 7fc88bfff640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc88c077460 0x7fc88c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.090+0000 7fc88bfff640 1 -- 172.21.15.52:0/1267667525 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc8980995e0 con 0x7fc8a4106800 2024-09-06T14:56:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.090+0000 7fc8a2ffd640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc88c077460 0x7fc88c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.090+0000 7fc8a2ffd640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc88c077460 0x7fc88c079920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc894000c00 tx=0x7fc894031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.094+0000 7fc88bfff640 1 -- 172.21.15.52:0/1267667525 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc898014030 con 0x7fc8a4106800 2024-09-06T14:56:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.273+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc8a4198390 con 0x7fc88c077460 2024-09-06T14:56:12.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.274+0000 7fc88bfff640 1 -- 172.21.15.52:0/1267667525 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc8a4198390 con 0x7fc88c077460 2024-09-06T14:56:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc88c077460 msgr2=0x7fc88c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc88c077460 0x7fc88c079920 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc894000c00 tx=0x7fc894031400 comp rx=0 tx=0).stop 2024-09-06T14:56:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 msgr2=0x7fc8a419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a419dbc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc89800c8f0 tx=0x7fc89800cdb0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 shutdown_connections 2024-09-06T14:56:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc8a4106800 0x7fc8a419dbc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc88c077460 0x7fc88c079920 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 --2- 172.21.15.52:0/1267667525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc8a4100800 0x7fc8a419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 >> 172.21.15.52:0/1267667525 conn(0x7fc8a40fc520 msgr2=0x7fc8a406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 shutdown_connections 2024-09-06T14:56:12.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.276+0000 7fc8a92d9640 1 -- 172.21.15.52:0/1267667525 wait complete. 2024-09-06T14:56:12.284 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:56:12.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 -- 172.21.15.52:0/3066014160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324102b20 msgr2=0x7f2324102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 --2- 172.21.15.52:0/3066014160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324102b20 0x7f2324102f00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f23140098b0 tx=0x7f231402a560 comp rx=0 tx=0).stop 2024-09-06T14:56:12.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 -- 172.21.15.52:0/3066014160 shutdown_connections 2024-09-06T14:56:12.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 --2- 172.21.15.52:0/3066014160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2324103440 0x7f232410b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 --2- 172.21.15.52:0/3066014160 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324102b20 0x7f2324102f00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 -- 172.21.15.52:0/3066014160 >> 172.21.15.52:0/3066014160 conn(0x7f23240fc520 msgr2=0x7f23240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:12.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 -- 172.21.15.52:0/3066014160 shutdown_connections 2024-09-06T14:56:12.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.361+0000 7f2329b00640 1 -- 172.21.15.52:0/3066014160 wait complete. 2024-09-06T14:56:12.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f2329b00640 1 Processor -- start 2024-09-06T14:56:12.362 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f2329b00640 1 -- start start 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f2329b00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2324102b20 0x7f2324100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f2329b00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324103440 0x7f2324100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f2329b00640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f232410ee50 con 0x7f2324103440 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f2329b00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f232410ecd0 con 0x7f2324102b20 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f231bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324103440 0x7f2324100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f231bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324103440 0x7f2324100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33748/0 (socket says 172.21.15.52:33748) 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.362+0000 7f231bfff640 1 -- 172.21.15.52:0/3624312936 learned_addr learned my addr 172.21.15.52:0/3624312936 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f23237fe640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2324102b20 0x7f2324100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f231bfff640 1 -- 172.21.15.52:0/3624312936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2324102b20 msgr2=0x7f2324100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f231bfff640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2324102b20 0x7f2324100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f231bfff640 1 -- 172.21.15.52:0/3624312936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2324101200 con 0x7f2324103440 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f231bfff640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324103440 0x7f2324100cc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f230c00b420 tx=0x7f230c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f23217fa640 1 -- 172.21.15.52:0/3624312936 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f230c011630 con 0x7f2324103440 2024-09-06T14:56:12.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23241014f0 con 0x7f2324103440 2024-09-06T14:56:12.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f23217fa640 1 -- 172.21.15.52:0/3624312936 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f230c016070 con 0x7f2324103440 2024-09-06T14:56:12.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f23217fa640 1 -- 172.21.15.52:0/3624312936 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f230c010d40 con 0x7f2324103440 2024-09-06T14:56:12.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.363+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23241a3ee0 con 0x7f2324103440 2024-09-06T14:56:12.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.364+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232406aa30 con 0x7f2324103440 2024-09-06T14:56:12.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.365+0000 7f23217fa640 1 -- 172.21.15.52:0/3624312936 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f230c01b460 con 0x7f2324103440 2024-09-06T14:56:12.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.365+0000 7f23217fa640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f23100774b0 0x7f2310079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.366+0000 7f23217fa640 1 -- 172.21.15.52:0/3624312936 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f230c098ec0 con 0x7f2324103440 2024-09-06T14:56:12.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.366+0000 7f23237fe640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f23100774b0 0x7f2310079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.366+0000 7f23237fe640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f23100774b0 0x7f2310079970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2314000c00 tx=0x7f2314031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.370+0000 7f23217fa640 1 -- 172.21.15.52:0/3624312936 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f230c021250 con 0x7f2324103440 2024-09-06T14:56:12.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.548+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2324062630 con 0x7f23100774b0 2024-09-06T14:56:12.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.549+0000 7f23217fa640 1 -- 172.21.15.52:0/3624312936 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2324062630 con 0x7f23100774b0 2024-09-06T14:56:12.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f23100774b0 msgr2=0x7f2310079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f23100774b0 0x7f2310079970 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2314000c00 tx=0x7f2314031400 comp rx=0 tx=0).stop 2024-09-06T14:56:12.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324103440 msgr2=0x7f2324100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324103440 0x7f2324100cc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f230c00b420 tx=0x7f230c00b8e0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 shutdown_connections 2024-09-06T14:56:12.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2324103440 0x7f2324100cc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f23100774b0 0x7f2310079970 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 --2- 172.21.15.52:0/3624312936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2324102b20 0x7f2324100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 >> 172.21.15.52:0/3624312936 conn(0x7f23240fc520 msgr2=0x7f2324108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:12.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 shutdown_connections 2024-09-06T14:56:12.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.551+0000 7f2329b00640 1 -- 172.21.15.52:0/3624312936 wait complete. 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 -- 172.21.15.52:0/2687282623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 msgr2=0x7f1e74100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/2687282623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e74100c60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009880 tx=0x7f1e6802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 -- 172.21.15.52:0/2687282623 shutdown_connections 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/2687282623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e74100c60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/2687282623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e74106800 0x7f1e74106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 -- 172.21.15.52:0/2687282623 >> 172.21.15.52:0/2687282623 conn(0x7f1e740fc520 msgr2=0x7f1e740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 -- 172.21.15.52:0/2687282623 shutdown_connections 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.635+0000 7f1e7a83b640 1 -- 172.21.15.52:0/2687282623 wait complete. 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.636+0000 7f1e7a83b640 1 Processor -- start 2024-09-06T14:56:12.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.636+0000 7f1e7a83b640 1 -- start start 2024-09-06T14:56:12.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.636+0000 7f1e7a83b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e740fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.636+0000 7f1e7a83b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e74106800 0x7f1e740fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.636+0000 7f1e7a83b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7410dcd0 con 0x7f1e74100800 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.636+0000 7f1e7a83b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7410db50 con 0x7f1e74106800 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e740fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e740fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33762/0 (socket says 172.21.15.52:33762) 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e73fff640 1 -- 172.21.15.52:0/1818809506 learned_addr learned my addr 172.21.15.52:0/1818809506 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e737fe640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e74106800 0x7f1e740fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e73fff640 1 -- 172.21.15.52:0/1818809506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e74106800 msgr2=0x7f1e740fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e73fff640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e74106800 0x7f1e740fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e73fff640 1 -- 172.21.15.52:0/1818809506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e740fd670 con 0x7f1e74100800 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e73fff640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e740fcbf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400c8f0 tx=0x7f1e6400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e717fa640 1 -- 172.21.15.52:0/1818809506 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e640079b0 con 0x7f1e74100800 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e717fa640 1 -- 172.21.15.52:0/1818809506 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e640054e0 con 0x7f1e74100800 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e740fd960 con 0x7f1e74100800 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e717fa640 1 -- 172.21.15.52:0/1818809506 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e64004dd0 con 0x7f1e74100800 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.637+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e741a3e70 con 0x7f1e74100800 2024-09-06T14:56:12.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.638+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e74101f40 con 0x7f1e74100800 2024-09-06T14:56:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.639+0000 7f1e717fa640 1 -- 172.21.15.52:0/1818809506 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1e64005020 con 0x7f1e74100800 2024-09-06T14:56:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.639+0000 7f1e717fa640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e5c0773f0 0x7f1e5c0798b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.640+0000 7f1e717fa640 1 -- 172.21.15.52:0/1818809506 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1e640997a0 con 0x7f1e74100800 2024-09-06T14:56:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.640+0000 7f1e737fe640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e5c0773f0 0x7f1e5c0798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.640+0000 7f1e737fe640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e5c0773f0 0x7f1e5c0798b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e740fe680 tx=0x7f1e68031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.644+0000 7f1e717fa640 1 -- 172.21.15.52:0/1818809506 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1e64014030 con 0x7f1e74100800 2024-09-06T14:56:12.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.812+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1e74062630 con 0x7f1e5c0773f0 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.822+0000 7f1e717fa640 1 -- 172.21.15.52:0/1818809506 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1e74062630 con 0x7f1e5c0773f0 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (8m) 2m ago 19m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (11m) 2m ago 19m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (10m) 2m ago 18m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (6m) 2m ago 19m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (6m) 2m ago 18m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:56:12.821 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (8m) 2m ago 19m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (3m) 2m ago 14m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (3m) 2m ago 14m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (2m) 2m ago 14m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (2m) 2m ago 14m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (10m) 2m ago 20m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (9m) 2m ago 18m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (7m) 2m ago 20m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (7m) 2m ago 18m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (9m) 2m ago 19m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (9m) 2m ago 18m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (6m) 2m ago 17m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (5m) 2m ago 17m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (5m) 2m ago 16m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:56:12.822 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (4m) 2m ago 16m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:56:12.823 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (4m) 2m ago 15m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:56:12.823 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (3m) 2m ago 15m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:56:12.823 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (8m) 2m ago 19m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:56:12.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e5c0773f0 msgr2=0x7f1e5c0798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e5c0773f0 0x7f1e5c0798b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e740fe680 tx=0x7f1e68031400 comp rx=0 tx=0).stop 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 msgr2=0x7f1e740fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e740fcbf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400c8f0 tx=0x7f1e6400cdb0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 shutdown_connections 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1e5c0773f0 0x7f1e5c0798b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e74106800 0x7f1e740fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 --2- 172.21.15.52:0/1818809506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1e74100800 0x7f1e740fcbf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 >> 172.21.15.52:0/1818809506 conn(0x7f1e740fc520 msgr2=0x7f1e7406a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 shutdown_connections 2024-09-06T14:56:12.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.824+0000 7f1e7a83b640 1 -- 172.21.15.52:0/1818809506 wait complete. 2024-09-06T14:56:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.906+0000 7f69f9563640 1 -- 172.21.15.52:0/1217226893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 msgr2=0x7f69f4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.906+0000 7f69f9563640 1 --2- 172.21.15.52:0/1217226893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f4102e90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009c20 tx=0x7f69e402aa00 comp rx=0 tx=0).stop 2024-09-06T14:56:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.906+0000 7f69f9563640 1 -- 172.21.15.52:0/1217226893 shutdown_connections 2024-09-06T14:56:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.906+0000 7f69f9563640 1 --2- 172.21.15.52:0/1217226893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69f41033d0 0x7f69f410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.906+0000 7f69f9563640 1 --2- 172.21.15.52:0/1217226893 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f4102e90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.906+0000 7f69f9563640 1 -- 172.21.15.52:0/1217226893 >> 172.21.15.52:0/1217226893 conn(0x7f69f40fc550 msgr2=0x7f69f40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.907+0000 7f69f9563640 1 -- 172.21.15.52:0/1217226893 shutdown_connections 2024-09-06T14:56:12.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.907+0000 7f69f9563640 1 -- 172.21.15.52:0/1217226893 wait complete. 2024-09-06T14:56:12.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.907+0000 7f69f9563640 1 Processor -- start 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f9563640 1 -- start start 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f9563640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f9563640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69f41033d0 0x7f69f419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f9563640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f69f410ee40 con 0x7f69f4102ab0 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f9563640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f69f410ecc0 con 0x7f69f41033d0 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33772/0 (socket says 172.21.15.52:33772) 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f2ffd640 1 -- 172.21.15.52:0/2487889003 learned_addr learned my addr 172.21.15.52:0/2487889003 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f2ffd640 1 -- 172.21.15.52:0/2487889003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69f41033d0 msgr2=0x7f69f419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:12.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f27fc640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69f41033d0 0x7f69f419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f2ffd640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69f41033d0 0x7f69f419dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f2ffd640 1 -- 172.21.15.52:0/2487889003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f4197870 con 0x7f69f4102ab0 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.908+0000 7f69f27fc640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69f41033d0 0x7f69f419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.909+0000 7f69f2ffd640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f419d6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005cc0 tx=0x7f69e402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.909+0000 7f69ebfff640 1 -- 172.21.15.52:0/2487889003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69e4047070 con 0x7f69f4102ab0 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.909+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f4197b00 con 0x7f69f4102ab0 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.909+0000 7f69ebfff640 1 -- 172.21.15.52:0/2487889003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69e4003e30 con 0x7f69f4102ab0 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.909+0000 7f69ebfff640 1 -- 172.21.15.52:0/2487889003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69e4033050 con 0x7f69f4102ab0 2024-09-06T14:56:12.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.909+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f4198030 con 0x7f69f4102ab0 2024-09-06T14:56:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.910+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f406a580 con 0x7f69f4102ab0 2024-09-06T14:56:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.911+0000 7f69ebfff640 1 -- 172.21.15.52:0/2487889003 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f69e404a070 con 0x7f69f4102ab0 2024-09-06T14:56:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.911+0000 7f69ebfff640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f69e00774b0 0x7f69e0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.911+0000 7f69ebfff640 1 -- 172.21.15.52:0/2487889003 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f69e403e030 con 0x7f69f4102ab0 2024-09-06T14:56:12.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.911+0000 7f69f27fc640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f69e00774b0 0x7f69e0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:12.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.912+0000 7f69f27fc640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f69e00774b0 0x7f69e0079970 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69dc006fd0 tx=0x7f69dc008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:12.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:12.916+0000 7f69ebfff640 1 -- 172.21.15.52:0/2487889003 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f69e40838d0 con 0x7f69f4102ab0 2024-09-06T14:56:13.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.139+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f69f4198da0 con 0x7f69f4102ab0 2024-09-06T14:56:13.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.140+0000 7f69ebfff640 1 -- 172.21.15.52:0/2487889003 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f69e4087a40 con 0x7f69f4102ab0 2024-09-06T14:56:13.139 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:56:13.139 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:56:13.139 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:56:13.139 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:56:13.140 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:56:13.141 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:56:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f69e00774b0 msgr2=0x7f69e0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f69e00774b0 0x7f69e0079970 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f69dc006fd0 tx=0x7f69dc008040 comp rx=0 tx=0).stop 2024-09-06T14:56:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 msgr2=0x7f69f419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f419d6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005cc0 tx=0x7f69e402ee60 comp rx=0 tx=0).stop 2024-09-06T14:56:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 shutdown_connections 2024-09-06T14:56:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f69e00774b0 0x7f69e0079970 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f69f41033d0 0x7f69f419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 --2- 172.21.15.52:0/2487889003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69f4102ab0 0x7f69f419d6b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 >> 172.21.15.52:0/2487889003 conn(0x7f69f40fc550 msgr2=0x7f69f4108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 shutdown_connections 2024-09-06T14:56:13.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.142+0000 7f69f9563640 1 -- 172.21.15.52:0/2487889003 wait complete. 2024-09-06T14:56:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 -- 172.21.15.52:0/1274871245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4102ab0 msgr2=0x7f91c4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 --2- 172.21.15.52:0/1274871245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4102ab0 0x7f91c4102e90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009880 tx=0x7f91b402a530 comp rx=0 tx=0).stop 2024-09-06T14:56:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 -- 172.21.15.52:0/1274871245 shutdown_connections 2024-09-06T14:56:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 --2- 172.21.15.52:0/1274871245 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c41033d0 0x7f91c410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 --2- 172.21.15.52:0/1274871245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c4102ab0 0x7f91c4102e90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 -- 172.21.15.52:0/1274871245 >> 172.21.15.52:0/1274871245 conn(0x7f91c40fc550 msgr2=0x7f91c40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 -- 172.21.15.52:0/1274871245 shutdown_connections 2024-09-06T14:56:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.226+0000 7f91ca654640 1 -- 172.21.15.52:0/1274871245 wait complete. 2024-09-06T14:56:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91ca654640 1 Processor -- start 2024-09-06T14:56:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91ca654640 1 -- start start 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91ca654640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c4102ab0 0x7f91c4100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91ca654640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c41033d0 0x7f91c4100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91ca654640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91c410edc0 con 0x7f91c41033d0 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91ca654640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f91c410ec40 con 0x7f91c4102ab0 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c41033d0 0x7f91c4100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91c37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c41033d0 0x7f91c4100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33792/0 (socket says 172.21.15.52:33792) 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91c37fe640 1 -- 172.21.15.52:0/2843692485 learned_addr learned my addr 172.21.15.52:0/2843692485 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91c3fff640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c4102ab0 0x7f91c4100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91c37fe640 1 -- 172.21.15.52:0/2843692485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c4102ab0 msgr2=0x7f91c4100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.227+0000 7f91c37fe640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c4102ab0 0x7f91c4100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.228+0000 7f91c37fe640 1 -- 172.21.15.52:0/2843692485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c4101190 con 0x7f91c41033d0 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.228+0000 7f91c37fe640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c41033d0 0x7f91c4100c50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c8f0 tx=0x7f91b800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.228+0000 7f91c17fa640 1 -- 172.21.15.52:0/2843692485 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91b80079b0 con 0x7f91c41033d0 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.228+0000 7f91c17fa640 1 -- 172.21.15.52:0/2843692485 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91b8007b50 con 0x7f91c41033d0 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.228+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c4101480 con 0x7f91c41033d0 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.228+0000 7f91c17fa640 1 -- 172.21.15.52:0/2843692485 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91b8018610 con 0x7f91c41033d0 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.228+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c41a3dd0 con 0x7f91c41033d0 2024-09-06T14:56:13.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.229+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c406a580 con 0x7f91c41033d0 2024-09-06T14:56:13.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.230+0000 7f91c17fa640 1 -- 172.21.15.52:0/2843692485 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f91b8007d00 con 0x7f91c41033d0 2024-09-06T14:56:13.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.230+0000 7f91c17fa640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91ac077460 0x7f91ac079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.230+0000 7f91c17fa640 1 -- 172.21.15.52:0/2843692485 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f91b8099920 con 0x7f91c41033d0 2024-09-06T14:56:13.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.230+0000 7f91c3fff640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91ac077460 0x7f91ac079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.231+0000 7f91c3fff640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91ac077460 0x7f91ac079920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f91b4000c00 tx=0x7f91b4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:13.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.234+0000 7f91c17fa640 1 -- 172.21.15.52:0/2843692485 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f91b8014030 con 0x7f91c41033d0 2024-09-06T14:56:13.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.419+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f91c4105f80 con 0x7f91c41033d0 2024-09-06T14:56:13.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.420+0000 7f91c17fa640 1 -- 172.21.15.52:0/2843692485 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f91b8062880 con 0x7f91c41033d0 2024-09-06T14:56:13.419 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:56:13.419 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:56:13.419 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:56:13.419 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:56:13.419 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:56:13.420 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:56:13.421 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:13.422 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:13.423 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:13.423 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:13.423 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:13.423 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91ac077460 msgr2=0x7f91ac079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91ac077460 0x7f91ac079920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f91b4000c00 tx=0x7f91b4031400 comp rx=0 tx=0).stop 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c41033d0 msgr2=0x7f91c4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c41033d0 0x7f91c4100c50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c8f0 tx=0x7f91b800cdb0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 shutdown_connections 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c41033d0 0x7f91c4100c50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91ac077460 0x7f91ac079920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 --2- 172.21.15.52:0/2843692485 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c4102ab0 0x7f91c4100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 >> 172.21.15.52:0/2843692485 conn(0x7f91c40fc550 msgr2=0x7f91c4108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 shutdown_connections 2024-09-06T14:56:13.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.422+0000 7f91ca654640 1 -- 172.21.15.52:0/2843692485 wait complete. 2024-09-06T14:56:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 -- 172.21.15.52:0/1101625718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8100800 msgr2=0x7f9ae8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 --2- 172.21.15.52:0/1101625718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8100800 0x7f9ae8100c60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009880 tx=0x7f9adc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 -- 172.21.15.52:0/1101625718 shutdown_connections 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 --2- 172.21.15.52:0/1101625718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8100800 0x7f9ae8100c60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 --2- 172.21.15.52:0/1101625718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae8106800 0x7f9ae8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 -- 172.21.15.52:0/1101625718 >> 172.21.15.52:0/1101625718 conn(0x7f9ae80fc520 msgr2=0x7f9ae80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 -- 172.21.15.52:0/1101625718 shutdown_connections 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.506+0000 7f9aec873640 1 -- 172.21.15.52:0/1101625718 wait complete. 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9aec873640 1 Processor -- start 2024-09-06T14:56:13.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9aec873640 1 -- start start 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9aec873640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae8100800 0x7f9ae819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9aec873640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8106800 0x7f9ae819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9aec873640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae810dcb0 con 0x7f9ae8106800 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9aec873640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae810db30 con 0x7f9ae8100800 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9ae5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8106800 0x7f9ae819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9ae659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae8100800 0x7f9ae819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9ae5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8106800 0x7f9ae819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33806/0 (socket says 172.21.15.52:33806) 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9ae5d9b640 1 -- 172.21.15.52:0/1246867175 learned_addr learned my addr 172.21.15.52:0/1246867175 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9ae5d9b640 1 -- 172.21.15.52:0/1246867175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae8100800 msgr2=0x7f9ae819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9ae5d9b640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae8100800 0x7f9ae819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.507+0000 7f9ae5d9b640 1 -- 172.21.15.52:0/1246867175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae81977a0 con 0x7f9ae8106800 2024-09-06T14:56:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.508+0000 7f9ae5d9b640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8106800 0x7f9ae819db60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9adc031460 tx=0x7f9adc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.508+0000 7f9ad77fe640 1 -- 172.21.15.52:0/1246867175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9adc03f070 con 0x7f9ae8106800 2024-09-06T14:56:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.508+0000 7f9ad77fe640 1 -- 172.21.15.52:0/1246867175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9adc0035f0 con 0x7f9ae8106800 2024-09-06T14:56:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.508+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae8197a30 con 0x7f9ae8106800 2024-09-06T14:56:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.508+0000 7f9ad77fe640 1 -- 172.21.15.52:0/1246867175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9adc035030 con 0x7f9ae8106800 2024-09-06T14:56:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.508+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae8197f60 con 0x7f9ae8106800 2024-09-06T14:56:13.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.509+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae8101f40 con 0x7f9ae8106800 2024-09-06T14:56:13.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.510+0000 7f9ad77fe640 1 -- 172.21.15.52:0/1246867175 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9adc042070 con 0x7f9ae8106800 2024-09-06T14:56:13.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.510+0000 7f9ad77fe640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9ad0077460 0x7f9ad0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.510+0000 7f9ad77fe640 1 -- 172.21.15.52:0/1246867175 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9adc0ba0e0 con 0x7f9ae8106800 2024-09-06T14:56:13.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.510+0000 7f9ae659c640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9ad0077460 0x7f9ad0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.511+0000 7f9ae659c640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9ad0077460 0x7f9ad0079920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800bbe0 tx=0x7f9ad800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:13.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.514+0000 7f9ad77fe640 1 -- 172.21.15.52:0/1246867175 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9adc0871b0 con 0x7f9ae8106800 2024-09-06T14:56:13.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.695+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9ae8198270 con 0x7f9ad0077460 2024-09-06T14:56:13.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.696+0000 7f9ad77fe640 1 -- 172.21.15.52:0/1246867175 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9ae8198270 con 0x7f9ad0077460 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:56:13.695 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:56:13.696 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:56:13.696 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:56:13.696 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9ad0077460 msgr2=0x7f9ad0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9ad0077460 0x7f9ad0079920 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800bbe0 tx=0x7f9ad800b390 comp rx=0 tx=0).stop 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8106800 msgr2=0x7f9ae819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8106800 0x7f9ae819db60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9adc031460 tx=0x7f9adc0045e0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 shutdown_connections 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ae8106800 0x7f9ae819db60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9ad0077460 0x7f9ad0079920 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 --2- 172.21.15.52:0/1246867175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ae8100800 0x7f9ae819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 >> 172.21.15.52:0/1246867175 conn(0x7f9ae80fc520 msgr2=0x7f9ae806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:13.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 shutdown_connections 2024-09-06T14:56:13.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.698+0000 7f9aec873640 1 -- 172.21.15.52:0/1246867175 wait complete. 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.781+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/335555344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41007f0 msgr2=0x7ffba4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.781+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/335555344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41007f0 0x7ffba4100c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009880 tx=0x7ffb9802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/335555344 shutdown_connections 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/335555344 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41007f0 0x7ffba4100c50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/335555344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffba41067f0 0x7ffba4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/335555344 >> 172.21.15.52:0/335555344 conn(0x7ffba40fc550 msgr2=0x7ffba40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/335555344 shutdown_connections 2024-09-06T14:56:13.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/335555344 wait complete. 2024-09-06T14:56:13.782 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:13 smithi052 ceph-mon[112917]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:13.782 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:13 smithi052 ceph-mon[112917]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:13.782 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:13 smithi052 ceph-mon[112917]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:13.782 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:13 smithi052 ceph-mon[112917]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:13.782 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:13 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2487889003' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:56:13.782 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:13 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2843692485' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 Processor -- start 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.782+0000 7ffbaa6ff640 1 -- start start 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffbaa6ff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffba41007f0 0x7ffba419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffbaa6ff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41067f0 0x7ffba419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffbaa6ff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410dca0 con 0x7ffba41067f0 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffbaa6ff640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffba410db20 con 0x7ffba41007f0 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffba37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41067f0 0x7ffba419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffba37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41067f0 0x7ffba419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33824/0 (socket says 172.21.15.52:33824) 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffba37fe640 1 -- 172.21.15.52:0/2804988525 learned_addr learned my addr 172.21.15.52:0/2804988525 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffba3fff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffba41007f0 0x7ffba419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffba37fe640 1 -- 172.21.15.52:0/2804988525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffba41007f0 msgr2=0x7ffba419c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffba37fe640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffba41007f0 0x7ffba419c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.783+0000 7ffba37fe640 1 -- 172.21.15.52:0/2804988525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba4196670 con 0x7ffba41067f0 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.784+0000 7ffba37fe640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41067f0 0x7ffba419cae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb98031460 tx=0x7ffb98004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.784+0000 7ffba17fa640 1 -- 172.21.15.52:0/2804988525 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb9803f070 con 0x7ffba41067f0 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.784+0000 7ffba17fa640 1 -- 172.21.15.52:0/2804988525 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb980035f0 con 0x7ffba41067f0 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.784+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba4196900 con 0x7ffba41067f0 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.784+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba4196e00 con 0x7ffba41067f0 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.784+0000 7ffba17fa640 1 -- 172.21.15.52:0/2804988525 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb98035030 con 0x7ffba41067f0 2024-09-06T14:56:13.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.785+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba4101f30 con 0x7ffba41067f0 2024-09-06T14:56:13.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.785+0000 7ffba17fa640 1 -- 172.21.15.52:0/2804988525 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ffb98042070 con 0x7ffba41067f0 2024-09-06T14:56:13.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.786+0000 7ffba17fa640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb8c077460 0x7ffb8c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:13.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.786+0000 7ffba17fa640 1 -- 172.21.15.52:0/2804988525 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ffb980ba1c0 con 0x7ffba41067f0 2024-09-06T14:56:13.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.786+0000 7ffba3fff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb8c077460 0x7ffb8c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:13.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.786+0000 7ffba3fff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb8c077460 0x7ffb8c079920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009b60 tx=0x7ffb94005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:13.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:13.790+0000 7ffba17fa640 1 -- 172.21.15.52:0/2804988525 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ffb98083120 con 0x7ffba41067f0 2024-09-06T14:56:13.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:13 smithi165 ceph-mon[82925]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:13.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:13 smithi165 ceph-mon[82925]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:13.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:13 smithi165 ceph-mon[82925]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:13.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:13 smithi165 ceph-mon[82925]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:13.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:13 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2487889003' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:56:13.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:13 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2843692485' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:56:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.014+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ffba41970b0 con 0x7ffba41067f0 2024-09-06T14:56:14.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.014+0000 7ffba17fa640 1 -- 172.21.15.52:0/2804988525 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7ffb98087290 con 0x7ffba41067f0 2024-09-06T14:56:14.013 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:56:14.013 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:56:14.014 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:56:14.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.016+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb8c077460 msgr2=0x7ffb8c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:14.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.016+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb8c077460 0x7ffb8c079920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb94009b60 tx=0x7ffb94005f90 comp rx=0 tx=0).stop 2024-09-06T14:56:14.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.016+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41067f0 msgr2=0x7ffba419cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:14.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.016+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41067f0 0x7ffba419cae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffb98031460 tx=0x7ffb98004530 comp rx=0 tx=0).stop 2024-09-06T14:56:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.017+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 shutdown_connections 2024-09-06T14:56:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.017+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffba41067f0 0x7ffba419cae0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.017+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffb8c077460 0x7ffb8c079920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.017+0000 7ffbaa6ff640 1 --2- 172.21.15.52:0/2804988525 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffba41007f0 0x7ffba419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.017+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 >> 172.21.15.52:0/2804988525 conn(0x7ffba40fc550 msgr2=0x7ffba40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.017+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 shutdown_connections 2024-09-06T14:56:14.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:14.017+0000 7ffbaa6ff640 1 -- 172.21.15.52:0/2804988525 wait complete. 2024-09-06T14:56:14.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:14 smithi165 ceph-mon[82925]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:14.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:14 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2804988525' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:56:14.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:14 smithi052 ceph-mon[112917]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:14.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:14 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2804988525' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:56:15.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:15 smithi165 ceph-mon[82925]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:15.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:15 smithi052 ceph-mon[112917]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:17.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:17 smithi165 ceph-mon[82925]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:17.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:17 smithi052 ceph-mon[112917]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:19.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:19 smithi165 ceph-mon[82925]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:19.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:19 smithi052 ceph-mon[112917]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:21.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:21 smithi165 ceph-mon[82925]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:21.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:21 smithi052 ceph-mon[112917]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:23.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:23 smithi165 ceph-mon[82925]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:23.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:23.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:23 smithi052 ceph-mon[112917]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:23.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:25.817 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:25 smithi052 ceph-mon[112917]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:25.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:25 smithi165 ceph-mon[82925]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:27.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:27 smithi165 ceph-mon[82925]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:27.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:27 smithi052 ceph-mon[112917]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:29.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:29 smithi165 ceph-mon[82925]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:29.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:29 smithi052 ceph-mon[112917]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:31.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:31 smithi165 ceph-mon[82925]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:31.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:31 smithi052 ceph-mon[112917]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:33.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:33 smithi165 ceph-mon[82925]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:33.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:33 smithi052 ceph-mon[112917]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:35.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:35 smithi165 ceph-mon[82925]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:35.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:35 smithi052 ceph-mon[112917]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:37.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:37 smithi165 ceph-mon[82925]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:37.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:37 smithi052 ceph-mon[112917]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:38.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:38.873 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:39.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:39 smithi165 ceph-mon[82925]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:39.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:39 smithi052 ceph-mon[112917]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:41.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:41 smithi165 ceph-mon[82925]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:41.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:41 smithi052 ceph-mon[112917]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:43.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:43 smithi165 ceph-mon[82925]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:43.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:43 smithi052 ceph-mon[112917]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 -- 172.21.15.52:0/3066198364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c0ffdc0 msgr2=0x7f9a6c100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/3066198364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c0ffdc0 0x7f9a6c100220 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009880 tx=0x7f9a6002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 -- 172.21.15.52:0/3066198364 shutdown_connections 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/3066198364 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c0ffdc0 0x7f9a6c100220 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/3066198364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a6c1069a0 0x7f9a6c106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 -- 172.21.15.52:0/3066198364 >> 172.21.15.52:0/3066198364 conn(0x7f9a6c0fbc90 msgr2=0x7f9a6c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 -- 172.21.15.52:0/3066198364 shutdown_connections 2024-09-06T14:56:44.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.115+0000 7f9a70fa8640 1 -- 172.21.15.52:0/3066198364 wait complete. 2024-09-06T14:56:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.116+0000 7f9a70fa8640 1 Processor -- start 2024-09-06T14:56:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.116+0000 7f9a70fa8640 1 -- start start 2024-09-06T14:56:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.116+0000 7f9a70fa8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a6c0ffdc0 0x7f9a6c19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.116+0000 7f9a70fa8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c1069a0 0x7f9a6c19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.116+0000 7f9a70fa8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c10ef20 con 0x7f9a6c1069a0 2024-09-06T14:56:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.116+0000 7f9a70fa8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6c10eda0 con 0x7f9a6c0ffdc0 2024-09-06T14:56:44.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a69d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c1069a0 0x7f9a6c19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a69d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c1069a0 0x7f9a6c19dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40232/0 (socket says 172.21.15.52:40232) 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a69d9b640 1 -- 172.21.15.52:0/317164325 learned_addr learned my addr 172.21.15.52:0/317164325 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a6a59c640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a6c0ffdc0 0x7f9a6c19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a69d9b640 1 -- 172.21.15.52:0/317164325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a6c0ffdc0 msgr2=0x7f9a6c19d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a69d9b640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a6c0ffdc0 0x7f9a6c19d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a69d9b640 1 -- 172.21.15.52:0/317164325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c1978f0 con 0x7f9a6c1069a0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a69d9b640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c1069a0 0x7f9a6c19dc70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a60031460 tx=0x7f9a600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a5b7fe640 1 -- 172.21.15.52:0/317164325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a6003f070 con 0x7f9a6c1069a0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6c197b80 con 0x7f9a6c1069a0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a5b7fe640 1 -- 172.21.15.52:0/317164325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a600035f0 con 0x7f9a6c1069a0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.117+0000 7f9a5b7fe640 1 -- 172.21.15.52:0/317164325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a60035030 con 0x7f9a6c1069a0 2024-09-06T14:56:44.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.118+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6c1980b0 con 0x7f9a6c1069a0 2024-09-06T14:56:44.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.119+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a6c1030e0 con 0x7f9a6c1069a0 2024-09-06T14:56:44.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.119+0000 7f9a5b7fe640 1 -- 172.21.15.52:0/317164325 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9a60042070 con 0x7f9a6c1069a0 2024-09-06T14:56:44.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.120+0000 7f9a5b7fe640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a540774b0 0x7f9a54079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.120+0000 7f9a5b7fe640 1 -- 172.21.15.52:0/317164325 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9a600ba0b0 con 0x7f9a6c1069a0 2024-09-06T14:56:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.120+0000 7f9a6a59c640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a540774b0 0x7f9a54079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.120+0000 7f9a6a59c640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a540774b0 0x7f9a54079970 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c198a30 tx=0x7f9a5c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.124+0000 7f9a5b7fe640 1 -- 172.21.15.52:0/317164325 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9a60087200 con 0x7f9a6c1069a0 2024-09-06T14:56:44.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.303+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9a6c198e20 con 0x7f9a540774b0 2024-09-06T14:56:44.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.304+0000 7f9a5b7fe640 1 -- 172.21.15.52:0/317164325 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9a6c198e20 con 0x7f9a540774b0 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.306+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a540774b0 msgr2=0x7f9a54079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.306+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a540774b0 0x7f9a54079970 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c198a30 tx=0x7f9a5c00b390 comp rx=0 tx=0).stop 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.306+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c1069a0 msgr2=0x7f9a6c19dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.306+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c1069a0 0x7f9a6c19dc70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9a60031460 tx=0x7f9a600045e0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.307+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 shutdown_connections 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.307+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6c1069a0 0x7f9a6c19dc70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.307+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9a540774b0 0x7f9a54079970 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.307+0000 7f9a70fa8640 1 --2- 172.21.15.52:0/317164325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9a6c0ffdc0 0x7f9a6c19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.307+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 >> 172.21.15.52:0/317164325 conn(0x7f9a6c0fbc90 msgr2=0x7f9a6c0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.307+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 shutdown_connections 2024-09-06T14:56:44.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.307+0000 7f9a70fa8640 1 -- 172.21.15.52:0/317164325 wait complete. 2024-09-06T14:56:44.314 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 -- 172.21.15.52:0/1771906589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 msgr2=0x7fec1c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 --2- 172.21.15.52:0/1771906589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c101d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fec10009880 tx=0x7fec1002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 -- 172.21.15.52:0/1771906589 shutdown_connections 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 --2- 172.21.15.52:0/1771906589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c101d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 --2- 172.21.15.52:0/1771906589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec1c107900 0x7fec1c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 -- 172.21.15.52:0/1771906589 >> 172.21.15.52:0/1771906589 conn(0x7fec1c0fd600 msgr2=0x7fec1c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 -- 172.21.15.52:0/1771906589 shutdown_connections 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.391+0000 7fec21c8f640 1 -- 172.21.15.52:0/1771906589 wait complete. 2024-09-06T14:56:44.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec21c8f640 1 Processor -- start 2024-09-06T14:56:44.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec21c8f640 1 -- start start 2024-09-06T14:56:44.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec21c8f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec21c8f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec1c107900 0x7fec1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec21c8f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c10edd0 con 0x7fec1c101900 2024-09-06T14:56:44.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec21c8f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c10ec50 con 0x7fec1c107900 2024-09-06T14:56:44.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40244/0 (socket says 172.21.15.52:40244) 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.392+0000 7fec1b7fe640 1 -- 172.21.15.52:0/3322619750 learned_addr learned my addr 172.21.15.52:0/3322619750 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec1affd640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec1c107900 0x7fec1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec1b7fe640 1 -- 172.21.15.52:0/3322619750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec1c107900 msgr2=0x7fec1c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec1b7fe640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec1c107900 0x7fec1c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec1b7fe640 1 -- 172.21.15.52:0/3322619750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c074f70 con 0x7fec1c101900 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec1affd640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec1c107900 0x7fec1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec1b7fe640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c0744f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00d6f0 tx=0x7fec0c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec18ff9640 1 -- 172.21.15.52:0/3322619750 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec0c017070 con 0x7fec1c101900 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec18ff9640 1 -- 172.21.15.52:0/3322619750 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec0c00de00 con 0x7fec1c101900 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c075260 con 0x7fec1c101900 2024-09-06T14:56:44.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec18ff9640 1 -- 172.21.15.52:0/3322619750 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec0c004bb0 con 0x7fec1c101900 2024-09-06T14:56:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.393+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c1a3e20 con 0x7fec1c101900 2024-09-06T14:56:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.394+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1c103040 con 0x7fec1c101900 2024-09-06T14:56:44.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.395+0000 7fec18ff9640 1 -- 172.21.15.52:0/3322619750 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fec0c004e60 con 0x7fec1c101900 2024-09-06T14:56:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.395+0000 7fec18ff9640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec04077460 0x7fec04079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.395+0000 7fec18ff9640 1 -- 172.21.15.52:0/3322619750 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fec0c0994c0 con 0x7fec1c101900 2024-09-06T14:56:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.395+0000 7fec1affd640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec04077460 0x7fec04079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.396+0000 7fec1affd640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec04077460 0x7fec04079920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fec10006010 tx=0x7fec100095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.399+0000 7fec18ff9640 1 -- 172.21.15.52:0/3322619750 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fec0c062380 con 0x7fec1c101900 2024-09-06T14:56:44.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.576+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fec1c062630 con 0x7fec04077460 2024-09-06T14:56:44.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.577+0000 7fec18ff9640 1 -- 172.21.15.52:0/3322619750 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fec1c062630 con 0x7fec04077460 2024-09-06T14:56:44.577 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec04077460 msgr2=0x7fec04079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec04077460 0x7fec04079920 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fec10006010 tx=0x7fec100095f0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 msgr2=0x7fec1c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c0744f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec0c00d6f0 tx=0x7fec0c00dbb0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 shutdown_connections 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec04077460 0x7fec04079920 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec1c107900 0x7fec1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 --2- 172.21.15.52:0/3322619750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec1c101900 0x7fec1c0744f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.579+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 >> 172.21.15.52:0/3322619750 conn(0x7fec1c0fd600 msgr2=0x7fec1c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.580+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 shutdown_connections 2024-09-06T14:56:44.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.580+0000 7fec21c8f640 1 -- 172.21.15.52:0/3322619750 wait complete. 2024-09-06T14:56:44.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.662+0000 7fbdd8a23640 1 -- 172.21.15.52:0/2309028195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 msgr2=0x7fbdd4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.662+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/2309028195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd4107ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009c20 tx=0x7fbdc402a970 comp rx=0 tx=0).stop 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.663+0000 7fbdd8a23640 1 -- 172.21.15.52:0/2309028195 shutdown_connections 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.663+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/2309028195 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd4101900 0x7fbdd4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.663+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/2309028195 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd4107ce0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.663+0000 7fbdd8a23640 1 -- 172.21.15.52:0/2309028195 >> 172.21.15.52:0/2309028195 conn(0x7fbdd40fd600 msgr2=0x7fbdd40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.663+0000 7fbdd8a23640 1 -- 172.21.15.52:0/2309028195 shutdown_connections 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.663+0000 7fbdd8a23640 1 -- 172.21.15.52:0/2309028195 wait complete. 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd8a23640 1 Processor -- start 2024-09-06T14:56:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd8a23640 1 -- start start 2024-09-06T14:56:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd8a23640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd4101900 0x7fbdd419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd8a23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd419dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd8a23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd410ee30 con 0x7fbdd4107900 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd8a23640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd410ecb0 con 0x7fbdd4101900 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd419dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd419dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40252/0 (socket says 172.21.15.52:40252) 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd1d9b640 1 -- 172.21.15.52:0/4190070789 learned_addr learned my addr 172.21.15.52:0/4190070789 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd259c640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd4101900 0x7fbdd419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd1d9b640 1 -- 172.21.15.52:0/4190070789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd4101900 msgr2=0x7fbdd419d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd1d9b640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd4101900 0x7fbdd419d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.664+0000 7fbdd1d9b640 1 -- 172.21.15.52:0/4190070789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd4197940 con 0x7fbdd4107900 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.665+0000 7fbdd1d9b640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd419dcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800b420 tx=0x7fbdc800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.665+0000 7fbdc37fe640 1 -- 172.21.15.52:0/4190070789 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdc8011630 con 0x7fbdd4107900 2024-09-06T14:56:44.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.665+0000 7fbdc37fe640 1 -- 172.21.15.52:0/4190070789 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdc8016070 con 0x7fbdd4107900 2024-09-06T14:56:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.665+0000 7fbdc37fe640 1 -- 172.21.15.52:0/4190070789 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdc8010d40 con 0x7fbdd4107900 2024-09-06T14:56:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.665+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd4197c30 con 0x7fbdd4107900 2024-09-06T14:56:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.665+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd41981c0 con 0x7fbdd4107900 2024-09-06T14:56:44.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.666+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd4103040 con 0x7fbdd4107900 2024-09-06T14:56:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.667+0000 7fbdc37fe640 1 -- 172.21.15.52:0/4190070789 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbdc801b460 con 0x7fbdd4107900 2024-09-06T14:56:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.667+0000 7fbdc37fe640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdbc077460 0x7fbdbc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.667+0000 7fbdc37fe640 1 -- 172.21.15.52:0/4190070789 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fbdc8098f90 con 0x7fbdd4107900 2024-09-06T14:56:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.667+0000 7fbdd259c640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdbc077460 0x7fbdbc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.668+0000 7fbdd259c640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdbc077460 0x7fbdbc079920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009430 tx=0x7fbdc40093a0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.671+0000 7fbdc37fe640 1 -- 172.21.15.52:0/4190070789 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbdc8021250 con 0x7fbdd4107900 2024-09-06T14:56:44.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.842+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbdd4109ee0 con 0x7fbdbc077460 2024-09-06T14:56:44.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.852+0000 7fbdc37fe640 1 -- 172.21.15.52:0/4190070789 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbdc402fc30 con 0x7fbdbc077460 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (9m) 3m ago 20m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (11m) 3m ago 20m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (11m) 2m ago 19m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (7m) 3m ago 20m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (7m) 2m ago 19m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (8m) 3m ago 19m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (3m) 3m ago 14m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:56:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (3m) 3m ago 14m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (3m) 2m ago 14m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (3m) 2m ago 14m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (11m) 3m ago 21m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (10m) 2m ago 19m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (7m) 3m ago 21m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (7m) 2m ago 19m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (10m) 3m ago 20m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (9m) 2m ago 19m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (6m) 3m ago 18m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (6m) 3m ago 17m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:56:44.851 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (5m) 3m ago 17m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:56:44.852 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (5m) 2m ago 16m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:56:44.852 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (4m) 2m ago 16m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:56:44.852 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (4m) 2m ago 15m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:56:44.852 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (9m) 3m ago 19m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:56:44.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdbc077460 msgr2=0x7fbdbc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.852 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdbc077460 0x7fbdbc079920 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009430 tx=0x7fbdc40093a0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 msgr2=0x7fbdd419dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd419dcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800b420 tx=0x7fbdc800b8e0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 shutdown_connections 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbdd4107900 0x7fbdd419dcc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbdbc077460 0x7fbdbc079920 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 --2- 172.21.15.52:0/4190070789 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbdd4101900 0x7fbdd419d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.853+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 >> 172.21.15.52:0/4190070789 conn(0x7fbdd40fd600 msgr2=0x7fbdd40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.854+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 shutdown_connections 2024-09-06T14:56:44.853 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.854+0000 7fbdd8a23640 1 -- 172.21.15.52:0/4190070789 wait complete. 2024-09-06T14:56:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 -- 172.21.15.52:0/883139847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858102b70 msgr2=0x7f4858102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 --2- 172.21.15.52:0/883139847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858102b70 0x7f4858102f50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4848009c20 tx=0x7f484802aa00 comp rx=0 tx=0).stop 2024-09-06T14:56:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 -- 172.21.15.52:0/883139847 shutdown_connections 2024-09-06T14:56:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 --2- 172.21.15.52:0/883139847 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4858103490 0x7f485810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 --2- 172.21.15.52:0/883139847 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858102b70 0x7f4858102f50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 -- 172.21.15.52:0/883139847 >> 172.21.15.52:0/883139847 conn(0x7f48580fc550 msgr2=0x7f48580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:44.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 -- 172.21.15.52:0/883139847 shutdown_connections 2024-09-06T14:56:44.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.936+0000 7f485d2d4640 1 -- 172.21.15.52:0/883139847 wait complete. 2024-09-06T14:56:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f485d2d4640 1 Processor -- start 2024-09-06T14:56:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f485d2d4640 1 -- start start 2024-09-06T14:56:44.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f485d2d4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4858102b70 0x7f485819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f485d2d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858103490 0x7f485819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f485d2d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f485810ede0 con 0x7f4858103490 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f485d2d4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f485810ec60 con 0x7f4858102b70 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f48567fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858103490 0x7f485819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f48567fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858103490 0x7f485819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40268/0 (socket says 172.21.15.52:40268) 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f48567fc640 1 -- 172.21.15.52:0/695889513 learned_addr learned my addr 172.21.15.52:0/695889513 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.937+0000 7f4856ffd640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4858102b70 0x7f485819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f48567fc640 1 -- 172.21.15.52:0/695889513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4858102b70 msgr2=0x7f485819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f48567fc640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4858102b70 0x7f485819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f48567fc640 1 -- 172.21.15.52:0/695889513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48581977b0 con 0x7f4858103490 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f48567fc640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858103490 0x7f485819db70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f484000e970 tx=0x7f484000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f484ffff640 1 -- 172.21.15.52:0/695889513 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f484000cac0 con 0x7f4858103490 2024-09-06T14:56:44.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f484ffff640 1 -- 172.21.15.52:0/695889513 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48400054e0 con 0x7f4858103490 2024-09-06T14:56:44.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f484ffff640 1 -- 172.21.15.52:0/695889513 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4840010430 con 0x7f4858103490 2024-09-06T14:56:44.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4858197aa0 con 0x7f4858103490 2024-09-06T14:56:44.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.938+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4858198030 con 0x7f4858103490 2024-09-06T14:56:44.938 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.939+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f485806a4c0 con 0x7f4858103490 2024-09-06T14:56:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.941+0000 7f484ffff640 1 -- 172.21.15.52:0/695889513 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4840004ee0 con 0x7f4858103490 2024-09-06T14:56:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.941+0000 7f484ffff640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f48440774b0 0x7f4844079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.942+0000 7f484ffff640 1 -- 172.21.15.52:0/695889513 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f484009a1c0 con 0x7f4858103490 2024-09-06T14:56:44.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.942+0000 7f4856ffd640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f48440774b0 0x7f4844079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:44.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.942+0000 7f4856ffd640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f48440774b0 0x7f4844079970 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4848000f80 tx=0x7f484803a040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:44.942 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:44.944+0000 7f484ffff640 1 -- 172.21.15.52:0/695889513 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4840063180 con 0x7f4858103490 2024-09-06T14:56:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.164+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4858105fd0 con 0x7f4858103490 2024-09-06T14:56:45.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.164+0000 7f484ffff640 1 -- 172.21.15.52:0/695889513 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f48400672f0 con 0x7f4858103490 2024-09-06T14:56:45.162 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:56:45.162 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:56:45.163 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:56:45.164 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:56:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f48440774b0 msgr2=0x7f4844079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f48440774b0 0x7f4844079970 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4848000f80 tx=0x7f484803a040 comp rx=0 tx=0).stop 2024-09-06T14:56:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858103490 msgr2=0x7f485819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858103490 0x7f485819db70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f484000e970 tx=0x7f484000ed70 comp rx=0 tx=0).stop 2024-09-06T14:56:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 shutdown_connections 2024-09-06T14:56:45.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4858103490 0x7f485819db70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f48440774b0 0x7f4844079970 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 --2- 172.21.15.52:0/695889513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4858102b70 0x7f485819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 >> 172.21.15.52:0/695889513 conn(0x7f48580fc550 msgr2=0x7f4858108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:45.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 shutdown_connections 2024-09-06T14:56:45.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.166+0000 7f485d2d4640 1 -- 172.21.15.52:0/695889513 wait complete. 2024-09-06T14:56:45.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 -- 172.21.15.52:0/3205894057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750106800 msgr2=0x7f5750106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 --2- 172.21.15.52:0/3205894057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750106800 0x7f5750106be0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5740009880 tx=0x7f574002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 -- 172.21.15.52:0/3205894057 shutdown_connections 2024-09-06T14:56:45.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 --2- 172.21.15.52:0/3205894057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5750100800 0x7f5750100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 --2- 172.21.15.52:0/3205894057 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750106800 0x7f5750106be0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 -- 172.21.15.52:0/3205894057 >> 172.21.15.52:0/3205894057 conn(0x7f57500fc520 msgr2=0x7f57500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:45.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 -- 172.21.15.52:0/3205894057 shutdown_connections 2024-09-06T14:56:45.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.249+0000 7f57566c1640 1 -- 172.21.15.52:0/3205894057 wait complete. 2024-09-06T14:56:45.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.250+0000 7f57566c1640 1 Processor -- start 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.250+0000 7f57566c1640 1 -- start start 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f57566c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750100800 0x7f57501987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f57566c1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5750106800 0x7f5750198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f57566c1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f575010dcb0 con 0x7f5750100800 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f57566c1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f575010db30 con 0x7f5750106800 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750100800 0x7f57501987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750100800 0x7f57501987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40298/0 (socket says 172.21.15.52:40298) 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574ffff640 1 -- 172.21.15.52:0/1557441129 learned_addr learned my addr 172.21.15.52:0/1557441129 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574f7fe640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5750106800 0x7f5750198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574ffff640 1 -- 172.21.15.52:0/1557441129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5750106800 msgr2=0x7f5750198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574ffff640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5750106800 0x7f5750198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574ffff640 1 -- 172.21.15.52:0/1557441129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5750199350 con 0x7f5750100800 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.251+0000 7f574ffff640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750100800 0x7f57501987c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5740031460 tx=0x7f5740004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.252+0000 7f574d7fa640 1 -- 172.21.15.52:0/1557441129 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f574003f070 con 0x7f5750100800 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.252+0000 7f574d7fa640 1 -- 172.21.15.52:0/1557441129 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57400035f0 con 0x7f5750100800 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.252+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57501995e0 con 0x7f5750100800 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.252+0000 7f574d7fa640 1 -- 172.21.15.52:0/1557441129 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5740035030 con 0x7f5750100800 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.252+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57501a1b90 con 0x7f5750100800 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.253+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5750101f40 con 0x7f5750100800 2024-09-06T14:56:45.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.254+0000 7f574d7fa640 1 -- 172.21.15.52:0/1557441129 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5740042070 con 0x7f5750100800 2024-09-06T14:56:45.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.254+0000 7f574d7fa640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f573c0774b0 0x7f573c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.254+0000 7f574f7fe640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f573c0774b0 0x7f573c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.254+0000 7f574d7fa640 1 -- 172.21.15.52:0/1557441129 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f57400ba090 con 0x7f5750100800 2024-09-06T14:56:45.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.255+0000 7f574f7fe640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f573c0774b0 0x7f573c079970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f575006ad40 tx=0x7f5738005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:45.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.258+0000 7f574d7fa640 1 -- 172.21.15.52:0/1557441129 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5740083070 con 0x7f5750100800 2024-09-06T14:56:45.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.441+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5750103a10 con 0x7f5750100800 2024-09-06T14:56:45.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.442+0000 7f574d7fa640 1 -- 172.21.15.52:0/1557441129 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f57400871e0 con 0x7f5750100800 2024-09-06T14:56:45.440 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:56:45.440 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:56:45.440 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:56:45.440 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:56:45.440 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:56:45.441 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:56:45.442 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:45.443 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:56:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:56:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.443+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f573c0774b0 msgr2=0x7f573c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.443+0000 7f57566c1640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f573c0774b0 0x7f573c079970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f575006ad40 tx=0x7f5738005f90 comp rx=0 tx=0).stop 2024-09-06T14:56:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.443+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750100800 msgr2=0x7f57501987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.443+0000 7f57566c1640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750100800 0x7f57501987c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5740031460 tx=0x7f5740004530 comp rx=0 tx=0).stop 2024-09-06T14:56:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.444+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 shutdown_connections 2024-09-06T14:56:45.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.444+0000 7f57566c1640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f573c0774b0 0x7f573c079970 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.444+0000 7f57566c1640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5750106800 0x7f5750198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.444+0000 7f57566c1640 1 --2- 172.21.15.52:0/1557441129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5750100800 0x7f57501987c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.444+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 >> 172.21.15.52:0/1557441129 conn(0x7f57500fc520 msgr2=0x7f57500fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.444+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 shutdown_connections 2024-09-06T14:56:45.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.444+0000 7f57566c1640 1 -- 172.21.15.52:0/1557441129 wait complete. 2024-09-06T14:56:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 -- 172.21.15.52:0/2177829242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 msgr2=0x7fe880106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 --2- 172.21.15.52:0/2177829242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880106bd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009880 tx=0x7fe87c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 -- 172.21.15.52:0/2177829242 shutdown_connections 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 --2- 172.21.15.52:0/2177829242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8801007f0 0x7fe880100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 --2- 172.21.15.52:0/2177829242 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880106bd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 -- 172.21.15.52:0/2177829242 >> 172.21.15.52:0/2177829242 conn(0x7fe8800fc550 msgr2=0x7fe8800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 -- 172.21.15.52:0/2177829242 shutdown_connections 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 -- 172.21.15.52:0/2177829242 wait complete. 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.528+0000 7fe887f7d640 1 Processor -- start 2024-09-06T14:56:45.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe887f7d640 1 -- start start 2024-09-06T14:56:45.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe887f7d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8801007f0 0x7fe8801966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe887f7d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880196c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe887f7d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe88010dca0 con 0x7fe8801067f0 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe887f7d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe88010db20 con 0x7fe8801007f0 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885518640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885518640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880196c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40324/0 (socket says 172.21.15.52:40324) 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885518640 1 -- 172.21.15.52:0/1092425965 learned_addr learned my addr 172.21.15.52:0/1092425965 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885d19640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8801007f0 0x7fe8801966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885518640 1 -- 172.21.15.52:0/1092425965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8801007f0 msgr2=0x7fe8801966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885518640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8801007f0 0x7fe8801966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885518640 1 -- 172.21.15.52:0/1092425965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe880197140 con 0x7fe8801067f0 2024-09-06T14:56:45.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885d19640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8801007f0 0x7fe8801966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:56:45.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.529+0000 7fe885518640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880196c00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe87000d8d0 tx=0x7fe87000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:45.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.530+0000 7fe876ffd640 1 -- 172.21.15.52:0/1092425965 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe870017070 con 0x7fe8801067f0 2024-09-06T14:56:45.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.530+0000 7fe876ffd640 1 -- 172.21.15.52:0/1092425965 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe870010460 con 0x7fe8801067f0 2024-09-06T14:56:45.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.530+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe880197430 con 0x7fe8801067f0 2024-09-06T14:56:45.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.530+0000 7fe876ffd640 1 -- 172.21.15.52:0/1092425965 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe87000f5f0 con 0x7fe8801067f0 2024-09-06T14:56:45.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.530+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801a3f00 con 0x7fe8801067f0 2024-09-06T14:56:45.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.531+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe880101f30 con 0x7fe8801067f0 2024-09-06T14:56:45.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.531+0000 7fe876ffd640 1 -- 172.21.15.52:0/1092425965 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe870009a30 con 0x7fe8801067f0 2024-09-06T14:56:45.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.532+0000 7fe876ffd640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe86c077460 0x7fe86c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.532+0000 7fe876ffd640 1 -- 172.21.15.52:0/1092425965 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe870099690 con 0x7fe8801067f0 2024-09-06T14:56:45.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.532+0000 7fe885d19640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe86c077460 0x7fe86c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.533+0000 7fe885d19640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe86c077460 0x7fe86c079920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000c00 tx=0x7fe87c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:45.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.536+0000 7fe876ffd640 1 -- 172.21.15.52:0/1092425965 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe8700625f0 con 0x7fe8801067f0 2024-09-06T14:56:45.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.717+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe880062630 con 0x7fe86c077460 2024-09-06T14:56:45.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.718+0000 7fe876ffd640 1 -- 172.21.15.52:0/1092425965 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe880062630 con 0x7fe86c077460 2024-09-06T14:56:45.716 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:56:45.717 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:56:45.718 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:56:45.718 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:56:45.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe86c077460 msgr2=0x7fe86c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe86c077460 0x7fe86c079920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000c00 tx=0x7fe87c031400 comp rx=0 tx=0).stop 2024-09-06T14:56:45.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 msgr2=0x7fe880196c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880196c00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe87000d8d0 tx=0x7fe87000dd90 comp rx=0 tx=0).stop 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 shutdown_connections 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8801067f0 0x7fe880196c00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe86c077460 0x7fe86c079920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 --2- 172.21.15.52:0/1092425965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8801007f0 0x7fe8801966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 >> 172.21.15.52:0/1092425965 conn(0x7fe8800fc550 msgr2=0x7fe8800fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 shutdown_connections 2024-09-06T14:56:45.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.720+0000 7fe887f7d640 1 -- 172.21.15.52:0/1092425965 wait complete. 2024-09-06T14:56:45.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.803+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3167307726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074f40 msgr2=0x7fd2f810dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.803+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3167307726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074f40 0x7fd2f810dc00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009880 tx=0x7fd2ec02a530 comp rx=0 tx=0).stop 2024-09-06T14:56:45.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.803+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3167307726 shutdown_connections 2024-09-06T14:56:45.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.803+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3167307726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074f40 0x7fd2f810dc00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.803+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3167307726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f8074620 0x7fd2f8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.803+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3167307726 >> 172.21.15.52:0/3167307726 conn(0x7fd2f80fd620 msgr2=0x7fd2f80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:45.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.804+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3167307726 shutdown_connections 2024-09-06T14:56:45.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.804+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3167307726 wait complete. 2024-09-06T14:56:45.803 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:45 smithi052 ceph-mon[112917]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:45.803 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:45 smithi052 ceph-mon[112917]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:45.803 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:45 smithi052 ceph-mon[112917]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:45.803 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:45 smithi052 ceph-mon[112917]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:45.803 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:45 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/695889513' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:56:45.803 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:45 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1557441129' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.804+0000 7fd2fe7d2640 1 Processor -- start 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.804+0000 7fd2fe7d2640 1 -- start start 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2fe7d2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074620 0x7fd2f819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2fe7d2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f8074f40 0x7fd2f819ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2fe7d2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f8110ff0 con 0x7fd2f8074620 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2fe7d2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f8110e70 con 0x7fd2f8074f40 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074620 0x7fd2f819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074620 0x7fd2f819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40338/0 (socket says 172.21.15.52:40338) 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2f7fff640 1 -- 172.21.15.52:0/3185554651 learned_addr learned my addr 172.21.15.52:0/3185554651 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:56:45.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2f77fe640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f8074f40 0x7fd2f819ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2f7fff640 1 -- 172.21.15.52:0/3185554651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f8074f40 msgr2=0x7fd2f819ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2f7fff640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f8074f40 0x7fd2f819ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.805+0000 7fd2f7fff640 1 -- 172.21.15.52:0/3185554651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f8199b20 con 0x7fd2f8074620 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.806+0000 7fd2f7fff640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074620 0x7fd2f819fa50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d6f0 tx=0x7fd2e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.806+0000 7fd2f57fa640 1 -- 172.21.15.52:0/3185554651 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2e8017070 con 0x7fd2f8074620 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.806+0000 7fd2f57fa640 1 -- 172.21.15.52:0/3185554651 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2e800de00 con 0x7fd2f8074620 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.806+0000 7fd2f57fa640 1 -- 172.21.15.52:0/3185554651 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2e8004bb0 con 0x7fd2f8074620 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.806+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f8199e10 con 0x7fd2f8074620 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.806+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f819a370 con 0x7fd2f8074620 2024-09-06T14:56:45.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.807+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f8075cd0 con 0x7fd2f8074620 2024-09-06T14:56:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.807+0000 7fd2f57fa640 1 -- 172.21.15.52:0/3185554651 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd2e8009a30 con 0x7fd2f8074620 2024-09-06T14:56:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.808+0000 7fd2f57fa640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2e00774b0 0x7fd2e0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:56:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.808+0000 7fd2f57fa640 1 -- 172.21.15.52:0/3185554651 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd2e80992a0 con 0x7fd2f8074620 2024-09-06T14:56:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.808+0000 7fd2f77fe640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2e00774b0 0x7fd2e0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:56:45.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.809+0000 7fd2f77fe640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2e00774b0 0x7fd2e0079970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2f819b300 tx=0x7fd2ec031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:56:45.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:45.812+0000 7fd2f57fa640 1 -- 172.21.15.52:0/3185554651 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd2e80663f0 con 0x7fd2f8074620 2024-09-06T14:56:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:45 smithi165 ceph-mon[82925]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:45 smithi165 ceph-mon[82925]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:45.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:45 smithi165 ceph-mon[82925]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:45 smithi165 ceph-mon[82925]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:45 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/695889513' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:56:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:45 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1557441129' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:56:46.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.034+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd2f819afe0 con 0x7fd2f8074620 2024-09-06T14:56:46.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.034+0000 7fd2f57fa640 1 -- 172.21.15.52:0/3185554651 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7fd2e806ae10 con 0x7fd2f8074620 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:56:46.033 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:56:46.034 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:56:46.034 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:56:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2e00774b0 msgr2=0x7fd2e0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2e00774b0 0x7fd2e0079970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2f819b300 tx=0x7fd2ec031400 comp rx=0 tx=0).stop 2024-09-06T14:56:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074620 msgr2=0x7fd2f819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:56:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074620 0x7fd2f819fa50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d6f0 tx=0x7fd2e800dbb0 comp rx=0 tx=0).stop 2024-09-06T14:56:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 shutdown_connections 2024-09-06T14:56:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2e00774b0 0x7fd2e0079970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:46.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2f8074f40 0x7fd2f819ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 --2- 172.21.15.52:0/3185554651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2f8074620 0x7fd2f819fa50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:56:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 >> 172.21.15.52:0/3185554651 conn(0x7fd2f80fd620 msgr2=0x7fd2f810b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:56:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 shutdown_connections 2024-09-06T14:56:46.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:56:46.037+0000 7fd2fe7d2640 1 -- 172.21.15.52:0/3185554651 wait complete. 2024-09-06T14:56:46.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:46 smithi052 ceph-mon[112917]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:46.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:46 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3185554651' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:56:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:46 smithi165 ceph-mon[82925]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:56:47.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:46 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3185554651' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:56:47.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:47 smithi052 ceph-mon[112917]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:48.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:47 smithi165 ceph-mon[82925]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:49.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:49 smithi052 ceph-mon[112917]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:50.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:49 smithi165 ceph-mon[82925]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:51.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:51 smithi052 ceph-mon[112917]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:52.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:51 smithi165 ceph-mon[82925]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:53.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:53 smithi052 ceph-mon[112917]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:53.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:54.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:53 smithi165 ceph-mon[82925]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:56:55.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:55 smithi052 ceph-mon[112917]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:55.876 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:55 smithi165 ceph-mon[82925]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:57.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:57 smithi052 ceph-mon[112917]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:58.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:57 smithi165 ceph-mon[82925]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:56:59.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:56:59 smithi052 ceph-mon[112917]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:00.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:56:59 smithi165 ceph-mon[82925]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:01.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:01 smithi165 ceph-mon[82925]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:01.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:01 smithi052 ceph-mon[112917]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:03.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:03 smithi052 ceph-mon[112917]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:04.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:03 smithi165 ceph-mon[82925]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:05.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:05 smithi052 ceph-mon[112917]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:06.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:05 smithi165 ceph-mon[82925]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:07.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:07 smithi052 ceph-mon[112917]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:07.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:08.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:07 smithi165 ceph-mon[82925]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:08.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:09.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:09 smithi052 ceph-mon[112917]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:10.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:09 smithi165 ceph-mon[82925]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:11.823 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:11 smithi165 ceph-mon[82925]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:11.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:11 smithi052 ceph-mon[112917]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:13.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:13 smithi052 ceph-mon[112917]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:14.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:13 smithi165 ceph-mon[82925]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:15.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:15 smithi052 ceph-mon[112917]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:16.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:15 smithi165 ceph-mon[82925]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 -- 172.21.15.52:0/374765604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320102b20 msgr2=0x7fd320102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 --2- 172.21.15.52:0/374765604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320102b20 0x7fd320102f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd3100098b0 tx=0x7fd31002a560 comp rx=0 tx=0).stop 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 -- 172.21.15.52:0/374765604 shutdown_connections 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 --2- 172.21.15.52:0/374765604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd320103440 0x7fd32010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 --2- 172.21.15.52:0/374765604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320102b20 0x7fd320102f00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 -- 172.21.15.52:0/374765604 >> 172.21.15.52:0/374765604 conn(0x7fd3200fc520 msgr2=0x7fd3200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 -- 172.21.15.52:0/374765604 shutdown_connections 2024-09-06T14:57:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.133+0000 7fd3248cd640 1 -- 172.21.15.52:0/374765604 wait complete. 2024-09-06T14:57:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.134+0000 7fd3248cd640 1 Processor -- start 2024-09-06T14:57:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd3248cd640 1 -- start start 2024-09-06T14:57:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd3248cd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd320102b20 0x7fd32019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd3248cd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320103440 0x7fd32019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd3248cd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd32010edd0 con 0x7fd320103440 2024-09-06T14:57:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd3248cd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd32010ec50 con 0x7fd320102b20 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd315d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320103440 0x7fd32019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd315d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320103440 0x7fd32019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60412/0 (socket says 172.21.15.52:60412) 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd315d9b640 1 -- 172.21.15.52:0/434717081 learned_addr learned my addr 172.21.15.52:0/434717081 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd31e59c640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd320102b20 0x7fd32019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd315d9b640 1 -- 172.21.15.52:0/434717081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd320102b20 msgr2=0x7fd32019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd315d9b640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd320102b20 0x7fd32019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.135+0000 7fd315d9b640 1 -- 172.21.15.52:0/434717081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd320197800 con 0x7fd320103440 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.136+0000 7fd315d9b640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320103440 0x7fd32019dbc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c8a0 tx=0x7fd30800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.136+0000 7fd317fff640 1 -- 172.21.15.52:0/434717081 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3080079b0 con 0x7fd320103440 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.136+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd320197af0 con 0x7fd320103440 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.136+0000 7fd317fff640 1 -- 172.21.15.52:0/434717081 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd308007b50 con 0x7fd320103440 2024-09-06T14:57:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.136+0000 7fd317fff640 1 -- 172.21.15.52:0/434717081 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd308018700 con 0x7fd320103440 2024-09-06T14:57:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.136+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd320198080 con 0x7fd320103440 2024-09-06T14:57:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.137+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32006aa30 con 0x7fd320103440 2024-09-06T14:57:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.138+0000 7fd317fff640 1 -- 172.21.15.52:0/434717081 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd308007d00 con 0x7fd320103440 2024-09-06T14:57:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.138+0000 7fd317fff640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd30c077460 0x7fd30c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.138+0000 7fd31e59c640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd30c077460 0x7fd30c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.138+0000 7fd317fff640 1 -- 172.21.15.52:0/434717081 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd308099a80 con 0x7fd320103440 2024-09-06T14:57:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.139+0000 7fd31e59c640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd30c077460 0x7fd30c079920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd310000c00 tx=0x7fd310009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.142+0000 7fd317fff640 1 -- 172.21.15.52:0/434717081 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd308014030 con 0x7fd320103440 2024-09-06T14:57:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.322+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd320198390 con 0x7fd30c077460 2024-09-06T14:57:16.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.324+0000 7fd317fff640 1 -- 172.21.15.52:0/434717081 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd320198390 con 0x7fd30c077460 2024-09-06T14:57:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd30c077460 msgr2=0x7fd30c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd30c077460 0x7fd30c079920 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd310000c00 tx=0x7fd310009560 comp rx=0 tx=0).stop 2024-09-06T14:57:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320103440 msgr2=0x7fd32019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320103440 0x7fd32019dbc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c8a0 tx=0x7fd30800cd60 comp rx=0 tx=0).stop 2024-09-06T14:57:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 shutdown_connections 2024-09-06T14:57:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd320103440 0x7fd32019dbc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.324 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd30c077460 0x7fd30c079920 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 --2- 172.21.15.52:0/434717081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd320102b20 0x7fd32019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 >> 172.21.15.52:0/434717081 conn(0x7fd3200fc520 msgr2=0x7fd320103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:16.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 shutdown_connections 2024-09-06T14:57:16.325 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.326+0000 7fd3248cd640 1 -- 172.21.15.52:0/434717081 wait complete. 2024-09-06T14:57:16.333 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:57:16.408 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 -- 172.21.15.52:0/1204067009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 msgr2=0x7f919c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1204067009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c107ce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f918c009c20 tx=0x7f918c02a970 comp rx=0 tx=0).stop 2024-09-06T14:57:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 -- 172.21.15.52:0/1204067009 shutdown_connections 2024-09-06T14:57:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1204067009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919c101900 0x7f919c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1204067009 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c107ce0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 -- 172.21.15.52:0/1204067009 >> 172.21.15.52:0/1204067009 conn(0x7f919c0fd600 msgr2=0x7f919c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 -- 172.21.15.52:0/1204067009 shutdown_connections 2024-09-06T14:57:16.409 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.410+0000 7f91a0da5640 1 -- 172.21.15.52:0/1204067009 wait complete. 2024-09-06T14:57:16.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.411+0000 7f91a0da5640 1 Processor -- start 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.411+0000 7f91a0da5640 1 -- start start 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.411+0000 7f91a0da5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919c101900 0x7f919c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.411+0000 7f91a0da5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c19dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.411+0000 7f91a0da5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f919c10ee30 con 0x7f919c107900 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.411+0000 7f91a0da5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f919c10ecb0 con 0x7f919c101900 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f9199d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c19dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f9199d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c19dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60438/0 (socket says 172.21.15.52:60438) 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f9199d9b640 1 -- 172.21.15.52:0/1256969794 learned_addr learned my addr 172.21.15.52:0/1256969794 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f919a59c640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919c101900 0x7f919c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f9199d9b640 1 -- 172.21.15.52:0/1256969794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919c101900 msgr2=0x7f919c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f9199d9b640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919c101900 0x7f919c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.411 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f9199d9b640 1 -- 172.21.15.52:0/1256969794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c1978c0 con 0x7f919c107900 2024-09-06T14:57:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f9199d9b640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c19dc40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f919000b420 tx=0x7f919000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f918b7fe640 1 -- 172.21.15.52:0/1256969794 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9190011630 con 0x7f919c107900 2024-09-06T14:57:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f918b7fe640 1 -- 172.21.15.52:0/1256969794 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9190016070 con 0x7f919c107900 2024-09-06T14:57:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919c197bb0 con 0x7f919c107900 2024-09-06T14:57:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.412+0000 7f918b7fe640 1 -- 172.21.15.52:0/1256969794 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9190010d40 con 0x7f919c107900 2024-09-06T14:57:16.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.413+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919c1980e0 con 0x7f919c107900 2024-09-06T14:57:16.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.414+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919c103040 con 0x7f919c107900 2024-09-06T14:57:16.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.414+0000 7f918b7fe640 1 -- 172.21.15.52:0/1256969794 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f919001b460 con 0x7f919c107900 2024-09-06T14:57:16.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.415+0000 7f918b7fe640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91840774b0 0x7f9184079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.415+0000 7f918b7fe640 1 -- 172.21.15.52:0/1256969794 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9190098eb0 con 0x7f919c107900 2024-09-06T14:57:16.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.415+0000 7f919a59c640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91840774b0 0x7f9184079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.415+0000 7f919a59c640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91840774b0 0x7f9184079970 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f918c009430 tx=0x7f918c03c040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.419+0000 7f918b7fe640 1 -- 172.21.15.52:0/1256969794 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9190061e30 con 0x7f919c107900 2024-09-06T14:57:16.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.598+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f919c198df0 con 0x7f91840774b0 2024-09-06T14:57:16.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.600+0000 7f918b7fe640 1 -- 172.21.15.52:0/1256969794 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f919c198df0 con 0x7f91840774b0 2024-09-06T14:57:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91840774b0 msgr2=0x7f9184079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91840774b0 0x7f9184079970 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f918c009430 tx=0x7f918c03c040 comp rx=0 tx=0).stop 2024-09-06T14:57:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 msgr2=0x7f919c19dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c19dc40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f919000b420 tx=0x7f919000b8e0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 shutdown_connections 2024-09-06T14:57:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f919c107900 0x7f919c19dc40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91840774b0 0x7f9184079970 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 --2- 172.21.15.52:0/1256969794 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f919c101900 0x7f919c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 >> 172.21.15.52:0/1256969794 conn(0x7f919c0fd600 msgr2=0x7f919c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 shutdown_connections 2024-09-06T14:57:16.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.602+0000 7f91a0da5640 1 -- 172.21.15.52:0/1256969794 wait complete. 2024-09-06T14:57:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 -- 172.21.15.52:0/4076333840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 msgr2=0x7f5338100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 --2- 172.21.15.52:0/4076333840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f5338100c60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f532c009880 tx=0x7f532c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 -- 172.21.15.52:0/4076333840 shutdown_connections 2024-09-06T14:57:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 --2- 172.21.15.52:0/4076333840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f5338100c60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 --2- 172.21.15.52:0/4076333840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5338106800 0x7f5338106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 -- 172.21.15.52:0/4076333840 >> 172.21.15.52:0/4076333840 conn(0x7f53380fc520 msgr2=0x7f53380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 -- 172.21.15.52:0/4076333840 shutdown_connections 2024-09-06T14:57:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.699+0000 7f533dfcb640 1 -- 172.21.15.52:0/4076333840 wait complete. 2024-09-06T14:57:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f533dfcb640 1 Processor -- start 2024-09-06T14:57:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f533dfcb640 1 -- start start 2024-09-06T14:57:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f533dfcb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f533819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f533dfcb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5338106800 0x7f533819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f533dfcb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f533810dcd0 con 0x7f5338100800 2024-09-06T14:57:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f533dfcb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f533810db50 con 0x7f5338106800 2024-09-06T14:57:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f53377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f533819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f53377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f533819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60460/0 (socket says 172.21.15.52:60460) 2024-09-06T14:57:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f53377fe640 1 -- 172.21.15.52:0/2702564733 learned_addr learned my addr 172.21.15.52:0/2702564733 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.700+0000 7f5336ffd640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5338106800 0x7f533819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f53377fe640 1 -- 172.21.15.52:0/2702564733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5338106800 msgr2=0x7f533819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f53377fe640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5338106800 0x7f533819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f53377fe640 1 -- 172.21.15.52:0/2702564733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53381977f0 con 0x7f5338100800 2024-09-06T14:57:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f53377fe640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f533819d670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f532800e970 tx=0x7f532800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f5334ff9640 1 -- 172.21.15.52:0/2702564733 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f532800cac0 con 0x7f5338100800 2024-09-06T14:57:16.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5338197ae0 con 0x7f5338100800 2024-09-06T14:57:16.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f5334ff9640 1 -- 172.21.15.52:0/2702564733 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53280054e0 con 0x7f5338100800 2024-09-06T14:57:16.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f5334ff9640 1 -- 172.21.15.52:0/2702564733 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5328010430 con 0x7f5338100800 2024-09-06T14:57:16.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.701+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5338198040 con 0x7f5338100800 2024-09-06T14:57:16.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.702+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5338101f40 con 0x7f5338100800 2024-09-06T14:57:16.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.703+0000 7f5334ff9640 1 -- 172.21.15.52:0/2702564733 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5328004e80 con 0x7f5338100800 2024-09-06T14:57:16.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.703+0000 7f5334ff9640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5320077460 0x7f5320079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.703+0000 7f5334ff9640 1 -- 172.21.15.52:0/2702564733 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f5328099de0 con 0x7f5338100800 2024-09-06T14:57:16.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.703+0000 7f5336ffd640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5320077460 0x7f5320079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.704+0000 7f5336ffd640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5320077460 0x7f5320079920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5338198b40 tx=0x7f532c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.707+0000 7f5334ff9640 1 -- 172.21.15.52:0/2702564733 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5328062d40 con 0x7f5338100800 2024-09-06T14:57:16.876 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.878+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5338198350 con 0x7f5320077460 2024-09-06T14:57:16.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.887+0000 7f5334ff9640 1 -- 172.21.15.52:0/2702564733 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5338198350 con 0x7f5320077460 2024-09-06T14:57:16.886 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:57:16.886 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (9m) 3m ago 20m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:57:16.886 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (12m) 3m ago 20m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:57:16.886 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (11m) 3m ago 19m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:57:16.887 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (7m) 3m ago 20m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:57:16.887 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (7m) 3m ago 19m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:57:16.887 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (9m) 3m ago 20m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:57:16.887 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (4m) 3m ago 15m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:57:16.887 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (4m) 3m ago 15m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:57:16.887 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (3m) 3m ago 15m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:57:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (3m) 3m ago 15m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:57:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (11m) 3m ago 21m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:57:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (10m) 3m ago 19m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:57:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (8m) 3m ago 21m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:57:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (8m) 3m ago 19m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:57:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (10m) 3m ago 20m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:57:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (10m) 3m ago 19m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:57:16.889 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (7m) 3m ago 18m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:57:16.889 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (6m) 3m ago 18m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:57:16.889 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (6m) 3m ago 17m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:57:16.889 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (5m) 3m ago 17m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:57:16.889 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (5m) 3m ago 16m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:57:16.889 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (4m) 3m ago 16m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:57:16.890 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (10m) 3m ago 20m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:57:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5320077460 msgr2=0x7f5320079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5320077460 0x7f5320079920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5338198b40 tx=0x7f532c031400 comp rx=0 tx=0).stop 2024-09-06T14:57:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 msgr2=0x7f533819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f533819d670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f532800e970 tx=0x7f532800ed70 comp rx=0 tx=0).stop 2024-09-06T14:57:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 shutdown_connections 2024-09-06T14:57:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5320077460 0x7f5320079920 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5338106800 0x7f533819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 --2- 172.21.15.52:0/2702564733 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5338100800 0x7f533819d670 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 >> 172.21.15.52:0/2702564733 conn(0x7f53380fc520 msgr2=0x7f533806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 shutdown_connections 2024-09-06T14:57:16.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.889+0000 7f533dfcb640 1 -- 172.21.15.52:0/2702564733 wait complete. 2024-09-06T14:57:16.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 -- 172.21.15.52:0/3114806814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30107900 msgr2=0x7f1d30107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 --2- 172.21.15.52:0/3114806814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30107900 0x7f1d30107ce0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009880 tx=0x7f1d2c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 -- 172.21.15.52:0/3114806814 shutdown_connections 2024-09-06T14:57:16.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 --2- 172.21.15.52:0/3114806814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d30101900 0x7f1d30101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 --2- 172.21.15.52:0/3114806814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30107900 0x7f1d30107ce0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 -- 172.21.15.52:0/3114806814 >> 172.21.15.52:0/3114806814 conn(0x7f1d300fd600 msgr2=0x7f1d300ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:16.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 -- 172.21.15.52:0/3114806814 shutdown_connections 2024-09-06T14:57:16.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.971+0000 7f1d3781a640 1 -- 172.21.15.52:0/3114806814 wait complete. 2024-09-06T14:57:16.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d3781a640 1 Processor -- start 2024-09-06T14:57:16.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d3781a640 1 -- start start 2024-09-06T14:57:16.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d3781a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30101900 0x7f1d300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d3781a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d30107900 0x7f1d30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d3781a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3010edd0 con 0x7f1d30101900 2024-09-06T14:57:16.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d3781a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3010ec50 con 0x7f1d30107900 2024-09-06T14:57:16.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d355b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30101900 0x7f1d300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d355b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30101900 0x7f1d300744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60472/0 (socket says 172.21.15.52:60472) 2024-09-06T14:57:16.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d355b6640 1 -- 172.21.15.52:0/4152535668 learned_addr learned my addr 172.21.15.52:0/4152535668 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:16.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.972+0000 7f1d34db5640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d30107900 0x7f1d30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d355b6640 1 -- 172.21.15.52:0/4152535668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d30107900 msgr2=0x7f1d30074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:16.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d355b6640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d30107900 0x7f1d30074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d355b6640 1 -- 172.21.15.52:0/4152535668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d30074f70 con 0x7f1d30101900 2024-09-06T14:57:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d355b6640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30101900 0x7f1d300744f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c031460 tx=0x7f1d2c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d267fc640 1 -- 172.21.15.52:0/4152535668 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d2c03f070 con 0x7f1d30101900 2024-09-06T14:57:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d267fc640 1 -- 172.21.15.52:0/4152535668 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d2c0035f0 con 0x7f1d30101900 2024-09-06T14:57:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d30075200 con 0x7f1d30101900 2024-09-06T14:57:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d267fc640 1 -- 172.21.15.52:0/4152535668 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d2c035030 con 0x7f1d30101900 2024-09-06T14:57:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.973+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d301a3d60 con 0x7f1d30101900 2024-09-06T14:57:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.974+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d30103040 con 0x7f1d30101900 2024-09-06T14:57:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.975+0000 7f1d267fc640 1 -- 172.21.15.52:0/4152535668 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1d2c042070 con 0x7f1d30101900 2024-09-06T14:57:16.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.975+0000 7f1d267fc640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1d1c077460 0x7f1d1c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:16.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.975+0000 7f1d267fc640 1 -- 172.21.15.52:0/4152535668 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1d2c0ba170 con 0x7f1d30101900 2024-09-06T14:57:16.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.975+0000 7f1d34db5640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1d1c077460 0x7f1d1c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:16.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.976+0000 7f1d34db5640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1d1c077460 0x7f1d1c079920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005fd0 tx=0x7f1d20005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:16.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:16.979+0000 7f1d267fc640 1 -- 172.21.15.52:0/4152535668 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1d2c0830d0 con 0x7f1d30101900 2024-09-06T14:57:17.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.200+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1d30109e70 con 0x7f1d30101900 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.200+0000 7f1d267fc640 1 -- 172.21.15.52:0/4152535668 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f1d2c087240 con 0x7f1d30101900 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:57:17.199 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:17.200 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:57:17.200 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:57:17.200 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:17.200 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:57:17.200 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:57:17.200 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:57:17.200 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1d1c077460 msgr2=0x7f1d1c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1d1c077460 0x7f1d1c079920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1d20005fd0 tx=0x7f1d20005850 comp rx=0 tx=0).stop 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30101900 msgr2=0x7f1d300744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30101900 0x7f1d300744f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c031460 tx=0x7f1d2c0045e0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 shutdown_connections 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1d1c077460 0x7f1d1c079920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1d30107900 0x7f1d30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 --2- 172.21.15.52:0/4152535668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1d30101900 0x7f1d300744f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 >> 172.21.15.52:0/4152535668 conn(0x7f1d300fd600 msgr2=0x7f1d300fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:17.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 shutdown_connections 2024-09-06T14:57:17.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.203+0000 7f1d3781a640 1 -- 172.21.15.52:0/4152535668 wait complete. 2024-09-06T14:57:17.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 -- 172.21.15.52:0/151465431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 msgr2=0x7f3cf01053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 --2- 172.21.15.52:0/151465431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01053d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009c20 tx=0x7f3cd802a970 comp rx=0 tx=0).stop 2024-09-06T14:57:17.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 -- 172.21.15.52:0/151465431 shutdown_connections 2024-09-06T14:57:17.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 --2- 172.21.15.52:0/151465431 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01053d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 --2- 172.21.15.52:0/151465431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf0101440 0x7f3cf0101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 -- 172.21.15.52:0/151465431 >> 172.21.15.52:0/151465431 conn(0x7f3cf0077270 msgr2=0x7f3cf0077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 -- 172.21.15.52:0/151465431 shutdown_connections 2024-09-06T14:57:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 -- 172.21.15.52:0/151465431 wait complete. 2024-09-06T14:57:17.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.286+0000 7f3cf551d640 1 Processor -- start 2024-09-06T14:57:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cf551d640 1 -- start start 2024-09-06T14:57:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cf551d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf0101440 0x7f3cf0102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cf551d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cf551d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf010dcc0 con 0x7f3cf0101df0 2024-09-06T14:57:17.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cf551d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf010db40 con 0x7f3cf0101440 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cee7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cee7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60486/0 (socket says 172.21.15.52:60486) 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cee7fc640 1 -- 172.21.15.52:0/30361058 learned_addr learned my addr 172.21.15.52:0/30361058 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3ceeffd640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf0101440 0x7f3cf0102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cee7fc640 1 -- 172.21.15.52:0/30361058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf0101440 msgr2=0x7f3cf0102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cee7fc640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf0101440 0x7f3cf0102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cee7fc640 1 -- 172.21.15.52:0/30361058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf0102ef0 con 0x7f3cf0101df0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.287+0000 7f3cee7fc640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01029b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3cd802ae90 tx=0x7f3cd802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.288+0000 7f3ce7fff640 1 -- 172.21.15.52:0/30361058 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd8047070 con 0x7f3cf0101df0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.288+0000 7f3ce7fff640 1 -- 172.21.15.52:0/30361058 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cd802f7e0 con 0x7f3cf0101df0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.288+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf0103180 con 0x7f3cf0101df0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.288+0000 7f3ce7fff640 1 -- 172.21.15.52:0/30361058 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cd8034070 con 0x7f3cf0101df0 2024-09-06T14:57:17.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.288+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf01a3d90 con 0x7f3cf0101df0 2024-09-06T14:57:17.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.289+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf0069f00 con 0x7f3cf0101df0 2024-09-06T14:57:17.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.290+0000 7f3ce7fff640 1 -- 172.21.15.52:0/30361058 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3cd804a070 con 0x7f3cf0101df0 2024-09-06T14:57:17.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.290+0000 7f3ce7fff640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cdc077460 0x7f3cdc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.290+0000 7f3ceeffd640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cdc077460 0x7f3cdc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.290+0000 7f3ce7fff640 1 -- 172.21.15.52:0/30361058 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3cd80ba450 con 0x7f3cf0101df0 2024-09-06T14:57:17.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.291+0000 7f3ceeffd640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cdc077460 0x7f3cdc079920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0005fd0 tx=0x7f3ce0005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:17.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.294+0000 7f3ce7fff640 1 -- 172.21.15.52:0/30361058 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3cd803f070 con 0x7f3cf0101df0 2024-09-06T14:57:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.477+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3cf0109da0 con 0x7f3cf0101df0 2024-09-06T14:57:17.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.478+0000 7f3ce7fff640 1 -- 172.21.15.52:0/30361058 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f3cd80833b0 con 0x7f3cf0101df0 2024-09-06T14:57:17.476 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:57:17.476 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:57:17.477 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:57:17.478 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:17.479 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:17.480 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:17.480 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cdc077460 msgr2=0x7f3cdc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cdc077460 0x7f3cdc079920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0005fd0 tx=0x7f3ce0005850 comp rx=0 tx=0).stop 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 msgr2=0x7f3cf01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01029b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3cd802ae90 tx=0x7f3cd802f5f0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 shutdown_connections 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3cf0101df0 0x7f3cf01029b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3cdc077460 0x7f3cdc079920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 --2- 172.21.15.52:0/30361058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cf0101440 0x7f3cf0102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.480+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 >> 172.21.15.52:0/30361058 conn(0x7f3cf0077270 msgr2=0x7f3cf01048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.481+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 shutdown_connections 2024-09-06T14:57:17.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.481+0000 7f3cf551d640 1 -- 172.21.15.52:0/30361058 wait complete. 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 -- 172.21.15.52:0/3739317582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144106800 msgr2=0x7fe144106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 --2- 172.21.15.52:0/3739317582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144106800 0x7fe144106be0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe134009880 tx=0x7fe13402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 -- 172.21.15.52:0/3739317582 shutdown_connections 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 --2- 172.21.15.52:0/3739317582 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe144100800 0x7fe144100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 --2- 172.21.15.52:0/3739317582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144106800 0x7fe144106be0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 -- 172.21.15.52:0/3739317582 >> 172.21.15.52:0/3739317582 conn(0x7fe1440fc520 msgr2=0x7fe1440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 -- 172.21.15.52:0/3739317582 shutdown_connections 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.565+0000 7fe149fd9640 1 -- 172.21.15.52:0/3739317582 wait complete. 2024-09-06T14:57:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe149fd9640 1 Processor -- start 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe149fd9640 1 -- start start 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe149fd9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144100800 0x7fe1441965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe149fd9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe144106800 0x7fe144196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe149fd9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe14410dcb0 con 0x7fe144100800 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe149fd9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe14410db30 con 0x7fe144106800 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144100800 0x7fe1441965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144100800 0x7fe1441965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60494/0 (socket says 172.21.15.52:60494) 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe1437fe640 1 -- 172.21.15.52:0/2726012986 learned_addr learned my addr 172.21.15.52:0/2726012986 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.566+0000 7fe142ffd640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe144106800 0x7fe144196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe1437fe640 1 -- 172.21.15.52:0/2726012986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe144106800 msgr2=0x7fe144196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe1437fe640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe144106800 0x7fe144196b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe1437fe640 1 -- 172.21.15.52:0/2726012986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe144197050 con 0x7fe144100800 2024-09-06T14:57:17.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe1437fe640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144100800 0x7fe1441965d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe134031460 tx=0x7fe1340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:17.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe140ff9640 1 -- 172.21.15.52:0/2726012986 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe13403f070 con 0x7fe144100800 2024-09-06T14:57:17.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1441972e0 con 0x7fe144100800 2024-09-06T14:57:17.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe140ff9640 1 -- 172.21.15.52:0/2726012986 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1340035f0 con 0x7fe144100800 2024-09-06T14:57:17.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe140ff9640 1 -- 172.21.15.52:0/2726012986 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe134035030 con 0x7fe144100800 2024-09-06T14:57:17.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.567+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1441a3e10 con 0x7fe144100800 2024-09-06T14:57:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.568+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe144101f40 con 0x7fe144100800 2024-09-06T14:57:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.569+0000 7fe140ff9640 1 -- 172.21.15.52:0/2726012986 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe134042070 con 0x7fe144100800 2024-09-06T14:57:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.569+0000 7fe140ff9640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe12c077460 0x7fe12c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.569+0000 7fe140ff9640 1 -- 172.21.15.52:0/2726012986 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe1340ba210 con 0x7fe144100800 2024-09-06T14:57:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.569+0000 7fe142ffd640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe12c077460 0x7fe12c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.570+0000 7fe142ffd640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe12c077460 0x7fe12c079920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe138005fd0 tx=0x7fe138005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:17.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.573+0000 7fe140ff9640 1 -- 172.21.15.52:0/2726012986 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe1340830d0 con 0x7fe144100800 2024-09-06T14:57:17.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.750+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe144062630 con 0x7fe12c077460 2024-09-06T14:57:17.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.751+0000 7fe140ff9640 1 -- 172.21.15.52:0/2726012986 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe144062630 con 0x7fe12c077460 2024-09-06T14:57:17.749 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:57:17.750 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:57:17.751 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe12c077460 msgr2=0x7fe12c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe12c077460 0x7fe12c079920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe138005fd0 tx=0x7fe138005850 comp rx=0 tx=0).stop 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144100800 msgr2=0x7fe1441965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144100800 0x7fe1441965d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe134031460 tx=0x7fe1340045e0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 shutdown_connections 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe12c077460 0x7fe12c079920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe144106800 0x7fe144196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 --2- 172.21.15.52:0/2726012986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe144100800 0x7fe1441965d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.753+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 >> 172.21.15.52:0/2726012986 conn(0x7fe1440fc520 msgr2=0x7fe1440fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.754+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 shutdown_connections 2024-09-06T14:57:17.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.754+0000 7fe149fd9640 1 -- 172.21.15.52:0/2726012986 wait complete. 2024-09-06T14:57:17.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 -- 172.21.15.52:0/925312367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 msgr2=0x7f1bc4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/925312367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc4101d60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009880 tx=0x7f1bb402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 -- 172.21.15.52:0/925312367 shutdown_connections 2024-09-06T14:57:17.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/925312367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc4101d60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/925312367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bc4107900 0x7f1bc4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 -- 172.21.15.52:0/925312367 >> 172.21.15.52:0/925312367 conn(0x7f1bc40fd600 msgr2=0x7f1bc40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:17.836 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:17 smithi052 ceph-mon[112917]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:17.836 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:17 smithi052 ceph-mon[112917]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:17.836 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:17 smithi052 ceph-mon[112917]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:17.836 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:17 smithi052 ceph-mon[112917]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:17.836 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:17 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4152535668' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:57:17.837 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:17 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/30361058' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:57:17.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 -- 172.21.15.52:0/925312367 shutdown_connections 2024-09-06T14:57:17.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.837+0000 7f1bcb58b640 1 -- 172.21.15.52:0/925312367 wait complete. 2024-09-06T14:57:17.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bcb58b640 1 Processor -- start 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bcb58b640 1 -- start start 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bcb58b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bcb58b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bc4107900 0x7f1bc4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bcb58b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc410edb0 con 0x7f1bc4101900 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bcb58b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc410ec30 con 0x7f1bc4107900 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bc9327640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bc9327640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60516/0 (socket says 172.21.15.52:60516) 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.838+0000 7f1bc9327640 1 -- 172.21.15.52:0/3622532590 learned_addr learned my addr 172.21.15.52:0/3622532590 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bc8b26640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bc4107900 0x7f1bc4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bc9327640 1 -- 172.21.15.52:0/3622532590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bc4107900 msgr2=0x7f1bc4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bc9327640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bc4107900 0x7f1bc4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:17.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bc9327640 1 -- 172.21.15.52:0/3622532590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc4074f70 con 0x7f1bc4101900 2024-09-06T14:57:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bc9327640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc40744f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000c810 tx=0x7f1bc000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bba7fc640 1 -- 172.21.15.52:0/3622532590 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bc0004020 con 0x7f1bc4101900 2024-09-06T14:57:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc4075260 con 0x7f1bc4101900 2024-09-06T14:57:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bba7fc640 1 -- 172.21.15.52:0/3622532590 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bc00041c0 con 0x7f1bc4101900 2024-09-06T14:57:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc41a3e80 con 0x7f1bc4101900 2024-09-06T14:57:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.839+0000 7f1bba7fc640 1 -- 172.21.15.52:0/3622532590 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bc00047a0 con 0x7f1bc4101900 2024-09-06T14:57:17.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.840+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc4103040 con 0x7f1bc4101900 2024-09-06T14:57:17.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.841+0000 7f1bba7fc640 1 -- 172.21.15.52:0/3622532590 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1bc00079b0 con 0x7f1bc4101900 2024-09-06T14:57:17.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.842+0000 7f1bba7fc640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bb00774b0 0x7f1bb0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:17.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.842+0000 7f1bba7fc640 1 -- 172.21.15.52:0/3622532590 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1bc00996b0 con 0x7f1bc4101900 2024-09-06T14:57:17.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.842+0000 7f1bc8b26640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bb00774b0 0x7f1bb0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:17.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.842+0000 7f1bc8b26640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bb00774b0 0x7f1bb0079970 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4075f80 tx=0x7f1bb4031420 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:17.846+0000 7f1bba7fc640 1 -- 172.21.15.52:0/3622532590 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1bc0014030 con 0x7f1bc4101900 2024-09-06T14:57:18.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.066+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1bc4109e90 con 0x7f1bc4101900 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.066+0000 7f1bba7fc640 1 -- 172.21.15.52:0/3622532590 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f1bc00625f0 con 0x7f1bc4101900 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:57:18.065 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:57:18.066 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:57:18.066 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:57:18.066 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:57:18.066 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:57:18.066 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:57:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bb00774b0 msgr2=0x7f1bb0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bb00774b0 0x7f1bb0079970 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4075f80 tx=0x7f1bb4031420 comp rx=0 tx=0).stop 2024-09-06T14:57:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 msgr2=0x7f1bc40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc40744f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000c810 tx=0x7f1bc000ccd0 comp rx=0 tx=0).stop 2024-09-06T14:57:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 shutdown_connections 2024-09-06T14:57:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bb00774b0 0x7f1bb0079970 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:18.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bc4107900 0x7f1bc4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:18.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 --2- 172.21.15.52:0/3622532590 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc4101900 0x7f1bc40744f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:18.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 >> 172.21.15.52:0/3622532590 conn(0x7f1bc40fd600 msgr2=0x7f1bc40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:18.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 shutdown_connections 2024-09-06T14:57:18.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:18.069+0000 7f1bcb58b640 1 -- 172.21.15.52:0/3622532590 wait complete. 2024-09-06T14:57:18.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:17 smithi165 ceph-mon[82925]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:18.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:17 smithi165 ceph-mon[82925]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:18.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:17 smithi165 ceph-mon[82925]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:18.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:17 smithi165 ceph-mon[82925]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:18.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:17 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4152535668' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:57:18.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:17 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/30361058' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:57:19.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:18 smithi165 ceph-mon[82925]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:19.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:18 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3622532590' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:57:19.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:18 smithi052 ceph-mon[112917]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:19.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:18 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3622532590' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:57:20.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:19 smithi165 ceph-mon[82925]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:20.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:19 smithi052 ceph-mon[112917]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:22.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:21 smithi165 ceph-mon[82925]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:22.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:21 smithi052 ceph-mon[112917]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:23.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:23.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:24.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:23 smithi165 ceph-mon[82925]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:24.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:23 smithi052 ceph-mon[112917]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:25.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:25 smithi052 ceph-mon[112917]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:26.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:25 smithi165 ceph-mon[82925]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:28.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:27 smithi165 ceph-mon[82925]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:28.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:27 smithi052 ceph-mon[112917]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:30.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:29 smithi165 ceph-mon[82925]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:30.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:29 smithi052 ceph-mon[112917]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:32.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:31 smithi165 ceph-mon[82925]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:32.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:31 smithi052 ceph-mon[112917]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:34.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:33 smithi165 ceph-mon[82925]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:34.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:33 smithi052 ceph-mon[112917]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:35.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:35 smithi052 ceph-mon[112917]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:36.073 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:35 smithi165 ceph-mon[82925]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:38.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:37 smithi165 ceph-mon[82925]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:38.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:38.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:37 smithi052 ceph-mon[112917]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:38.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:40.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:39 smithi165 ceph-mon[82925]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:39 smithi052 ceph-mon[112917]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:41.968 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:41 smithi052 ceph-mon[112917]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:42.001 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:41 smithi165 ceph-mon[82925]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:44.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:43 smithi165 ceph-mon[82925]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:44.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:43 smithi052 ceph-mon[112917]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:45.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:45 smithi052 ceph-mon[112917]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:46.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:45 smithi165 ceph-mon[82925]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:48.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:47 smithi165 ceph-mon[82925]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:47 smithi052 ceph-mon[112917]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2259675817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b48102ac0 msgr2=0x7f6b48102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2259675817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b48102ac0 0x7f6b48102ea0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009880 tx=0x7f6b3802a530 comp rx=0 tx=0).stop 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2259675817 shutdown_connections 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2259675817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b481033e0 0x7f6b4810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2259675817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b48102ac0 0x7f6b48102ea0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2259675817 >> 172.21.15.52:0/2259675817 conn(0x7f6b480fc520 msgr2=0x7f6b480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2259675817 shutdown_connections 2024-09-06T14:57:48.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.165+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2259675817 wait complete. 2024-09-06T14:57:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.166+0000 7f6b4cd69640 1 Processor -- start 2024-09-06T14:57:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.166+0000 7f6b4cd69640 1 -- start start 2024-09-06T14:57:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.166+0000 7f6b4cd69640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b48102ac0 0x7f6b4819f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.166+0000 7f6b4cd69640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b481033e0 0x7f6b4819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.166+0000 7f6b4cd69640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4810edf0 con 0x7f6b481033e0 2024-09-06T14:57:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.166+0000 7f6b4cd69640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4810ec70 con 0x7f6b48102ac0 2024-09-06T14:57:48.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b45d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b481033e0 0x7f6b4819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b45d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b481033e0 0x7f6b4819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58898/0 (socket says 172.21.15.52:58898) 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b45d9b640 1 -- 172.21.15.52:0/2538616507 learned_addr learned my addr 172.21.15.52:0/2538616507 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b4659c640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b48102ac0 0x7f6b4819f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b45d9b640 1 -- 172.21.15.52:0/2538616507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b48102ac0 msgr2=0x7f6b4819f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b45d9b640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b48102ac0 0x7f6b4819f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b45d9b640 1 -- 172.21.15.52:0/2538616507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b481999c0 con 0x7f6b481033e0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b45d9b640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b481033e0 0x7f6b4819fd40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00d6d0 tx=0x7f6b3c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.167+0000 7f6b377fe640 1 -- 172.21.15.52:0/2538616507 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b3c017070 con 0x7f6b481033e0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.168+0000 7f6b377fe640 1 -- 172.21.15.52:0/2538616507 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b3c0054e0 con 0x7f6b481033e0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.168+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b48199cb0 con 0x7f6b481033e0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.168+0000 7f6b377fe640 1 -- 172.21.15.52:0/2538616507 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b3c004ae0 con 0x7f6b481033e0 2024-09-06T14:57:48.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.168+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4819a240 con 0x7f6b481033e0 2024-09-06T14:57:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.169+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4806aa90 con 0x7f6b481033e0 2024-09-06T14:57:48.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.169+0000 7f6b377fe640 1 -- 172.21.15.52:0/2538616507 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6b3c004de0 con 0x7f6b481033e0 2024-09-06T14:57:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.170+0000 7f6b377fe640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6b30077460 0x7f6b30079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.170+0000 7f6b4659c640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6b30077460 0x7f6b30079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.170+0000 7f6b377fe640 1 -- 172.21.15.52:0/2538616507 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f6b3c0993f0 con 0x7f6b481033e0 2024-09-06T14:57:48.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.171+0000 7f6b4659c640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6b30077460 0x7f6b30079920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b38000c00 tx=0x7f6b38031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.174+0000 7f6b377fe640 1 -- 172.21.15.52:0/2538616507 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6b3c066420 con 0x7f6b481033e0 2024-09-06T14:57:48.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.353+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b4819aef0 con 0x7f6b30077460 2024-09-06T14:57:48.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.354+0000 7f6b377fe640 1 -- 172.21.15.52:0/2538616507 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6b4819aef0 con 0x7f6b30077460 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6b30077460 msgr2=0x7f6b30079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6b30077460 0x7f6b30079920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b38000c00 tx=0x7f6b38031400 comp rx=0 tx=0).stop 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b481033e0 msgr2=0x7f6b4819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b481033e0 0x7f6b4819fd40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00d6d0 tx=0x7f6b3c00db90 comp rx=0 tx=0).stop 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 shutdown_connections 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6b481033e0 0x7f6b4819fd40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6b30077460 0x7f6b30079920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 --2- 172.21.15.52:0/2538616507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b48102ac0 0x7f6b4819f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 >> 172.21.15.52:0/2538616507 conn(0x7f6b480fc520 msgr2=0x7f6b48100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:48.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 shutdown_connections 2024-09-06T14:57:48.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.356+0000 7f6b4cd69640 1 -- 172.21.15.52:0/2538616507 wait complete. 2024-09-06T14:57:48.363 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:57:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3974378817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac1033e0 msgr2=0x7f0eac10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3974378817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac1033e0 0x7f0eac10b8d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009880 tx=0x7f0ea002a530 comp rx=0 tx=0).stop 2024-09-06T14:57:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3974378817 shutdown_connections 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3974378817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac1033e0 0x7f0eac10b8d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3974378817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eac102ac0 0x7f0eac102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3974378817 >> 172.21.15.52:0/3974378817 conn(0x7f0eac0fc520 msgr2=0x7f0eac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3974378817 shutdown_connections 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.440+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3974378817 wait complete. 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eb1efd640 1 Processor -- start 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eb1efd640 1 -- start start 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eb1efd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac102ac0 0x7f0eac19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eb1efd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eac1033e0 0x7f0eac19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eb1efd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac10edd0 con 0x7f0eac102ac0 2024-09-06T14:57:48.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eb1efd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0eac10ec50 con 0x7f0eac1033e0 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac102ac0 0x7f0eac19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac102ac0 0x7f0eac19f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58914/0 (socket says 172.21.15.52:58914) 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.441+0000 7f0eab7fe640 1 -- 172.21.15.52:0/3123976358 learned_addr learned my addr 172.21.15.52:0/3123976358 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0eaaffd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eac1033e0 0x7f0eac19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0eab7fe640 1 -- 172.21.15.52:0/3123976358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eac1033e0 msgr2=0x7f0eac19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0eab7fe640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eac1033e0 0x7f0eac19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0eab7fe640 1 -- 172.21.15.52:0/3123976358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eac1a03e0 con 0x7f0eac102ac0 2024-09-06T14:57:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0eab7fe640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac102ac0 0x7f0eac19f7f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00c8a0 tx=0x7f0e9c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0ea8ff9640 1 -- 172.21.15.52:0/3123976358 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e9c0079b0 con 0x7f0eac102ac0 2024-09-06T14:57:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eac199ad0 con 0x7f0eac102ac0 2024-09-06T14:57:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0ea8ff9640 1 -- 172.21.15.52:0/3123976358 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e9c007b50 con 0x7f0eac102ac0 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0ea8ff9640 1 -- 172.21.15.52:0/3123976358 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e9c018700 con 0x7f0eac102ac0 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.442+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eac19a030 con 0x7f0eac102ac0 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.443+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eac06aa90 con 0x7f0eac102ac0 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.444+0000 7f0ea8ff9640 1 -- 172.21.15.52:0/3123976358 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0e9c00f450 con 0x7f0eac102ac0 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.444+0000 7f0ea8ff9640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0e94077460 0x7f0e94079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.445+0000 7f0eaaffd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0e94077460 0x7f0e94079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.445+0000 7f0ea8ff9640 1 -- 172.21.15.52:0/3123976358 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0e9c099aa0 con 0x7f0eac102ac0 2024-09-06T14:57:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.445+0000 7f0eaaffd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0e94077460 0x7f0e94079920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eac19b1a0 tx=0x7f0ea0009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.449+0000 7f0ea8ff9640 1 -- 172.21.15.52:0/3123976358 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0e9c014030 con 0x7f0eac102ac0 2024-09-06T14:57:48.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.626+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0eac19aff0 con 0x7f0e94077460 2024-09-06T14:57:48.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.627+0000 7f0ea8ff9640 1 -- 172.21.15.52:0/3123976358 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0eac19aff0 con 0x7f0e94077460 2024-09-06T14:57:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0e94077460 msgr2=0x7f0e94079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0e94077460 0x7f0e94079920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eac19b1a0 tx=0x7f0ea0009560 comp rx=0 tx=0).stop 2024-09-06T14:57:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac102ac0 msgr2=0x7f0eac19f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac102ac0 0x7f0eac19f7f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00c8a0 tx=0x7f0e9c00cd60 comp rx=0 tx=0).stop 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 shutdown_connections 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0e94077460 0x7f0e94079920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0eac1033e0 0x7f0eac19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 --2- 172.21.15.52:0/3123976358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0eac102ac0 0x7f0eac19f7f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 >> 172.21.15.52:0/3123976358 conn(0x7f0eac0fc520 msgr2=0x7f0eac100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 shutdown_connections 2024-09-06T14:57:48.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.629+0000 7f0eb1efd640 1 -- 172.21.15.52:0/3123976358 wait complete. 2024-09-06T14:57:48.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.712+0000 7fca18f2e640 1 -- 172.21.15.52:0/2973688856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 msgr2=0x7fca14100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.712+0000 7fca18f2e640 1 --2- 172.21.15.52:0/2973688856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca14100c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fca08009880 tx=0x7fca0802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.713+0000 7fca18f2e640 1 -- 172.21.15.52:0/2973688856 shutdown_connections 2024-09-06T14:57:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.713+0000 7fca18f2e640 1 --2- 172.21.15.52:0/2973688856 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca14100c50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.713+0000 7fca18f2e640 1 --2- 172.21.15.52:0/2973688856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca141067f0 0x7fca14106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.713+0000 7fca18f2e640 1 -- 172.21.15.52:0/2973688856 >> 172.21.15.52:0/2973688856 conn(0x7fca140fc550 msgr2=0x7fca140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.713+0000 7fca18f2e640 1 -- 172.21.15.52:0/2973688856 shutdown_connections 2024-09-06T14:57:48.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.713+0000 7fca18f2e640 1 -- 172.21.15.52:0/2973688856 wait complete. 2024-09-06T14:57:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.713+0000 7fca18f2e640 1 Processor -- start 2024-09-06T14:57:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca18f2e640 1 -- start start 2024-09-06T14:57:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca18f2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca1419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca18f2e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca141067f0 0x7fca1419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca18f2e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fca1410dcc0 con 0x7fca141007f0 2024-09-06T14:57:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca18f2e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca1410db40 con 0x7fca141067f0 2024-09-06T14:57:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca1419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca1259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca1419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58928/0 (socket says 172.21.15.52:58928) 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca1259c640 1 -- 172.21.15.52:0/1791004001 learned_addr learned my addr 172.21.15.52:0/1791004001 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca11d9b640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca141067f0 0x7fca1419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca1259c640 1 -- 172.21.15.52:0/1791004001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca141067f0 msgr2=0x7fca1419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca1259c640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca141067f0 0x7fca1419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.714+0000 7fca1259c640 1 -- 172.21.15.52:0/1791004001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca141977e0 con 0x7fca141007f0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.715+0000 7fca1259c640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca1419d660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d6f0 tx=0x7fca0400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.715+0000 7fca037fe640 1 -- 172.21.15.52:0/1791004001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca04017070 con 0x7fca141007f0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.715+0000 7fca037fe640 1 -- 172.21.15.52:0/1791004001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca0400de00 con 0x7fca141007f0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.715+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca14197ad0 con 0x7fca141007f0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.715+0000 7fca037fe640 1 -- 172.21.15.52:0/1791004001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca04004bb0 con 0x7fca141007f0 2024-09-06T14:57:48.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.715+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca14198030 con 0x7fca141007f0 2024-09-06T14:57:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.716+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f4005290 con 0x7fca141007f0 2024-09-06T14:57:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.717+0000 7fca037fe640 1 -- 172.21.15.52:0/1791004001 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fca040053d0 con 0x7fca141007f0 2024-09-06T14:57:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.717+0000 7fca037fe640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9fc077460 0x7fc9fc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.717+0000 7fca037fe640 1 -- 172.21.15.52:0/1791004001 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fca040992d0 con 0x7fca141007f0 2024-09-06T14:57:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.717+0000 7fca11d9b640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9fc077460 0x7fc9fc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.718+0000 7fca11d9b640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9fc077460 0x7fc9fc079920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca14198b30 tx=0x7fca08031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.721+0000 7fca037fe640 1 -- 172.21.15.52:0/1791004001 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fca040663a0 con 0x7fca141007f0 2024-09-06T14:57:48.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.890+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc9f4000bc0 con 0x7fc9fc077460 2024-09-06T14:57:48.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.899+0000 7fca037fe640 1 -- 172.21.15.52:0/1791004001 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc9f4000bc0 con 0x7fc9fc077460 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (10m) 4m ago 21m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (13m) 4m ago 21m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (12m) 4m ago 20m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (8m) 4m ago 21m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (8m) 4m ago 20m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (9m) 4m ago 20m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (4m) 4m ago 15m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:57:48.898 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (4m) 4m ago 15m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (4m) 4m ago 15m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (4m) 4m ago 15m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (12m) 4m ago 22m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (11m) 4m ago 20m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (8m) 4m ago 22m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (8m) 4m ago 20m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (11m) 4m ago 21m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (10m) 4m ago 20m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (8m) 4m ago 19m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (7m) 4m ago 18m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (6m) 4m ago 18m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:57:48.899 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (6m) 4m ago 17m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:57:48.900 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (5m) 4m ago 17m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:57:48.900 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (5m) 4m ago 16m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:57:48.900 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (10m) 4m ago 20m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:57:48.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9fc077460 msgr2=0x7fc9fc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9fc077460 0x7fc9fc079920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fca14198b30 tx=0x7fca08031400 comp rx=0 tx=0).stop 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 msgr2=0x7fca1419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca1419d660 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fca0400d6f0 tx=0x7fca0400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 shutdown_connections 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9fc077460 0x7fc9fc079920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca141067f0 0x7fca1419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 --2- 172.21.15.52:0/1791004001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fca141007f0 0x7fca1419d660 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.901+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 >> 172.21.15.52:0/1791004001 conn(0x7fca140fc550 msgr2=0x7fca14069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.902+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 shutdown_connections 2024-09-06T14:57:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.902+0000 7fca18f2e640 1 -- 172.21.15.52:0/1791004001 wait complete. 2024-09-06T14:57:48.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 -- 172.21.15.52:0/1674400146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0107900 msgr2=0x7fb5d0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/1674400146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0107900 0x7fb5d0107ce0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009880 tx=0x7fb5c002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 -- 172.21.15.52:0/1674400146 shutdown_connections 2024-09-06T14:57:48.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/1674400146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5d0101900 0x7fb5d0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/1674400146 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0107900 0x7fb5d0107ce0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 -- 172.21.15.52:0/1674400146 >> 172.21.15.52:0/1674400146 conn(0x7fb5d00fd600 msgr2=0x7fb5d00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:48.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 -- 172.21.15.52:0/1674400146 shutdown_connections 2024-09-06T14:57:48.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.983+0000 7fb5d5aac640 1 -- 172.21.15.52:0/1674400146 wait complete. 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.984+0000 7fb5d5aac640 1 Processor -- start 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.984+0000 7fb5d5aac640 1 -- start start 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.984+0000 7fb5d5aac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0101900 0x7fb5d00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.984+0000 7fb5d5aac640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5d0107900 0x7fb5d0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.984+0000 7fb5d5aac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d010ee30 con 0x7fb5d0101900 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.984+0000 7fb5d5aac640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d010ecb0 con 0x7fb5d0107900 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0101900 0x7fb5d00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5cf7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0101900 0x7fb5d00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58944/0 (socket says 172.21.15.52:58944) 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5cf7fe640 1 -- 172.21.15.52:0/2723242802 learned_addr learned my addr 172.21.15.52:0/2723242802 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:48.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5ceffd640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5d0107900 0x7fb5d0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5cf7fe640 1 -- 172.21.15.52:0/2723242802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5d0107900 msgr2=0x7fb5d0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5cf7fe640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5d0107900 0x7fb5d0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5cf7fe640 1 -- 172.21.15.52:0/2723242802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d0074f70 con 0x7fb5d0101900 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5cf7fe640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0101900 0x7fb5d00744f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0031460 tx=0x7fb5c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5ccff9640 1 -- 172.21.15.52:0/2723242802 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5c003f070 con 0x7fb5d0101900 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5ccff9640 1 -- 172.21.15.52:0/2723242802 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5c0004cf0 con 0x7fb5d0101900 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d0075200 con 0x7fb5d0101900 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.985+0000 7fb5ccff9640 1 -- 172.21.15.52:0/2723242802 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb5c0035030 con 0x7fb5d0101900 2024-09-06T14:57:48.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.986+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d01a3e40 con 0x7fb5d0101900 2024-09-06T14:57:48.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.987+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d0103040 con 0x7fb5d0101900 2024-09-06T14:57:48.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.987+0000 7fb5ccff9640 1 -- 172.21.15.52:0/2723242802 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb5c0042070 con 0x7fb5d0101900 2024-09-06T14:57:48.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.988+0000 7fb5ccff9640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb5b8077460 0x7fb5b8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:48.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.988+0000 7fb5ccff9640 1 -- 172.21.15.52:0/2723242802 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fb5c00ba230 con 0x7fb5d0101900 2024-09-06T14:57:48.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.988+0000 7fb5ceffd640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb5b8077460 0x7fb5b8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.989+0000 7fb5ceffd640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb5b8077460 0x7fb5b8079920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0075f80 tx=0x7fb5c4009110 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:48.992+0000 7fb5ccff9640 1 -- 172.21.15.52:0/2723242802 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb5c0083190 con 0x7fb5d0101900 2024-09-06T14:57:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.212+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb5d0075a20 con 0x7fb5d0101900 2024-09-06T14:57:49.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.213+0000 7fb5ccff9640 1 -- 172.21.15.52:0/2723242802 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb5c0087300 con 0x7fb5d0101900 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:49.212 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:57:49.213 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:57:49.213 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:57:49.213 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:57:49.213 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:57:49.213 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:57:49.213 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:57:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb5b8077460 msgr2=0x7fb5b8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb5b8077460 0x7fb5b8079920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0075f80 tx=0x7fb5c4009110 comp rx=0 tx=0).stop 2024-09-06T14:57:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0101900 msgr2=0x7fb5d00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0101900 0x7fb5d00744f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0031460 tx=0x7fb5c00048f0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 shutdown_connections 2024-09-06T14:57:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb5b8077460 0x7fb5b8079920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb5d0107900 0x7fb5d0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 --2- 172.21.15.52:0/2723242802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb5d0101900 0x7fb5d00744f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 >> 172.21.15.52:0/2723242802 conn(0x7fb5d00fd600 msgr2=0x7fb5d00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 shutdown_connections 2024-09-06T14:57:49.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.216+0000 7fb5d5aac640 1 -- 172.21.15.52:0/2723242802 wait complete. 2024-09-06T14:57:49.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 -- 172.21.15.52:0/2780353835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 msgr2=0x7f1f0c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 --2- 172.21.15.52:0/2780353835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c106bd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009880 tx=0x7f1efc02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 -- 172.21.15.52:0/2780353835 shutdown_connections 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 --2- 172.21.15.52:0/2780353835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c1007f0 0x7f1f0c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 --2- 172.21.15.52:0/2780353835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c106bd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 -- 172.21.15.52:0/2780353835 >> 172.21.15.52:0/2780353835 conn(0x7f1f0c0fc550 msgr2=0x7f1f0c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 -- 172.21.15.52:0/2780353835 shutdown_connections 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 -- 172.21.15.52:0/2780353835 wait complete. 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 Processor -- start 2024-09-06T14:57:49.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.299+0000 7f1f12d16640 1 -- start start 2024-09-06T14:57:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f12d16640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c1007f0 0x7f1f0c0fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f12d16640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c0fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f12d16640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c10dcc0 con 0x7f1f0c1067f0 2024-09-06T14:57:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f12d16640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c10db40 con 0x7f1f0c1007f0 2024-09-06T14:57:49.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c0fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c0fd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58960/0 (socket says 172.21.15.52:58960) 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f0bfff640 1 -- 172.21.15.52:0/1718331833 learned_addr learned my addr 172.21.15.52:0/1718331833 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f10ab2640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c1007f0 0x7f1f0c0fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f0bfff640 1 -- 172.21.15.52:0/1718331833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c1007f0 msgr2=0x7f1f0c0fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f0bfff640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c1007f0 0x7f1f0c0fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f0bfff640 1 -- 172.21.15.52:0/1718331833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0fd770 con 0x7f1f0c1067f0 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f10ab2640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c1007f0 0x7f1f0c0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f0bfff640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c0fd230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000d6f0 tx=0x7f1f0000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:49.301 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.300+0000 7f1f09ffb640 1 -- 172.21.15.52:0/1718331833 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f00017070 con 0x7f1f0c1067f0 2024-09-06T14:57:49.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.301+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c0fda60 con 0x7f1f0c1067f0 2024-09-06T14:57:49.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.301+0000 7f1f09ffb640 1 -- 172.21.15.52:0/1718331833 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f0000de00 con 0x7f1f0c1067f0 2024-09-06T14:57:49.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.301+0000 7f1f09ffb640 1 -- 172.21.15.52:0/1718331833 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f00004bb0 con 0x7f1f0c1067f0 2024-09-06T14:57:49.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.301+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c1a3e30 con 0x7f1f0c1067f0 2024-09-06T14:57:49.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.302+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c101f30 con 0x7f1f0c1067f0 2024-09-06T14:57:49.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.302+0000 7f1f09ffb640 1 -- 172.21.15.52:0/1718331833 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1f00009a30 con 0x7f1f0c1067f0 2024-09-06T14:57:49.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.303+0000 7f1f09ffb640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1ef40774b0 0x7f1ef4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.303+0000 7f1f09ffb640 1 -- 172.21.15.52:0/1718331833 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1f00099330 con 0x7f1f0c1067f0 2024-09-06T14:57:49.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.303+0000 7f1f10ab2640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1ef40774b0 0x7f1ef4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.303+0000 7f1f10ab2640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1ef40774b0 0x7f1ef4079970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000c00 tx=0x7f1efc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:49.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.307+0000 7f1f09ffb640 1 -- 172.21.15.52:0/1718331833 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1f00062310 con 0x7f1f0c1067f0 2024-09-06T14:57:49.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.493+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1f0c109d70 con 0x7f1f0c1067f0 2024-09-06T14:57:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.493+0000 7f1f09ffb640 1 -- 172.21.15.52:0/1718331833 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f1f00066480 con 0x7f1f0c1067f0 2024-09-06T14:57:49.492 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:57:49.492 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:57:49.492 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:57:49.492 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:57:49.492 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:57:49.492 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:57:49.493 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:57:49.494 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:49.495 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:57:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:57:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.495+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1ef40774b0 msgr2=0x7f1ef4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.495+0000 7f1f12d16640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1ef40774b0 0x7f1ef4079970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1efc000c00 tx=0x7f1efc031400 comp rx=0 tx=0).stop 2024-09-06T14:57:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.495+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 msgr2=0x7f1f0c0fd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.495+0000 7f1f12d16640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c0fd230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000d6f0 tx=0x7f1f0000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.495+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 shutdown_connections 2024-09-06T14:57:49.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.496+0000 7f1f12d16640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f0c1067f0 0x7f1f0c0fd230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.496+0000 7f1f12d16640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1ef40774b0 0x7f1ef4079970 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.496+0000 7f1f12d16640 1 --2- 172.21.15.52:0/1718331833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f0c1007f0 0x7f1f0c0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.496+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 >> 172.21.15.52:0/1718331833 conn(0x7f1f0c0fc550 msgr2=0x7f1f0c069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:49.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.496+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 shutdown_connections 2024-09-06T14:57:49.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.496+0000 7f1f12d16640 1 -- 172.21.15.52:0/1718331833 wait complete. 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 -- 172.21.15.52:0/4100554240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 msgr2=0x7f244c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 --2- 172.21.15.52:0/4100554240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c102ea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f243c009880 tx=0x7f243c02a530 comp rx=0 tx=0).stop 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 -- 172.21.15.52:0/4100554240 shutdown_connections 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 --2- 172.21.15.52:0/4100554240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f244c1033e0 0x7f244c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 --2- 172.21.15.52:0/4100554240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c102ea0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 -- 172.21.15.52:0/4100554240 >> 172.21.15.52:0/4100554240 conn(0x7f244c0fc520 msgr2=0x7f244c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 -- 172.21.15.52:0/4100554240 shutdown_connections 2024-09-06T14:57:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.579+0000 7f2451fd7640 1 -- 172.21.15.52:0/4100554240 wait complete. 2024-09-06T14:57:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.580+0000 7f2451fd7640 1 Processor -- start 2024-09-06T14:57:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.580+0000 7f2451fd7640 1 -- start start 2024-09-06T14:57:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.580+0000 7f2451fd7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.580+0000 7f2451fd7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f244c1033e0 0x7f244c19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.580+0000 7f2451fd7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f244c10edd0 con 0x7f244c102ac0 2024-09-06T14:57:49.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.580+0000 7f2451fd7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f244c10ec50 con 0x7f244c1033e0 2024-09-06T14:57:49.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58974/0 (socket says 172.21.15.52:58974) 2024-09-06T14:57:49.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244b7fe640 1 -- 172.21.15.52:0/1296488398 learned_addr learned my addr 172.21.15.52:0/1296488398 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:49.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244affd640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f244c1033e0 0x7f244c19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244b7fe640 1 -- 172.21.15.52:0/1296488398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f244c1033e0 msgr2=0x7f244c19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244b7fe640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f244c1033e0 0x7f244c19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244b7fe640 1 -- 172.21.15.52:0/1296488398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244c1a03f0 con 0x7f244c102ac0 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244affd640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f244c1033e0 0x7f244c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f244b7fe640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c19f800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f243c031460 tx=0x7f243c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f2448ff9640 1 -- 172.21.15.52:0/1296488398 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f243c03f070 con 0x7f244c102ac0 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244c199a80 con 0x7f244c102ac0 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f2448ff9640 1 -- 172.21.15.52:0/1296488398 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f243c004cf0 con 0x7f244c102ac0 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f2448ff9640 1 -- 172.21.15.52:0/1296488398 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f243c035030 con 0x7f244c102ac0 2024-09-06T14:57:49.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.581+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244c199f80 con 0x7f244c102ac0 2024-09-06T14:57:49.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.582+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244c06aa90 con 0x7f244c102ac0 2024-09-06T14:57:49.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.583+0000 7f2448ff9640 1 -- 172.21.15.52:0/1296488398 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f243c042070 con 0x7f244c102ac0 2024-09-06T14:57:49.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.584+0000 7f2448ff9640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24340774b0 0x7f2434079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.584+0000 7f2448ff9640 1 -- 172.21.15.52:0/1296488398 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f243c0ba1c0 con 0x7f244c102ac0 2024-09-06T14:57:49.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.584+0000 7f244affd640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24340774b0 0x7f2434079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.584+0000 7f244affd640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24340774b0 0x7f2434079970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2440005e10 tx=0x7f2440005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:49.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.588+0000 7f2448ff9640 1 -- 172.21.15.52:0/1296488398 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f243c0831a0 con 0x7f244c102ac0 2024-09-06T14:57:49.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.765+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f244c19b000 con 0x7f24340774b0 2024-09-06T14:57:49.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.766+0000 7f2448ff9640 1 -- 172.21.15.52:0/1296488398 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f244c19b000 con 0x7f24340774b0 2024-09-06T14:57:49.764 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:57:49.764 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:57:49.764 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:57:49.765 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:57:49.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24340774b0 msgr2=0x7f2434079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24340774b0 0x7f2434079970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2440005e10 tx=0x7f2440005da0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 msgr2=0x7f244c19f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c19f800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f243c031460 tx=0x7f243c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 shutdown_connections 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24340774b0 0x7f2434079970 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f244c1033e0 0x7f244c19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 --2- 172.21.15.52:0/1296488398 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f244c102ac0 0x7f244c19f800 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 >> 172.21.15.52:0/1296488398 conn(0x7f244c0fc520 msgr2=0x7f244c100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 shutdown_connections 2024-09-06T14:57:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.768+0000 7f2451fd7640 1 -- 172.21.15.52:0/1296488398 wait complete. 2024-09-06T14:57:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 -- 172.21.15.52:0/2129842599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c107900 msgr2=0x7f737c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 --2- 172.21.15.52:0/2129842599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c107900 0x7f737c107ce0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f736c009880 tx=0x7f736c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 -- 172.21.15.52:0/2129842599 shutdown_connections 2024-09-06T14:57:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 --2- 172.21.15.52:0/2129842599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f737c101900 0x7f737c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 --2- 172.21.15.52:0/2129842599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c107900 0x7f737c107ce0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 -- 172.21.15.52:0/2129842599 >> 172.21.15.52:0/2129842599 conn(0x7f737c0fd600 msgr2=0x7f737c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:49.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 -- 172.21.15.52:0/2129842599 shutdown_connections 2024-09-06T14:57:49.852 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:49 smithi052 ceph-mon[112917]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:49.852 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:49 smithi052 ceph-mon[112917]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:49.852 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:49 smithi052 ceph-mon[112917]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:49.852 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:49 smithi052 ceph-mon[112917]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:49.852 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:49 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2723242802' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:57:49.852 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:49 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1718331833' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.852+0000 7f7381ac5640 1 -- 172.21.15.52:0/2129842599 wait complete. 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f7381ac5640 1 Processor -- start 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f7381ac5640 1 -- start start 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f7381ac5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c101900 0x7f737c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f7381ac5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f737c107900 0x7f737c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f7381ac5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f737c10edd0 con 0x7f737c101900 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f7381ac5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f737c10ec50 con 0x7f737c107900 2024-09-06T14:57:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f737b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c101900 0x7f737c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f737b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c101900 0x7f737c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58988/0 (socket says 172.21.15.52:58988) 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.853+0000 7f737b7fe640 1 -- 172.21.15.52:0/3717060784 learned_addr learned my addr 172.21.15.52:0/3717060784 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f7373fff640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f737c107900 0x7f737c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f737b7fe640 1 -- 172.21.15.52:0/3717060784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f737c107900 msgr2=0x7f737c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f737b7fe640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f737c107900 0x7f737c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f737b7fe640 1 -- 172.21.15.52:0/3717060784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c074f70 con 0x7f737c101900 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f737b7fe640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c101900 0x7f737c0744f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f736c031460 tx=0x7f736c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f73797fa640 1 -- 172.21.15.52:0/3717060784 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f736c03f070 con 0x7f737c101900 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f73797fa640 1 -- 172.21.15.52:0/3717060784 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f736c0035f0 con 0x7f737c101900 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c075200 con 0x7f737c101900 2024-09-06T14:57:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f73797fa640 1 -- 172.21.15.52:0/3717060784 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f736c035030 con 0x7f737c101900 2024-09-06T14:57:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.854+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c1a3d60 con 0x7f737c101900 2024-09-06T14:57:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.855+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c103040 con 0x7f737c101900 2024-09-06T14:57:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.856+0000 7f73797fa640 1 -- 172.21.15.52:0/3717060784 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f736c042070 con 0x7f737c101900 2024-09-06T14:57:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.857+0000 7f73797fa640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7368077460 0x7f7368079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:57:49.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.857+0000 7f7373fff640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7368077460 0x7f7368079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:57:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.857+0000 7f73797fa640 1 -- 172.21.15.52:0/3717060784 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f736c0ba170 con 0x7f737c101900 2024-09-06T14:57:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.857+0000 7f7373fff640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7368077460 0x7f7368079920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7364005fd0 tx=0x7f7364005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:57:49.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:49.861+0000 7f73797fa640 1 -- 172.21.15.52:0/3717060784 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f736c0830d0 con 0x7f737c101900 2024-09-06T14:57:50.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:49 smithi165 ceph-mon[82925]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:50.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:49 smithi165 ceph-mon[82925]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:50.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:49 smithi165 ceph-mon[82925]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:50.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:49 smithi165 ceph-mon[82925]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:50.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:49 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2723242802' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:57:50.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:49 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1718331833' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:57:50.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.081+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f737c075a20 con 0x7f737c101900 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.081+0000 7f73797fa640 1 -- 172.21.15.52:0/3717060784 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f736c087240 con 0x7f737c101900 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:57:50.080 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:57:50.081 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:57:50.081 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:57:50.081 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:57:50.081 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:57:50.081 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:57:50.081 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:57:50.081 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:57:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.083+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7368077460 msgr2=0x7f7368079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.083+0000 7f7381ac5640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7368077460 0x7f7368079920 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7364005fd0 tx=0x7f7364005850 comp rx=0 tx=0).stop 2024-09-06T14:57:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.083+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c101900 msgr2=0x7f737c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:57:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.083+0000 7f7381ac5640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c101900 0x7f737c0744f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f736c031460 tx=0x7f736c0045e0 comp rx=0 tx=0).stop 2024-09-06T14:57:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.084+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 shutdown_connections 2024-09-06T14:57:50.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.084+0000 7f7381ac5640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7368077460 0x7f7368079920 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.084+0000 7f7381ac5640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f737c107900 0x7f737c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.084+0000 7f7381ac5640 1 --2- 172.21.15.52:0/3717060784 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f737c101900 0x7f737c0744f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:57:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.084+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 >> 172.21.15.52:0/3717060784 conn(0x7f737c0fd600 msgr2=0x7f737c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:57:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.084+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 shutdown_connections 2024-09-06T14:57:50.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:57:50.084+0000 7f7381ac5640 1 -- 172.21.15.52:0/3717060784 wait complete. 2024-09-06T14:57:51.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:50 smithi165 ceph-mon[82925]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:51.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:50 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3717060784' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:57:51.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:50 smithi052 ceph-mon[112917]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:57:51.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:50 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3717060784' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:57:52.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:51 smithi165 ceph-mon[82925]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:52.119 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:51 smithi052 ceph-mon[112917]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:53.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:53.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:57:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:53 smithi165 ceph-mon[82925]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:54.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:53 smithi052 ceph-mon[112917]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:55.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:55 smithi052 ceph-mon[112917]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:56.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:55 smithi165 ceph-mon[82925]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:58.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:57 smithi165 ceph-mon[82925]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:57:58.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:57 smithi052 ceph-mon[112917]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:00.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:57:59 smithi165 ceph-mon[82925]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:00.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:57:59 smithi052 ceph-mon[112917]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:02.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:01 smithi165 ceph-mon[82925]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:02.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:01 smithi052 ceph-mon[112917]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:04.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:03 smithi165 ceph-mon[82925]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:04.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:03 smithi052 ceph-mon[112917]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:05.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:05 smithi052 ceph-mon[112917]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:06.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:05 smithi165 ceph-mon[82925]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:08.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:07 smithi165 ceph-mon[82925]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:08.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:08.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:07 smithi052 ceph-mon[112917]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:08.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:10.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:09 smithi165 ceph-mon[82925]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:09 smithi052 ceph-mon[112917]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:12.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:11 smithi165 ceph-mon[82925]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:12.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:11 smithi052 ceph-mon[112917]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:14.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:13 smithi165 ceph-mon[82925]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:14.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:13 smithi052 ceph-mon[112917]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:15.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:15 smithi052 ceph-mon[112917]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:16.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:15 smithi165 ceph-mon[82925]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:17.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:17 smithi165 ceph-mon[82925]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:17.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:17 smithi052 ceph-mon[112917]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:20.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:19 smithi165 ceph-mon[82925]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:20.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:19 smithi052 ceph-mon[112917]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:20.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 -- 172.21.15.52:0/37183278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 msgr2=0x7fee4010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 --2- 172.21.15.52:0/37183278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4010b8c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee34009880 tx=0x7fee3402a530 comp rx=0 tx=0).stop 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 -- 172.21.15.52:0/37183278 shutdown_connections 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 --2- 172.21.15.52:0/37183278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4010b8c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 --2- 172.21.15.52:0/37183278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee40102ab0 0x7fee40102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 -- 172.21.15.52:0/37183278 >> 172.21.15.52:0/37183278 conn(0x7fee400fc550 msgr2=0x7fee400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 -- 172.21.15.52:0/37183278 shutdown_connections 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 -- 172.21.15.52:0/37183278 wait complete. 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.181+0000 7fee45b48640 1 Processor -- start 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee45b48640 1 -- start start 2024-09-06T14:58:20.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee45b48640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee40102ab0 0x7fee4019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee45b48640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee45b48640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fee4010ede0 con 0x7fee401033d0 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee45b48640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee4010ec60 con 0x7fee40102ab0 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47060/0 (socket says 172.21.15.52:47060) 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3effd640 1 -- 172.21.15.52:0/2046572514 learned_addr learned my addr 172.21.15.52:0/2046572514 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee40102ab0 0x7fee4019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3effd640 1 -- 172.21.15.52:0/2046572514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee40102ab0 msgr2=0x7fee4019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3effd640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee40102ab0 0x7fee4019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3effd640 1 -- 172.21.15.52:0/2046572514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee40197810 con 0x7fee401033d0 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.182+0000 7fee3effd640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4019dbd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fee34031460 tx=0x7fee340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:20.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.183+0000 7fee3cff9640 1 -- 172.21.15.52:0/2046572514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee3403f070 con 0x7fee401033d0 2024-09-06T14:58:20.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.183+0000 7fee3cff9640 1 -- 172.21.15.52:0/2046572514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee34004ac0 con 0x7fee401033d0 2024-09-06T14:58:20.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.183+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee40197aa0 con 0x7fee401033d0 2024-09-06T14:58:20.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.183+0000 7fee3cff9640 1 -- 172.21.15.52:0/2046572514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee34035030 con 0x7fee401033d0 2024-09-06T14:58:20.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.183+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee40197fd0 con 0x7fee401033d0 2024-09-06T14:58:20.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.184+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee4006a580 con 0x7fee401033d0 2024-09-06T14:58:20.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.185+0000 7fee3cff9640 1 -- 172.21.15.52:0/2046572514 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fee34042070 con 0x7fee401033d0 2024-09-06T14:58:20.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.185+0000 7fee3cff9640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fee280774b0 0x7fee28079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.185+0000 7fee3cff9640 1 -- 172.21.15.52:0/2046572514 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fee340ba100 con 0x7fee401033d0 2024-09-06T14:58:20.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.185+0000 7fee3f7fe640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fee280774b0 0x7fee28079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.186+0000 7fee3f7fe640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fee280774b0 0x7fee28079970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee300058c0 tx=0x7fee3000a250 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:20.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.190+0000 7fee3cff9640 1 -- 172.21.15.52:0/2046572514 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fee340871b0 con 0x7fee401033d0 2024-09-06T14:58:20.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.369+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fee40198340 con 0x7fee280774b0 2024-09-06T14:58:20.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.370+0000 7fee3cff9640 1 -- 172.21.15.52:0/2046572514 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fee40198340 con 0x7fee280774b0 2024-09-06T14:58:20.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fee280774b0 msgr2=0x7fee28079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fee280774b0 0x7fee28079970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fee300058c0 tx=0x7fee3000a250 comp rx=0 tx=0).stop 2024-09-06T14:58:20.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 msgr2=0x7fee4019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4019dbd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fee34031460 tx=0x7fee340046c0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 shutdown_connections 2024-09-06T14:58:20.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee401033d0 0x7fee4019dbd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fee280774b0 0x7fee28079970 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 --2- 172.21.15.52:0/2046572514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee40102ab0 0x7fee4019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.372+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 >> 172.21.15.52:0/2046572514 conn(0x7fee400fc550 msgr2=0x7fee40108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:20.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.373+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 shutdown_connections 2024-09-06T14:58:20.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.373+0000 7fee45b48640 1 -- 172.21.15.52:0/2046572514 wait complete. 2024-09-06T14:58:20.380 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:58:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.456+0000 7f13fc91e640 1 -- 172.21.15.52:0/1973018466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 msgr2=0x7f13f8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.456+0000 7f13fc91e640 1 --2- 172.21.15.52:0/1973018466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8102ea0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009c20 tx=0x7f13e802aa00 comp rx=0 tx=0).stop 2024-09-06T14:58:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.457+0000 7f13fc91e640 1 -- 172.21.15.52:0/1973018466 shutdown_connections 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.457+0000 7f13fc91e640 1 --2- 172.21.15.52:0/1973018466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13f81033e0 0x7f13f810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.457+0000 7f13fc91e640 1 --2- 172.21.15.52:0/1973018466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8102ea0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.457+0000 7f13fc91e640 1 -- 172.21.15.52:0/1973018466 >> 172.21.15.52:0/1973018466 conn(0x7f13f80fc520 msgr2=0x7f13f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.457+0000 7f13fc91e640 1 -- 172.21.15.52:0/1973018466 shutdown_connections 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.457+0000 7f13fc91e640 1 -- 172.21.15.52:0/1973018466 wait complete. 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13fc91e640 1 Processor -- start 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13fc91e640 1 -- start start 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13fc91e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13fc91e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13f81033e0 0x7f13f8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13fc91e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f13f810edf0 con 0x7f13f8102ac0 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13fc91e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13f810ec70 con 0x7f13f81033e0 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39178/0 (socket says 172.21.15.52:39178) 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13f659c640 1 -- 172.21.15.52:0/782973359 learned_addr learned my addr 172.21.15.52:0/782973359 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.458+0000 7f13f5d9b640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13f81033e0 0x7f13f8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.459+0000 7f13f659c640 1 -- 172.21.15.52:0/782973359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13f81033e0 msgr2=0x7f13f8100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.459+0000 7f13f659c640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13f81033e0 0x7f13f8100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.459+0000 7f13f659c640 1 -- 172.21.15.52:0/782973359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f81011a0 con 0x7f13f8102ac0 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.459+0000 7f13f659c640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8100720 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13e8005cc0 tx=0x7f13e802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.459+0000 7f13ef7fe640 1 -- 172.21.15.52:0/782973359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13e8047070 con 0x7f13f8102ac0 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.459+0000 7f13ef7fe640 1 -- 172.21.15.52:0/782973359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13e8003e30 con 0x7f13f8102ac0 2024-09-06T14:58:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.459+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f8101430 con 0x7f13f8102ac0 2024-09-06T14:58:20.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.460+0000 7f13ef7fe640 1 -- 172.21.15.52:0/782973359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13e8033050 con 0x7f13f8102ac0 2024-09-06T14:58:20.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.460+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f81a3d80 con 0x7f13f8102ac0 2024-09-06T14:58:20.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.461+0000 7f13ef7fe640 1 -- 172.21.15.52:0/782973359 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f13e804a070 con 0x7f13f8102ac0 2024-09-06T14:58:20.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.461+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f806aa90 con 0x7f13f8102ac0 2024-09-06T14:58:20.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.461+0000 7f13ef7fe640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f13e4077230 0x7f13e40796f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.461+0000 7f13ef7fe640 1 -- 172.21.15.52:0/782973359 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f13e803e030 con 0x7f13f8102ac0 2024-09-06T14:58:20.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.461+0000 7f13f5d9b640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f13e4077230 0x7f13e40796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.462+0000 7f13f5d9b640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f13e4077230 0x7f13e40796f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f13e0005fd0 tx=0x7f13e0005d00 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:20.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.466+0000 7f13ef7fe640 1 -- 172.21.15.52:0/782973359 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f13e8083970 con 0x7f13f8102ac0 2024-09-06T14:58:20.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.644+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f13f8101c50 con 0x7f13e4077230 2024-09-06T14:58:20.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.645+0000 7f13ef7fe640 1 -- 172.21.15.52:0/782973359 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f13f8101c50 con 0x7f13e4077230 2024-09-06T14:58:20.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f13e4077230 msgr2=0x7f13e40796f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f13e4077230 0x7f13e40796f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f13e0005fd0 tx=0x7f13e0005d00 comp rx=0 tx=0).stop 2024-09-06T14:58:20.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 msgr2=0x7f13f8100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8100720 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13e8005cc0 tx=0x7f13e802ee60 comp rx=0 tx=0).stop 2024-09-06T14:58:20.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 shutdown_connections 2024-09-06T14:58:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f13e4077230 0x7f13e40796f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f13f81033e0 0x7f13f8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 --2- 172.21.15.52:0/782973359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13f8102ac0 0x7f13f8100720 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 >> 172.21.15.52:0/782973359 conn(0x7f13f80fc520 msgr2=0x7f13f810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 shutdown_connections 2024-09-06T14:58:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.647+0000 7f13fc91e640 1 -- 172.21.15.52:0/782973359 wait complete. 2024-09-06T14:58:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.730+0000 7fd7d870e640 1 -- 172.21.15.52:0/166642166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01067f0 msgr2=0x7fd7d0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.730+0000 7fd7d870e640 1 --2- 172.21.15.52:0/166642166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01067f0 0x7fd7d0106bd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009c20 tx=0x7fd7c002a970 comp rx=0 tx=0).stop 2024-09-06T14:58:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 -- 172.21.15.52:0/166642166 shutdown_connections 2024-09-06T14:58:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 --2- 172.21.15.52:0/166642166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d01007f0 0x7fd7d0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 --2- 172.21.15.52:0/166642166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01067f0 0x7fd7d0106bd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.729 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 -- 172.21.15.52:0/166642166 >> 172.21.15.52:0/166642166 conn(0x7fd7d00fc550 msgr2=0x7fd7d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:20.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 -- 172.21.15.52:0/166642166 shutdown_connections 2024-09-06T14:58:20.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 -- 172.21.15.52:0/166642166 wait complete. 2024-09-06T14:58:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 Processor -- start 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 -- start start 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.731+0000 7fd7d870e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01007f0 0x7fd7d019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d870e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d01067f0 0x7fd7d019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d870e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010dcc0 con 0x7fd7d01007f0 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d870e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010db40 con 0x7fd7d01067f0 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d64aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01007f0 0x7fd7d019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d64aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01007f0 0x7fd7d019f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39194/0 (socket says 172.21.15.52:39194) 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d64aa640 1 -- 172.21.15.52:0/3814151917 learned_addr learned my addr 172.21.15.52:0/3814151917 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d5ca9640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d01067f0 0x7fd7d019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d64aa640 1 -- 172.21.15.52:0/3814151917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d01067f0 msgr2=0x7fd7d019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d64aa640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d01067f0 0x7fd7d019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d64aa640 1 -- 172.21.15.52:0/3814151917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d01999d0 con 0x7fd7d01007f0 2024-09-06T14:58:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d64aa640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01007f0 0x7fd7d019f810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd7c002ae90 tx=0x7fd7c002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7cf7fe640 1 -- 172.21.15.52:0/3814151917 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7c0047070 con 0x7fd7d01007f0 2024-09-06T14:58:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7cf7fe640 1 -- 172.21.15.52:0/3814151917 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd7c002f7e0 con 0x7fd7d01007f0 2024-09-06T14:58:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d0199c60 con 0x7fd7d01007f0 2024-09-06T14:58:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.732+0000 7fd7cf7fe640 1 -- 172.21.15.52:0/3814151917 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7c0034070 con 0x7fd7d01007f0 2024-09-06T14:58:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.733+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d019a190 con 0x7fd7d01007f0 2024-09-06T14:58:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.734+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d0101f30 con 0x7fd7d01007f0 2024-09-06T14:58:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.734+0000 7fd7cf7fe640 1 -- 172.21.15.52:0/3814151917 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd7c004a070 con 0x7fd7d01007f0 2024-09-06T14:58:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.734+0000 7fd7cf7fe640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7b8077460 0x7fd7b8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:20.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.735+0000 7fd7cf7fe640 1 -- 172.21.15.52:0/3814151917 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd7c00ba570 con 0x7fd7d01007f0 2024-09-06T14:58:20.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.735+0000 7fd7d5ca9640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7b8077460 0x7fd7b8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:20.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.735+0000 7fd7d5ca9640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7b8077460 0x7fd7b8079920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4005fd0 tx=0x7fd7c4005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.739+0000 7fd7cf7fe640 1 -- 172.21.15.52:0/3814151917 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd7c003f070 con 0x7fd7d01007f0 2024-09-06T14:58:20.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.910+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd7d019a440 con 0x7fd7b8077460 2024-09-06T14:58:20.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.919+0000 7fd7cf7fe640 1 -- 172.21.15.52:0/3814151917 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd7d019a440 con 0x7fd7b8077460 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (10m) 5m ago 21m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (13m) 5m ago 21m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (13m) 4m ago 21m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (9m) 5m ago 21m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (8m) 4m ago 20m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (10m) 5m ago 21m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (5m) 5m ago 16m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:58:20.918 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (5m) 5m ago 16m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (4m) 4m ago 16m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (4m) 4m ago 16m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (12m) 5m ago 22m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (11m) 4m ago 20m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (9m) 5m ago 22m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (9m) 4m ago 20m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (11m) 5m ago 21m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (11m) 4m ago 20m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (8m) 5m ago 19m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (8m) 5m ago 19m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (7m) 5m ago 18m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:58:20.919 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (6m) 4m ago 18m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:58:20.920 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (6m) 4m ago 17m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:58:20.920 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (5m) 4m ago 17m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:58:20.920 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (11m) 5m ago 21m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7b8077460 msgr2=0x7fd7b8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7b8077460 0x7fd7b8079920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4005fd0 tx=0x7fd7c4005850 comp rx=0 tx=0).stop 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01007f0 msgr2=0x7fd7d019f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01007f0 0x7fd7d019f810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd7c002ae90 tx=0x7fd7c002f5f0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 shutdown_connections 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7b8077460 0x7fd7b8079920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7d01067f0 0x7fd7d019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 --2- 172.21.15.52:0/3814151917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7d01007f0 0x7fd7d019f810 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.921+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 >> 172.21.15.52:0/3814151917 conn(0x7fd7d00fc550 msgr2=0x7fd7d00fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.922+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 shutdown_connections 2024-09-06T14:58:20.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:20.922+0000 7fd7d870e640 1 -- 172.21.15.52:0/3814151917 wait complete. 2024-09-06T14:58:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 -- 172.21.15.52:0/506489030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14107900 msgr2=0x7eff14107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 --2- 172.21.15.52:0/506489030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14107900 0x7eff14107ce0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff04009880 tx=0x7eff0402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 -- 172.21.15.52:0/506489030 shutdown_connections 2024-09-06T14:58:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 --2- 172.21.15.52:0/506489030 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff14101900 0x7eff14101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.002 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 --2- 172.21.15.52:0/506489030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14107900 0x7eff14107ce0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 -- 172.21.15.52:0/506489030 >> 172.21.15.52:0/506489030 conn(0x7eff140fd600 msgr2=0x7eff140ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 -- 172.21.15.52:0/506489030 shutdown_connections 2024-09-06T14:58:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.003+0000 7eff1add8640 1 -- 172.21.15.52:0/506489030 wait complete. 2024-09-06T14:58:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff1add8640 1 Processor -- start 2024-09-06T14:58:21.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff1add8640 1 -- start start 2024-09-06T14:58:21.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff1add8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14101900 0x7eff1419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff1add8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff14107900 0x7eff1419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff1add8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7eff1410ee30 con 0x7eff14101900 2024-09-06T14:58:21.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff1add8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7eff1410ecb0 con 0x7eff14107900 2024-09-06T14:58:21.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff18b74640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14101900 0x7eff1419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.004+0000 7eff18b74640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14101900 0x7eff1419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39206/0 (socket says 172.21.15.52:39206) 2024-09-06T14:58:21.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff18b74640 1 -- 172.21.15.52:0/408428218 learned_addr learned my addr 172.21.15.52:0/408428218 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:21.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff13fff640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff14107900 0x7eff1419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff18b74640 1 -- 172.21.15.52:0/408428218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff14107900 msgr2=0x7eff1419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff18b74640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff14107900 0x7eff1419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff18b74640 1 -- 172.21.15.52:0/408428218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff14197880 con 0x7eff14101900 2024-09-06T14:58:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff18b74640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14101900 0x7eff1419d6c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff04031460 tx=0x7eff040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff11ffb640 1 -- 172.21.15.52:0/408428218 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff0403f070 con 0x7eff14101900 2024-09-06T14:58:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff11ffb640 1 -- 172.21.15.52:0/408428218 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7eff04004cf0 con 0x7eff14101900 2024-09-06T14:58:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff14197b10 con 0x7eff14101900 2024-09-06T14:58:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.005+0000 7eff11ffb640 1 -- 172.21.15.52:0/408428218 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7eff04035030 con 0x7eff14101900 2024-09-06T14:58:21.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.006+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff14198040 con 0x7eff14101900 2024-09-06T14:58:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.007+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff14103040 con 0x7eff14101900 2024-09-06T14:58:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.007+0000 7eff11ffb640 1 -- 172.21.15.52:0/408428218 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7eff04042070 con 0x7eff14101900 2024-09-06T14:58:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.008+0000 7eff11ffb640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7eff000774b0 0x7eff00079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.008+0000 7eff11ffb640 1 -- 172.21.15.52:0/408428218 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7eff040ba260 con 0x7eff14101900 2024-09-06T14:58:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.008+0000 7eff13fff640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7eff000774b0 0x7eff00079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.008+0000 7eff13fff640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7eff000774b0 0x7eff00079970 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff140ffbf0 tx=0x7efefc008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.012+0000 7eff11ffb640 1 -- 172.21.15.52:0/408428218 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7eff04083240 con 0x7eff14101900 2024-09-06T14:58:21.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.234+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7eff14198db0 con 0x7eff14101900 2024-09-06T14:58:21.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.234+0000 7eff11ffb640 1 -- 172.21.15.52:0/408428218 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7eff040873b0 con 0x7eff14101900 2024-09-06T14:58:21.233 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:58:21.233 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:58:21.233 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:58:21.233 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:21.234 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:58:21.235 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:58:21.235 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:58:21.235 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7eff000774b0 msgr2=0x7eff00079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7eff000774b0 0x7eff00079970 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7eff140ffbf0 tx=0x7efefc008040 comp rx=0 tx=0).stop 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14101900 msgr2=0x7eff1419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14101900 0x7eff1419d6c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff04031460 tx=0x7eff040048f0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 shutdown_connections 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7eff000774b0 0x7eff00079970 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7eff14107900 0x7eff1419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 --2- 172.21.15.52:0/408428218 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7eff14101900 0x7eff1419d6c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 >> 172.21.15.52:0/408428218 conn(0x7eff140fd600 msgr2=0x7eff140fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:21.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 shutdown_connections 2024-09-06T14:58:21.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.236+0000 7eff1add8640 1 -- 172.21.15.52:0/408428218 wait complete. 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 -- 172.21.15.52:0/2994923089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc100800 msgr2=0x7f24bc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 --2- 172.21.15.52:0/2994923089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc100800 0x7f24bc100c60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f24b0009880 tx=0x7f24b002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 -- 172.21.15.52:0/2994923089 shutdown_connections 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 --2- 172.21.15.52:0/2994923089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc100800 0x7f24bc100c60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 --2- 172.21.15.52:0/2994923089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24bc106800 0x7f24bc106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 -- 172.21.15.52:0/2994923089 >> 172.21.15.52:0/2994923089 conn(0x7f24bc0fc520 msgr2=0x7f24bc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 -- 172.21.15.52:0/2994923089 shutdown_connections 2024-09-06T14:58:21.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.319+0000 7f24c0bef640 1 -- 172.21.15.52:0/2994923089 wait complete. 2024-09-06T14:58:21.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24c0bef640 1 Processor -- start 2024-09-06T14:58:21.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24c0bef640 1 -- start start 2024-09-06T14:58:21.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24c0bef640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24bc100800 0x7f24bc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.320 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24c0bef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc106800 0x7f24bc198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24c0bef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10dcb0 con 0x7f24bc106800 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24c0bef640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f24bc10db30 con 0x7f24bc100800 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24b9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc106800 0x7f24bc198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24b9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc106800 0x7f24bc198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39228/0 (socket says 172.21.15.52:39228) 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.320+0000 7f24b9d9b640 1 -- 172.21.15.52:0/74549176 learned_addr learned my addr 172.21.15.52:0/74549176 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24ba59c640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24bc100800 0x7f24bc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24b9d9b640 1 -- 172.21.15.52:0/74549176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24bc100800 msgr2=0x7f24bc1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24b9d9b640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24bc100800 0x7f24bc1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24b9d9b640 1 -- 172.21.15.52:0/74549176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24bc199350 con 0x7f24bc106800 2024-09-06T14:58:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24b9d9b640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc106800 0x7f24bc198d00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24b0031460 tx=0x7f24b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24ab7fe640 1 -- 172.21.15.52:0/74549176 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b003f070 con 0x7f24bc106800 2024-09-06T14:58:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24bc1995e0 con 0x7f24bc106800 2024-09-06T14:58:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24ab7fe640 1 -- 172.21.15.52:0/74549176 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24b00035f0 con 0x7f24bc106800 2024-09-06T14:58:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24ab7fe640 1 -- 172.21.15.52:0/74549176 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24b0035030 con 0x7f24bc106800 2024-09-06T14:58:21.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.321+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24bc1a1b90 con 0x7f24bc106800 2024-09-06T14:58:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.323+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24bc101f40 con 0x7f24bc106800 2024-09-06T14:58:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.323+0000 7f24ab7fe640 1 -- 172.21.15.52:0/74549176 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f24b0042070 con 0x7f24bc106800 2024-09-06T14:58:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.323+0000 7f24ab7fe640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24a4077460 0x7f24a4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.323+0000 7f24ab7fe640 1 -- 172.21.15.52:0/74549176 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f24b00ba160 con 0x7f24bc106800 2024-09-06T14:58:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.323+0000 7f24ba59c640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24a4077460 0x7f24a4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.324+0000 7f24ba59c640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24a4077460 0x7f24a4079920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00bbe0 tx=0x7f24ac00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.327+0000 7f24ab7fe640 1 -- 172.21.15.52:0/74549176 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f24b0087190 con 0x7f24bc106800 2024-09-06T14:58:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.510+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f24bc06a7e0 con 0x7f24bc106800 2024-09-06T14:58:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.510+0000 7f24ab7fe640 1 -- 172.21.15.52:0/74549176 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f24b008bbb0 con 0x7f24bc106800 2024-09-06T14:58:21.509 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:58:21.509 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:58:21.509 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:58:21.509 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:58:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:58:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:21.512 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:58:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24a4077460 msgr2=0x7f24a4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24a4077460 0x7f24a4079920 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00bbe0 tx=0x7f24ac00b390 comp rx=0 tx=0).stop 2024-09-06T14:58:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc106800 msgr2=0x7f24bc198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc106800 0x7f24bc198d00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24b0031460 tx=0x7f24b00045e0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 shutdown_connections 2024-09-06T14:58:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24bc106800 0x7f24bc198d00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24a4077460 0x7f24a4079920 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 --2- 172.21.15.52:0/74549176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f24bc100800 0x7f24bc1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.512+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 >> 172.21.15.52:0/74549176 conn(0x7f24bc0fc520 msgr2=0x7f24bc0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.513+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 shutdown_connections 2024-09-06T14:58:21.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.513+0000 7f24c0bef640 1 -- 172.21.15.52:0/74549176 wait complete. 2024-09-06T14:58:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 -- 172.21.15.52:0/1621474832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 msgr2=0x7fbe40107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 --2- 172.21.15.52:0/1621474832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe40107ce0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009880 tx=0x7fbe3c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 -- 172.21.15.52:0/1621474832 shutdown_connections 2024-09-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 --2- 172.21.15.52:0/1621474832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe40101900 0x7fbe40101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 --2- 172.21.15.52:0/1621474832 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe40107ce0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 -- 172.21.15.52:0/1621474832 >> 172.21.15.52:0/1621474832 conn(0x7fbe400fd600 msgr2=0x7fbe400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 -- 172.21.15.52:0/1621474832 shutdown_connections 2024-09-06T14:58:21.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.597+0000 7fbe484f8640 1 -- 172.21.15.52:0/1621474832 wait complete. 2024-09-06T14:58:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe484f8640 1 Processor -- start 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe484f8640 1 -- start start 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe484f8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe40101900 0x7fbe4019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe484f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe4019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe484f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4010edd0 con 0x7fbe40107900 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe484f8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4010ec50 con 0x7fbe40101900 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe45a93640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe4019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe45a93640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe4019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39236/0 (socket says 172.21.15.52:39236) 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe45a93640 1 -- 172.21.15.52:0/758677474 learned_addr learned my addr 172.21.15.52:0/758677474 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe46294640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe40101900 0x7fbe4019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe45a93640 1 -- 172.21.15.52:0/758677474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe40101900 msgr2=0x7fbe4019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.598+0000 7fbe45a93640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe40101900 0x7fbe4019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.599+0000 7fbe45a93640 1 -- 172.21.15.52:0/758677474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe401977c0 con 0x7fbe40107900 2024-09-06T14:58:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.599+0000 7fbe45a93640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe4019db80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000e970 tx=0x7fbe3000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.599+0000 7fbe377fe640 1 -- 172.21.15.52:0/758677474 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe3000cac0 con 0x7fbe40107900 2024-09-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.599+0000 7fbe377fe640 1 -- 172.21.15.52:0/758677474 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe300054e0 con 0x7fbe40107900 2024-09-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.599+0000 7fbe377fe640 1 -- 172.21.15.52:0/758677474 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe30010430 con 0x7fbe40107900 2024-09-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.599+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe40197ab0 con 0x7fbe40107900 2024-09-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.599+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe40198040 con 0x7fbe40107900 2024-09-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.600+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe40103040 con 0x7fbe40107900 2024-09-06T14:58:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.601+0000 7fbe377fe640 1 -- 172.21.15.52:0/758677474 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbe30004f00 con 0x7fbe40107900 2024-09-06T14:58:21.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.601+0000 7fbe377fe640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe2c0774b0 0x7fbe2c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.602+0000 7fbe46294640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe2c0774b0 0x7fbe2c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.602+0000 7fbe377fe640 1 -- 172.21.15.52:0/758677474 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fbe30099df0 con 0x7fbe40107900 2024-09-06T14:58:21.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.602+0000 7fbe46294640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe2c0774b0 0x7fbe2c079970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0096c0 tx=0x7fbe3c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.606+0000 7fbe377fe640 1 -- 172.21.15.52:0/758677474 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbe30062dd0 con 0x7fbe40107900 2024-09-06T14:58:21.779 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.781+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe401983b0 con 0x7fbe2c0774b0 2024-09-06T14:58:21.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.782+0000 7fbe377fe640 1 -- 172.21.15.52:0/758677474 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbe401983b0 con 0x7fbe2c0774b0 2024-09-06T14:58:21.780 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:58:21.781 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:58:21.782 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:58:21.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe2c0774b0 msgr2=0x7fbe2c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe2c0774b0 0x7fbe2c079970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0096c0 tx=0x7fbe3c031400 comp rx=0 tx=0).stop 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 msgr2=0x7fbe4019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe4019db80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000e970 tx=0x7fbe3000ed70 comp rx=0 tx=0).stop 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 shutdown_connections 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe40107900 0x7fbe4019db80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe2c0774b0 0x7fbe2c079970 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 --2- 172.21.15.52:0/758677474 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe40101900 0x7fbe4019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 >> 172.21.15.52:0/758677474 conn(0x7fbe400fd600 msgr2=0x7fbe400fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 shutdown_connections 2024-09-06T14:58:21.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.784+0000 7fbe484f8640 1 -- 172.21.15.52:0/758677474 wait complete. 2024-09-06T14:58:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.866+0000 7f58b3621640 1 -- 172.21.15.52:0/2252736818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1007f0 msgr2=0x7f58ac100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.866+0000 7f58b3621640 1 --2- 172.21.15.52:0/2252736818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1007f0 0x7f58ac100c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009880 tx=0x7f58a802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 -- 172.21.15.52:0/2252736818 shutdown_connections 2024-09-06T14:58:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 --2- 172.21.15.52:0/2252736818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1007f0 0x7f58ac100c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 --2- 172.21.15.52:0/2252736818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58ac1067f0 0x7f58ac106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 -- 172.21.15.52:0/2252736818 >> 172.21.15.52:0/2252736818 conn(0x7f58ac0fc550 msgr2=0x7f58ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 -- 172.21.15.52:0/2252736818 shutdown_connections 2024-09-06T14:58:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 -- 172.21.15.52:0/2252736818 wait complete. 2024-09-06T14:58:21.866 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:21 smithi052 ceph-mon[112917]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:21.867 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:21 smithi052 ceph-mon[112917]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:21.867 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:21 smithi052 ceph-mon[112917]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:21.867 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:21 smithi052 ceph-mon[112917]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:21.867 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:21 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/408428218' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:58:21.867 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:21 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/74549176' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 Processor -- start 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.867+0000 7f58b3621640 1 -- start start 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b3621640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58ac1007f0 0x7f58ac1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b3621640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1067f0 0x7f58ac198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b3621640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac10dcc0 con 0x7f58ac1067f0 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b3621640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac10db40 con 0x7f58ac1007f0 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b0bbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1067f0 0x7f58ac198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b0bbc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1067f0 0x7f58ac198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39254/0 (socket says 172.21.15.52:39254) 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b0bbc640 1 -- 172.21.15.52:0/605807361 learned_addr learned my addr 172.21.15.52:0/605807361 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b13bd640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58ac1007f0 0x7f58ac1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b0bbc640 1 -- 172.21.15.52:0/605807361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58ac1007f0 msgr2=0x7f58ac1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b0bbc640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58ac1007f0 0x7f58ac1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b0bbc640 1 -- 172.21.15.52:0/605807361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac199330 con 0x7f58ac1067f0 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b13bd640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58ac1007f0 0x7f58ac1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.868+0000 7f58b0bbc640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1067f0 0x7f58ac198d30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f58a8031460 tx=0x7f58a80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.869+0000 7f589e7fc640 1 -- 172.21.15.52:0/605807361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58a803f070 con 0x7f58ac1067f0 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.869+0000 7f589e7fc640 1 -- 172.21.15.52:0/605807361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58a80035f0 con 0x7f58ac1067f0 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.869+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac1995c0 con 0x7f58ac1067f0 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.869+0000 7f589e7fc640 1 -- 172.21.15.52:0/605807361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58a8035030 con 0x7f58ac1067f0 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.869+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac1a1b70 con 0x7f58ac1067f0 2024-09-06T14:58:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.870+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ac101f30 con 0x7f58ac1067f0 2024-09-06T14:58:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.871+0000 7f589e7fc640 1 -- 172.21.15.52:0/605807361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f58a8042070 con 0x7f58ac1067f0 2024-09-06T14:58:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.871+0000 7f589e7fc640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5898077460 0x7f5898079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.872+0000 7f589e7fc640 1 -- 172.21.15.52:0/605807361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f58a80ba170 con 0x7f58ac1067f0 2024-09-06T14:58:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.872+0000 7f58b13bd640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5898077460 0x7f5898079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.872+0000 7f58b13bd640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5898077460 0x7f5898079920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f58a00058c0 tx=0x7f58a0005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:21.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:21.876+0000 7f589e7fc640 1 -- 172.21.15.52:0/605807361 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f58a80830d0 con 0x7f58ac1067f0 2024-09-06T14:58:22.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:21 smithi165 ceph-mon[82925]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:22.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:21 smithi165 ceph-mon[82925]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:22.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:21 smithi165 ceph-mon[82925]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:22.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:21 smithi165 ceph-mon[82925]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:22.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:21 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/408428218' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:58:22.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:21 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/74549176' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:58:22.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.099+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f58ac108d60 con 0x7f58ac1067f0 2024-09-06T14:58:22.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.099+0000 7f589e7fc640 1 -- 172.21.15.52:0/605807361 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f58a8087240 con 0x7f58ac1067f0 2024-09-06T14:58:22.098 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:58:22.098 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:58:22.098 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:58:22.098 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:58:22.099 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:58:22.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5898077460 msgr2=0x7f5898079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5898077460 0x7f5898079920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f58a00058c0 tx=0x7f58a0005850 comp rx=0 tx=0).stop 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1067f0 msgr2=0x7f58ac198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1067f0 0x7f58ac198d30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f58a8031460 tx=0x7f58a80045e0 comp rx=0 tx=0).stop 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 shutdown_connections 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58ac1067f0 0x7f58ac198d30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5898077460 0x7f5898079920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 --2- 172.21.15.52:0/605807361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58ac1007f0 0x7f58ac1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.101+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 >> 172.21.15.52:0/605807361 conn(0x7f58ac0fc550 msgr2=0x7f58ac0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.102+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 shutdown_connections 2024-09-06T14:58:22.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:22.102+0000 7f58b3621640 1 -- 172.21.15.52:0/605807361 wait complete. 2024-09-06T14:58:22.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:22 smithi052 ceph-mon[112917]: from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:22.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:22 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/605807361' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:58:22.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:23.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:22 smithi165 ceph-mon[82925]: from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:23.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:22 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/605807361' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:58:23.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:24.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:23 smithi165 ceph-mon[82925]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:24.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:23 smithi052 ceph-mon[112917]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:25.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:25 smithi052 ceph-mon[112917]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:26.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:25 smithi165 ceph-mon[82925]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:28.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:27 smithi165 ceph-mon[82925]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:28.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:27 smithi052 ceph-mon[112917]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:30.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:29 smithi165 ceph-mon[82925]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:30.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:29 smithi052 ceph-mon[112917]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:32.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:31 smithi165 ceph-mon[82925]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:32.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:31 smithi052 ceph-mon[112917]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:34.025 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:33 smithi052 ceph-mon[112917]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:34.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:33 smithi165 ceph-mon[82925]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:35.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:35 smithi052 ceph-mon[112917]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:36.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:35 smithi165 ceph-mon[82925]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:38.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:37 smithi165 ceph-mon[82925]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:38.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:38.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:37 smithi052 ceph-mon[112917]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:38.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:40.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:39 smithi165 ceph-mon[82925]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:39 smithi052 ceph-mon[112917]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:42.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:41 smithi165 ceph-mon[82925]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:42.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:41 smithi052 ceph-mon[112917]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:44.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:43 smithi165 ceph-mon[82925]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:44.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:43 smithi052 ceph-mon[112917]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:45.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:45 smithi052 ceph-mon[112917]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:46.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:45 smithi165 ceph-mon[82925]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:48.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:47 smithi165 ceph-mon[82925]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:48.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:47 smithi052 ceph-mon[112917]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:50.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:49 smithi165 ceph-mon[82925]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:50.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:49 smithi052 ceph-mon[112917]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:52.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:51 smithi165 ceph-mon[82925]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:52.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:51 smithi052 ceph-mon[112917]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:52.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.197+0000 7fd2e9f81640 1 -- 172.21.15.52:0/3128271132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e4102ac0 msgr2=0x7fd2e4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.197+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/3128271132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e4102ac0 0x7fd2e4102ea0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4009880 tx=0x7fd2d402a530 comp rx=0 tx=0).stop 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.198+0000 7fd2e9f81640 1 -- 172.21.15.52:0/3128271132 shutdown_connections 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.198+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/3128271132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e41033e0 0x7fd2e410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.198+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/3128271132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e4102ac0 0x7fd2e4102ea0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.198+0000 7fd2e9f81640 1 -- 172.21.15.52:0/3128271132 >> 172.21.15.52:0/3128271132 conn(0x7fd2e40fc520 msgr2=0x7fd2e40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.198+0000 7fd2e9f81640 1 -- 172.21.15.52:0/3128271132 shutdown_connections 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.198+0000 7fd2e9f81640 1 -- 172.21.15.52:0/3128271132 wait complete. 2024-09-06T14:58:52.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.198+0000 7fd2e9f81640 1 Processor -- start 2024-09-06T14:58:52.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e9f81640 1 -- start start 2024-09-06T14:58:52.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e9f81640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e4102ac0 0x7fd2e4100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e9f81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e41033e0 0x7fd2e4100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e9f81640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e410edf0 con 0x7fd2e41033e0 2024-09-06T14:58:52.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e9f81640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e410ec70 con 0x7fd2e4102ac0 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e41033e0 0x7fd2e4100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e41033e0 0x7fd2e4100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53792/0 (socket says 172.21.15.52:53792) 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e2ffd640 1 -- 172.21.15.52:0/2307791995 learned_addr learned my addr 172.21.15.52:0/2307791995 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e37fe640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e4102ac0 0x7fd2e4100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e2ffd640 1 -- 172.21.15.52:0/2307791995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e4102ac0 msgr2=0x7fd2e4100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e2ffd640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e4102ac0 0x7fd2e4100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.199+0000 7fd2e2ffd640 1 -- 172.21.15.52:0/2307791995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e41011a0 con 0x7fd2e41033e0 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.200+0000 7fd2e2ffd640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e41033e0 0x7fd2e4100c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e970 tx=0x7fd2cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:52.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.200+0000 7fd2e0ff9640 1 -- 172.21.15.52:0/2307791995 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2cc00cac0 con 0x7fd2e41033e0 2024-09-06T14:58:52.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.200+0000 7fd2e0ff9640 1 -- 172.21.15.52:0/2307791995 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2cc0054e0 con 0x7fd2e41033e0 2024-09-06T14:58:52.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.200+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e4101490 con 0x7fd2e41033e0 2024-09-06T14:58:52.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.200+0000 7fd2e0ff9640 1 -- 172.21.15.52:0/2307791995 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2cc004dd0 con 0x7fd2e41033e0 2024-09-06T14:58:52.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.200+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e41a3e00 con 0x7fd2e41033e0 2024-09-06T14:58:52.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.201+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e406aa90 con 0x7fd2e41033e0 2024-09-06T14:58:52.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.202+0000 7fd2e0ff9640 1 -- 172.21.15.52:0/2307791995 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd2cc005020 con 0x7fd2e41033e0 2024-09-06T14:58:52.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.202+0000 7fd2e0ff9640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2d00773f0 0x7fd2d00798b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.202+0000 7fd2e0ff9640 1 -- 172.21.15.52:0/2307791995 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd2cc099ea0 con 0x7fd2e41033e0 2024-09-06T14:58:52.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.202+0000 7fd2e37fe640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2d00773f0 0x7fd2d00798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.203+0000 7fd2e37fe640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2d00773f0 0x7fd2d00798b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:52.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.206+0000 7fd2e0ff9640 1 -- 172.21.15.52:0/2307791995 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd2cc062e00 con 0x7fd2e41033e0 2024-09-06T14:58:52.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.386+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd2e410b640 con 0x7fd2d00773f0 2024-09-06T14:58:52.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.388+0000 7fd2e0ff9640 1 -- 172.21.15.52:0/2307791995 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd2e410b640 con 0x7fd2d00773f0 2024-09-06T14:58:52.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2d00773f0 msgr2=0x7fd2d00798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2d00773f0 0x7fd2d00798b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd2d4000c00 tx=0x7fd2d4031400 comp rx=0 tx=0).stop 2024-09-06T14:58:52.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e41033e0 msgr2=0x7fd2e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e41033e0 0x7fd2e4100c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00e970 tx=0x7fd2cc00ee30 comp rx=0 tx=0).stop 2024-09-06T14:58:52.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 shutdown_connections 2024-09-06T14:58:52.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2e41033e0 0x7fd2e4100c60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd2d00773f0 0x7fd2d00798b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 --2- 172.21.15.52:0/2307791995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd2e4102ac0 0x7fd2e4100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.390+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 >> 172.21.15.52:0/2307791995 conn(0x7fd2e40fc520 msgr2=0x7fd2e410af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:52.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.391+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 shutdown_connections 2024-09-06T14:58:52.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.391+0000 7fd2e9f81640 1 -- 172.21.15.52:0/2307791995 wait complete. 2024-09-06T14:58:52.398 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:58:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 -- 172.21.15.52:0/3176366557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 msgr2=0x7f3d60100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3176366557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d60100c50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009880 tx=0x7f3d5002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 -- 172.21.15.52:0/3176366557 shutdown_connections 2024-09-06T14:58:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3176366557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d60100c50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3176366557 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d601067f0 0x7f3d60106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 -- 172.21.15.52:0/3176366557 >> 172.21.15.52:0/3176366557 conn(0x7f3d600fc550 msgr2=0x7f3d600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 -- 172.21.15.52:0/3176366557 shutdown_connections 2024-09-06T14:58:52.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.475+0000 7f3d687c2640 1 -- 172.21.15.52:0/3176366557 wait complete. 2024-09-06T14:58:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d687c2640 1 Processor -- start 2024-09-06T14:58:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d687c2640 1 -- start start 2024-09-06T14:58:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d687c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d6019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d687c2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d601067f0 0x7f3d6019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d687c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6010dca0 con 0x7f3d601007f0 2024-09-06T14:58:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d687c2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6010db20 con 0x7f3d601067f0 2024-09-06T14:58:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d6655e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d6019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d6655e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d6019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53804/0 (socket says 172.21.15.52:53804) 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d6655e640 1 -- 172.21.15.52:0/3530998941 learned_addr learned my addr 172.21.15.52:0/3530998941 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d65d5d640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d601067f0 0x7f3d6019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d6655e640 1 -- 172.21.15.52:0/3530998941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d601067f0 msgr2=0x7f3d6019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d6655e640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d601067f0 0x7f3d6019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.476+0000 7f3d6655e640 1 -- 172.21.15.52:0/3530998941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d60197770 con 0x7f3d601007f0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.477+0000 7f3d6655e640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d6019d6a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00d8d0 tx=0x7f3d5c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.477+0000 7f3d577fe640 1 -- 172.21.15.52:0/3530998941 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d5c017070 con 0x7f3d601007f0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.477+0000 7f3d577fe640 1 -- 172.21.15.52:0/3530998941 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d5c010460 con 0x7f3d601007f0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.477+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d60197a60 con 0x7f3d601007f0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.477+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d60197fc0 con 0x7f3d601007f0 2024-09-06T14:58:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.477+0000 7f3d577fe640 1 -- 172.21.15.52:0/3530998941 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d5c00f5f0 con 0x7f3d601007f0 2024-09-06T14:58:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.478+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d60101f30 con 0x7f3d601007f0 2024-09-06T14:58:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.479+0000 7f3d577fe640 1 -- 172.21.15.52:0/3530998941 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3d5c009a30 con 0x7f3d601007f0 2024-09-06T14:58:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.479+0000 7f3d577fe640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d4c0774b0 0x7f3d4c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.479+0000 7f3d577fe640 1 -- 172.21.15.52:0/3530998941 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3d5c099530 con 0x7f3d601007f0 2024-09-06T14:58:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.479+0000 7f3d65d5d640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d4c0774b0 0x7f3d4c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.480+0000 7f3d65d5d640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d4c0774b0 0x7f3d4c079970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3d60198fc0 tx=0x7f3d50031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.483+0000 7f3d577fe640 1 -- 172.21.15.52:0/3530998941 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3d5c066680 con 0x7f3d601007f0 2024-09-06T14:58:52.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.660+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3d60198270 con 0x7f3d4c0774b0 2024-09-06T14:58:52.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.661+0000 7f3d577fe640 1 -- 172.21.15.52:0/3530998941 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3d60198270 con 0x7f3d4c0774b0 2024-09-06T14:58:52.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d4c0774b0 msgr2=0x7f3d4c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d4c0774b0 0x7f3d4c079970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3d60198fc0 tx=0x7f3d50031400 comp rx=0 tx=0).stop 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 msgr2=0x7f3d6019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d6019d6a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c00d8d0 tx=0x7f3d5c00dd90 comp rx=0 tx=0).stop 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 shutdown_connections 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3d4c0774b0 0x7f3d4c079970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d601067f0 0x7f3d6019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 --2- 172.21.15.52:0/3530998941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d601007f0 0x7f3d6019d6a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 >> 172.21.15.52:0/3530998941 conn(0x7f3d600fc550 msgr2=0x7f3d60104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 shutdown_connections 2024-09-06T14:58:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.663+0000 7f3d687c2640 1 -- 172.21.15.52:0/3530998941 wait complete. 2024-09-06T14:58:52.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/690688124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 msgr2=0x7fc9e0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/690688124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e0101d60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009880 tx=0x7fc9d402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/690688124 shutdown_connections 2024-09-06T14:58:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/690688124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e0101d60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/690688124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e0107900 0x7fc9e0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/690688124 >> 172.21.15.52:0/690688124 conn(0x7fc9e00fd600 msgr2=0x7fc9e00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/690688124 shutdown_connections 2024-09-06T14:58:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.750+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/690688124 wait complete. 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.751+0000 7fc9e4d5b640 1 Processor -- start 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.751+0000 7fc9e4d5b640 1 -- start start 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.751+0000 7fc9e4d5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9e4d5b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e0107900 0x7fc9e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9e4d5b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e010edb0 con 0x7fc9e0101900 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9e4d5b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e010ec30 con 0x7fc9e0107900 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9de59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9de59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53816/0 (socket says 172.21.15.52:53816) 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9de59c640 1 -- 172.21.15.52:0/4161117078 learned_addr learned my addr 172.21.15.52:0/4161117078 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9ddd9b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e0107900 0x7fc9e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9de59c640 1 -- 172.21.15.52:0/4161117078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e0107900 msgr2=0x7fc9e0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9de59c640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e0107900 0x7fc9e0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9de59c640 1 -- 172.21.15.52:0/4161117078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e0074f70 con 0x7fc9e0101900 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9ddd9b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e0107900 0x7fc9e0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9de59c640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e00744f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c8a0 tx=0x7fc9d000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9cf7fe640 1 -- 172.21.15.52:0/4161117078 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d00079b0 con 0x7fc9e0101900 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9cf7fe640 1 -- 172.21.15.52:0/4161117078 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9d0007b50 con 0x7fc9e0101900 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.752+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e0075260 con 0x7fc9e0101900 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.753+0000 7fc9cf7fe640 1 -- 172.21.15.52:0/4161117078 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d0018700 con 0x7fc9e0101900 2024-09-06T14:58:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.753+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e01a3e20 con 0x7fc9e0101900 2024-09-06T14:58:52.754 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.754+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e0103040 con 0x7fc9e0101900 2024-09-06T14:58:52.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.754+0000 7fc9cf7fe640 1 -- 172.21.15.52:0/4161117078 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc9d000f450 con 0x7fc9e0101900 2024-09-06T14:58:52.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.755+0000 7fc9cf7fe640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9c80774b0 0x7fc9c8079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:52.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.755+0000 7fc9cf7fe640 1 -- 172.21.15.52:0/4161117078 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc9d00999b0 con 0x7fc9e0101900 2024-09-06T14:58:52.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.755+0000 7fc9ddd9b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9c80774b0 0x7fc9c8079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:52.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.755+0000 7fc9ddd9b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9c80774b0 0x7fc9c8079970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0075f80 tx=0x7fc9d4009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:52.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.759+0000 7fc9cf7fe640 1 -- 172.21.15.52:0/4161117078 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc9d0014030 con 0x7fc9e0101900 2024-09-06T14:58:52.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.928+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc9e0062630 con 0x7fc9c80774b0 2024-09-06T14:58:52.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.937+0000 7fc9cf7fe640 1 -- 172.21.15.52:0/4161117078 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc9e0062630 con 0x7fc9c80774b0 2024-09-06T14:58:52.936 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:58:52.936 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (11m) 5m ago 22m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:58:52.936 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (14m) 5m ago 22m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:58:52.936 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (13m) 5m ago 21m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:58:52.936 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (9m) 5m ago 22m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:58:52.936 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (9m) 5m ago 21m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (10m) 5m ago 21m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (5m) 5m ago 17m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (5m) 5m ago 16m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (5m) 5m ago 16m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (5m) 5m ago 16m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (13m) 5m ago 23m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (12m) 5m ago 21m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (10m) 5m ago 23m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (9m) 5m ago 21m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (12m) 5m ago 22m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (12m) 5m ago 21m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:58:52.937 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (9m) 5m ago 20m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:58:52.938 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (8m) 5m ago 19m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:58:52.938 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (7m) 5m ago 19m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:58:52.938 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (7m) 5m ago 18m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:58:52.938 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (6m) 5m ago 18m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:58:52.938 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (6m) 5m ago 18m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:58:52.938 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (11m) 5m ago 21m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9c80774b0 msgr2=0x7fc9c8079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9c80774b0 0x7fc9c8079970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0075f80 tx=0x7fc9d4009560 comp rx=0 tx=0).stop 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 msgr2=0x7fc9e00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e00744f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c8a0 tx=0x7fc9d000cd60 comp rx=0 tx=0).stop 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 shutdown_connections 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9c80774b0 0x7fc9c8079970 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e0107900 0x7fc9e0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 --2- 172.21.15.52:0/4161117078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e0101900 0x7fc9e00744f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.939+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 >> 172.21.15.52:0/4161117078 conn(0x7fc9e00fd600 msgr2=0x7fc9e00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.940+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 shutdown_connections 2024-09-06T14:58:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:52.940+0000 7fc9e4d5b640 1 -- 172.21.15.52:0/4161117078 wait complete. 2024-09-06T14:58:53.019 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 -- 172.21.15.52:0/2451348290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 msgr2=0x7fbe2c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 --2- 172.21.15.52:0/2451348290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c107ce0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009880 tx=0x7fbe2802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 -- 172.21.15.52:0/2451348290 shutdown_connections 2024-09-06T14:58:53.020 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:53.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 --2- 172.21.15.52:0/2451348290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2c101900 0x7fbe2c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 --2- 172.21.15.52:0/2451348290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c107ce0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 -- 172.21.15.52:0/2451348290 >> 172.21.15.52:0/2451348290 conn(0x7fbe2c0fd600 msgr2=0x7fbe2c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 -- 172.21.15.52:0/2451348290 shutdown_connections 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.021+0000 7fbe33555640 1 -- 172.21.15.52:0/2451348290 wait complete. 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe33555640 1 Processor -- start 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe33555640 1 -- start start 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe33555640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2c101900 0x7fbe2c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe33555640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe33555640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c10ee30 con 0x7fbe2c107900 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe33555640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2c10ecb0 con 0x7fbe2c101900 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe30af0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe30af0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53846/0 (socket says 172.21.15.52:53846) 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe30af0640 1 -- 172.21.15.52:0/452856602 learned_addr learned my addr 172.21.15.52:0/452856602 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.022+0000 7fbe312f1640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2c101900 0x7fbe2c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe30af0640 1 -- 172.21.15.52:0/452856602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2c101900 msgr2=0x7fbe2c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe30af0640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2c101900 0x7fbe2c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe30af0640 1 -- 172.21.15.52:0/452856602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2c074f70 con 0x7fbe2c107900 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe312f1640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2c101900 0x7fbe2c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe30af0640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c074a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b420 tx=0x7fbe1c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe227fc640 1 -- 172.21.15.52:0/452856602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe1c011630 con 0x7fbe2c107900 2024-09-06T14:58:53.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe227fc640 1 -- 172.21.15.52:0/452856602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe1c016070 con 0x7fbe2c107900 2024-09-06T14:58:53.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2c075260 con 0x7fbe2c107900 2024-09-06T14:58:53.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe227fc640 1 -- 172.21.15.52:0/452856602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe1c010d40 con 0x7fbe2c107900 2024-09-06T14:58:53.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.023+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2c1a3ee0 con 0x7fbe2c107900 2024-09-06T14:58:53.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.024+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2c103040 con 0x7fbe2c107900 2024-09-06T14:58:53.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.025+0000 7fbe227fc640 1 -- 172.21.15.52:0/452856602 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbe1c01b460 con 0x7fbe2c107900 2024-09-06T14:58:53.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.025+0000 7fbe227fc640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe18077460 0x7fbe18079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.026+0000 7fbe227fc640 1 -- 172.21.15.52:0/452856602 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fbe1c098f90 con 0x7fbe2c107900 2024-09-06T14:58:53.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.026+0000 7fbe312f1640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe18077460 0x7fbe18079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.025 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.026+0000 7fbe312f1640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe18077460 0x7fbe18079920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbe28006010 tx=0x7fbe280095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.030+0000 7fbe227fc640 1 -- 172.21.15.52:0/452856602 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbe1c021250 con 0x7fbe2c107900 2024-09-06T14:58:53.070 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:58:53.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.253+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbe2c109e70 con 0x7fbe2c107900 2024-09-06T14:58:53.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.254+0000 7fbe227fc640 1 -- 172.21.15.52:0/452856602 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbe1c061ef0 con 0x7fbe2c107900 2024-09-06T14:58:53.252 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:58:53.253 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:58:53.254 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:58:53.254 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:58:53.254 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:58:53.254 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:58:53.254 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.255+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe18077460 msgr2=0x7fbe18079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.255+0000 7fbe33555640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe18077460 0x7fbe18079920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbe28006010 tx=0x7fbe280095f0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.255+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 msgr2=0x7fbe2c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.255+0000 7fbe33555640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c074a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b420 tx=0x7fbe1c00b8e0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.256+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 shutdown_connections 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.256+0000 7fbe33555640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe2c107900 0x7fbe2c074a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.256+0000 7fbe33555640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbe18077460 0x7fbe18079920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.256+0000 7fbe33555640 1 --2- 172.21.15.52:0/452856602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbe2c101900 0x7fbe2c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.256+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 >> 172.21.15.52:0/452856602 conn(0x7fbe2c0fd600 msgr2=0x7fbe2c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.256+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 shutdown_connections 2024-09-06T14:58:53.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.256+0000 7fbe33555640 1 -- 172.21.15.52:0/452856602 wait complete. 2024-09-06T14:58:53.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 -- 172.21.15.52:0/3072226498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c102b20 msgr2=0x7f719c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 --2- 172.21.15.52:0/3072226498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c102b20 0x7f719c102f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f718c0098b0 tx=0x7f718c02a560 comp rx=0 tx=0).stop 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 -- 172.21.15.52:0/3072226498 shutdown_connections 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 --2- 172.21.15.52:0/3072226498 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f719c103440 0x7f719c10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 --2- 172.21.15.52:0/3072226498 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c102b20 0x7f719c102f00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 -- 172.21.15.52:0/3072226498 >> 172.21.15.52:0/3072226498 conn(0x7f719c0fc520 msgr2=0x7f719c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 -- 172.21.15.52:0/3072226498 shutdown_connections 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.338+0000 7f71a21de640 1 -- 172.21.15.52:0/3072226498 wait complete. 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.339+0000 7f71a21de640 1 Processor -- start 2024-09-06T14:58:53.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.339+0000 7f71a21de640 1 -- start start 2024-09-06T14:58:53.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.339+0000 7f71a21de640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f719c102b20 0x7f719c100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.339+0000 7f71a21de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c103440 0x7f719c100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f71a21de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f719c10edf0 con 0x7f719c103440 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f71a21de640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f719c10ec70 con 0x7f719c102b20 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c103440 0x7f719c100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c103440 0x7f719c100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53866/0 (socket says 172.21.15.52:53866) 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719affd640 1 -- 172.21.15.52:0/2885738430 learned_addr learned my addr 172.21.15.52:0/2885738430 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719b7fe640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f719c102b20 0x7f719c100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719affd640 1 -- 172.21.15.52:0/2885738430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f719c102b20 msgr2=0x7f719c100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719affd640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f719c102b20 0x7f719c100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719affd640 1 -- 172.21.15.52:0/2885738430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c101200 con 0x7f719c103440 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f719affd640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c103440 0x7f719c100cc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f719000d6f0 tx=0x7f719000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f7198ff9640 1 -- 172.21.15.52:0/2885738430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7190017070 con 0x7f719c103440 2024-09-06T14:58:53.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f7198ff9640 1 -- 172.21.15.52:0/2885738430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f719000de00 con 0x7f719c103440 2024-09-06T14:58:53.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c1014f0 con 0x7f719c103440 2024-09-06T14:58:53.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.340+0000 7f7198ff9640 1 -- 172.21.15.52:0/2885738430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7190004bb0 con 0x7f719c103440 2024-09-06T14:58:53.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.341+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c1a3ea0 con 0x7f719c103440 2024-09-06T14:58:53.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.341+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719c06aa30 con 0x7f719c103440 2024-09-06T14:58:53.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.342+0000 7f7198ff9640 1 -- 172.21.15.52:0/2885738430 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7190009a30 con 0x7f719c103440 2024-09-06T14:58:53.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.343+0000 7f7198ff9640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f71840774b0 0x7f7184079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.343+0000 7f7198ff9640 1 -- 172.21.15.52:0/2885738430 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7190099270 con 0x7f719c103440 2024-09-06T14:58:53.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.343+0000 7f719b7fe640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f71840774b0 0x7f7184079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.343+0000 7f719b7fe640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f71840774b0 0x7f7184079970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f718c000c00 tx=0x7f718c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.347+0000 7f7198ff9640 1 -- 172.21.15.52:0/2885738430 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f71900663c0 con 0x7f719c103440 2024-09-06T14:58:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.530+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f719c105ff0 con 0x7f719c103440 2024-09-06T14:58:53.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.530+0000 7f7198ff9640 1 -- 172.21.15.52:0/2885738430 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f719006ade0 con 0x7f719c103440 2024-09-06T14:58:53.530 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:58:53.530 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:58:53.530 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:58:53.530 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:58:53.530 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:58:53.531 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:53.531 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:58:53.531 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:58:53.531 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:58:53.531 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:58:53.531 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:58:53.532 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:58:53.532 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:58:53.532 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:58:53.532 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:58:53.532 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:58:53.532 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:58:53.532 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:58:53.533 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:58:53.533 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:58:53.533 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:58:53.533 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:58:53.533 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:58:53.534 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:58:53.534 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:58:53.534 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:58:53.534 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:58:53.534 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:58:53.534 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:58:53.534 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:58:53.535 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:58:53.535 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:58:53.535 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:58:53.535 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:58:53.535 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:58:53.535 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:53.536 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:53.536 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:58:53.536 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:58:53.537 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:53.537 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:53.537 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:53.537 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:58:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:58:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f71840774b0 msgr2=0x7f7184079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f71840774b0 0x7f7184079970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f718c000c00 tx=0x7f718c031400 comp rx=0 tx=0).stop 2024-09-06T14:58:53.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c103440 msgr2=0x7f719c100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c103440 0x7f719c100cc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f719000d6f0 tx=0x7f719000dbb0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 shutdown_connections 2024-09-06T14:58:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f719c103440 0x7f719c100cc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f71840774b0 0x7f7184079970 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.540 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 --2- 172.21.15.52:0/2885738430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f719c102b20 0x7f719c100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.532+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 >> 172.21.15.52:0/2885738430 conn(0x7f719c0fc520 msgr2=0x7f719c103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.533+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 shutdown_connections 2024-09-06T14:58:53.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.533+0000 7f71a21de640 1 -- 172.21.15.52:0/2885738430 wait complete. 2024-09-06T14:58:53.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 -- 172.21.15.52:0/1520222516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881067f0 msgr2=0x7fb688106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 --2- 172.21.15.52:0/1520222516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881067f0 0x7fb688106bd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb678009880 tx=0x7fb67802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 -- 172.21.15.52:0/1520222516 shutdown_connections 2024-09-06T14:58:53.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 --2- 172.21.15.52:0/1520222516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6881007f0 0x7fb688100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 --2- 172.21.15.52:0/1520222516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881067f0 0x7fb688106bd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 -- 172.21.15.52:0/1520222516 >> 172.21.15.52:0/1520222516 conn(0x7fb6880fc550 msgr2=0x7fb6880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:53.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 -- 172.21.15.52:0/1520222516 shutdown_connections 2024-09-06T14:58:53.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 -- 172.21.15.52:0/1520222516 wait complete. 2024-09-06T14:58:53.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 Processor -- start 2024-09-06T14:58:53.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.617+0000 7fb68e875640 1 -- start start 2024-09-06T14:58:53.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb68e875640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881007f0 0x7fb6880fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb68e875640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6881067f0 0x7fb6880fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb68e875640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb68810dcc0 con 0x7fb6881007f0 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb68e875640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb68810db40 con 0x7fb6881067f0 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb687fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881007f0 0x7fb6880fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb687fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881007f0 0x7fb6880fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53882/0 (socket says 172.21.15.52:53882) 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb687fff640 1 -- 172.21.15.52:0/547004327 learned_addr learned my addr 172.21.15.52:0/547004327 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb6877fe640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6881067f0 0x7fb6880fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb687fff640 1 -- 172.21.15.52:0/547004327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6881067f0 msgr2=0x7fb6880fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb687fff640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6881067f0 0x7fb6880fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb687fff640 1 -- 172.21.15.52:0/547004327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6880fd750 con 0x7fb6881007f0 2024-09-06T14:58:53.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb6877fe640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6881067f0 0x7fb6880fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.618+0000 7fb687fff640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881007f0 0x7fb6880fccd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb678031460 tx=0x7fb6780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.619+0000 7fb6857fa640 1 -- 172.21.15.52:0/547004327 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb67803f070 con 0x7fb6881007f0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.619+0000 7fb6857fa640 1 -- 172.21.15.52:0/547004327 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb678004cf0 con 0x7fb6881007f0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.619+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6880fd9e0 con 0x7fb6881007f0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.619+0000 7fb6857fa640 1 -- 172.21.15.52:0/547004327 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb678035030 con 0x7fb6881007f0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.619+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6881a3d70 con 0x7fb6881007f0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.620+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb688101f30 con 0x7fb6881007f0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.620+0000 7fb6857fa640 1 -- 172.21.15.52:0/547004327 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb678042070 con 0x7fb6881007f0 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.621+0000 7fb6857fa640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb670077460 0x7fb670079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.621+0000 7fb6857fa640 1 -- 172.21.15.52:0/547004327 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fb6780ba230 con 0x7fb6881007f0 2024-09-06T14:58:53.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.621+0000 7fb6877fe640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb670077460 0x7fb670079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.621+0000 7fb6877fe640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb670077460 0x7fb670079920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb6880fe760 tx=0x7fb67c005d30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.625+0000 7fb6857fa640 1 -- 172.21.15.52:0/547004327 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb678083190 con 0x7fb6881007f0 2024-09-06T14:58:53.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.801+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb688062630 con 0x7fb670077460 2024-09-06T14:58:53.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.802+0000 7fb6857fa640 1 -- 172.21.15.52:0/547004327 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb688062630 con 0x7fb670077460 2024-09-06T14:58:53.800 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:58:53.801 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:58:53.802 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:58:53.802 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:58:53.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb670077460 msgr2=0x7fb670079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb670077460 0x7fb670079920 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb6880fe760 tx=0x7fb67c005d30 comp rx=0 tx=0).stop 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881007f0 msgr2=0x7fb6880fccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881007f0 0x7fb6880fccd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb678031460 tx=0x7fb6780048f0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 shutdown_connections 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb670077460 0x7fb670079920 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6881067f0 0x7fb6880fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 --2- 172.21.15.52:0/547004327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb6881007f0 0x7fb6880fccd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 >> 172.21.15.52:0/547004327 conn(0x7fb6880fc550 msgr2=0x7fb688069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 shutdown_connections 2024-09-06T14:58:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.804+0000 7fb68e875640 1 -- 172.21.15.52:0/547004327 wait complete. 2024-09-06T14:58:53.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:53 smithi052 ceph-mon[112917]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:53.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:53 smithi052 ceph-mon[112917]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:53.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:53 smithi052 ceph-mon[112917]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:53.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:53 smithi052 ceph-mon[112917]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:53.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:53 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/452856602' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:58:53.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:53 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2885738430' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:58:53.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 -- 172.21.15.52:0/1780752704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 msgr2=0x7effcc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 --2- 172.21.15.52:0/1780752704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc101d60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7effc0009880 tx=0x7effc002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 -- 172.21.15.52:0/1780752704 shutdown_connections 2024-09-06T14:58:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 --2- 172.21.15.52:0/1780752704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc101d60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 --2- 172.21.15.52:0/1780752704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effcc107900 0x7effcc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 -- 172.21.15.52:0/1780752704 >> 172.21.15.52:0/1780752704 conn(0x7effcc0fd600 msgr2=0x7effcc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 -- 172.21.15.52:0/1780752704 shutdown_connections 2024-09-06T14:58:53.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.887+0000 7effd2116640 1 -- 172.21.15.52:0/1780752704 wait complete. 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effd2116640 1 Processor -- start 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effd2116640 1 -- start start 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effd2116640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effd2116640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effcc107900 0x7effcc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effd2116640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7effcc10edd0 con 0x7effcc101900 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effd2116640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effcc10ec50 con 0x7effcc107900 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effcb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effcb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53890/0 (socket says 172.21.15.52:53890) 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effcb7fe640 1 -- 172.21.15.52:0/2934234438 learned_addr learned my addr 172.21.15.52:0/2934234438 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:58:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effcb7fe640 1 -- 172.21.15.52:0/2934234438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effcc107900 msgr2=0x7effcc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.888+0000 7effcb7fe640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effcc107900 0x7effcc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.889+0000 7effcb7fe640 1 -- 172.21.15.52:0/2934234438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc074f70 con 0x7effcc101900 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.889+0000 7effcb7fe640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc0744f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7effbc00c8f0 tx=0x7effbc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.889+0000 7effc8ff9640 1 -- 172.21.15.52:0/2934234438 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effbc0079b0 con 0x7effcc101900 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.889+0000 7effc8ff9640 1 -- 172.21.15.52:0/2934234438 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effbc0054e0 con 0x7effcc101900 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.889+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc075260 con 0x7effcc101900 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.889+0000 7effc8ff9640 1 -- 172.21.15.52:0/2934234438 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effbc004dd0 con 0x7effcc101900 2024-09-06T14:58:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.889+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc1a3e80 con 0x7effcc101900 2024-09-06T14:58:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.890+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effcc103040 con 0x7effcc101900 2024-09-06T14:58:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.891+0000 7effc8ff9640 1 -- 172.21.15.52:0/2934234438 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7effbc005020 con 0x7effcc101900 2024-09-06T14:58:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.891+0000 7effc8ff9640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7effb4077460 0x7effb4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:58:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.891+0000 7effcaffd640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7effb4077460 0x7effb4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:58:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.891+0000 7effc8ff9640 1 -- 172.21.15.52:0/2934234438 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7effbc0996c0 con 0x7effcc101900 2024-09-06T14:58:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.891+0000 7effcaffd640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7effb4077460 0x7effb4079920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7effc00096c0 tx=0x7effc0000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:58:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:53.895+0000 7effc8ff9640 1 -- 172.21.15.52:0/2934234438 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7effbc014030 con 0x7effcc101900 2024-09-06T14:58:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:53 smithi165 ceph-mon[82925]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:53 smithi165 ceph-mon[82925]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:54.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:53 smithi165 ceph-mon[82925]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:54.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:53 smithi165 ceph-mon[82925]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:54.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:53 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/452856602' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:58:54.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:53 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2885738430' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:58:54.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.118+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7effcc101d60 con 0x7effcc101900 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.118+0000 7effc8ff9640 1 -- 172.21.15.52:0/2934234438 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7effbc0626a0 con 0x7effcc101900 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:58:54.117 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:58:54.118 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:58:54.118 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:58:54.118 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:58:54.118 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:58:54.118 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:58:54.118 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:58:54.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7effb4077460 msgr2=0x7effb4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7effb4077460 0x7effb4079920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7effc00096c0 tx=0x7effc0000bc0 comp rx=0 tx=0).stop 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 msgr2=0x7effcc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc0744f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7effbc00c8f0 tx=0x7effbc00cdb0 comp rx=0 tx=0).stop 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 shutdown_connections 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7effb4077460 0x7effb4079920 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effcc107900 0x7effcc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 --2- 172.21.15.52:0/2934234438 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effcc101900 0x7effcc0744f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 >> 172.21.15.52:0/2934234438 conn(0x7effcc0fd600 msgr2=0x7effcc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 shutdown_connections 2024-09-06T14:58:54.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:58:54.120+0000 7effd2116640 1 -- 172.21.15.52:0/2934234438 wait complete. 2024-09-06T14:58:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:54 smithi165 ceph-mon[82925]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:55.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:54 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2934234438' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:58:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:54 smithi052 ceph-mon[112917]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:58:55.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:54 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2934234438' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:58:55.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:55 smithi052 ceph-mon[112917]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:56.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:55 smithi165 ceph-mon[82925]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:58.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:57 smithi165 ceph-mon[82925]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:58:58.100 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:57 smithi052 ceph-mon[112917]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:00.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:58:59 smithi165 ceph-mon[82925]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:00.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:58:59 smithi052 ceph-mon[112917]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:02.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:01 smithi165 ceph-mon[82925]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:02.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:01 smithi052 ceph-mon[112917]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:04.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:03 smithi165 ceph-mon[82925]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:04.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:03 smithi052 ceph-mon[112917]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:05.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:05 smithi052 ceph-mon[112917]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:06.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:05 smithi165 ceph-mon[82925]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:08.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:07 smithi165 ceph-mon[82925]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:08.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:08.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:07 smithi052 ceph-mon[112917]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:08.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:10.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:09 smithi165 ceph-mon[82925]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:10.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:09 smithi052 ceph-mon[112917]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:12.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:11 smithi052 ceph-mon[112917]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:12.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:11 smithi165 ceph-mon[82925]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:14.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:13 smithi052 ceph-mon[112917]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:14.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:13 smithi165 ceph-mon[82925]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:15.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:15 smithi052 ceph-mon[112917]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:16.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:15 smithi165 ceph-mon[82925]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:18.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:17 smithi052 ceph-mon[112917]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:18.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:17 smithi165 ceph-mon[82925]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:20.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:19 smithi052 ceph-mon[112917]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:20.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:19 smithi165 ceph-mon[82925]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:22.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:21 smithi052 ceph-mon[112917]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:22.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:21 smithi165 ceph-mon[82925]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:23.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:23.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:24.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:23 smithi052 ceph-mon[112917]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 -- 172.21.15.52:0/2915304578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 msgr2=0x7f6d70102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 --2- 172.21.15.52:0/2915304578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d70102e90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c009880 tx=0x7f6d6c02a540 comp rx=0 tx=0).stop 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 -- 172.21.15.52:0/2915304578 shutdown_connections 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 --2- 172.21.15.52:0/2915304578 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d701033d0 0x7f6d7010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 --2- 172.21.15.52:0/2915304578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d70102e90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 -- 172.21.15.52:0/2915304578 >> 172.21.15.52:0/2915304578 conn(0x7f6d700fc550 msgr2=0x7f6d700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 -- 172.21.15.52:0/2915304578 shutdown_connections 2024-09-06T14:59:24.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.217+0000 7f6d777c7640 1 -- 172.21.15.52:0/2915304578 wait complete. 2024-09-06T14:59:24.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d777c7640 1 Processor -- start 2024-09-06T14:59:24.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d777c7640 1 -- start start 2024-09-06T14:59:24.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d777c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d7019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d777c7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d701033d0 0x7f6d7019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d777c7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7010ee40 con 0x7f6d70102ab0 2024-09-06T14:59:24.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d777c7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7010ecc0 con 0x7f6d701033d0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d75563640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d7019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d75563640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d7019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33046/0 (socket says 172.21.15.52:33046) 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d75563640 1 -- 172.21.15.52:0/3483788739 learned_addr learned my addr 172.21.15.52:0/3483788739 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.218+0000 7f6d74d62640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d701033d0 0x7f6d7019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d75563640 1 -- 172.21.15.52:0/3483788739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d701033d0 msgr2=0x7f6d7019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d75563640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d701033d0 0x7f6d7019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d75563640 1 -- 172.21.15.52:0/3483788739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d70197810 con 0x7f6d70102ab0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d75563640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d7019d690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c031460 tx=0x7f6d6c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d667fc640 1 -- 172.21.15.52:0/3483788739 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d6c03f070 con 0x7f6d70102ab0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d667fc640 1 -- 172.21.15.52:0/3483788739 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d6c004cf0 con 0x7f6d70102ab0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d70197aa0 con 0x7f6d70102ab0 2024-09-06T14:59:24.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d667fc640 1 -- 172.21.15.52:0/3483788739 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d6c035030 con 0x7f6d70102ab0 2024-09-06T14:59:24.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.219+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d70197fd0 con 0x7f6d70102ab0 2024-09-06T14:59:24.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.220+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d7006a580 con 0x7f6d70102ab0 2024-09-06T14:59:24.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.221+0000 7f6d667fc640 1 -- 172.21.15.52:0/3483788739 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6d6c042070 con 0x7f6d70102ab0 2024-09-06T14:59:24.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.221+0000 7f6d667fc640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6d5c077460 0x7f6d5c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.221+0000 7f6d667fc640 1 -- 172.21.15.52:0/3483788739 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f6d6c0ba2d0 con 0x7f6d70102ab0 2024-09-06T14:59:24.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.222+0000 7f6d74d62640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6d5c077460 0x7f6d5c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.222+0000 7f6d74d62640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6d5c077460 0x7f6d5c079920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d700feff0 tx=0x7f6d60009060 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:24.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.226+0000 7f6d667fc640 1 -- 172.21.15.52:0/3483788739 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6d6c087300 con 0x7f6d70102ab0 2024-09-06T14:59:24.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:23 smithi165 ceph-mon[82925]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:24.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.404+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6d70198280 con 0x7f6d5c077460 2024-09-06T14:59:24.403 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.405+0000 7f6d667fc640 1 -- 172.21.15.52:0/3483788739 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6d70198280 con 0x7f6d5c077460 2024-09-06T14:59:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.406+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6d5c077460 msgr2=0x7f6d5c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.406+0000 7f6d777c7640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6d5c077460 0x7f6d5c079920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d700feff0 tx=0x7f6d60009060 comp rx=0 tx=0).stop 2024-09-06T14:59:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 msgr2=0x7f6d7019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d7019d690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c031460 tx=0x7f6d6c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 shutdown_connections 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6d5c077460 0x7f6d5c079920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6d701033d0 0x7f6d7019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 --2- 172.21.15.52:0/3483788739 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6d70102ab0 0x7f6d7019d690 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 >> 172.21.15.52:0/3483788739 conn(0x7f6d700fc550 msgr2=0x7f6d70108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 shutdown_connections 2024-09-06T14:59:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.407+0000 7f6d777c7640 1 -- 172.21.15.52:0/3483788739 wait complete. 2024-09-06T14:59:24.414 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:59:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 -- 172.21.15.52:0/1467595371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb00102ab0 msgr2=0x7fdb00102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1467595371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb00102ab0 0x7fdb00102e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009880 tx=0x7fdaf002a530 comp rx=0 tx=0).stop 2024-09-06T14:59:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 -- 172.21.15.52:0/1467595371 shutdown_connections 2024-09-06T14:59:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1467595371 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb001033d0 0x7fdb0010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1467595371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb00102ab0 0x7fdb00102e90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 -- 172.21.15.52:0/1467595371 >> 172.21.15.52:0/1467595371 conn(0x7fdb000fc550 msgr2=0x7fdb000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 -- 172.21.15.52:0/1467595371 shutdown_connections 2024-09-06T14:59:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 -- 172.21.15.52:0/1467595371 wait complete. 2024-09-06T14:59:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 Processor -- start 2024-09-06T14:59:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.491+0000 7fdb0694c640 1 -- start start 2024-09-06T14:59:24.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdb0694c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb00102ab0 0x7fdb0019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdb0694c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb001033d0 0x7fdb0019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdb0694c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0010ede0 con 0x7fdb001033d0 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdb0694c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0010ec60 con 0x7fdb00102ab0 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdaff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb001033d0 0x7fdb0019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdaff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb001033d0 0x7fdb0019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33062/0 (socket says 172.21.15.52:33062) 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdaff7fe640 1 -- 172.21.15.52:0/1814056282 learned_addr learned my addr 172.21.15.52:0/1814056282 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdafffff640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb00102ab0 0x7fdb0019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdaff7fe640 1 -- 172.21.15.52:0/1814056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb00102ab0 msgr2=0x7fdb0019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdaff7fe640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb00102ab0 0x7fdb0019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.492+0000 7fdaff7fe640 1 -- 172.21.15.52:0/1814056282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00199a20 con 0x7fdb001033d0 2024-09-06T14:59:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.493+0000 7fdaff7fe640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb001033d0 0x7fdb0019fd50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d6d0 tx=0x7fdaf400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.493+0000 7fdafd7fa640 1 -- 172.21.15.52:0/1814056282 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdaf4017070 con 0x7fdb001033d0 2024-09-06T14:59:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.493+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb00199d10 con 0x7fdb001033d0 2024-09-06T14:59:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.493+0000 7fdafd7fa640 1 -- 172.21.15.52:0/1814056282 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdaf40054e0 con 0x7fdb001033d0 2024-09-06T14:59:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.493+0000 7fdafd7fa640 1 -- 172.21.15.52:0/1814056282 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdaf4004ae0 con 0x7fdb001033d0 2024-09-06T14:59:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.493+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0019a2a0 con 0x7fdb001033d0 2024-09-06T14:59:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.494+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0006a580 con 0x7fdb001033d0 2024-09-06T14:59:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.495+0000 7fdafd7fa640 1 -- 172.21.15.52:0/1814056282 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fdaf4004de0 con 0x7fdb001033d0 2024-09-06T14:59:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.496+0000 7fdafd7fa640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdae8077460 0x7fdae8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.496+0000 7fdafd7fa640 1 -- 172.21.15.52:0/1814056282 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fdaf4099400 con 0x7fdb001033d0 2024-09-06T14:59:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.496+0000 7fdafffff640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdae8077460 0x7fdae8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.496+0000 7fdafffff640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdae8077460 0x7fdae8079920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000c00 tx=0x7fdaf0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:24.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.501+0000 7fdafd7fa640 1 -- 172.21.15.52:0/1814056282 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fdaf4062360 con 0x7fdb001033d0 2024-09-06T14:59:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.677+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdb0019af00 con 0x7fdae8077460 2024-09-06T14:59:24.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.678+0000 7fdafd7fa640 1 -- 172.21.15.52:0/1814056282 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fdb0019af00 con 0x7fdae8077460 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdae8077460 msgr2=0x7fdae8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdae8077460 0x7fdae8079920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000c00 tx=0x7fdaf0031400 comp rx=0 tx=0).stop 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb001033d0 msgr2=0x7fdb0019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb001033d0 0x7fdb0019fd50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d6d0 tx=0x7fdaf400db90 comp rx=0 tx=0).stop 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 shutdown_connections 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb001033d0 0x7fdb0019fd50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdae8077460 0x7fdae8079920 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 --2- 172.21.15.52:0/1814056282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb00102ab0 0x7fdb0019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 >> 172.21.15.52:0/1814056282 conn(0x7fdb000fc550 msgr2=0x7fdb00100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 shutdown_connections 2024-09-06T14:59:24.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.680+0000 7fdb0694c640 1 -- 172.21.15.52:0/1814056282 wait complete. 2024-09-06T14:59:24.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 -- 172.21.15.52:0/883765385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 msgr2=0x7ffa38107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/883765385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa38107ce0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009880 tx=0x7ffa2c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 -- 172.21.15.52:0/883765385 shutdown_connections 2024-09-06T14:59:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/883765385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa38101900 0x7ffa38101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/883765385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa38107ce0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 -- 172.21.15.52:0/883765385 >> 172.21.15.52:0/883765385 conn(0x7ffa380fd600 msgr2=0x7ffa380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 -- 172.21.15.52:0/883765385 shutdown_connections 2024-09-06T14:59:24.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.763+0000 7ffa3ec26640 1 -- 172.21.15.52:0/883765385 wait complete. 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3ec26640 1 Processor -- start 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3ec26640 1 -- start start 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3ec26640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa38101900 0x7ffa3819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3ec26640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa3819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3ec26640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3810ee30 con 0x7ffa38107900 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3ec26640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3810ecb0 con 0x7ffa38101900 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa3819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa37fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa3819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33084/0 (socket says 172.21.15.52:33084) 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa37fff640 1 -- 172.21.15.52:0/308513417 learned_addr learned my addr 172.21.15.52:0/308513417 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3c9c2640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa38101900 0x7ffa3819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa37fff640 1 -- 172.21.15.52:0/308513417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa38101900 msgr2=0x7ffa3819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa37fff640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa38101900 0x7ffa3819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa37fff640 1 -- 172.21.15.52:0/308513417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa38197860 con 0x7ffa38107900 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.764+0000 7ffa3c9c2640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa38101900 0x7ffa3819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.765+0000 7ffa37fff640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa3819dbe0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400b420 tx=0x7ffa2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.765+0000 7ffa35ffb640 1 -- 172.21.15.52:0/308513417 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa24011630 con 0x7ffa38107900 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.765+0000 7ffa35ffb640 1 -- 172.21.15.52:0/308513417 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa24016070 con 0x7ffa38107900 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.765+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa38197b50 con 0x7ffa38107900 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.765+0000 7ffa35ffb640 1 -- 172.21.15.52:0/308513417 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa24010d40 con 0x7ffa38107900 2024-09-06T14:59:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.765+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa381980e0 con 0x7ffa38107900 2024-09-06T14:59:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.766+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa38103040 con 0x7ffa38107900 2024-09-06T14:59:24.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.767+0000 7ffa35ffb640 1 -- 172.21.15.52:0/308513417 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ffa2401b460 con 0x7ffa38107900 2024-09-06T14:59:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.767+0000 7ffa35ffb640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffa280774b0 0x7ffa28079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.767+0000 7ffa35ffb640 1 -- 172.21.15.52:0/308513417 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ffa24098ec0 con 0x7ffa38107900 2024-09-06T14:59:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.767+0000 7ffa3c9c2640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffa280774b0 0x7ffa28079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.768+0000 7ffa3c9c2640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffa280774b0 0x7ffa28079970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006010 tx=0x7ffa2c004220 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:24.770 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.771+0000 7ffa35ffb640 1 -- 172.21.15.52:0/308513417 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ffa24021250 con 0x7ffa38107900 2024-09-06T14:59:24.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.942+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ffa38198d90 con 0x7ffa280774b0 2024-09-06T14:59:24.950 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.952+0000 7ffa35ffb640 1 -- 172.21.15.52:0/308513417 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ffa38198d90 con 0x7ffa280774b0 2024-09-06T14:59:24.951 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:59:24.951 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (11m) 6m ago 22m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:59:24.951 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (14m) 6m ago 22m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:59:24.951 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (14m) 5m ago 22m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:59:24.951 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (10m) 6m ago 22m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:59:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (10m) 5m ago 22m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:59:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (11m) 6m ago 22m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:59:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (6m) 6m ago 17m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:59:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (6m) 6m ago 17m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:59:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (5m) 5m ago 17m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:59:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (5m) 5m ago 17m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:59:24.952 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (14m) 6m ago 23m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (12m) 5m ago 21m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (10m) 6m ago 24m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (10m) 5m ago 21m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (12m) 6m ago 22m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (12m) 5m ago 21m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (9m) 6m ago 20m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (9m) 6m ago 20m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (8m) 6m ago 19m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (7m) 5m ago 19m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (7m) 5m ago 19m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (6m) 5m ago 18m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:59:24.953 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (12m) 6m ago 22m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:59:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffa280774b0 msgr2=0x7ffa28079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffa280774b0 0x7ffa28079970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c006010 tx=0x7ffa2c004220 comp rx=0 tx=0).stop 2024-09-06T14:59:24.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 msgr2=0x7ffa3819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa3819dbe0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400b420 tx=0x7ffa2400b8e0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 shutdown_connections 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa38107900 0x7ffa3819dbe0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ffa280774b0 0x7ffa28079970 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 --2- 172.21.15.52:0/308513417 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffa38101900 0x7ffa3819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 >> 172.21.15.52:0/308513417 conn(0x7ffa380fd600 msgr2=0x7ffa380fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 shutdown_connections 2024-09-06T14:59:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:24.954+0000 7ffa3ec26640 1 -- 172.21.15.52:0/308513417 wait complete. 2024-09-06T14:59:25.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.036+0000 7f8383984640 1 -- 172.21.15.52:0/909649516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c100650 msgr2=0x7f837c100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.036+0000 7f8383984640 1 --2- 172.21.15.52:0/909649516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c100650 0x7f837c100a30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f836c009880 tx=0x7f836c02a490 comp rx=0 tx=0).stop 2024-09-06T14:59:25.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.036+0000 7f8383984640 1 -- 172.21.15.52:0/909649516 shutdown_connections 2024-09-06T14:59:25.035 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.036+0000 7f8383984640 1 --2- 172.21.15.52:0/909649516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f837c101000 0x7f837c10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.036+0000 7f8383984640 1 --2- 172.21.15.52:0/909649516 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c100650 0x7f837c100a30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.036+0000 7f8383984640 1 -- 172.21.15.52:0/909649516 >> 172.21.15.52:0/909649516 conn(0x7f837c0fc520 msgr2=0x7f837c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:25.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 -- 172.21.15.52:0/909649516 shutdown_connections 2024-09-06T14:59:25.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 -- 172.21.15.52:0/909649516 wait complete. 2024-09-06T14:59:25.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 Processor -- start 2024-09-06T14:59:25.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 -- start start 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f837c100650 0x7f837c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c101000 0x7f837c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f837c110fb0 con 0x7f837c101000 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.037+0000 7f8383984640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f837c110e30 con 0x7f837c100650 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8380f1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c101000 0x7f837c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8380f1f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c101000 0x7f837c19fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33114/0 (socket says 172.21.15.52:33114) 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8380f1f640 1 -- 172.21.15.52:0/2813369994 learned_addr learned my addr 172.21.15.52:0/2813369994 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8381720640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f837c100650 0x7f837c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8380f1f640 1 -- 172.21.15.52:0/2813369994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f837c100650 msgr2=0x7f837c19f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8380f1f640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f837c100650 0x7f837c19f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8380f1f640 1 -- 172.21.15.52:0/2813369994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c199a40 con 0x7f837c101000 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8380f1f640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c101000 0x7f837c19fdc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f837800c8f0 tx=0x7f837800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f83727fc640 1 -- 172.21.15.52:0/2813369994 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83780079b0 con 0x7f837c101000 2024-09-06T14:59:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f83727fc640 1 -- 172.21.15.52:0/2813369994 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83780054e0 con 0x7f837c101000 2024-09-06T14:59:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837c199d30 con 0x7f837c101000 2024-09-06T14:59:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837c19a2c0 con 0x7f837c101000 2024-09-06T14:59:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.038+0000 7f83727fc640 1 -- 172.21.15.52:0/2813369994 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8378004dd0 con 0x7f837c101000 2024-09-06T14:59:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.040+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837c06aa90 con 0x7f837c101000 2024-09-06T14:59:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.040+0000 7f83727fc640 1 -- 172.21.15.52:0/2813369994 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8378005020 con 0x7f837c101000 2024-09-06T14:59:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.041+0000 7f83727fc640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8368077460 0x7f8368079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.041+0000 7f8381720640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8368077460 0x7f8368079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.041+0000 7f83727fc640 1 -- 172.21.15.52:0/2813369994 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f83780995f0 con 0x7f837c101000 2024-09-06T14:59:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.041+0000 7f8381720640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8368077460 0x7f8368079920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f836c000c00 tx=0x7f836c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.045+0000 7f83727fc640 1 -- 172.21.15.52:0/2813369994 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8378014030 con 0x7f837c101000 2024-09-06T14:59:25.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.266+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f837c19af70 con 0x7f837c101000 2024-09-06T14:59:25.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.266+0000 7f83727fc640 1 -- 172.21.15.52:0/2813369994 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8378066740 con 0x7f837c101000 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:25.266 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:59:25.267 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:59:25.268 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:59:25.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8368077460 msgr2=0x7f8368079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8368077460 0x7f8368079920 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f836c000c00 tx=0x7f836c031400 comp rx=0 tx=0).stop 2024-09-06T14:59:25.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c101000 msgr2=0x7f837c19fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c101000 0x7f837c19fdc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f837800c8f0 tx=0x7f837800cdb0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 shutdown_connections 2024-09-06T14:59:25.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f837c101000 0x7f837c19fdc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8368077460 0x7f8368079920 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 --2- 172.21.15.52:0/2813369994 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f837c100650 0x7f837c19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.268+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 >> 172.21.15.52:0/2813369994 conn(0x7f837c0fc520 msgr2=0x7f837c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:25.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.269+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 shutdown_connections 2024-09-06T14:59:25.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.269+0000 7f8383984640 1 -- 172.21.15.52:0/2813369994 wait complete. 2024-09-06T14:59:25.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 -- 172.21.15.52:0/152905043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904101900 msgr2=0x7f1904101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 --2- 172.21.15.52:0/152905043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904101900 0x7f1904101d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009880 tx=0x7f18f802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 -- 172.21.15.52:0/152905043 shutdown_connections 2024-09-06T14:59:25.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 --2- 172.21.15.52:0/152905043 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904101900 0x7f1904101d60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 --2- 172.21.15.52:0/152905043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1904107900 0x7f1904107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 -- 172.21.15.52:0/152905043 >> 172.21.15.52:0/152905043 conn(0x7f19040fd600 msgr2=0x7f19040ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:25.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 -- 172.21.15.52:0/152905043 shutdown_connections 2024-09-06T14:59:25.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.351+0000 7f1909a7c640 1 -- 172.21.15.52:0/152905043 wait complete. 2024-09-06T14:59:25.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1909a7c640 1 Processor -- start 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1909a7c640 1 -- start start 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1909a7c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1904101900 0x7f190419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1909a7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904107900 0x7f190419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1909a7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f190410edb0 con 0x7f1904107900 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1909a7c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f190410ec30 con 0x7f1904101900 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1902ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904107900 0x7f190419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1902ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904107900 0x7f190419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33140/0 (socket says 172.21.15.52:33140) 2024-09-06T14:59:25.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f1902ffd640 1 -- 172.21.15.52:0/3180020652 learned_addr learned my addr 172.21.15.52:0/3180020652 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.352+0000 7f19037fe640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1904101900 0x7f190419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1902ffd640 1 -- 172.21.15.52:0/3180020652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1904101900 msgr2=0x7f190419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1902ffd640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1904101900 0x7f190419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1902ffd640 1 -- 172.21.15.52:0/3180020652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1904197800 con 0x7f1904107900 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1902ffd640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904107900 0x7f190419dbc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18f8031460 tx=0x7f18f8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1900ff9640 1 -- 172.21.15.52:0/3180020652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18f803f070 con 0x7f1904107900 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1904197a90 con 0x7f1904107900 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1900ff9640 1 -- 172.21.15.52:0/3180020652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18f80035f0 con 0x7f1904107900 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1900ff9640 1 -- 172.21.15.52:0/3180020652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18f8035030 con 0x7f1904107900 2024-09-06T14:59:25.354 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.353+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1904197fc0 con 0x7f1904107900 2024-09-06T14:59:25.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.354+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1904103040 con 0x7f1904107900 2024-09-06T14:59:25.355 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.355+0000 7f1900ff9640 1 -- 172.21.15.52:0/3180020652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f18f8042070 con 0x7f1904107900 2024-09-06T14:59:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.355+0000 7f1900ff9640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f18ec0774b0 0x7f18ec079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.356+0000 7f1900ff9640 1 -- 172.21.15.52:0/3180020652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f18f80ba080 con 0x7f1904107900 2024-09-06T14:59:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.356+0000 7f19037fe640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f18ec0774b0 0x7f18ec079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.356+0000 7f19037fe640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f18ec0774b0 0x7f18ec079970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009bd0 tx=0x7f18f4005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.360+0000 7f1900ff9640 1 -- 172.21.15.52:0/3180020652 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f18f8087130 con 0x7f1904107900 2024-09-06T14:59:25.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.546+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1904198d30 con 0x7f1904107900 2024-09-06T14:59:25.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.547+0000 7f1900ff9640 1 -- 172.21.15.52:0/3180020652 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f18f808bb50 con 0x7f1904107900 2024-09-06T14:59:25.545 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:59:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:59:25.547 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:59:25.547 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:59:25.547 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:59:25.547 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:59:25.547 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:59:25.547 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:59:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:59:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:59:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:59:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:59:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:59:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:59:25.548 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:59:25.549 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:25.550 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:25.551 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:59:25.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f18ec0774b0 msgr2=0x7f18ec079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f18ec0774b0 0x7f18ec079970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009bd0 tx=0x7f18f4005f90 comp rx=0 tx=0).stop 2024-09-06T14:59:25.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904107900 msgr2=0x7f190419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904107900 0x7f190419dbc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18f8031460 tx=0x7f18f8004530 comp rx=0 tx=0).stop 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 shutdown_connections 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1904107900 0x7f190419dbc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f18ec0774b0 0x7f18ec079970 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 --2- 172.21.15.52:0/3180020652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1904101900 0x7f190419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 >> 172.21.15.52:0/3180020652 conn(0x7f19040fd600 msgr2=0x7f19040fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 shutdown_connections 2024-09-06T14:59:25.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.549+0000 7f1909a7c640 1 -- 172.21.15.52:0/3180020652 wait complete. 2024-09-06T14:59:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 -- 172.21.15.52:0/2158311125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac106800 msgr2=0x7fe5ac106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/2158311125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac106800 0x7fe5ac106be0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009880 tx=0x7fe59c02a4a0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 -- 172.21.15.52:0/2158311125 shutdown_connections 2024-09-06T14:59:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/2158311125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5ac100800 0x7fe5ac100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/2158311125 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac106800 0x7fe5ac106be0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 -- 172.21.15.52:0/2158311125 >> 172.21.15.52:0/2158311125 conn(0x7fe5ac0fc520 msgr2=0x7fe5ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 -- 172.21.15.52:0/2158311125 shutdown_connections 2024-09-06T14:59:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 -- 172.21.15.52:0/2158311125 wait complete. 2024-09-06T14:59:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 Processor -- start 2024-09-06T14:59:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.633+0000 7fe5b27f1640 1 -- start start 2024-09-06T14:59:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5b27f1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac100800 0x7fe5ac19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5b27f1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5ac106800 0x7fe5ac19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5b27f1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac10dcb0 con 0x7fe5ac100800 2024-09-06T14:59:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5b27f1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac10db30 con 0x7fe5ac106800 2024-09-06T14:59:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac100800 0x7fe5ac19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5abfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac100800 0x7fe5ac19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33148/0 (socket says 172.21.15.52:33148) 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5abfff640 1 -- 172.21.15.52:0/3203055604 learned_addr learned my addr 172.21.15.52:0/3203055604 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5ab7fe640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5ac106800 0x7fe5ac19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5abfff640 1 -- 172.21.15.52:0/3203055604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5ac106800 msgr2=0x7fe5ac19cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5abfff640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5ac106800 0x7fe5ac19cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5abfff640 1 -- 172.21.15.52:0/3203055604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac1966a0 con 0x7fe5ac100800 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.634+0000 7fe5abfff640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac100800 0x7fe5ac19c5d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe59c031460 tx=0x7fe59c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.635+0000 7fe5a97fa640 1 -- 172.21.15.52:0/3203055604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe59c03f070 con 0x7fe5ac100800 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.635+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac196930 con 0x7fe5ac100800 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.635+0000 7fe5a97fa640 1 -- 172.21.15.52:0/3203055604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe59c004cf0 con 0x7fe5ac100800 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.635+0000 7fe5a97fa640 1 -- 172.21.15.52:0/3203055604 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe59c035030 con 0x7fe5ac100800 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.635+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac196e30 con 0x7fe5ac100800 2024-09-06T14:59:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.636+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ac101f40 con 0x7fe5ac100800 2024-09-06T14:59:25.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.636+0000 7fe5a97fa640 1 -- 172.21.15.52:0/3203055604 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe59c042070 con 0x7fe5ac100800 2024-09-06T14:59:25.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.637+0000 7fe5a97fa640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe594077460 0x7fe594079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.637+0000 7fe5a97fa640 1 -- 172.21.15.52:0/3203055604 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe59c0ba2b0 con 0x7fe5ac100800 2024-09-06T14:59:25.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.637+0000 7fe5ab7fe640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe594077460 0x7fe594079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.637 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.637+0000 7fe5ab7fe640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe594077460 0x7fe594079920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac197ef0 tx=0x7fe5a000a4c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.641+0000 7fe5a97fa640 1 -- 172.21.15.52:0/3203055604 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe59c083210 con 0x7fe5ac100800 2024-09-06T14:59:25.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.818+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe5ac1971a0 con 0x7fe594077460 2024-09-06T14:59:25.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.820+0000 7fe5a97fa640 1 -- 172.21.15.52:0/3203055604 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe5ac1971a0 con 0x7fe594077460 2024-09-06T14:59:25.818 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:59:25.818 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:59:25.818 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:59:25.818 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:59:25.818 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:59:25.819 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.821+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe594077460 msgr2=0x7fe594079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe594077460 0x7fe594079920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac197ef0 tx=0x7fe5a000a4c0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac100800 msgr2=0x7fe5ac19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac100800 0x7fe5ac19c5d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe59c031460 tx=0x7fe59c0048f0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 shutdown_connections 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe594077460 0x7fe594079920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5ac106800 0x7fe5ac19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 --2- 172.21.15.52:0/3203055604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5ac100800 0x7fe5ac19c5d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 >> 172.21.15.52:0/3203055604 conn(0x7fe5ac0fc520 msgr2=0x7fe5ac0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:25.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 shutdown_connections 2024-09-06T14:59:25.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.822+0000 7fe5b27f1640 1 -- 172.21.15.52:0/3203055604 wait complete. 2024-09-06T14:59:25.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:25 smithi052 ceph-mon[112917]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:25.874 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:25 smithi052 ceph-mon[112917]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:25 smithi052 ceph-mon[112917]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:25 smithi052 ceph-mon[112917]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:25 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2813369994' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:59:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:25 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3180020652' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:59:25.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 -- 172.21.15.52:0/3099561664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 msgr2=0x7f35e410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 --2- 172.21.15.52:0/3099561664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e410b920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f35d80098b0 tx=0x7f35d802a560 comp rx=0 tx=0).stop 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 -- 172.21.15.52:0/3099561664 shutdown_connections 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 --2- 172.21.15.52:0/3099561664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e410b920 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 --2- 172.21.15.52:0/3099561664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e4102b10 0x7f35e4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 -- 172.21.15.52:0/3099561664 >> 172.21.15.52:0/3099561664 conn(0x7f35e40fc550 msgr2=0x7f35e40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 -- 172.21.15.52:0/3099561664 shutdown_connections 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.906+0000 7f35e9890640 1 -- 172.21.15.52:0/3099561664 wait complete. 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e9890640 1 Processor -- start 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e9890640 1 -- start start 2024-09-06T14:59:25.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e9890640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e4102b10 0x7f35e419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e9890640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e9890640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f35e410ede0 con 0x7f35e4103430 2024-09-06T14:59:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e9890640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f35e410ec60 con 0x7f35e4102b10 2024-09-06T14:59:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33162/0 (socket says 172.21.15.52:33162) 2024-09-06T14:59:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e27fc640 1 -- 172.21.15.52:0/3699748098 learned_addr learned my addr 172.21.15.52:0/3699748098 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:25.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e2ffd640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e4102b10 0x7f35e419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e27fc640 1 -- 172.21.15.52:0/3699748098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e4102b10 msgr2=0x7f35e419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e27fc640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e4102b10 0x7f35e419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.907+0000 7f35e27fc640 1 -- 172.21.15.52:0/3699748098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e41977f0 con 0x7f35e4103430 2024-09-06T14:59:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.908+0000 7f35e27fc640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e419dbb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f35d8031460 tx=0x7f35d80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.908+0000 7f35e888e640 1 -- 172.21.15.52:0/3699748098 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35d803f070 con 0x7f35e4103430 2024-09-06T14:59:25.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.908+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e4197a80 con 0x7f35e4103430 2024-09-06T14:59:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.908+0000 7f35e888e640 1 -- 172.21.15.52:0/3699748098 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35d80044d0 con 0x7f35e4103430 2024-09-06T14:59:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.908+0000 7f35e888e640 1 -- 172.21.15.52:0/3699748098 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35d8035030 con 0x7f35e4103430 2024-09-06T14:59:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.908+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e4197fb0 con 0x7f35e4103430 2024-09-06T14:59:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.909+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35e406a520 con 0x7f35e4103430 2024-09-06T14:59:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.910+0000 7f35e888e640 1 -- 172.21.15.52:0/3699748098 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f35d8042070 con 0x7f35e4103430 2024-09-06T14:59:25.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.910+0000 7f35e888e640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35cc077460 0x7f35cc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:25.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.910+0000 7f35e888e640 1 -- 172.21.15.52:0/3699748098 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f35d80ba190 con 0x7f35e4103430 2024-09-06T14:59:25.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.910+0000 7f35e2ffd640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35cc077460 0x7f35cc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:25.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.911+0000 7f35e2ffd640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35cc077460 0x7f35cc079920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35d40058c0 tx=0x7f35d400a250 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:25.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:25.914+0000 7f35e888e640 1 -- 172.21.15.52:0/3699748098 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f35d8004cf0 con 0x7f35e4103430 2024-09-06T14:59:26.126 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:25 smithi165 ceph-mon[82925]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:26.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:25 smithi165 ceph-mon[82925]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:26.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:25 smithi165 ceph-mon[82925]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:26.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:25 smithi165 ceph-mon[82925]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:26.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:25 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2813369994' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:59:26.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:25 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3180020652' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:59:26.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.134+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f35e4106010 con 0x7f35e4103430 2024-09-06T14:59:26.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.135+0000 7f35e888e640 1 -- 172.21.15.52:0/3699748098 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f35d8087260 con 0x7f35e4103430 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:59:26.134 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35cc077460 msgr2=0x7f35cc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35cc077460 0x7f35cc079920 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35d40058c0 tx=0x7f35d400a250 comp rx=0 tx=0).stop 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 msgr2=0x7f35e419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e419dbb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f35d8031460 tx=0x7f35d80048f0 comp rx=0 tx=0).stop 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 shutdown_connections 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f35e4103430 0x7f35e419dbb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35cc077460 0x7f35cc079920 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 --2- 172.21.15.52:0/3699748098 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f35e4102b10 0x7f35e419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 >> 172.21.15.52:0/3699748098 conn(0x7f35e40fc550 msgr2=0x7f35e4103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 shutdown_connections 2024-09-06T14:59:26.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:26.137+0000 7f35e9890640 1 -- 172.21.15.52:0/3699748098 wait complete. 2024-09-06T14:59:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:26 smithi052 ceph-mon[112917]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:26 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3699748098' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:59:27.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:26 smithi165 ceph-mon[82925]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:27.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:26 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3699748098' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:59:28.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:27 smithi052 ceph-mon[112917]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:28.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:27 smithi165 ceph-mon[82925]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:30.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:29 smithi052 ceph-mon[112917]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:30.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:29 smithi165 ceph-mon[82925]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:32.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:31 smithi052 ceph-mon[112917]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:32.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:31 smithi165 ceph-mon[82925]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:34.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:33 smithi165 ceph-mon[82925]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:34.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:33 smithi052 ceph-mon[112917]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:36.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:35 smithi052 ceph-mon[112917]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:36.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:35 smithi165 ceph-mon[82925]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:37 smithi052 ceph-mon[112917]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:38.227 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:38.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:37 smithi165 ceph-mon[82925]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:38.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:40.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:39 smithi052 ceph-mon[112917]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:40.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:39 smithi165 ceph-mon[82925]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:42.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:41 smithi165 ceph-mon[82925]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:42.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:41 smithi052 ceph-mon[112917]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:44.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:43 smithi052 ceph-mon[112917]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:44.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:43 smithi165 ceph-mon[82925]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:46.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:45 smithi052 ceph-mon[112917]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:46.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:45 smithi165 ceph-mon[82925]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:48.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:47 smithi165 ceph-mon[82925]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:48.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:47 smithi052 ceph-mon[112917]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:50.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:49 smithi165 ceph-mon[82925]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:50.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:49 smithi052 ceph-mon[112917]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:52.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:51 smithi052 ceph-mon[112917]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:52.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:51 smithi165 ceph-mon[82925]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:53.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:53.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T14:59:54.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:53 smithi165 ceph-mon[82925]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:54.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:53 smithi052 ceph-mon[112917]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 -- 172.21.15.52:0/1739767618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201067f0 msgr2=0x7f5720106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 --2- 172.21.15.52:0/1739767618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201067f0 0x7f5720106bd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5710009880 tx=0x7f571002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 -- 172.21.15.52:0/1739767618 shutdown_connections 2024-09-06T14:59:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 --2- 172.21.15.52:0/1739767618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57201007f0 0x7f5720100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 --2- 172.21.15.52:0/1739767618 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201067f0 0x7f5720106bd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 -- 172.21.15.52:0/1739767618 >> 172.21.15.52:0/1739767618 conn(0x7f57200fc550 msgr2=0x7f57200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:56.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 -- 172.21.15.52:0/1739767618 shutdown_connections 2024-09-06T14:59:56.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.233+0000 7f5726b0c640 1 -- 172.21.15.52:0/1739767618 wait complete. 2024-09-06T14:59:56.234 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:55 smithi052 ceph-mon[112917]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f5726b0c640 1 Processor -- start 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f5726b0c640 1 -- start start 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f5726b0c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201007f0 0x7f572019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f5726b0c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57201067f0 0x7f572019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f5726b0c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f572010dca0 con 0x7f57201007f0 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f5726b0c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f572010db20 con 0x7f57201067f0 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f57248a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201007f0 0x7f572019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f57248a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201007f0 0x7f572019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35790/0 (socket says 172.21.15.52:35790) 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f57248a8640 1 -- 172.21.15.52:0/4219592727 learned_addr learned my addr 172.21.15.52:0/4219592727 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f571ffff640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57201067f0 0x7f572019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f57248a8640 1 -- 172.21.15.52:0/4219592727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57201067f0 msgr2=0x7f572019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f57248a8640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57201067f0 0x7f572019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.234+0000 7f57248a8640 1 -- 172.21.15.52:0/4219592727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5720197750 con 0x7f57201007f0 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.235+0000 7f57248a8640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201007f0 0x7f572019d680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5710031460 tx=0x7f57100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.235+0000 7f571dffb640 1 -- 172.21.15.52:0/4219592727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f571003f070 con 0x7f57201007f0 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.235+0000 7f571dffb640 1 -- 172.21.15.52:0/4219592727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57100035f0 con 0x7f57201007f0 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.235+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57201979e0 con 0x7f57201007f0 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.235+0000 7f571dffb640 1 -- 172.21.15.52:0/4219592727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5710035030 con 0x7f57201007f0 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.235+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5720197ee0 con 0x7f57201007f0 2024-09-06T14:59:56.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.236+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5720101f30 con 0x7f57201007f0 2024-09-06T14:59:56.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.237+0000 7f571dffb640 1 -- 172.21.15.52:0/4219592727 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5710042070 con 0x7f57201007f0 2024-09-06T14:59:56.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.238+0000 7f571dffb640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5708077460 0x7f5708079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.238+0000 7f571ffff640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5708077460 0x7f5708079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.238+0000 7f571dffb640 1 -- 172.21.15.52:0/4219592727 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f57100ba160 con 0x7f57201007f0 2024-09-06T14:59:56.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.238+0000 7f571ffff640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5708077460 0x7f5708079920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5720198fa0 tx=0x7f571400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:56.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.242+0000 7f571dffb640 1 -- 172.21.15.52:0/4219592727 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5710087190 con 0x7f57201007f0 2024-09-06T14:59:56.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:55 smithi165 ceph-mon[82925]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:56.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.424+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5720198250 con 0x7f5708077460 2024-09-06T14:59:56.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.425+0000 7f571dffb640 1 -- 172.21.15.52:0/4219592727 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5720198250 con 0x7f5708077460 2024-09-06T14:59:56.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5708077460 msgr2=0x7f5708079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5708077460 0x7f5708079920 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5720198fa0 tx=0x7f571400b390 comp rx=0 tx=0).stop 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201007f0 msgr2=0x7f572019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201007f0 0x7f572019d680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5710031460 tx=0x7f57100045e0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 shutdown_connections 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5708077460 0x7f5708079920 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57201067f0 0x7f572019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 --2- 172.21.15.52:0/4219592727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57201007f0 0x7f572019d680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 >> 172.21.15.52:0/4219592727 conn(0x7f57200fc550 msgr2=0x7f5720069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:56.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 shutdown_connections 2024-09-06T14:59:56.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.427+0000 7f5726b0c640 1 -- 172.21.15.52:0/4219592727 wait complete. 2024-09-06T14:59:56.435 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T14:59:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 -- 172.21.15.52:0/937123208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 msgr2=0x7f01b4106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 --2- 172.21.15.52:0/937123208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4106a30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f01b0009880 tx=0x7f01b002a4a0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 -- 172.21.15.52:0/937123208 shutdown_connections 2024-09-06T14:59:56.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 --2- 172.21.15.52:0/937123208 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01b4100650 0x7f01b4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 --2- 172.21.15.52:0/937123208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4106a30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 -- 172.21.15.52:0/937123208 >> 172.21.15.52:0/937123208 conn(0x7f01b40fc350 msgr2=0x7f01b40fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 -- 172.21.15.52:0/937123208 shutdown_connections 2024-09-06T14:59:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.512+0000 7f01baba0640 1 -- 172.21.15.52:0/937123208 wait complete. 2024-09-06T14:59:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.513+0000 7f01baba0640 1 Processor -- start 2024-09-06T14:59:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.513+0000 7f01baba0640 1 -- start start 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.513+0000 7f01baba0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01b4100650 0x7f01b41966c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.513+0000 7f01baba0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4196c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.513+0000 7f01baba0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f01b410db20 con 0x7f01b4106650 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.513+0000 7f01baba0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01b410d9a0 con 0x7f01b4100650 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b939d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b939d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4196c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35810/0 (socket says 172.21.15.52:35810) 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b939d640 1 -- 172.21.15.52:0/4211709183 learned_addr learned my addr 172.21.15.52:0/4211709183 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b9b9e640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01b4100650 0x7f01b41966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b939d640 1 -- 172.21.15.52:0/4211709183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01b4100650 msgr2=0x7f01b41966c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b939d640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01b4100650 0x7f01b41966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b939d640 1 -- 172.21.15.52:0/4211709183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b419af90 con 0x7f01b4106650 2024-09-06T14:59:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01b939d640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4196c00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f01a400d6f0 tx=0x7f01a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01aaffd640 1 -- 172.21.15.52:0/4211709183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01a4017070 con 0x7f01b4106650 2024-09-06T14:59:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01aaffd640 1 -- 172.21.15.52:0/4211709183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01a400de00 con 0x7f01b4106650 2024-09-06T14:59:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b419b280 con 0x7f01b4106650 2024-09-06T14:59:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.514+0000 7f01aaffd640 1 -- 172.21.15.52:0/4211709183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01a4004bb0 con 0x7f01b4106650 2024-09-06T14:59:56.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.515+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b419b810 con 0x7f01b4106650 2024-09-06T14:59:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.516+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b4101d90 con 0x7f01b4106650 2024-09-06T14:59:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.516+0000 7f01aaffd640 1 -- 172.21.15.52:0/4211709183 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f01a4009a30 con 0x7f01b4106650 2024-09-06T14:59:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.517+0000 7f01aaffd640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f01a00774b0 0x7f01a0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.517+0000 7f01aaffd640 1 -- 172.21.15.52:0/4211709183 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f01a4099270 con 0x7f01b4106650 2024-09-06T14:59:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.517+0000 7f01b9b9e640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f01a00774b0 0x7f01a0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.517+0000 7f01b9b9e640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f01a00774b0 0x7f01a0079970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f01b00096c0 tx=0x7f01b0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:56.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.521+0000 7f01aaffd640 1 -- 172.21.15.52:0/4211709183 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f01a40663c0 con 0x7f01b4106650 2024-09-06T14:59:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.698+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f01b419bac0 con 0x7f01a00774b0 2024-09-06T14:59:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.699+0000 7f01aaffd640 1 -- 172.21.15.52:0/4211709183 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f01b419bac0 con 0x7f01a00774b0 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f01a00774b0 msgr2=0x7f01a0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f01a00774b0 0x7f01a0079970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f01b00096c0 tx=0x7f01b0031400 comp rx=0 tx=0).stop 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 msgr2=0x7f01b4196c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4196c00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f01a400d6f0 tx=0x7f01a400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 shutdown_connections 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01b4106650 0x7f01b4196c00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f01a00774b0 0x7f01a0079970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 --2- 172.21.15.52:0/4211709183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01b4100650 0x7f01b41966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 >> 172.21.15.52:0/4211709183 conn(0x7f01b40fc350 msgr2=0x7f01b40fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 shutdown_connections 2024-09-06T14:59:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.701+0000 7f01baba0640 1 -- 172.21.15.52:0/4211709183 wait complete. 2024-09-06T14:59:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.783+0000 7f8d0b588640 1 -- 172.21.15.52:0/3780507857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d041033e0 msgr2=0x7f8d0410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.783+0000 7f8d0b588640 1 --2- 172.21.15.52:0/3780507857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d041033e0 0x7f8d0410b8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009880 tx=0x7f8cf802a530 comp rx=0 tx=0).stop 2024-09-06T14:59:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.783+0000 7f8d0b588640 1 -- 172.21.15.52:0/3780507857 shutdown_connections 2024-09-06T14:59:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.783+0000 7f8d0b588640 1 --2- 172.21.15.52:0/3780507857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d041033e0 0x7f8d0410b8d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.783+0000 7f8d0b588640 1 --2- 172.21.15.52:0/3780507857 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d04102ac0 0x7f8d04102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.783+0000 7f8d0b588640 1 -- 172.21.15.52:0/3780507857 >> 172.21.15.52:0/3780507857 conn(0x7f8d040fc520 msgr2=0x7f8d040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 -- 172.21.15.52:0/3780507857 shutdown_connections 2024-09-06T14:59:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 -- 172.21.15.52:0/3780507857 wait complete. 2024-09-06T14:59:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 Processor -- start 2024-09-06T14:59:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 -- start start 2024-09-06T14:59:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d04102ac0 0x7f8d0419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d041033e0 0x7f8d0419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0410edd0 con 0x7f8d04102ac0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.784+0000 7f8d0b588640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0410ec50 con 0x7f8d041033e0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d09324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d04102ac0 0x7f8d0419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d09324640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d04102ac0 0x7f8d0419f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35822/0 (socket says 172.21.15.52:35822) 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d09324640 1 -- 172.21.15.52:0/2324701814 learned_addr learned my addr 172.21.15.52:0/2324701814 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d08b23640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d041033e0 0x7f8d0419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d09324640 1 -- 172.21.15.52:0/2324701814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d041033e0 msgr2=0x7f8d0419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d09324640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d041033e0 0x7f8d0419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d09324640 1 -- 172.21.15.52:0/2324701814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d041999c0 con 0x7f8d04102ac0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d09324640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d04102ac0 0x7f8d0419f800 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400db80 tx=0x7f8cf400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d027fc640 1 -- 172.21.15.52:0/2324701814 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8cf4017070 con 0x7f8d04102ac0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d027fc640 1 -- 172.21.15.52:0/2324701814 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8cf4003e30 con 0x7f8d04102ac0 2024-09-06T14:59:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d04199cb0 con 0x7f8d04102ac0 2024-09-06T14:59:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.785+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d0419a210 con 0x7f8d04102ac0 2024-09-06T14:59:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.786+0000 7f8d027fc640 1 -- 172.21.15.52:0/2324701814 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8cf4010460 con 0x7f8d04102ac0 2024-09-06T14:59:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.787+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d0406aa90 con 0x7f8d04102ac0 2024-09-06T14:59:56.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.787+0000 7f8d027fc640 1 -- 172.21.15.52:0/2324701814 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8cf400dc70 con 0x7f8d04102ac0 2024-09-06T14:59:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.788+0000 7f8d027fc640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8cec0774b0 0x7f8cec079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.788+0000 7f8d08b23640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8cec0774b0 0x7f8cec079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.788+0000 7f8d027fc640 1 -- 172.21.15.52:0/2324701814 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8cf40996a0 con 0x7f8d04102ac0 2024-09-06T14:59:56.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.789+0000 7f8d08b23640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8cec0774b0 0x7f8cec079970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d0419b1b0 tx=0x7f8cf8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:56.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.792+0000 7f8d027fc640 1 -- 172.21.15.52:0/2324701814 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8cf4020070 con 0x7f8d04102ac0 2024-09-06T14:59:56.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.959+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d0419aef0 con 0x7f8cec0774b0 2024-09-06T14:59:56.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.969+0000 7f8d027fc640 1 -- 172.21.15.52:0/2324701814 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8d0419aef0 con 0x7f8cec0774b0 2024-09-06T14:59:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T14:59:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (12m) 6m ago 23m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T14:59:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (15m) 6m ago 23m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T14:59:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (14m) 6m ago 22m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T14:59:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (10m) 6m ago 23m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T14:59:56.969 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (10m) 6m ago 22m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (11m) 6m ago 23m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (7m) 6m ago 18m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (6m) 6m ago 18m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (6m) 6m ago 18m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (6m) 6m ago 17m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (14m) 6m ago 24m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (13m) 6m ago 22m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (11m) 6m ago 24m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (10m) 6m ago 22m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (13m) 6m ago 23m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (13m) 6m ago 22m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (10m) 6m ago 21m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T14:59:56.970 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (9m) 6m ago 20m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T14:59:56.971 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (9m) 6m ago 20m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T14:59:56.971 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (8m) 6m ago 19m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T14:59:56.971 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (7m) 6m ago 19m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T14:59:56.971 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (7m) 6m ago 19m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T14:59:56.971 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (12m) 6m ago 22m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8cec0774b0 msgr2=0x7f8cec079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8cec0774b0 0x7f8cec079970 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d0419b1b0 tx=0x7f8cf8031400 comp rx=0 tx=0).stop 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d04102ac0 msgr2=0x7f8d0419f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d04102ac0 0x7f8d0419f800 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400db80 tx=0x7f8cf400b630 comp rx=0 tx=0).stop 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 shutdown_connections 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8cec0774b0 0x7f8cec079970 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d041033e0 0x7f8d0419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 --2- 172.21.15.52:0/2324701814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d04102ac0 0x7f8d0419f800 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 >> 172.21.15.52:0/2324701814 conn(0x7f8d040fc520 msgr2=0x7f8d04100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 shutdown_connections 2024-09-06T14:59:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:56.971+0000 7f8d0b588640 1 -- 172.21.15.52:0/2324701814 wait complete. 2024-09-06T14:59:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 -- 172.21.15.52:0/1996476725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4106800 msgr2=0x7f4be4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 --2- 172.21.15.52:0/1996476725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4106800 0x7f4be4106be0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009880 tx=0x7f4bd402a4a0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 -- 172.21.15.52:0/1996476725 shutdown_connections 2024-09-06T14:59:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 --2- 172.21.15.52:0/1996476725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4be4100800 0x7f4be4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 --2- 172.21.15.52:0/1996476725 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4106800 0x7f4be4106be0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 -- 172.21.15.52:0/1996476725 >> 172.21.15.52:0/1996476725 conn(0x7f4be40fc520 msgr2=0x7f4be40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 -- 172.21.15.52:0/1996476725 shutdown_connections 2024-09-06T14:59:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.053+0000 7f4be984e640 1 -- 172.21.15.52:0/1996476725 wait complete. 2024-09-06T14:59:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be984e640 1 Processor -- start 2024-09-06T14:59:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be984e640 1 -- start start 2024-09-06T14:59:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be984e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4100800 0x7f4be41987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be984e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4be4106800 0x7f4be4198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be984e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410dcd0 con 0x7f4be4100800 2024-09-06T14:59:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be984e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4be410db50 con 0x7f4be4106800 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4100800 0x7f4be41987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4100800 0x7f4be41987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35838/0 (socket says 172.21.15.52:35838) 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4be2ffd640 1 -- 172.21.15.52:0/1153841047 learned_addr learned my addr 172.21.15.52:0/1153841047 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.054+0000 7f4bdbfff640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4be4106800 0x7f4be4198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be2ffd640 1 -- 172.21.15.52:0/1153841047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4be4106800 msgr2=0x7f4be4198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be2ffd640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4be4106800 0x7f4be4198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be2ffd640 1 -- 172.21.15.52:0/1153841047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be4199360 con 0x7f4be4100800 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be2ffd640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4100800 0x7f4be41987d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4031460 tx=0x7f4bd40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be884c640 1 -- 172.21.15.52:0/1153841047 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bd403f070 con 0x7f4be4100800 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be884c640 1 -- 172.21.15.52:0/1153841047 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bd40035f0 con 0x7f4be4100800 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be41995f0 con 0x7f4be4100800 2024-09-06T14:59:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be884c640 1 -- 172.21.15.52:0/1153841047 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bd4035030 con 0x7f4be4100800 2024-09-06T14:59:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.055+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41a1ba0 con 0x7f4be4100800 2024-09-06T14:59:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.056+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be4101f40 con 0x7f4be4100800 2024-09-06T14:59:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.057+0000 7f4be884c640 1 -- 172.21.15.52:0/1153841047 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4bd4042070 con 0x7f4be4100800 2024-09-06T14:59:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.058+0000 7f4be884c640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bd0077460 0x7f4bd0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.058+0000 7f4bdbfff640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bd0077460 0x7f4bd0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.058+0000 7f4be884c640 1 -- 172.21.15.52:0/1153841047 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4bd40ba160 con 0x7f4be4100800 2024-09-06T14:59:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.059+0000 7f4bdbfff640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bd0077460 0x7f4bd0079920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4be406ad40 tx=0x7f4bcc00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.062+0000 7f4be884c640 1 -- 172.21.15.52:0/1153841047 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4bd4087190 con 0x7f4be4100800 2024-09-06T14:59:57.282 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.283+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4be4108d70 con 0x7f4be4100800 2024-09-06T14:59:57.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.283+0000 7f4be884c640 1 -- 172.21.15.52:0/1153841047 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4bd408bbb0 con 0x7f4be4100800 2024-09-06T14:59:57.283 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:59:57.283 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T14:59:57.283 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:59:57.283 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T14:59:57.284 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T14:59:57.285 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:59:57.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bd0077460 msgr2=0x7f4bd0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bd0077460 0x7f4bd0079920 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4be406ad40 tx=0x7f4bcc00b390 comp rx=0 tx=0).stop 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4100800 msgr2=0x7f4be41987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4100800 0x7f4be41987d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4031460 tx=0x7f4bd40045e0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 shutdown_connections 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bd0077460 0x7f4bd0079920 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4be4106800 0x7f4be4198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 --2- 172.21.15.52:0/1153841047 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4be4100800 0x7f4be41987d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.285+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 >> 172.21.15.52:0/1153841047 conn(0x7f4be40fc520 msgr2=0x7f4be40fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.286+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 shutdown_connections 2024-09-06T14:59:57.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.286+0000 7f4be984e640 1 -- 172.21.15.52:0/1153841047 wait complete. 2024-09-06T14:59:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 -- 172.21.15.52:0/2496890504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 msgr2=0x7f10fc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 --2- 172.21.15.52:0/2496890504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc106be0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009880 tx=0x7f10f802a4a0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 -- 172.21.15.52:0/2496890504 shutdown_connections 2024-09-06T14:59:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 --2- 172.21.15.52:0/2496890504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc100800 0x7f10fc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 --2- 172.21.15.52:0/2496890504 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc106be0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 -- 172.21.15.52:0/2496890504 >> 172.21.15.52:0/2496890504 conn(0x7f10fc0fc520 msgr2=0x7f10fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 -- 172.21.15.52:0/2496890504 shutdown_connections 2024-09-06T14:59:57.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.368+0000 7f1104747640 1 -- 172.21.15.52:0/2496890504 wait complete. 2024-09-06T14:59:57.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1104747640 1 Processor -- start 2024-09-06T14:59:57.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1104747640 1 -- start start 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1104747640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc100800 0x7f10fc19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1104747640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1104747640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10dcb0 con 0x7f10fc106800 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1104747640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc10db30 con 0x7f10fc100800 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1101ce2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1101ce2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35852/0 (socket says 172.21.15.52:35852) 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f1101ce2640 1 -- 172.21.15.52:0/964177977 learned_addr learned my addr 172.21.15.52:0/964177977 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.369+0000 7f11024e3640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc100800 0x7f10fc19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f1101ce2640 1 -- 172.21.15.52:0/964177977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc100800 msgr2=0x7f10fc19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f1101ce2640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc100800 0x7f10fc19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f1101ce2640 1 -- 172.21.15.52:0/964177977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc1999c0 con 0x7f10fc106800 2024-09-06T14:59:57.371 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f1101ce2640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc19fd40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00d8d0 tx=0x7f10ec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f10f37fe640 1 -- 172.21.15.52:0/964177977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10ec017030 con 0x7f10fc106800 2024-09-06T14:59:57.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f10f37fe640 1 -- 172.21.15.52:0/964177977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10ec004020 con 0x7f10fc106800 2024-09-06T14:59:57.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc199cb0 con 0x7f10fc106800 2024-09-06T14:59:57.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f10f37fe640 1 -- 172.21.15.52:0/964177977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10ec0047a0 con 0x7f10fc106800 2024-09-06T14:59:57.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.370+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc19a240 con 0x7f10fc106800 2024-09-06T14:59:57.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.371+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10fc101f40 con 0x7f10fc106800 2024-09-06T14:59:57.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.372+0000 7f10f37fe640 1 -- 172.21.15.52:0/964177977 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f10ec0041d0 con 0x7f10fc106800 2024-09-06T14:59:57.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.372+0000 7f10f37fe640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f10e80774b0 0x7f10e8079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.373+0000 7f11024e3640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f10e80774b0 0x7f10e8079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.373+0000 7f10f37fe640 1 -- 172.21.15.52:0/964177977 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f10ec018070 con 0x7f10fc106800 2024-09-06T14:59:57.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.373+0000 7f11024e3640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f10e80774b0 0x7f10e8079970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f10f8000c00 tx=0x7f10f8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.376+0000 7f10f37fe640 1 -- 172.21.15.52:0/964177977 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f10ec062490 con 0x7f10fc106800 2024-09-06T14:59:57.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.565+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f10fc19afd0 con 0x7f10fc106800 2024-09-06T14:59:57.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.565+0000 7f10f37fe640 1 -- 172.21.15.52:0/964177977 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f10fc19afd0 con 0x7f10fc106800 2024-09-06T14:59:57.565 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T14:59:57.565 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T14:59:57.565 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T14:59:57.566 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T14:59:57.567 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T14:59:57.568 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:57.569 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:57.569 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:57.569 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f10e80774b0 msgr2=0x7f10e8079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f10e80774b0 0x7f10e8079970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f10f8000c00 tx=0x7f10f8031400 comp rx=0 tx=0).stop 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 msgr2=0x7f10fc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc19fd40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00d8d0 tx=0x7f10ec00dd90 comp rx=0 tx=0).stop 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 shutdown_connections 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10fc106800 0x7f10fc19fd40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f10e80774b0 0x7f10e8079970 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 --2- 172.21.15.52:0/964177977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc100800 0x7f10fc19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 >> 172.21.15.52:0/964177977 conn(0x7f10fc0fc520 msgr2=0x7f10fc06a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:57.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 shutdown_connections 2024-09-06T14:59:57.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.567+0000 7f1104747640 1 -- 172.21.15.52:0/964177977 wait complete. 2024-09-06T14:59:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 -- 172.21.15.52:0/180139126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37041028b0 msgr2=0x7f37040ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 --2- 172.21.15.52:0/180139126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37041028b0 0x7f37040ffdc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3700009880 tx=0x7f370002a530 comp rx=0 tx=0).stop 2024-09-06T14:59:57.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 -- 172.21.15.52:0/180139126 shutdown_connections 2024-09-06T14:59:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 --2- 172.21.15.52:0/180139126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3704102c90 0x7f3704100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 --2- 172.21.15.52:0/180139126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37041028b0 0x7f37040ffdc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 -- 172.21.15.52:0/180139126 >> 172.21.15.52:0/180139126 conn(0x7f37040fbc90 msgr2=0x7f37040fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 -- 172.21.15.52:0/180139126 shutdown_connections 2024-09-06T14:59:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.651+0000 7f370b869640 1 -- 172.21.15.52:0/180139126 wait complete. 2024-09-06T14:59:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f370b869640 1 Processor -- start 2024-09-06T14:59:57.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f370b869640 1 -- start start 2024-09-06T14:59:57.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f370b869640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041028b0 0x7f370419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f370b869640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3704102c90 0x7f370419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f370b869640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3704111000 con 0x7f3704102c90 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f370b869640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3704110e80 con 0x7f37041028b0 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f3708e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3704102c90 0x7f370419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f3708e04640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3704102c90 0x7f370419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35874/0 (socket says 172.21.15.52:35874) 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f3708e04640 1 -- 172.21.15.52:0/3260508328 learned_addr learned my addr 172.21.15.52:0/3260508328 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.652+0000 7f3709605640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041028b0 0x7f370419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f3708e04640 1 -- 172.21.15.52:0/3260508328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041028b0 msgr2=0x7f370419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f3708e04640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041028b0 0x7f370419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f3708e04640 1 -- 172.21.15.52:0/3260508328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3704199990 con 0x7f3704102c90 2024-09-06T14:59:57.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f3708e04640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3704102c90 0x7f370419fd10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f36f400d6f0 tx=0x7f36f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f36fa7fc640 1 -- 172.21.15.52:0/3260508328 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36f4017070 con 0x7f3704102c90 2024-09-06T14:59:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3704199c80 con 0x7f3704102c90 2024-09-06T14:59:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f36fa7fc640 1 -- 172.21.15.52:0/3260508328 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36f400de00 con 0x7f3704102c90 2024-09-06T14:59:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f36fa7fc640 1 -- 172.21.15.52:0/3260508328 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36f400f3c0 con 0x7f3704102c90 2024-09-06T14:59:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.653+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370419a210 con 0x7f3704102c90 2024-09-06T14:59:57.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.654+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3704100fe0 con 0x7f3704102c90 2024-09-06T14:59:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.655+0000 7f36fa7fc640 1 -- 172.21.15.52:0/3260508328 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f36f401a070 con 0x7f3704102c90 2024-09-06T14:59:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.655+0000 7f36fa7fc640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f36f00774b0 0x7f36f0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.655+0000 7f36fa7fc640 1 -- 172.21.15.52:0/3260508328 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f36f4099330 con 0x7f3704102c90 2024-09-06T14:59:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.655+0000 7f3709605640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f36f00774b0 0x7f36f0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.656+0000 7f3709605640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f36f00774b0 0x7f36f0079970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3700000c00 tx=0x7f3700031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.659+0000 7f36fa7fc640 1 -- 172.21.15.52:0/3260508328 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f36f4021030 con 0x7f3704102c90 2024-09-06T14:59:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.837+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f370419aec0 con 0x7f36f00774b0 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.838+0000 7f36fa7fc640 1 -- 172.21.15.52:0/3260508328 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f370419aec0 con 0x7f36f00774b0 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T14:59:57.838 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T14:59:57.839 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T14:59:57.839 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T14:59:57.839 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T14:59:57.839 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T14:59:57.839 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T14:59:57.839 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T14:59:57.839 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T14:59:57.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f36f00774b0 msgr2=0x7f36f0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f36f00774b0 0x7f36f0079970 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3700000c00 tx=0x7f3700031400 comp rx=0 tx=0).stop 2024-09-06T14:59:57.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3704102c90 msgr2=0x7f370419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3704102c90 0x7f370419fd10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f36f400d6f0 tx=0x7f36f400dbb0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 shutdown_connections 2024-09-06T14:59:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3704102c90 0x7f370419fd10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f36f00774b0 0x7f36f0079970 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 --2- 172.21.15.52:0/3260508328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37041028b0 0x7f370419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 >> 172.21.15.52:0/3260508328 conn(0x7f37040fbc90 msgr2=0x7f37040fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 shutdown_connections 2024-09-06T14:59:57.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.840+0000 7f370b869640 1 -- 172.21.15.52:0/3260508328 wait complete. 2024-09-06T14:59:57.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 -- 172.21.15.52:0/3975823761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c107900 msgr2=0x7fc34c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 --2- 172.21.15.52:0/3975823761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c107900 0x7fc34c107ce0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009c20 tx=0x7fc33c02a970 comp rx=0 tx=0).stop 2024-09-06T14:59:57.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 -- 172.21.15.52:0/3975823761 shutdown_connections 2024-09-06T14:59:57.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 --2- 172.21.15.52:0/3975823761 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34c101900 0x7fc34c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 --2- 172.21.15.52:0/3975823761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c107900 0x7fc34c107ce0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 -- 172.21.15.52:0/3975823761 >> 172.21.15.52:0/3975823761 conn(0x7fc34c0fd600 msgr2=0x7fc34c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:57.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 -- 172.21.15.52:0/3975823761 shutdown_connections 2024-09-06T14:59:57.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 -- 172.21.15.52:0/3975823761 wait complete. 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 Processor -- start 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.925+0000 7fc354231640 1 -- start start 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc354231640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c101900 0x7fc34c19d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc354231640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34c107900 0x7fc34c19dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc354231640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c10ee30 con 0x7fc34c101900 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc354231640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c10ecb0 con 0x7fc34c107900 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc351fcd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c101900 0x7fc34c19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc351fcd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c101900 0x7fc34c19d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35894/0 (socket says 172.21.15.52:35894) 2024-09-06T14:59:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc351fcd640 1 -- 172.21.15.52:0/3981026479 learned_addr learned my addr 172.21.15.52:0/3981026479 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc3517cc640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34c107900 0x7fc34c19dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc351fcd640 1 -- 172.21.15.52:0/3981026479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34c107900 msgr2=0x7fc34c19dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc351fcd640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34c107900 0x7fc34c19dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc351fcd640 1 -- 172.21.15.52:0/3981026479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34c197940 con 0x7fc34c101900 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc351fcd640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c101900 0x7fc34c19d780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc33c005cc0 tx=0x7fc33c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc34affd640 1 -- 172.21.15.52:0/3981026479 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc33c047070 con 0x7fc34c101900 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc34affd640 1 -- 172.21.15.52:0/3981026479 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc33c02f7e0 con 0x7fc34c101900 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34c197bd0 con 0x7fc34c101900 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc34affd640 1 -- 172.21.15.52:0/3981026479 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc33c034070 con 0x7fc34c101900 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.926+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34c198100 con 0x7fc34c101900 2024-09-06T14:59:57.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.927+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34c103040 con 0x7fc34c101900 2024-09-06T14:59:57.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.928+0000 7fc34affd640 1 -- 172.21.15.52:0/3981026479 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc33c04a070 con 0x7fc34c101900 2024-09-06T14:59:57.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.928+0000 7fc34affd640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3340774b0 0x7fc334079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T14:59:57.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.929+0000 7fc34affd640 1 -- 172.21.15.52:0/3981026479 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc33c0ba610 con 0x7fc34c101900 2024-09-06T14:59:57.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.929+0000 7fc3517cc640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3340774b0 0x7fc334079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T14:59:57.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.929+0000 7fc3517cc640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3340774b0 0x7fc334079970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc34c106fb0 tx=0x7fc340008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T14:59:57.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:57.933+0000 7fc34affd640 1 -- 172.21.15.52:0/3981026479 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc33c03f070 con 0x7fc34c101900 2024-09-06T14:59:58.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.154+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc34c109e70 con 0x7fc34c101900 2024-09-06T14:59:58.155 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:57 smithi052 ceph-mon[112917]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:58.155 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:57 smithi052 ceph-mon[112917]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:58.155 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:57 smithi052 ceph-mon[112917]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:58.155 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:57 smithi052 ceph-mon[112917]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:58.155 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:57 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1153841047' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:59:58.155 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:57 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/964177977' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:59:58.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.155+0000 7fc34affd640 1 -- 172.21.15.52:0/3981026479 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7fc33c0835f0 con 0x7fc34c101900 2024-09-06T14:59:58.155 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T14:59:58.156 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T14:59:58.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3340774b0 msgr2=0x7fc334079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:58.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3340774b0 0x7fc334079970 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc34c106fb0 tx=0x7fc340008040 comp rx=0 tx=0).stop 2024-09-06T14:59:58.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c101900 msgr2=0x7fc34c19d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T14:59:58.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c101900 0x7fc34c19d780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc33c005cc0 tx=0x7fc33c02f5f0 comp rx=0 tx=0).stop 2024-09-06T14:59:58.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 shutdown_connections 2024-09-06T14:59:58.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3340774b0 0x7fc334079970 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:58.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc34c107900 0x7fc34c19dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:58.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 --2- 172.21.15.52:0/3981026479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc34c101900 0x7fc34c19d780 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T14:59:58.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 >> 172.21.15.52:0/3981026479 conn(0x7fc34c0fd600 msgr2=0x7fc34c0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T14:59:58.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 shutdown_connections 2024-09-06T14:59:58.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T14:59:58.157+0000 7fc354231640 1 -- 172.21.15.52:0/3981026479 wait complete. 2024-09-06T14:59:58.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:57 smithi165 ceph-mon[82925]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T14:59:58.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:57 smithi165 ceph-mon[82925]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:58.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:57 smithi165 ceph-mon[82925]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:57 smithi165 ceph-mon[82925]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:57 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1153841047' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T14:59:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:57 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/964177977' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T14:59:59.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:58 smithi165 ceph-mon[82925]: from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:59.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:58 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3981026479' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T14:59:59.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:58 smithi052 ceph-mon[112917]: from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T14:59:59.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:58 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3981026479' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:00:00.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 14:59:59 smithi165 ceph-mon[82925]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 14:59:59 smithi052 ceph-mon[112917]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:00:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:00:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : [WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:00:00.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:00:00.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T14:59:59.998+0000 7f5058106640 -1 log_channel(cluster) log [ERR] : mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:00:01.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:00:01.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:00:01.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: fs cephfs is degraded 2024-09-06T15:00:01.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:00:01.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:00:01.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:00:01.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:00:01.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:01.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:01.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: [WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:00:01.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:00:01.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:00:01.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:00:01.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:00:01.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:00:01.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:00:01.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: fs cephfs is degraded 2024-09-06T15:00:01.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: [WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:00:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:00:02.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:01 smithi165 ceph-mon[82925]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:02.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:01 smithi052 ceph-mon[112917]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:04.177 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:03 smithi052 ceph-mon[112917]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:03 smithi165 ceph-mon[82925]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:06.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:05 smithi165 ceph-mon[82925]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:06.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:05 smithi052 ceph-mon[112917]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:08.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:07 smithi165 ceph-mon[82925]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:08.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:08.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:07 smithi052 ceph-mon[112917]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:08.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:10.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:09 smithi052 ceph-mon[112917]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:10.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:09 smithi165 ceph-mon[82925]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:12.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:11 smithi165 ceph-mon[82925]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:12.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:11 smithi052 ceph-mon[112917]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:14.237 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:13 smithi052 ceph-mon[112917]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:14.299 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:13 smithi165 ceph-mon[82925]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:16.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:15 smithi052 ceph-mon[112917]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:16.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:15 smithi165 ceph-mon[82925]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:18.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:17 smithi165 ceph-mon[82925]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:17 smithi052 ceph-mon[112917]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:20.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:19 smithi165 ceph-mon[82925]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:20.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:19 smithi052 ceph-mon[112917]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:22.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:21 smithi052 ceph-mon[112917]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:22.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:21 smithi165 ceph-mon[82925]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:23.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:23.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:24.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:23 smithi165 ceph-mon[82925]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:24.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:23 smithi052 ceph-mon[112917]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:26.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:25 smithi165 ceph-mon[82925]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:26.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:25 smithi052 ceph-mon[112917]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:28.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:27 smithi052 ceph-mon[112917]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 -- 172.21.15.52:0/2660716090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150101900 msgr2=0x7ff150101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 --2- 172.21.15.52:0/2660716090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150101900 0x7ff150101d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff140009880 tx=0x7ff14002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 -- 172.21.15.52:0/2660716090 shutdown_connections 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 --2- 172.21.15.52:0/2660716090 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150101900 0x7ff150101d60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 --2- 172.21.15.52:0/2660716090 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff150107900 0x7ff150107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 -- 172.21.15.52:0/2660716090 >> 172.21.15.52:0/2660716090 conn(0x7ff1500fd600 msgr2=0x7ff1500ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 -- 172.21.15.52:0/2660716090 shutdown_connections 2024-09-06T15:00:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 -- 172.21.15.52:0/2660716090 wait complete. 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.256+0000 7ff157b8f640 1 Processor -- start 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff157b8f640 1 -- start start 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff157b8f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff150101900 0x7ff15019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff157b8f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150107900 0x7ff15019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff157b8f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010edd0 con 0x7ff150107900 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff157b8f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010ec50 con 0x7ff150101900 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15512a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150107900 0x7ff15019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15512a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150107900 0x7ff15019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44776/0 (socket says 172.21.15.52:44776) 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15512a640 1 -- 172.21.15.52:0/353737322 learned_addr learned my addr 172.21.15.52:0/353737322 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15592b640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff150101900 0x7ff15019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15512a640 1 -- 172.21.15.52:0/353737322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff150101900 msgr2=0x7ff15019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15512a640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff150101900 0x7ff15019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15512a640 1 -- 172.21.15.52:0/353737322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1501977a0 con 0x7ff150107900 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.257+0000 7ff15512a640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150107900 0x7ff15019db60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff140031460 tx=0x7ff140004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.258+0000 7ff146ffd640 1 -- 172.21.15.52:0/353737322 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff14003f070 con 0x7ff150107900 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.258+0000 7ff146ffd640 1 -- 172.21.15.52:0/353737322 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff1400035f0 con 0x7ff150107900 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.258+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff150197a30 con 0x7ff150107900 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.258+0000 7ff146ffd640 1 -- 172.21.15.52:0/353737322 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff140035030 con 0x7ff150107900 2024-09-06T15:00:28.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.258+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff150197f60 con 0x7ff150107900 2024-09-06T15:00:28.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.259+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff150103040 con 0x7ff150107900 2024-09-06T15:00:28.259 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.259+0000 7ff146ffd640 1 -- 172.21.15.52:0/353737322 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff140042070 con 0x7ff150107900 2024-09-06T15:00:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.260+0000 7ff146ffd640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff13c0774b0 0x7ff13c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.260+0000 7ff146ffd640 1 -- 172.21.15.52:0/353737322 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ff1400ba090 con 0x7ff150107900 2024-09-06T15:00:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.260+0000 7ff15592b640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff13c0774b0 0x7ff13c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.260 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.261+0000 7ff15592b640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff13c0774b0 0x7ff13c079970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009b60 tx=0x7ff14c005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:28.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.264+0000 7ff146ffd640 1 -- 172.21.15.52:0/353737322 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff140083070 con 0x7ff150107900 2024-09-06T15:00:28.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:27 smithi165 ceph-mon[82925]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:28.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.442+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff150198210 con 0x7ff13c0774b0 2024-09-06T15:00:28.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.443+0000 7ff146ffd640 1 -- 172.21.15.52:0/353737322 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff150198210 con 0x7ff13c0774b0 2024-09-06T15:00:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff13c0774b0 msgr2=0x7ff13c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff13c0774b0 0x7ff13c079970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009b60 tx=0x7ff14c005f90 comp rx=0 tx=0).stop 2024-09-06T15:00:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150107900 msgr2=0x7ff15019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150107900 0x7ff15019db60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff140031460 tx=0x7ff140004530 comp rx=0 tx=0).stop 2024-09-06T15:00:28.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 shutdown_connections 2024-09-06T15:00:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff150107900 0x7ff15019db60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff13c0774b0 0x7ff13c079970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 --2- 172.21.15.52:0/353737322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff150101900 0x7ff15019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 >> 172.21.15.52:0/353737322 conn(0x7ff1500fd600 msgr2=0x7ff1500fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.445+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 shutdown_connections 2024-09-06T15:00:28.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.446+0000 7ff157b8f640 1 -- 172.21.15.52:0/353737322 wait complete. 2024-09-06T15:00:28.453 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:00:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.529+0000 7fa7e8af2640 1 -- 172.21.15.52:0/853037059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 msgr2=0x7fa7e410dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.529+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/853037059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e410dc80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009880 tx=0x7fa7d802a530 comp rx=0 tx=0).stop 2024-09-06T15:00:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.529+0000 7fa7e8af2640 1 -- 172.21.15.52:0/853037059 shutdown_connections 2024-09-06T15:00:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.529+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/853037059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e410dc80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.529+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/853037059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4074510 0x7fa7e40748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.529+0000 7fa7e8af2640 1 -- 172.21.15.52:0/853037059 >> 172.21.15.52:0/853037059 conn(0x7fa7e40fd600 msgr2=0x7fa7e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.530+0000 7fa7e8af2640 1 -- 172.21.15.52:0/853037059 shutdown_connections 2024-09-06T15:00:28.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.530+0000 7fa7e8af2640 1 -- 172.21.15.52:0/853037059 wait complete. 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.530+0000 7fa7e8af2640 1 Processor -- start 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e8af2640 1 -- start start 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e8af2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4074510 0x7fa7e419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e8af2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e8af2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4110fe0 con 0x7fa7e4074e30 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e8af2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e4110e60 con 0x7fa7e4074510 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44806/0 (socket says 172.21.15.52:44806) 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e1d9b640 1 -- 172.21.15.52:0/3265810058 learned_addr learned my addr 172.21.15.52:0/3265810058 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e259c640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4074510 0x7fa7e419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e1d9b640 1 -- 172.21.15.52:0/3265810058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4074510 msgr2=0x7fa7e419f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e1d9b640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4074510 0x7fa7e419f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.531+0000 7fa7e1d9b640 1 -- 172.21.15.52:0/3265810058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e41999d0 con 0x7fa7e4074e30 2024-09-06T15:00:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.532+0000 7fa7e1d9b640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e419fd50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8031460 tx=0x7fa7d8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.532+0000 7fa7d37fe640 1 -- 172.21.15.52:0/3265810058 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7d803f070 con 0x7fa7e4074e30 2024-09-06T15:00:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.532+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e4199c60 con 0x7fa7e4074e30 2024-09-06T15:00:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.532+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e419a190 con 0x7fa7e4074e30 2024-09-06T15:00:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.532+0000 7fa7d37fe640 1 -- 172.21.15.52:0/3265810058 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7d80035f0 con 0x7fa7e4074e30 2024-09-06T15:00:28.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.532+0000 7fa7d37fe640 1 -- 172.21.15.52:0/3265810058 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7d8035030 con 0x7fa7e4074e30 2024-09-06T15:00:28.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.533+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c4005290 con 0x7fa7e4074e30 2024-09-06T15:00:28.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.534+0000 7fa7d37fe640 1 -- 172.21.15.52:0/3265810058 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa7d8042070 con 0x7fa7e4074e30 2024-09-06T15:00:28.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.534+0000 7fa7d37fe640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa7cc0774b0 0x7fa7cc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.534+0000 7fa7d37fe640 1 -- 172.21.15.52:0/3265810058 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fa7d80b9ff0 con 0x7fa7e4074e30 2024-09-06T15:00:28.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.534+0000 7fa7e259c640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa7cc0774b0 0x7fa7cc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.535+0000 7fa7e259c640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa7cc0774b0 0x7fa7cc079970 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7e419ab10 tx=0x7fa7d4005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:28.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.538+0000 7fa7d37fe640 1 -- 172.21.15.52:0/3265810058 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa7d8082fd0 con 0x7fa7e4074e30 2024-09-06T15:00:28.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.714+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa7c4000bc0 con 0x7fa7cc0774b0 2024-09-06T15:00:28.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.715+0000 7fa7d37fe640 1 -- 172.21.15.52:0/3265810058 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa7c4000bc0 con 0x7fa7cc0774b0 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa7cc0774b0 msgr2=0x7fa7cc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa7cc0774b0 0x7fa7cc079970 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7e419ab10 tx=0x7fa7d4005f90 comp rx=0 tx=0).stop 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 msgr2=0x7fa7e419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e419fd50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8031460 tx=0x7fa7d8004530 comp rx=0 tx=0).stop 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 shutdown_connections 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7e4074e30 0x7fa7e419fd50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa7cc0774b0 0x7fa7cc079970 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 --2- 172.21.15.52:0/3265810058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa7e4074510 0x7fa7e419f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 >> 172.21.15.52:0/3265810058 conn(0x7fa7e40fd600 msgr2=0x7fa7e410b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:28.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 shutdown_connections 2024-09-06T15:00:28.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.717+0000 7fa7e8af2640 1 -- 172.21.15.52:0/3265810058 wait complete. 2024-09-06T15:00:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.800+0000 7f92c6458640 1 -- 172.21.15.52:0/3129614613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100ad0 msgr2=0x7f92c0106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.800+0000 7f92c6458640 1 --2- 172.21.15.52:0/3129614613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100ad0 0x7f92c0106610 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009880 tx=0x7f92a802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.800+0000 7f92c6458640 1 -- 172.21.15.52:0/3129614613 shutdown_connections 2024-09-06T15:00:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.800+0000 7f92c6458640 1 --2- 172.21.15.52:0/3129614613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100ad0 0x7f92c0106610 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.800+0000 7f92c6458640 1 --2- 172.21.15.52:0/3129614613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92c0100120 0x7f92c0100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.800+0000 7f92c6458640 1 -- 172.21.15.52:0/3129614613 >> 172.21.15.52:0/3129614613 conn(0x7f92c00fbc90 msgr2=0x7f92c00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.801+0000 7f92c6458640 1 -- 172.21.15.52:0/3129614613 shutdown_connections 2024-09-06T15:00:28.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.801+0000 7f92c6458640 1 -- 172.21.15.52:0/3129614613 wait complete. 2024-09-06T15:00:28.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.801+0000 7f92c6458640 1 Processor -- start 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.801+0000 7f92c6458640 1 -- start start 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92c6458640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100120 0x7f92c019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92c6458640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92c0100ad0 0x7f92c019dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92c6458640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f92c010ee60 con 0x7f92c0100120 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92c6458640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f92c010ece0 con 0x7f92c0100ad0 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100120 0x7f92c019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100120 0x7f92c019d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44810/0 (socket says 172.21.15.52:44810) 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bffff640 1 -- 172.21.15.52:0/3309823214 learned_addr learned my addr 172.21.15.52:0/3309823214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bf7fe640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92c0100ad0 0x7f92c019dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bffff640 1 -- 172.21.15.52:0/3309823214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92c0100ad0 msgr2=0x7f92c019dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bffff640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92c0100ad0 0x7f92c019dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bffff640 1 -- 172.21.15.52:0/3309823214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c01978c0 con 0x7f92c0100120 2024-09-06T15:00:28.802 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bffff640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100120 0x7f92c019d700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f92b000d6f0 tx=0x7f92b000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:28.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.802+0000 7f92bd7fa640 1 -- 172.21.15.52:0/3309823214 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92b0017070 con 0x7f92c0100120 2024-09-06T15:00:28.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.803+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c0197bb0 con 0x7f92c0100120 2024-09-06T15:00:28.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.803+0000 7f92bd7fa640 1 -- 172.21.15.52:0/3309823214 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f92b000de00 con 0x7f92c0100120 2024-09-06T15:00:28.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.803+0000 7f92bd7fa640 1 -- 172.21.15.52:0/3309823214 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92b0004bb0 con 0x7f92c0100120 2024-09-06T15:00:28.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.803+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c0198110 con 0x7f92c0100120 2024-09-06T15:00:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.804+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c01031e0 con 0x7f92c0100120 2024-09-06T15:00:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.804+0000 7f92bd7fa640 1 -- 172.21.15.52:0/3309823214 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f92b0009a30 con 0x7f92c0100120 2024-09-06T15:00:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.805+0000 7f92bd7fa640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92ac0774b0 0x7f92ac079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.805+0000 7f92bd7fa640 1 -- 172.21.15.52:0/3309823214 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f92b0099270 con 0x7f92c0100120 2024-09-06T15:00:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.805+0000 7f92bf7fe640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92ac0774b0 0x7f92ac079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:28.804 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.805+0000 7f92bf7fe640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92ac0774b0 0x7f92ac079970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f92a8000c00 tx=0x7f92a8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:28.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.809+0000 7f92bd7fa640 1 -- 172.21.15.52:0/3309823214 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f92b00663c0 con 0x7f92c0100120 2024-09-06T15:00:28.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.978+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f92c0198df0 con 0x7f92ac0774b0 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.988+0000 7f92bd7fa640 1 -- 172.21.15.52:0/3309823214 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f92c0198df0 con 0x7f92ac0774b0 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (12m) 7m ago 23m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (15m) 7m ago 23m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (15m) 6m ago 23m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (11m) 7m ago 23m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (11m) 6m ago 23m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (12m) 7m ago 23m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:00:28.987 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (7m) 7m ago 18m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (7m) 7m ago 18m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (7m) 6m ago 18m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (6m) 6m ago 18m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (15m) 7m ago 25m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (13m) 6m ago 22m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (11m) 7m ago 25m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (11m) 6m ago 22m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (13m) 7m ago 23m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (13m) 6m ago 23m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (10m) 7m ago 21m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (10m) 7m ago 21m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (9m) 7m ago 20m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (8m) 6m ago 20m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:00:28.988 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (8m) 6m ago 20m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:00:28.989 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (7m) 6m ago 19m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:00:28.989 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (13m) 7m ago 23m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:00:28.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92ac0774b0 msgr2=0x7f92ac079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92ac0774b0 0x7f92ac079970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f92a8000c00 tx=0x7f92a8031400 comp rx=0 tx=0).stop 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100120 msgr2=0x7f92c019d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100120 0x7f92c019d700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f92b000d6f0 tx=0x7f92b000dbb0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 shutdown_connections 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92ac0774b0 0x7f92ac079970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f92c0100ad0 0x7f92c019dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 --2- 172.21.15.52:0/3309823214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f92c0100120 0x7f92c019d700 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 >> 172.21.15.52:0/3309823214 conn(0x7f92c00fbc90 msgr2=0x7f92c00fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 shutdown_connections 2024-09-06T15:00:28.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:28.990+0000 7f92c6458640 1 -- 172.21.15.52:0/3309823214 wait complete. 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.071+0000 7f9291967640 1 -- 172.21.15.52:0/3893430833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 msgr2=0x7f928c101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.071+0000 7f9291967640 1 --2- 172.21.15.52:0/3893430833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c101dc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9274009880 tx=0x7f927402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.071+0000 7f9291967640 1 -- 172.21.15.52:0/3893430833 shutdown_connections 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.071+0000 7f9291967640 1 --2- 172.21.15.52:0/3893430833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c101dc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.071+0000 7f9291967640 1 --2- 172.21.15.52:0/3893430833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f928c107960 0x7f928c107d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.071+0000 7f9291967640 1 -- 172.21.15.52:0/3893430833 >> 172.21.15.52:0/3893430833 conn(0x7f928c0fd680 msgr2=0x7f928c0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.072+0000 7f9291967640 1 -- 172.21.15.52:0/3893430833 shutdown_connections 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.072+0000 7f9291967640 1 -- 172.21.15.52:0/3893430833 wait complete. 2024-09-06T15:00:29.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.072+0000 7f9291967640 1 Processor -- start 2024-09-06T15:00:29.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.072+0000 7f9291967640 1 -- start start 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f9291967640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f9291967640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f928c107960 0x7f928c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f9291967640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f928c10ee30 con 0x7f928c101960 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f9291967640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f928c10ecb0 con 0x7f928c107960 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928affd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44830/0 (socket says 172.21.15.52:44830) 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928affd640 1 -- 172.21.15.52:0/3701841657 learned_addr learned my addr 172.21.15.52:0/3701841657 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928a7fc640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f928c107960 0x7f928c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928affd640 1 -- 172.21.15.52:0/3701841657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f928c107960 msgr2=0x7f928c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928affd640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f928c107960 0x7f928c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928affd640 1 -- 172.21.15.52:0/3701841657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c074f70 con 0x7f928c101960 2024-09-06T15:00:29.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f928affd640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c0744f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f927c00eb10 tx=0x7f927c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.073+0000 7f9290965640 1 -- 172.21.15.52:0/3701841657 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f927c00cce0 con 0x7f928c101960 2024-09-06T15:00:29.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.074+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c075260 con 0x7f928c101960 2024-09-06T15:00:29.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.074+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c1a3e80 con 0x7f928c101960 2024-09-06T15:00:29.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.074+0000 7f9290965640 1 -- 172.21.15.52:0/3701841657 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f927c005020 con 0x7f928c101960 2024-09-06T15:00:29.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.074+0000 7f9290965640 1 -- 172.21.15.52:0/3701841657 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f927c010660 con 0x7f928c101960 2024-09-06T15:00:29.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.075+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928c1030a0 con 0x7f928c101960 2024-09-06T15:00:29.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.076+0000 7f9290965640 1 -- 172.21.15.52:0/3701841657 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f927c010910 con 0x7f928c101960 2024-09-06T15:00:29.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.076+0000 7f9290965640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92780774b0 0x7f9278079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.077+0000 7f9290965640 1 -- 172.21.15.52:0/3701841657 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f927c099ef0 con 0x7f928c101960 2024-09-06T15:00:29.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.077+0000 7f928a7fc640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92780774b0 0x7f9278079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.077+0000 7f928a7fc640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92780774b0 0x7f9278079970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f928c075f80 tx=0x7f9274031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.081+0000 7f9290965640 1 -- 172.21.15.52:0/3701841657 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f927c062ed0 con 0x7f928c101960 2024-09-06T15:00:29.299 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.301+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f928c109ed0 con 0x7f928c101960 2024-09-06T15:00:29.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.301+0000 7f9290965640 1 -- 172.21.15.52:0/3701841657 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f927c06b380 con 0x7f928c101960 2024-09-06T15:00:29.300 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:00:29.300 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:00:29.300 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:00:29.300 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:00:29.300 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:00:29.301 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:00:29.302 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:00:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92780774b0 msgr2=0x7f9278079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92780774b0 0x7f9278079970 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f928c075f80 tx=0x7f9274031400 comp rx=0 tx=0).stop 2024-09-06T15:00:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 msgr2=0x7f928c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c0744f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f927c00eb10 tx=0x7f927c00c2d0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.302 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 shutdown_connections 2024-09-06T15:00:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f92780774b0 0x7f9278079970 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f928c107960 0x7f928c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 --2- 172.21.15.52:0/3701841657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f928c101960 0x7f928c0744f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.303+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 >> 172.21.15.52:0/3701841657 conn(0x7f928c0fd680 msgr2=0x7f928c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.304+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 shutdown_connections 2024-09-06T15:00:29.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.304+0000 7f9291967640 1 -- 172.21.15.52:0/3701841657 wait complete. 2024-09-06T15:00:29.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 -- 172.21.15.52:0/1322786213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4107900 msgr2=0x7f61e4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 --2- 172.21.15.52:0/1322786213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4107900 0x7f61e4107ce0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009880 tx=0x7f61d402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 -- 172.21.15.52:0/1322786213 shutdown_connections 2024-09-06T15:00:29.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 --2- 172.21.15.52:0/1322786213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61e4101900 0x7f61e4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 --2- 172.21.15.52:0/1322786213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4107900 0x7f61e4107ce0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 -- 172.21.15.52:0/1322786213 >> 172.21.15.52:0/1322786213 conn(0x7f61e40fd600 msgr2=0x7f61e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:29.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 -- 172.21.15.52:0/1322786213 shutdown_connections 2024-09-06T15:00:29.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.389+0000 7f61ea166640 1 -- 172.21.15.52:0/1322786213 wait complete. 2024-09-06T15:00:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.390+0000 7f61ea166640 1 Processor -- start 2024-09-06T15:00:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.390+0000 7f61ea166640 1 -- start start 2024-09-06T15:00:29.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.390+0000 7f61ea166640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4101900 0x7f61e419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.390+0000 7f61ea166640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61e4107900 0x7f61e419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.390+0000 7f61ea166640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410edd0 con 0x7f61e4101900 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.390+0000 7f61ea166640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410ec50 con 0x7f61e4107900 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.390+0000 7f61e37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4101900 0x7f61e419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e37fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4101900 0x7f61e419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44842/0 (socket says 172.21.15.52:44842) 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e37fe640 1 -- 172.21.15.52:0/3011194888 learned_addr learned my addr 172.21.15.52:0/3011194888 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e2ffd640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61e4107900 0x7f61e419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e37fe640 1 -- 172.21.15.52:0/3011194888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61e4107900 msgr2=0x7f61e419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e37fe640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61e4107900 0x7f61e419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e37fe640 1 -- 172.21.15.52:0/3011194888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e41977a0 con 0x7f61e4101900 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e37fe640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4101900 0x7f61e419d620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61d4031460 tx=0x7f61d40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e0ff9640 1 -- 172.21.15.52:0/3011194888 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61d403f070 con 0x7f61e4101900 2024-09-06T15:00:29.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e0ff9640 1 -- 172.21.15.52:0/3011194888 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f61d4004b10 con 0x7f61e4101900 2024-09-06T15:00:29.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e4197a30 con 0x7f61e4101900 2024-09-06T15:00:29.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61e0ff9640 1 -- 172.21.15.52:0/3011194888 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f61d4035030 con 0x7f61e4101900 2024-09-06T15:00:29.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.391+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e4197f60 con 0x7f61e4101900 2024-09-06T15:00:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.392+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e4103040 con 0x7f61e4101900 2024-09-06T15:00:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.393+0000 7f61e0ff9640 1 -- 172.21.15.52:0/3011194888 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f61d4042070 con 0x7f61e4101900 2024-09-06T15:00:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.393+0000 7f61e0ff9640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f61cc0774b0 0x7f61cc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.393+0000 7f61e0ff9640 1 -- 172.21.15.52:0/3011194888 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f61d40ba180 con 0x7f61e4101900 2024-09-06T15:00:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.393+0000 7f61e2ffd640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f61cc0774b0 0x7f61cc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.394+0000 7f61e2ffd640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f61cc0774b0 0x7f61cc079970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f61e40ffc20 tx=0x7f61d800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.397+0000 7f61e0ff9640 1 -- 172.21.15.52:0/3011194888 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f61d40872d0 con 0x7f61e4101900 2024-09-06T15:00:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.609+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f61e4109e70 con 0x7f61e4101900 2024-09-06T15:00:29.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.610+0000 7f61e0ff9640 1 -- 172.21.15.52:0/3011194888 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f61d408bcf0 con 0x7f61e4101900 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:00:29.609 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:00:29.610 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:00:29.611 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:00:29.612 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:00:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:00:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f61cc0774b0 msgr2=0x7f61cc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f61cc0774b0 0x7f61cc079970 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f61e40ffc20 tx=0x7f61d800b390 comp rx=0 tx=0).stop 2024-09-06T15:00:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4101900 msgr2=0x7f61e419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4101900 0x7f61e419d620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61d4031460 tx=0x7f61d40045e0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 shutdown_connections 2024-09-06T15:00:29.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f61cc0774b0 0x7f61cc079970 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f61e4107900 0x7f61e419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 --2- 172.21.15.52:0/3011194888 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f61e4101900 0x7f61e419d620 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 >> 172.21.15.52:0/3011194888 conn(0x7f61e40fd600 msgr2=0x7f61e40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 shutdown_connections 2024-09-06T15:00:29.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.612+0000 7f61ea166640 1 -- 172.21.15.52:0/3011194888 wait complete. 2024-09-06T15:00:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 -- 172.21.15.52:0/3376745848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50102ac0 msgr2=0x7f9f50102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 --2- 172.21.15.52:0/3376745848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50102ac0 0x7f9f50102ea0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009880 tx=0x7f9f4002a530 comp rx=0 tx=0).stop 2024-09-06T15:00:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 -- 172.21.15.52:0/3376745848 shutdown_connections 2024-09-06T15:00:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 --2- 172.21.15.52:0/3376745848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f501033e0 0x7f9f5010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 --2- 172.21.15.52:0/3376745848 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f50102ac0 0x7f9f50102ea0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 -- 172.21.15.52:0/3376745848 >> 172.21.15.52:0/3376745848 conn(0x7f9f500fc520 msgr2=0x7f9f500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 -- 172.21.15.52:0/3376745848 shutdown_connections 2024-09-06T15:00:29.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.696+0000 7f9f555b0640 1 -- 172.21.15.52:0/3376745848 wait complete. 2024-09-06T15:00:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f555b0640 1 Processor -- start 2024-09-06T15:00:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f555b0640 1 -- start start 2024-09-06T15:00:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f555b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f50102ac0 0x7f9f5019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f555b0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f501033e0 0x7f9f5019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f555b0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5010edf0 con 0x7f9f501033e0 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f555b0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5010ec70 con 0x7f9f50102ac0 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f4e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f501033e0 0x7f9f5019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f4e7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f501033e0 0x7f9f5019db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44862/0 (socket says 172.21.15.52:44862) 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f4e7fc640 1 -- 172.21.15.52:0/2393801885 learned_addr learned my addr 172.21.15.52:0/2393801885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.697+0000 7f9f4effd640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f50102ac0 0x7f9f5019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f4e7fc640 1 -- 172.21.15.52:0/2393801885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f50102ac0 msgr2=0x7f9f5019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f4e7fc640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f50102ac0 0x7f9f5019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f4e7fc640 1 -- 172.21.15.52:0/2393801885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f501977c0 con 0x7f9f501033e0 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f4e7fc640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f501033e0 0x7f9f5019db80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400d6d0 tx=0x7f9f4400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f37fff640 1 -- 172.21.15.52:0/2393801885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f44017070 con 0x7f9f501033e0 2024-09-06T15:00:29.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f37fff640 1 -- 172.21.15.52:0/2393801885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f440054e0 con 0x7f9f501033e0 2024-09-06T15:00:29.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f37fff640 1 -- 172.21.15.52:0/2393801885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f44004ae0 con 0x7f9f501033e0 2024-09-06T15:00:29.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f50197ab0 con 0x7f9f501033e0 2024-09-06T15:00:29.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.698+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f50198040 con 0x7f9f501033e0 2024-09-06T15:00:29.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.699+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f5006aa90 con 0x7f9f501033e0 2024-09-06T15:00:29.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.700+0000 7f9f37fff640 1 -- 172.21.15.52:0/2393801885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9f44004de0 con 0x7f9f501033e0 2024-09-06T15:00:29.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.700+0000 7f9f37fff640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f38077460 0x7f9f38079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.701+0000 7f9f37fff640 1 -- 172.21.15.52:0/2393801885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9f44099350 con 0x7f9f501033e0 2024-09-06T15:00:29.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.701+0000 7f9f4effd640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f38077460 0x7f9f38079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.701+0000 7f9f4effd640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f38077460 0x7f9f38079920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f400096c0 tx=0x7f9f40031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.705+0000 7f9f37fff640 1 -- 172.21.15.52:0/2393801885 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9f44066420 con 0x7f9f501033e0 2024-09-06T15:00:29.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.883+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9f501983b0 con 0x7f9f38077460 2024-09-06T15:00:29.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.884+0000 7f9f37fff640 1 -- 172.21.15.52:0/2393801885 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9f501983b0 con 0x7f9f38077460 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:00:29.883 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:00:29.884 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:00:29.884 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:00:29.884 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f38077460 msgr2=0x7f9f38079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f38077460 0x7f9f38079920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9f400096c0 tx=0x7f9f40031400 comp rx=0 tx=0).stop 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f501033e0 msgr2=0x7f9f5019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f501033e0 0x7f9f5019db80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400d6d0 tx=0x7f9f4400db90 comp rx=0 tx=0).stop 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 shutdown_connections 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9f501033e0 0x7f9f5019db80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9f38077460 0x7f9f38079920 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 --2- 172.21.15.52:0/2393801885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f50102ac0 0x7f9f5019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 >> 172.21.15.52:0/2393801885 conn(0x7f9f500fc520 msgr2=0x7f9f5010af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:29.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 shutdown_connections 2024-09-06T15:00:29.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.886+0000 7f9f555b0640 1 -- 172.21.15.52:0/2393801885 wait complete. 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.970+0000 7f3a37e54640 1 -- 172.21.15.52:0/2845898298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 msgr2=0x7f3a30100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.970+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2845898298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a30100630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00a990 tx=0x7f3a2c02b7d0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 -- 172.21.15.52:0/2845898298 shutdown_connections 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2845898298 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a30100c00 0x7f3a30104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2845898298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a30100630 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 -- 172.21.15.52:0/2845898298 >> 172.21.15.52:0/2845898298 conn(0x7f3a300fbc90 msgr2=0x7f3a300fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 -- 172.21.15.52:0/2845898298 shutdown_connections 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 -- 172.21.15.52:0/2845898298 wait complete. 2024-09-06T15:00:29.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 Processor -- start 2024-09-06T15:00:29.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.971+0000 7f3a37e54640 1 -- start start 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a37e54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a3019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a37e54640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a30100c00 0x7f3a3019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a37e54640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3010cbb0 con 0x7f3a30100250 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a37e54640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3010ca30 con 0x7f3a30100c00 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a35bf0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a3019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a35bf0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a3019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44882/0 (socket says 172.21.15.52:44882) 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a35bf0640 1 -- 172.21.15.52:0/2898553410 learned_addr learned my addr 172.21.15.52:0/2898553410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:00:29.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a353ef640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a30100c00 0x7f3a3019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a35bf0640 1 -- 172.21.15.52:0/2898553410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a30100c00 msgr2=0x7f3a3019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a35bf0640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a30100c00 0x7f3a3019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a35bf0640 1 -- 172.21.15.52:0/2898553410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a30197880 con 0x7f3a30100250 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a35bf0640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a3019d6b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c006010 tx=0x7f3a2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a26ffd640 1 -- 172.21.15.52:0/2898553410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c008e90 con 0x7f3a30100250 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a26ffd640 1 -- 172.21.15.52:0/2898553410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a2c045070 con 0x7f3a30100250 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a30197b10 con 0x7f3a30100250 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a26ffd640 1 -- 172.21.15.52:0/2898553410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a2c0035f0 con 0x7f3a30100250 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.972+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a30198040 con 0x7f3a30100250 2024-09-06T15:00:29.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.973+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a30101730 con 0x7f3a30100250 2024-09-06T15:00:29.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.974+0000 7f3a26ffd640 1 -- 172.21.15.52:0/2898553410 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3a2c032070 con 0x7f3a30100250 2024-09-06T15:00:29.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.974+0000 7f3a26ffd640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3a1c0774b0 0x7f3a1c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:00:29.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.975+0000 7f3a26ffd640 1 -- 172.21.15.52:0/2898553410 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3a2c008030 con 0x7f3a30100250 2024-09-06T15:00:29.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.975+0000 7f3a353ef640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3a1c0774b0 0x7f3a1c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:00:29.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.975+0000 7f3a353ef640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3a1c0774b0 0x7f3a1c079970 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3a300fc440 tx=0x7f3a2000b410 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:00:29.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:29.978+0000 7f3a26ffd640 1 -- 172.21.15.52:0/2898553410 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3a2c083590 con 0x7f3a30100250 2024-09-06T15:00:30.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.201+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3a30198d60 con 0x7f3a30100250 2024-09-06T15:00:30.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.202+0000 7f3a26ffd640 1 -- 172.21.15.52:0/2898553410 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f3a2c087700 con 0x7f3a30100250 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:00:30.201 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:30.202 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:00:30.202 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:00:30.202 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:00:30.202 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:00:30.202 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:00:30.202 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:00:30.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3a1c0774b0 msgr2=0x7f3a1c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:30.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3a1c0774b0 0x7f3a1c079970 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3a300fc440 tx=0x7f3a2000b410 comp rx=0 tx=0).stop 2024-09-06T15:00:30.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 msgr2=0x7f3a3019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:00:30.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a3019d6b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c006010 tx=0x7f3a2c004270 comp rx=0 tx=0).stop 2024-09-06T15:00:30.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 shutdown_connections 2024-09-06T15:00:30.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3a1c0774b0 0x7f3a1c079970 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:30.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3a30100c00 0x7f3a3019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:30.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 --2- 172.21.15.52:0/2898553410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a30100250 0x7f3a3019d6b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:00:30.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 >> 172.21.15.52:0/2898553410 conn(0x7f3a300fbc90 msgr2=0x7f3a300fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:00:30.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 shutdown_connections 2024-09-06T15:00:30.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:00:30.204+0000 7f3a37e54640 1 -- 172.21.15.52:0/2898553410 wait complete. 2024-09-06T15:00:30.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:29 smithi165 ceph-mon[82925]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:30.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:29 smithi165 ceph-mon[82925]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:30.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:29 smithi165 ceph-mon[82925]: from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:29 smithi165 ceph-mon[82925]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:29 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3701841657' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:00:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:29 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3011194888' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:00:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:29 smithi052 ceph-mon[112917]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:29 smithi052 ceph-mon[112917]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:29 smithi052 ceph-mon[112917]: from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:29 smithi052 ceph-mon[112917]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:29 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3701841657' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:00:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:29 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3011194888' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:00:31.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:30 smithi052 ceph-mon[112917]: from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:31.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:30 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2898553410' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:00:31.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:30 smithi165 ceph-mon[82925]: from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:00:31.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:30 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2898553410' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:00:32.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:31 smithi165 ceph-mon[82925]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:32.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:31 smithi052 ceph-mon[112917]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:34.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:33 smithi052 ceph-mon[112917]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:34.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:33 smithi165 ceph-mon[82925]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:36.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:35 smithi165 ceph-mon[82925]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:36.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:35 smithi052 ceph-mon[112917]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:38.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:37 smithi165 ceph-mon[82925]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:38.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:37 smithi052 ceph-mon[112917]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:40.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:39 smithi165 ceph-mon[82925]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:40.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:39 smithi052 ceph-mon[112917]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:42.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:41 smithi165 ceph-mon[82925]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:42.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:41 smithi052 ceph-mon[112917]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:44.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:43 smithi165 ceph-mon[82925]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:44.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:43 smithi052 ceph-mon[112917]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:46.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:45 smithi165 ceph-mon[82925]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:46.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:45 smithi052 ceph-mon[112917]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:48.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:47 smithi165 ceph-mon[82925]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:48.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:47 smithi052 ceph-mon[112917]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:50.124 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:49 smithi052 ceph-mon[112917]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:50.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:49 smithi165 ceph-mon[82925]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:52.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:51 smithi165 ceph-mon[82925]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:52.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:51 smithi052 ceph-mon[112917]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:53.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:53.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:00:54.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:54 smithi165 ceph-mon[82925]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:54.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:54 smithi052 ceph-mon[112917]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:56.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:56 smithi165 ceph-mon[82925]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:56.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:56 smithi052 ceph-mon[112917]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:58.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:00:58 smithi165 ceph-mon[82925]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:00:58.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:00:58 smithi052 ceph-mon[112917]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:00.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.304+0000 7fde20e0d640 1 -- 172.21.15.52:0/3881545458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 msgr2=0x7fde1c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.304+0000 7fde20e0d640 1 --2- 172.21.15.52:0/3881545458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c101d60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fde10009880 tx=0x7fde1002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.304 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.305+0000 7fde20e0d640 1 -- 172.21.15.52:0/3881545458 shutdown_connections 2024-09-06T15:01:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.305+0000 7fde20e0d640 1 --2- 172.21.15.52:0/3881545458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c101d60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.305+0000 7fde20e0d640 1 --2- 172.21.15.52:0/3881545458 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde1c107900 0x7fde1c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.305+0000 7fde20e0d640 1 -- 172.21.15.52:0/3881545458 >> 172.21.15.52:0/3881545458 conn(0x7fde1c0fd620 msgr2=0x7fde1c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.305+0000 7fde20e0d640 1 -- 172.21.15.52:0/3881545458 shutdown_connections 2024-09-06T15:01:00.305 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.305+0000 7fde20e0d640 1 -- 172.21.15.52:0/3881545458 wait complete. 2024-09-06T15:01:00.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:00 smithi052 ceph-mon[112917]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.305+0000 7fde20e0d640 1 Processor -- start 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde20e0d640 1 -- start start 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde20e0d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde20e0d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde1c107900 0x7fde1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde20e0d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c10edd0 con 0x7fde1c101900 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde20e0d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c10ec50 con 0x7fde1c107900 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde1a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde1a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55880/0 (socket says 172.21.15.52:55880) 2024-09-06T15:01:00.308 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde1a59c640 1 -- 172.21.15.52:0/156074775 learned_addr learned my addr 172.21.15.52:0/156074775 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde19d9b640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde1c107900 0x7fde1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde1a59c640 1 -- 172.21.15.52:0/156074775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde1c107900 msgr2=0x7fde1c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde1a59c640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde1c107900 0x7fde1c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.306+0000 7fde1a59c640 1 -- 172.21.15.52:0/156074775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1c074f70 con 0x7fde1c101900 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.307+0000 7fde1a59c640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c0744f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00d6f0 tx=0x7fde0c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.307+0000 7fde0b7fe640 1 -- 172.21.15.52:0/156074775 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde0c017070 con 0x7fde1c101900 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.307+0000 7fde0b7fe640 1 -- 172.21.15.52:0/156074775 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde0c00de00 con 0x7fde1c101900 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.307+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1c075260 con 0x7fde1c101900 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.307+0000 7fde0b7fe640 1 -- 172.21.15.52:0/156074775 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde0c004bb0 con 0x7fde1c101900 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.307+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1c1a3e80 con 0x7fde1c101900 2024-09-06T15:01:00.309 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.308+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde1c103040 con 0x7fde1c101900 2024-09-06T15:01:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.309+0000 7fde0b7fe640 1 -- 172.21.15.52:0/156074775 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fde0c004e60 con 0x7fde1c101900 2024-09-06T15:01:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.309+0000 7fde0b7fe640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde04077460 0x7fde04079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.309+0000 7fde0b7fe640 1 -- 172.21.15.52:0/156074775 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fde0c099420 con 0x7fde1c101900 2024-09-06T15:01:00.310 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.309+0000 7fde19d9b640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde04077460 0x7fde04079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.311 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.310+0000 7fde19d9b640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde04077460 0x7fde04079920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fde1c075f80 tx=0x7fde10031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:00.312 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.313+0000 7fde0b7fe640 1 -- 172.21.15.52:0/156074775 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fde0c062380 con 0x7fde1c101900 2024-09-06T15:01:00.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:00 smithi165 ceph-mon[82925]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:00.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.491+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fde1c062630 con 0x7fde04077460 2024-09-06T15:01:00.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.492+0000 7fde0b7fe640 1 -- 172.21.15.52:0/156074775 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fde1c062630 con 0x7fde04077460 2024-09-06T15:01:00.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde04077460 msgr2=0x7fde04079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde04077460 0x7fde04079920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fde1c075f80 tx=0x7fde10031400 comp rx=0 tx=0).stop 2024-09-06T15:01:00.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 msgr2=0x7fde1c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c0744f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00d6f0 tx=0x7fde0c00dbb0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 shutdown_connections 2024-09-06T15:01:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde04077460 0x7fde04079920 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde1c107900 0x7fde1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 --2- 172.21.15.52:0/156074775 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde1c101900 0x7fde1c0744f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 >> 172.21.15.52:0/156074775 conn(0x7fde1c0fd620 msgr2=0x7fde1c0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 shutdown_connections 2024-09-06T15:01:00.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.494+0000 7fde20e0d640 1 -- 172.21.15.52:0/156074775 wait complete. 2024-09-06T15:01:00.502 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:01:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 -- 172.21.15.52:0/593513467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34641033e0 msgr2=0x7f346410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 --2- 172.21.15.52:0/593513467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34641033e0 0x7f346410b8d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3458009880 tx=0x7f345802a530 comp rx=0 tx=0).stop 2024-09-06T15:01:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 -- 172.21.15.52:0/593513467 shutdown_connections 2024-09-06T15:01:00.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 --2- 172.21.15.52:0/593513467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34641033e0 0x7f346410b8d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 --2- 172.21.15.52:0/593513467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3464102ac0 0x7f3464102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 -- 172.21.15.52:0/593513467 >> 172.21.15.52:0/593513467 conn(0x7f34640fc520 msgr2=0x7f34640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 -- 172.21.15.52:0/593513467 shutdown_connections 2024-09-06T15:01:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.579+0000 7f346b712640 1 -- 172.21.15.52:0/593513467 wait complete. 2024-09-06T15:01:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f346b712640 1 Processor -- start 2024-09-06T15:01:00.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f346b712640 1 -- start start 2024-09-06T15:01:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f346b712640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3464102ac0 0x7f3464100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f346b712640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34641033e0 0x7f3464100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f346b712640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f346410edd0 con 0x7f3464102ac0 2024-09-06T15:01:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f346b712640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f346410ec50 con 0x7f34641033e0 2024-09-06T15:01:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f34694ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3464102ac0 0x7f3464100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f34694ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3464102ac0 0x7f3464100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44568/0 (socket says 172.21.15.52:44568) 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f34694ae640 1 -- 172.21.15.52:0/2036706947 learned_addr learned my addr 172.21.15.52:0/2036706947 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f34694ae640 1 -- 172.21.15.52:0/2036706947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34641033e0 msgr2=0x7f3464100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f3468cad640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34641033e0 0x7f3464100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f34694ae640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34641033e0 0x7f3464100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.580+0000 7f34694ae640 1 -- 172.21.15.52:0/2036706947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34641011a0 con 0x7f3464102ac0 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.581+0000 7f34694ae640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3464102ac0 0x7f3464100720 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f345400db80 tx=0x7f345400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.581+0000 7f34627fc640 1 -- 172.21.15.52:0/2036706947 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3454017070 con 0x7f3464102ac0 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.581+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3464101490 con 0x7f3464102ac0 2024-09-06T15:01:00.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.581+0000 7f34627fc640 1 -- 172.21.15.52:0/2036706947 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3454003e30 con 0x7f3464102ac0 2024-09-06T15:01:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.581+0000 7f34627fc640 1 -- 172.21.15.52:0/2036706947 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3454010460 con 0x7f3464102ac0 2024-09-06T15:01:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.581+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34641a3e60 con 0x7f3464102ac0 2024-09-06T15:01:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.582+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346406aa90 con 0x7f3464102ac0 2024-09-06T15:01:00.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.582+0000 7f34627fc640 1 -- 172.21.15.52:0/2036706947 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f345400dc70 con 0x7f3464102ac0 2024-09-06T15:01:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.583+0000 7f34627fc640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f344c077460 0x7f344c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.583+0000 7f34627fc640 1 -- 172.21.15.52:0/2036706947 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3454099940 con 0x7f3464102ac0 2024-09-06T15:01:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.583+0000 7f3468cad640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f344c077460 0x7f344c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.583+0000 7f3468cad640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f344c077460 0x7f344c079920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3458031460 tx=0x7f3458009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:00.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.587+0000 7f34627fc640 1 -- 172.21.15.52:0/2036706947 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3454062920 con 0x7f3464102ac0 2024-09-06T15:01:00.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.764+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3464062630 con 0x7f344c077460 2024-09-06T15:01:00.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.766+0000 7f34627fc640 1 -- 172.21.15.52:0/2036706947 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3464062630 con 0x7f344c077460 2024-09-06T15:01:00.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f344c077460 msgr2=0x7f344c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f344c077460 0x7f344c079920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3458031460 tx=0x7f3458009560 comp rx=0 tx=0).stop 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3464102ac0 msgr2=0x7f3464100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3464102ac0 0x7f3464100720 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f345400db80 tx=0x7f345400b630 comp rx=0 tx=0).stop 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 shutdown_connections 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f344c077460 0x7f344c079920 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34641033e0 0x7f3464100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 --2- 172.21.15.52:0/2036706947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3464102ac0 0x7f3464100720 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.767+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 >> 172.21.15.52:0/2036706947 conn(0x7f34640fc520 msgr2=0x7f3464108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.768+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 shutdown_connections 2024-09-06T15:01:00.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.768+0000 7f346b712640 1 -- 172.21.15.52:0/2036706947 wait complete. 2024-09-06T15:01:00.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 -- 172.21.15.52:0/731294962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 msgr2=0x7ff8bc10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/731294962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc10b960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009880 tx=0x7ff8ac02a530 comp rx=0 tx=0).stop 2024-09-06T15:01:00.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 -- 172.21.15.52:0/731294962 shutdown_connections 2024-09-06T15:01:00.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/731294962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc10b960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/731294962 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc102b50 0x7ff8bc102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 -- 172.21.15.52:0/731294962 >> 172.21.15.52:0/731294962 conn(0x7ff8bc0fc550 msgr2=0x7ff8bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:00.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 -- 172.21.15.52:0/731294962 shutdown_connections 2024-09-06T15:01:00.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 -- 172.21.15.52:0/731294962 wait complete. 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 Processor -- start 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.851+0000 7ff8c32a8640 1 -- start start 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c32a8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc102b50 0x7ff8bc19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c32a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c32a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc10edc0 con 0x7ff8bc103470 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c32a8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc10ec40 con 0x7ff8bc102b50 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c0843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c0843640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc19db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44586/0 (socket says 172.21.15.52:44586) 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c0843640 1 -- 172.21.15.52:0/3920363171 learned_addr learned my addr 172.21.15.52:0/3920363171 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c1044640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc102b50 0x7ff8bc19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c0843640 1 -- 172.21.15.52:0/3920363171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc102b50 msgr2=0x7ff8bc19d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c0843640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc102b50 0x7ff8bc19d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c0843640 1 -- 172.21.15.52:0/3920363171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc197790 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.852+0000 7ff8c0843640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc19db50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac004f90 tx=0x7ff8ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.853+0000 7ff8b27fc640 1 -- 172.21.15.52:0/3920363171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8ac03f070 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.853+0000 7ff8b27fc640 1 -- 172.21.15.52:0/3920363171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff8ac004cf0 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.853+0000 7ff8b27fc640 1 -- 172.21.15.52:0/3920363171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff8ac035030 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.853+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8bc197a20 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.853+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8bc197f50 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.854+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8bc06a4e0 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.855+0000 7ff8b27fc640 1 -- 172.21.15.52:0/3920363171 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff8ac042070 con 0x7ff8bc103470 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.855+0000 7ff8b27fc640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff8a8077460 0x7ff8a8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.855+0000 7ff8c1044640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff8a8077460 0x7ff8a8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:00.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.855+0000 7ff8b27fc640 1 -- 172.21.15.52:0/3920363171 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ff8ac0ba350 con 0x7ff8bc103470 2024-09-06T15:01:00.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.856+0000 7ff8c1044640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff8a8077460 0x7ff8a8079920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005e10 tx=0x7ff8b8005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:00.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:00.859+0000 7ff8b27fc640 1 -- 172.21.15.52:0/3920363171 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff8ac0832b0 con 0x7ff8bc103470 2024-09-06T15:01:01.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.030+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff8bc198200 con 0x7ff8a8077460 2024-09-06T15:01:01.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.039+0000 7ff8b27fc640 1 -- 172.21.15.52:0/3920363171 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff8bc198200 con 0x7ff8a8077460 2024-09-06T15:01:01.038 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:01:01.038 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (13m) 7m ago 24m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:01:01.038 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (16m) 7m ago 24m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:01:01.038 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (15m) 7m ago 23m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (11m) 7m ago 24m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (11m) 7m ago 23m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (13m) 7m ago 24m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (8m) 7m ago 19m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (7m) 7m ago 19m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (7m) 7m ago 19m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (7m) 7m ago 19m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (15m) 7m ago 25m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (14m) 7m ago 23m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (12m) 7m ago 25m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (11m) 7m ago 23m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (14m) 7m ago 24m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:01:01.039 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (14m) 7m ago 23m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:01:01.040 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (11m) 7m ago 22m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:01:01.040 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (10m) 7m ago 21m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:01:01.040 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (10m) 7m ago 21m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:01:01.040 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (9m) 7m ago 21m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:01:01.040 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (8m) 7m ago 20m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:01:01.040 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (8m) 7m ago 20m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:01:01.040 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (13m) 7m ago 23m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:01:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.041+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff8a8077460 msgr2=0x7ff8a8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.041+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff8a8077460 0x7ff8a8079920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8005e10 tx=0x7ff8b8005da0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 msgr2=0x7ff8bc19db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc19db50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac004f90 tx=0x7ff8ac0048f0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 shutdown_connections 2024-09-06T15:01:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc103470 0x7ff8bc19db50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff8a8077460 0x7ff8a8079920 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 --2- 172.21.15.52:0/3920363171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff8bc102b50 0x7ff8bc19d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 >> 172.21.15.52:0/3920363171 conn(0x7ff8bc0fc550 msgr2=0x7ff8bc108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 shutdown_connections 2024-09-06T15:01:01.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.042+0000 7ff8c32a8640 1 -- 172.21.15.52:0/3920363171 wait complete. 2024-09-06T15:01:01.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 -- 172.21.15.52:0/4188220503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 msgr2=0x7f8bb4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 --2- 172.21.15.52:0/4188220503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb4107ce0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009880 tx=0x7f8bb002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 -- 172.21.15.52:0/4188220503 shutdown_connections 2024-09-06T15:01:01.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 --2- 172.21.15.52:0/4188220503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4101900 0x7f8bb4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 --2- 172.21.15.52:0/4188220503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb4107ce0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 -- 172.21.15.52:0/4188220503 >> 172.21.15.52:0/4188220503 conn(0x7f8bb40fd600 msgr2=0x7f8bb40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:01.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 -- 172.21.15.52:0/4188220503 shutdown_connections 2024-09-06T15:01:01.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.123+0000 7f8bbc524640 1 -- 172.21.15.52:0/4188220503 wait complete. 2024-09-06T15:01:01.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bbc524640 1 Processor -- start 2024-09-06T15:01:01.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bbc524640 1 -- start start 2024-09-06T15:01:01.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bbc524640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4101900 0x7f8bb419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bbc524640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bbc524640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb410edd0 con 0x7f8bb4107900 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bbc524640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb410ec50 con 0x7f8bb4101900 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bb9abf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bb9abf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb419db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44592/0 (socket says 172.21.15.52:44592) 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.124+0000 7f8bb9abf640 1 -- 172.21.15.52:0/1129351483 learned_addr learned my addr 172.21.15.52:0/1129351483 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bba2c0640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4101900 0x7f8bb419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bb9abf640 1 -- 172.21.15.52:0/1129351483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4101900 msgr2=0x7f8bb419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bb9abf640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4101900 0x7f8bb419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bb9abf640 1 -- 172.21.15.52:0/1129351483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb4197780 con 0x7f8bb4107900 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bba2c0640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4101900 0x7f8bb419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:01:01.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bb9abf640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb419db40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c8f0 tx=0x7f8ba400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:01.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bab7fe640 1 -- 172.21.15.52:0/1129351483 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ba40079b0 con 0x7f8bb4107900 2024-09-06T15:01:01.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb4197a70 con 0x7f8bb4107900 2024-09-06T15:01:01.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bab7fe640 1 -- 172.21.15.52:0/1129351483 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ba40054e0 con 0x7f8bb4107900 2024-09-06T15:01:01.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb4198000 con 0x7f8bb4107900 2024-09-06T15:01:01.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.125+0000 7f8bab7fe640 1 -- 172.21.15.52:0/1129351483 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ba4004dd0 con 0x7f8bb4107900 2024-09-06T15:01:01.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.126+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b98005290 con 0x7f8bb4107900 2024-09-06T15:01:01.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.127+0000 7f8bab7fe640 1 -- 172.21.15.52:0/1129351483 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8ba4007b50 con 0x7f8bb4107900 2024-09-06T15:01:01.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.128+0000 7f8bab7fe640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8ba0077460 0x7f8ba0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.128+0000 7f8bba2c0640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8ba0077460 0x7f8ba0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.128+0000 7f8bab7fe640 1 -- 172.21.15.52:0/1129351483 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8ba4099670 con 0x7f8bb4107900 2024-09-06T15:01:01.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.128+0000 7f8bba2c0640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8ba0077460 0x7f8ba0079920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0031460 tx=0x7f8bb0009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:01.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.131+0000 7f8bab7fe640 1 -- 172.21.15.52:0/1129351483 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8ba4014030 con 0x7f8bb4107900 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.367+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8b98005d90 con 0x7f8bb4107900 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.368+0000 7f8bab7fe640 1 -- 172.21.15.52:0/1129351483 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f8ba40625f0 con 0x7f8bb4107900 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:01:01.367 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:01:01.368 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:01:01.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.370+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8ba0077460 msgr2=0x7f8ba0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8ba0077460 0x7f8ba0079920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0031460 tx=0x7f8bb0009560 comp rx=0 tx=0).stop 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 msgr2=0x7f8bb419db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb419db40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400c8f0 tx=0x7f8ba400cdb0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 shutdown_connections 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bb4107900 0x7f8bb419db40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8ba0077460 0x7f8ba0079920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 --2- 172.21.15.52:0/1129351483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bb4101900 0x7f8bb419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 >> 172.21.15.52:0/1129351483 conn(0x7f8bb40fd600 msgr2=0x7f8bb40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 shutdown_connections 2024-09-06T15:01:01.370 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.371+0000 7f8bbc524640 1 -- 172.21.15.52:0/1129351483 wait complete. 2024-09-06T15:01:01.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 -- 172.21.15.52:0/2095596025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1007f0 msgr2=0x7fba4c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 --2- 172.21.15.52:0/2095596025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1007f0 0x7fba4c100c50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fba40009880 tx=0x7fba4002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 -- 172.21.15.52:0/2095596025 shutdown_connections 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 --2- 172.21.15.52:0/2095596025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1007f0 0x7fba4c100c50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 --2- 172.21.15.52:0/2095596025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba4c1067f0 0x7fba4c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 -- 172.21.15.52:0/2095596025 >> 172.21.15.52:0/2095596025 conn(0x7fba4c0fc550 msgr2=0x7fba4c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 -- 172.21.15.52:0/2095596025 shutdown_connections 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.453+0000 7fba54282640 1 -- 172.21.15.52:0/2095596025 wait complete. 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.454+0000 7fba54282640 1 Processor -- start 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.454+0000 7fba54282640 1 -- start start 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.454+0000 7fba54282640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba4c1007f0 0x7fba4c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.454+0000 7fba54282640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1067f0 0x7fba4c198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.454+0000 7fba54282640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10dcc0 con 0x7fba4c1067f0 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.454+0000 7fba54282640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c10db40 con 0x7fba4c1007f0 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5181d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1067f0 0x7fba4c198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5181d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1067f0 0x7fba4c198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44614/0 (socket says 172.21.15.52:44614) 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5181d640 1 -- 172.21.15.52:0/2849015183 learned_addr learned my addr 172.21.15.52:0/2849015183 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5201e640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba4c1007f0 0x7fba4c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5181d640 1 -- 172.21.15.52:0/2849015183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba4c1007f0 msgr2=0x7fba4c1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5181d640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba4c1007f0 0x7fba4c1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5181d640 1 -- 172.21.15.52:0/2849015183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c199330 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba5181d640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1067f0 0x7fba4c198d30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fba40031460 tx=0x7fba400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba3f7fe640 1 -- 172.21.15.52:0/2849015183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba4003f070 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1995c0 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba3f7fe640 1 -- 172.21.15.52:0/2849015183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fba40004cf0 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba3f7fe640 1 -- 172.21.15.52:0/2849015183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fba40035030 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.455+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c1a1b70 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.456+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c101f30 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.457+0000 7fba3f7fe640 1 -- 172.21.15.52:0/2849015183 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fba40042070 con 0x7fba4c1067f0 2024-09-06T15:01:01.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.458+0000 7fba3f7fe640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fba38077460 0x7fba38079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.458+0000 7fba3f7fe640 1 -- 172.21.15.52:0/2849015183 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fba400ba180 con 0x7fba4c1067f0 2024-09-06T15:01:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.458+0000 7fba5201e640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fba38077460 0x7fba38079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.458+0000 7fba5201e640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fba38077460 0x7fba38079920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fba480058c0 tx=0x7fba4800a250 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:01.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.462+0000 7fba3f7fe640 1 -- 172.21.15.52:0/2849015183 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fba40087250 con 0x7fba4c1067f0 2024-09-06T15:01:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.647+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fba4c108d60 con 0x7fba4c1067f0 2024-09-06T15:01:01.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.648+0000 7fba3f7fe640 1 -- 172.21.15.52:0/2849015183 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7fba4008bc70 con 0x7fba4c1067f0 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:01:01.647 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:01:01.648 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:01:01.649 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:01.650 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.649+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fba38077460 msgr2=0x7fba38079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.649+0000 7fba54282640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fba38077460 0x7fba38079920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fba480058c0 tx=0x7fba4800a250 comp rx=0 tx=0).stop 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.649+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1067f0 msgr2=0x7fba4c198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.649+0000 7fba54282640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1067f0 0x7fba4c198d30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fba40031460 tx=0x7fba400048f0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.650+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 shutdown_connections 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.650+0000 7fba54282640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba4c1067f0 0x7fba4c198d30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.650+0000 7fba54282640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fba38077460 0x7fba38079920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.650+0000 7fba54282640 1 --2- 172.21.15.52:0/2849015183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba4c1007f0 0x7fba4c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.650+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 >> 172.21.15.52:0/2849015183 conn(0x7fba4c0fc550 msgr2=0x7fba4c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.650+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 shutdown_connections 2024-09-06T15:01:01.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.650+0000 7fba54282640 1 -- 172.21.15.52:0/2849015183 wait complete. 2024-09-06T15:01:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 -- 172.21.15.52:0/3414555849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 msgr2=0x7fb444107b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/3414555849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444107b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb440009880 tx=0x7fb44002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 -- 172.21.15.52:0/3414555849 shutdown_connections 2024-09-06T15:01:01.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/3414555849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb444101750 0x7fb444101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/3414555849 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444107b30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 -- 172.21.15.52:0/3414555849 >> 172.21.15.52:0/3414555849 conn(0x7fb4440fd470 msgr2=0x7fb4440ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:01.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 -- 172.21.15.52:0/3414555849 shutdown_connections 2024-09-06T15:01:01.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.733+0000 7fb44a1a1640 1 -- 172.21.15.52:0/3414555849 wait complete. 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44a1a1640 1 Processor -- start 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44a1a1640 1 -- start start 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44a1a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb444101750 0x7fb4440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44a1a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44a1a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb44410ec00 con 0x7fb444107750 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44a1a1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb44410ea80 con 0x7fb444101750 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44899e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44899e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44632/0 (socket says 172.21.15.52:44632) 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.734+0000 7fb44899e640 1 -- 172.21.15.52:0/135274999 learned_addr learned my addr 172.21.15.52:0/135274999 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:01.735 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb44919f640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb444101750 0x7fb4440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb44899e640 1 -- 172.21.15.52:0/135274999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb444101750 msgr2=0x7fb4440744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb44899e640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb444101750 0x7fb4440744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb44899e640 1 -- 172.21.15.52:0/135274999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb444074f70 con 0x7fb444107750 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb44899e640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444074a30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c810 tx=0x7fb43400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb43a7fc640 1 -- 172.21.15.52:0/135274999 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb434004020 con 0x7fb444107750 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb43a7fc640 1 -- 172.21.15.52:0/135274999 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4340041c0 con 0x7fb444107750 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.735+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb444075260 con 0x7fb444107750 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.736+0000 7fb43a7fc640 1 -- 172.21.15.52:0/135274999 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4340047a0 con 0x7fb444107750 2024-09-06T15:01:01.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.736+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4441a3c70 con 0x7fb444107750 2024-09-06T15:01:01.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.737+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb444102e90 con 0x7fb444107750 2024-09-06T15:01:01.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.737+0000 7fb43a7fc640 1 -- 172.21.15.52:0/135274999 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb4340079b0 con 0x7fb444107750 2024-09-06T15:01:01.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.738+0000 7fb43a7fc640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb4300774b0 0x7fb430079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:01.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.738+0000 7fb43a7fc640 1 -- 172.21.15.52:0/135274999 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fb434099260 con 0x7fb444107750 2024-09-06T15:01:01.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.738+0000 7fb44919f640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb4300774b0 0x7fb430079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:01.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.738+0000 7fb44919f640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb4300774b0 0x7fb430079970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb440031460 tx=0x7fb440005bd0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:01.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.743+0000 7fb43a7fc640 1 -- 172.21.15.52:0/135274999 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb434014030 con 0x7fb444107750 2024-09-06T15:01:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.920+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb444062630 con 0x7fb4300774b0 2024-09-06T15:01:01.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.921+0000 7fb43a7fc640 1 -- 172.21.15.52:0/135274999 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb444062630 con 0x7fb4300774b0 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:01:01.920 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:01:01.921 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:01:01.921 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:01:01.921 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:01:01.921 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:01:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb4300774b0 msgr2=0x7fb430079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb4300774b0 0x7fb430079970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb440031460 tx=0x7fb440005bd0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 msgr2=0x7fb444074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444074a30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb43400c810 tx=0x7fb43400ccd0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 shutdown_connections 2024-09-06T15:01:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb444107750 0x7fb444074a30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb4300774b0 0x7fb430079970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 --2- 172.21.15.52:0/135274999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb444101750 0x7fb4440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 >> 172.21.15.52:0/135274999 conn(0x7fb4440fd470 msgr2=0x7fb4440fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 shutdown_connections 2024-09-06T15:01:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:01.923+0000 7fb44a1a1640 1 -- 172.21.15.52:0/135274999 wait complete. 2024-09-06T15:01:02.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 -- 172.21.15.52:0/4029965239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524100800 msgr2=0x7f1524100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 --2- 172.21.15.52:0/4029965239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524100800 0x7f1524100c60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1514009880 tx=0x7f151402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 -- 172.21.15.52:0/4029965239 shutdown_connections 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 --2- 172.21.15.52:0/4029965239 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524100800 0x7f1524100c60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 --2- 172.21.15.52:0/4029965239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1524106800 0x7f1524106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 -- 172.21.15.52:0/4029965239 >> 172.21.15.52:0/4029965239 conn(0x7f15240fc520 msgr2=0x7f15240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 -- 172.21.15.52:0/4029965239 shutdown_connections 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.005+0000 7f152c592640 1 -- 172.21.15.52:0/4029965239 wait complete. 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f152c592640 1 Processor -- start 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f152c592640 1 -- start start 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f152c592640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1524100800 0x7f152419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f152c592640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524106800 0x7f152419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f152c592640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f152410dcb0 con 0x7f1524106800 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f152c592640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f152410db30 con 0x7f1524100800 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f1529b2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524106800 0x7f152419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f1529b2d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524106800 0x7f152419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:44644/0 (socket says 172.21.15.52:44644) 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f1529b2d640 1 -- 172.21.15.52:0/3302229721 learned_addr learned my addr 172.21.15.52:0/3302229721 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.006+0000 7f152a32e640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1524100800 0x7f152419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f1529b2d640 1 -- 172.21.15.52:0/3302229721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1524100800 msgr2=0x7f152419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f1529b2d640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1524100800 0x7f152419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f1529b2d640 1 -- 172.21.15.52:0/3302229721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15241977f0 con 0x7f1524106800 2024-09-06T15:01:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f1529b2d640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524106800 0x7f152419dbb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1514031460 tx=0x7f15140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f151b7fe640 1 -- 172.21.15.52:0/3302229721 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f151403f070 con 0x7f1524106800 2024-09-06T15:01:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1524197a80 con 0x7f1524106800 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f151b7fe640 1 -- 172.21.15.52:0/3302229721 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15140035f0 con 0x7f1524106800 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f151b7fe640 1 -- 172.21.15.52:0/3302229721 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1514035030 con 0x7f1524106800 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.007+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1524197fb0 con 0x7f1524106800 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.008+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1524101f40 con 0x7f1524106800 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.009+0000 7f151b7fe640 1 -- 172.21.15.52:0/3302229721 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1514042070 con 0x7f1524106800 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.009+0000 7f151b7fe640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1510077460 0x7f1510079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.010+0000 7f151b7fe640 1 -- 172.21.15.52:0/3302229721 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f15140ba160 con 0x7f1524106800 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.010+0000 7f152a32e640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1510077460 0x7f1510079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.010+0000 7f152a32e640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1510077460 0x7f1510079920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f152000bbe0 tx=0x7f152000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.014+0000 7f151b7fe640 1 -- 172.21.15.52:0/3302229721 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1514087190 con 0x7f1524106800 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.233+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1524109da0 con 0x7f1524106800 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.233+0000 7f151b7fe640 1 -- 172.21.15.52:0/3302229721 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f151408bbb0 con 0x7f1524106800 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:01:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:01:02.233 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:01:02.233 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:01:02.233 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:01:02.233 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:01:02.233 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:01:02.233 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:01:02.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1510077460 msgr2=0x7f1510079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:02.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1510077460 0x7f1510079920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f152000bbe0 tx=0x7f152000b390 comp rx=0 tx=0).stop 2024-09-06T15:01:02.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524106800 msgr2=0x7f152419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:02.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524106800 0x7f152419dbb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1514031460 tx=0x7f15140045e0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 shutdown_connections 2024-09-06T15:01:02.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1524106800 0x7f152419dbb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1510077460 0x7f1510079920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 --2- 172.21.15.52:0/3302229721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1524100800 0x7f152419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:02.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 >> 172.21.15.52:0/3302229721 conn(0x7f15240fc520 msgr2=0x7f152406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:02.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 shutdown_connections 2024-09-06T15:01:02.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:02.235+0000 7f152c592640 1 -- 172.21.15.52:0/3302229721 wait complete. 2024-09-06T15:01:02.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:02 smithi165 ceph-mon[82925]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:02.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:02 smithi165 ceph-mon[82925]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:02.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:02 smithi165 ceph-mon[82925]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:02.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:02 smithi165 ceph-mon[82925]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:02.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:02 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1129351483' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:01:02.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:02 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2849015183' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:01:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:02 smithi052 ceph-mon[112917]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:02 smithi052 ceph-mon[112917]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:02 smithi052 ceph-mon[112917]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:02 smithi052 ceph-mon[112917]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:02 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1129351483' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:01:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:02 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2849015183' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:01:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:03 smithi165 ceph-mon[82925]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:03.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:03 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3302229721' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:01:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:03 smithi052 ceph-mon[112917]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:03 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3302229721' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:01:04.276 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:04 smithi052 ceph-mon[112917]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:04.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:04 smithi165 ceph-mon[82925]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:06.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:06 smithi165 ceph-mon[82925]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:06.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:06 smithi052 ceph-mon[112917]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:08.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:08 smithi165 ceph-mon[82925]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:08.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:08 smithi052 ceph-mon[112917]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:08.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:10.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:10 smithi165 ceph-mon[82925]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:10.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:10 smithi052 ceph-mon[112917]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:12.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:12 smithi165 ceph-mon[82925]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:12.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:12 smithi052 ceph-mon[112917]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:14.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:14 smithi165 ceph-mon[82925]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:14.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:14 smithi052 ceph-mon[112917]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:16.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:16 smithi165 ceph-mon[82925]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:16.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:16 smithi052 ceph-mon[112917]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:18.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:18 smithi165 ceph-mon[82925]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:18.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:18 smithi052 ceph-mon[112917]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:20.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:20 smithi165 ceph-mon[82925]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:20.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:20 smithi052 ceph-mon[112917]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:22.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:22 smithi165 ceph-mon[82925]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:22.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:22 smithi052 ceph-mon[112917]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:23.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:23.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:24.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:24 smithi165 ceph-mon[82925]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:24.374 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:24 smithi052 ceph-mon[112917]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:26.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:26 smithi165 ceph-mon[82925]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:26.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:26 smithi052 ceph-mon[112917]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:28.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:28 smithi165 ceph-mon[82925]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:28.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:28 smithi052 ceph-mon[112917]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:30.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:30 smithi165 ceph-mon[82925]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:30 smithi052 ceph-mon[112917]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:32.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:32 smithi165 ceph-mon[82925]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 -- 172.21.15.52:0/2247392311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c106800 msgr2=0x7fa46c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 --2- 172.21.15.52:0/2247392311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c106800 0x7fa46c106be0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa468009880 tx=0x7fa46802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 -- 172.21.15.52:0/2247392311 shutdown_connections 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 --2- 172.21.15.52:0/2247392311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa46c100800 0x7fa46c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 --2- 172.21.15.52:0/2247392311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c106800 0x7fa46c106be0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 -- 172.21.15.52:0/2247392311 >> 172.21.15.52:0/2247392311 conn(0x7fa46c0fc520 msgr2=0x7fa46c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 -- 172.21.15.52:0/2247392311 shutdown_connections 2024-09-06T15:01:32.332 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.332+0000 7fa472c7c640 1 -- 172.21.15.52:0/2247392311 wait complete. 2024-09-06T15:01:32.333 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:32 smithi052 ceph-mon[112917]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:32.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa472c7c640 1 Processor -- start 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa472c7c640 1 -- start start 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa472c7c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c100800 0x7fa46c0fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa472c7c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa46c106800 0x7fa46c0fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa472c7c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c10dcd0 con 0x7fa46c100800 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa472c7c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c10db50 con 0x7fa46c106800 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa470a18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c100800 0x7fa46c0fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa470a18640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c100800 0x7fa46c0fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51508/0 (socket says 172.21.15.52:51508) 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.333+0000 7fa470a18640 1 -- 172.21.15.52:0/4214561348 learned_addr learned my addr 172.21.15.52:0/4214561348 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa463fff640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa46c106800 0x7fa46c0fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa470a18640 1 -- 172.21.15.52:0/4214561348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa46c106800 msgr2=0x7fa46c0fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.335 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa470a18640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa46c106800 0x7fa46c0fd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa470a18640 1 -- 172.21.15.52:0/4214561348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c0fd6c0 con 0x7fa46c100800 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa470a18640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c100800 0x7fa46c0fcc40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa468031460 tx=0x7fa4680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa461ffb640 1 -- 172.21.15.52:0/4214561348 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa46803f070 con 0x7fa46c100800 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c0fd950 con 0x7fa46c100800 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa461ffb640 1 -- 172.21.15.52:0/4214561348 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4680035f0 con 0x7fa46c100800 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.334+0000 7fa461ffb640 1 -- 172.21.15.52:0/4214561348 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa468035030 con 0x7fa46c100800 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.335+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c1a3d20 con 0x7fa46c100800 2024-09-06T15:01:32.336 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.336+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c101f40 con 0x7fa46c100800 2024-09-06T15:01:32.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.336+0000 7fa461ffb640 1 -- 172.21.15.52:0/4214561348 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa468042070 con 0x7fa46c100800 2024-09-06T15:01:32.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.337+0000 7fa461ffb640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa454077460 0x7fa454079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.337+0000 7fa461ffb640 1 -- 172.21.15.52:0/4214561348 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fa4680ba0c0 con 0x7fa46c100800 2024-09-06T15:01:32.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.337+0000 7fa463fff640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa454077460 0x7fa454079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.338+0000 7fa463fff640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa454077460 0x7fa454079920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0fe6d0 tx=0x7fa45c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:32.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.341+0000 7fa461ffb640 1 -- 172.21.15.52:0/4214561348 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa468087190 con 0x7fa46c100800 2024-09-06T15:01:32.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.518+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa46c109df0 con 0x7fa454077460 2024-09-06T15:01:32.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.519+0000 7fa461ffb640 1 -- 172.21.15.52:0/4214561348 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa45c003890 con 0x7fa454077460 2024-09-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa454077460 msgr2=0x7fa454079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa454077460 0x7fa454079920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0fe6d0 tx=0x7fa45c00b390 comp rx=0 tx=0).stop 2024-09-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c100800 msgr2=0x7fa46c0fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c100800 0x7fa46c0fcc40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa468031460 tx=0x7fa4680045e0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 shutdown_connections 2024-09-06T15:01:32.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa454077460 0x7fa454079920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa46c106800 0x7fa46c0fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 --2- 172.21.15.52:0/4214561348 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa46c100800 0x7fa46c0fcc40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 >> 172.21.15.52:0/4214561348 conn(0x7fa46c0fc520 msgr2=0x7fa46c06a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 shutdown_connections 2024-09-06T15:01:32.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.521+0000 7fa472c7c640 1 -- 172.21.15.52:0/4214561348 wait complete. 2024-09-06T15:01:32.529 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:01:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.605+0000 7f87f17a2640 1 -- 172.21.15.52:0/2067957463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 msgr2=0x7f87ec107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.605+0000 7f87f17a2640 1 --2- 172.21.15.52:0/2067957463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec107ce0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009880 tx=0x7f87e402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.606+0000 7f87f17a2640 1 -- 172.21.15.52:0/2067957463 shutdown_connections 2024-09-06T15:01:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.606+0000 7f87f17a2640 1 --2- 172.21.15.52:0/2067957463 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87ec101900 0x7f87ec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.606+0000 7f87f17a2640 1 --2- 172.21.15.52:0/2067957463 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec107ce0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.606+0000 7f87f17a2640 1 -- 172.21.15.52:0/2067957463 >> 172.21.15.52:0/2067957463 conn(0x7f87ec0fd620 msgr2=0x7f87ec0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.606+0000 7f87f17a2640 1 -- 172.21.15.52:0/2067957463 shutdown_connections 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.606+0000 7f87f17a2640 1 -- 172.21.15.52:0/2067957463 wait complete. 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.606+0000 7f87f17a2640 1 Processor -- start 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87f17a2640 1 -- start start 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87f17a2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87ec101900 0x7f87ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87f17a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87f17a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec10edb0 con 0x7f87ec107900 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87f17a2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec10ec30 con 0x7f87ec101900 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87ea7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87ea7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51524/0 (socket says 172.21.15.52:51524) 2024-09-06T15:01:32.607 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87ea7fc640 1 -- 172.21.15.52:0/3874232214 learned_addr learned my addr 172.21.15.52:0/3874232214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87eaffd640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87ec101900 0x7f87ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87ea7fc640 1 -- 172.21.15.52:0/3874232214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87ec101900 msgr2=0x7f87ec0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87ea7fc640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87ec101900 0x7f87ec0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87ea7fc640 1 -- 172.21.15.52:0/3874232214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec074f70 con 0x7f87ec107900 2024-09-06T15:01:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87eaffd640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87ec101900 0x7f87ec0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:01:32.608 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.607+0000 7f87ea7fc640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec074a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c810 tx=0x7f87d400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.608+0000 7f87e3fff640 1 -- 172.21.15.52:0/3874232214 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87d4004020 con 0x7f87ec107900 2024-09-06T15:01:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.608+0000 7f87e3fff640 1 -- 172.21.15.52:0/3874232214 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87d40041c0 con 0x7f87ec107900 2024-09-06T15:01:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.608+0000 7f87e3fff640 1 -- 172.21.15.52:0/3874232214 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87d40047a0 con 0x7f87ec107900 2024-09-06T15:01:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.608+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ec075260 con 0x7f87ec107900 2024-09-06T15:01:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.608+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ec1a3df0 con 0x7f87ec107900 2024-09-06T15:01:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.609+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ec103040 con 0x7f87ec107900 2024-09-06T15:01:32.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.609+0000 7f87e3fff640 1 -- 172.21.15.52:0/3874232214 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f87d40079b0 con 0x7f87ec107900 2024-09-06T15:01:32.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.610+0000 7f87e3fff640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87d80774e0 0x7f87d80799a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.610+0000 7f87eaffd640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87d80774e0 0x7f87d80799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.610+0000 7f87e3fff640 1 -- 172.21.15.52:0/3874232214 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f87d40998d0 con 0x7f87ec107900 2024-09-06T15:01:32.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.611+0000 7f87eaffd640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87d80774e0 0x7f87d80799a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87e4031460 tx=0x7f87e4004280 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:32.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.614+0000 7f87e3fff640 1 -- 172.21.15.52:0/3874232214 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f87d4014030 con 0x7f87ec107900 2024-09-06T15:01:32.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.793+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f87ec062630 con 0x7f87d80774e0 2024-09-06T15:01:32.793 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.794+0000 7f87e3fff640 1 -- 172.21.15.52:0/3874232214 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f87ec062630 con 0x7f87d80774e0 2024-09-06T15:01:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87d80774e0 msgr2=0x7f87d80799a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87d80774e0 0x7f87d80799a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f87e4031460 tx=0x7f87e4004280 comp rx=0 tx=0).stop 2024-09-06T15:01:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 msgr2=0x7f87ec074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec074a30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87d400c810 tx=0x7f87d400ccd0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 shutdown_connections 2024-09-06T15:01:32.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f87ec107900 0x7f87ec074a30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f87d80774e0 0x7f87d80799a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 --2- 172.21.15.52:0/3874232214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f87ec101900 0x7f87ec0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 >> 172.21.15.52:0/3874232214 conn(0x7f87ec0fd620 msgr2=0x7f87ec0fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 shutdown_connections 2024-09-06T15:01:32.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.796+0000 7f87f17a2640 1 -- 172.21.15.52:0/3874232214 wait complete. 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 -- 172.21.15.52:0/2088772766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 msgr2=0x7f23ac106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2088772766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac106bd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f239c009880 tx=0x7f239c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 -- 172.21.15.52:0/2088772766 shutdown_connections 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2088772766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23ac1007f0 0x7f23ac100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2088772766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac106bd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 -- 172.21.15.52:0/2088772766 >> 172.21.15.52:0/2088772766 conn(0x7f23ac0fc550 msgr2=0x7f23ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 -- 172.21.15.52:0/2088772766 shutdown_connections 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 -- 172.21.15.52:0/2088772766 wait complete. 2024-09-06T15:01:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 Processor -- start 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.880+0000 7f23b39c2640 1 -- start start 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b39c2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23ac1007f0 0x7f23ac19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b39c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b39c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac10dca0 con 0x7f23ac1067f0 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b39c2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac10db20 con 0x7f23ac1007f0 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b0f5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b0f5d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51538/0 (socket says 172.21.15.52:51538) 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b0f5d640 1 -- 172.21.15.52:0/2817517483 learned_addr learned my addr 172.21.15.52:0/2817517483 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b175e640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23ac1007f0 0x7f23ac19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b0f5d640 1 -- 172.21.15.52:0/2817517483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23ac1007f0 msgr2=0x7f23ac19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b0f5d640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23ac1007f0 0x7f23ac19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b0f5d640 1 -- 172.21.15.52:0/2817517483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac197750 con 0x7f23ac1067f0 2024-09-06T15:01:32.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b0f5d640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac19dbc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c810 tx=0x7f23a800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23a27fc640 1 -- 172.21.15.52:0/2817517483 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23a8004020 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23a27fc640 1 -- 172.21.15.52:0/2817517483 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23a80041c0 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.881+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac197a40 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.882+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac197fa0 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.882+0000 7f23a27fc640 1 -- 172.21.15.52:0/2817517483 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23a80047a0 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.883+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac101f30 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.883+0000 7f23a27fc640 1 -- 172.21.15.52:0/2817517483 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f23a80079b0 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.884+0000 7f23a27fc640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2398077460 0x7f2398079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.884+0000 7f23a27fc640 1 -- 172.21.15.52:0/2817517483 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f23a8099640 con 0x7f23ac1067f0 2024-09-06T15:01:32.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.884+0000 7f23b175e640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2398077460 0x7f2398079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:32.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.884+0000 7f23b175e640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2398077460 0x7f2398079920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f239c000c00 tx=0x7f239c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:32.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:32.888+0000 7f23a27fc640 1 -- 172.21.15.52:0/2817517483 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f23a8014030 con 0x7f23ac1067f0 2024-09-06T15:01:33.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.055+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f23ac1982b0 con 0x7f2398077460 2024-09-06T15:01:33.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.065+0000 7f23a27fc640 1 -- 172.21.15.52:0/2817517483 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f23ac1982b0 con 0x7f2398077460 2024-09-06T15:01:33.064 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:01:33.064 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (13m) 8m ago 24m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:01:33.064 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (16m) 8m ago 25m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:01:33.064 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (16m) 7m ago 24m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:01:33.064 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (12m) 8m ago 25m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:01:33.064 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (12m) 7m ago 24m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:01:33.064 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (13m) 8m ago 24m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (8m) 8m ago 19m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (8m) 8m ago 19m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (8m) 7m ago 19m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (7m) 7m ago 19m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (16m) 8m ago 26m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (15m) 7m ago 24m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (12m) 8m ago 26m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (12m) 7m ago 23m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (14m) 8m ago 24m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (14m) 7m ago 24m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (11m) 8m ago 22m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:01:33.065 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (11m) 8m ago 22m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:01:33.066 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (10m) 8m ago 21m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:01:33.066 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (10m) 7m ago 21m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:01:33.066 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (9m) 7m ago 21m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:01:33.066 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (8m) 7m ago 20m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:01:33.066 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (14m) 8m ago 24m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2398077460 msgr2=0x7f2398079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2398077460 0x7f2398079920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f239c000c00 tx=0x7f239c031400 comp rx=0 tx=0).stop 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 msgr2=0x7f23ac19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac19dbc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c810 tx=0x7f23a800ccd0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 shutdown_connections 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23ac1067f0 0x7f23ac19dbc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2398077460 0x7f2398079920 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.066+0000 7f23b39c2640 1 --2- 172.21.15.52:0/2817517483 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23ac1007f0 0x7f23ac19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.067+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 >> 172.21.15.52:0/2817517483 conn(0x7f23ac0fc550 msgr2=0x7f23ac069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:33.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.067+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 shutdown_connections 2024-09-06T15:01:33.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.067+0000 7f23b39c2640 1 -- 172.21.15.52:0/2817517483 wait complete. 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 -- 172.21.15.52:0/4229603822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704103440 msgr2=0x7f070410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 --2- 172.21.15.52:0/4229603822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704103440 0x7f070410b930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f06f40098b0 tx=0x7f06f402a560 comp rx=0 tx=0).stop 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 -- 172.21.15.52:0/4229603822 shutdown_connections 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 --2- 172.21.15.52:0/4229603822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704103440 0x7f070410b930 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 --2- 172.21.15.52:0/4229603822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0704102b20 0x7f0704102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 -- 172.21.15.52:0/4229603822 >> 172.21.15.52:0/4229603822 conn(0x7f07040fc520 msgr2=0x7f07040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 -- 172.21.15.52:0/4229603822 shutdown_connections 2024-09-06T15:01:33.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.148+0000 7f070c357640 1 -- 172.21.15.52:0/4229603822 wait complete. 2024-09-06T15:01:33.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.149+0000 7f070c357640 1 Processor -- start 2024-09-06T15:01:33.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.149+0000 7f070c357640 1 -- start start 2024-09-06T15:01:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.149+0000 7f070c357640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704102b20 0x7f070419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070c357640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0704103440 0x7f070419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070c357640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f070410edd0 con 0x7f0704102b20 2024-09-06T15:01:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070c357640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f070410ec50 con 0x7f0704103440 2024-09-06T15:01:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070a0f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704102b20 0x7f070419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070a0f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704102b20 0x7f070419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51560/0 (socket says 172.21.15.52:51560) 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070a0f3640 1 -- 172.21.15.52:0/2580599911 learned_addr learned my addr 172.21.15.52:0/2580599911 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f07098f2640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0704103440 0x7f070419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070a0f3640 1 -- 172.21.15.52:0/2580599911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0704103440 msgr2=0x7f070419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070a0f3640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0704103440 0x7f070419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070a0f3640 1 -- 172.21.15.52:0/2580599911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070419e2b0 con 0x7f0704102b20 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070a0f3640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704102b20 0x7f070419d6c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f070000c8a0 tx=0x7f070000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f06fb7fe640 1 -- 172.21.15.52:0/2580599911 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07000079b0 con 0x7f0704102b20 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f06fb7fe640 1 -- 172.21.15.52:0/2580599911 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0700007b50 con 0x7f0704102b20 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07041979a0 con 0x7f0704102b20 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f06fb7fe640 1 -- 172.21.15.52:0/2580599911 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0700018700 con 0x7f0704102b20 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.150+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0704197f00 con 0x7f0704102b20 2024-09-06T15:01:33.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.151+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070406aa30 con 0x7f0704102b20 2024-09-06T15:01:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.152+0000 7f06fb7fe640 1 -- 172.21.15.52:0/2580599911 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0700007d00 con 0x7f0704102b20 2024-09-06T15:01:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.153+0000 7f06fb7fe640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06f00774b0 0x7f06f0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.153+0000 7f07098f2640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06f00774b0 0x7f06f0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.153+0000 7f06fb7fe640 1 -- 172.21.15.52:0/2580599911 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0700099a40 con 0x7f0704102b20 2024-09-06T15:01:33.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.154+0000 7f07098f2640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06f00774b0 0x7f06f0079970 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f06f4000c00 tx=0x7f06f4031420 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:33.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.157+0000 7f06fb7fe640 1 -- 172.21.15.52:0/2580599911 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0700014030 con 0x7f0704102b20 2024-09-06T15:01:33.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.377+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0704198de0 con 0x7f0704102b20 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.378+0000 7f06fb7fe640 1 -- 172.21.15.52:0/2580599911 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0700062980 con 0x7f0704102b20 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:01:33.377 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:01:33.378 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:01:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06f00774b0 msgr2=0x7f06f0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06f00774b0 0x7f06f0079970 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f06f4000c00 tx=0x7f06f4031420 comp rx=0 tx=0).stop 2024-09-06T15:01:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704102b20 msgr2=0x7f070419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704102b20 0x7f070419d6c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f070000c8a0 tx=0x7f070000cd60 comp rx=0 tx=0).stop 2024-09-06T15:01:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 shutdown_connections 2024-09-06T15:01:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f06f00774b0 0x7f06f0079970 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0704103440 0x7f070419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 --2- 172.21.15.52:0/2580599911 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0704102b20 0x7f070419d6c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 >> 172.21.15.52:0/2580599911 conn(0x7f07040fc520 msgr2=0x7f0704103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 shutdown_connections 2024-09-06T15:01:33.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.380+0000 7f070c357640 1 -- 172.21.15.52:0/2580599911 wait complete. 2024-09-06T15:01:33.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 -- 172.21.15.52:0/4031810912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c102ac0 msgr2=0x7f8e8c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 --2- 172.21.15.52:0/4031810912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c102ac0 0x7f8e8c102ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009880 tx=0x7f8e7c02a530 comp rx=0 tx=0).stop 2024-09-06T15:01:33.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 -- 172.21.15.52:0/4031810912 shutdown_connections 2024-09-06T15:01:33.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 --2- 172.21.15.52:0/4031810912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8c1033e0 0x7f8e8c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 --2- 172.21.15.52:0/4031810912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c102ac0 0x7f8e8c102ea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 -- 172.21.15.52:0/4031810912 >> 172.21.15.52:0/4031810912 conn(0x7f8e8c0fc520 msgr2=0x7f8e8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:33.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 -- 172.21.15.52:0/4031810912 shutdown_connections 2024-09-06T15:01:33.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.462+0000 7f8e90973640 1 -- 172.21.15.52:0/4031810912 wait complete. 2024-09-06T15:01:33.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.463+0000 7f8e90973640 1 Processor -- start 2024-09-06T15:01:33.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.463+0000 7f8e90973640 1 -- start start 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.463+0000 7f8e90973640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8c102ac0 0x7f8e8c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.463+0000 7f8e90973640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c1033e0 0x7f8e8c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.463+0000 7f8e90973640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c10edd0 con 0x7f8e8c1033e0 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.463+0000 7f8e90973640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c10ec50 con 0x7f8e8c102ac0 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.463+0000 7f8e89d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c1033e0 0x7f8e8c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e89d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c1033e0 0x7f8e8c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51584/0 (socket says 172.21.15.52:51584) 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e89d9b640 1 -- 172.21.15.52:0/3511474076 learned_addr learned my addr 172.21.15.52:0/3511474076 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e8a59c640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8c102ac0 0x7f8e8c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e89d9b640 1 -- 172.21.15.52:0/3511474076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8c102ac0 msgr2=0x7f8e8c100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e89d9b640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8c102ac0 0x7f8e8c100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e89d9b640 1 -- 172.21.15.52:0/3511474076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c1011a0 con 0x7f8e8c1033e0 2024-09-06T15:01:33.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e89d9b640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c1033e0 0x7f8e8c100c60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c8f0 tx=0x7f8e8000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:33.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e7b7fe640 1 -- 172.21.15.52:0/3511474076 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e800079b0 con 0x7f8e8c1033e0 2024-09-06T15:01:33.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c101490 con 0x7f8e8c1033e0 2024-09-06T15:01:33.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e7b7fe640 1 -- 172.21.15.52:0/3511474076 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e80007b50 con 0x7f8e8c1033e0 2024-09-06T15:01:33.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c1a3de0 con 0x7f8e8c1033e0 2024-09-06T15:01:33.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.464+0000 7f8e7b7fe640 1 -- 172.21.15.52:0/3511474076 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e80018610 con 0x7f8e8c1033e0 2024-09-06T15:01:33.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.465+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6c005290 con 0x7f8e8c1033e0 2024-09-06T15:01:33.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.466+0000 7f8e7b7fe640 1 -- 172.21.15.52:0/3511474076 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8e80007d00 con 0x7f8e8c1033e0 2024-09-06T15:01:33.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.467+0000 7f8e7b7fe640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8e74077460 0x7f8e74079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.467+0000 7f8e7b7fe640 1 -- 172.21.15.52:0/3511474076 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8e800998c0 con 0x7f8e8c1033e0 2024-09-06T15:01:33.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.467+0000 7f8e8a59c640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8e74077460 0x7f8e74079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.467+0000 7f8e8a59c640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8e74077460 0x7f8e74079920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c031460 tx=0x7f8e7c005bd0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:33.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.471+0000 7f8e7b7fe640 1 -- 172.21.15.52:0/3511474076 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8e80014030 con 0x7f8e8c1033e0 2024-09-06T15:01:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.656+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8e6c005d90 con 0x7f8e8c1033e0 2024-09-06T15:01:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.656+0000 7f8e7b7fe640 1 -- 172.21.15.52:0/3511474076 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f8e80062820 con 0x7f8e8c1033e0 2024-09-06T15:01:33.655 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:01:33.655 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:01:33.655 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:01:33.655 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:01:33.656 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:01:33.657 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:33.658 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:33.659 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:01:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8e74077460 msgr2=0x7f8e74079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8e74077460 0x7f8e74079920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c031460 tx=0x7f8e7c005bd0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c1033e0 msgr2=0x7f8e8c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c1033e0 0x7f8e8c100c60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000c8f0 tx=0x7f8e8000cdb0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 shutdown_connections 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8e8c1033e0 0x7f8e8c100c60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8e74077460 0x7f8e74079920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 --2- 172.21.15.52:0/3511474076 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e8c102ac0 0x7f8e8c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 >> 172.21.15.52:0/3511474076 conn(0x7f8e8c0fc520 msgr2=0x7f8e8c108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 shutdown_connections 2024-09-06T15:01:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.658+0000 7f8e90973640 1 -- 172.21.15.52:0/3511474076 wait complete. 2024-09-06T15:01:33.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.741+0000 7f8decebd640 1 -- 172.21.15.52:0/2927705734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 msgr2=0x7f8de8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.741+0000 7f8decebd640 1 --2- 172.21.15.52:0/2927705734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de8101d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009880 tx=0x7f8dd002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.742+0000 7f8decebd640 1 -- 172.21.15.52:0/2927705734 shutdown_connections 2024-09-06T15:01:33.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.742+0000 7f8decebd640 1 --2- 172.21.15.52:0/2927705734 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de8101d60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.742+0000 7f8decebd640 1 --2- 172.21.15.52:0/2927705734 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8de8107900 0x7f8de8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.741 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.742+0000 7f8decebd640 1 -- 172.21.15.52:0/2927705734 >> 172.21.15.52:0/2927705734 conn(0x7f8de80fd620 msgr2=0x7f8de80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:33.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.742+0000 7f8decebd640 1 -- 172.21.15.52:0/2927705734 shutdown_connections 2024-09-06T15:01:33.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.742+0000 7f8decebd640 1 -- 172.21.15.52:0/2927705734 wait complete. 2024-09-06T15:01:33.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8decebd640 1 Processor -- start 2024-09-06T15:01:33.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8decebd640 1 -- start start 2024-09-06T15:01:33.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8decebd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8decebd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8de8107900 0x7f8de819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8decebd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8de810ee30 con 0x7f8de8101900 2024-09-06T15:01:33.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8decebd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8de810ecb0 con 0x7f8de8107900 2024-09-06T15:01:33.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8de659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8de659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de819f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51608/0 (socket says 172.21.15.52:51608) 2024-09-06T15:01:33.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8de659c640 1 -- 172.21.15.52:0/2881130842 learned_addr learned my addr 172.21.15.52:0/2881130842 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8de5d9b640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8de8107900 0x7f8de819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8de659c640 1 -- 172.21.15.52:0/2881130842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8de8107900 msgr2=0x7f8de819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8de659c640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8de8107900 0x7f8de819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.743+0000 7f8de659c640 1 -- 172.21.15.52:0/2881130842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de8199a50 con 0x7f8de8101900 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.744+0000 7f8de659c640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de819f890 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8de000ba50 tx=0x7f8de000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.744+0000 7f8ddf7fe640 1 -- 172.21.15.52:0/2881130842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8de0019070 con 0x7f8de8101900 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.744+0000 7f8ddf7fe640 1 -- 172.21.15.52:0/2881130842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8de000ce20 con 0x7f8de8101900 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.744+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de8199d40 con 0x7f8de8101900 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.744+0000 7f8ddf7fe640 1 -- 172.21.15.52:0/2881130842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8de00075a0 con 0x7f8de8101900 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.744+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de819a2a0 con 0x7f8de8101900 2024-09-06T15:01:33.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.745+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de8103040 con 0x7f8de8101900 2024-09-06T15:01:33.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.745+0000 7f8ddf7fe640 1 -- 172.21.15.52:0/2881130842 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8de001c070 con 0x7f8de8101900 2024-09-06T15:01:33.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.746+0000 7f8ddf7fe640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8dd4077460 0x7f8dd4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:33.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.746+0000 7f8ddf7fe640 1 -- 172.21.15.52:0/2881130842 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8de0099000 con 0x7f8de8101900 2024-09-06T15:01:33.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.746+0000 7f8de5d9b640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8dd4077460 0x7f8dd4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:33.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.747+0000 7f8de5d9b640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8dd4077460 0x7f8dd4079920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8de819b240 tx=0x7f8dd0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:33.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.750+0000 7f8ddf7fe640 1 -- 172.21.15.52:0/2881130842 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8de00660d0 con 0x7f8de8101900 2024-09-06T15:01:33.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.926+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8de819aff0 con 0x7f8dd4077460 2024-09-06T15:01:33.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.928+0000 7f8ddf7fe640 1 -- 172.21.15.52:0/2881130842 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8de819aff0 con 0x7f8dd4077460 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:01:33.927 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:01:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:01:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:01:33.928 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:01:33.928 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:01:33.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8dd4077460 msgr2=0x7f8dd4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8dd4077460 0x7f8dd4079920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8de819b240 tx=0x7f8dd0031400 comp rx=0 tx=0).stop 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 msgr2=0x7f8de819f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de819f890 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8de000ba50 tx=0x7f8de000bf10 comp rx=0 tx=0).stop 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 shutdown_connections 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8dd4077460 0x7f8dd4079920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8de8107900 0x7f8de819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 --2- 172.21.15.52:0/2881130842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8de8101900 0x7f8de819f890 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.929+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 >> 172.21.15.52:0/2881130842 conn(0x7f8de80fd620 msgr2=0x7f8de8074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.930+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 shutdown_connections 2024-09-06T15:01:33.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:33.930+0000 7f8decebd640 1 -- 172.21.15.52:0/2881130842 wait complete. 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.012+0000 7f084063a640 1 -- 172.21.15.52:0/2026221155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381007f0 msgr2=0x7f0838100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.012+0000 7f084063a640 1 --2- 172.21.15.52:0/2026221155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381007f0 0x7f0838100c50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0834009880 tx=0x7f083402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 -- 172.21.15.52:0/2026221155 shutdown_connections 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 --2- 172.21.15.52:0/2026221155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381007f0 0x7f0838100c50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 --2- 172.21.15.52:0/2026221155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08381067f0 0x7f0838106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 -- 172.21.15.52:0/2026221155 >> 172.21.15.52:0/2026221155 conn(0x7f08380fc550 msgr2=0x7f08380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 -- 172.21.15.52:0/2026221155 shutdown_connections 2024-09-06T15:01:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 -- 172.21.15.52:0/2026221155 wait complete. 2024-09-06T15:01:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 Processor -- start 2024-09-06T15:01:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.013+0000 7f084063a640 1 -- start start 2024-09-06T15:01:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f084063a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08381007f0 0x7f08380fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f084063a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381067f0 0x7f08380fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f084063a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f083810dcc0 con 0x7f08381067f0 2024-09-06T15:01:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f084063a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f083810db40 con 0x7f08381007f0 2024-09-06T15:01:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083dbd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381067f0 0x7f08380fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083dbd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381067f0 0x7f08380fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51628/0 (socket says 172.21.15.52:51628) 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083dbd5640 1 -- 172.21.15.52:0/800861312 learned_addr learned my addr 172.21.15.52:0/800861312 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083e3d6640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08381007f0 0x7f08380fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083dbd5640 1 -- 172.21.15.52:0/800861312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08381007f0 msgr2=0x7f08380fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083dbd5640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08381007f0 0x7f08380fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083dbd5640 1 -- 172.21.15.52:0/800861312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380fd750 con 0x7f08381067f0 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083e3d6640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08381007f0 0x7f08380fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f083dbd5640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381067f0 0x7f08380fd210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0834031460 tx=0x7f08340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.014+0000 7f082f7fe640 1 -- 172.21.15.52:0/800861312 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f083403f070 con 0x7f08381067f0 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.015+0000 7f082f7fe640 1 -- 172.21.15.52:0/800861312 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0834004cf0 con 0x7f08381067f0 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.015+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08380fd9e0 con 0x7f08381067f0 2024-09-06T15:01:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.015+0000 7f082f7fe640 1 -- 172.21.15.52:0/800861312 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0834035030 con 0x7f08381067f0 2024-09-06T15:01:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.015+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381a3da0 con 0x7f08381067f0 2024-09-06T15:01:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.016+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0838101f30 con 0x7f08381067f0 2024-09-06T15:01:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.016+0000 7f082f7fe640 1 -- 172.21.15.52:0/800861312 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0834042070 con 0x7f08381067f0 2024-09-06T15:01:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.017+0000 7f082f7fe640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08240774b0 0x7f0824079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:01:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.017+0000 7f082f7fe640 1 -- 172.21.15.52:0/800861312 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f08340ba1c0 con 0x7f08381067f0 2024-09-06T15:01:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.017+0000 7f083e3d6640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08240774b0 0x7f0824079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:01:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.017+0000 7f083e3d6640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08240774b0 0x7f0824079970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0828005fd0 tx=0x7f0828005ea0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:01:34.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.021+0000 7f082f7fe640 1 -- 172.21.15.52:0/800861312 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f08340831a0 con 0x7f08381067f0 2024-09-06T15:01:34.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.241+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f08380fe200 con 0x7f08381067f0 2024-09-06T15:01:34.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.241+0000 7f082f7fe640 1 -- 172.21.15.52:0/800861312 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f0834087310 con 0x7f08381067f0 2024-09-06T15:01:34.243 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:01:34.243 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:01:34.243 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:01:34.243 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:01:34.244 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08240774b0 msgr2=0x7f0824079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08240774b0 0x7f0824079970 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0828005fd0 tx=0x7f0828005ea0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381067f0 msgr2=0x7f08380fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381067f0 0x7f08380fd210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0834031460 tx=0x7f08340048f0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 shutdown_connections 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f08381067f0 0x7f08380fd210 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f08240774b0 0x7f0824079970 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 --2- 172.21.15.52:0/800861312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08381007f0 0x7f08380fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:01:34.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 >> 172.21.15.52:0/800861312 conn(0x7f08380fc550 msgr2=0x7f0838069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:01:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 shutdown_connections 2024-09-06T15:01:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:01:34.243+0000 7f084063a640 1 -- 172.21.15.52:0/800861312 wait complete. 2024-09-06T15:01:34.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:34 smithi165 ceph-mon[82925]: pgmap v519: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:34.330 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:34 smithi165 ceph-mon[82925]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:34.330 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:34 smithi165 ceph-mon[82925]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:34.330 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:34 smithi165 ceph-mon[82925]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:34.330 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:34 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2580599911' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:01:34.330 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:34 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3511474076' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:01:34.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:34 smithi052 ceph-mon[112917]: pgmap v519: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:34.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:34 smithi052 ceph-mon[112917]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:34.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:34 smithi052 ceph-mon[112917]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:34.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:34 smithi052 ceph-mon[112917]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:34.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:34 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2580599911' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:01:34.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:34 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3511474076' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:01:35.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:35 smithi052 ceph-mon[112917]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:35.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:35 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/800861312' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:01:35.516 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:35 smithi165 ceph-mon[82925]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:01:35.516 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:35 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/800861312' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:01:36.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:36 smithi052 ceph-mon[112917]: pgmap v520: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:36.510 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:36 smithi165 ceph-mon[82925]: pgmap v520: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:38 smithi052 ceph-mon[112917]: pgmap v521: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:38.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:38 smithi165 ceph-mon[82925]: pgmap v521: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:38.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:40.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:40 smithi052 ceph-mon[112917]: pgmap v522: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:40.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:40 smithi165 ceph-mon[82925]: pgmap v522: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:42.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:42 smithi052 ceph-mon[112917]: pgmap v523: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:42.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:42 smithi165 ceph-mon[82925]: pgmap v523: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:44.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:44 smithi052 ceph-mon[112917]: pgmap v524: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:44.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:44 smithi165 ceph-mon[82925]: pgmap v524: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:46.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:46 smithi052 ceph-mon[112917]: pgmap v525: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:46.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:46 smithi165 ceph-mon[82925]: pgmap v525: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:48.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:48 smithi052 ceph-mon[112917]: pgmap v526: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:48.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:48 smithi165 ceph-mon[82925]: pgmap v526: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:50 smithi052 ceph-mon[112917]: pgmap v527: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:50.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:50 smithi165 ceph-mon[82925]: pgmap v527: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:52.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:52 smithi052 ceph-mon[112917]: pgmap v528: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:52.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:52 smithi165 ceph-mon[82925]: pgmap v528: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:53.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:53.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:01:54.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:54 smithi052 ceph-mon[112917]: pgmap v529: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:54.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:54 smithi165 ceph-mon[82925]: pgmap v529: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:56.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:56 smithi052 ceph-mon[112917]: pgmap v530: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:56.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:56 smithi165 ceph-mon[82925]: pgmap v530: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:58.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:01:58 smithi052 ceph-mon[112917]: pgmap v531: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:01:58.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:01:58 smithi165 ceph-mon[82925]: pgmap v531: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:00 smithi052 ceph-mon[112917]: pgmap v532: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:00.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:00 smithi165 ceph-mon[82925]: pgmap v532: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:02 smithi052 ceph-mon[112917]: pgmap v533: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:02.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:02 smithi165 ceph-mon[82925]: pgmap v533: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:04.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.337+0000 7fda61c82640 1 -- 172.21.15.52:0/2663811947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100c00 msgr2=0x7fda5c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.337+0000 7fda61c82640 1 --2- 172.21.15.52:0/2663811947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100c00 0x7fda5c104c50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fda4400a990 tx=0x7fda4402b7d0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.337+0000 7fda61c82640 1 -- 172.21.15.52:0/2663811947 shutdown_connections 2024-09-06T15:02:04.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.337+0000 7fda61c82640 1 --2- 172.21.15.52:0/2663811947 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100c00 0x7fda5c104c50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.337+0000 7fda61c82640 1 --2- 172.21.15.52:0/2663811947 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda5c100250 0x7fda5c100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.337+0000 7fda61c82640 1 -- 172.21.15.52:0/2663811947 >> 172.21.15.52:0/2663811947 conn(0x7fda5c0fbc90 msgr2=0x7fda5c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.338+0000 7fda61c82640 1 -- 172.21.15.52:0/2663811947 shutdown_connections 2024-09-06T15:02:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.338+0000 7fda61c82640 1 -- 172.21.15.52:0/2663811947 wait complete. 2024-09-06T15:02:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.338+0000 7fda61c82640 1 Processor -- start 2024-09-06T15:02:04.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.338+0000 7fda61c82640 1 -- start start 2024-09-06T15:02:04.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda61c82640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100250 0x7fda5c101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda61c82640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda5c100c00 0x7fda5c102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda61c82640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c10cbb0 con 0x7fda5c100250 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda61c82640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda5c10ca30 con 0x7fda5c100c00 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100250 0x7fda5c101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100250 0x7fda5c101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52246/0 (socket says 172.21.15.52:52246) 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5b7fe640 1 -- 172.21.15.52:0/1935826089 learned_addr learned my addr 172.21.15.52:0/1935826089 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5affd640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda5c100c00 0x7fda5c102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5b7fe640 1 -- 172.21.15.52:0/1935826089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda5c100c00 msgr2=0x7fda5c102230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5b7fe640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda5c100c00 0x7fda5c102230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5b7fe640 1 -- 172.21.15.52:0/1935826089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5c102770 con 0x7fda5c100250 2024-09-06T15:02:04.340 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5affd640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda5c100c00 0x7fda5c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:02:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda5b7fe640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100250 0x7fda5c101cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00cc60 tx=0x7fda4c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.339+0000 7fda58ff9640 1 -- 172.21.15.52:0/1935826089 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda4c00ce10 con 0x7fda5c100250 2024-09-06T15:02:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.340+0000 7fda58ff9640 1 -- 172.21.15.52:0/1935826089 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda4c00f910 con 0x7fda5c100250 2024-09-06T15:02:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.340+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5c102a60 con 0x7fda5c100250 2024-09-06T15:02:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.340+0000 7fda58ff9640 1 -- 172.21.15.52:0/1935826089 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda4c018ae0 con 0x7fda5c100250 2024-09-06T15:02:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.340+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5c1a3d80 con 0x7fda5c100250 2024-09-06T15:02:04.341 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.341+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5c101730 con 0x7fda5c100250 2024-09-06T15:02:04.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.341+0000 7fda58ff9640 1 -- 172.21.15.52:0/1935826089 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fda4c018c80 con 0x7fda5c100250 2024-09-06T15:02:04.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.342+0000 7fda58ff9640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda480774b0 0x7fda48079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.342+0000 7fda58ff9640 1 -- 172.21.15.52:0/1935826089 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fda4c099d90 con 0x7fda5c100250 2024-09-06T15:02:04.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.342+0000 7fda5affd640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda480774b0 0x7fda48079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.343+0000 7fda5affd640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda480774b0 0x7fda48079970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda5c103780 tx=0x7fda440058d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:04.345 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.346+0000 7fda58ff9640 1 -- 172.21.15.52:0/1935826089 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fda4c014030 con 0x7fda5c100250 2024-09-06T15:02:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:04 smithi052 ceph-mon[112917]: pgmap v534: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:04.524 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.525+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda5c10a5c0 con 0x7fda480774b0 2024-09-06T15:02:04.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.526+0000 7fda58ff9640 1 -- 172.21.15.52:0/1935826089 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fda5c10a5c0 con 0x7fda480774b0 2024-09-06T15:02:04.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda480774b0 msgr2=0x7fda48079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda480774b0 0x7fda48079970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fda5c103780 tx=0x7fda440058d0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100250 msgr2=0x7fda5c101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100250 0x7fda5c101cf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00cc60 tx=0x7fda4c00a620 comp rx=0 tx=0).stop 2024-09-06T15:02:04.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 shutdown_connections 2024-09-06T15:02:04.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fda480774b0 0x7fda48079970 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda5c100c00 0x7fda5c102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 --2- 172.21.15.52:0/1935826089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda5c100250 0x7fda5c101cf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 >> 172.21.15.52:0/1935826089 conn(0x7fda5c0fbc90 msgr2=0x7fda5c0fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:04.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 shutdown_connections 2024-09-06T15:02:04.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.528+0000 7fda61c82640 1 -- 172.21.15.52:0/1935826089 wait complete. 2024-09-06T15:02:04.536 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:02:04.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:04 smithi165 ceph-mon[82925]: pgmap v534: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 -- 172.21.15.52:0/3284209920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 msgr2=0x7fa51c102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 --2- 172.21.15.52:0/3284209920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c102f40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa510009880 tx=0x7fa51002a530 comp rx=0 tx=0).stop 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 -- 172.21.15.52:0/3284209920 shutdown_connections 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 --2- 172.21.15.52:0/3284209920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa51c103480 0x7fa51c10b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 --2- 172.21.15.52:0/3284209920 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c102f40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 -- 172.21.15.52:0/3284209920 >> 172.21.15.52:0/3284209920 conn(0x7fa51c0fc520 msgr2=0x7fa51c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 -- 172.21.15.52:0/3284209920 shutdown_connections 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.612+0000 7fa522db9640 1 -- 172.21.15.52:0/3284209920 wait complete. 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa522db9640 1 Processor -- start 2024-09-06T15:02:04.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa522db9640 1 -- start start 2024-09-06T15:02:04.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa522db9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa522db9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa51c103480 0x7fa51c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa522db9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c10edf0 con 0x7fa51c102b60 2024-09-06T15:02:04.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa522db9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c10ec70 con 0x7fa51c103480 2024-09-06T15:02:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa520b55640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa520b55640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52262/0 (socket says 172.21.15.52:52262) 2024-09-06T15:02:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa520b55640 1 -- 172.21.15.52:0/957918924 learned_addr learned my addr 172.21.15.52:0/957918924 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa51bfff640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa51c103480 0x7fa51c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa520b55640 1 -- 172.21.15.52:0/957918924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa51c103480 msgr2=0x7fa51c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa520b55640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa51c103480 0x7fa51c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.613+0000 7fa520b55640 1 -- 172.21.15.52:0/957918924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c197880 con 0x7fa51c102b60 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.614+0000 7fa520b55640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c19d6c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa510004f90 tx=0x7fa5100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.614+0000 7fa519ffb640 1 -- 172.21.15.52:0/957918924 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa51003f070 con 0x7fa51c102b60 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.614+0000 7fa519ffb640 1 -- 172.21.15.52:0/957918924 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa510004c70 con 0x7fa51c102b60 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.614+0000 7fa519ffb640 1 -- 172.21.15.52:0/957918924 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa510035030 con 0x7fa51c102b60 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.614+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c197b10 con 0x7fa51c102b60 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.614+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c198040 con 0x7fa51c102b60 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.615+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa51c06a9f0 con 0x7fa51c102b60 2024-09-06T15:02:04.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.615+0000 7fa519ffb640 1 -- 172.21.15.52:0/957918924 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa510042070 con 0x7fa51c102b60 2024-09-06T15:02:04.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.616+0000 7fa519ffb640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa50c077460 0x7fa50c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.616+0000 7fa519ffb640 1 -- 172.21.15.52:0/957918924 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fa5100ba210 con 0x7fa51c102b60 2024-09-06T15:02:04.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.616+0000 7fa51bfff640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa50c077460 0x7fa50c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.616 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.616+0000 7fa51bfff640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa50c077460 0x7fa50c079920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa508005fd0 tx=0x7fa508005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:04.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.620+0000 7fa519ffb640 1 -- 172.21.15.52:0/957918924 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa510083170 con 0x7fa51c102b60 2024-09-06T15:02:04.796 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.797+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa51c105020 con 0x7fa50c077460 2024-09-06T15:02:04.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.798+0000 7fa519ffb640 1 -- 172.21.15.52:0/957918924 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa50800ea00 con 0x7fa50c077460 2024-09-06T15:02:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.800+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa50c077460 msgr2=0x7fa50c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.800+0000 7fa522db9640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa50c077460 0x7fa50c079920 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa508005fd0 tx=0x7fa508005850 comp rx=0 tx=0).stop 2024-09-06T15:02:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 msgr2=0x7fa51c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c19d6c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa510004f90 tx=0x7fa5100048f0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 shutdown_connections 2024-09-06T15:02:04.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa50c077460 0x7fa50c079920 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa51c103480 0x7fa51c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 --2- 172.21.15.52:0/957918924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa51c102b60 0x7fa51c19d6c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 >> 172.21.15.52:0/957918924 conn(0x7fa51c0fc520 msgr2=0x7fa51c107e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 shutdown_connections 2024-09-06T15:02:04.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.801+0000 7fa522db9640 1 -- 172.21.15.52:0/957918924 wait complete. 2024-09-06T15:02:04.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.883+0000 7f1c0273b640 1 -- 172.21.15.52:0/3581636974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc107900 msgr2=0x7f1bfc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.883+0000 7f1c0273b640 1 --2- 172.21.15.52:0/3581636974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc107900 0x7f1bfc107ce0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009880 tx=0x7f1bec02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.883+0000 7f1c0273b640 1 -- 172.21.15.52:0/3581636974 shutdown_connections 2024-09-06T15:02:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.883+0000 7f1c0273b640 1 --2- 172.21.15.52:0/3581636974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bfc101900 0x7f1bfc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.883+0000 7f1c0273b640 1 --2- 172.21.15.52:0/3581636974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc107900 0x7f1bfc107ce0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.883+0000 7f1c0273b640 1 -- 172.21.15.52:0/3581636974 >> 172.21.15.52:0/3581636974 conn(0x7f1bfc0fd600 msgr2=0x7f1bfc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.884+0000 7f1c0273b640 1 -- 172.21.15.52:0/3581636974 shutdown_connections 2024-09-06T15:02:04.883 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.884+0000 7f1c0273b640 1 -- 172.21.15.52:0/3581636974 wait complete. 2024-09-06T15:02:04.884 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.884+0000 7f1c0273b640 1 Processor -- start 2024-09-06T15:02:04.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.884+0000 7f1c0273b640 1 -- start start 2024-09-06T15:02:04.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.884+0000 7f1c0273b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc101900 0x7f1bfc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.884+0000 7f1c0273b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bfc107900 0x7f1bfc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.884+0000 7f1c0273b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc10edb0 con 0x7f1bfc101900 2024-09-06T15:02:04.885 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1c0273b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1bfc10ec30 con 0x7f1bfc107900 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc101900 0x7f1bfc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc101900 0x7f1bfc19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52282/0 (socket says 172.21.15.52:52282) 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfbfff640 1 -- 172.21.15.52:0/935608366 learned_addr learned my addr 172.21.15.52:0/935608366 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bfc107900 0x7f1bfc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfbfff640 1 -- 172.21.15.52:0/935608366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bfc107900 msgr2=0x7f1bfc19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfbfff640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bfc107900 0x7f1bfc19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfbfff640 1 -- 172.21.15.52:0/935608366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bfc1977c0 con 0x7f1bfc101900 2024-09-06T15:02:04.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bfbfff640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc101900 0x7f1bfc19d640 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1bec031460 tx=0x7f1bec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:04.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bf97fa640 1 -- 172.21.15.52:0/935608366 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bec03f070 con 0x7f1bfc101900 2024-09-06T15:02:04.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bf97fa640 1 -- 172.21.15.52:0/935608366 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bec004cf0 con 0x7f1bfc101900 2024-09-06T15:02:04.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bfc197a50 con 0x7f1bfc101900 2024-09-06T15:02:04.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1bf97fa640 1 -- 172.21.15.52:0/935608366 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bec035030 con 0x7f1bfc101900 2024-09-06T15:02:04.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.885+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bfc197f80 con 0x7f1bfc101900 2024-09-06T15:02:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.886+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bfc103040 con 0x7f1bfc101900 2024-09-06T15:02:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.887+0000 7f1bf97fa640 1 -- 172.21.15.52:0/935608366 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1bec042070 con 0x7f1bfc101900 2024-09-06T15:02:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.887+0000 7f1bf97fa640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1be40774b0 0x7f1be4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.887+0000 7f1bf97fa640 1 -- 172.21.15.52:0/935608366 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1bec0ba0b0 con 0x7f1bfc101900 2024-09-06T15:02:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.887+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1be40774b0 0x7f1be4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:04.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.888+0000 7f1bfb7fe640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1be40774b0 0x7f1be4079970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc100e00 tx=0x7f1bf000a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:04.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:04.891+0000 7f1bf97fa640 1 -- 172.21.15.52:0/935608366 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1bec083090 con 0x7f1bfc101900 2024-09-06T15:02:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.060+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1bfc198230 con 0x7f1be40774b0 2024-09-06T15:02:05.068 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.069+0000 7f1bf97fa640 1 -- 172.21.15.52:0/935608366 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1bfc198230 con 0x7f1be40774b0 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (14m) 8m ago 25m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (17m) 8m ago 25m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (16m) 8m ago 24m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (12m) 8m ago 25m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (12m) 8m ago 24m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (14m) 8m ago 25m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:02:05.069 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (9m) 8m ago 20m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (8m) 8m ago 20m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (8m) 8m ago 20m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (8m) 8m ago 20m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (16m) 8m ago 26m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (15m) 8m ago 24m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (13m) 8m ago 26m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (12m) 8m ago 24m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (15m) 8m ago 25m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (15m) 8m ago 24m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (12m) 8m ago 23m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (11m) 8m ago 23m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (11m) 8m ago 22m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:02:05.070 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (10m) 8m ago 22m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:02:05.071 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (10m) 8m ago 21m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:02:05.071 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (9m) 8m ago 21m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:02:05.071 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (14m) 8m ago 25m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:02:05.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1be40774b0 msgr2=0x7f1be4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1be40774b0 0x7f1be4079970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc100e00 tx=0x7f1bf000a2d0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc101900 msgr2=0x7f1bfc19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc101900 0x7f1bfc19d640 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1bec031460 tx=0x7f1bec0048f0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 shutdown_connections 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1be40774b0 0x7f1be4079970 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1bfc107900 0x7f1bfc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 --2- 172.21.15.52:0/935608366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bfc101900 0x7f1bfc19d640 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 >> 172.21.15.52:0/935608366 conn(0x7f1bfc0fd600 msgr2=0x7f1bfc0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 shutdown_connections 2024-09-06T15:02:05.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.071+0000 7f1c0273b640 1 -- 172.21.15.52:0/935608366 wait complete. 2024-09-06T15:02:05.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 -- 172.21.15.52:0/4026767052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf01033e0 msgr2=0x7f4bf010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/4026767052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf01033e0 0x7f4bf010b8d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009880 tx=0x7f4be002a530 comp rx=0 tx=0).stop 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 -- 172.21.15.52:0/4026767052 shutdown_connections 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/4026767052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf01033e0 0x7f4bf010b8d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/4026767052 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf0102ac0 0x7f4bf0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 -- 172.21.15.52:0/4026767052 >> 172.21.15.52:0/4026767052 conn(0x7f4bf00fc520 msgr2=0x7f4bf00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 -- 172.21.15.52:0/4026767052 shutdown_connections 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 -- 172.21.15.52:0/4026767052 wait complete. 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.154+0000 7f4bf76ee640 1 Processor -- start 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf76ee640 1 -- start start 2024-09-06T15:02:05.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf76ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf0102ac0 0x7f4bf0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf76ee640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf01033e0 0x7f4bf0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf76ee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf010edd0 con 0x7f4bf0102ac0 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf76ee640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf010ec50 con 0x7f4bf01033e0 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf548a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf0102ac0 0x7f4bf0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf548a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf0102ac0 0x7f4bf0100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52314/0 (socket says 172.21.15.52:52314) 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf548a640 1 -- 172.21.15.52:0/3161329939 learned_addr learned my addr 172.21.15.52:0/3161329939 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf4c89640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf01033e0 0x7f4bf0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf548a640 1 -- 172.21.15.52:0/3161329939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf01033e0 msgr2=0x7f4bf0100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf548a640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf01033e0 0x7f4bf0100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf548a640 1 -- 172.21.15.52:0/3161329939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf01011a0 con 0x7f4bf0102ac0 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf4c89640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf01033e0 0x7f4bf0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4bf548a640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf0102ac0 0x7f4bf0100720 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c8a0 tx=0x7f4bec00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:05.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.155+0000 7f4be67fc640 1 -- 172.21.15.52:0/3161329939 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bec0079b0 con 0x7f4bf0102ac0 2024-09-06T15:02:05.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.156+0000 7f4be67fc640 1 -- 172.21.15.52:0/3161329939 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bec007b50 con 0x7f4bf0102ac0 2024-09-06T15:02:05.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.156+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf0101490 con 0x7f4bf0102ac0 2024-09-06T15:02:05.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.156+0000 7f4be67fc640 1 -- 172.21.15.52:0/3161329939 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bec018700 con 0x7f4bf0102ac0 2024-09-06T15:02:05.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.156+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf01a3e00 con 0x7f4bf0102ac0 2024-09-06T15:02:05.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.157+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf006aa90 con 0x7f4bf0102ac0 2024-09-06T15:02:05.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.157+0000 7f4be67fc640 1 -- 172.21.15.52:0/3161329939 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4bec007d00 con 0x7f4bf0102ac0 2024-09-06T15:02:05.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.158+0000 7f4be67fc640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bdc0774b0 0x7f4bdc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.158+0000 7f4bf4c89640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bdc0774b0 0x7f4bdc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.158+0000 7f4be67fc640 1 -- 172.21.15.52:0/3161329939 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4bec0999a0 con 0x7f4bf0102ac0 2024-09-06T15:02:05.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.158+0000 7f4bf4c89640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bdc0774b0 0x7f4bdc079970 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4be0006010 tx=0x7f4be00095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:05.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.162+0000 7f4be67fc640 1 -- 172.21.15.52:0/3161329939 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4bec014030 con 0x7f4bf0102ac0 2024-09-06T15:02:05.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.382+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4bf0105fc0 con 0x7f4bf0102ac0 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.383+0000 7f4be67fc640 1 -- 172.21.15.52:0/3161329939 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4bec062980 con 0x7f4bf0102ac0 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:02:05.382 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:02:05.383 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:02:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.384+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bdc0774b0 msgr2=0x7f4bdc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.384+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bdc0774b0 0x7f4bdc079970 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4be0006010 tx=0x7f4be00095f0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.384+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf0102ac0 msgr2=0x7f4bf0100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.384+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf0102ac0 0x7f4bf0100720 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00c8a0 tx=0x7f4bec00cd60 comp rx=0 tx=0).stop 2024-09-06T15:02:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.385+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 shutdown_connections 2024-09-06T15:02:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.385+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bdc0774b0 0x7f4bdc079970 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.385+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bf01033e0 0x7f4bf0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.385+0000 7f4bf76ee640 1 --2- 172.21.15.52:0/3161329939 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bf0102ac0 0x7f4bf0100720 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.385+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 >> 172.21.15.52:0/3161329939 conn(0x7f4bf00fc520 msgr2=0x7f4bf0108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.385+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 shutdown_connections 2024-09-06T15:02:05.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.385+0000 7f4bf76ee640 1 -- 172.21.15.52:0/3161329939 wait complete. 2024-09-06T15:02:05.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 -- 172.21.15.52:0/1403230834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc101900 msgr2=0x7f81cc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 --2- 172.21.15.52:0/1403230834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc101900 0x7f81cc101d60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009880 tx=0x7f81c002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 -- 172.21.15.52:0/1403230834 shutdown_connections 2024-09-06T15:02:05.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 --2- 172.21.15.52:0/1403230834 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc101900 0x7f81cc101d60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 --2- 172.21.15.52:0/1403230834 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81cc107900 0x7f81cc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 -- 172.21.15.52:0/1403230834 >> 172.21.15.52:0/1403230834 conn(0x7f81cc0fd600 msgr2=0x7f81cc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:05.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 -- 172.21.15.52:0/1403230834 shutdown_connections 2024-09-06T15:02:05.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.467+0000 7f81d0c39640 1 -- 172.21.15.52:0/1403230834 wait complete. 2024-09-06T15:02:05.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81d0c39640 1 Processor -- start 2024-09-06T15:02:05.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81d0c39640 1 -- start start 2024-09-06T15:02:05.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81d0c39640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81cc101900 0x7f81cc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81d0c39640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc107900 0x7f81cc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81d0c39640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc10edd0 con 0x7f81cc107900 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81d0c39640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f81cc10ec50 con 0x7f81cc101900 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81c9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc107900 0x7f81cc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81c9d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc107900 0x7f81cc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52330/0 (socket says 172.21.15.52:52330) 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81c9d9b640 1 -- 172.21.15.52:0/272551423 learned_addr learned my addr 172.21.15.52:0/272551423 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.468+0000 7f81ca59c640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81cc101900 0x7f81cc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81c9d9b640 1 -- 172.21.15.52:0/272551423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81cc101900 msgr2=0x7f81cc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81c9d9b640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81cc101900 0x7f81cc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81c9d9b640 1 -- 172.21.15.52:0/272551423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81cc074f70 con 0x7f81cc107900 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81c9d9b640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc107900 0x7f81cc074a30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f81c0031460 tx=0x7f81c00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81bb7fe640 1 -- 172.21.15.52:0/272551423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81c003f070 con 0x7f81cc107900 2024-09-06T15:02:05.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81bb7fe640 1 -- 172.21.15.52:0/272551423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81c00035f0 con 0x7f81cc107900 2024-09-06T15:02:05.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81cc075200 con 0x7f81cc107900 2024-09-06T15:02:05.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81bb7fe640 1 -- 172.21.15.52:0/272551423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81c0035030 con 0x7f81cc107900 2024-09-06T15:02:05.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.469+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81cc1a3dc0 con 0x7f81cc107900 2024-09-06T15:02:05.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.470+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81cc103040 con 0x7f81cc107900 2024-09-06T15:02:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.471+0000 7f81bb7fe640 1 -- 172.21.15.52:0/272551423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f81c0042070 con 0x7f81cc107900 2024-09-06T15:02:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.471+0000 7f81bb7fe640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81b4077460 0x7f81b4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.471+0000 7f81bb7fe640 1 -- 172.21.15.52:0/272551423 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f81c00ba0c0 con 0x7f81cc107900 2024-09-06T15:02:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.471+0000 7f81ca59c640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81b4077460 0x7f81b4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.472+0000 7f81ca59c640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81b4077460 0x7f81b4079920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005fd0 tx=0x7f81bc00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:05.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.475+0000 7f81bb7fe640 1 -- 172.21.15.52:0/272551423 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f81c0087190 con 0x7f81cc107900 2024-09-06T15:02:05.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.658+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f81cc109e70 con 0x7f81cc107900 2024-09-06T15:02:05.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.659+0000 7f81bb7fe640 1 -- 172.21.15.52:0/272551423 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f81c008bbb0 con 0x7f81cc107900 2024-09-06T15:02:05.658 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:02:05.658 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:02:05.658 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:02:05.658 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:02:05.658 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:02:05.658 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:02:05.659 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:02:05.660 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:05.661 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:05.662 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:02:05.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.660+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81b4077460 msgr2=0x7f81b4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.660+0000 7f81d0c39640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81b4077460 0x7f81b4079920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f81bc005fd0 tx=0x7f81bc00b390 comp rx=0 tx=0).stop 2024-09-06T15:02:05.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.660+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc107900 msgr2=0x7f81cc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.660+0000 7f81d0c39640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc107900 0x7f81cc074a30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f81c0031460 tx=0x7f81c00045e0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.661+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 shutdown_connections 2024-09-06T15:02:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.661+0000 7f81d0c39640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81cc107900 0x7f81cc074a30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.661+0000 7f81d0c39640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81b4077460 0x7f81b4079920 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.661+0000 7f81d0c39640 1 --2- 172.21.15.52:0/272551423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f81cc101900 0x7f81cc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.661+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 >> 172.21.15.52:0/272551423 conn(0x7f81cc0fd600 msgr2=0x7f81cc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.661+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 shutdown_connections 2024-09-06T15:02:05.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.661+0000 7f81d0c39640 1 -- 172.21.15.52:0/272551423 wait complete. 2024-09-06T15:02:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 -- 172.21.15.52:0/2991035879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c101900 msgr2=0x7f5e7c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 --2- 172.21.15.52:0/2991035879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c101900 0x7f5e7c101d60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009880 tx=0x7f5e6c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 -- 172.21.15.52:0/2991035879 shutdown_connections 2024-09-06T15:02:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 --2- 172.21.15.52:0/2991035879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c101900 0x7f5e7c101d60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 --2- 172.21.15.52:0/2991035879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e7c107900 0x7f5e7c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 -- 172.21.15.52:0/2991035879 >> 172.21.15.52:0/2991035879 conn(0x7f5e7c0fd600 msgr2=0x7f5e7c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 -- 172.21.15.52:0/2991035879 shutdown_connections 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.745+0000 7f5e83d02640 1 -- 172.21.15.52:0/2991035879 wait complete. 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e83d02640 1 Processor -- start 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e83d02640 1 -- start start 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e83d02640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e7c101900 0x7f5e7c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e83d02640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c107900 0x7f5e7c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e83d02640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c10edb0 con 0x7f5e7c107900 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e83d02640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c10ec30 con 0x7f5e7c101900 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e8129d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c107900 0x7f5e7c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e8129d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c107900 0x7f5e7c19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52358/0 (socket says 172.21.15.52:52358) 2024-09-06T15:02:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e8129d640 1 -- 172.21.15.52:0/1154248357 learned_addr learned my addr 172.21.15.52:0/1154248357 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e81a9e640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e7c101900 0x7f5e7c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e8129d640 1 -- 172.21.15.52:0/1154248357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e7c101900 msgr2=0x7f5e7c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e8129d640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e7c101900 0x7f5e7c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e8129d640 1 -- 172.21.15.52:0/1154248357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c1977d0 con 0x7f5e7c107900 2024-09-06T15:02:05.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.746+0000 7f5e8129d640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c107900 0x7f5e7c19db90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c031460 tx=0x7f5e6c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.747+0000 7f5e72ffd640 1 -- 172.21.15.52:0/1154248357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c03f070 con 0x7f5e7c107900 2024-09-06T15:02:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.747+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7c197a60 con 0x7f5e7c107900 2024-09-06T15:02:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.747+0000 7f5e72ffd640 1 -- 172.21.15.52:0/1154248357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e6c004cf0 con 0x7f5e7c107900 2024-09-06T15:02:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.747+0000 7f5e72ffd640 1 -- 172.21.15.52:0/1154248357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c035030 con 0x7f5e7c107900 2024-09-06T15:02:05.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.747+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7c197f90 con 0x7f5e7c107900 2024-09-06T15:02:05.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.748+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7c103040 con 0x7f5e7c107900 2024-09-06T15:02:05.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.748+0000 7f5e72ffd640 1 -- 172.21.15.52:0/1154248357 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5e6c042070 con 0x7f5e7c107900 2024-09-06T15:02:05.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.749+0000 7f5e72ffd640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e68077460 0x7f5e68079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:05.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.749+0000 7f5e72ffd640 1 -- 172.21.15.52:0/1154248357 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f5e6c0ba230 con 0x7f5e7c107900 2024-09-06T15:02:05.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.749+0000 7f5e81a9e640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e68077460 0x7f5e68079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:05.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.749+0000 7f5e81a9e640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e68077460 0x7f5e68079920 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005e10 tx=0x7f5e78005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:05.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.753+0000 7f5e72ffd640 1 -- 172.21.15.52:0/1154248357 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5e6c083190 con 0x7f5e7c107900 2024-09-06T15:02:05.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.929+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5e7c198300 con 0x7f5e68077460 2024-09-06T15:02:05.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.930+0000 7f5e72ffd640 1 -- 172.21.15.52:0/1154248357 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5e7c198300 con 0x7f5e68077460 2024-09-06T15:02:05.929 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:02:05.929 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:02:05.929 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:02:05.930 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.932+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e68077460 msgr2=0x7f5e68079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e68077460 0x7f5e68079920 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e78005e10 tx=0x7f5e78005da0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c107900 msgr2=0x7f5e7c19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c107900 0x7f5e7c19db90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c031460 tx=0x7f5e6c0048f0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 shutdown_connections 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e7c107900 0x7f5e7c19db90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e68077460 0x7f5e68079920 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 --2- 172.21.15.52:0/1154248357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e7c101900 0x7f5e7c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 >> 172.21.15.52:0/1154248357 conn(0x7f5e7c0fd600 msgr2=0x7f5e7c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:05.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 shutdown_connections 2024-09-06T15:02:05.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:05.933+0000 7f5e83d02640 1 -- 172.21.15.52:0/1154248357 wait complete. 2024-09-06T15:02:06.020 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 -- 172.21.15.52:0/1511361980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 msgr2=0x7f8384100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 --2- 172.21.15.52:0/1511361980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f8384100a30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8378009880 tx=0x7f837802a490 comp rx=0 tx=0).stop 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 -- 172.21.15.52:0/1511361980 shutdown_connections 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 --2- 172.21.15.52:0/1511361980 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8384101000 0x7f838410dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 --2- 172.21.15.52:0/1511361980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f8384100a30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 -- 172.21.15.52:0/1511361980 >> 172.21.15.52:0/1511361980 conn(0x7f83840fc520 msgr2=0x7f83840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 -- 172.21.15.52:0/1511361980 shutdown_connections 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.020+0000 7f838acf9640 1 -- 172.21.15.52:0/1511361980 wait complete. 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f838acf9640 1 Processor -- start 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f838acf9640 1 -- start start 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f838acf9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f838419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f838acf9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8384101000 0x7f838419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:06.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f838acf9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8384110fb0 con 0x7f8384100650 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f838acf9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8384110e30 con 0x7f8384101000 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f8388a95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f838419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f8388a95640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f838419f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52372/0 (socket says 172.21.15.52:52372) 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f8388a95640 1 -- 172.21.15.52:0/633873059 learned_addr learned my addr 172.21.15.52:0/633873059 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.021+0000 7f8383fff640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8384101000 0x7f838419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f8388a95640 1 -- 172.21.15.52:0/633873059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8384101000 msgr2=0x7f838419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f8388a95640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8384101000 0x7f838419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f8388a95640 1 -- 172.21.15.52:0/633873059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8384199a40 con 0x7f8384100650 2024-09-06T15:02:06.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f8388a95640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f838419f880 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8378031460 tx=0x7f83780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f8381ffb640 1 -- 172.21.15.52:0/633873059 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f837803f070 con 0x7f8384100650 2024-09-06T15:02:06.023 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8384199cd0 con 0x7f8384100650 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f8381ffb640 1 -- 172.21.15.52:0/633873059 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83780035f0 con 0x7f8384100650 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f8381ffb640 1 -- 172.21.15.52:0/633873059 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8378035030 con 0x7f8384100650 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.022+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838419a260 con 0x7f8384100650 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.023+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838406aa90 con 0x7f8384100650 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.024+0000 7f8381ffb640 1 -- 172.21.15.52:0/633873059 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8378042070 con 0x7f8384100650 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.024+0000 7f8381ffb640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8374077460 0x7f8374079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.024+0000 7f8381ffb640 1 -- 172.21.15.52:0/633873059 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f83780ba0c0 con 0x7f8384100650 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.024+0000 7f8383fff640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8374077460 0x7f8374079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:06.024 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.025+0000 7f8383fff640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8374077460 0x7f8374079920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8384102520 tx=0x7f837000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:06.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.028+0000 7f8381ffb640 1 -- 172.21.15.52:0/633873059 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8378087190 con 0x7f8384100650 2024-09-06T15:02:06.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.247+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f838410b3a0 con 0x7f8384100650 2024-09-06T15:02:06.246 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:06 smithi052 ceph-mon[112917]: pgmap v535: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:06.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:06 smithi052 ceph-mon[112917]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:06.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:06 smithi052 ceph-mon[112917]: from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:06.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:06 smithi052 ceph-mon[112917]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:06.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:06 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3161329939' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:02:06.247 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:06 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/272551423' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:02:06.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.247+0000 7f8381ffb640 1 -- 172.21.15.52:0/633873059 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f837808bbb0 con 0x7f8384100650 2024-09-06T15:02:06.247 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:02:06.248 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:02:06.249 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:02:06.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.249+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8374077460 msgr2=0x7f8374079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:06.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.249+0000 7f838acf9640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8374077460 0x7f8374079920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8384102520 tx=0x7f837000b390 comp rx=0 tx=0).stop 2024-09-06T15:02:06.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.249+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 msgr2=0x7f838419f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.249+0000 7f838acf9640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f838419f880 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8378031460 tx=0x7f83780045e0 comp rx=0 tx=0).stop 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.250+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 shutdown_connections 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.250+0000 7f838acf9640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8374077460 0x7f8374079920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.250+0000 7f838acf9640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8384101000 0x7f838419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.250+0000 7f838acf9640 1 --2- 172.21.15.52:0/633873059 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8384100650 0x7f838419f880 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.250+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 >> 172.21.15.52:0/633873059 conn(0x7f83840fc520 msgr2=0x7f83840fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.250+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 shutdown_connections 2024-09-06T15:02:06.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:06.250+0000 7f838acf9640 1 -- 172.21.15.52:0/633873059 wait complete. 2024-09-06T15:02:06.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:06 smithi165 ceph-mon[82925]: pgmap v535: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:06 smithi165 ceph-mon[82925]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:06 smithi165 ceph-mon[82925]: from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:06 smithi165 ceph-mon[82925]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:06 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3161329939' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:02:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:06 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/272551423' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:02:07.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:07 smithi165 ceph-mon[82925]: from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:07.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:07 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/633873059' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:02:07.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:07 smithi052 ceph-mon[112917]: from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:07.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:07 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/633873059' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:02:08.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:08 smithi165 ceph-mon[82925]: pgmap v536: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:08.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:08.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:08 smithi052 ceph-mon[112917]: pgmap v536: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:08.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:10.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:10 smithi165 ceph-mon[82925]: pgmap v537: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:10.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:10 smithi052 ceph-mon[112917]: pgmap v537: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:11.324 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:11 smithi165 ceph-mon[82925]: pgmap v538: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:11.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:11 smithi052 ceph-mon[112917]: pgmap v538: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:13.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:13 smithi052 ceph-mon[112917]: pgmap v539: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:13.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:13 smithi165 ceph-mon[82925]: pgmap v539: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:15.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:15 smithi165 ceph-mon[82925]: pgmap v540: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:15.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:15 smithi052 ceph-mon[112917]: pgmap v540: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:17.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:17 smithi165 ceph-mon[82925]: pgmap v541: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:17.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:17 smithi052 ceph-mon[112917]: pgmap v541: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:19.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:19 smithi052 ceph-mon[112917]: pgmap v542: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:19.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:19 smithi165 ceph-mon[82925]: pgmap v542: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:21.574 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:21 smithi165 ceph-mon[82925]: pgmap v543: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:21.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:21 smithi052 ceph-mon[112917]: pgmap v543: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:23.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:23 smithi165 ceph-mon[82925]: pgmap v544: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:23.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:23.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:23 smithi052 ceph-mon[112917]: pgmap v544: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:23.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:25.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:25 smithi052 ceph-mon[112917]: pgmap v545: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:25.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:25 smithi165 ceph-mon[82925]: pgmap v545: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:27.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:27 smithi165 ceph-mon[82925]: pgmap v546: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:27.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:27 smithi052 ceph-mon[112917]: pgmap v546: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:29.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:29 smithi165 ceph-mon[82925]: pgmap v547: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:29.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:29 smithi052 ceph-mon[112917]: pgmap v547: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:31.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:31 smithi052 ceph-mon[112917]: pgmap v548: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:31.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:31 smithi165 ceph-mon[82925]: pgmap v548: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:33.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:33 smithi165 ceph-mon[82925]: pgmap v549: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:33.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:33 smithi052 ceph-mon[112917]: pgmap v549: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:35.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:35 smithi165 ceph-mon[82925]: pgmap v550: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:35.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:35 smithi052 ceph-mon[112917]: pgmap v550: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 -- 172.21.15.52:0/1338949248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 msgr2=0x7fac60102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1338949248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac60102cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fac50009c20 tx=0x7fac5002aa00 comp rx=0 tx=0).stop 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 -- 172.21.15.52:0/1338949248 shutdown_connections 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1338949248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac601031f0 0x7fac6010b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1338949248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac60102cb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 -- 172.21.15.52:0/1338949248 >> 172.21.15.52:0/1338949248 conn(0x7fac600fc310 msgr2=0x7fac600fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 -- 172.21.15.52:0/1338949248 shutdown_connections 2024-09-06T15:02:36.348 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.348+0000 7fac5f59e640 1 -- 172.21.15.52:0/1338949248 wait complete. 2024-09-06T15:02:36.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.349+0000 7fac5f59e640 1 Processor -- start 2024-09-06T15:02:36.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.349+0000 7fac5f59e640 1 -- start start 2024-09-06T15:02:36.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5f59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac6019d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5f59e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac601031f0 0x7fac6019d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5f59e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fac6010ec00 con 0x7fac601028d0 2024-09-06T15:02:36.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5f59e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac6010ea80 con 0x7fac601031f0 2024-09-06T15:02:36.350 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac6019d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac6019d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58478/0 (socket says 172.21.15.52:58478) 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5e59c640 1 -- 172.21.15.52:0/1296559610 learned_addr learned my addr 172.21.15.52:0/1296559610 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5dd9b640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac601031f0 0x7fac6019d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5e59c640 1 -- 172.21.15.52:0/1296559610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac601031f0 msgr2=0x7fac6019d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5e59c640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac601031f0 0x7fac6019d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5e59c640 1 -- 172.21.15.52:0/1296559610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac60197610 con 0x7fac601028d0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac5e59c640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac6019d450 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fac50006010 tx=0x7fac5002ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.350+0000 7fac4f7fe640 1 -- 172.21.15.52:0/1296559610 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac50047070 con 0x7fac601028d0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.351+0000 7fac4f7fe640 1 -- 172.21.15.52:0/1296559610 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac50003e30 con 0x7fac601028d0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.351+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac601978a0 con 0x7fac601028d0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.351+0000 7fac4f7fe640 1 -- 172.21.15.52:0/1296559610 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac50033050 con 0x7fac601028d0 2024-09-06T15:02:36.351 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.351+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac60197dd0 con 0x7fac601028d0 2024-09-06T15:02:36.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.352+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac6006a580 con 0x7fac601028d0 2024-09-06T15:02:36.352 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.352+0000 7fac4f7fe640 1 -- 172.21.15.52:0/1296559610 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fac5004a070 con 0x7fac601028d0 2024-09-06T15:02:36.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.353+0000 7fac4f7fe640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac48077460 0x7fac48079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.353+0000 7fac4f7fe640 1 -- 172.21.15.52:0/1296559610 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fac5003e030 con 0x7fac601028d0 2024-09-06T15:02:36.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.353+0000 7fac5dd9b640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac48077460 0x7fac48079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.353 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.353+0000 7fac5dd9b640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac48077460 0x7fac48079920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac540058c0 tx=0x7fac54005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:36.356 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.357+0000 7fac4f7fe640 1 -- 172.21.15.52:0/1296559610 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fac500837c0 con 0x7fac601028d0 2024-09-06T15:02:36.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.536+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fac60198140 con 0x7fac48077460 2024-09-06T15:02:36.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.537+0000 7fac4f7fe640 1 -- 172.21.15.52:0/1296559610 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fac60198140 con 0x7fac48077460 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac48077460 msgr2=0x7fac48079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac48077460 0x7fac48079920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fac540058c0 tx=0x7fac54005850 comp rx=0 tx=0).stop 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 msgr2=0x7fac6019d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac6019d450 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fac50006010 tx=0x7fac5002ed20 comp rx=0 tx=0).stop 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 shutdown_connections 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac48077460 0x7fac48079920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac601031f0 0x7fac6019d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.538 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 --2- 172.21.15.52:0/1296559610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac601028d0 0x7fac6019d450 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 >> 172.21.15.52:0/1296559610 conn(0x7fac600fc310 msgr2=0x7fac60108d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 shutdown_connections 2024-09-06T15:02:36.539 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.539+0000 7fac5f59e640 1 -- 172.21.15.52:0/1296559610 wait complete. 2024-09-06T15:02:36.547 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:02:36.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 -- 172.21.15.52:0/2117803339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238107900 msgr2=0x7f9238107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 --2- 172.21.15.52:0/2117803339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238107900 0x7f9238107ce0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9228009c20 tx=0x7f922802a970 comp rx=0 tx=0).stop 2024-09-06T15:02:36.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 -- 172.21.15.52:0/2117803339 shutdown_connections 2024-09-06T15:02:36.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 --2- 172.21.15.52:0/2117803339 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9238101900 0x7f9238101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 --2- 172.21.15.52:0/2117803339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238107900 0x7f9238107ce0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 -- 172.21.15.52:0/2117803339 >> 172.21.15.52:0/2117803339 conn(0x7f92380fd600 msgr2=0x7f92380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:36.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 -- 172.21.15.52:0/2117803339 shutdown_connections 2024-09-06T15:02:36.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.624+0000 7f92405b6640 1 -- 172.21.15.52:0/2117803339 wait complete. 2024-09-06T15:02:36.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f92405b6640 1 Processor -- start 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f92405b6640 1 -- start start 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f92405b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238101900 0x7f923819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f92405b6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9238107900 0x7f923819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f92405b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f923810edb0 con 0x7f9238101900 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f92405b6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f923810ec30 con 0x7f9238107900 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f923e352640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238101900 0x7f923819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f923e352640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238101900 0x7f923819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58500/0 (socket says 172.21.15.52:58500) 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f923e352640 1 -- 172.21.15.52:0/3094219186 learned_addr learned my addr 172.21.15.52:0/3094219186 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.625+0000 7f923db51640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9238107900 0x7f923819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f923e352640 1 -- 172.21.15.52:0/3094219186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9238107900 msgr2=0x7f923819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f923e352640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9238107900 0x7f923819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f923e352640 1 -- 172.21.15.52:0/3094219186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92381977e0 con 0x7f9238101900 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f923db51640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9238107900 0x7f923819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f923e352640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238101900 0x7f923819d660 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9228005cc0 tx=0x7f922802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f92377fe640 1 -- 172.21.15.52:0/3094219186 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9228047070 con 0x7f9238101900 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9238197a70 con 0x7f9238101900 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f92377fe640 1 -- 172.21.15.52:0/3094219186 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f922802f7e0 con 0x7f9238101900 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f92377fe640 1 -- 172.21.15.52:0/3094219186 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9228034070 con 0x7f9238101900 2024-09-06T15:02:36.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.626+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9238197fa0 con 0x7f9238101900 2024-09-06T15:02:36.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.627+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9238103040 con 0x7f9238101900 2024-09-06T15:02:36.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.628+0000 7f92377fe640 1 -- 172.21.15.52:0/3094219186 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f922804a070 con 0x7f9238101900 2024-09-06T15:02:36.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.628+0000 7f92377fe640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9220077460 0x7f9220079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.629+0000 7f92377fe640 1 -- 172.21.15.52:0/3094219186 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f92280ba690 con 0x7f9238101900 2024-09-06T15:02:36.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.629+0000 7f923db51640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9220077460 0x7f9220079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.629+0000 7f923db51640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9220077460 0x7f9220079920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9238100d10 tx=0x7f922c00a5c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:36.631 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.633+0000 7f92377fe640 1 -- 172.21.15.52:0/3094219186 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f922803f070 con 0x7f9238101900 2024-09-06T15:02:36.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.809+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9238198310 con 0x7f9220077460 2024-09-06T15:02:36.809 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.811+0000 7f92377fe640 1 -- 172.21.15.52:0/3094219186 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9238198310 con 0x7f9220077460 2024-09-06T15:02:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9220077460 msgr2=0x7f9220079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9220077460 0x7f9220079920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9238100d10 tx=0x7f922c00a5c0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238101900 msgr2=0x7f923819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238101900 0x7f923819d660 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9228005cc0 tx=0x7f922802f5f0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 shutdown_connections 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9220077460 0x7f9220079920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9238107900 0x7f923819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 --2- 172.21.15.52:0/3094219186 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9238101900 0x7f923819d660 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.812+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 >> 172.21.15.52:0/3094219186 conn(0x7f92380fd600 msgr2=0x7f92380fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.813+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 shutdown_connections 2024-09-06T15:02:36.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.813+0000 7f92405b6640 1 -- 172.21.15.52:0/3094219186 wait complete. 2024-09-06T15:02:36.894 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 -- 172.21.15.52:0/3112476779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 msgr2=0x7fc368106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/3112476779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc368106be0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc358009880 tx=0x7fc35802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 -- 172.21.15.52:0/3112476779 shutdown_connections 2024-09-06T15:02:36.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/3112476779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc368100800 0x7fc368100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/3112476779 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc368106be0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 -- 172.21.15.52:0/3112476779 >> 172.21.15.52:0/3112476779 conn(0x7fc3680fc520 msgr2=0x7fc3680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:36.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 -- 172.21.15.52:0/3112476779 shutdown_connections 2024-09-06T15:02:36.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.895+0000 7fc36dcfa640 1 -- 172.21.15.52:0/3112476779 wait complete. 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.896+0000 7fc36dcfa640 1 Processor -- start 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.896+0000 7fc36dcfa640 1 -- start start 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.896+0000 7fc36dcfa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc368100800 0x7fc3680fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.896+0000 7fc36dcfa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc3680fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.896+0000 7fc36dcfa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc36810dd30 con 0x7fc368106800 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.896+0000 7fc36dcfa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc36810dbb0 con 0x7fc368100800 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc366ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc3680fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc366ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc3680fd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58510/0 (socket says 172.21.15.52:58510) 2024-09-06T15:02:36.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc366ffd640 1 -- 172.21.15.52:0/2333830250 learned_addr learned my addr 172.21.15.52:0/2333830250 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc3677fe640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc368100800 0x7fc3680fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc366ffd640 1 -- 172.21.15.52:0/2333830250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc368100800 msgr2=0x7fc3680fcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc366ffd640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc368100800 0x7fc3680fcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc366ffd640 1 -- 172.21.15.52:0/2333830250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3680fd6f0 con 0x7fc368106800 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc366ffd640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc3680fd1b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00b420 tx=0x7fc35c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc364ff9640 1 -- 172.21.15.52:0/2333830250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc35c011630 con 0x7fc368106800 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc364ff9640 1 -- 172.21.15.52:0/2333830250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc35c016070 con 0x7fc368106800 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3680fd9e0 con 0x7fc368106800 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc364ff9640 1 -- 172.21.15.52:0/2333830250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc35c010d40 con 0x7fc368106800 2024-09-06T15:02:36.898 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.897+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3681a3f00 con 0x7fc368106800 2024-09-06T15:02:36.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.898+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc368101f40 con 0x7fc368106800 2024-09-06T15:02:36.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.899+0000 7fc364ff9640 1 -- 172.21.15.52:0/2333830250 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc35c01b460 con 0x7fc368106800 2024-09-06T15:02:36.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.899+0000 7fc364ff9640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3500774b0 0x7fc350079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:36.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.900+0000 7fc3677fe640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3500774b0 0x7fc350079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:36.899 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.900+0000 7fc364ff9640 1 -- 172.21.15.52:0/2333830250 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc35c098df0 con 0x7fc368106800 2024-09-06T15:02:36.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.900+0000 7fc3677fe640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3500774b0 0x7fc350079970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3580096c0 tx=0x7fc358031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:36.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:36.903+0000 7fc364ff9640 1 -- 172.21.15.52:0/2333830250 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc35c061dd0 con 0x7fc368106800 2024-09-06T15:02:37.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.073+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc368062630 con 0x7fc3500774b0 2024-09-06T15:02:37.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.082+0000 7fc364ff9640 1 -- 172.21.15.52:0/2333830250 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc368062630 con 0x7fc3500774b0 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (15m) 9m ago 25m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (17m) 9m ago 26m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (17m) 8m ago 25m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (13m) 9m ago 26m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (13m) 8m ago 25m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (14m) 9m ago 25m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (9m) 9m ago 20m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (9m) 9m ago 20m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (9m) 8m ago 20m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (8m) 8m ago 20m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:02:37.082 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (17m) 9m ago 27m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (16m) 8m ago 25m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (13m) 9m ago 27m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (13m) 8m ago 25m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (15m) 9m ago 26m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (15m) 8m ago 25m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (12m) 9m ago 23m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (12m) 9m ago 23m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (11m) 9m ago 23m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (11m) 8m ago 22m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (10m) 8m ago 22m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (9m) 8m ago 21m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:02:37.083 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (15m) 9m ago 25m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:02:37.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3500774b0 msgr2=0x7fc350079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3500774b0 0x7fc350079970 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3580096c0 tx=0x7fc358031400 comp rx=0 tx=0).stop 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 msgr2=0x7fc3680fd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc3680fd1b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc35c00b420 tx=0x7fc35c00b8e0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 shutdown_connections 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc368106800 0x7fc3680fd1b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc3500774b0 0x7fc350079970 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 --2- 172.21.15.52:0/2333830250 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc368100800 0x7fc3680fcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 >> 172.21.15.52:0/2333830250 conn(0x7fc3680fc520 msgr2=0x7fc36806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 shutdown_connections 2024-09-06T15:02:37.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.085+0000 7fc36dcfa640 1 -- 172.21.15.52:0/2333830250 wait complete. 2024-09-06T15:02:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 -- 172.21.15.52:0/1813729085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 msgr2=0x7f0d181018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 --2- 172.21.15.52:0/1813729085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d181018b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009880 tx=0x7f0d0802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 -- 172.21.15.52:0/1813729085 shutdown_connections 2024-09-06T15:02:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 --2- 172.21.15.52:0/1813729085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d18101e80 0x7f0d181054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 --2- 172.21.15.52:0/1813729085 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d181018b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 -- 172.21.15.52:0/1813729085 >> 172.21.15.52:0/1813729085 conn(0x7f0d18077150 msgr2=0x7f0d18077560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 -- 172.21.15.52:0/1813729085 shutdown_connections 2024-09-06T15:02:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.166+0000 7f0d1e484640 1 -- 172.21.15.52:0/1813729085 wait complete. 2024-09-06T15:02:37.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d1e484640 1 Processor -- start 2024-09-06T15:02:37.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d1e484640 1 -- start start 2024-09-06T15:02:37.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d1e484640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d1819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d1e484640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d18101e80 0x7f0d1819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d1e484640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810dd00 con 0x7f0d181014d0 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d1e484640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810db80 con 0x7f0d18101e80 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d1819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d17fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d1819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58534/0 (socket says 172.21.15.52:58534) 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d17fff640 1 -- 172.21.15.52:0/2817172073 learned_addr learned my addr 172.21.15.52:0/2817172073 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.167+0000 7f0d177fe640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d18101e80 0x7f0d1819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d17fff640 1 -- 172.21.15.52:0/2817172073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d18101e80 msgr2=0x7f0d1819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d17fff640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d18101e80 0x7f0d1819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d17fff640 1 -- 172.21.15.52:0/2817172073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d18197850 con 0x7f0d181014d0 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d17fff640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d1819d6d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0d08031460 tx=0x7f0d080045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d157fa640 1 -- 172.21.15.52:0/2817172073 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d0803f070 con 0x7f0d181014d0 2024-09-06T15:02:37.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d157fa640 1 -- 172.21.15.52:0/2817172073 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d08004b10 con 0x7f0d181014d0 2024-09-06T15:02:37.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d18197ae0 con 0x7f0d181014d0 2024-09-06T15:02:37.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d157fa640 1 -- 172.21.15.52:0/2817172073 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d08035030 con 0x7f0d181014d0 2024-09-06T15:02:37.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.168+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d18198010 con 0x7f0d181014d0 2024-09-06T15:02:37.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.169+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d18069e70 con 0x7f0d181014d0 2024-09-06T15:02:37.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.170+0000 7f0d157fa640 1 -- 172.21.15.52:0/2817172073 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0d08042070 con 0x7f0d181014d0 2024-09-06T15:02:37.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.171+0000 7f0d157fa640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d00077460 0x7f0d00079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.171+0000 7f0d157fa640 1 -- 172.21.15.52:0/2817172073 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0d080ba2b0 con 0x7f0d181014d0 2024-09-06T15:02:37.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.171+0000 7f0d177fe640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d00077460 0x7f0d00079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.171+0000 7f0d177fe640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d00077460 0x7f0d00079920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0d18100e80 tx=0x7f0d0c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:37.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.174+0000 7f0d157fa640 1 -- 172.21.15.52:0/2817172073 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0d080872e0 con 0x7f0d181014d0 2024-09-06T15:02:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.397+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0d18109d50 con 0x7f0d181014d0 2024-09-06T15:02:37.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.397+0000 7f0d157fa640 1 -- 172.21.15.52:0/2817172073 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0d0808bd00 con 0x7f0d181014d0 2024-09-06T15:02:37.396 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:02:37.396 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:02:37.397 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:02:37.398 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:02:37.398 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:02:37.398 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:02:37.398 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:02:37.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d00077460 msgr2=0x7f0d00079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d00077460 0x7f0d00079920 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0d18100e80 tx=0x7f0d0c00b390 comp rx=0 tx=0).stop 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 msgr2=0x7f0d1819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d1819d6d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0d08031460 tx=0x7f0d080045e0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 shutdown_connections 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d00077460 0x7f0d00079920 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d18101e80 0x7f0d1819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 --2- 172.21.15.52:0/2817172073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d181014d0 0x7f0d1819d6d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 >> 172.21.15.52:0/2817172073 conn(0x7f0d18077150 msgr2=0x7f0d181049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 shutdown_connections 2024-09-06T15:02:37.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.399+0000 7f0d1e484640 1 -- 172.21.15.52:0/2817172073 wait complete. 2024-09-06T15:02:37.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1828645496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 msgr2=0x7f8c6c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1828645496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c100c60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009880 tx=0x7f8c6002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1828645496 shutdown_connections 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1828645496 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c100c60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1828645496 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c6c106800 0x7f8c6c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1828645496 >> 172.21.15.52:0/1828645496 conn(0x7f8c6c0fc520 msgr2=0x7f8c6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1828645496 shutdown_connections 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1828645496 wait complete. 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.483+0000 7f8c71cf8640 1 Processor -- start 2024-09-06T15:02:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c71cf8640 1 -- start start 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c71cf8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c71cf8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c6c106800 0x7f8c6c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c71cf8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c10dd30 con 0x7f8c6c100800 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c71cf8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c10dbb0 con 0x7f8c6c106800 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c6b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58564/0 (socket says 172.21.15.52:58564) 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c6b7fe640 1 -- 172.21.15.52:0/1924873539 learned_addr learned my addr 172.21.15.52:0/1924873539 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c6b7fe640 1 -- 172.21.15.52:0/1924873539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c6c106800 msgr2=0x7f8c6c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c6b7fe640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c6c106800 0x7f8c6c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c6b7fe640 1 -- 172.21.15.52:0/1924873539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c1993c0 con 0x7f8c6c100800 2024-09-06T15:02:37.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.484+0000 7f8c6b7fe640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c198880 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00b420 tx=0x7f8c5c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:37.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.485+0000 7f8c68ff9640 1 -- 172.21.15.52:0/1924873539 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c5c011630 con 0x7f8c6c100800 2024-09-06T15:02:37.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.485+0000 7f8c68ff9640 1 -- 172.21.15.52:0/1924873539 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c5c016070 con 0x7f8c6c100800 2024-09-06T15:02:37.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.485+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c1996b0 con 0x7f8c6c100800 2024-09-06T15:02:37.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.485+0000 7f8c68ff9640 1 -- 172.21.15.52:0/1924873539 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c5c010d40 con 0x7f8c6c100800 2024-09-06T15:02:37.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.485+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c1a1cb0 con 0x7f8c6c100800 2024-09-06T15:02:37.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.486+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6c101f40 con 0x7f8c6c100800 2024-09-06T15:02:37.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.486+0000 7f8c68ff9640 1 -- 172.21.15.52:0/1924873539 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8c5c01b460 con 0x7f8c6c100800 2024-09-06T15:02:37.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.487+0000 7f8c68ff9640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8c540774b0 0x7f8c54079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.487+0000 7f8c68ff9640 1 -- 172.21.15.52:0/1924873539 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8c5c098ec0 con 0x7f8c6c100800 2024-09-06T15:02:37.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.487+0000 7f8c6affd640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8c540774b0 0x7f8c54079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.487+0000 7f8c6affd640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8c540774b0 0x7f8c54079970 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8c600096c0 tx=0x7f8c60000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:37.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.491+0000 7f8c68ff9640 1 -- 172.21.15.52:0/1924873539 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8c6c1996b0 con 0x7f8c6c100800 2024-09-06T15:02:37.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.677+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8c6c108de0 con 0x7f8c6c100800 2024-09-06T15:02:37.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.677+0000 7f8c68ff9640 1 -- 172.21.15.52:0/1924873539 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f8c6c108de0 con 0x7f8c6c100800 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:02:37.677 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:02:37.678 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:02:37.679 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:37.680 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:02:37.680 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:02:37.680 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:37.680 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:37.680 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:37.680 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8c540774b0 msgr2=0x7f8c54079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8c540774b0 0x7f8c54079970 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8c600096c0 tx=0x7f8c60000bc0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 msgr2=0x7f8c6c198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c198880 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00b420 tx=0x7f8c5c00b8e0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 shutdown_connections 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8c540774b0 0x7f8c54079970 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c6c106800 0x7f8c6c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.679+0000 7f8c71cf8640 1 --2- 172.21.15.52:0/1924873539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c6c100800 0x7f8c6c198880 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.680+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 >> 172.21.15.52:0/1924873539 conn(0x7f8c6c0fc520 msgr2=0x7f8c6c0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:37.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.680+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 shutdown_connections 2024-09-06T15:02:37.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.680+0000 7f8c71cf8640 1 -- 172.21.15.52:0/1924873539 wait complete. 2024-09-06T15:02:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 -- 172.21.15.52:0/2665480632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 msgr2=0x7f2868106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 --2- 172.21.15.52:0/2665480632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868106bd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2864009880 tx=0x7f286402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 -- 172.21.15.52:0/2665480632 shutdown_connections 2024-09-06T15:02:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 --2- 172.21.15.52:0/2665480632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28681007f0 0x7f2868100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 --2- 172.21.15.52:0/2665480632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868106bd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 -- 172.21.15.52:0/2665480632 >> 172.21.15.52:0/2665480632 conn(0x7f28680fc550 msgr2=0x7f28680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:37.764 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:37 smithi052 ceph-mon[112917]: pgmap v551: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:37.764 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:37 smithi052 ceph-mon[112917]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:37.764 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:37 smithi052 ceph-mon[112917]: from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:37.764 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:37 smithi052 ceph-mon[112917]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:37.764 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:37 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2817172073' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:02:37.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 -- 172.21.15.52:0/2665480632 shutdown_connections 2024-09-06T15:02:37.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.764+0000 7f286fa57640 1 -- 172.21.15.52:0/2665480632 wait complete. 2024-09-06T15:02:37.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286fa57640 1 Processor -- start 2024-09-06T15:02:37.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286fa57640 1 -- start start 2024-09-06T15:02:37.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286fa57640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28681007f0 0x7f28681988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286fa57640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286fa57640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f286810dca0 con 0x7f28681067f0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286fa57640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f286810db20 con 0x7f28681007f0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286cff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286cff2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58580/0 (socket says 172.21.15.52:58580) 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286cff2640 1 -- 172.21.15.52:0/2509348145 learned_addr learned my addr 172.21.15.52:0/2509348145 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.765+0000 7f286d7f3640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28681007f0 0x7f28681988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f286cff2640 1 -- 172.21.15.52:0/2509348145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28681007f0 msgr2=0x7f28681988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f286cff2640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28681007f0 0x7f28681988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f286cff2640 1 -- 172.21.15.52:0/2509348145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2868199410 con 0x7f28681067f0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f286cff2640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868198e10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f285800c810 tx=0x7f285800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f285e7fc640 1 -- 172.21.15.52:0/2509348145 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2858004020 con 0x7f28681067f0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f285e7fc640 1 -- 172.21.15.52:0/2509348145 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f28580041c0 con 0x7f28681067f0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2868199700 con 0x7f28681067f0 2024-09-06T15:02:37.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f285e7fc640 1 -- 172.21.15.52:0/2509348145 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f28580047a0 con 0x7f28681067f0 2024-09-06T15:02:37.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.766+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28681a1d00 con 0x7f28681067f0 2024-09-06T15:02:37.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.767+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2868101f30 con 0x7f28681067f0 2024-09-06T15:02:37.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.768+0000 7f285e7fc640 1 -- 172.21.15.52:0/2509348145 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f28580079b0 con 0x7f28681067f0 2024-09-06T15:02:37.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.768+0000 7f285e7fc640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f28540774b0 0x7f2854079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:37.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.768+0000 7f285e7fc640 1 -- 172.21.15.52:0/2509348145 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f2858099590 con 0x7f28681067f0 2024-09-06T15:02:37.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.768+0000 7f286d7f3640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f28540774b0 0x7f2854079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:37.769 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.769+0000 7f286d7f3640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f28540774b0 0x7f2854079970 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2864000c00 tx=0x7f2864031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:37.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.772+0000 7f285e7fc640 1 -- 172.21.15.52:0/2509348145 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f2868199700 con 0x7f28681067f0 2024-09-06T15:02:37.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:37 smithi165 ceph-mon[82925]: pgmap v551: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:37.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:37 smithi165 ceph-mon[82925]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:37.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:37 smithi165 ceph-mon[82925]: from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:37.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:37 smithi165 ceph-mon[82925]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:37.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:37 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2817172073' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:02:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.955+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2868062630 con 0x7f28540774b0 2024-09-06T15:02:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.956+0000 7f285e7fc640 1 -- 172.21.15.52:0/2509348145 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2868062630 con 0x7f28540774b0 2024-09-06T15:02:37.955 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:02:37.955 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:02:37.955 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:02:37.955 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:02:37.955 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:02:37.956 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:02:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f28540774b0 msgr2=0x7f2854079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f28540774b0 0x7f2854079970 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2864000c00 tx=0x7f2864031400 comp rx=0 tx=0).stop 2024-09-06T15:02:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 msgr2=0x7f2868198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868198e10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f285800c810 tx=0x7f285800ccd0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 shutdown_connections 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28681067f0 0x7f2868198e10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f28540774b0 0x7f2854079970 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 --2- 172.21.15.52:0/2509348145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f28681007f0 0x7f28681988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 >> 172.21.15.52:0/2509348145 conn(0x7f28680fc550 msgr2=0x7f28680fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 shutdown_connections 2024-09-06T15:02:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:37.958+0000 7f286fa57640 1 -- 172.21.15.52:0/2509348145 wait complete. 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 -- 172.21.15.52:0/1878497740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974106800 msgr2=0x7f6974106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 --2- 172.21.15.52:0/1878497740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974106800 0x7f6974106be0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6968009880 tx=0x7f696802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 -- 172.21.15.52:0/1878497740 shutdown_connections 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 --2- 172.21.15.52:0/1878497740 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6974100800 0x7f6974100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 --2- 172.21.15.52:0/1878497740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974106800 0x7f6974106be0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 -- 172.21.15.52:0/1878497740 >> 172.21.15.52:0/1878497740 conn(0x7f69740fc520 msgr2=0x7f69740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 -- 172.21.15.52:0/1878497740 shutdown_connections 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.041+0000 7f697aedc640 1 -- 172.21.15.52:0/1878497740 wait complete. 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f697aedc640 1 Processor -- start 2024-09-06T15:02:38.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f697aedc640 1 -- start start 2024-09-06T15:02:38.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f697aedc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974100800 0x7f697419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:38.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f697aedc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6974106800 0x7f697419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:38.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f697aedc640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f697406a8e0 con 0x7f6974100800 2024-09-06T15:02:38.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f697aedc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f697406a760 con 0x7f6974106800 2024-09-06T15:02:38.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f6978c78640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974100800 0x7f697419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:38.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f6978c78640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974100800 0x7f697419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58592/0 (socket says 172.21.15.52:58592) 2024-09-06T15:02:38.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f6978c78640 1 -- 172.21.15.52:0/1211961869 learned_addr learned my addr 172.21.15.52:0/1211961869 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.042+0000 7f6973fff640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6974106800 0x7f697419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f6978c78640 1 -- 172.21.15.52:0/1211961869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6974106800 msgr2=0x7f697419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f6978c78640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6974106800 0x7f697419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f6978c78640 1 -- 172.21.15.52:0/1211961869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6974197820 con 0x7f6974100800 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f6978c78640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974100800 0x7f697419d6a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6968031460 tx=0x7f6968004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f6971ffb640 1 -- 172.21.15.52:0/1211961869 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f696803f070 con 0x7f6974100800 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6974197ab0 con 0x7f6974100800 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f6971ffb640 1 -- 172.21.15.52:0/1211961869 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69680035f0 con 0x7f6974100800 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f6971ffb640 1 -- 172.21.15.52:0/1211961869 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6968035030 con 0x7f6974100800 2024-09-06T15:02:38.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.043+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6974197fe0 con 0x7f6974100800 2024-09-06T15:02:38.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.044+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6974101f40 con 0x7f6974100800 2024-09-06T15:02:38.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.045+0000 7f6971ffb640 1 -- 172.21.15.52:0/1211961869 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6968042070 con 0x7f6974100800 2024-09-06T15:02:38.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.045+0000 7f6971ffb640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6964077460 0x7f6964079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:02:38.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.045+0000 7f6971ffb640 1 -- 172.21.15.52:0/1211961869 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f69680ba090 con 0x7f6974100800 2024-09-06T15:02:38.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.045+0000 7f6973fff640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6964077460 0x7f6964079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:02:38.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.046+0000 7f6973fff640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6964077460 0x7f6964079920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f69740fe750 tx=0x7f6960005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:02:38.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.049+0000 7f6971ffb640 1 -- 172.21.15.52:0/1211961869 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6968087160 con 0x7f6974100800 2024-09-06T15:02:38.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.270+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6974198d50 con 0x7f6974100800 2024-09-06T15:02:38.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.270+0000 7f6971ffb640 1 -- 172.21.15.52:0/1211961869 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f696808bb80 con 0x7f6974100800 2024-09-06T15:02:38.269 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:02:38.270 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:02:38.271 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:02:38.271 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:02:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6964077460 msgr2=0x7f6964079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:38.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6964077460 0x7f6964079920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f69740fe750 tx=0x7f6960005f90 comp rx=0 tx=0).stop 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974100800 msgr2=0x7f697419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974100800 0x7f697419d6a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6968031460 tx=0x7f6968004530 comp rx=0 tx=0).stop 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 shutdown_connections 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6964077460 0x7f6964079920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6974106800 0x7f697419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 --2- 172.21.15.52:0/1211961869 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6974100800 0x7f697419d6a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 >> 172.21.15.52:0/1211961869 conn(0x7f69740fc520 msgr2=0x7f69740fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 shutdown_connections 2024-09-06T15:02:38.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:02:38.272+0000 7f697aedc640 1 -- 172.21.15.52:0/1211961869 wait complete. 2024-09-06T15:02:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:38 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1924873539' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:02:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:38 smithi165 ceph-mon[82925]: from='client.34878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:38.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:38 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1211961869' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:02:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:38 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1924873539' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:02:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:38 smithi052 ceph-mon[112917]: from='client.34878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:02:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:38 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1211961869' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:02:39.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:39 smithi165 ceph-mon[82925]: pgmap v552: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:39.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:39 smithi052 ceph-mon[112917]: pgmap v552: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:41.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:41 smithi165 ceph-mon[82925]: pgmap v553: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:41.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:41 smithi052 ceph-mon[112917]: pgmap v553: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:43.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:43 smithi052 ceph-mon[112917]: pgmap v554: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:43.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:43 smithi165 ceph-mon[82925]: pgmap v554: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:45.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:45 smithi165 ceph-mon[82925]: pgmap v555: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:45.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:45 smithi052 ceph-mon[112917]: pgmap v555: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:47.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:47 smithi165 ceph-mon[82925]: pgmap v556: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:47.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:47 smithi052 ceph-mon[112917]: pgmap v556: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:49.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:49 smithi165 ceph-mon[82925]: pgmap v557: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:49.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:49 smithi052 ceph-mon[112917]: pgmap v557: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:51.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:51 smithi165 ceph-mon[82925]: pgmap v558: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:51.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:51 smithi052 ceph-mon[112917]: pgmap v558: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:53.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:53 smithi165 ceph-mon[82925]: pgmap v559: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:53.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:53.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:53 smithi052 ceph-mon[112917]: pgmap v559: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:53.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:02:55.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:55 smithi165 ceph-mon[82925]: pgmap v560: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:55.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:55 smithi052 ceph-mon[112917]: pgmap v560: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:57.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:57 smithi165 ceph-mon[82925]: pgmap v561: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:57.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:57 smithi052 ceph-mon[112917]: pgmap v561: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:59.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:02:59 smithi165 ceph-mon[82925]: pgmap v562: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:02:59.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:02:59 smithi052 ceph-mon[112917]: pgmap v562: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:01.761 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:01 smithi052 ceph-mon[112917]: pgmap v563: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:01.819 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:01 smithi165 ceph-mon[82925]: pgmap v563: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:03.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:03 smithi165 ceph-mon[82925]: pgmap v564: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:03.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:03 smithi052 ceph-mon[112917]: pgmap v564: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:05.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:05 smithi165 ceph-mon[82925]: pgmap v565: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:05.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:05 smithi052 ceph-mon[112917]: pgmap v565: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:07.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:07 smithi165 ceph-mon[82925]: pgmap v566: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:07.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:07 smithi052 ceph-mon[112917]: pgmap v566: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:08.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3912302680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0100650 msgr2=0x7f8ad0100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3912302680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0100650 0x7f8ad0100a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009880 tx=0x7f8acc02a490 comp rx=0 tx=0).stop 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3912302680 shutdown_connections 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3912302680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ad0101000 0x7f8ad010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3912302680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0100650 0x7f8ad0100a30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3912302680 >> 172.21.15.52:0/3912302680 conn(0x7f8ad00fc520 msgr2=0x7f8ad00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3912302680 shutdown_connections 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3912302680 wait complete. 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 Processor -- start 2024-09-06T15:03:08.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.369+0000 7f8ad80ef640 1 -- start start 2024-09-06T15:03:08.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad80ef640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ad0100650 0x7f8ad019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad80ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0101000 0x7f8ad019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad80ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0110f90 con 0x7f8ad0101000 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad80ef640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad0110e10 con 0x7f8ad0100650 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad568a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0101000 0x7f8ad019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad568a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0101000 0x7f8ad019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51288/0 (socket says 172.21.15.52:51288) 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad568a640 1 -- 172.21.15.52:0/3151255016 learned_addr learned my addr 172.21.15.52:0/3151255016 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad5e8b640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ad0100650 0x7f8ad019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad568a640 1 -- 172.21.15.52:0/3151255016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ad0100650 msgr2=0x7f8ad019f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad568a640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ad0100650 0x7f8ad019f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad568a640 1 -- 172.21.15.52:0/3151255016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad01a03b0 con 0x7f8ad0101000 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad5e8b640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ad0100650 0x7f8ad019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:03:08.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.370+0000 7f8ad568a640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0101000 0x7f8ad019fd00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000c8a0 tx=0x7f8ac000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.371+0000 7f8ac6ffd640 1 -- 172.21.15.52:0/3151255016 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ac00079b0 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.371+0000 7f8ac6ffd640 1 -- 172.21.15.52:0/3151255016 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ac0007b50 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.371+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad0199aa0 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.371+0000 7f8ac6ffd640 1 -- 172.21.15.52:0/3151255016 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ac0018700 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.371+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad019a000 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.372+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad006aa90 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.372+0000 7f8ac6ffd640 1 -- 172.21.15.52:0/3151255016 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8ac0007d00 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.373+0000 7f8ac6ffd640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8abc0774b0 0x7f8abc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.373+0000 7f8ac6ffd640 1 -- 172.21.15.52:0/3151255016 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8ac0099970 con 0x7f8ad0101000 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.373+0000 7f8ad5e8b640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8abc0774b0 0x7f8abc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.373+0000 7f8ad5e8b640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8abc0774b0 0x7f8abc079970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8acc006010 tx=0x7f8acc004220 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:08.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.377+0000 7f8ac6ffd640 1 -- 172.21.15.52:0/3151255016 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8ac0014030 con 0x7f8ad0101000 2024-09-06T15:03:08.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.557+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8ad019af50 con 0x7f8abc0774b0 2024-09-06T15:03:08.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.559+0000 7f8ac6ffd640 1 -- 172.21.15.52:0/3151255016 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8ad019af50 con 0x7f8abc0774b0 2024-09-06T15:03:08.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8abc0774b0 msgr2=0x7f8abc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8abc0774b0 0x7f8abc079970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8acc006010 tx=0x7f8acc004220 comp rx=0 tx=0).stop 2024-09-06T15:03:08.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0101000 msgr2=0x7f8ad019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0101000 0x7f8ad019fd00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ac000c8a0 tx=0x7f8ac000cd60 comp rx=0 tx=0).stop 2024-09-06T15:03:08.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 shutdown_connections 2024-09-06T15:03:08.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8ad0101000 0x7f8ad019fd00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8abc0774b0 0x7f8abc079970 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 --2- 172.21.15.52:0/3151255016 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8ad0100650 0x7f8ad019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.560+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 >> 172.21.15.52:0/3151255016 conn(0x7f8ad00fc520 msgr2=0x7f8ad00fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:08.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.561+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 shutdown_connections 2024-09-06T15:03:08.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.561+0000 7f8ad80ef640 1 -- 172.21.15.52:0/3151255016 wait complete. 2024-09-06T15:03:08.568 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:03:08.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.646+0000 7fe5293df640 1 -- 172.21.15.52:0/535032021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524101900 msgr2=0x7fe524101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.646+0000 7fe5293df640 1 --2- 172.21.15.52:0/535032021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524101900 0x7fe524101d60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe518009880 tx=0x7fe51802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 -- 172.21.15.52:0/535032021 shutdown_connections 2024-09-06T15:03:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 --2- 172.21.15.52:0/535032021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524101900 0x7fe524101d60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 --2- 172.21.15.52:0/535032021 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe524107900 0x7fe524107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 -- 172.21.15.52:0/535032021 >> 172.21.15.52:0/535032021 conn(0x7fe5240fd600 msgr2=0x7fe5240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 -- 172.21.15.52:0/535032021 shutdown_connections 2024-09-06T15:03:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 -- 172.21.15.52:0/535032021 wait complete. 2024-09-06T15:03:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 Processor -- start 2024-09-06T15:03:08.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.647+0000 7fe5293df640 1 -- start start 2024-09-06T15:03:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5293df640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe524101900 0x7fe52419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5293df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524107900 0x7fe52419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5293df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe52410ee30 con 0x7fe524107900 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5293df640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe52410ecb0 con 0x7fe524101900 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5227fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524107900 0x7fe52419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5227fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524107900 0x7fe52419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51304/0 (socket says 172.21.15.52:51304) 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5227fc640 1 -- 172.21.15.52:0/3939211244 learned_addr learned my addr 172.21.15.52:0/3939211244 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe522ffd640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe524101900 0x7fe52419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5227fc640 1 -- 172.21.15.52:0/3939211244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe524101900 msgr2=0x7fe52419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5227fc640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe524101900 0x7fe52419f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5227fc640 1 -- 172.21.15.52:0/3939211244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe524199a50 con 0x7fe524107900 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe522ffd640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe524101900 0x7fe52419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5227fc640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524107900 0x7fe52419fdd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe518031460 tx=0x7fe5180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:08.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe50bfff640 1 -- 172.21.15.52:0/3939211244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe51803f070 con 0x7fe524107900 2024-09-06T15:03:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe50bfff640 1 -- 172.21.15.52:0/3939211244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe518004cf0 con 0x7fe524107900 2024-09-06T15:03:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.648+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe524199ce0 con 0x7fe524107900 2024-09-06T15:03:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.649+0000 7fe50bfff640 1 -- 172.21.15.52:0/3939211244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe518035030 con 0x7fe524107900 2024-09-06T15:03:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.649+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52419a210 con 0x7fe524107900 2024-09-06T15:03:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.650+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe524103040 con 0x7fe524107900 2024-09-06T15:03:08.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.650+0000 7fe50bfff640 1 -- 172.21.15.52:0/3939211244 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe518042070 con 0x7fe524107900 2024-09-06T15:03:08.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.651+0000 7fe50bfff640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe50c0774b0 0x7fe50c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.651+0000 7fe50bfff640 1 -- 172.21.15.52:0/3939211244 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe5180ba2a0 con 0x7fe524107900 2024-09-06T15:03:08.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.651+0000 7fe522ffd640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe50c0774b0 0x7fe50c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.651+0000 7fe522ffd640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe50c0774b0 0x7fe50c079970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe52419ab90 tx=0x7fe514009570 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:08.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.655+0000 7fe50bfff640 1 -- 172.21.15.52:0/3939211244 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe5180831e0 con 0x7fe524107900 2024-09-06T15:03:08.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:08.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.834+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe52419a4c0 con 0x7fe50c0774b0 2024-09-06T15:03:08.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.835+0000 7fe50bfff640 1 -- 172.21.15.52:0/3939211244 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe52419a4c0 con 0x7fe50c0774b0 2024-09-06T15:03:08.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe50c0774b0 msgr2=0x7fe50c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe50c0774b0 0x7fe50c079970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe52419ab90 tx=0x7fe514009570 comp rx=0 tx=0).stop 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524107900 msgr2=0x7fe52419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524107900 0x7fe52419fdd0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe518031460 tx=0x7fe5180048f0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 shutdown_connections 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe524107900 0x7fe52419fdd0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe50c0774b0 0x7fe50c079970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 --2- 172.21.15.52:0/3939211244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe524101900 0x7fe52419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 >> 172.21.15.52:0/3939211244 conn(0x7fe5240fd600 msgr2=0x7fe5240744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.837+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 shutdown_connections 2024-09-06T15:03:08.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.838+0000 7fe5293df640 1 -- 172.21.15.52:0/3939211244 wait complete. 2024-09-06T15:03:08.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 -- 172.21.15.52:0/4077884941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 msgr2=0x7f9ba8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/4077884941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba8100c60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9b90009880 tx=0x7f9b9002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 -- 172.21.15.52:0/4077884941 shutdown_connections 2024-09-06T15:03:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/4077884941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba8100c60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/4077884941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba8106800 0x7f9ba8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 -- 172.21.15.52:0/4077884941 >> 172.21.15.52:0/4077884941 conn(0x7f9ba80fc520 msgr2=0x7f9ba80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 -- 172.21.15.52:0/4077884941 shutdown_connections 2024-09-06T15:03:08.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.920+0000 7f9bacbdd640 1 -- 172.21.15.52:0/4077884941 wait complete. 2024-09-06T15:03:08.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9bacbdd640 1 Processor -- start 2024-09-06T15:03:08.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9bacbdd640 1 -- start start 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9bacbdd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba819f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9bacbdd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba8106800 0x7f9ba819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9bacbdd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba810edd0 con 0x7f9ba8100800 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9bacbdd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba810ec50 con 0x7f9ba8106800 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9ba659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba819f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9ba659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba819f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51324/0 (socket says 172.21.15.52:51324) 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9ba659c640 1 -- 172.21.15.52:0/3805096241 learned_addr learned my addr 172.21.15.52:0/3805096241 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9b9ffff640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba8106800 0x7f9ba819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9ba659c640 1 -- 172.21.15.52:0/3805096241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba8106800 msgr2=0x7f9ba819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9ba659c640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba8106800 0x7f9ba819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9ba659c640 1 -- 172.21.15.52:0/3805096241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba8199a30 con 0x7f9ba8100800 2024-09-06T15:03:08.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.921+0000 7f9b9ffff640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba8106800 0x7f9ba819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:03:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.922+0000 7f9ba659c640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba819f870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c810 tx=0x7f9b9800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.922+0000 7f9b9f7fe640 1 -- 172.21.15.52:0/3805096241 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b98004020 con 0x7f9ba8100800 2024-09-06T15:03:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.922+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba8199d20 con 0x7f9ba8100800 2024-09-06T15:03:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.922+0000 7f9b9f7fe640 1 -- 172.21.15.52:0/3805096241 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b980041c0 con 0x7f9ba8100800 2024-09-06T15:03:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.922+0000 7f9b9f7fe640 1 -- 172.21.15.52:0/3805096241 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b980047a0 con 0x7f9ba8100800 2024-09-06T15:03:08.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.922+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba819a280 con 0x7f9ba8100800 2024-09-06T15:03:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.923+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba8101f40 con 0x7f9ba8100800 2024-09-06T15:03:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.924+0000 7f9b9f7fe640 1 -- 172.21.15.52:0/3805096241 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9b980079b0 con 0x7f9ba8100800 2024-09-06T15:03:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.924+0000 7f9b9f7fe640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9b94077460 0x7f9b94079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.924+0000 7f9b9f7fe640 1 -- 172.21.15.52:0/3805096241 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9b98099710 con 0x7f9ba8100800 2024-09-06T15:03:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.924+0000 7f9b9ffff640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9b94077460 0x7f9b94079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:08.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.925+0000 7f9b9ffff640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9b94077460 0x7f9b94079920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ba819b220 tx=0x7f9b90009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:08.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:08.928+0000 7f9b9f7fe640 1 -- 172.21.15.52:0/3805096241 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9b98014030 con 0x7f9ba8100800 2024-09-06T15:03:09.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.096+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9ba819af60 con 0x7f9b94077460 2024-09-06T15:03:09.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.105+0000 7f9b9f7fe640 1 -- 172.21.15.52:0/3805096241 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f9ba819af60 con 0x7f9b94077460 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (15m) 9m ago 26m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (18m) 9m ago 26m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (17m) 9m ago 25m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (13m) 9m ago 26m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (13m) 9m ago 25m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (15m) 9m ago 26m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (10m) 9m ago 21m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (9m) 9m ago 21m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (9m) 9m ago 21m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (9m) 9m ago 21m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (17m) 9m ago 27m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:03:09.105 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (16m) 9m ago 25m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (14m) 9m ago 27m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (14m) 9m ago 25m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (16m) 9m ago 26m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (16m) 9m ago 25m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (13m) 9m ago 24m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (12m) 9m ago 24m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (12m) 9m ago 23m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (11m) 9m ago 23m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (11m) 9m ago 22m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (10m) 9m ago 22m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:03:09.106 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (15m) 9m ago 26m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:03:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9b94077460 msgr2=0x7f9b94079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9b94077460 0x7f9b94079920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9ba819b220 tx=0x7f9b90009560 comp rx=0 tx=0).stop 2024-09-06T15:03:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 msgr2=0x7f9ba819f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba819f870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800c810 tx=0x7f9b9800ccd0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 shutdown_connections 2024-09-06T15:03:09.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9b94077460 0x7f9b94079920 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9ba8106800 0x7f9ba819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 --2- 172.21.15.52:0/3805096241 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba8100800 0x7f9ba819f870 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 >> 172.21.15.52:0/3805096241 conn(0x7f9ba80fc520 msgr2=0x7f9ba80fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 shutdown_connections 2024-09-06T15:03:09.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.107+0000 7f9bacbdd640 1 -- 172.21.15.52:0/3805096241 wait complete. 2024-09-06T15:03:09.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 -- 172.21.15.52:0/2603215384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90106800 msgr2=0x7fde90106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 --2- 172.21.15.52:0/2603215384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90106800 0x7fde90106be0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fde78009880 tx=0x7fde7802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 -- 172.21.15.52:0/2603215384 shutdown_connections 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 --2- 172.21.15.52:0/2603215384 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde90100800 0x7fde90100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 --2- 172.21.15.52:0/2603215384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90106800 0x7fde90106be0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 -- 172.21.15.52:0/2603215384 >> 172.21.15.52:0/2603215384 conn(0x7fde900fc520 msgr2=0x7fde900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 -- 172.21.15.52:0/2603215384 shutdown_connections 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.189+0000 7fde97105640 1 -- 172.21.15.52:0/2603215384 wait complete. 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde97105640 1 Processor -- start 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde97105640 1 -- start start 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde97105640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90100800 0x7fde901987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde97105640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde90106800 0x7fde90198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde97105640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fde9010dcb0 con 0x7fde90100800 2024-09-06T15:03:09.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde97105640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fde9010db30 con 0x7fde90106800 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde94ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90100800 0x7fde901987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde94ea1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90100800 0x7fde901987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51342/0 (socket says 172.21.15.52:51342) 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde94ea1640 1 -- 172.21.15.52:0/699941887 learned_addr learned my addr 172.21.15.52:0/699941887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.190+0000 7fde8ffff640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde90106800 0x7fde90198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde94ea1640 1 -- 172.21.15.52:0/699941887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde90106800 msgr2=0x7fde90198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde94ea1640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde90106800 0x7fde90198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde94ea1640 1 -- 172.21.15.52:0/699941887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde901992d0 con 0x7fde90100800 2024-09-06T15:03:09.191 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde8ffff640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde90106800 0x7fde90198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:03:09.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde94ea1640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90100800 0x7fde901987d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fde78031460 tx=0x7fde780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde8dffb640 1 -- 172.21.15.52:0/699941887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde7803f070 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde8dffb640 1 -- 172.21.15.52:0/699941887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde78004cf0 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde90199560 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde8dffb640 1 -- 172.21.15.52:0/699941887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde78035030 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.191+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde901a1b20 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.192+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde90101f40 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.193+0000 7fde8dffb640 1 -- 172.21.15.52:0/699941887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fde78042070 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.193+0000 7fde8dffb640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde7c077460 0x7fde7c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.193+0000 7fde8dffb640 1 -- 172.21.15.52:0/699941887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fde780ba230 con 0x7fde90100800 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.193+0000 7fde8ffff640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde7c077460 0x7fde7c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.194+0000 7fde8ffff640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde7c077460 0x7fde7c079920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde9006ad40 tx=0x7fde8000a5c0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:09.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.197+0000 7fde8dffb640 1 -- 172.21.15.52:0/699941887 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fde78083190 con 0x7fde90100800 2024-09-06T15:03:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.422+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fde90103a10 con 0x7fde90100800 2024-09-06T15:03:09.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.422+0000 7fde8dffb640 1 -- 172.21.15.52:0/699941887 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fde78087300 con 0x7fde90100800 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:09.422 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:03:09.423 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:03:09.423 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:09.423 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:03:09.423 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:03:09.423 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:03:09.423 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.424+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde7c077460 msgr2=0x7fde7c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.424+0000 7fde97105640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde7c077460 0x7fde7c079920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fde9006ad40 tx=0x7fde8000a5c0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.424+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90100800 msgr2=0x7fde901987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90100800 0x7fde901987d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fde78031460 tx=0x7fde780048f0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 shutdown_connections 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fde7c077460 0x7fde7c079920 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fde90106800 0x7fde90198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 --2- 172.21.15.52:0/699941887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde90100800 0x7fde901987d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 >> 172.21.15.52:0/699941887 conn(0x7fde900fc520 msgr2=0x7fde900fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:09.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 shutdown_connections 2024-09-06T15:03:09.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.425+0000 7fde97105640 1 -- 172.21.15.52:0/699941887 wait complete. 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.508+0000 7f640e23c640 1 -- 172.21.15.52:0/3459205646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 msgr2=0x7f640810dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.508+0000 7f640e23c640 1 --2- 172.21.15.52:0/3459205646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640810dd10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009880 tx=0x7f63fc02a490 comp rx=0 tx=0).stop 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.508+0000 7f640e23c640 1 -- 172.21.15.52:0/3459205646 shutdown_connections 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.508+0000 7f640e23c640 1 --2- 172.21.15.52:0/3459205646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640810dd10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.508+0000 7f640e23c640 1 --2- 172.21.15.52:0/3459205646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64081006a0 0x7f6408100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.509+0000 7f640e23c640 1 -- 172.21.15.52:0/3459205646 >> 172.21.15.52:0/3459205646 conn(0x7f64080fc550 msgr2=0x7f64080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.509+0000 7f640e23c640 1 -- 172.21.15.52:0/3459205646 shutdown_connections 2024-09-06T15:03:09.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.509+0000 7f640e23c640 1 -- 172.21.15.52:0/3459205646 wait complete. 2024-09-06T15:03:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.509+0000 7f640e23c640 1 Processor -- start 2024-09-06T15:03:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.509+0000 7f640e23c640 1 -- start start 2024-09-06T15:03:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f640e23c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64081006a0 0x7f640819f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f640e23c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f640e23c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6408110f30 con 0x7f6408101050 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f640e23c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6408110db0 con 0x7f64081006a0 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6406ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51352/0 (socket says 172.21.15.52:51352) 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6406ffd640 1 -- 172.21.15.52:0/2438945292 learned_addr learned my addr 172.21.15.52:0/2438945292 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f64077fe640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64081006a0 0x7f640819f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6406ffd640 1 -- 172.21.15.52:0/2438945292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64081006a0 msgr2=0x7f640819f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6406ffd640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64081006a0 0x7f640819f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6406ffd640 1 -- 172.21.15.52:0/2438945292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6408199940 con 0x7f6408101050 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6406ffd640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640819fcc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63fc031460 tx=0x7f63fc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6404ff9640 1 -- 172.21.15.52:0/2438945292 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63fc03f070 con 0x7f6408101050 2024-09-06T15:03:09.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6408199c30 con 0x7f6408101050 2024-09-06T15:03:09.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6404ff9640 1 -- 172.21.15.52:0/2438945292 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63fc004a90 con 0x7f6408101050 2024-09-06T15:03:09.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.510+0000 7f6404ff9640 1 -- 172.21.15.52:0/2438945292 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63fc035030 con 0x7f6408101050 2024-09-06T15:03:09.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.511+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640819a1c0 con 0x7f6408101050 2024-09-06T15:03:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.512+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640806a520 con 0x7f6408101050 2024-09-06T15:03:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.512+0000 7f6404ff9640 1 -- 172.21.15.52:0/2438945292 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f63fc042070 con 0x7f6408101050 2024-09-06T15:03:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.513+0000 7f6404ff9640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63f0077460 0x7f63f0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.513+0000 7f6404ff9640 1 -- 172.21.15.52:0/2438945292 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f63fc0ba2b0 con 0x7f6408101050 2024-09-06T15:03:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.513+0000 7f64077fe640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63f0077460 0x7f63f0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.513+0000 7f64077fe640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63f0077460 0x7f63f0079920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f640819aa80 tx=0x7f63f8005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:09.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.517+0000 7f6404ff9640 1 -- 172.21.15.52:0/2438945292 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f63fc0872e0 con 0x7f6408101050 2024-09-06T15:03:09.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.700+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f640819ae70 con 0x7f6408101050 2024-09-06T15:03:09.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.700+0000 7f6404ff9640 1 -- 172.21.15.52:0/2438945292 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f63fc08bd00 con 0x7f6408101050 2024-09-06T15:03:09.699 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:03:09.699 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:03:09.699 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:03:09.700 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:03:09.701 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:03:09.702 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:09.704 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:09.704 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:09.704 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:09.704 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:03:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63f0077460 msgr2=0x7f63f0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63f0077460 0x7f63f0079920 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f640819aa80 tx=0x7f63f8005f90 comp rx=0 tx=0).stop 2024-09-06T15:03:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 msgr2=0x7f640819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640819fcc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f63fc031460 tx=0x7f63fc004530 comp rx=0 tx=0).stop 2024-09-06T15:03:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 shutdown_connections 2024-09-06T15:03:09.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6408101050 0x7f640819fcc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63f0077460 0x7f63f0079920 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 --2- 172.21.15.52:0/2438945292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f64081006a0 0x7f640819f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 >> 172.21.15.52:0/2438945292 conn(0x7f64080fc550 msgr2=0x7f64080fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 shutdown_connections 2024-09-06T15:03:09.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.702+0000 7f640e23c640 1 -- 172.21.15.52:0/2438945292 wait complete. 2024-09-06T15:03:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 -- 172.21.15.52:0/2595555716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 msgr2=0x7fd66c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 --2- 172.21.15.52:0/2595555716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c101d60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009880 tx=0x7fd65c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 -- 172.21.15.52:0/2595555716 shutdown_connections 2024-09-06T15:03:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 --2- 172.21.15.52:0/2595555716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c101d60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 --2- 172.21.15.52:0/2595555716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd66c107900 0x7fd66c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 -- 172.21.15.52:0/2595555716 >> 172.21.15.52:0/2595555716 conn(0x7fd66c0fd600 msgr2=0x7fd66c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 -- 172.21.15.52:0/2595555716 shutdown_connections 2024-09-06T15:03:09.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.786+0000 7fd673cda640 1 -- 172.21.15.52:0/2595555716 wait complete. 2024-09-06T15:03:09.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:09 smithi052 ceph-mon[112917]: pgmap v567: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:09.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:09 smithi052 ceph-mon[112917]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.786 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:09 smithi052 ceph-mon[112917]: from='client.34890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.787 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:09 smithi052 ceph-mon[112917]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.787 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:09 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/699941887' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:03:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.787+0000 7fd673cda640 1 Processor -- start 2024-09-06T15:03:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.787+0000 7fd673cda640 1 -- start start 2024-09-06T15:03:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.787+0000 7fd673cda640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.787+0000 7fd673cda640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd66c107900 0x7fd66c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.787+0000 7fd673cda640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c10edd0 con 0x7fd66c101900 2024-09-06T15:03:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.787+0000 7fd673cda640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c10ec50 con 0x7fd66c107900 2024-09-06T15:03:09.788 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.787+0000 7fd671a76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd671a76640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51362/0 (socket says 172.21.15.52:51362) 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd671a76640 1 -- 172.21.15.52:0/2158317643 learned_addr learned my addr 172.21.15.52:0/2158317643 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd671275640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd66c107900 0x7fd66c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd671a76640 1 -- 172.21.15.52:0/2158317643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd66c107900 msgr2=0x7fd66c19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd671a76640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd66c107900 0x7fd66c19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd671a76640 1 -- 172.21.15.52:0/2158317643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c1977a0 con 0x7fd66c101900 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd671a76640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c19d620 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd66800d6f0 tx=0x7fd66800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd662ffd640 1 -- 172.21.15.52:0/2158317643 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd668017070 con 0x7fd66c101900 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd662ffd640 1 -- 172.21.15.52:0/2158317643 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd66800de00 con 0x7fd66c101900 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c197a90 con 0x7fd66c101900 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd662ffd640 1 -- 172.21.15.52:0/2158317643 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd668004bb0 con 0x7fd66c101900 2024-09-06T15:03:09.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.788+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66c197ff0 con 0x7fd66c101900 2024-09-06T15:03:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.789+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd66c103040 con 0x7fd66c101900 2024-09-06T15:03:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.790+0000 7fd662ffd640 1 -- 172.21.15.52:0/2158317643 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd668004e60 con 0x7fd66c101900 2024-09-06T15:03:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.790+0000 7fd662ffd640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd658077460 0x7fd658079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.791+0000 7fd662ffd640 1 -- 172.21.15.52:0/2158317643 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd668099390 con 0x7fd66c101900 2024-09-06T15:03:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.791+0000 7fd671275640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd658077460 0x7fd658079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:09.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.791+0000 7fd671275640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd658077460 0x7fd658079920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd66c198af0 tx=0x7fd65c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:09.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.795+0000 7fd662ffd640 1 -- 172.21.15.52:0/2158317643 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd668066460 con 0x7fd66c101900 2024-09-06T15:03:09.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:09 smithi165 ceph-mon[82925]: pgmap v567: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:09.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:09 smithi165 ceph-mon[82925]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:09 smithi165 ceph-mon[82925]: from='client.34890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:09 smithi165 ceph-mon[82925]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:09.826 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:09 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/699941887' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:03:09.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.974+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd66c1982a0 con 0x7fd658077460 2024-09-06T15:03:09.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.975+0000 7fd662ffd640 1 -- 172.21.15.52:0/2158317643 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd66c1982a0 con 0x7fd658077460 2024-09-06T15:03:09.974 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:03:09.974 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:03:09.974 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:03:09.974 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:03:09.974 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:03:09.975 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd658077460 msgr2=0x7fd658079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd658077460 0x7fd658079920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd66c198af0 tx=0x7fd65c031400 comp rx=0 tx=0).stop 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 msgr2=0x7fd66c19d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c19d620 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd66800d6f0 tx=0x7fd66800dbb0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 shutdown_connections 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd658077460 0x7fd658079920 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd66c107900 0x7fd66c19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 --2- 172.21.15.52:0/2158317643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd66c101900 0x7fd66c19d620 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 >> 172.21.15.52:0/2158317643 conn(0x7fd66c0fd600 msgr2=0x7fd66c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 shutdown_connections 2024-09-06T15:03:09.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:09.977+0000 7fd673cda640 1 -- 172.21.15.52:0/2158317643 wait complete. 2024-09-06T15:03:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.059+0000 7f7ce964a640 1 -- 172.21.15.52:0/126107277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 msgr2=0x7f7ce410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.059+0000 7f7ce964a640 1 --2- 172.21.15.52:0/126107277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce410b930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80098b0 tx=0x7f7cd802a560 comp rx=0 tx=0).stop 2024-09-06T15:03:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.059+0000 7f7ce964a640 1 -- 172.21.15.52:0/126107277 shutdown_connections 2024-09-06T15:03:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.059+0000 7f7ce964a640 1 --2- 172.21.15.52:0/126107277 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce410b930 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.059+0000 7f7ce964a640 1 --2- 172.21.15.52:0/126107277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ce4102b20 0x7f7ce4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.059+0000 7f7ce964a640 1 -- 172.21.15.52:0/126107277 >> 172.21.15.52:0/126107277 conn(0x7f7ce40fc520 msgr2=0x7f7ce40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.059+0000 7f7ce964a640 1 -- 172.21.15.52:0/126107277 shutdown_connections 2024-09-06T15:03:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.060+0000 7f7ce964a640 1 -- 172.21.15.52:0/126107277 wait complete. 2024-09-06T15:03:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.060+0000 7f7ce964a640 1 Processor -- start 2024-09-06T15:03:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.060+0000 7f7ce964a640 1 -- start start 2024-09-06T15:03:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.060+0000 7f7ce964a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ce4102b20 0x7f7ce419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.060+0000 7f7ce964a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.060+0000 7f7ce964a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410edf0 con 0x7f7ce4103440 2024-09-06T15:03:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.060+0000 7f7ce964a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410ec70 con 0x7f7ce4102b20 2024-09-06T15:03:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce27fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce419dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51374/0 (socket says 172.21.15.52:51374) 2024-09-06T15:03:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce27fc640 1 -- 172.21.15.52:0/3963941537 learned_addr learned my addr 172.21.15.52:0/3963941537 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce2ffd640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ce4102b20 0x7f7ce419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce27fc640 1 -- 172.21.15.52:0/3963941537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ce4102b20 msgr2=0x7f7ce419d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce27fc640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ce4102b20 0x7f7ce419d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce27fc640 1 -- 172.21.15.52:0/3963941537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce41978a0 con 0x7f7ce4103440 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce2ffd640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ce4102b20 0x7f7ce419d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce27fc640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce419dc20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8031460 tx=0x7f7cd80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ccbfff640 1 -- 172.21.15.52:0/3963941537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cd803f070 con 0x7f7ce4103440 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce4197b30 con 0x7f7ce4103440 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.061+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce4198060 con 0x7f7ce4103440 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.062+0000 7f7ccbfff640 1 -- 172.21.15.52:0/3963941537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cd80035f0 con 0x7f7ce4103440 2024-09-06T15:03:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.062+0000 7f7ccbfff640 1 -- 172.21.15.52:0/3963941537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cd8049060 con 0x7f7ce4103440 2024-09-06T15:03:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.063+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd0005290 con 0x7f7ce4103440 2024-09-06T15:03:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.063+0000 7f7ccbfff640 1 -- 172.21.15.52:0/3963941537 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7cd8042070 con 0x7f7ce4103440 2024-09-06T15:03:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.064+0000 7f7ccbfff640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ccc0774b0 0x7f7ccc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.064+0000 7f7ccbfff640 1 -- 172.21.15.52:0/3963941537 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7cd80ba120 con 0x7f7ce4103440 2024-09-06T15:03:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.064+0000 7f7ce2ffd640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ccc0774b0 0x7f7ccc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.064+0000 7f7ce2ffd640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ccc0774b0 0x7f7ccc079970 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4005fd0 tx=0x7f7cd4005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:10.067 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.068+0000 7f7ccbfff640 1 -- 172.21.15.52:0/3963941537 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7cd8083100 con 0x7f7ce4103440 2024-09-06T15:03:10.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.288+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f7cd0005580 con 0x7f7ce4103440 2024-09-06T15:03:10.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.288+0000 7f7ccbfff640 1 -- 172.21.15.52:0/3963941537 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f7cd8087270 con 0x7f7ce4103440 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:03:10.288 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:03:10.289 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:03:10.289 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:03:10.289 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:03:10.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ccc0774b0 msgr2=0x7f7ccc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ccc0774b0 0x7f7ccc079970 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4005fd0 tx=0x7f7cd4005850 comp rx=0 tx=0).stop 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 msgr2=0x7f7ce419dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce419dc20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8031460 tx=0x7f7cd80045c0 comp rx=0 tx=0).stop 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 shutdown_connections 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce4103440 0x7f7ce419dc20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ccc0774b0 0x7f7ccc079970 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 --2- 172.21.15.52:0/3963941537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7ce4102b20 0x7f7ce419d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.290+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 >> 172.21.15.52:0/3963941537 conn(0x7f7ce40fc520 msgr2=0x7f7ce4103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.291+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 shutdown_connections 2024-09-06T15:03:10.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:10.291+0000 7f7ce964a640 1 -- 172.21.15.52:0/3963941537 wait complete. 2024-09-06T15:03:10.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:10 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2438945292' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:03:10.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:10 smithi165 ceph-mon[82925]: from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:10.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:10 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3963941537' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:03:10.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:10 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2438945292' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:03:10.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:10 smithi052 ceph-mon[112917]: from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:10.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:10 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3963941537' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:03:11.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:11 smithi165 ceph-mon[82925]: pgmap v568: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:11.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:11 smithi052 ceph-mon[112917]: pgmap v568: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:13.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:13 smithi165 ceph-mon[82925]: pgmap v569: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:13.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:13 smithi052 ceph-mon[112917]: pgmap v569: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:15.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:15 smithi165 ceph-mon[82925]: pgmap v570: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:15.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:15 smithi052 ceph-mon[112917]: pgmap v570: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:17.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:17 smithi165 ceph-mon[82925]: pgmap v571: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:17.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:17 smithi052 ceph-mon[112917]: pgmap v571: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:19.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:19 smithi165 ceph-mon[82925]: pgmap v572: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:19.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:19 smithi052 ceph-mon[112917]: pgmap v572: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:21.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:21 smithi165 ceph-mon[82925]: pgmap v573: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:21.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:21 smithi052 ceph-mon[112917]: pgmap v573: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:23.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:23 smithi165 ceph-mon[82925]: pgmap v574: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:23.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:23.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:23 smithi052 ceph-mon[112917]: pgmap v574: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:23.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:25.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:25 smithi165 ceph-mon[82925]: pgmap v575: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:25 smithi052 ceph-mon[112917]: pgmap v575: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:27.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:27 smithi165 ceph-mon[82925]: pgmap v576: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:27.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:27 smithi052 ceph-mon[112917]: pgmap v576: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:29.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:29 smithi165 ceph-mon[82925]: pgmap v577: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:29.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:29 smithi052 ceph-mon[112917]: pgmap v577: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:31.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:31 smithi165 ceph-mon[82925]: pgmap v578: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:31.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:31 smithi052 ceph-mon[112917]: pgmap v578: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:33.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:33 smithi165 ceph-mon[82925]: pgmap v579: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:33.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:33 smithi052 ceph-mon[112917]: pgmap v579: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:35.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:35 smithi165 ceph-mon[82925]: pgmap v580: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:35.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:35 smithi052 ceph-mon[112917]: pgmap v580: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:37.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:37 smithi165 ceph-mon[82925]: pgmap v581: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:37.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:37 smithi052 ceph-mon[112917]: pgmap v581: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:38.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:38.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:39.726 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:39 smithi165 ceph-mon[82925]: pgmap v582: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:39.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:39 smithi052 ceph-mon[112917]: pgmap v582: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:40.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 -- 172.21.15.52:0/1949097486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 msgr2=0x7f1af0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 --2- 172.21.15.52:0/1949097486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af0074970 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1aec009c20 tx=0x7f1aec02aa00 comp rx=0 tx=0).stop 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 -- 172.21.15.52:0/1949097486 shutdown_connections 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 --2- 172.21.15.52:0/1949097486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1af0074eb0 0x7f1af01123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 --2- 172.21.15.52:0/1949097486 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af0074970 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 -- 172.21.15.52:0/1949097486 >> 172.21.15.52:0/1949097486 conn(0x7f1af00fd600 msgr2=0x7f1af00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 -- 172.21.15.52:0/1949097486 shutdown_connections 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.381+0000 7f1af73ae640 1 -- 172.21.15.52:0/1949097486 wait complete. 2024-09-06T15:03:40.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.382+0000 7f1af73ae640 1 Processor -- start 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.382+0000 7f1af73ae640 1 -- start start 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.382+0000 7f1af73ae640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.382+0000 7f1af73ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1af0074eb0 0x7f1af019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.382+0000 7f1af73ae640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01153f0 con 0x7f1af0074590 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.382+0000 7f1af73ae640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1af0115270 con 0x7f1af0074eb0 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af514a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af514a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af019e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45708/0 (socket says 172.21.15.52:45708) 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af514a640 1 -- 172.21.15.52:0/2883009777 learned_addr learned my addr 172.21.15.52:0/2883009777 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af4949640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1af0074eb0 0x7f1af019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af514a640 1 -- 172.21.15.52:0/2883009777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1af0074eb0 msgr2=0x7f1af019e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af514a640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1af0074eb0 0x7f1af019e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af514a640 1 -- 172.21.15.52:0/2883009777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af01a2900 con 0x7f1af0074590 2024-09-06T15:03:40.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af514a640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af019e030 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1aec02af20 tx=0x7f1aec02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:40.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1ae67fc640 1 -- 172.21.15.52:0/2883009777 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1aec047070 con 0x7f1af0074590 2024-09-06T15:03:40.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af01a2b90 con 0x7f1af0074590 2024-09-06T15:03:40.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1ae67fc640 1 -- 172.21.15.52:0/2883009777 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1aec003e30 con 0x7f1af0074590 2024-09-06T15:03:40.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1ae67fc640 1 -- 172.21.15.52:0/2883009777 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1aec033050 con 0x7f1af0074590 2024-09-06T15:03:40.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.383+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af01a30c0 con 0x7f1af0074590 2024-09-06T15:03:40.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.384+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af0075cd0 con 0x7f1af0074590 2024-09-06T15:03:40.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.385+0000 7f1ae67fc640 1 -- 172.21.15.52:0/2883009777 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1aec04a070 con 0x7f1af0074590 2024-09-06T15:03:40.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.385+0000 7f1ae67fc640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1adc077460 0x7f1adc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.386+0000 7f1af4949640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1adc077460 0x7f1adc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.386+0000 7f1ae67fc640 1 -- 172.21.15.52:0/2883009777 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1aec03e030 con 0x7f1af0074590 2024-09-06T15:03:40.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.386+0000 7f1af4949640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1adc077460 0x7f1adc079920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1af0104860 tx=0x7f1ae000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:40.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.390+0000 7f1ae67fc640 1 -- 172.21.15.52:0/2883009777 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1aec087940 con 0x7f1af0074590 2024-09-06T15:03:40.567 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.567+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1af01a3370 con 0x7f1adc077460 2024-09-06T15:03:40.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.568+0000 7f1ae67fc640 1 -- 172.21.15.52:0/2883009777 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1af01a3370 con 0x7f1adc077460 2024-09-06T15:03:40.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1adc077460 msgr2=0x7f1adc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1adc077460 0x7f1adc079920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1af0104860 tx=0x7f1ae000b390 comp rx=0 tx=0).stop 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 msgr2=0x7f1af019e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af019e030 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1aec02af20 tx=0x7f1aec02ee60 comp rx=0 tx=0).stop 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 shutdown_connections 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1adc077460 0x7f1adc079920 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1af0074eb0 0x7f1af019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 --2- 172.21.15.52:0/2883009777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1af0074590 0x7f1af019e030 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 >> 172.21.15.52:0/2883009777 conn(0x7f1af00fd600 msgr2=0x7f1af0104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 shutdown_connections 2024-09-06T15:03:40.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.570+0000 7f1af73ae640 1 -- 172.21.15.52:0/2883009777 wait complete. 2024-09-06T15:03:40.579 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.653+0000 7f47241c2640 1 -- 172.21.15.52:0/1461657613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 msgr2=0x7f471c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 --2- 172.21.15.52:0/1461657613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c100c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4710009880 tx=0x7f471002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 -- 172.21.15.52:0/1461657613 shutdown_connections 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 --2- 172.21.15.52:0/1461657613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c100c50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 --2- 172.21.15.52:0/1461657613 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471c1067f0 0x7f471c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 -- 172.21.15.52:0/1461657613 >> 172.21.15.52:0/1461657613 conn(0x7f471c0fc550 msgr2=0x7f471c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 -- 172.21.15.52:0/1461657613 shutdown_connections 2024-09-06T15:03:40.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 -- 172.21.15.52:0/1461657613 wait complete. 2024-09-06T15:03:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 Processor -- start 2024-09-06T15:03:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.654+0000 7f47241c2640 1 -- start start 2024-09-06T15:03:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f47241c2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f47241c2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471c1067f0 0x7f471c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f47241c2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f471c10dcc0 con 0x7f471c1007f0 2024-09-06T15:03:40.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f47241c2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f471c10db40 con 0x7f471c1067f0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f4721f5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f4721f5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45720/0 (socket says 172.21.15.52:45720) 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f4721f5e640 1 -- 172.21.15.52:0/211478919 learned_addr learned my addr 172.21.15.52:0/211478919 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f472175d640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471c1067f0 0x7f471c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f4721f5e640 1 -- 172.21.15.52:0/211478919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471c1067f0 msgr2=0x7f471c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f4721f5e640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471c1067f0 0x7f471c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f4721f5e640 1 -- 172.21.15.52:0/211478919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471c1977e0 con 0x7f471c1007f0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f4721f5e640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c19d660 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f471400d6f0 tx=0x7f471400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f471affd640 1 -- 172.21.15.52:0/211478919 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4714017070 con 0x7f471c1007f0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f471affd640 1 -- 172.21.15.52:0/211478919 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f471400de00 con 0x7f471c1007f0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471c197ad0 con 0x7f471c1007f0 2024-09-06T15:03:40.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f471affd640 1 -- 172.21.15.52:0/211478919 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4714004bb0 con 0x7f471c1007f0 2024-09-06T15:03:40.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.655+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f471c198030 con 0x7f471c1007f0 2024-09-06T15:03:40.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.657+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f471c101f30 con 0x7f471c1007f0 2024-09-06T15:03:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.657+0000 7f471affd640 1 -- 172.21.15.52:0/211478919 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4714004e60 con 0x7f471c1007f0 2024-09-06T15:03:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.658+0000 7f471affd640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4704077460 0x7f4704079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.658+0000 7f471affd640 1 -- 172.21.15.52:0/211478919 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4714099440 con 0x7f471c1007f0 2024-09-06T15:03:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.658+0000 7f472175d640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4704077460 0x7f4704079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.658+0000 7f472175d640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4704077460 0x7f4704079920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f471c198b30 tx=0x7f4710031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:40.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.662+0000 7f471affd640 1 -- 172.21.15.52:0/211478919 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f47140623a0 con 0x7f471c1007f0 2024-09-06T15:03:40.841 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.841+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f471c1983a0 con 0x7f4704077460 2024-09-06T15:03:40.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.843+0000 7f471affd640 1 -- 172.21.15.52:0/211478919 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f471c1983a0 con 0x7f4704077460 2024-09-06T15:03:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4704077460 msgr2=0x7f4704079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4704077460 0x7f4704079920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f471c198b30 tx=0x7f4710031400 comp rx=0 tx=0).stop 2024-09-06T15:03:40.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 msgr2=0x7f471c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c19d660 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f471400d6f0 tx=0x7f471400dbb0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 shutdown_connections 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4704077460 0x7f4704079920 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f471c1067f0 0x7f471c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 --2- 172.21.15.52:0/211478919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f471c1007f0 0x7f471c19d660 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 >> 172.21.15.52:0/211478919 conn(0x7f471c0fc550 msgr2=0x7f471c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 shutdown_connections 2024-09-06T15:03:40.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.845+0000 7f47241c2640 1 -- 172.21.15.52:0/211478919 wait complete. 2024-09-06T15:03:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 -- 172.21.15.52:0/372617524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1067f0 msgr2=0x7f73ec106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 --2- 172.21.15.52:0/372617524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1067f0 0x7f73ec106bd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009880 tx=0x7f73dc02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.928 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 -- 172.21.15.52:0/372617524 shutdown_connections 2024-09-06T15:03:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 --2- 172.21.15.52:0/372617524 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73ec1007f0 0x7f73ec100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 --2- 172.21.15.52:0/372617524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1067f0 0x7f73ec106bd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 -- 172.21.15.52:0/372617524 >> 172.21.15.52:0/372617524 conn(0x7f73ec0fc550 msgr2=0x7f73ec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 -- 172.21.15.52:0/372617524 shutdown_connections 2024-09-06T15:03:40.929 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.928+0000 7f73f0cea640 1 -- 172.21.15.52:0/372617524 wait complete. 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73f0cea640 1 Processor -- start 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73f0cea640 1 -- start start 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73f0cea640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1007f0 0x7f73ec19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73f0cea640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73ec1067f0 0x7f73ec19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73f0cea640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec10dcc0 con 0x7f73ec1007f0 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73f0cea640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec10db40 con 0x7f73ec1067f0 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1007f0 0x7f73ec19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.931 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73ea59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1007f0 0x7f73ec19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45728/0 (socket says 172.21.15.52:45728) 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73ea59c640 1 -- 172.21.15.52:0/1024537887 learned_addr learned my addr 172.21.15.52:0/1024537887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73ec1067f0 0x7f73ec19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73ea59c640 1 -- 172.21.15.52:0/1024537887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73ec1067f0 msgr2=0x7f73ec19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73ea59c640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73ec1067f0 0x7f73ec19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73ea59c640 1 -- 172.21.15.52:0/1024537887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec1977b0 con 0x7f73ec1007f0 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.929+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73ec1067f0 0x7f73ec19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.930+0000 7f73ea59c640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1007f0 0x7f73ec19d630 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f73dc031460 tx=0x7f73dc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.930+0000 7f73db7fe640 1 -- 172.21.15.52:0/1024537887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73dc03f070 con 0x7f73ec1007f0 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.930+0000 7f73db7fe640 1 -- 172.21.15.52:0/1024537887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73dc004a90 con 0x7f73ec1007f0 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.930+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ec197a40 con 0x7f73ec1007f0 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.930+0000 7f73db7fe640 1 -- 172.21.15.52:0/1024537887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73dc035030 con 0x7f73ec1007f0 2024-09-06T15:03:40.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.930+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ec197f70 con 0x7f73ec1007f0 2024-09-06T15:03:40.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.931+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ec101f30 con 0x7f73ec1007f0 2024-09-06T15:03:40.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.931+0000 7f73db7fe640 1 -- 172.21.15.52:0/1024537887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f73dc042070 con 0x7f73ec1007f0 2024-09-06T15:03:40.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.932+0000 7f73db7fe640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f73d40774b0 0x7f73d4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:40.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.932+0000 7f73db7fe640 1 -- 172.21.15.52:0/1024537887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f73dc0ba220 con 0x7f73ec1007f0 2024-09-06T15:03:40.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.932+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f73d40774b0 0x7f73d4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:40.934 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.932+0000 7f73e9d9b640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f73d40774b0 0x7f73d4079970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73ec104fd0 tx=0x7f73e0005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:40.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:40.936+0000 7f73db7fe640 1 -- 172.21.15.52:0/1024537887 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f73dc083200 con 0x7f73ec1007f0 2024-09-06T15:03:41.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.104+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f73ec198220 con 0x7f73d40774b0 2024-09-06T15:03:41.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.113+0000 7f73db7fe640 1 -- 172.21.15.52:0/1024537887 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f73ec198220 con 0x7f73d40774b0 2024-09-06T15:03:41.113 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (16m) 10m ago 26m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (18m) 10m ago 27m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (18m) 9m ago 26m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (14m) 10m ago 27m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (14m) 9m ago 26m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (15m) 10m ago 26m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (10m) 10m ago 21m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (10m) 10m ago 21m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (10m) 9m ago 21m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (9m) 9m ago 21m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (18m) 10m ago 28m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (17m) 9m ago 26m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:03:41.114 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (14m) 10m ago 28m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (14m) 9m ago 26m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (16m) 10m ago 27m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (16m) 9m ago 26m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (13m) 10m ago 25m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (13m) 10m ago 24m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (12m) 10m ago 24m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (12m) 9m ago 23m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (11m) 9m ago 23m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (11m) 9m ago 22m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:03:41.115 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (16m) 10m ago 26m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f73d40774b0 msgr2=0x7f73d4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f73d40774b0 0x7f73d4079970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f73ec104fd0 tx=0x7f73e0005f90 comp rx=0 tx=0).stop 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1007f0 msgr2=0x7f73ec19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1007f0 0x7f73ec19d630 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f73dc031460 tx=0x7f73dc004530 comp rx=0 tx=0).stop 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 shutdown_connections 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f73d40774b0 0x7f73d4079970 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f73ec1067f0 0x7f73ec19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 --2- 172.21.15.52:0/1024537887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73ec1007f0 0x7f73ec19d630 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 >> 172.21.15.52:0/1024537887 conn(0x7f73ec0fc550 msgr2=0x7f73ec069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 shutdown_connections 2024-09-06T15:03:41.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.115+0000 7f73f0cea640 1 -- 172.21.15.52:0/1024537887 wait complete. 2024-09-06T15:03:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 -- 172.21.15.52:0/1617059422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 msgr2=0x7f2fd8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/1617059422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd8102ea0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009880 tx=0x7f2fd402a530 comp rx=0 tx=0).stop 2024-09-06T15:03:41.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 -- 172.21.15.52:0/1617059422 shutdown_connections 2024-09-06T15:03:41.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/1617059422 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd81033e0 0x7f2fd810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/1617059422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd8102ea0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 -- 172.21.15.52:0/1617059422 >> 172.21.15.52:0/1617059422 conn(0x7f2fd80fc520 msgr2=0x7f2fd80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:41.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 -- 172.21.15.52:0/1617059422 shutdown_connections 2024-09-06T15:03:41.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.197+0000 7f2fe07d7640 1 -- 172.21.15.52:0/1617059422 wait complete. 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fe07d7640 1 Processor -- start 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fe07d7640 1 -- start start 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fe07d7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fe07d7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd81033e0 0x7f2fd819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fe07d7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd810edf0 con 0x7f2fd8102ac0 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fe07d7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd810ec70 con 0x7f2fd81033e0 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fde573640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fde573640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd819f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45738/0 (socket says 172.21.15.52:45738) 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fde573640 1 -- 172.21.15.52:0/648557748 learned_addr learned my addr 172.21.15.52:0/648557748 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fddd72640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd81033e0 0x7f2fd819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fde573640 1 -- 172.21.15.52:0/648557748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd81033e0 msgr2=0x7f2fd819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fde573640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd81033e0 0x7f2fd819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.198+0000 7f2fde573640 1 -- 172.21.15.52:0/648557748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd8199a30 con 0x7f2fd8102ac0 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.199+0000 7f2fde573640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd819f820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4031460 tx=0x7f2fd40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.199+0000 7f2fcf7fe640 1 -- 172.21.15.52:0/648557748 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd403f070 con 0x7f2fd8102ac0 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.199+0000 7f2fcf7fe640 1 -- 172.21.15.52:0/648557748 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fd40035f0 con 0x7f2fd8102ac0 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.199+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd8199cc0 con 0x7f2fd8102ac0 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.199+0000 7f2fcf7fe640 1 -- 172.21.15.52:0/648557748 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4035030 con 0x7f2fd8102ac0 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.199+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd819a1f0 con 0x7f2fd8102ac0 2024-09-06T15:03:41.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.200+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd806aa90 con 0x7f2fd8102ac0 2024-09-06T15:03:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.200+0000 7f2fcf7fe640 1 -- 172.21.15.52:0/648557748 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2fd4042070 con 0x7f2fd8102ac0 2024-09-06T15:03:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.201+0000 7f2fcf7fe640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc4077460 0x7f2fc4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.201+0000 7f2fcf7fe640 1 -- 172.21.15.52:0/648557748 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f2fd40ba160 con 0x7f2fd8102ac0 2024-09-06T15:03:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.201+0000 7f2fddd72640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc4077460 0x7f2fc4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.201+0000 7f2fddd72640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc4077460 0x7f2fc4079920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80fee80 tx=0x7f2fc800b2e0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:41.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.205+0000 7f2fcf7fe640 1 -- 172.21.15.52:0/648557748 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f2fd4087190 con 0x7f2fd8102ac0 2024-09-06T15:03:41.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.426+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2fd810b3a0 con 0x7f2fd8102ac0 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.426+0000 7f2fcf7fe640 1 -- 172.21.15.52:0/648557748 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2fd408bbb0 con 0x7f2fd8102ac0 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:03:41.427 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:03:41.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.428+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc4077460 msgr2=0x7f2fc4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.428+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc4077460 0x7f2fc4079920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80fee80 tx=0x7f2fc800b2e0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.428+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 msgr2=0x7f2fd819f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.428+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd819f820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4031460 tx=0x7f2fd40045e0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.428+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 shutdown_connections 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.429+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc4077460 0x7f2fc4079920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.429+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fd81033e0 0x7f2fd819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.429+0000 7f2fe07d7640 1 --2- 172.21.15.52:0/648557748 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd8102ac0 0x7f2fd819f820 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.429+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 >> 172.21.15.52:0/648557748 conn(0x7f2fd80fc520 msgr2=0x7f2fd8100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.429+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 shutdown_connections 2024-09-06T15:03:41.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.429+0000 7f2fe07d7640 1 -- 172.21.15.52:0/648557748 wait complete. 2024-09-06T15:03:41.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 -- 172.21.15.52:0/3021349615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138107900 msgr2=0x7f2138107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 --2- 172.21.15.52:0/3021349615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138107900 0x7f2138107ce0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f212c009880 tx=0x7f212c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 -- 172.21.15.52:0/3021349615 shutdown_connections 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 --2- 172.21.15.52:0/3021349615 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2138101900 0x7f2138101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 --2- 172.21.15.52:0/3021349615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138107900 0x7f2138107ce0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 -- 172.21.15.52:0/3021349615 >> 172.21.15.52:0/3021349615 conn(0x7f21380fd600 msgr2=0x7f21380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 -- 172.21.15.52:0/3021349615 shutdown_connections 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.511+0000 7f213f61e640 1 -- 172.21.15.52:0/3021349615 wait complete. 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213f61e640 1 Processor -- start 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213f61e640 1 -- start start 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213f61e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101900 0x7f21380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213f61e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2138107900 0x7f2138074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213f61e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f213810ee30 con 0x7f2138101900 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213f61e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f213810ecb0 con 0x7f2138107900 2024-09-06T15:03:41.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213d3ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101900 0x7f21380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213d3ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101900 0x7f21380744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45754/0 (socket says 172.21.15.52:45754) 2024-09-06T15:03:41.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.512+0000 7f213d3ba640 1 -- 172.21.15.52:0/464349197 learned_addr learned my addr 172.21.15.52:0/464349197 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f213d3ba640 1 -- 172.21.15.52:0/464349197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2138107900 msgr2=0x7f2138074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f213cbb9640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2138107900 0x7f2138074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f213d3ba640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2138107900 0x7f2138074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f213d3ba640 1 -- 172.21.15.52:0/464349197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2138074f70 con 0x7f2138101900 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f213d3ba640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101900 0x7f21380744f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f212c031460 tx=0x7f212c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f212a7fc640 1 -- 172.21.15.52:0/464349197 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f212c03f070 con 0x7f2138101900 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f212a7fc640 1 -- 172.21.15.52:0/464349197 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f212c004cf0 con 0x7f2138101900 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2138075200 con 0x7f2138101900 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f212a7fc640 1 -- 172.21.15.52:0/464349197 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f212c035030 con 0x7f2138101900 2024-09-06T15:03:41.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.513+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21381a3e20 con 0x7f2138101900 2024-09-06T15:03:41.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.514+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2138103040 con 0x7f2138101900 2024-09-06T15:03:41.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.515+0000 7f212a7fc640 1 -- 172.21.15.52:0/464349197 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f212c042070 con 0x7f2138101900 2024-09-06T15:03:41.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.515+0000 7f212a7fc640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f21240774b0 0x7f2124079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.515+0000 7f213cbb9640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f21240774b0 0x7f2124079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.515+0000 7f212a7fc640 1 -- 172.21.15.52:0/464349197 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f212c0ba200 con 0x7f2138101900 2024-09-06T15:03:41.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.516+0000 7f213cbb9640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f21240774b0 0x7f2124079970 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2138075f80 tx=0x7f2134008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:41.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.519+0000 7f212a7fc640 1 -- 172.21.15.52:0/464349197 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f212c0831e0 con 0x7f2138101900 2024-09-06T15:03:41.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.704+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f213802d7c0 con 0x7f2138101900 2024-09-06T15:03:41.705 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:41 smithi052 ceph-mon[112917]: pgmap v583: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:41.705 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:41 smithi052 ceph-mon[112917]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:41.705 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:41 smithi052 ceph-mon[112917]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:41.705 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:41 smithi052 ceph-mon[112917]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:41.705 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:41 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/648557748' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.705+0000 7f212a7fc640 1 -- 172.21.15.52:0/464349197 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f212c087350 con 0x7f2138101900 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:03:41.706 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:03:41.707 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:03:41.708 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:41.709 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:03:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:03:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.707+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f21240774b0 msgr2=0x7f2124079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.707+0000 7f213f61e640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f21240774b0 0x7f2124079970 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2138075f80 tx=0x7f2134008040 comp rx=0 tx=0).stop 2024-09-06T15:03:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.707+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101900 msgr2=0x7f21380744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.707+0000 7f213f61e640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101900 0x7f21380744f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f212c031460 tx=0x7f212c0048f0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.708+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 shutdown_connections 2024-09-06T15:03:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.708+0000 7f213f61e640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f21240774b0 0x7f2124079970 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.708+0000 7f213f61e640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2138107900 0x7f2138074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.708+0000 7f213f61e640 1 --2- 172.21.15.52:0/464349197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2138101900 0x7f21380744f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.708+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 >> 172.21.15.52:0/464349197 conn(0x7f21380fd600 msgr2=0x7f21380fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.708+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 shutdown_connections 2024-09-06T15:03:41.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.708+0000 7f213f61e640 1 -- 172.21.15.52:0/464349197 wait complete. 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 -- 172.21.15.52:0/3963031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb24102ac0 msgr2=0x7fcb24102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 --2- 172.21.15.52:0/3963031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb24102ac0 0x7fcb24102ea0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009880 tx=0x7fcb1402a530 comp rx=0 tx=0).stop 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 -- 172.21.15.52:0/3963031307 shutdown_connections 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 --2- 172.21.15.52:0/3963031307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb241033e0 0x7fcb2410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 --2- 172.21.15.52:0/3963031307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb24102ac0 0x7fcb24102ea0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 -- 172.21.15.52:0/3963031307 >> 172.21.15.52:0/3963031307 conn(0x7fcb240fc520 msgr2=0x7fcb240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 -- 172.21.15.52:0/3963031307 shutdown_connections 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.792+0000 7fcb28f83640 1 -- 172.21.15.52:0/3963031307 wait complete. 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb28f83640 1 Processor -- start 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb28f83640 1 -- start start 2024-09-06T15:03:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb28f83640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb24102ac0 0x7fcb2419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb28f83640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb241033e0 0x7fcb2419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb28f83640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2410edd0 con 0x7fcb241033e0 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb28f83640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2410ec50 con 0x7fcb24102ac0 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb21d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb241033e0 0x7fcb2419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb21d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb241033e0 0x7fcb2419dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45778/0 (socket says 172.21.15.52:45778) 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb21d9b640 1 -- 172.21.15.52:0/607909889 learned_addr learned my addr 172.21.15.52:0/607909889 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.793+0000 7fcb2259c640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb24102ac0 0x7fcb2419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb21d9b640 1 -- 172.21.15.52:0/607909889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb24102ac0 msgr2=0x7fcb2419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb21d9b640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb24102ac0 0x7fcb2419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb21d9b640 1 -- 172.21.15.52:0/607909889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2419e310 con 0x7fcb241033e0 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb2259c640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb24102ac0 0x7fcb2419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:03:41.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb21d9b640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb241033e0 0x7fcb2419dc60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c8f0 tx=0x7fcb1800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb137fe640 1 -- 172.21.15.52:0/607909889 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb180079b0 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb137fe640 1 -- 172.21.15.52:0/607909889 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb18007b50 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb24197a00 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb137fe640 1 -- 172.21.15.52:0/607909889 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb18018610 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.794+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb24197f60 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.795+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2406aa90 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.796+0000 7fcb137fe640 1 -- 172.21.15.52:0/607909889 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fcb18007d00 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.796+0000 7fcb137fe640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb0c0774b0 0x7fcb0c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.796+0000 7fcb137fe640 1 -- 172.21.15.52:0/607909889 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fcb18099910 con 0x7fcb241033e0 2024-09-06T15:03:41.797 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.796+0000 7fcb2259c640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb0c0774b0 0x7fcb0c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:41.798 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.797+0000 7fcb2259c640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb0c0774b0 0x7fcb0c079970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb14000c00 tx=0x7fcb14031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:41.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.800+0000 7fcb137fe640 1 -- 172.21.15.52:0/607909889 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fcb18014030 con 0x7fcb241033e0 2024-09-06T15:03:41.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:41 smithi165 ceph-mon[82925]: pgmap v583: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:41.824 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:41 smithi165 ceph-mon[82925]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:41.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:41 smithi165 ceph-mon[82925]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:41.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:41 smithi165 ceph-mon[82925]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:41.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:41 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/648557748' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:03:41.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.980+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcb24198e80 con 0x7fcb0c0774b0 2024-09-06T15:03:41.981 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.981+0000 7fcb137fe640 1 -- 172.21.15.52:0/607909889 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fcb24198e80 con 0x7fcb0c0774b0 2024-09-06T15:03:41.981 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:03:41.982 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:03:41.983 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:03:41.984 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb0c0774b0 msgr2=0x7fcb0c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb0c0774b0 0x7fcb0c079970 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb14000c00 tx=0x7fcb14031400 comp rx=0 tx=0).stop 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb241033e0 msgr2=0x7fcb2419dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb241033e0 0x7fcb2419dc60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c8f0 tx=0x7fcb1800cdb0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 shutdown_connections 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb241033e0 0x7fcb2419dc60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb0c0774b0 0x7fcb0c079970 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 --2- 172.21.15.52:0/607909889 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb24102ac0 0x7fcb2419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 >> 172.21.15.52:0/607909889 conn(0x7fcb240fc520 msgr2=0x7fcb24108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 shutdown_connections 2024-09-06T15:03:41.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:41.984+0000 7fcb28f83640 1 -- 172.21.15.52:0/607909889 wait complete. 2024-09-06T15:03:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 -- 172.21.15.52:0/389802349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24100800 msgr2=0x7fac24100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/389802349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24100800 0x7fac24100c60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fac10009880 tx=0x7fac1002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 -- 172.21.15.52:0/389802349 shutdown_connections 2024-09-06T15:03:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/389802349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24100800 0x7fac24100c60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.069 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/389802349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac24106800 0x7fac24106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 -- 172.21.15.52:0/389802349 >> 172.21.15.52:0/389802349 conn(0x7fac240fc520 msgr2=0x7fac240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 -- 172.21.15.52:0/389802349 shutdown_connections 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.067+0000 7fac2b0fe640 1 -- 172.21.15.52:0/389802349 wait complete. 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac2b0fe640 1 Processor -- start 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac2b0fe640 1 -- start start 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac2b0fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac24100800 0x7fac24198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac2b0fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24106800 0x7fac24198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac2b0fe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fac2410dcb0 con 0x7fac24106800 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac2b0fe640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac2410db30 con 0x7fac24100800 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24106800 0x7fac24198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:42.070 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac23fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24106800 0x7fac24198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45792/0 (socket says 172.21.15.52:45792) 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac23fff640 1 -- 172.21.15.52:0/3668069349 learned_addr learned my addr 172.21.15.52:0/3668069349 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac28e9a640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac24100800 0x7fac24198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac23fff640 1 -- 172.21.15.52:0/3668069349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac24100800 msgr2=0x7fac24198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac23fff640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac24100800 0x7fac24198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.068+0000 7fac23fff640 1 -- 172.21.15.52:0/3668069349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac241992b0 con 0x7fac24106800 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.069+0000 7fac23fff640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24106800 0x7fac24198d40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fac10031460 tx=0x7fac100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.069+0000 7fac21ffb640 1 -- 172.21.15.52:0/3668069349 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac1003f070 con 0x7fac24106800 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.069+0000 7fac21ffb640 1 -- 172.21.15.52:0/3668069349 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac100044d0 con 0x7fac24106800 2024-09-06T15:03:42.071 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.069+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac24199540 con 0x7fac24106800 2024-09-06T15:03:42.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.069+0000 7fac21ffb640 1 -- 172.21.15.52:0/3668069349 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac10035030 con 0x7fac24106800 2024-09-06T15:03:42.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.069+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac241a1af0 con 0x7fac24106800 2024-09-06T15:03:42.072 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.070+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac24101f40 con 0x7fac24106800 2024-09-06T15:03:42.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.071+0000 7fac21ffb640 1 -- 172.21.15.52:0/3668069349 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fac10042070 con 0x7fac24106800 2024-09-06T15:03:42.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.071+0000 7fac21ffb640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac140774b0 0x7fac14079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:03:42.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.071+0000 7fac21ffb640 1 -- 172.21.15.52:0/3668069349 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fac100ba170 con 0x7fac24106800 2024-09-06T15:03:42.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.071+0000 7fac28e9a640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac140774b0 0x7fac14079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:03:42.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.072+0000 7fac28e9a640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac140774b0 0x7fac14079970 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fac1800abe0 tx=0x7fac1800a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:03:42.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.075+0000 7fac21ffb640 1 -- 172.21.15.52:0/3668069349 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fac10004cf0 con 0x7fac24106800 2024-09-06T15:03:42.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.293+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fac2406a7a0 con 0x7fac24106800 2024-09-06T15:03:42.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.293+0000 7fac21ffb640 1 -- 172.21.15.52:0/3668069349 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7fac10083150 con 0x7fac24106800 2024-09-06T15:03:42.294 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:03:42.294 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:03:42.294 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:03:42.294 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:03:42.294 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:03:42.295 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:03:42.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac140774b0 msgr2=0x7fac14079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac140774b0 0x7fac14079970 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fac1800abe0 tx=0x7fac1800a2d0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24106800 msgr2=0x7fac24198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24106800 0x7fac24198d40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fac10031460 tx=0x7fac100048f0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 shutdown_connections 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fac24106800 0x7fac24198d40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fac140774b0 0x7fac14079970 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 --2- 172.21.15.52:0/3668069349 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac24100800 0x7fac24198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 >> 172.21.15.52:0/3668069349 conn(0x7fac240fc520 msgr2=0x7fac240fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.296+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 shutdown_connections 2024-09-06T15:03:42.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:03:42.297+0000 7fac2b0fe640 1 -- 172.21.15.52:0/3668069349 wait complete. 2024-09-06T15:03:42.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:42 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/464349197' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:03:42.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:42 smithi165 ceph-mon[82925]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:42.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:42 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3668069349' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:03:42.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:42 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/464349197' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:03:42.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:42 smithi052 ceph-mon[112917]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:03:42.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:42 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3668069349' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:03:43.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:43 smithi165 ceph-mon[82925]: pgmap v584: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:43.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:43 smithi052 ceph-mon[112917]: pgmap v584: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:45.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:45 smithi165 ceph-mon[82925]: pgmap v585: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:45.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:45 smithi052 ceph-mon[112917]: pgmap v585: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:47.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:47 smithi165 ceph-mon[82925]: pgmap v586: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:47.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:47 smithi052 ceph-mon[112917]: pgmap v586: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:49.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:49 smithi052 ceph-mon[112917]: pgmap v587: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:50.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:49 smithi165 ceph-mon[82925]: pgmap v587: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:51.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:51 smithi052 ceph-mon[112917]: pgmap v588: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:52.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:51 smithi165 ceph-mon[82925]: pgmap v588: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:53.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:53 smithi052 ceph-mon[112917]: pgmap v589: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:53.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:54.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:53 smithi165 ceph-mon[82925]: pgmap v589: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:54.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:03:55.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:55 smithi052 ceph-mon[112917]: pgmap v590: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:56.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:55 smithi165 ceph-mon[82925]: pgmap v590: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:57.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:57 smithi052 ceph-mon[112917]: pgmap v591: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:57.876 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:57 smithi165 ceph-mon[82925]: pgmap v591: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:03:59.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:03:59 smithi052 ceph-mon[112917]: pgmap v592: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:00.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:03:59 smithi165 ceph-mon[82925]: pgmap v592: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:01.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:01 smithi052 ceph-mon[112917]: pgmap v593: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:02.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:01 smithi165 ceph-mon[82925]: pgmap v593: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:03.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:03 smithi052 ceph-mon[112917]: pgmap v594: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:04.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:03 smithi165 ceph-mon[82925]: pgmap v594: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:05.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:05 smithi052 ceph-mon[112917]: pgmap v595: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:06.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:05 smithi165 ceph-mon[82925]: pgmap v595: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:07.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:07 smithi052 ceph-mon[112917]: pgmap v596: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:08.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:07 smithi165 ceph-mon[82925]: pgmap v596: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:08.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:09.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:09.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:09 smithi052 ceph-mon[112917]: pgmap v597: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:10.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:09 smithi165 ceph-mon[82925]: pgmap v597: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:11.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:11 smithi052 ceph-mon[112917]: pgmap v598: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:12.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:11 smithi165 ceph-mon[82925]: pgmap v598: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:12.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.394+0000 7f8142725640 1 -- 172.21.15.52:0/1228916367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c100800 msgr2=0x7f813c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.394+0000 7f8142725640 1 --2- 172.21.15.52:0/1228916367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c100800 0x7f813c100c60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8130009880 tx=0x7f813002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.394+0000 7f8142725640 1 -- 172.21.15.52:0/1228916367 shutdown_connections 2024-09-06T15:04:12.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.394+0000 7f8142725640 1 --2- 172.21.15.52:0/1228916367 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c100800 0x7f813c100c60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.394+0000 7f8142725640 1 --2- 172.21.15.52:0/1228916367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f813c106800 0x7f813c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.394+0000 7f8142725640 1 -- 172.21.15.52:0/1228916367 >> 172.21.15.52:0/1228916367 conn(0x7f813c0fc520 msgr2=0x7f813c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:12.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.394+0000 7f8142725640 1 -- 172.21.15.52:0/1228916367 shutdown_connections 2024-09-06T15:04:12.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.395+0000 7f8142725640 1 -- 172.21.15.52:0/1228916367 wait complete. 2024-09-06T15:04:12.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.395+0000 7f8142725640 1 Processor -- start 2024-09-06T15:04:12.395 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.395+0000 7f8142725640 1 -- start start 2024-09-06T15:04:12.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f8142725640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f813c100800 0x7f813c0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f8142725640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c106800 0x7f813c0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f8142725640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10dcb0 con 0x7f813c106800 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f8142725640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f813c10db30 con 0x7f813c100800 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c106800 0x7f813c0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c106800 0x7f813c0fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35058/0 (socket says 172.21.15.52:35058) 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813b7fe640 1 -- 172.21.15.52:0/1989802636 learned_addr learned my addr 172.21.15.52:0/1989802636 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813bfff640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f813c100800 0x7f813c0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813b7fe640 1 -- 172.21.15.52:0/1989802636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f813c100800 msgr2=0x7f813c0fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813b7fe640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f813c100800 0x7f813c0fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813b7fe640 1 -- 172.21.15.52:0/1989802636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0fd650 con 0x7f813c106800 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.396+0000 7f813b7fe640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c106800 0x7f813c0fd110 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8130031460 tx=0x7f81300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:12.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.397+0000 7f81397fa640 1 -- 172.21.15.52:0/1989802636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f813003f070 con 0x7f813c106800 2024-09-06T15:04:12.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.397+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c0fd8e0 con 0x7f813c106800 2024-09-06T15:04:12.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.397+0000 7f81397fa640 1 -- 172.21.15.52:0/1989802636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8130004cf0 con 0x7f813c106800 2024-09-06T15:04:12.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.397+0000 7f81397fa640 1 -- 172.21.15.52:0/1989802636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8130035030 con 0x7f813c106800 2024-09-06T15:04:12.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.397+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c1a3d10 con 0x7f813c106800 2024-09-06T15:04:12.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.398+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c101f40 con 0x7f813c106800 2024-09-06T15:04:12.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.398+0000 7f81397fa640 1 -- 172.21.15.52:0/1989802636 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8130042070 con 0x7f813c106800 2024-09-06T15:04:12.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.399+0000 7f81397fa640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81240774b0 0x7f8124079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.399+0000 7f81397fa640 1 -- 172.21.15.52:0/1989802636 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f81300ba0d0 con 0x7f813c106800 2024-09-06T15:04:12.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.399+0000 7f813bfff640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81240774b0 0x7f8124079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.400+0000 7f813bfff640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81240774b0 0x7f8124079970 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f812c00abe0 tx=0x7f812c00a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:12.404 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.403+0000 7f81397fa640 1 -- 172.21.15.52:0/1989802636 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f81300830b0 con 0x7f813c106800 2024-09-06T15:04:12.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.580+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f813c109df0 con 0x7f81240774b0 2024-09-06T15:04:12.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.581+0000 7f81397fa640 1 -- 172.21.15.52:0/1989802636 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f813c109df0 con 0x7f81240774b0 2024-09-06T15:04:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81240774b0 msgr2=0x7f8124079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81240774b0 0x7f8124079970 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f812c00abe0 tx=0x7f812c00a2d0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c106800 msgr2=0x7f813c0fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.582 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c106800 0x7f813c0fd110 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8130031460 tx=0x7f81300048f0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 shutdown_connections 2024-09-06T15:04:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f813c106800 0x7f813c0fd110 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f81240774b0 0x7f8124079970 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 --2- 172.21.15.52:0/1989802636 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f813c100800 0x7f813c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 >> 172.21.15.52:0/1989802636 conn(0x7f813c0fc520 msgr2=0x7f813c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 shutdown_connections 2024-09-06T15:04:12.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.583+0000 7f8142725640 1 -- 172.21.15.52:0/1989802636 wait complete. 2024-09-06T15:04:12.591 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:04:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.667+0000 7f663004c640 1 -- 172.21.15.52:0/889193473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628101000 msgr2=0x7f662810dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.667+0000 7f663004c640 1 --2- 172.21.15.52:0/889193473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628101000 0x7f662810dcc0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f661c009880 tx=0x7f661c02a490 comp rx=0 tx=0).stop 2024-09-06T15:04:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.667+0000 7f663004c640 1 -- 172.21.15.52:0/889193473 shutdown_connections 2024-09-06T15:04:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.667+0000 7f663004c640 1 --2- 172.21.15.52:0/889193473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628101000 0x7f662810dcc0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.667+0000 7f663004c640 1 --2- 172.21.15.52:0/889193473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6628100650 0x7f6628100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.667+0000 7f663004c640 1 -- 172.21.15.52:0/889193473 >> 172.21.15.52:0/889193473 conn(0x7f66280fc520 msgr2=0x7f66280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 -- 172.21.15.52:0/889193473 shutdown_connections 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 -- 172.21.15.52:0/889193473 wait complete. 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 Processor -- start 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 -- start start 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628100650 0x7f662819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6628101000 0x7f662819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6628110f90 con 0x7f6628100650 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.668+0000 7f663004c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6628110e10 con 0x7f6628101000 2024-09-06T15:04:12.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662dde8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628100650 0x7f662819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662dde8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628100650 0x7f662819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35064/0 (socket says 172.21.15.52:35064) 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662dde8640 1 -- 172.21.15.52:0/3944962660 learned_addr learned my addr 172.21.15.52:0/3944962660 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662d5e7640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6628101000 0x7f662819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662dde8640 1 -- 172.21.15.52:0/3944962660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6628101000 msgr2=0x7f662819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662dde8640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6628101000 0x7f662819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662dde8640 1 -- 172.21.15.52:0/3944962660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6628199a20 con 0x7f6628100650 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f662dde8640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628100650 0x7f662819f860 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f661800ea00 tx=0x7f661800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f6626ffd640 1 -- 172.21.15.52:0/3944962660 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f661800cb80 con 0x7f6628100650 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f6626ffd640 1 -- 172.21.15.52:0/3944962660 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f661800cd20 con 0x7f6628100650 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6628199d10 con 0x7f6628100650 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f6626ffd640 1 -- 172.21.15.52:0/3944962660 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6618011470 con 0x7f6628100650 2024-09-06T15:04:12.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.669+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662819a270 con 0x7f6628100650 2024-09-06T15:04:12.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.670+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662806aa90 con 0x7f6628100650 2024-09-06T15:04:12.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.671+0000 7f6626ffd640 1 -- 172.21.15.52:0/3944962660 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6618011770 con 0x7f6628100650 2024-09-06T15:04:12.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.672+0000 7f6626ffd640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6610077460 0x7f6610079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.672+0000 7f6626ffd640 1 -- 172.21.15.52:0/3944962660 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f6618099960 con 0x7f6628100650 2024-09-06T15:04:12.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.672+0000 7f662d5e7640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6610077460 0x7f6610079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.672+0000 7f662d5e7640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6610077460 0x7f6610079920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f662819b210 tx=0x7f661c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:12.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.676+0000 7f6626ffd640 1 -- 172.21.15.52:0/3944962660 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6618016030 con 0x7f6628100650 2024-09-06T15:04:12.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.854+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f662819af50 con 0x7f6610077460 2024-09-06T15:04:12.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.856+0000 7f6626ffd640 1 -- 172.21.15.52:0/3944962660 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f662819af50 con 0x7f6610077460 2024-09-06T15:04:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6610077460 msgr2=0x7f6610079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6610077460 0x7f6610079920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f662819b210 tx=0x7f661c031400 comp rx=0 tx=0).stop 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628100650 msgr2=0x7f662819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628100650 0x7f662819f860 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f661800ea00 tx=0x7f661800eec0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 shutdown_connections 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6610077460 0x7f6610079920 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6628101000 0x7f662819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 --2- 172.21.15.52:0/3944962660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6628100650 0x7f662819f860 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 >> 172.21.15.52:0/3944962660 conn(0x7f66280fc520 msgr2=0x7f66280fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.858+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 shutdown_connections 2024-09-06T15:04:12.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.859+0000 7f663004c640 1 -- 172.21.15.52:0/3944962660 wait complete. 2024-09-06T15:04:12.945 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 -- 172.21.15.52:0/220008240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 msgr2=0x7fe030100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 --2- 172.21.15.52:0/220008240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe030100a30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe020009880 tx=0x7fe02002a490 comp rx=0 tx=0).stop 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 -- 172.21.15.52:0/220008240 shutdown_connections 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 --2- 172.21.15.52:0/220008240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe030101000 0x7fe03010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 --2- 172.21.15.52:0/220008240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe030100a30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 -- 172.21.15.52:0/220008240 >> 172.21.15.52:0/220008240 conn(0x7fe0300fc520 msgr2=0x7fe0300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 -- 172.21.15.52:0/220008240 shutdown_connections 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.945+0000 7fe036368640 1 -- 172.21.15.52:0/220008240 wait complete. 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe036368640 1 Processor -- start 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe036368640 1 -- start start 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe036368640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe03019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe036368640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe030101000 0x7fe03019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe036368640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe030110fb0 con 0x7fe030100650 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe036368640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe030110e30 con 0x7fe030101000 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe02ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe03019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe02ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe03019f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35076/0 (socket says 172.21.15.52:35076) 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe02ffff640 1 -- 172.21.15.52:0/628644887 learned_addr learned my addr 172.21.15.52:0/628644887 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe027fff640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe030101000 0x7fe03019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe02ffff640 1 -- 172.21.15.52:0/628644887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe030101000 msgr2=0x7fe03019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe02ffff640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe030101000 0x7fe03019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.946+0000 7fe02ffff640 1 -- 172.21.15.52:0/628644887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe030199a40 con 0x7fe030100650 2024-09-06T15:04:12.947 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.947+0000 7fe02ffff640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe03019f880 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe020031460 tx=0x7fe0200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.947+0000 7fe02dffb640 1 -- 172.21.15.52:0/628644887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe02003f070 con 0x7fe030100650 2024-09-06T15:04:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.947+0000 7fe02dffb640 1 -- 172.21.15.52:0/628644887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0200035f0 con 0x7fe030100650 2024-09-06T15:04:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.947+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe030199cd0 con 0x7fe030100650 2024-09-06T15:04:12.948 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.947+0000 7fe02dffb640 1 -- 172.21.15.52:0/628644887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe020035030 con 0x7fe030100650 2024-09-06T15:04:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.947+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03019a260 con 0x7fe030100650 2024-09-06T15:04:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.948+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03006aa90 con 0x7fe030100650 2024-09-06T15:04:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.948+0000 7fe02dffb640 1 -- 172.21.15.52:0/628644887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe020042070 con 0x7fe030100650 2024-09-06T15:04:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.949+0000 7fe02dffb640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe01c0774b0 0x7fe01c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.949+0000 7fe027fff640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe01c0774b0 0x7fe01c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.949+0000 7fe02dffb640 1 -- 172.21.15.52:0/628644887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe0200ba010 con 0x7fe030100650 2024-09-06T15:04:12.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.950+0000 7fe027fff640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe01c0774b0 0x7fe01c079970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe030102520 tx=0x7fe01800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:12.953 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:12.953+0000 7fe02dffb640 1 -- 172.21.15.52:0/628644887 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe020087160 con 0x7fe030100650 2024-09-06T15:04:13.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.121+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe03019af70 con 0x7fe01c0774b0 2024-09-06T15:04:13.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.131+0000 7fe02dffb640 1 -- 172.21.15.52:0/628644887 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe03019af70 con 0x7fe01c0774b0 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (16m) 10m ago 27m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (19m) 10m ago 27m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (18m) 10m ago 26m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (14m) 10m ago 27m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (14m) 10m ago 26m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (16m) 10m ago 27m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (11m) 10m ago 22m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:04:13.131 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (11m) 10m ago 22m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (10m) 10m ago 22m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (10m) 10m ago 22m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (18m) 10m ago 28m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (17m) 10m ago 26m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (15m) 10m ago 28m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (15m) 10m ago 26m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (17m) 10m ago 27m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (17m) 10m ago 26m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (14m) 10m ago 25m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:04:13.132 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (13m) 10m ago 25m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:04:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (13m) 10m ago 24m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:04:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (12m) 10m ago 24m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:04:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (12m) 10m ago 23m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:04:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (11m) 10m ago 23m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:04:13.133 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (16m) 10m ago 27m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:04:13.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe01c0774b0 msgr2=0x7fe01c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe01c0774b0 0x7fe01c079970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe030102520 tx=0x7fe01800b390 comp rx=0 tx=0).stop 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 msgr2=0x7fe03019f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe03019f880 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe020031460 tx=0x7fe0200045e0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 shutdown_connections 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe01c0774b0 0x7fe01c079970 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe030101000 0x7fe03019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 --2- 172.21.15.52:0/628644887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe030100650 0x7fe03019f880 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 >> 172.21.15.52:0/628644887 conn(0x7fe0300fc520 msgr2=0x7fe0300fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 shutdown_connections 2024-09-06T15:04:13.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.133+0000 7fe036368640 1 -- 172.21.15.52:0/628644887 wait complete. 2024-09-06T15:04:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 -- 172.21.15.52:0/2960401764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 msgr2=0x7f2a40106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 --2- 172.21.15.52:0/2960401764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40106bd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009c20 tx=0x7f2a3002a970 comp rx=0 tx=0).stop 2024-09-06T15:04:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 -- 172.21.15.52:0/2960401764 shutdown_connections 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 --2- 172.21.15.52:0/2960401764 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a401007f0 0x7f2a40100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 --2- 172.21.15.52:0/2960401764 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40106bd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 -- 172.21.15.52:0/2960401764 >> 172.21.15.52:0/2960401764 conn(0x7f2a400fc4d0 msgr2=0x7f2a400fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 -- 172.21.15.52:0/2960401764 shutdown_connections 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.218+0000 7f2a46c54640 1 -- 172.21.15.52:0/2960401764 wait complete. 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a46c54640 1 Processor -- start 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a46c54640 1 -- start start 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a46c54640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a401007f0 0x7f2a40107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a46c54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a46c54640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4010dca0 con 0x7f2a401067f0 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a46c54640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4010db20 con 0x7f2a401007f0 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a3ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a3ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35088/0 (socket says 172.21.15.52:35088) 2024-09-06T15:04:13.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.219+0000 7f2a3ffff640 1 -- 172.21.15.52:0/3536263161 learned_addr learned my addr 172.21.15.52:0/3536263161 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a449f0640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a401007f0 0x7f2a40107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a3ffff640 1 -- 172.21.15.52:0/3536263161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a401007f0 msgr2=0x7f2a40107720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a3ffff640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a401007f0 0x7f2a40107720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a3ffff640 1 -- 172.21.15.52:0/3536263161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a401081a0 con 0x7f2a401067f0 2024-09-06T15:04:13.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a3ffff640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40107c60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400d8d0 tx=0x7f2a3400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a3dffb640 1 -- 172.21.15.52:0/3536263161 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a34017070 con 0x7f2a401067f0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a3dffb640 1 -- 172.21.15.52:0/3536263161 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a34010460 con 0x7f2a401067f0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a40108490 con 0x7f2a401067f0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a3dffb640 1 -- 172.21.15.52:0/3536263161 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a3400f5f0 con 0x7f2a401067f0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.220+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a401a3e00 con 0x7f2a401067f0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.221+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a40101f30 con 0x7f2a401067f0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.222+0000 7f2a3dffb640 1 -- 172.21.15.52:0/3536263161 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2a34009a30 con 0x7f2a401067f0 2024-09-06T15:04:13.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.223+0000 7f2a3dffb640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a28077460 0x7f2a28079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.223+0000 7f2a3dffb640 1 -- 172.21.15.52:0/3536263161 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f2a340996b0 con 0x7f2a401067f0 2024-09-06T15:04:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.223+0000 7f2a449f0640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a28077460 0x7f2a28079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.223+0000 7f2a449f0640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a28077460 0x7f2a28079920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005fc0 tx=0x7f2a30005f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:13.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.227+0000 7f2a3dffb640 1 -- 172.21.15.52:0/3536263161 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f2a34062610 con 0x7f2a401067f0 2024-09-06T15:04:13.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.447+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2a401a4090 con 0x7f2a401067f0 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.448+0000 7f2a3dffb640 1 -- 172.21.15.52:0/3536263161 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2a34066780 con 0x7f2a401067f0 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:13.447 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:04:13.448 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.449+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a28077460 msgr2=0x7f2a28079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.449+0000 7f2a46c54640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a28077460 0x7f2a28079920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005fc0 tx=0x7f2a30005f30 comp rx=0 tx=0).stop 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.449+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 msgr2=0x7f2a40107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.449+0000 7f2a46c54640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40107c60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400d8d0 tx=0x7f2a3400dd90 comp rx=0 tx=0).stop 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.450+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 shutdown_connections 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.450+0000 7f2a46c54640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2a401067f0 0x7f2a40107c60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.450+0000 7f2a46c54640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2a28077460 0x7f2a28079920 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.450+0000 7f2a46c54640 1 --2- 172.21.15.52:0/3536263161 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2a401007f0 0x7f2a40107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.450+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 >> 172.21.15.52:0/3536263161 conn(0x7f2a400fc4d0 msgr2=0x7f2a4006a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:13.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.450+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 shutdown_connections 2024-09-06T15:04:13.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.450+0000 7f2a46c54640 1 -- 172.21.15.52:0/3536263161 wait complete. 2024-09-06T15:04:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 -- 172.21.15.52:0/4100941540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774101900 msgr2=0x7f1774101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4100941540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774101900 0x7f1774101d60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1768009880 tx=0x7f176802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 -- 172.21.15.52:0/4100941540 shutdown_connections 2024-09-06T15:04:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4100941540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774101900 0x7f1774101d60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4100941540 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1774107900 0x7f1774107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 -- 172.21.15.52:0/4100941540 >> 172.21.15.52:0/4100941540 conn(0x7f17740fd600 msgr2=0x7f17740ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 -- 172.21.15.52:0/4100941540 shutdown_connections 2024-09-06T15:04:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.532+0000 7f1778dc0640 1 -- 172.21.15.52:0/4100941540 wait complete. 2024-09-06T15:04:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.533+0000 7f1778dc0640 1 Processor -- start 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.533+0000 7f1778dc0640 1 -- start start 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1778dc0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1774101900 0x7f177419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1778dc0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774107900 0x7f177419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1778dc0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f177410edd0 con 0x7f1774107900 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1778dc0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f177410ec50 con 0x7f1774101900 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1771d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774107900 0x7f177419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1771d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774107900 0x7f177419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35106/0 (socket says 172.21.15.52:35106) 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1771d9b640 1 -- 172.21.15.52:0/4130766214 learned_addr learned my addr 172.21.15.52:0/4130766214 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f177259c640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1774101900 0x7f177419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1771d9b640 1 -- 172.21.15.52:0/4130766214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1774101900 msgr2=0x7f177419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1771d9b640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1774101900 0x7f177419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1771d9b640 1 -- 172.21.15.52:0/4130766214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1774197800 con 0x7f1774107900 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.534+0000 7f1771d9b640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774107900 0x7f177419dbc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1768031460 tx=0x7f1768004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.535+0000 7f17637fe640 1 -- 172.21.15.52:0/4130766214 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f176803f070 con 0x7f1774107900 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.535+0000 7f17637fe640 1 -- 172.21.15.52:0/4130766214 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17680035f0 con 0x7f1774107900 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.535+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1774197a90 con 0x7f1774107900 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.535+0000 7f17637fe640 1 -- 172.21.15.52:0/4130766214 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1768035030 con 0x7f1774107900 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.535+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1774197fc0 con 0x7f1774107900 2024-09-06T15:04:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.536+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1754005290 con 0x7f1774107900 2024-09-06T15:04:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.537+0000 7f17637fe640 1 -- 172.21.15.52:0/4130766214 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1768042070 con 0x7f1774107900 2024-09-06T15:04:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.537+0000 7f17637fe640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f175c0774b0 0x7f175c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.538+0000 7f17637fe640 1 -- 172.21.15.52:0/4130766214 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f17680b9f80 con 0x7f1774107900 2024-09-06T15:04:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.538+0000 7f177259c640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f175c0774b0 0x7f175c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.537 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.538+0000 7f177259c640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f175c0774b0 0x7f175c079970 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1764009b60 tx=0x7f1764005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:13.541 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.542+0000 7f17637fe640 1 -- 172.21.15.52:0/4130766214 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1768082f60 con 0x7f1774107900 2024-09-06T15:04:13.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.726+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1754005d90 con 0x7f1774107900 2024-09-06T15:04:13.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.726+0000 7f17637fe640 1 -- 172.21.15.52:0/4130766214 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f176808b410 con 0x7f1774107900 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:04:13.726 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:04:13.727 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:04:13.728 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:13.729 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:04:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f175c0774b0 msgr2=0x7f175c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f175c0774b0 0x7f175c079970 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1764009b60 tx=0x7f1764005f90 comp rx=0 tx=0).stop 2024-09-06T15:04:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774107900 msgr2=0x7f177419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774107900 0x7f177419dbc0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1768031460 tx=0x7f1768004530 comp rx=0 tx=0).stop 2024-09-06T15:04:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 shutdown_connections 2024-09-06T15:04:13.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1774107900 0x7f177419dbc0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f175c0774b0 0x7f175c079970 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 --2- 172.21.15.52:0/4130766214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1774101900 0x7f177419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.728+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 >> 172.21.15.52:0/4130766214 conn(0x7f17740fd600 msgr2=0x7f17740fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.729+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 shutdown_connections 2024-09-06T15:04:13.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.729+0000 7f1778dc0640 1 -- 172.21.15.52:0/4130766214 wait complete. 2024-09-06T15:04:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 -- 172.21.15.52:0/3942792625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 msgr2=0x7f4c20105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 --2- 172.21.15.52:0/3942792625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c20105480 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009880 tx=0x7f4c1402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 -- 172.21.15.52:0/3942792625 shutdown_connections 2024-09-06T15:04:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 --2- 172.21.15.52:0/3942792625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c20105480 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 --2- 172.21.15.52:0/3942792625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c201011f0 0x7f4c201015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.812 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 -- 172.21.15.52:0/3942792625 >> 172.21.15.52:0/3942792625 conn(0x7f4c200fbc90 msgr2=0x7f4c200fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 -- 172.21.15.52:0/3942792625 shutdown_connections 2024-09-06T15:04:13.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.812+0000 7f4c26258640 1 -- 172.21.15.52:0/3942792625 wait complete. 2024-09-06T15:04:13.813 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:13 smithi052 ceph-mon[112917]: pgmap v599: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:13.813 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:13 smithi052 ceph-mon[112917]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:13.813 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:13 smithi052 ceph-mon[112917]: from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:13.813 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:13 smithi052 ceph-mon[112917]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:13.813 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:13 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3536263161' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.813+0000 7f4c26258640 1 Processor -- start 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.813+0000 7f4c26258640 1 -- start start 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.813+0000 7f4c26258640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c201011f0 0x7f4c2019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.813+0000 7f4c26258640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c2019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.813+0000 7f4c26258640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2010dd40 con 0x7f4c20101ba0 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.813+0000 7f4c26258640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2010dbc0 con 0x7f4c201011f0 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c2019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c2019fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35132/0 (socket says 172.21.15.52:35132) 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1effd640 1 -- 172.21.15.52:0/1490486697 learned_addr learned my addr 172.21.15.52:0/1490486697 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1f7fe640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c201011f0 0x7f4c2019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1effd640 1 -- 172.21.15.52:0/1490486697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c201011f0 msgr2=0x7f4c2019f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1effd640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c201011f0 0x7f4c2019f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1effd640 1 -- 172.21.15.52:0/1490486697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c20199a30 con 0x7f4c20101ba0 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1effd640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c2019fdb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4c14031460 tx=0x7f4c140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1cff9640 1 -- 172.21.15.52:0/1490486697 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c1403f070 con 0x7f4c20101ba0 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1cff9640 1 -- 172.21.15.52:0/1490486697 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c140035f0 con 0x7f4c20101ba0 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c20199cc0 con 0x7f4c20101ba0 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c1cff9640 1 -- 172.21.15.52:0/1490486697 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c14035030 con 0x7f4c20101ba0 2024-09-06T15:04:13.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.814+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2019a1f0 con 0x7f4c20101ba0 2024-09-06T15:04:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.816+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c201021b0 con 0x7f4c20101ba0 2024-09-06T15:04:13.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.816+0000 7f4c1cff9640 1 -- 172.21.15.52:0/1490486697 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4c14042070 con 0x7f4c20101ba0 2024-09-06T15:04:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.817+0000 7f4c1cff9640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4c08077460 0x7f4c08079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.817+0000 7f4c1f7fe640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4c08077460 0x7f4c08079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.817+0000 7f4c1cff9640 1 -- 172.21.15.52:0/1490486697 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4c140ba1d0 con 0x7f4c20101ba0 2024-09-06T15:04:13.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.817+0000 7f4c1f7fe640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4c08077460 0x7f4c08079920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c2019ab70 tx=0x7f4c1000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:13.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.821+0000 7f4c1cff9640 1 -- 172.21.15.52:0/1490486697 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4c14087200 con 0x7f4c20101ba0 2024-09-06T15:04:13.997 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.998+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4c2019af60 con 0x7f4c08077460 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:13.999+0000 7f4c1cff9640 1 -- 172.21.15.52:0/1490486697 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4c2019af60 con 0x7f4c08077460 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:04:13.999 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:04:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:04:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:04:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:04:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:04:14.000 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:04:14.000 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:04:14.000 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4c08077460 msgr2=0x7f4c08079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4c08077460 0x7f4c08079920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4c2019ab70 tx=0x7f4c1000b390 comp rx=0 tx=0).stop 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 msgr2=0x7f4c2019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c2019fdb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4c14031460 tx=0x7f4c140045e0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 shutdown_connections 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c20101ba0 0x7f4c2019fdb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4c08077460 0x7f4c08079920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 --2- 172.21.15.52:0/1490486697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4c201011f0 0x7f4c2019f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.001+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 >> 172.21.15.52:0/1490486697 conn(0x7f4c200fbc90 msgr2=0x7f4c201043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.002+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 shutdown_connections 2024-09-06T15:04:14.001 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.002+0000 7f4c26258640 1 -- 172.21.15.52:0/1490486697 wait complete. 2024-09-06T15:04:14.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:13 smithi165 ceph-mon[82925]: pgmap v599: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:14.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:13 smithi165 ceph-mon[82925]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:14.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:13 smithi165 ceph-mon[82925]: from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:14.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:13 smithi165 ceph-mon[82925]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:14.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:13 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3536263161' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.084+0000 7f800ff52640 1 -- 172.21.15.52:0/2360400843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101900 msgr2=0x7f8008101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.084+0000 7f800ff52640 1 --2- 172.21.15.52:0/2360400843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101900 0x7f8008101d60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009880 tx=0x7f7ffc02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 -- 172.21.15.52:0/2360400843 shutdown_connections 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 --2- 172.21.15.52:0/2360400843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101900 0x7f8008101d60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 --2- 172.21.15.52:0/2360400843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8008107900 0x7f8008107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 -- 172.21.15.52:0/2360400843 >> 172.21.15.52:0/2360400843 conn(0x7f80080fd620 msgr2=0x7f80080ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 -- 172.21.15.52:0/2360400843 shutdown_connections 2024-09-06T15:04:14.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 -- 172.21.15.52:0/2360400843 wait complete. 2024-09-06T15:04:14.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 Processor -- start 2024-09-06T15:04:14.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.085+0000 7f800ff52640 1 -- start start 2024-09-06T15:04:14.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800ff52640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8008101900 0x7f800819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:14.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800ff52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008107900 0x7f800819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:14.086 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800ff52640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f800810edd0 con 0x7f8008107900 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800ff52640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f800810ec50 con 0x7f8008101900 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800d4ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008107900 0x7f800819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800d4ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008107900 0x7f800819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35152/0 (socket says 172.21.15.52:35152) 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800dcee640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8008101900 0x7f800819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800d4ed640 1 -- 172.21.15.52:0/4258015542 learned_addr learned my addr 172.21.15.52:0/4258015542 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800d4ed640 1 -- 172.21.15.52:0/4258015542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8008101900 msgr2=0x7f800819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800d4ed640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8008101900 0x7f800819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800d4ed640 1 -- 172.21.15.52:0/4258015542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8008197820 con 0x7f8008107900 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.086+0000 7f800d4ed640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008107900 0x7f800819dbe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc031460 tx=0x7f7ffc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.087+0000 7f8006ffd640 1 -- 172.21.15.52:0/4258015542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ffc03f070 con 0x7f8008107900 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.087+0000 7f8006ffd640 1 -- 172.21.15.52:0/4258015542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ffc0035f0 con 0x7f8008107900 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.087+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8008197ab0 con 0x7f8008107900 2024-09-06T15:04:14.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.087+0000 7f8006ffd640 1 -- 172.21.15.52:0/4258015542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ffc035030 con 0x7f8008107900 2024-09-06T15:04:14.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.087+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8008197fe0 con 0x7f8008107900 2024-09-06T15:04:14.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.088+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8008103040 con 0x7f8008107900 2024-09-06T15:04:14.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.089+0000 7f8006ffd640 1 -- 172.21.15.52:0/4258015542 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7ffc042070 con 0x7f8008107900 2024-09-06T15:04:14.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.090+0000 7f8006ffd640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ff0077460 0x7f7ff0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:14.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.090+0000 7f8006ffd640 1 -- 172.21.15.52:0/4258015542 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7ffc0ba0f0 con 0x7f8008107900 2024-09-06T15:04:14.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.090+0000 7f800dcee640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ff0077460 0x7f7ff0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:14.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.090+0000 7f800dcee640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ff0077460 0x7f7ff0079920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8000005fd0 tx=0x7f8000009500 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:14.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.094+0000 7f8006ffd640 1 -- 172.21.15.52:0/4258015542 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7ffc087160 con 0x7f8008107900 2024-09-06T15:04:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.314+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8008109e70 con 0x7f8008107900 2024-09-06T15:04:14.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.315+0000 7f8006ffd640 1 -- 172.21.15.52:0/4258015542 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f7ffc08bb80 con 0x7f8008107900 2024-09-06T15:04:14.314 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:04:14.315 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:04:14.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ff0077460 msgr2=0x7f7ff0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ff0077460 0x7f7ff0079920 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8000005fd0 tx=0x7f8000009500 comp rx=0 tx=0).stop 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008107900 msgr2=0x7f800819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008107900 0x7f800819dbe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc031460 tx=0x7f7ffc004530 comp rx=0 tx=0).stop 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 shutdown_connections 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008107900 0x7f800819dbe0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7ff0077460 0x7f7ff0079920 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 --2- 172.21.15.52:0/4258015542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8008101900 0x7f800819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 >> 172.21.15.52:0/4258015542 conn(0x7f80080fd620 msgr2=0x7f80080fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 shutdown_connections 2024-09-06T15:04:14.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:14.317+0000 7f800ff52640 1 -- 172.21.15.52:0/4258015542 wait complete. 2024-09-06T15:04:14.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:14 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4130766214' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:04:14.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:14 smithi052 ceph-mon[112917]: from='client.34962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:14.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:14 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4258015542' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:04:15.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:14 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4130766214' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:04:15.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:14 smithi165 ceph-mon[82925]: from='client.34962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:15.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:14 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4258015542' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:04:15.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:15 smithi052 ceph-mon[112917]: pgmap v600: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:16.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:15 smithi165 ceph-mon[82925]: pgmap v600: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:17.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:17 smithi052 ceph-mon[112917]: pgmap v601: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:17.960 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:17 smithi165 ceph-mon[82925]: pgmap v601: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:20.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:19 smithi165 ceph-mon[82925]: pgmap v602: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:20.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:19 smithi052 ceph-mon[112917]: pgmap v602: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:22.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:21 smithi165 ceph-mon[82925]: pgmap v603: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:22.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:21 smithi052 ceph-mon[112917]: pgmap v603: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:22.975 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:23.037 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:24.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:23 smithi165 ceph-mon[82925]: pgmap v604: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:24.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:23 smithi052 ceph-mon[112917]: pgmap v604: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:25 smithi052 ceph-mon[112917]: pgmap v605: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:25 smithi165 ceph-mon[82925]: pgmap v605: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:28.051 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:27 smithi052 ceph-mon[112917]: pgmap v606: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:28.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:27 smithi165 ceph-mon[82925]: pgmap v606: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:30.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:29 smithi165 ceph-mon[82925]: pgmap v607: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:30.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:29 smithi052 ceph-mon[112917]: pgmap v607: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:32.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:31 smithi165 ceph-mon[82925]: pgmap v608: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:32.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:31 smithi052 ceph-mon[112917]: pgmap v608: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:34.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:33 smithi165 ceph-mon[82925]: pgmap v609: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:34.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:33 smithi052 ceph-mon[112917]: pgmap v609: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:35.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:35 smithi052 ceph-mon[112917]: pgmap v610: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:36.074 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:35 smithi165 ceph-mon[82925]: pgmap v610: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:38.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:37 smithi165 ceph-mon[82925]: pgmap v611: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:38.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:37 smithi052 ceph-mon[112917]: pgmap v611: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:40.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:39 smithi165 ceph-mon[82925]: pgmap v612: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:40.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:39 smithi052 ceph-mon[112917]: pgmap v612: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:42.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:41 smithi165 ceph-mon[82925]: pgmap v613: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:42.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:41 smithi052 ceph-mon[112917]: pgmap v613: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:44.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:43 smithi165 ceph-mon[82925]: pgmap v614: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:44.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:43 smithi052 ceph-mon[112917]: pgmap v614: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:44.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.413+0000 7f9bddbff640 1 -- 172.21.15.52:0/2427377807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8101900 msgr2=0x7f9bd8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.413+0000 7f9bddbff640 1 --2- 172.21.15.52:0/2427377807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8101900 0x7f9bd8101d60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009880 tx=0x7f9bcc02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.413+0000 7f9bddbff640 1 -- 172.21.15.52:0/2427377807 shutdown_connections 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.413+0000 7f9bddbff640 1 --2- 172.21.15.52:0/2427377807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8101900 0x7f9bd8101d60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.413+0000 7f9bddbff640 1 --2- 172.21.15.52:0/2427377807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bd8107900 0x7f9bd8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.413+0000 7f9bddbff640 1 -- 172.21.15.52:0/2427377807 >> 172.21.15.52:0/2427377807 conn(0x7f9bd80fd600 msgr2=0x7f9bd80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.413+0000 7f9bddbff640 1 -- 172.21.15.52:0/2427377807 shutdown_connections 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.414+0000 7f9bddbff640 1 -- 172.21.15.52:0/2427377807 wait complete. 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.414+0000 7f9bddbff640 1 Processor -- start 2024-09-06T15:04:44.414 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.414+0000 7f9bddbff640 1 -- start start 2024-09-06T15:04:44.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bddbff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bd8101900 0x7f9bd819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bddbff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8107900 0x7f9bd819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bddbff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd810edd0 con 0x7f9bd8107900 2024-09-06T15:04:44.415 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bddbff640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd810ec50 con 0x7f9bd8101900 2024-09-06T15:04:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8107900 0x7f9bd819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8107900 0x7f9bd819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47126/0 (socket says 172.21.15.52:47126) 2024-09-06T15:04:44.416 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd6ffd640 1 -- 172.21.15.52:0/936512334 learned_addr learned my addr 172.21.15.52:0/936512334 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd77fe640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bd8101900 0x7f9bd819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd6ffd640 1 -- 172.21.15.52:0/936512334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bd8101900 msgr2=0x7f9bd819f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd6ffd640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bd8101900 0x7f9bd819f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd6ffd640 1 -- 172.21.15.52:0/936512334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd81999d0 con 0x7f9bd8107900 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd6ffd640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8107900 0x7f9bd819fd50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc031460 tx=0x7f9bcc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.415+0000 7f9bd4ff9640 1 -- 172.21.15.52:0/936512334 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bcc03f070 con 0x7f9bd8107900 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.416+0000 7f9bd4ff9640 1 -- 172.21.15.52:0/936512334 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9bcc0035f0 con 0x7f9bd8107900 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.416+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd8199c60 con 0x7f9bd8107900 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.416+0000 7f9bd4ff9640 1 -- 172.21.15.52:0/936512334 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bcc035030 con 0x7f9bd8107900 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.416+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd819a190 con 0x7f9bd8107900 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.417+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd8103040 con 0x7f9bd8107900 2024-09-06T15:04:44.417 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.417+0000 7f9bd4ff9640 1 -- 172.21.15.52:0/936512334 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9bcc042070 con 0x7f9bd8107900 2024-09-06T15:04:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.418+0000 7f9bd4ff9640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9bc0077460 0x7f9bc0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.418+0000 7f9bd4ff9640 1 -- 172.21.15.52:0/936512334 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9bcc0ba110 con 0x7f9bd8107900 2024-09-06T15:04:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.418+0000 7f9bd77fe640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9bc0077460 0x7f9bc0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.418 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.418+0000 7f9bd77fe640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9bc0077460 0x7f9bc0079920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9bd819ab10 tx=0x7f9bc800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:44.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.422+0000 7f9bd4ff9640 1 -- 172.21.15.52:0/936512334 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9bcc0871e0 con 0x7f9bd8107900 2024-09-06T15:04:44.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.599+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9bd819afa0 con 0x7f9bc0077460 2024-09-06T15:04:44.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.600+0000 7f9bd4ff9640 1 -- 172.21.15.52:0/936512334 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9bd819afa0 con 0x7f9bc0077460 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9bc0077460 msgr2=0x7f9bc0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9bc0077460 0x7f9bc0079920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9bd819ab10 tx=0x7f9bc800b390 comp rx=0 tx=0).stop 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8107900 msgr2=0x7f9bd819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8107900 0x7f9bd819fd50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc031460 tx=0x7f9bcc0045e0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 shutdown_connections 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9bd8107900 0x7f9bd819fd50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9bc0077460 0x7f9bc0079920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 --2- 172.21.15.52:0/936512334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9bd8101900 0x7f9bd819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 >> 172.21.15.52:0/936512334 conn(0x7f9bd80fd600 msgr2=0x7f9bd8074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:44.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 shutdown_connections 2024-09-06T15:04:44.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.602+0000 7f9bddbff640 1 -- 172.21.15.52:0/936512334 wait complete. 2024-09-06T15:04:44.610 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:04:44.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 -- 172.21.15.52:0/335979307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 msgr2=0x7f3728101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 --2- 172.21.15.52:0/335979307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f3728101d60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f371c009880 tx=0x7f371c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 -- 172.21.15.52:0/335979307 shutdown_connections 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 --2- 172.21.15.52:0/335979307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f3728101d60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 --2- 172.21.15.52:0/335979307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3728107900 0x7f3728107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 -- 172.21.15.52:0/335979307 >> 172.21.15.52:0/335979307 conn(0x7f37280fd600 msgr2=0x7f37280ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 -- 172.21.15.52:0/335979307 shutdown_connections 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 -- 172.21.15.52:0/335979307 wait complete. 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.688+0000 7f372ec81640 1 Processor -- start 2024-09-06T15:04:44.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ec81640 1 -- start start 2024-09-06T15:04:44.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ec81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f372819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ec81640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3728107900 0x7f372819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ec81640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f372810ee30 con 0x7f3728101900 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ec81640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f372810ecb0 con 0x7f3728107900 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ca1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f372819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ca1d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f372819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47136/0 (socket says 172.21.15.52:47136) 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ca1d640 1 -- 172.21.15.52:0/1471622992 learned_addr learned my addr 172.21.15.52:0/1471622992 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ca1d640 1 -- 172.21.15.52:0/1471622992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3728107900 msgr2=0x7f372819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ca1d640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3728107900 0x7f372819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ca1d640 1 -- 172.21.15.52:0/1471622992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3728197840 con 0x7f3728101900 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f372ca1d640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f372819d6c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f371800b420 tx=0x7f371800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.689+0000 7f3725ffb640 1 -- 172.21.15.52:0/1471622992 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3718011630 con 0x7f3728101900 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.690+0000 7f3725ffb640 1 -- 172.21.15.52:0/1471622992 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3718016070 con 0x7f3728101900 2024-09-06T15:04:44.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.690+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3728197b30 con 0x7f3728101900 2024-09-06T15:04:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.690+0000 7f3725ffb640 1 -- 172.21.15.52:0/1471622992 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3718010d40 con 0x7f3728101900 2024-09-06T15:04:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.690+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281980c0 con 0x7f3728101900 2024-09-06T15:04:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.691+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3728103040 con 0x7f3728101900 2024-09-06T15:04:44.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.691+0000 7f3725ffb640 1 -- 172.21.15.52:0/1471622992 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f371801b460 con 0x7f3728101900 2024-09-06T15:04:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.692+0000 7f3725ffb640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37100774b0 0x7f3710079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.692+0000 7f3725ffb640 1 -- 172.21.15.52:0/1471622992 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3718098ea0 con 0x7f3728101900 2024-09-06T15:04:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.692+0000 7f3727fff640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37100774b0 0x7f3710079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.692 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.692+0000 7f3727fff640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37100774b0 0x7f3710079970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f371c0096c0 tx=0x7f371c000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:44.695 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.696+0000 7f3725ffb640 1 -- 172.21.15.52:0/1471622992 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3718061e80 con 0x7f3728101900 2024-09-06T15:04:44.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.872+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f37281983d0 con 0x7f37100774b0 2024-09-06T15:04:44.872 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.873+0000 7f3725ffb640 1 -- 172.21.15.52:0/1471622992 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f37281983d0 con 0x7f37100774b0 2024-09-06T15:04:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37100774b0 msgr2=0x7f3710079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37100774b0 0x7f3710079970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f371c0096c0 tx=0x7f371c000bc0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 msgr2=0x7f372819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f372819d6c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f371800b420 tx=0x7f371800b8e0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 shutdown_connections 2024-09-06T15:04:44.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37100774b0 0x7f3710079970 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3728107900 0x7f372819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 --2- 172.21.15.52:0/1471622992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3728101900 0x7f372819d6c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 >> 172.21.15.52:0/1471622992 conn(0x7f37280fd600 msgr2=0x7f37280fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 shutdown_connections 2024-09-06T15:04:44.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.875+0000 7f372ec81640 1 -- 172.21.15.52:0/1471622992 wait complete. 2024-09-06T15:04:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 -- 172.21.15.52:0/3728933401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 msgr2=0x7f91c8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 --2- 172.21.15.52:0/3728933401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c8101d60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f91b4009880 tx=0x7f91b402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 -- 172.21.15.52:0/3728933401 shutdown_connections 2024-09-06T15:04:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 --2- 172.21.15.52:0/3728933401 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c8101d60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 --2- 172.21.15.52:0/3728933401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c8107900 0x7f91c8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 -- 172.21.15.52:0/3728933401 >> 172.21.15.52:0/3728933401 conn(0x7f91c80fd620 msgr2=0x7f91c80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 -- 172.21.15.52:0/3728933401 shutdown_connections 2024-09-06T15:04:44.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.958+0000 7f91cf116640 1 -- 172.21.15.52:0/3728933401 wait complete. 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cf116640 1 Processor -- start 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cf116640 1 -- start start 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cf116640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cf116640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c8107900 0x7f91c819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cf116640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91c810edd0 con 0x7f91c8101900 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cf116640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f91c810ec50 con 0x7f91c8107900 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cceb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cceb2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47150/0 (socket says 172.21.15.52:47150) 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cceb2640 1 -- 172.21.15.52:0/3901421342 learned_addr learned my addr 172.21.15.52:0/3901421342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:44.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91c7fff640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c8107900 0x7f91c819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cceb2640 1 -- 172.21.15.52:0/3901421342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c8107900 msgr2=0x7f91c819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cceb2640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c8107900 0x7f91c819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91cceb2640 1 -- 172.21.15.52:0/3901421342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8197820 con 0x7f91c8101900 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.959+0000 7f91c7fff640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c8107900 0x7f91c819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.960+0000 7f91cceb2640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c819d6a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00d6f0 tx=0x7f91bc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.960+0000 7f91c5ffb640 1 -- 172.21.15.52:0/3901421342 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91bc017070 con 0x7f91c8101900 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.960+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c8197b10 con 0x7f91c8101900 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.960+0000 7f91c5ffb640 1 -- 172.21.15.52:0/3901421342 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91bc00de00 con 0x7f91c8101900 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.960+0000 7f91c5ffb640 1 -- 172.21.15.52:0/3901421342 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91bc004bb0 con 0x7f91c8101900 2024-09-06T15:04:44.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.960+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81980a0 con 0x7f91c8101900 2024-09-06T15:04:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.961+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c8103040 con 0x7f91c8101900 2024-09-06T15:04:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.962+0000 7f91c5ffb640 1 -- 172.21.15.52:0/3901421342 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f91bc004e60 con 0x7f91c8101900 2024-09-06T15:04:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.962+0000 7f91c5ffb640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91b8077460 0x7f91b8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:44.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.962+0000 7f91c5ffb640 1 -- 172.21.15.52:0/3901421342 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f91bc099440 con 0x7f91c8101900 2024-09-06T15:04:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.962+0000 7f91c7fff640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91b8077460 0x7f91b8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:44.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.963+0000 7f91c7fff640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91b8077460 0x7f91b8079920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f91b4031460 tx=0x7f91b40095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:44.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:44.966+0000 7f91c5ffb640 1 -- 172.21.15.52:0/3901421342 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f91bc0623a0 con 0x7f91c8101900 2024-09-06T15:04:45.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.135+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f91c8198350 con 0x7f91b8077460 2024-09-06T15:04:45.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.145+0000 7f91c5ffb640 1 -- 172.21.15.52:0/3901421342 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f91c8198350 con 0x7f91b8077460 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (17m) 11m ago 28m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (19m) 11m ago 28m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (19m) 10m ago 27m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (15m) 11m ago 28m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (15m) 10m ago 27m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (16m) 11m ago 27m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (11m) 11m ago 22m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (11m) 11m ago 22m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (11m) 10m ago 22m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (11m) 10m ago 22m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:04:45.145 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (19m) 11m ago 29m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (18m) 10m ago 27m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (15m) 11m ago 29m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (15m) 10m ago 27m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (18m) 11m ago 28m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (17m) 10m ago 27m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (15m) 11m ago 26m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (14m) 11m ago 25m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (13m) 11m ago 25m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (13m) 10m ago 24m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (12m) 10m ago 24m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (12m) 10m ago 23m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:04:45.146 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (17m) 11m ago 27m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:04:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91b8077460 msgr2=0x7f91b8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91b8077460 0x7f91b8079920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f91b4031460 tx=0x7f91b40095f0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 msgr2=0x7f91c819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c819d6a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00d6f0 tx=0x7f91bc00dbb0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 shutdown_connections 2024-09-06T15:04:45.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f91b8077460 0x7f91b8079920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f91c8107900 0x7f91c819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 --2- 172.21.15.52:0/3901421342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f91c8101900 0x7f91c819d6a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.147+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 >> 172.21.15.52:0/3901421342 conn(0x7f91c80fd620 msgr2=0x7f91c80fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.148+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 shutdown_connections 2024-09-06T15:04:45.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.148+0000 7f91cf116640 1 -- 172.21.15.52:0/3901421342 wait complete. 2024-09-06T15:04:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.229+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2300005938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074f40 msgr2=0x7f0fd410dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.229+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2300005938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074f40 0x7f0fd410dc00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009880 tx=0x7f0fc802a530 comp rx=0 tx=0).stop 2024-09-06T15:04:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2300005938 shutdown_connections 2024-09-06T15:04:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2300005938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074f40 0x7f0fd410dc00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2300005938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fd4074620 0x7f0fd4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2300005938 >> 172.21.15.52:0/2300005938 conn(0x7f0fd40fd640 msgr2=0x7f0fd40ffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2300005938 shutdown_connections 2024-09-06T15:04:45.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2300005938 wait complete. 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 Processor -- start 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 -- start start 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074620 0x7f0fd419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.230+0000 7f0fdbd58640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fd4074f40 0x7f0fd419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fdbd58640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4110fd0 con 0x7f0fd4074620 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fdbd58640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd4110e50 con 0x7f0fd4074f40 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd9af4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074620 0x7f0fd419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd9af4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074620 0x7f0fd419f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47178/0 (socket says 172.21.15.52:47178) 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd9af4640 1 -- 172.21.15.52:0/2694029212 learned_addr learned my addr 172.21.15.52:0/2694029212 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd92f3640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fd4074f40 0x7f0fd419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd9af4640 1 -- 172.21.15.52:0/2694029212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fd4074f40 msgr2=0x7f0fd419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd9af4640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fd4074f40 0x7f0fd419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd9af4640 1 -- 172.21.15.52:0/2694029212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd41999c0 con 0x7f0fd4074620 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd92f3640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fd4074f40 0x7f0fd419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd9af4640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074620 0x7f0fd419f800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400ea30 tx=0x7f0fc400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd2ffd640 1 -- 172.21.15.52:0/2694029212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0fc400cbe0 con 0x7f0fd4074620 2024-09-06T15:04:45.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd2ffd640 1 -- 172.21.15.52:0/2694029212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0fc400cd80 con 0x7f0fd4074620 2024-09-06T15:04:45.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd4199cb0 con 0x7f0fd4074620 2024-09-06T15:04:45.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fd2ffd640 1 -- 172.21.15.52:0/2694029212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0fc401a920 con 0x7f0fd4074620 2024-09-06T15:04:45.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.231+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd419a210 con 0x7f0fd4074620 2024-09-06T15:04:45.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.233+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd4075cd0 con 0x7f0fd4074620 2024-09-06T15:04:45.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.233+0000 7f0fd2ffd640 1 -- 172.21.15.52:0/2694029212 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0fc401abd0 con 0x7f0fd4074620 2024-09-06T15:04:45.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.234+0000 7f0fd2ffd640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0fbc077460 0x7f0fbc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.234+0000 7f0fd2ffd640 1 -- 172.21.15.52:0/2694029212 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0fc4099ea0 con 0x7f0fd4074620 2024-09-06T15:04:45.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.234+0000 7f0fd92f3640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0fbc077460 0x7f0fbc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.234+0000 7f0fd92f3640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0fbc077460 0x7f0fbc079920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0fd419b1b0 tx=0x7f0fc8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:45.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.238+0000 7f0fd2ffd640 1 -- 172.21.15.52:0/2694029212 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0fc4016030 con 0x7f0fd4074620 2024-09-06T15:04:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.460+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0fd419aef0 con 0x7f0fd4074620 2024-09-06T15:04:45.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.460+0000 7f0fd2ffd640 1 -- 172.21.15.52:0/2694029212 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0fc4062e00 con 0x7f0fd4074620 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:04:45.460 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:04:45.461 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:04:45.461 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:04:45.461 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:04:45.461 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:04:45.461 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0fbc077460 msgr2=0x7f0fbc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0fbc077460 0x7f0fbc079920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0fd419b1b0 tx=0x7f0fc8031400 comp rx=0 tx=0).stop 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074620 msgr2=0x7f0fd419f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074620 0x7f0fd419f800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400ea30 tx=0x7f0fc400eef0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 shutdown_connections 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0fbc077460 0x7f0fbc079920 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0fd4074f40 0x7f0fd419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 --2- 172.21.15.52:0/2694029212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0fd4074620 0x7f0fd419f800 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 >> 172.21.15.52:0/2694029212 conn(0x7f0fd40fd640 msgr2=0x7f0fd410b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:45.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 shutdown_connections 2024-09-06T15:04:45.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.462+0000 7f0fdbd58640 1 -- 172.21.15.52:0/2694029212 wait complete. 2024-09-06T15:04:45.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 -- 172.21.15.52:0/3176613150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 msgr2=0x7facc4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 --2- 172.21.15.52:0/3176613150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc4100c60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7facb8009880 tx=0x7facb802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 -- 172.21.15.52:0/3176613150 shutdown_connections 2024-09-06T15:04:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 --2- 172.21.15.52:0/3176613150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc4100c60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 --2- 172.21.15.52:0/3176613150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facc4106800 0x7facc4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 -- 172.21.15.52:0/3176613150 >> 172.21.15.52:0/3176613150 conn(0x7facc40fc520 msgr2=0x7facc40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 -- 172.21.15.52:0/3176613150 shutdown_connections 2024-09-06T15:04:45.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.545+0000 7faccb364640 1 -- 172.21.15.52:0/3176613150 wait complete. 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7faccb364640 1 Processor -- start 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7faccb364640 1 -- start start 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7faccb364640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc419f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7faccb364640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facc4106800 0x7facc419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7faccb364640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7facc410cc40 con 0x7facc4100800 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7faccb364640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7facc410cac0 con 0x7facc4106800 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7facc9100640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc419f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7facc9100640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc419f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47194/0 (socket says 172.21.15.52:47194) 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7facc9100640 1 -- 172.21.15.52:0/3066420793 learned_addr learned my addr 172.21.15.52:0/3066420793 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:45.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7facc88ff640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facc4106800 0x7facc419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.546+0000 7facc9100640 1 -- 172.21.15.52:0/3066420793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facc4106800 msgr2=0x7facc419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7facc9100640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facc4106800 0x7facc419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7facc9100640 1 -- 172.21.15.52:0/3066420793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc4199ac0 con 0x7facc4100800 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7facc9100640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc419f900 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7facc000b420 tx=0x7facc000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7facb67fc640 1 -- 172.21.15.52:0/3066420793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facc0011630 con 0x7facc4100800 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7facb67fc640 1 -- 172.21.15.52:0/3066420793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facc0016070 con 0x7facc4100800 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc4199db0 con 0x7facc4100800 2024-09-06T15:04:45.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7facb67fc640 1 -- 172.21.15.52:0/3066420793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facc0010d40 con 0x7facc4100800 2024-09-06T15:04:45.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.547+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc419a310 con 0x7facc4100800 2024-09-06T15:04:45.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.548+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc4101f40 con 0x7facc4100800 2024-09-06T15:04:45.549 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.549+0000 7facb67fc640 1 -- 172.21.15.52:0/3066420793 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7facc001b460 con 0x7facc4100800 2024-09-06T15:04:45.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.549+0000 7facb67fc640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facb0077440 0x7facb0079900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.549+0000 7facc88ff640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facb0077440 0x7facb0079900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.549+0000 7facb67fc640 1 -- 172.21.15.52:0/3066420793 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7facc0098e80 con 0x7facc4100800 2024-09-06T15:04:45.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.550+0000 7facc88ff640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facb0077440 0x7facb0079900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7facc419b2b0 tx=0x7facb8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:45.552 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.553+0000 7facb67fc640 1 -- 172.21.15.52:0/3066420793 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7facc0061de0 con 0x7facc4100800 2024-09-06T15:04:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.739+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7facc419aff0 con 0x7facc4100800 2024-09-06T15:04:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.739+0000 7facb67fc640 1 -- 172.21.15.52:0/3066420793 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7facc0065f50 con 0x7facc4100800 2024-09-06T15:04:45.739 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:04:45.739 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:04:45.739 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:04:45.739 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:04:45.739 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:04:45.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:04:45.740 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:04:45.741 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:45.742 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:04:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:04:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facb0077440 msgr2=0x7facb0079900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facb0077440 0x7facb0079900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7facc419b2b0 tx=0x7facb8031400 comp rx=0 tx=0).stop 2024-09-06T15:04:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 msgr2=0x7facc419f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc419f900 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7facc000b420 tx=0x7facc000b8e0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.743 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 shutdown_connections 2024-09-06T15:04:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facb0077440 0x7facb0079900 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7facc4106800 0x7facc419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 --2- 172.21.15.52:0/3066420793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facc4100800 0x7facc419f900 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 >> 172.21.15.52:0/3066420793 conn(0x7facc40fc520 msgr2=0x7facc40fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 shutdown_connections 2024-09-06T15:04:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.742+0000 7faccb364640 1 -- 172.21.15.52:0/3066420793 wait complete. 2024-09-06T15:04:45.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.826+0000 7f2fe7894640 1 -- 172.21.15.52:0/3099238976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0101900 msgr2=0x7f2fe0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.826+0000 7f2fe7894640 1 --2- 172.21.15.52:0/3099238976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0101900 0x7f2fe0101d60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009880 tx=0x7f2fd402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.826+0000 7f2fe7894640 1 -- 172.21.15.52:0/3099238976 shutdown_connections 2024-09-06T15:04:45.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.826+0000 7f2fe7894640 1 --2- 172.21.15.52:0/3099238976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0101900 0x7f2fe0101d60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.826+0000 7f2fe7894640 1 --2- 172.21.15.52:0/3099238976 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fe0107900 0x7f2fe0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.826+0000 7f2fe7894640 1 -- 172.21.15.52:0/3099238976 >> 172.21.15.52:0/3099238976 conn(0x7f2fe00fd600 msgr2=0x7f2fe00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:45.827 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:45 smithi052 ceph-mon[112917]: pgmap v615: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:45.827 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:45 smithi052 ceph-mon[112917]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:45.827 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:45 smithi052 ceph-mon[112917]: from='client.34974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:45.827 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:45 smithi052 ceph-mon[112917]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:45.827 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:45 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2694029212' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.827+0000 7f2fe7894640 1 -- 172.21.15.52:0/3099238976 shutdown_connections 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.827+0000 7f2fe7894640 1 -- 172.21.15.52:0/3099238976 wait complete. 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.827+0000 7f2fe7894640 1 Processor -- start 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.827+0000 7f2fe7894640 1 -- start start 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe7894640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fe0101900 0x7f2fe019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe7894640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0107900 0x7f2fe019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe7894640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe010edd0 con 0x7f2fe0107900 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe7894640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe010ec50 con 0x7f2fe0101900 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe4e2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0107900 0x7f2fe019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe4e2f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0107900 0x7f2fe019db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47214/0 (socket says 172.21.15.52:47214) 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe4e2f640 1 -- 172.21.15.52:0/1092369544 learned_addr learned my addr 172.21.15.52:0/1092369544 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe5630640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fe0101900 0x7f2fe019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe4e2f640 1 -- 172.21.15.52:0/1092369544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fe0101900 msgr2=0x7f2fe019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe4e2f640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fe0101900 0x7f2fe019d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe4e2f640 1 -- 172.21.15.52:0/1092369544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe01977a0 con 0x7f2fe0107900 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe4e2f640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0107900 0x7f2fe019db60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4031460 tx=0x7f2fd40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fde7fc640 1 -- 172.21.15.52:0/1092369544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd403f070 con 0x7f2fe0107900 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fde7fc640 1 -- 172.21.15.52:0/1092369544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fd40035f0 con 0x7f2fe0107900 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe0197a30 con 0x7f2fe0107900 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.828+0000 7f2fde7fc640 1 -- 172.21.15.52:0/1092369544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4035030 con 0x7f2fe0107900 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.829+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe0197f60 con 0x7f2fe0107900 2024-09-06T15:04:45.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.829+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe0103040 con 0x7f2fe0107900 2024-09-06T15:04:45.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.830+0000 7f2fde7fc640 1 -- 172.21.15.52:0/1092369544 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f2fd4042070 con 0x7f2fe0107900 2024-09-06T15:04:45.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.831+0000 7f2fde7fc640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc8077460 0x7f2fc8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:45.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.831+0000 7f2fde7fc640 1 -- 172.21.15.52:0/1092369544 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f2fd40ba0c0 con 0x7f2fe0107900 2024-09-06T15:04:45.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.831+0000 7f2fe5630640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc8077460 0x7f2fc8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:45.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.831+0000 7f2fe5630640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc8077460 0x7f2fc8079920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8005fd0 tx=0x7f2fd800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:45.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:45.835+0000 7f2fde7fc640 1 -- 172.21.15.52:0/1092369544 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f2fd4087190 con 0x7f2fe0107900 2024-09-06T15:04:46.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.012+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2fe0198270 con 0x7f2fc8077460 2024-09-06T15:04:46.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.013+0000 7f2fde7fc640 1 -- 172.21.15.52:0/1092369544 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2fe0198270 con 0x7f2fc8077460 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:04:46.013 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:04:46.014 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:04:46.014 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:04:46.014 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc8077460 msgr2=0x7f2fc8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc8077460 0x7f2fc8079920 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8005fd0 tx=0x7f2fd800b390 comp rx=0 tx=0).stop 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0107900 msgr2=0x7f2fe019db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0107900 0x7f2fe019db60 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4031460 tx=0x7f2fd40045e0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 shutdown_connections 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fe0107900 0x7f2fe019db60 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f2fc8077460 0x7f2fc8079920 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 --2- 172.21.15.52:0/1092369544 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2fe0101900 0x7f2fe019d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 >> 172.21.15.52:0/1092369544 conn(0x7f2fe00fd600 msgr2=0x7f2fe00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 shutdown_connections 2024-09-06T15:04:46.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.015+0000 7f2fe7894640 1 -- 172.21.15.52:0/1092369544 wait complete. 2024-09-06T15:04:46.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:45 smithi165 ceph-mon[82925]: pgmap v615: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:46.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:45 smithi165 ceph-mon[82925]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:46.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:45 smithi165 ceph-mon[82925]: from='client.34974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:46.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:45 smithi165 ceph-mon[82925]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:46.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:45 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2694029212' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:04:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 -- 172.21.15.52:0/618765210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18106800 msgr2=0x7fbf18106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 --2- 172.21.15.52:0/618765210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18106800 0x7fbf18106be0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009880 tx=0x7fbf0802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 -- 172.21.15.52:0/618765210 shutdown_connections 2024-09-06T15:04:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 --2- 172.21.15.52:0/618765210 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf18100800 0x7fbf18100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 --2- 172.21.15.52:0/618765210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18106800 0x7fbf18106be0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 -- 172.21.15.52:0/618765210 >> 172.21.15.52:0/618765210 conn(0x7fbf180fc520 msgr2=0x7fbf180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 -- 172.21.15.52:0/618765210 shutdown_connections 2024-09-06T15:04:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.098+0000 7fbf1c938640 1 -- 172.21.15.52:0/618765210 wait complete. 2024-09-06T15:04:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1c938640 1 Processor -- start 2024-09-06T15:04:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1c938640 1 -- start start 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1c938640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18100800 0x7fbf1819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1c938640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf18106800 0x7fbf1819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1c938640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810dd30 con 0x7fbf18100800 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1c938640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810dbb0 con 0x7fbf18106800 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18100800 0x7fbf1819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18100800 0x7fbf1819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47236/0 (socket says 172.21.15.52:47236) 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1659c640 1 -- 172.21.15.52:0/2318679813 learned_addr learned my addr 172.21.15.52:0/2318679813 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf15d9b640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf18106800 0x7fbf1819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1659c640 1 -- 172.21.15.52:0/2318679813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf18106800 msgr2=0x7fbf1819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1659c640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf18106800 0x7fbf1819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.099+0000 7fbf1659c640 1 -- 172.21.15.52:0/2318679813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf18197880 con 0x7fbf18100800 2024-09-06T15:04:46.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.100+0000 7fbf1659c640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18100800 0x7fbf1819d6c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbf08031460 tx=0x7fbf080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:46.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.100+0000 7fbf077fe640 1 -- 172.21.15.52:0/2318679813 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf0803f070 con 0x7fbf18100800 2024-09-06T15:04:46.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.100+0000 7fbf077fe640 1 -- 172.21.15.52:0/2318679813 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf08004cf0 con 0x7fbf18100800 2024-09-06T15:04:46.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.100+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf18197b10 con 0x7fbf18100800 2024-09-06T15:04:46.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.100+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf18198040 con 0x7fbf18100800 2024-09-06T15:04:46.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.100+0000 7fbf077fe640 1 -- 172.21.15.52:0/2318679813 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf08035030 con 0x7fbf18100800 2024-09-06T15:04:46.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.101+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf18101f40 con 0x7fbf18100800 2024-09-06T15:04:46.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.102+0000 7fbf077fe640 1 -- 172.21.15.52:0/2318679813 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbf08042070 con 0x7fbf18100800 2024-09-06T15:04:46.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.103+0000 7fbf077fe640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbf00077460 0x7fbf00079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:04:46.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.103+0000 7fbf15d9b640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbf00077460 0x7fbf00079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:04:46.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.103+0000 7fbf077fe640 1 -- 172.21.15.52:0/2318679813 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fbf080ba2d0 con 0x7fbf18100800 2024-09-06T15:04:46.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.103+0000 7fbf15d9b640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbf00077460 0x7fbf00079920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbf18104f50 tx=0x7fbf0c008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:04:46.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.107+0000 7fbf077fe640 1 -- 172.21.15.52:0/2318679813 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbf08083230 con 0x7fbf18100800 2024-09-06T15:04:46.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.327+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbf18198db0 con 0x7fbf18100800 2024-09-06T15:04:46.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.328+0000 7fbf077fe640 1 -- 172.21.15.52:0/2318679813 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7fbf080873a0 con 0x7fbf18100800 2024-09-06T15:04:46.327 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:04:46.327 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:04:46.327 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:04:46.328 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:04:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbf00077460 msgr2=0x7fbf00079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbf00077460 0x7fbf00079920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbf18104f50 tx=0x7fbf0c008040 comp rx=0 tx=0).stop 2024-09-06T15:04:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18100800 msgr2=0x7fbf1819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:04:46.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18100800 0x7fbf1819d6c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbf08031460 tx=0x7fbf080048f0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 shutdown_connections 2024-09-06T15:04:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbf00077460 0x7fbf00079920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf18106800 0x7fbf1819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 --2- 172.21.15.52:0/2318679813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf18100800 0x7fbf1819d6c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:04:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 >> 172.21.15.52:0/2318679813 conn(0x7fbf180fc520 msgr2=0x7fbf1806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:04:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 shutdown_connections 2024-09-06T15:04:46.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:04:46.330+0000 7fbf1c938640 1 -- 172.21.15.52:0/2318679813 wait complete. 2024-09-06T15:04:47.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:46 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3066420793' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:04:47.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:46 smithi165 ceph-mon[82925]: from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:47.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:46 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2318679813' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:04:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:46 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3066420793' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:04:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:46 smithi052 ceph-mon[112917]: from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:04:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:46 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2318679813' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:04:48.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:47 smithi165 ceph-mon[82925]: pgmap v616: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:48.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:47 smithi052 ceph-mon[112917]: pgmap v616: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:50.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:49 smithi165 ceph-mon[82925]: pgmap v617: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:50.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:49 smithi052 ceph-mon[112917]: pgmap v617: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:52.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:51 smithi165 ceph-mon[82925]: pgmap v618: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:52.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:51 smithi052 ceph-mon[112917]: pgmap v618: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:53.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:04:53.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:53 smithi165 ceph-mon[82925]: pgmap v619: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:54.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:53 smithi052 ceph-mon[112917]: pgmap v619: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:55.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:55 smithi052 ceph-mon[112917]: pgmap v620: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:56.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:55 smithi165 ceph-mon[82925]: pgmap v620: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:58.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:57 smithi165 ceph-mon[82925]: pgmap v621: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:04:58.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:57 smithi052 ceph-mon[112917]: pgmap v621: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:00.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:04:59 smithi165 ceph-mon[82925]: pgmap v622: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:00.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:04:59 smithi052 ceph-mon[112917]: pgmap v622: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:02.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:01 smithi165 ceph-mon[82925]: pgmap v623: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:02.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:01 smithi052 ceph-mon[112917]: pgmap v623: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:03.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:03 smithi052 ceph-mon[112917]: pgmap v624: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:04.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:03 smithi165 ceph-mon[82925]: pgmap v624: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:05.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:05 smithi052 ceph-mon[112917]: pgmap v625: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:06.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:05 smithi165 ceph-mon[82925]: pgmap v625: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:08.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:07 smithi165 ceph-mon[82925]: pgmap v626: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:08.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:08.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:07 smithi052 ceph-mon[112917]: pgmap v626: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:08.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:10.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:09 smithi165 ceph-mon[82925]: pgmap v627: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:09 smithi052 ceph-mon[112917]: pgmap v627: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:12.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:11 smithi165 ceph-mon[82925]: pgmap v628: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:12.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:11 smithi052 ceph-mon[112917]: pgmap v628: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:14.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:13 smithi165 ceph-mon[82925]: pgmap v629: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:14.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:13 smithi052 ceph-mon[112917]: pgmap v629: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:15.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:15 smithi052 ceph-mon[112917]: pgmap v630: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:16.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:15 smithi165 ceph-mon[82925]: pgmap v630: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:16.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 -- 172.21.15.52:0/835978727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 msgr2=0x7f4788106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 --2- 172.21.15.52:0/835978727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f4788106be0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4778009880 tx=0x7f477802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 -- 172.21.15.52:0/835978727 shutdown_connections 2024-09-06T15:05:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 --2- 172.21.15.52:0/835978727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4788100800 0x7f4788100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 --2- 172.21.15.52:0/835978727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f4788106be0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 -- 172.21.15.52:0/835978727 >> 172.21.15.52:0/835978727 conn(0x7f47880fc520 msgr2=0x7f47880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 -- 172.21.15.52:0/835978727 shutdown_connections 2024-09-06T15:05:16.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.426+0000 7f478c923640 1 -- 172.21.15.52:0/835978727 wait complete. 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.427+0000 7f478c923640 1 Processor -- start 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.427+0000 7f478c923640 1 -- start start 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.427+0000 7f478c923640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4788100800 0x7f478819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.427+0000 7f478c923640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f478819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.427+0000 7f478c923640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f478810dd30 con 0x7f4788106800 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.427+0000 7f478c923640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f478810dbb0 con 0x7f4788100800 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.427+0000 7f477dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f478819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f478819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37298/0 (socket says 172.21.15.52:37298) 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477dd9b640 1 -- 172.21.15.52:0/1304431835 learned_addr learned my addr 172.21.15.52:0/1304431835 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f478659c640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4788100800 0x7f478819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477dd9b640 1 -- 172.21.15.52:0/1304431835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4788100800 msgr2=0x7f478819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477dd9b640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4788100800 0x7f478819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477dd9b640 1 -- 172.21.15.52:0/1304431835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4788197820 con 0x7f4788106800 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477dd9b640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f478819dbe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f477000b420 tx=0x7f477000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477ffff640 1 -- 172.21.15.52:0/1304431835 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4770011630 con 0x7f4788106800 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477ffff640 1 -- 172.21.15.52:0/1304431835 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4770016070 con 0x7f4788106800 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f477ffff640 1 -- 172.21.15.52:0/1304431835 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4770010d40 con 0x7f4788106800 2024-09-06T15:05:16.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4788197b10 con 0x7f4788106800 2024-09-06T15:05:16.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.428+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47881980a0 con 0x7f4788106800 2024-09-06T15:05:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.429+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4788101f40 con 0x7f4788106800 2024-09-06T15:05:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.430+0000 7f477ffff640 1 -- 172.21.15.52:0/1304431835 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f477001b460 con 0x7f4788106800 2024-09-06T15:05:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.431+0000 7f477ffff640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4774077460 0x7f4774079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.431+0000 7f478659c640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4774077460 0x7f4774079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.431+0000 7f477ffff640 1 -- 172.21.15.52:0/1304431835 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4770098e80 con 0x7f4788106800 2024-09-06T15:05:16.431 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.431+0000 7f478659c640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4774077460 0x7f4774079920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f47780096c0 tx=0x7f4778031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:16.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.435+0000 7f477ffff640 1 -- 172.21.15.52:0/1304431835 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4770061de0 con 0x7f4788106800 2024-09-06T15:05:16.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.611+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f47881983b0 con 0x7f4774077460 2024-09-06T15:05:16.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.612+0000 7f477ffff640 1 -- 172.21.15.52:0/1304431835 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f47881983b0 con 0x7f4774077460 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4774077460 msgr2=0x7f4774079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4774077460 0x7f4774079920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f47780096c0 tx=0x7f4778031400 comp rx=0 tx=0).stop 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 msgr2=0x7f478819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f478819dbe0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f477000b420 tx=0x7f477000b8e0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 shutdown_connections 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4788106800 0x7f478819dbe0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4774077460 0x7f4774079920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 --2- 172.21.15.52:0/1304431835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4788100800 0x7f478819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.614+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 >> 172.21.15.52:0/1304431835 conn(0x7f47880fc520 msgr2=0x7f478806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.615+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 shutdown_connections 2024-09-06T15:05:16.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.615+0000 7f478c923640 1 -- 172.21.15.52:0/1304431835 wait complete. 2024-09-06T15:05:16.622 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:05:16.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 -- 172.21.15.52:0/2539490429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 msgr2=0x7f37d8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 --2- 172.21.15.52:0/2539490429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d8101d60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009880 tx=0x7f37c802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 -- 172.21.15.52:0/2539490429 shutdown_connections 2024-09-06T15:05:16.698 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 --2- 172.21.15.52:0/2539490429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d8101d60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 --2- 172.21.15.52:0/2539490429 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d8107900 0x7f37d8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 -- 172.21.15.52:0/2539490429 >> 172.21.15.52:0/2539490429 conn(0x7f37d80fd5e0 msgr2=0x7f37d80ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:16.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 -- 172.21.15.52:0/2539490429 shutdown_connections 2024-09-06T15:05:16.699 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 -- 172.21.15.52:0/2539490429 wait complete. 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 Processor -- start 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.699+0000 7f37e00ce640 1 -- start start 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37e00ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37e00ce640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d8107900 0x7f37d819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37e00ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37d810ee30 con 0x7f37d8101900 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37e00ce640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37d810ecb0 con 0x7f37d8107900 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dde6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dde6a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d819f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37320/0 (socket says 172.21.15.52:37320) 2024-09-06T15:05:16.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dde6a640 1 -- 172.21.15.52:0/1791502032 learned_addr learned my addr 172.21.15.52:0/1791502032 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dd669640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d8107900 0x7f37d819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dde6a640 1 -- 172.21.15.52:0/1791502032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d8107900 msgr2=0x7f37d819fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dde6a640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d8107900 0x7f37d819fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dde6a640 1 -- 172.21.15.52:0/1791502032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8199ab0 con 0x7f37d8101900 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dd669640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d8107900 0x7f37d819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37dde6a640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d819f8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f37d400b420 tx=0x7f37d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.700+0000 7f37ceffd640 1 -- 172.21.15.52:0/1791502032 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37d4011630 con 0x7f37d8101900 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.701+0000 7f37ceffd640 1 -- 172.21.15.52:0/1791502032 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37d4016070 con 0x7f37d8101900 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.701+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d8199da0 con 0x7f37d8101900 2024-09-06T15:05:16.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.701+0000 7f37ceffd640 1 -- 172.21.15.52:0/1791502032 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f37d4010d40 con 0x7f37d8101900 2024-09-06T15:05:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.701+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d819a300 con 0x7f37d8101900 2024-09-06T15:05:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.702+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d8103040 con 0x7f37d8101900 2024-09-06T15:05:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.702+0000 7f37ceffd640 1 -- 172.21.15.52:0/1791502032 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f37d401b460 con 0x7f37d8101900 2024-09-06T15:05:16.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.703+0000 7f37ceffd640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37c4077460 0x7f37c4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.703+0000 7f37ceffd640 1 -- 172.21.15.52:0/1791502032 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f37d4098f40 con 0x7f37d8101900 2024-09-06T15:05:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.703+0000 7f37dd669640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37c4077460 0x7f37c4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.703+0000 7f37dd669640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37c4077460 0x7f37c4079920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f37d819b2a0 tx=0x7f37c8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:16.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.707+0000 7f37ceffd640 1 -- 172.21.15.52:0/1791502032 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f37d4021250 con 0x7f37d8101900 2024-09-06T15:05:16.886 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.887+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f37d819a610 con 0x7f37c4077460 2024-09-06T15:05:16.887 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.888+0000 7f37ceffd640 1 -- 172.21.15.52:0/1791502032 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f37d819a610 con 0x7f37c4077460 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37c4077460 msgr2=0x7f37c4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37c4077460 0x7f37c4079920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f37d819b2a0 tx=0x7f37c8031400 comp rx=0 tx=0).stop 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 msgr2=0x7f37d819f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d819f8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f37d400b420 tx=0x7f37d400b8e0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 shutdown_connections 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f37c4077460 0x7f37c4079920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f37d8107900 0x7f37d819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 --2- 172.21.15.52:0/1791502032 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37d8101900 0x7f37d819f8f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 >> 172.21.15.52:0/1791502032 conn(0x7f37d80fd5e0 msgr2=0x7f37d8074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 shutdown_connections 2024-09-06T15:05:16.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.890+0000 7f37e00ce640 1 -- 172.21.15.52:0/1791502032 wait complete. 2024-09-06T15:05:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 -- 172.21.15.52:0/1861441145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8100800 msgr2=0x7f43f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 --2- 172.21.15.52:0/1861441145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8100800 0x7f43f8100c60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f43e4009880 tx=0x7f43e402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 -- 172.21.15.52:0/1861441145 shutdown_connections 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 --2- 172.21.15.52:0/1861441145 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8100800 0x7f43f8100c60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 --2- 172.21.15.52:0/1861441145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43f8106800 0x7f43f8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 -- 172.21.15.52:0/1861441145 >> 172.21.15.52:0/1861441145 conn(0x7f43f80fc520 msgr2=0x7f43f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 -- 172.21.15.52:0/1861441145 shutdown_connections 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.975+0000 7f43fee25640 1 -- 172.21.15.52:0/1861441145 wait complete. 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43fee25640 1 Processor -- start 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43fee25640 1 -- start start 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43fee25640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43f8100800 0x7f43f80fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43fee25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8106800 0x7f43f80fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43fee25640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43f810dcd0 con 0x7f43f8106800 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43fee25640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43f810db50 con 0x7f43f8100800 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8106800 0x7f43f80fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43f7fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8106800 0x7f43f80fd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37336/0 (socket says 172.21.15.52:37336) 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43f7fff640 1 -- 172.21.15.52:0/1676619369 learned_addr learned my addr 172.21.15.52:0/1676619369 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.976+0000 7f43fcbc1640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43f8100800 0x7f43f80fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43f7fff640 1 -- 172.21.15.52:0/1676619369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43f8100800 msgr2=0x7f43f80fcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43f7fff640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43f8100800 0x7f43f80fcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43f7fff640 1 -- 172.21.15.52:0/1676619369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f80fd6d0 con 0x7f43f8106800 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43f7fff640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8106800 0x7f43f80fd190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f43e4031460 tx=0x7f43e4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43f5ffb640 1 -- 172.21.15.52:0/1676619369 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43e403f070 con 0x7f43f8106800 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43f5ffb640 1 -- 172.21.15.52:0/1676619369 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f43e40035f0 con 0x7f43f8106800 2024-09-06T15:05:16.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f80fd960 con 0x7f43f8106800 2024-09-06T15:05:16.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43f5ffb640 1 -- 172.21.15.52:0/1676619369 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f43e4035030 con 0x7f43f8106800 2024-09-06T15:05:16.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.977+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f81a3db0 con 0x7f43f8106800 2024-09-06T15:05:16.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.978+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f8101f40 con 0x7f43f8106800 2024-09-06T15:05:16.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.979+0000 7f43f5ffb640 1 -- 172.21.15.52:0/1676619369 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f43e4042070 con 0x7f43f8106800 2024-09-06T15:05:16.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.979+0000 7f43f5ffb640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43e8077460 0x7f43e8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:16.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.980+0000 7f43fcbc1640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43e8077460 0x7f43e8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:16.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.980+0000 7f43f5ffb640 1 -- 172.21.15.52:0/1676619369 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f43e40ba130 con 0x7f43f8106800 2024-09-06T15:05:16.980 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.980+0000 7f43fcbc1640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43e8077460 0x7f43e8079920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009bd0 tx=0x7f43ec005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:16.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:16.983+0000 7f43f5ffb640 1 -- 172.21.15.52:0/1676619369 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f43e4087160 con 0x7f43f8106800 2024-09-06T15:05:17.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.150+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f43f8062630 con 0x7f43e8077460 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.159+0000 7f43f5ffb640 1 -- 172.21.15.52:0/1676619369 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f43f8062630 con 0x7f43e8077460 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (17m) 11m ago 28m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (20m) 11m ago 28m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (19m) 11m ago 27m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (15m) 11m ago 28m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (15m) 11m ago 27m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (17m) 11m ago 28m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:05:17.159 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (12m) 11m ago 23m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (12m) 11m ago 23m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (11m) 11m ago 23m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (11m) 11m ago 23m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (19m) 11m ago 29m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (18m) 11m ago 27m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (16m) 11m ago 29m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (16m) 11m ago 27m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (18m) 11m ago 28m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (18m) 11m ago 27m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (15m) 11m ago 26m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (14m) 11m ago 26m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (14m) 11m ago 25m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:05:17.160 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (13m) 11m ago 25m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:05:17.161 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (13m) 11m ago 24m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:05:17.161 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (12m) 11m ago 24m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:05:17.161 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (18m) 11m ago 28m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43e8077460 msgr2=0x7f43e8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43e8077460 0x7f43e8079920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009bd0 tx=0x7f43ec005f90 comp rx=0 tx=0).stop 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8106800 msgr2=0x7f43f80fd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8106800 0x7f43f80fd190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f43e4031460 tx=0x7f43e4004530 comp rx=0 tx=0).stop 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 shutdown_connections 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43f8106800 0x7f43f80fd190 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43e8077460 0x7f43e8079920 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 --2- 172.21.15.52:0/1676619369 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43f8100800 0x7f43f80fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 >> 172.21.15.52:0/1676619369 conn(0x7f43f80fc520 msgr2=0x7f43f806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 shutdown_connections 2024-09-06T15:05:17.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.162+0000 7f43fee25640 1 -- 172.21.15.52:0/1676619369 wait complete. 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/2354114354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c04102ac0 msgr2=0x7f1c04102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/2354114354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c04102ac0 0x7f1c04102ea0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4009880 tx=0x7f1bf402a530 comp rx=0 tx=0).stop 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/2354114354 shutdown_connections 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/2354114354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c041033e0 0x7f1c0410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/2354114354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c04102ac0 0x7f1c04102ea0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/2354114354 >> 172.21.15.52:0/2354114354 conn(0x7f1c040fc520 msgr2=0x7f1c040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/2354114354 shutdown_connections 2024-09-06T15:05:17.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.244+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/2354114354 wait complete. 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c0a2ce640 1 Processor -- start 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c0a2ce640 1 -- start start 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c0a2ce640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c04102ac0 0x7f1c0419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c0a2ce640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c041033e0 0x7f1c0419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c0a2ce640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0410edf0 con 0x7f1c041033e0 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c0a2ce640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0410ec70 con 0x7f1c04102ac0 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c041033e0 0x7f1c0419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.245+0000 7f1c037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c041033e0 0x7f1c0419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37356/0 (socket says 172.21.15.52:37356) 2024-09-06T15:05:17.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c037fe640 1 -- 172.21.15.52:0/1393470475 learned_addr learned my addr 172.21.15.52:0/1393470475 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c03fff640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c04102ac0 0x7f1c0419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c037fe640 1 -- 172.21.15.52:0/1393470475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c04102ac0 msgr2=0x7f1c0419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c037fe640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c04102ac0 0x7f1c0419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c037fe640 1 -- 172.21.15.52:0/1393470475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c04199a30 con 0x7f1c041033e0 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c037fe640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c041033e0 0x7f1c0419fd60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d6d0 tx=0x7f1bec00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c017fa640 1 -- 172.21.15.52:0/1393470475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bec017070 con 0x7f1c041033e0 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c017fa640 1 -- 172.21.15.52:0/1393470475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bec0054e0 con 0x7f1c041033e0 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c017fa640 1 -- 172.21.15.52:0/1393470475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bec004ae0 con 0x7f1c041033e0 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c04199d20 con 0x7f1c041033e0 2024-09-06T15:05:17.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.246+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0419a2b0 con 0x7f1c041033e0 2024-09-06T15:05:17.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.247+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0406aa90 con 0x7f1c041033e0 2024-09-06T15:05:17.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.248+0000 7f1c017fa640 1 -- 172.21.15.52:0/1393470475 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1bec004d90 con 0x7f1c041033e0 2024-09-06T15:05:17.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.249+0000 7f1c017fa640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bf00774b0 0x7f1bf0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.249+0000 7f1c03fff640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bf00774b0 0x7f1bf0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.249+0000 7f1c017fa640 1 -- 172.21.15.52:0/1393470475 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1bec099290 con 0x7f1c041033e0 2024-09-06T15:05:17.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.249+0000 7f1c03fff640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bf00774b0 0x7f1bf0079970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4000c00 tx=0x7f1bf4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:17.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.253+0000 7f1c017fa640 1 -- 172.21.15.52:0/1393470475 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1bec0663e0 con 0x7f1c041033e0 2024-09-06T15:05:17.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.474+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1c0410b3a0 con 0x7f1c041033e0 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.475+0000 7f1c017fa640 1 -- 172.21.15.52:0/1393470475 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f1bec06ae00 con 0x7f1c041033e0 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:05:17.474 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:05:17.475 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bf00774b0 msgr2=0x7f1bf0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bf00774b0 0x7f1bf0079970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4000c00 tx=0x7f1bf4031400 comp rx=0 tx=0).stop 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c041033e0 msgr2=0x7f1c0419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c041033e0 0x7f1c0419fd60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00d6d0 tx=0x7f1bec00db90 comp rx=0 tx=0).stop 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 shutdown_connections 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c041033e0 0x7f1c0419fd60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1bf00774b0 0x7f1bf0079970 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 --2- 172.21.15.52:0/1393470475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1c04102ac0 0x7f1c0419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.477+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 >> 172.21.15.52:0/1393470475 conn(0x7f1c040fc520 msgr2=0x7f1c04100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.478+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 shutdown_connections 2024-09-06T15:05:17.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.478+0000 7f1c0a2ce640 1 -- 172.21.15.52:0/1393470475 wait complete. 2024-09-06T15:05:17.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.561+0000 7f7da8724640 1 -- 172.21.15.52:0/2976204600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 msgr2=0x7f7da010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.561+0000 7f7da8724640 1 --2- 172.21.15.52:0/2976204600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da010b8c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009880 tx=0x7f7d9002a530 comp rx=0 tx=0).stop 2024-09-06T15:05:17.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 -- 172.21.15.52:0/2976204600 shutdown_connections 2024-09-06T15:05:17.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 --2- 172.21.15.52:0/2976204600 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da010b8c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 --2- 172.21.15.52:0/2976204600 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7da0102ab0 0x7f7da0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 -- 172.21.15.52:0/2976204600 >> 172.21.15.52:0/2976204600 conn(0x7f7da00fc550 msgr2=0x7f7da00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 -- 172.21.15.52:0/2976204600 shutdown_connections 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 -- 172.21.15.52:0/2976204600 wait complete. 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 Processor -- start 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 -- start start 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7da0102ab0 0x7f7da019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7da010ede0 con 0x7f7da01033d0 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.562+0000 7f7da8724640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7da010ec60 con 0x7f7da0102ab0 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da5cbf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da5cbf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37384/0 (socket says 172.21.15.52:37384) 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da5cbf640 1 -- 172.21.15.52:0/832617554 learned_addr learned my addr 172.21.15.52:0/832617554 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da64c0640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7da0102ab0 0x7f7da019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da5cbf640 1 -- 172.21.15.52:0/832617554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7da0102ab0 msgr2=0x7f7da019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da5cbf640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7da0102ab0 0x7f7da019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da5cbf640 1 -- 172.21.15.52:0/832617554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da0197810 con 0x7f7da01033d0 2024-09-06T15:05:17.564 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da64c0640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7da0102ab0 0x7f7da019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:05:17.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da5cbf640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da019dbd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7d90031460 tx=0x7f7d900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:17.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7d977fe640 1 -- 172.21.15.52:0/832617554 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d9003f070 con 0x7f7da01033d0 2024-09-06T15:05:17.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da0197aa0 con 0x7f7da01033d0 2024-09-06T15:05:17.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7d977fe640 1 -- 172.21.15.52:0/832617554 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d90004ac0 con 0x7f7da01033d0 2024-09-06T15:05:17.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7d977fe640 1 -- 172.21.15.52:0/832617554 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d90035030 con 0x7f7da01033d0 2024-09-06T15:05:17.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.563+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da0197fd0 con 0x7f7da01033d0 2024-09-06T15:05:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.564+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da006a580 con 0x7f7da01033d0 2024-09-06T15:05:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.565+0000 7f7d977fe640 1 -- 172.21.15.52:0/832617554 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7d90042070 con 0x7f7da01033d0 2024-09-06T15:05:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.565+0000 7f7d977fe640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7d8c077460 0x7f7d8c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.566+0000 7f7da64c0640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7d8c077460 0x7f7d8c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.566+0000 7f7d977fe640 1 -- 172.21.15.52:0/832617554 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7d900ba260 con 0x7f7da01033d0 2024-09-06T15:05:17.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.566+0000 7f7da64c0640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7d8c077460 0x7f7d8c079920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c005fd0 tx=0x7f7d9c005ea0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:17.568 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.569+0000 7f7d977fe640 1 -- 172.21.15.52:0/832617554 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7d90083120 con 0x7f7da01033d0 2024-09-06T15:05:17.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.756+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7da0198d40 con 0x7f7da01033d0 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.756+0000 7f7d977fe640 1 -- 172.21.15.52:0/832617554 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f7d90087290 con 0x7f7da01033d0 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:17.756 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:05:17.757 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:05:17.758 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:17.759 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:05:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7d8c077460 msgr2=0x7f7d8c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7d8c077460 0x7f7d8c079920 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c005fd0 tx=0x7f7d9c005ea0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 msgr2=0x7f7da019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.760 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da019dbd0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7d90031460 tx=0x7f7d900046c0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 shutdown_connections 2024-09-06T15:05:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7da01033d0 0x7f7da019dbd0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7d8c077460 0x7f7d8c079920 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 --2- 172.21.15.52:0/832617554 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7da0102ab0 0x7f7da019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 >> 172.21.15.52:0/832617554 conn(0x7f7da00fc550 msgr2=0x7f7da0108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 shutdown_connections 2024-09-06T15:05:17.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.758+0000 7f7da8724640 1 -- 172.21.15.52:0/832617554 wait complete. 2024-09-06T15:05:17.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.841+0000 7fecb9af7640 1 -- 172.21.15.52:0/3149038097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 msgr2=0x7fecb4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.841+0000 7fecb9af7640 1 --2- 172.21.15.52:0/3149038097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb4107ce0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7feca4009c20 tx=0x7feca402a970 comp rx=0 tx=0).stop 2024-09-06T15:05:17.842 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.841+0000 7fecb9af7640 1 -- 172.21.15.52:0/3149038097 shutdown_connections 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.842+0000 7fecb9af7640 1 --2- 172.21.15.52:0/3149038097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecb4101900 0x7fecb4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.842+0000 7fecb9af7640 1 --2- 172.21.15.52:0/3149038097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb4107ce0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.842+0000 7fecb9af7640 1 -- 172.21.15.52:0/3149038097 >> 172.21.15.52:0/3149038097 conn(0x7fecb40fd600 msgr2=0x7fecb40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.842+0000 7fecb9af7640 1 -- 172.21.15.52:0/3149038097 shutdown_connections 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.842+0000 7fecb9af7640 1 -- 172.21.15.52:0/3149038097 wait complete. 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.842+0000 7fecb9af7640 1 Processor -- start 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.842+0000 7fecb9af7640 1 -- start start 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb9af7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecb4101900 0x7fecb419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb9af7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb419dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb9af7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fecb410ee30 con 0x7fecb4107900 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb9af7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecb410ecb0 con 0x7fecb4101900 2024-09-06T15:05:17.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb419dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb2ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb419dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37412/0 (socket says 172.21.15.52:37412) 2024-09-06T15:05:17.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb2ffd640 1 -- 172.21.15.52:0/1816906159 learned_addr learned my addr 172.21.15.52:0/1816906159 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:17.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb37fe640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecb4101900 0x7fecb419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb2ffd640 1 -- 172.21.15.52:0/1816906159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecb4101900 msgr2=0x7fecb419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:17.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb2ffd640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecb4101900 0x7fecb419d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:17.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb2ffd640 1 -- 172.21.15.52:0/1816906159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb4197900 con 0x7fecb4107900 2024-09-06T15:05:17.844 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb2ffd640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb419dc80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00b420 tx=0x7fec9c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:17.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb0ff9640 1 -- 172.21.15.52:0/1816906159 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec9c011630 con 0x7fecb4107900 2024-09-06T15:05:17.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb0ff9640 1 -- 172.21.15.52:0/1816906159 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec9c016070 con 0x7fecb4107900 2024-09-06T15:05:17.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb4197bf0 con 0x7fecb4107900 2024-09-06T15:05:17.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.843+0000 7fecb0ff9640 1 -- 172.21.15.52:0/1816906159 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec9c010d40 con 0x7fecb4107900 2024-09-06T15:05:17.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.844+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb4198180 con 0x7fecb4107900 2024-09-06T15:05:17.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.845+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb4103040 con 0x7fecb4107900 2024-09-06T15:05:17.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.845+0000 7fecb0ff9640 1 -- 172.21.15.52:0/1816906159 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fec9c01b460 con 0x7fecb4107900 2024-09-06T15:05:17.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.846+0000 7fecb0ff9640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7feca0077460 0x7feca0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:17.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.846+0000 7fecb37fe640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7feca0077460 0x7feca0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:17.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.846+0000 7fecb0ff9640 1 -- 172.21.15.52:0/1816906159 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fec9c098e60 con 0x7fecb4107900 2024-09-06T15:05:17.846 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.847+0000 7fecb37fe640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7feca0077460 0x7feca0079920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feca4009430 tx=0x7feca403c040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:17.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:17.850+0000 7fecb0ff9640 1 -- 172.21.15.52:0/1816906159 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fec9c061dc0 con 0x7fecb4107900 2024-09-06T15:05:18.026 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.027+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fecb4198e30 con 0x7feca0077460 2024-09-06T15:05:18.026 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:17 smithi052 ceph-mon[112917]: pgmap v631: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:18.026 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:17 smithi052 ceph-mon[112917]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:18.027 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:17 smithi052 ceph-mon[112917]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:18.027 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:17 smithi052 ceph-mon[112917]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:18.027 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:17 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1393470475' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:05:18.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.028+0000 7fecb0ff9640 1 -- 172.21.15.52:0/1816906159 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fecb4198e30 con 0x7feca0077460 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:05:18.028 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:05:18.029 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:05:18.029 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:05:18.029 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:05:18.029 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.030+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7feca0077460 msgr2=0x7feca0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.030+0000 7fecb9af7640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7feca0077460 0x7feca0079920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7feca4009430 tx=0x7feca403c040 comp rx=0 tx=0).stop 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.030+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 msgr2=0x7fecb419dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.030+0000 7fecb9af7640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb419dc80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00b420 tx=0x7fec9c00b8e0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.031+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 shutdown_connections 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.031+0000 7fecb9af7640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fecb4107900 0x7fecb419dc80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.031+0000 7fecb9af7640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7feca0077460 0x7feca0079920 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.031+0000 7fecb9af7640 1 --2- 172.21.15.52:0/1816906159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecb4101900 0x7fecb419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.031+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 >> 172.21.15.52:0/1816906159 conn(0x7fecb40fd600 msgr2=0x7fecb40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:18.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.031+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 shutdown_connections 2024-09-06T15:05:18.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.031+0000 7fecb9af7640 1 -- 172.21.15.52:0/1816906159 wait complete. 2024-09-06T15:05:18.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:17 smithi165 ceph-mon[82925]: pgmap v631: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:18.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:17 smithi165 ceph-mon[82925]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:18.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:17 smithi165 ceph-mon[82925]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:18.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:17 smithi165 ceph-mon[82925]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:18.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:17 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1393470475' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 -- 172.21.15.52:0/608167375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 msgr2=0x7f8900100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 --2- 172.21.15.52:0/608167375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f8900100c60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009880 tx=0x7f88e802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 -- 172.21.15.52:0/608167375 shutdown_connections 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 --2- 172.21.15.52:0/608167375 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f8900100c60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 --2- 172.21.15.52:0/608167375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8900106800 0x7f8900106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 -- 172.21.15.52:0/608167375 >> 172.21.15.52:0/608167375 conn(0x7f89000fc520 msgr2=0x7f89000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 -- 172.21.15.52:0/608167375 shutdown_connections 2024-09-06T15:05:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.113+0000 7f89054df640 1 -- 172.21.15.52:0/608167375 wait complete. 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f89054df640 1 Processor -- start 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f89054df640 1 -- start start 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f89054df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f89001023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f89054df640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8900106800 0x7f8900102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f89054df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f890010dcb0 con 0x7f8900100800 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f89054df640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f890010db30 con 0x7f8900106800 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f88feffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f89001023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f88feffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f89001023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37418/0 (socket says 172.21.15.52:37418) 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f88feffd640 1 -- 172.21.15.52:0/3248097824 learned_addr learned my addr 172.21.15.52:0/3248097824 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f88f7fff640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8900106800 0x7f8900102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f88feffd640 1 -- 172.21.15.52:0/3248097824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8900106800 msgr2=0x7f8900102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.114+0000 7f88feffd640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8900106800 0x7f8900102910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.115+0000 7f88feffd640 1 -- 172.21.15.52:0/3248097824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8900102e50 con 0x7f8900100800 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.115+0000 7f88feffd640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f89001023d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f88f000d8d0 tx=0x7f88f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.115+0000 7f88fcff9640 1 -- 172.21.15.52:0/3248097824 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f0017070 con 0x7f8900100800 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.115+0000 7f88fcff9640 1 -- 172.21.15.52:0/3248097824 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88f0010460 con 0x7f8900100800 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.115+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8900103140 con 0x7f8900100800 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.115+0000 7f88fcff9640 1 -- 172.21.15.52:0/3248097824 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f000f5f0 con 0x7f8900100800 2024-09-06T15:05:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.115+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89001a3e20 con 0x7f8900100800 2024-09-06T15:05:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.116+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8900101f40 con 0x7f8900100800 2024-09-06T15:05:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.117+0000 7f88fcff9640 1 -- 172.21.15.52:0/3248097824 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f88f0009a30 con 0x7f8900100800 2024-09-06T15:05:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.117+0000 7f88fcff9640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f88ec0774b0 0x7f88ec079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.117+0000 7f88fcff9640 1 -- 172.21.15.52:0/3248097824 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f88f0099570 con 0x7f8900100800 2024-09-06T15:05:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.117+0000 7f88f7fff640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f88ec0774b0 0x7f88ec079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.118+0000 7f88f7fff640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f88ec0774b0 0x7f88ec079970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8900103e60 tx=0x7f88e8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.121+0000 7f88fcff9640 1 -- 172.21.15.52:0/3248097824 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f88f00666c0 con 0x7f8900100800 2024-09-06T15:05:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.340+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8900100c60 con 0x7f8900100800 2024-09-06T15:05:18.339 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.340+0000 7f88fcff9640 1 -- 172.21.15.52:0/3248097824 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f88f006b0e0 con 0x7f8900100800 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:05:18.340 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:05:18.341 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:05:18.341 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:05:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f88ec0774b0 msgr2=0x7f88ec079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f88ec0774b0 0x7f88ec079970 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8900103e60 tx=0x7f88e8031400 comp rx=0 tx=0).stop 2024-09-06T15:05:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 msgr2=0x7f89001023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f89001023d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f88f000d8d0 tx=0x7f88f000dd90 comp rx=0 tx=0).stop 2024-09-06T15:05:18.342 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 shutdown_connections 2024-09-06T15:05:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f88ec0774b0 0x7f88ec079970 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8900106800 0x7f8900102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 --2- 172.21.15.52:0/3248097824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8900100800 0x7f89001023d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 >> 172.21.15.52:0/3248097824 conn(0x7f89000fc520 msgr2=0x7f89001045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 shutdown_connections 2024-09-06T15:05:18.343 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:18.343+0000 7f89054df640 1 -- 172.21.15.52:0/3248097824 wait complete. 2024-09-06T15:05:19.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:18 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/832617554' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:05:19.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:18 smithi165 ceph-mon[82925]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:19.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:18 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3248097824' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:05:19.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:18 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/832617554' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:05:19.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:18 smithi052 ceph-mon[112917]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:19.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:18 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3248097824' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:05:20.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:19 smithi165 ceph-mon[82925]: pgmap v632: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:20.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:19 smithi052 ceph-mon[112917]: pgmap v632: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:22.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:21 smithi165 ceph-mon[82925]: pgmap v633: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:22.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:21 smithi052 ceph-mon[112917]: pgmap v633: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:23.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:23.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:24.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:23 smithi165 ceph-mon[82925]: pgmap v634: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:24.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:23 smithi052 ceph-mon[112917]: pgmap v634: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:25 smithi052 ceph-mon[112917]: pgmap v635: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:25 smithi165 ceph-mon[82925]: pgmap v635: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:28.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:27 smithi165 ceph-mon[82925]: pgmap v636: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:28.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:27 smithi052 ceph-mon[112917]: pgmap v636: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:30.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:29 smithi165 ceph-mon[82925]: pgmap v637: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:30.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:29 smithi052 ceph-mon[112917]: pgmap v637: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:32.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:31 smithi165 ceph-mon[82925]: pgmap v638: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:32.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:31 smithi052 ceph-mon[112917]: pgmap v638: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:34.033 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:33 smithi052 ceph-mon[112917]: pgmap v639: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:34.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:33 smithi165 ceph-mon[82925]: pgmap v639: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:35.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:35 smithi052 ceph-mon[112917]: pgmap v640: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:36.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:35 smithi165 ceph-mon[82925]: pgmap v640: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:38.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:37 smithi165 ceph-mon[82925]: pgmap v641: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:38.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:37 smithi052 ceph-mon[112917]: pgmap v641: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:40.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:39 smithi165 ceph-mon[82925]: pgmap v642: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:40.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:39 smithi052 ceph-mon[112917]: pgmap v642: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:42.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:41 smithi165 ceph-mon[82925]: pgmap v643: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:42.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:41 smithi052 ceph-mon[112917]: pgmap v643: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:44.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:43 smithi165 ceph-mon[82925]: pgmap v644: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:44.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:43 smithi052 ceph-mon[112917]: pgmap v644: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:45.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:45 smithi052 ceph-mon[112917]: pgmap v645: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:46.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:45 smithi165 ceph-mon[82925]: pgmap v645: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:48.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:47 smithi165 ceph-mon[82925]: pgmap v646: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:48.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:47 smithi052 ceph-mon[112917]: pgmap v646: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:48.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 -- 172.21.15.52:0/2823932093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 msgr2=0x7fef7410dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 --2- 172.21.15.52:0/2823932093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7410dcc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fef64009880 tx=0x7fef6402a490 comp rx=0 tx=0).stop 2024-09-06T15:05:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 -- 172.21.15.52:0/2823932093 shutdown_connections 2024-09-06T15:05:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 --2- 172.21.15.52:0/2823932093 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7410dcc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 --2- 172.21.15.52:0/2823932093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef74100650 0x7fef74100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 -- 172.21.15.52:0/2823932093 >> 172.21.15.52:0/2823932093 conn(0x7fef740fc520 msgr2=0x7fef740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 -- 172.21.15.52:0/2823932093 shutdown_connections 2024-09-06T15:05:48.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.440+0000 7fef7c18a640 1 -- 172.21.15.52:0/2823932093 wait complete. 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef7c18a640 1 Processor -- start 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef7c18a640 1 -- start start 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef7c18a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef74100650 0x7fef7419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef7c18a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef7c18a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fef74110ff0 con 0x7fef74101000 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef7c18a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fef74110e70 con 0x7fef74100650 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef79725640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef79725640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59092/0 (socket says 172.21.15.52:59092) 2024-09-06T15:05:48.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef79725640 1 -- 172.21.15.52:0/1024239950 learned_addr learned my addr 172.21.15.52:0/1024239950 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.441+0000 7fef79f26640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef74100650 0x7fef7419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef79725640 1 -- 172.21.15.52:0/1024239950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef74100650 msgr2=0x7fef7419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef79725640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef74100650 0x7fef7419f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef79725640 1 -- 172.21.15.52:0/1024239950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef74199a80 con 0x7fef74101000 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef79f26640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef74100650 0x7fef7419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef79725640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7419fe00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef64031460 tx=0x7fef640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef6affd640 1 -- 172.21.15.52:0/1024239950 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef6403f070 con 0x7fef74101000 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef6affd640 1 -- 172.21.15.52:0/1024239950 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef64004cf0 con 0x7fef74101000 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef74199d10 con 0x7fef74101000 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef6affd640 1 -- 172.21.15.52:0/1024239950 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef64035030 con 0x7fef74101000 2024-09-06T15:05:48.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.442+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7419a2a0 con 0x7fef74101000 2024-09-06T15:05:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.443+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef7406aa90 con 0x7fef74101000 2024-09-06T15:05:48.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.444+0000 7fef6affd640 1 -- 172.21.15.52:0/1024239950 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fef64042070 con 0x7fef74101000 2024-09-06T15:05:48.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.444+0000 7fef6affd640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fef600774b0 0x7fef60079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.445+0000 7fef6affd640 1 -- 172.21.15.52:0/1024239950 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fef640ba2a0 con 0x7fef74101000 2024-09-06T15:05:48.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.445+0000 7fef79f26640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fef600774b0 0x7fef60079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.445+0000 7fef79f26640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fef600774b0 0x7fef60079970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef7419abc0 tx=0x7fef70008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:48.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.449+0000 7fef6affd640 1 -- 172.21.15.52:0/1024239950 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fef640831e0 con 0x7fef74101000 2024-09-06T15:05:48.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.627+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fef7419afb0 con 0x7fef600774b0 2024-09-06T15:05:48.627 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.628+0000 7fef6affd640 1 -- 172.21.15.52:0/1024239950 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fef7419afb0 con 0x7fef600774b0 2024-09-06T15:05:48.629 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fef600774b0 msgr2=0x7fef60079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fef600774b0 0x7fef60079970 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fef7419abc0 tx=0x7fef70008040 comp rx=0 tx=0).stop 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 msgr2=0x7fef7419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7419fe00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fef64031460 tx=0x7fef640048f0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 shutdown_connections 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef74101000 0x7fef7419fe00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fef600774b0 0x7fef60079970 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 --2- 172.21.15.52:0/1024239950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef74100650 0x7fef7419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 >> 172.21.15.52:0/1024239950 conn(0x7fef740fc520 msgr2=0x7fef740fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 shutdown_connections 2024-09-06T15:05:48.630 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.630+0000 7fef7c18a640 1 -- 172.21.15.52:0/1024239950 wait complete. 2024-09-06T15:05:48.638 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.714+0000 7f1175c39640 1 -- 172.21.15.52:0/4006256220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 msgr2=0x7f117010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.714+0000 7f1175c39640 1 --2- 172.21.15.52:0/4006256220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117010b8d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1158009880 tx=0x7f115802a530 comp rx=0 tx=0).stop 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.714+0000 7f1175c39640 1 -- 172.21.15.52:0/4006256220 shutdown_connections 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.714+0000 7f1175c39640 1 --2- 172.21.15.52:0/4006256220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117010b8d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.714+0000 7f1175c39640 1 --2- 172.21.15.52:0/4006256220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1170102ac0 0x7f1170102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.714+0000 7f1175c39640 1 -- 172.21.15.52:0/4006256220 >> 172.21.15.52:0/4006256220 conn(0x7f11700fc520 msgr2=0x7f11700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.714+0000 7f1175c39640 1 -- 172.21.15.52:0/4006256220 shutdown_connections 2024-09-06T15:05:48.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.715+0000 7f1175c39640 1 -- 172.21.15.52:0/4006256220 wait complete. 2024-09-06T15:05:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.715+0000 7f1175c39640 1 Processor -- start 2024-09-06T15:05:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.715+0000 7f1175c39640 1 -- start start 2024-09-06T15:05:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1175c39640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1170102ac0 0x7f117019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1175c39640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1175c39640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f117010edf0 con 0x7f11701033e0 2024-09-06T15:05:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1175c39640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f117010ec70 con 0x7f1170102ac0 2024-09-06T15:05:48.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1166ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1166ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59110/0 (socket says 172.21.15.52:59110) 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1166ffd640 1 -- 172.21.15.52:0/647493801 learned_addr learned my addr 172.21.15.52:0/647493801 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f116f7fe640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1170102ac0 0x7f117019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1166ffd640 1 -- 172.21.15.52:0/647493801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1170102ac0 msgr2=0x7f117019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1166ffd640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1170102ac0 0x7f117019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1166ffd640 1 -- 172.21.15.52:0/647493801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1170197820 con 0x7f11701033e0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f1166ffd640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117019dbe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1158031460 tx=0x7f11580045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.716+0000 7f116d7fa640 1 -- 172.21.15.52:0/647493801 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f115803f070 con 0x7f11701033e0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.717+0000 7f116d7fa640 1 -- 172.21.15.52:0/647493801 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11580035f0 con 0x7f11701033e0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.717+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1170197ab0 con 0x7f11701033e0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.717+0000 7f116d7fa640 1 -- 172.21.15.52:0/647493801 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1158035030 con 0x7f11701033e0 2024-09-06T15:05:48.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.717+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1170197fe0 con 0x7f11701033e0 2024-09-06T15:05:48.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.718+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117006aa90 con 0x7f11701033e0 2024-09-06T15:05:48.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.718+0000 7f116d7fa640 1 -- 172.21.15.52:0/647493801 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1158042070 con 0x7f11701033e0 2024-09-06T15:05:48.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.719+0000 7f116d7fa640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f115c077460 0x7f115c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.719+0000 7f116d7fa640 1 -- 172.21.15.52:0/647493801 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f11580ba0a0 con 0x7f11701033e0 2024-09-06T15:05:48.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.719+0000 7f116f7fe640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f115c077460 0x7f115c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.719+0000 7f116f7fe640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f115c077460 0x7f115c079920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1160009b60 tx=0x7f1160005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:48.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.724+0000 7f116d7fa640 1 -- 172.21.15.52:0/647493801 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1158083000 con 0x7f11701033e0 2024-09-06T15:05:48.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.901+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1170198290 con 0x7f115c077460 2024-09-06T15:05:48.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.902+0000 7f116d7fa640 1 -- 172.21.15.52:0/647493801 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1170198290 con 0x7f115c077460 2024-09-06T15:05:48.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f115c077460 msgr2=0x7f115c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f115c077460 0x7f115c079920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1160009b60 tx=0x7f1160005f90 comp rx=0 tx=0).stop 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 msgr2=0x7f117019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117019dbe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1158031460 tx=0x7f11580045c0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 shutdown_connections 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f11701033e0 0x7f117019dbe0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f115c077460 0x7f115c079920 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 --2- 172.21.15.52:0/647493801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1170102ac0 0x7f117019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 >> 172.21.15.52:0/647493801 conn(0x7f11700fc520 msgr2=0x7f1170108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 shutdown_connections 2024-09-06T15:05:48.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.904+0000 7f1175c39640 1 -- 172.21.15.52:0/647493801 wait complete. 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 -- 172.21.15.52:0/673355657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 msgr2=0x7f0d88100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 --2- 172.21.15.52:0/673355657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d88100c60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009880 tx=0x7f0d7c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 -- 172.21.15.52:0/673355657 shutdown_connections 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 --2- 172.21.15.52:0/673355657 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d88100c60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 --2- 172.21.15.52:0/673355657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d88106800 0x7f0d88106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 -- 172.21.15.52:0/673355657 >> 172.21.15.52:0/673355657 conn(0x7f0d880fc520 msgr2=0x7f0d880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 -- 172.21.15.52:0/673355657 shutdown_connections 2024-09-06T15:05:48.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.987+0000 7f0d8e865640 1 -- 172.21.15.52:0/673355657 wait complete. 2024-09-06T15:05:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d8e865640 1 Processor -- start 2024-09-06T15:05:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d8e865640 1 -- start start 2024-09-06T15:05:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d8e865640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d881023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d8e865640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d88106800 0x7f0d88102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d8e865640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8810dcd0 con 0x7f0d88100800 2024-09-06T15:05:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d8e865640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8810db50 con 0x7f0d88106800 2024-09-06T15:05:48.989 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d881023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d881023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59124/0 (socket says 172.21.15.52:59124) 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.988+0000 7f0d87fff640 1 -- 172.21.15.52:0/2966333492 learned_addr learned my addr 172.21.15.52:0/2966333492 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d877fe640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d88106800 0x7f0d88102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d87fff640 1 -- 172.21.15.52:0/2966333492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d88106800 msgr2=0x7f0d88102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d87fff640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d88106800 0x7f0d88102910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d87fff640 1 -- 172.21.15.52:0/2966333492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d88102e50 con 0x7f0d88100800 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d87fff640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d881023d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800d6f0 tx=0x7f0d7800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d857fa640 1 -- 172.21.15.52:0/2966333492 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d78017070 con 0x7f0d88100800 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d88103140 con 0x7f0d88100800 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d857fa640 1 -- 172.21.15.52:0/2966333492 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d7800de00 con 0x7f0d88100800 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.989+0000 7f0d857fa640 1 -- 172.21.15.52:0/2966333492 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d78004bb0 con 0x7f0d88100800 2024-09-06T15:05:48.990 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.990+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d881a3e50 con 0x7f0d88100800 2024-09-06T15:05:48.991 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.991+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d88101f40 con 0x7f0d88100800 2024-09-06T15:05:48.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.991+0000 7f0d857fa640 1 -- 172.21.15.52:0/2966333492 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0d78004e60 con 0x7f0d88100800 2024-09-06T15:05:48.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.992+0000 7f0d857fa640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d70077460 0x7f0d70079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:48.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.992+0000 7f0d857fa640 1 -- 172.21.15.52:0/2966333492 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0d78099430 con 0x7f0d88100800 2024-09-06T15:05:48.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.992+0000 7f0d877fe640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d70077460 0x7f0d70079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:48.992 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.992+0000 7f0d877fe640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d70077460 0x7f0d70079920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d88103e60 tx=0x7f0d7c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:48.995 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:48.996+0000 7f0d857fa640 1 -- 172.21.15.52:0/2966333492 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0d78066460 con 0x7f0d88100800 2024-09-06T15:05:49.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.164+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d8806a1b0 con 0x7f0d70077460 2024-09-06T15:05:49.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.173+0000 7f0d857fa640 1 -- 172.21.15.52:0/2966333492 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0d8806a1b0 con 0x7f0d70077460 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (18m) 12m ago 29m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (21m) 12m ago 29m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (20m) 12m ago 28m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (16m) 12m ago 29m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (16m) 12m ago 28m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (17m) 12m ago 28m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (12m) 12m ago 23m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (12m) 12m ago 23m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (12m) 12m ago 23m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:05:49.173 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (12m) 12m ago 23m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (20m) 12m ago 30m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (19m) 12m ago 28m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (16m) 12m ago 30m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (16m) 12m ago 28m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (19m) 12m ago 29m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (18m) 12m ago 28m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (16m) 12m ago 27m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (15m) 12m ago 26m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (14m) 12m ago 26m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (14m) 12m ago 25m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (13m) 12m ago 25m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (13m) 12m ago 24m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:05:49.174 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (18m) 12m ago 28m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:05:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d70077460 msgr2=0x7f0d70079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d70077460 0x7f0d70079920 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0d88103e60 tx=0x7f0d7c031400 comp rx=0 tx=0).stop 2024-09-06T15:05:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 msgr2=0x7f0d881023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d881023d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0d7800d6f0 tx=0x7f0d7800dbb0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 shutdown_connections 2024-09-06T15:05:49.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0d70077460 0x7f0d70079920 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0d88106800 0x7f0d88102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 --2- 172.21.15.52:0/2966333492 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d88100800 0x7f0d881023d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 >> 172.21.15.52:0/2966333492 conn(0x7f0d880fc520 msgr2=0x7f0d881045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 shutdown_connections 2024-09-06T15:05:49.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.176+0000 7f0d8e865640 1 -- 172.21.15.52:0/2966333492 wait complete. 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 -- 172.21.15.52:0/2129782728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641067f0 msgr2=0x7fce64106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/2129782728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641067f0 0x7fce64106bd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fce54009880 tx=0x7fce5402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 -- 172.21.15.52:0/2129782728 shutdown_connections 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/2129782728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce641007f0 0x7fce64100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/2129782728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641067f0 0x7fce64106bd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 -- 172.21.15.52:0/2129782728 >> 172.21.15.52:0/2129782728 conn(0x7fce640fc550 msgr2=0x7fce640fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 -- 172.21.15.52:0/2129782728 shutdown_connections 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 -- 172.21.15.52:0/2129782728 wait complete. 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.261+0000 7fce6a8cb640 1 Processor -- start 2024-09-06T15:05:49.261 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce6a8cb640 1 -- start start 2024-09-06T15:05:49.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce6a8cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641007f0 0x7fce64107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce6a8cb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce641067f0 0x7fce64107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce6a8cb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce6410dca0 con 0x7fce641007f0 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce6a8cb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce6410db20 con 0x7fce641067f0 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641007f0 0x7fce64107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce63fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641007f0 0x7fce64107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59142/0 (socket says 172.21.15.52:59142) 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce63fff640 1 -- 172.21.15.52:0/3950948144 learned_addr learned my addr 172.21.15.52:0/3950948144 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce637fe640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce641067f0 0x7fce64107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce63fff640 1 -- 172.21.15.52:0/3950948144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce641067f0 msgr2=0x7fce64107c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce63fff640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce641067f0 0x7fce64107c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.262+0000 7fce63fff640 1 -- 172.21.15.52:0/3950948144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce641081a0 con 0x7fce641007f0 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.263+0000 7fce63fff640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641007f0 0x7fce64107720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fce54031460 tx=0x7fce540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:49.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.263+0000 7fce617fa640 1 -- 172.21.15.52:0/3950948144 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce5403f070 con 0x7fce641007f0 2024-09-06T15:05:49.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.263+0000 7fce617fa640 1 -- 172.21.15.52:0/3950948144 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce540035f0 con 0x7fce641007f0 2024-09-06T15:05:49.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.263+0000 7fce617fa640 1 -- 172.21.15.52:0/3950948144 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce54035030 con 0x7fce641007f0 2024-09-06T15:05:49.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.263+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce64108430 con 0x7fce641007f0 2024-09-06T15:05:49.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.263+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce641a3d50 con 0x7fce641007f0 2024-09-06T15:05:49.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.264+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce64101f30 con 0x7fce641007f0 2024-09-06T15:05:49.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.266+0000 7fce617fa640 1 -- 172.21.15.52:0/3950948144 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fce54042070 con 0x7fce641007f0 2024-09-06T15:05:49.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.266+0000 7fce617fa640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fce4c0774b0 0x7fce4c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.266+0000 7fce617fa640 1 -- 172.21.15.52:0/3950948144 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fce540ba610 con 0x7fce641007f0 2024-09-06T15:05:49.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.266+0000 7fce637fe640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fce4c0774b0 0x7fce4c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.267+0000 7fce637fe640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fce4c0774b0 0x7fce4c079970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce641091b0 tx=0x7fce5800b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:49.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.269+0000 7fce617fa640 1 -- 172.21.15.52:0/3950948144 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fce54087800 con 0x7fce641007f0 2024-09-06T15:05:49.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.490+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fce641a40a0 con 0x7fce641007f0 2024-09-06T15:05:49.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.491+0000 7fce617fa640 1 -- 172.21.15.52:0/3950948144 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fce5408c220 con 0x7fce641007f0 2024-09-06T15:05:49.490 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:05:49.491 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:05:49.492 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:05:49.492 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:05:49.492 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:05:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fce4c0774b0 msgr2=0x7fce4c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fce4c0774b0 0x7fce4c079970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce641091b0 tx=0x7fce5800b390 comp rx=0 tx=0).stop 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641007f0 msgr2=0x7fce64107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641007f0 0x7fce64107720 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fce54031460 tx=0x7fce540045e0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 shutdown_connections 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fce4c0774b0 0x7fce4c079970 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce641067f0 0x7fce64107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 --2- 172.21.15.52:0/3950948144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce641007f0 0x7fce64107720 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 >> 172.21.15.52:0/3950948144 conn(0x7fce640fc550 msgr2=0x7fce64069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 shutdown_connections 2024-09-06T15:05:49.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.493+0000 7fce6a8cb640 1 -- 172.21.15.52:0/3950948144 wait complete. 2024-09-06T15:05:49.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.575+0000 7fc9eb643640 1 -- 172.21.15.52:0/2644837407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074590 msgr2=0x7fc9e4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.575+0000 7fc9eb643640 1 --2- 172.21.15.52:0/2644837407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074590 0x7fc9e4074970 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0009880 tx=0x7fc9e002a530 comp rx=0 tx=0).stop 2024-09-06T15:05:49.575 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.575+0000 7fc9eb643640 1 -- 172.21.15.52:0/2644837407 shutdown_connections 2024-09-06T15:05:49.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.575+0000 7fc9eb643640 1 --2- 172.21.15.52:0/2644837407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e4074eb0 0x7fc9e41123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.575+0000 7fc9eb643640 1 --2- 172.21.15.52:0/2644837407 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074590 0x7fc9e4074970 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.575+0000 7fc9eb643640 1 -- 172.21.15.52:0/2644837407 >> 172.21.15.52:0/2644837407 conn(0x7fc9e40fd600 msgr2=0x7fc9e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:49.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 -- 172.21.15.52:0/2644837407 shutdown_connections 2024-09-06T15:05:49.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 -- 172.21.15.52:0/2644837407 wait complete. 2024-09-06T15:05:49.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 Processor -- start 2024-09-06T15:05:49.576 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 -- start start 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e4074590 0x7fc9e419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074eb0 0x7fc9e419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e41153f0 con 0x7fc9e4074eb0 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.576+0000 7fc9eb643640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4115270 con 0x7fc9e4074590 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e8bde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074eb0 0x7fc9e419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e8bde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074eb0 0x7fc9e419e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59162/0 (socket says 172.21.15.52:59162) 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e8bde640 1 -- 172.21.15.52:0/1627905751 learned_addr learned my addr 172.21.15.52:0/1627905751 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e93df640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e4074590 0x7fc9e419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e8bde640 1 -- 172.21.15.52:0/1627905751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e4074590 msgr2=0x7fc9e419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e8bde640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e4074590 0x7fc9e419e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e8bde640 1 -- 172.21.15.52:0/1627905751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e41a2900 con 0x7fc9e4074eb0 2024-09-06T15:05:49.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9e8bde640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074eb0 0x7fc9e419e570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400d6f0 tx=0x7fc9d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:49.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9da7fc640 1 -- 172.21.15.52:0/1627905751 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d4017070 con 0x7fc9e4074eb0 2024-09-06T15:05:49.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9da7fc640 1 -- 172.21.15.52:0/1627905751 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9d400de00 con 0x7fc9e4074eb0 2024-09-06T15:05:49.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e41a2bf0 con 0x7fc9e4074eb0 2024-09-06T15:05:49.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9da7fc640 1 -- 172.21.15.52:0/1627905751 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9d4004bb0 con 0x7fc9e4074eb0 2024-09-06T15:05:49.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.577+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e41a3180 con 0x7fc9e4074eb0 2024-09-06T15:05:49.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.578+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e4075cd0 con 0x7fc9e4074eb0 2024-09-06T15:05:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.579+0000 7fc9da7fc640 1 -- 172.21.15.52:0/1627905751 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc9d4004e60 con 0x7fc9e4074eb0 2024-09-06T15:05:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.580+0000 7fc9da7fc640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9d0077460 0x7fc9d0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.580+0000 7fc9da7fc640 1 -- 172.21.15.52:0/1627905751 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc9d4099440 con 0x7fc9e4074eb0 2024-09-06T15:05:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.580+0000 7fc9e93df640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9d0077460 0x7fc9d0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.580+0000 7fc9e93df640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9d0077460 0x7fc9d0079920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00096c0 tx=0x7fc9e0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:49.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.584+0000 7fc9da7fc640 1 -- 172.21.15.52:0/1627905751 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc9d40623a0 con 0x7fc9e4074eb0 2024-09-06T15:05:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.767+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc9e419f390 con 0x7fc9e4074eb0 2024-09-06T15:05:49.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.768+0000 7fc9da7fc640 1 -- 172.21.15.52:0/1627905751 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7fc9d4066510 con 0x7fc9e4074eb0 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:05:49.768 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:05:49.769 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:05:49.770 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:49.771 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9d0077460 msgr2=0x7fc9d0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9d0077460 0x7fc9d0079920 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00096c0 tx=0x7fc9e0031400 comp rx=0 tx=0).stop 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074eb0 msgr2=0x7fc9e419e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074eb0 0x7fc9e419e570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400d6f0 tx=0x7fc9d400dbb0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 shutdown_connections 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9e4074eb0 0x7fc9e419e570 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9d0077460 0x7fc9d0079920 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.772 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 --2- 172.21.15.52:0/1627905751 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9e4074590 0x7fc9e419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 >> 172.21.15.52:0/1627905751 conn(0x7fc9e40fd600 msgr2=0x7fc9e4104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:49.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 shutdown_connections 2024-09-06T15:05:49.773 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.771+0000 7fc9eb643640 1 -- 172.21.15.52:0/1627905751 wait complete. 2024-09-06T15:05:49.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 -- 172.21.15.52:0/3367738467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 msgr2=0x7fc234107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/3367738467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc234107ce0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc230009880 tx=0x7fc23002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 -- 172.21.15.52:0/3367738467 shutdown_connections 2024-09-06T15:05:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/3367738467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc234101900 0x7fc234101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/3367738467 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc234107ce0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 -- 172.21.15.52:0/3367738467 >> 172.21.15.52:0/3367738467 conn(0x7fc2340fd600 msgr2=0x7fc2340ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 -- 172.21.15.52:0/3367738467 shutdown_connections 2024-09-06T15:05:49.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.855+0000 7fc23b2e3640 1 -- 172.21.15.52:0/3367738467 wait complete. 2024-09-06T15:05:49.855 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:49 smithi052 ceph-mon[112917]: pgmap v647: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:49.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:49 smithi052 ceph-mon[112917]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:49.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:49 smithi052 ceph-mon[112917]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:49.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:49 smithi052 ceph-mon[112917]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:49.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:49 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3950948144' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:05:49.856 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:49 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1627905751' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:05:49.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23b2e3640 1 Processor -- start 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23b2e3640 1 -- start start 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23b2e3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc234101900 0x7fc23419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23b2e3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc23419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23b2e3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc23410edd0 con 0x7fc234107900 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23b2e3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc23410ec50 con 0x7fc234101900 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23887e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc23419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23887e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc23419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59184/0 (socket says 172.21.15.52:59184) 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23887e640 1 -- 172.21.15.52:0/342150645 learned_addr learned my addr 172.21.15.52:0/342150645 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:49.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23907f640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc234101900 0x7fc23419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23887e640 1 -- 172.21.15.52:0/342150645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc234101900 msgr2=0x7fc23419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23887e640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc234101900 0x7fc23419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.856+0000 7fc23887e640 1 -- 172.21.15.52:0/342150645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2341977c0 con 0x7fc234107900 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.857+0000 7fc23887e640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc23419db80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc22400e970 tx=0x7fc22400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.857+0000 7fc22a7fc640 1 -- 172.21.15.52:0/342150645 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc22400cac0 con 0x7fc234107900 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.857+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc234197ab0 con 0x7fc234107900 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.857+0000 7fc22a7fc640 1 -- 172.21.15.52:0/342150645 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2240054e0 con 0x7fc234107900 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.857+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc234198040 con 0x7fc234107900 2024-09-06T15:05:49.861 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.857+0000 7fc22a7fc640 1 -- 172.21.15.52:0/342150645 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc224010430 con 0x7fc234107900 2024-09-06T15:05:49.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.858+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc218005290 con 0x7fc234107900 2024-09-06T15:05:49.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.858+0000 7fc22a7fc640 1 -- 172.21.15.52:0/342150645 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc224004f00 con 0x7fc234107900 2024-09-06T15:05:49.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.859+0000 7fc22a7fc640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc220077460 0x7fc220079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:49.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.859+0000 7fc22a7fc640 1 -- 172.21.15.52:0/342150645 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc224099d40 con 0x7fc234107900 2024-09-06T15:05:49.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.859+0000 7fc23907f640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc220077460 0x7fc220079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:49.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.859+0000 7fc23907f640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc220077460 0x7fc220079920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2300096c0 tx=0x7fc230031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:49.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:49.863+0000 7fc22a7fc640 1 -- 172.21.15.52:0/342150645 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc224062ca0 con 0x7fc234107900 2024-09-06T15:05:50.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.044+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc218000bc0 con 0x7fc220077460 2024-09-06T15:05:50.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.045+0000 7fc22a7fc640 1 -- 172.21.15.52:0/342150645 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc218000bc0 con 0x7fc220077460 2024-09-06T15:05:50.044 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:05:50.045 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:05:50.046 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:05:50.046 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:05:50.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc220077460 msgr2=0x7fc220079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc220077460 0x7fc220079920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2300096c0 tx=0x7fc230031400 comp rx=0 tx=0).stop 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 msgr2=0x7fc23419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc23419db80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc22400e970 tx=0x7fc22400ed70 comp rx=0 tx=0).stop 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 shutdown_connections 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc234107900 0x7fc23419db80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc220077460 0x7fc220079920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 --2- 172.21.15.52:0/342150645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc234101900 0x7fc23419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 >> 172.21.15.52:0/342150645 conn(0x7fc2340fd600 msgr2=0x7fc2340fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 shutdown_connections 2024-09-06T15:05:50.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.047+0000 7fc23b2e3640 1 -- 172.21.15.52:0/342150645 wait complete. 2024-09-06T15:05:50.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:49 smithi165 ceph-mon[82925]: pgmap v647: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:50.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:49 smithi165 ceph-mon[82925]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:50.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:49 smithi165 ceph-mon[82925]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:50.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:49 smithi165 ceph-mon[82925]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:50.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:49 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3950948144' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:05:50.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:49 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1627905751' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:05:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.130+0000 7f9952240640 1 -- 172.21.15.52:0/3913307264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c101900 msgr2=0x7f994c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.130+0000 7f9952240640 1 --2- 172.21.15.52:0/3913307264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c101900 0x7f994c101d60 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9934009880 tx=0x7f993402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 -- 172.21.15.52:0/3913307264 shutdown_connections 2024-09-06T15:05:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 --2- 172.21.15.52:0/3913307264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c101900 0x7f994c101d60 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 --2- 172.21.15.52:0/3913307264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c107900 0x7f994c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 -- 172.21.15.52:0/3913307264 >> 172.21.15.52:0/3913307264 conn(0x7f994c0fd600 msgr2=0x7f994c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:50.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 -- 172.21.15.52:0/3913307264 shutdown_connections 2024-09-06T15:05:50.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 -- 172.21.15.52:0/3913307264 wait complete. 2024-09-06T15:05:50.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 Processor -- start 2024-09-06T15:05:50.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.131+0000 7f9952240640 1 -- start start 2024-09-06T15:05:50.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9952240640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c101900 0x7f994c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:50.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9952240640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c107900 0x7f994c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9952240640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f994c10edd0 con 0x7f994c107900 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9952240640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f994c10ec50 con 0x7f994c101900 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9943fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c107900 0x7f994c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9943fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c107900 0x7f994c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59202/0 (socket says 172.21.15.52:59202) 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9943fff640 1 -- 172.21.15.52:0/1136560071 learned_addr learned my addr 172.21.15.52:0/1136560071 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f994b7fe640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c101900 0x7f994c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9943fff640 1 -- 172.21.15.52:0/1136560071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c101900 msgr2=0x7f994c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9943fff640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c101900 0x7f994c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9943fff640 1 -- 172.21.15.52:0/1136560071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c197800 con 0x7f994c107900 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f994b7fe640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c101900 0x7f994c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9943fff640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c107900 0x7f994c19dbc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9934031460 tx=0x7f99340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:50.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f99497fa640 1 -- 172.21.15.52:0/1136560071 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f993403f070 con 0x7f994c107900 2024-09-06T15:05:50.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f99497fa640 1 -- 172.21.15.52:0/1136560071 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9934004cf0 con 0x7f994c107900 2024-09-06T15:05:50.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c197a90 con 0x7f994c107900 2024-09-06T15:05:50.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.132+0000 7f99497fa640 1 -- 172.21.15.52:0/1136560071 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9934035030 con 0x7f994c107900 2024-09-06T15:05:50.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.133+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c197fc0 con 0x7f994c107900 2024-09-06T15:05:50.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.133+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c103040 con 0x7f994c107900 2024-09-06T15:05:50.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.134+0000 7f99497fa640 1 -- 172.21.15.52:0/1136560071 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f9934042070 con 0x7f994c107900 2024-09-06T15:05:50.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.135+0000 7f99497fa640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9938077460 0x7f9938079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:05:50.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.135+0000 7f99497fa640 1 -- 172.21.15.52:0/1136560071 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f99340ba230 con 0x7f994c107900 2024-09-06T15:05:50.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.135+0000 7f994b7fe640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9938077460 0x7f9938079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:05:50.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.135+0000 7f994b7fe640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9938077460 0x7f9938079920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f993c0058c0 tx=0x7f993c005d30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:05:50.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.139+0000 7f99497fa640 1 -- 172.21.15.52:0/1136560071 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9934083190 con 0x7f994c107900 2024-09-06T15:05:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.358+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f994c109e70 con 0x7f994c107900 2024-09-06T15:05:50.358 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.359+0000 7f99497fa640 1 -- 172.21.15.52:0/1136560071 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f9934087300 con 0x7f994c107900 2024-09-06T15:05:50.358 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:05:50.358 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:05:50.358 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:05:50.358 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:05:50.359 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.360+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9938077460 msgr2=0x7f9938079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.360+0000 7f9952240640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9938077460 0x7f9938079920 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f993c0058c0 tx=0x7f993c005d30 comp rx=0 tx=0).stop 2024-09-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.360+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c107900 msgr2=0x7f994c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.360+0000 7f9952240640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c107900 0x7f994c19dbc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9934031460 tx=0x7f99340048f0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.361+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 shutdown_connections 2024-09-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.361+0000 7f9952240640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f994c107900 0x7f994c19dbc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.360 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.361+0000 7f9952240640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f9938077460 0x7f9938079920 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.361+0000 7f9952240640 1 --2- 172.21.15.52:0/1136560071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f994c101900 0x7f994c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:05:50.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.361+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 >> 172.21.15.52:0/1136560071 conn(0x7f994c0fd600 msgr2=0x7f994c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:05:50.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.361+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 shutdown_connections 2024-09-06T15:05:50.361 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:05:50.361+0000 7f9952240640 1 -- 172.21.15.52:0/1136560071 wait complete. 2024-09-06T15:05:51.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:50 smithi165 ceph-mon[82925]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:51.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:50 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1136560071' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:05:51.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:50 smithi052 ceph-mon[112917]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:05:51.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:50 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1136560071' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:05:52.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:51 smithi165 ceph-mon[82925]: pgmap v648: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:52.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:51 smithi052 ceph-mon[112917]: pgmap v648: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:53.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:05:54.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:53 smithi165 ceph-mon[82925]: pgmap v649: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:54.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:53 smithi052 ceph-mon[112917]: pgmap v649: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:55.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:55 smithi052 ceph-mon[112917]: pgmap v650: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:56.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:55 smithi165 ceph-mon[82925]: pgmap v650: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:58.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:57 smithi165 ceph-mon[82925]: pgmap v651: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:05:58.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:57 smithi052 ceph-mon[112917]: pgmap v651: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:00.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:05:59 smithi165 ceph-mon[82925]: pgmap v652: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:00.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:05:59 smithi052 ceph-mon[112917]: pgmap v652: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:02.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:01 smithi165 ceph-mon[82925]: pgmap v653: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:02.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:01 smithi052 ceph-mon[112917]: pgmap v653: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:04.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:03 smithi165 ceph-mon[82925]: pgmap v654: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:04.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:03 smithi052 ceph-mon[112917]: pgmap v654: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:05.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:05 smithi052 ceph-mon[112917]: pgmap v655: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:06.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:05 smithi165 ceph-mon[82925]: pgmap v655: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:08.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:07 smithi165 ceph-mon[82925]: pgmap v656: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:08.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:08.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:07 smithi052 ceph-mon[112917]: pgmap v656: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:08.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:10.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:09 smithi165 ceph-mon[82925]: pgmap v657: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:10.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:09 smithi052 ceph-mon[112917]: pgmap v657: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:12.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:11 smithi052 ceph-mon[112917]: pgmap v658: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:12.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:11 smithi165 ceph-mon[82925]: pgmap v658: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:14.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:13 smithi052 ceph-mon[112917]: pgmap v659: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:14.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:13 smithi165 ceph-mon[82925]: pgmap v659: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:15.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:15 smithi052 ceph-mon[112917]: pgmap v660: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:16.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:15 smithi165 ceph-mon[82925]: pgmap v660: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:18.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:17 smithi052 ceph-mon[112917]: pgmap v661: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:18.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:17 smithi165 ceph-mon[82925]: pgmap v661: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:20.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:19 smithi165 ceph-mon[82925]: pgmap v662: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:20.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:19 smithi052 ceph-mon[112917]: pgmap v662: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 -- 172.21.15.52:0/818671606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 msgr2=0x7f8a48101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 --2- 172.21.15.52:0/818671606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a48101d60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009880 tx=0x7f8a3002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 -- 172.21.15.52:0/818671606 shutdown_connections 2024-09-06T15:06:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 --2- 172.21.15.52:0/818671606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a48101d60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 --2- 172.21.15.52:0/818671606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a48107900 0x7f8a48107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 -- 172.21.15.52:0/818671606 >> 172.21.15.52:0/818671606 conn(0x7f8a480fd600 msgr2=0x7f8a480ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 -- 172.21.15.52:0/818671606 shutdown_connections 2024-09-06T15:06:20.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.457+0000 7f8a4c876640 1 -- 172.21.15.52:0/818671606 wait complete. 2024-09-06T15:06:20.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.458+0000 7f8a4c876640 1 Processor -- start 2024-09-06T15:06:20.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.458+0000 7f8a4c876640 1 -- start start 2024-09-06T15:06:20.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.458+0000 7f8a4c876640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a4819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:20.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.458+0000 7f8a4c876640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a48107900 0x7f8a4819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:20.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.458+0000 7f8a4c876640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810edd0 con 0x7f8a48101900 2024-09-06T15:06:20.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.458+0000 7f8a4c876640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4810ec50 con 0x7f8a48107900 2024-09-06T15:06:20.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a4819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:20.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a4819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58680/0 (socket says 172.21.15.52:58680) 2024-09-06T15:06:20.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4659c640 1 -- 172.21.15.52:0/2388741967 learned_addr learned my addr 172.21.15.52:0/2388741967 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:20.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a3dd9b640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a48107900 0x7f8a4819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:20.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4659c640 1 -- 172.21.15.52:0/2388741967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a48107900 msgr2=0x7f8a4819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4659c640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a48107900 0x7f8a4819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4659c640 1 -- 172.21.15.52:0/2388741967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a481977a0 con 0x7f8a48101900 2024-09-06T15:06:20.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4659c640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a4819d620 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800d6f0 tx=0x7f8a3800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:20.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a3ffff640 1 -- 172.21.15.52:0/2388741967 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a38017070 con 0x7f8a48101900 2024-09-06T15:06:20.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a3ffff640 1 -- 172.21.15.52:0/2388741967 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a3800de00 con 0x7f8a48101900 2024-09-06T15:06:20.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a48197a90 con 0x7f8a48101900 2024-09-06T15:06:20.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.459+0000 7f8a3ffff640 1 -- 172.21.15.52:0/2388741967 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a38004bb0 con 0x7f8a48101900 2024-09-06T15:06:20.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.460+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a48197ff0 con 0x7f8a48101900 2024-09-06T15:06:20.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.461+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a48103040 con 0x7f8a48101900 2024-09-06T15:06:20.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.461+0000 7f8a3ffff640 1 -- 172.21.15.52:0/2388741967 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8a38009a30 con 0x7f8a48101900 2024-09-06T15:06:20.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.462+0000 7f8a3ffff640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a340774b0 0x7f8a34079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:20.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.462+0000 7f8a3ffff640 1 -- 172.21.15.52:0/2388741967 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8a38099270 con 0x7f8a48101900 2024-09-06T15:06:20.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.462+0000 7f8a3dd9b640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a340774b0 0x7f8a34079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:20.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.462+0000 7f8a3dd9b640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a340774b0 0x7f8a34079970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8a48198af0 tx=0x7f8a30031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:20.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.466+0000 7f8a3ffff640 1 -- 172.21.15.52:0/2388741967 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8a380663c0 con 0x7f8a48101900 2024-09-06T15:06:20.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.646+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8a481982a0 con 0x7f8a340774b0 2024-09-06T15:06:20.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.647+0000 7f8a3ffff640 1 -- 172.21.15.52:0/2388741967 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8a481982a0 con 0x7f8a340774b0 2024-09-06T15:06:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a340774b0 msgr2=0x7f8a34079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a340774b0 0x7f8a34079970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8a48198af0 tx=0x7f8a30031400 comp rx=0 tx=0).stop 2024-09-06T15:06:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 msgr2=0x7f8a4819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a4819d620 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800d6f0 tx=0x7f8a3800dbb0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 shutdown_connections 2024-09-06T15:06:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a340774b0 0x7f8a34079970 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a48107900 0x7f8a4819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 --2- 172.21.15.52:0/2388741967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a48101900 0x7f8a4819d620 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 >> 172.21.15.52:0/2388741967 conn(0x7f8a480fd600 msgr2=0x7f8a480fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 shutdown_connections 2024-09-06T15:06:20.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.649+0000 7f8a4c876640 1 -- 172.21.15.52:0/2388741967 wait complete. 2024-09-06T15:06:20.658 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:06:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.733+0000 7f67a7f43640 1 -- 172.21.15.52:0/702634388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0102b50 msgr2=0x7f67a0102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.733+0000 7f67a7f43640 1 --2- 172.21.15.52:0/702634388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0102b50 0x7f67a0102f30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f679c009880 tx=0x7f679c02a530 comp rx=0 tx=0).stop 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 -- 172.21.15.52:0/702634388 shutdown_connections 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 --2- 172.21.15.52:0/702634388 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0103470 0x7f67a010b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 --2- 172.21.15.52:0/702634388 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0102b50 0x7f67a0102f30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 -- 172.21.15.52:0/702634388 >> 172.21.15.52:0/702634388 conn(0x7f67a00fc550 msgr2=0x7f67a00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 -- 172.21.15.52:0/702634388 shutdown_connections 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 -- 172.21.15.52:0/702634388 wait complete. 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 Processor -- start 2024-09-06T15:06:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.734+0000 7f67a7f43640 1 -- start start 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a7f43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0102b50 0x7f67a019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a7f43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0103470 0x7f67a019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a7f43640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f67a010ede0 con 0x7f67a0103470 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a7f43640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67a010ec60 con 0x7f67a0102b50 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a54de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0103470 0x7f67a019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a54de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0103470 0x7f67a019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58692/0 (socket says 172.21.15.52:58692) 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a54de640 1 -- 172.21.15.52:0/3428281675 learned_addr learned my addr 172.21.15.52:0/3428281675 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:20.736 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a5cdf640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0102b50 0x7f67a019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a54de640 1 -- 172.21.15.52:0/3428281675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0102b50 msgr2=0x7f67a019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a54de640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0102b50 0x7f67a019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a54de640 1 -- 172.21.15.52:0/3428281675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a01977d0 con 0x7f67a0103470 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.735+0000 7f67a54de640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0103470 0x7f67a019db90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f679000d6f0 tx=0x7f679000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.736+0000 7f6796ffd640 1 -- 172.21.15.52:0/3428281675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6790017070 con 0x7f67a0103470 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.736+0000 7f6796ffd640 1 -- 172.21.15.52:0/3428281675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f679000de00 con 0x7f67a0103470 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.736+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a0197ac0 con 0x7f67a0103470 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.736+0000 7f6796ffd640 1 -- 172.21.15.52:0/3428281675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6790004bb0 con 0x7f67a0103470 2024-09-06T15:06:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.736+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a0198050 con 0x7f67a0103470 2024-09-06T15:06:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.737+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a006a4e0 con 0x7f67a0103470 2024-09-06T15:06:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.737+0000 7f6796ffd640 1 -- 172.21.15.52:0/3428281675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6790009a30 con 0x7f67a0103470 2024-09-06T15:06:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.738+0000 7f6796ffd640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f678c0774b0 0x7f678c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.738+0000 7f67a5cdf640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f678c0774b0 0x7f678c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.738+0000 7f6796ffd640 1 -- 172.21.15.52:0/3428281675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f6790099270 con 0x7f67a0103470 2024-09-06T15:06:20.738 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.739+0000 7f67a5cdf640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f678c0774b0 0x7f678c079970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f679c0096c0 tx=0x7f679c004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:20.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.743+0000 7f6796ffd640 1 -- 172.21.15.52:0/3428281675 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f67900663c0 con 0x7f67a0103470 2024-09-06T15:06:20.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.923+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f67a0198300 con 0x7f678c0774b0 2024-09-06T15:06:20.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.924+0000 7f6796ffd640 1 -- 172.21.15.52:0/3428281675 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f67a0198300 con 0x7f678c0774b0 2024-09-06T15:06:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f678c0774b0 msgr2=0x7f678c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f678c0774b0 0x7f678c079970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f679c0096c0 tx=0x7f679c004f30 comp rx=0 tx=0).stop 2024-09-06T15:06:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0103470 msgr2=0x7f67a019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0103470 0x7f67a019db90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f679000d6f0 tx=0x7f679000dbb0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 shutdown_connections 2024-09-06T15:06:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67a0103470 0x7f67a019db90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.926 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f678c0774b0 0x7f678c079970 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 --2- 172.21.15.52:0/3428281675 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f67a0102b50 0x7f67a019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.926+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 >> 172.21.15.52:0/3428281675 conn(0x7f67a00fc550 msgr2=0x7f67a0108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.927+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 shutdown_connections 2024-09-06T15:06:20.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:20.927+0000 7f67a7f43640 1 -- 172.21.15.52:0/3428281675 wait complete. 2024-09-06T15:06:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.009+0000 7f6df52ab640 1 -- 172.21.15.52:0/3612641235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01007f0 msgr2=0x7f6df0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.009+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3612641235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01007f0 0x7f6df0100c50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009880 tx=0x7f6dd802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.013 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.009+0000 7f6df52ab640 1 -- 172.21.15.52:0/3612641235 shutdown_connections 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.009+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3612641235 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01007f0 0x7f6df0100c50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.009+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3612641235 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6df01067f0 0x7f6df0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.009+0000 7f6df52ab640 1 -- 172.21.15.52:0/3612641235 >> 172.21.15.52:0/3612641235 conn(0x7f6df00fc550 msgr2=0x7f6df00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.009+0000 7f6df52ab640 1 -- 172.21.15.52:0/3612641235 shutdown_connections 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.010+0000 7f6df52ab640 1 -- 172.21.15.52:0/3612641235 wait complete. 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.010+0000 7f6df52ab640 1 Processor -- start 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.010+0000 7f6df52ab640 1 -- start start 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.010+0000 7f6df52ab640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6df01007f0 0x7f6df019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.010+0000 7f6df52ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01067f0 0x7f6df019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6df52ab640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6df010dcc0 con 0x7f6df01067f0 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6df52ab640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6df010db40 con 0x7f6df01007f0 2024-09-06T15:06:21.014 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6dee7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01067f0 0x7f6df019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6dee7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01067f0 0x7f6df019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58710/0 (socket says 172.21.15.52:58710) 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6dee7fc640 1 -- 172.21.15.52:0/3894688843 learned_addr learned my addr 172.21.15.52:0/3894688843 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6deeffd640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6df01007f0 0x7f6df019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6dee7fc640 1 -- 172.21.15.52:0/3894688843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6df01007f0 msgr2=0x7f6df019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6dee7fc640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6df01007f0 0x7f6df019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6dee7fc640 1 -- 172.21.15.52:0/3894688843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df01977e0 con 0x7f6df01067f0 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6deeffd640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6df01007f0 0x7f6df019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6dee7fc640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01067f0 0x7f6df019dba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8031460 tx=0x7f6dd80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6de7fff640 1 -- 172.21.15.52:0/3894688843 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dd803f070 con 0x7f6df01067f0 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6de7fff640 1 -- 172.21.15.52:0/3894688843 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dd8004cf0 con 0x7f6df01067f0 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df0197a70 con 0x7f6df01067f0 2024-09-06T15:06:21.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6de7fff640 1 -- 172.21.15.52:0/3894688843 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dd8035030 con 0x7f6df01067f0 2024-09-06T15:06:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.011+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df0197fa0 con 0x7f6df01067f0 2024-09-06T15:06:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.013+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df0101f30 con 0x7f6df01067f0 2024-09-06T15:06:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.013+0000 7f6de7fff640 1 -- 172.21.15.52:0/3894688843 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6dd8042070 con 0x7f6df01067f0 2024-09-06T15:06:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.014+0000 7f6de7fff640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6ddc077460 0x7f6ddc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.014+0000 7f6deeffd640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6ddc077460 0x7f6ddc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.014+0000 7f6de7fff640 1 -- 172.21.15.52:0/3894688843 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f6dd80ba230 con 0x7f6df01067f0 2024-09-06T15:06:21.016 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.014+0000 7f6deeffd640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6ddc077460 0x7f6ddc079920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6de80058c0 tx=0x7f6de8005d30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.018+0000 7f6de7fff640 1 -- 172.21.15.52:0/3894688843 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6dd8083190 con 0x7f6df01067f0 2024-09-06T15:06:21.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.187+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6df0198250 con 0x7f6ddc077460 2024-09-06T15:06:21.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.197+0000 7f6de7fff640 1 -- 172.21.15.52:0/3894688843 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6df0198250 con 0x7f6ddc077460 2024-09-06T15:06:21.196 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:06:21.196 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (18m) 13m ago 29m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (21m) 13m ago 29m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (21m) 12m ago 29m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (17m) 13m ago 29m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (16m) 12m ago 28m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (18m) 13m ago 29m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (13m) 13m ago 24m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (13m) 13m ago 24m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (12m) 12m ago 24m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (12m) 12m ago 24m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (20m) 13m ago 30m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (19m) 12m ago 28m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (17m) 13m ago 31m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:06:21.197 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (17m) 12m ago 28m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (19m) 13m ago 29m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (19m) 12m ago 28m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (16m) 13m ago 27m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (16m) 13m ago 27m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (15m) 13m ago 26m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (14m) 12m ago 26m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (14m) 12m ago 25m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (13m) 12m ago 25m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:06:21.198 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (19m) 13m ago 29m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:06:21.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6ddc077460 msgr2=0x7f6ddc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6ddc077460 0x7f6ddc079920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6de80058c0 tx=0x7f6de8005d30 comp rx=0 tx=0).stop 2024-09-06T15:06:21.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01067f0 msgr2=0x7f6df019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01067f0 0x7f6df019dba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8031460 tx=0x7f6dd80048f0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 shutdown_connections 2024-09-06T15:06:21.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6df01067f0 0x7f6df019dba0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6ddc077460 0x7f6ddc079920 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 --2- 172.21.15.52:0/3894688843 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6df01007f0 0x7f6df019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 >> 172.21.15.52:0/3894688843 conn(0x7f6df00fc550 msgr2=0x7f6df0069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:21.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 shutdown_connections 2024-09-06T15:06:21.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.199+0000 7f6df52ab640 1 -- 172.21.15.52:0/3894688843 wait complete. 2024-09-06T15:06:21.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 -- 172.21.15.52:0/3572406656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd588102ac0 msgr2=0x7fd588102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/3572406656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd588102ac0 0x7fd588102ea0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd578009c20 tx=0x7fd57802aa00 comp rx=0 tx=0).stop 2024-09-06T15:06:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 -- 172.21.15.52:0/3572406656 shutdown_connections 2024-09-06T15:06:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/3572406656 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd5881033e0 0x7fd58810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/3572406656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd588102ac0 0x7fd588102ea0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 -- 172.21.15.52:0/3572406656 >> 172.21.15.52:0/3572406656 conn(0x7fd5880fc520 msgr2=0x7fd5880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 -- 172.21.15.52:0/3572406656 shutdown_connections 2024-09-06T15:06:21.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 -- 172.21.15.52:0/3572406656 wait complete. 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.281+0000 7fd58e1d4640 1 Processor -- start 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd58e1d4640 1 -- start start 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd58e1d4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd588102ac0 0x7fd58819d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd58e1d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5881033e0 0x7fd58819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd58e1d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd58810ee50 con 0x7fd5881033e0 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd58e1d4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd58810ecd0 con 0x7fd588102ac0 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5881033e0 0x7fd58819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd586ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5881033e0 0x7fd58819dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58736/0 (socket says 172.21.15.52:58736) 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd586ffd640 1 -- 172.21.15.52:0/111122111 learned_addr learned my addr 172.21.15.52:0/111122111 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd5877fe640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd588102ac0 0x7fd58819d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd586ffd640 1 -- 172.21.15.52:0/111122111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd588102ac0 msgr2=0x7fd58819d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.282+0000 7fd586ffd640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd588102ac0 0x7fd58819d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.283+0000 7fd586ffd640 1 -- 172.21.15.52:0/111122111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd588197900 con 0x7fd5881033e0 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.283+0000 7fd586ffd640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5881033e0 0x7fd58819dc80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b370 tx=0x7fd57c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.283+0000 7fd584ff9640 1 -- 172.21.15.52:0/111122111 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd57c015020 con 0x7fd5881033e0 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.283+0000 7fd584ff9640 1 -- 172.21.15.52:0/111122111 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd57c011af0 con 0x7fd5881033e0 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.283+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd588197bf0 con 0x7fd5881033e0 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.283+0000 7fd584ff9640 1 -- 172.21.15.52:0/111122111 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd57c010d60 con 0x7fd5881033e0 2024-09-06T15:06:21.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.283+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd588198180 con 0x7fd5881033e0 2024-09-06T15:06:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.284+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd58806aa90 con 0x7fd5881033e0 2024-09-06T15:06:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.285+0000 7fd584ff9640 1 -- 172.21.15.52:0/111122111 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd57c018020 con 0x7fd5881033e0 2024-09-06T15:06:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.285+0000 7fd584ff9640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd570077460 0x7fd570079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.286+0000 7fd584ff9640 1 -- 172.21.15.52:0/111122111 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd57c0990b0 con 0x7fd5881033e0 2024-09-06T15:06:21.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.286+0000 7fd5877fe640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd570077460 0x7fd570079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.286+0000 7fd5877fe640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd570077460 0x7fd570079920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd578009430 tx=0x7fd57803a040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.290+0000 7fd584ff9640 1 -- 172.21.15.52:0/111122111 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd57c01f020 con 0x7fd5881033e0 2024-09-06T15:06:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.509+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd588198e30 con 0x7fd5881033e0 2024-09-06T15:06:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.510+0000 7fd584ff9640 1 -- 172.21.15.52:0/111122111 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd57c062010 con 0x7fd5881033e0 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:06:21.510 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:21.511 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:06:21.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:06:21.511 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:21.511 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:06:21.511 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:06:21.511 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:06:21.511 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd570077460 msgr2=0x7fd570079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd570077460 0x7fd570079920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd578009430 tx=0x7fd57803a040 comp rx=0 tx=0).stop 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5881033e0 msgr2=0x7fd58819dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5881033e0 0x7fd58819dc80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00b370 tx=0x7fd57c00b830 comp rx=0 tx=0).stop 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 shutdown_connections 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd5881033e0 0x7fd58819dc80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd570077460 0x7fd570079920 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 --2- 172.21.15.52:0/111122111 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd588102ac0 0x7fd58819d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 >> 172.21.15.52:0/111122111 conn(0x7fd5880fc520 msgr2=0x7fd588103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 shutdown_connections 2024-09-06T15:06:21.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.512+0000 7fd58e1d4640 1 -- 172.21.15.52:0/111122111 wait complete. 2024-09-06T15:06:21.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 -- 172.21.15.52:0/2616927267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 msgr2=0x7fcd00106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 --2- 172.21.15.52:0/2616927267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00106be0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009880 tx=0x7fccf402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 -- 172.21.15.52:0/2616927267 shutdown_connections 2024-09-06T15:06:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 --2- 172.21.15.52:0/2616927267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd00100800 0x7fcd00100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 --2- 172.21.15.52:0/2616927267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00106be0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 -- 172.21.15.52:0/2616927267 >> 172.21.15.52:0/2616927267 conn(0x7fcd000fc520 msgr2=0x7fcd000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 -- 172.21.15.52:0/2616927267 shutdown_connections 2024-09-06T15:06:21.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.595+0000 7fcd06d62640 1 -- 172.21.15.52:0/2616927267 wait complete. 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fcd06d62640 1 Processor -- start 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fcd06d62640 1 -- start start 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fcd06d62640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd00100800 0x7fcd00198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fcd06d62640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fcd06d62640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0010dd30 con 0x7fcd00106800 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fcd06d62640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0010dbb0 con 0x7fcd00100800 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fccfffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fccfffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58750/0 (socket says 172.21.15.52:58750) 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fccfffff640 1 -- 172.21.15.52:0/1195417373 learned_addr learned my addr 172.21.15.52:0/1195417373 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:21.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fcd04afe640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd00100800 0x7fcd00198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fccfffff640 1 -- 172.21.15.52:0/1195417373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd00100800 msgr2=0x7fcd00198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fccfffff640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd00100800 0x7fcd00198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.596+0000 7fccfffff640 1 -- 172.21.15.52:0/1195417373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd001993a0 con 0x7fcd00106800 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.597+0000 7fccfffff640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00198da0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fccec00b420 tx=0x7fccec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.597+0000 7fccfdffb640 1 -- 172.21.15.52:0/1195417373 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccec011630 con 0x7fcd00106800 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.597+0000 7fccfdffb640 1 -- 172.21.15.52:0/1195417373 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccec016070 con 0x7fcd00106800 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.597+0000 7fccfdffb640 1 -- 172.21.15.52:0/1195417373 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccec010d40 con 0x7fcd00106800 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.597+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd00199690 con 0x7fcd00106800 2024-09-06T15:06:21.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.597+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd001a1c90 con 0x7fcd00106800 2024-09-06T15:06:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.598+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd00101f40 con 0x7fcd00106800 2024-09-06T15:06:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.599+0000 7fccfdffb640 1 -- 172.21.15.52:0/1195417373 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fccec01b460 con 0x7fcd00106800 2024-09-06T15:06:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.600+0000 7fccfdffb640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccf0077460 0x7fccf0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.600+0000 7fcd04afe640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccf0077460 0x7fccf0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.600+0000 7fccfdffb640 1 -- 172.21.15.52:0/1195417373 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fccec098f80 con 0x7fcd00106800 2024-09-06T15:06:21.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.601+0000 7fcd04afe640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccf0077460 0x7fccf0079920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fccf40096c0 tx=0x7fccf4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.604+0000 7fccfdffb640 1 -- 172.21.15.52:0/1195417373 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fcd00199690 con 0x7fcd00106800 2024-09-06T15:06:21.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.786+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcd00108d70 con 0x7fcd00106800 2024-09-06T15:06:21.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.787+0000 7fccfdffb640 1 -- 172.21.15.52:0/1195417373 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7fccec082e20 con 0x7fcd00106800 2024-09-06T15:06:21.786 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:06:21.787 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:06:21.788 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:06:21.789 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:21.790 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:21.790 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:06:21.790 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:21.790 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:21.790 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:21.790 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:21.790 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccf0077460 msgr2=0x7fccf0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccf0077460 0x7fccf0079920 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fccf40096c0 tx=0x7fccf4031400 comp rx=0 tx=0).stop 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 msgr2=0x7fcd00198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00198da0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fccec00b420 tx=0x7fccec00b8e0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 shutdown_connections 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd00106800 0x7fcd00198da0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fccf0077460 0x7fccf0079920 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 --2- 172.21.15.52:0/1195417373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcd00100800 0x7fcd00198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.791 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 >> 172.21.15.52:0/1195417373 conn(0x7fcd000fc520 msgr2=0x7fcd000fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:21.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 shutdown_connections 2024-09-06T15:06:21.792 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.789+0000 7fcd06d62640 1 -- 172.21.15.52:0/1195417373 wait complete. 2024-09-06T15:06:21.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.874+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/1502017416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581007f0 msgr2=0x7f3e58100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.874+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/1502017416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581007f0 0x7f3e58100c50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c009880 tx=0x7f3e4c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.874 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.874+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/1502017416 shutdown_connections 2024-09-06T15:06:21.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.874+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/1502017416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581007f0 0x7f3e58100c50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.874+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/1502017416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e581067f0 0x7f3e58106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.874+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/1502017416 >> 172.21.15.52:0/1502017416 conn(0x7f3e580fc550 msgr2=0x7f3e580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:21.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.875+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/1502017416 shutdown_connections 2024-09-06T15:06:21.875 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.875+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/1502017416 wait complete. 2024-09-06T15:06:21.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:21 smithi052 ceph-mon[112917]: pgmap v663: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:21.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:21 smithi052 ceph-mon[112917]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:21.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:21 smithi052 ceph-mon[112917]: from='client.35058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:21.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:21 smithi052 ceph-mon[112917]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:21.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:21 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/111122111' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:06:21.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:21 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1195417373' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:06:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.875+0000 7f3e5e6f8640 1 Processor -- start 2024-09-06T15:06:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.875+0000 7f3e5e6f8640 1 -- start start 2024-09-06T15:06:21.877 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e5e6f8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e581007f0 0x7f3e5819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e5e6f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581067f0 0x7f3e5819db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e5e6f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5810dca0 con 0x7f3e581067f0 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e5e6f8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5810db20 con 0x7f3e581007f0 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581067f0 0x7f3e5819db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581067f0 0x7f3e5819db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58778/0 (socket says 172.21.15.52:58778) 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e577fe640 1 -- 172.21.15.52:0/2202457776 learned_addr learned my addr 172.21.15.52:0/2202457776 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e57fff640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e581007f0 0x7f3e5819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e577fe640 1 -- 172.21.15.52:0/2202457776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e581007f0 msgr2=0x7f3e5819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e577fe640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e581007f0 0x7f3e5819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e577fe640 1 -- 172.21.15.52:0/2202457776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e58197780 con 0x7f3e581067f0 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.876+0000 7f3e577fe640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581067f0 0x7f3e5819db40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c031460 tx=0x7f3e4c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.877+0000 7f3e557fa640 1 -- 172.21.15.52:0/2202457776 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e4c03f070 con 0x7f3e581067f0 2024-09-06T15:06:21.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.877+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e58197a10 con 0x7f3e581067f0 2024-09-06T15:06:21.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.877+0000 7f3e557fa640 1 -- 172.21.15.52:0/2202457776 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e4c004cf0 con 0x7f3e581067f0 2024-09-06T15:06:21.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.877+0000 7f3e557fa640 1 -- 172.21.15.52:0/2202457776 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e4c035030 con 0x7f3e581067f0 2024-09-06T15:06:21.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.877+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e58197f40 con 0x7f3e581067f0 2024-09-06T15:06:21.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.878+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e58101f30 con 0x7f3e581067f0 2024-09-06T15:06:21.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.878+0000 7f3e557fa640 1 -- 172.21.15.52:0/2202457776 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3e4c042070 con 0x7f3e581067f0 2024-09-06T15:06:21.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.879+0000 7f3e557fa640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e40077460 0x7f3e40079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:21.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.879+0000 7f3e557fa640 1 -- 172.21.15.52:0/2202457776 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3e4c0ba220 con 0x7f3e581067f0 2024-09-06T15:06:21.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.879+0000 7f3e57fff640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e40077460 0x7f3e40079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:21.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.880+0000 7f3e57fff640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e40077460 0x7f3e40079920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e480058c0 tx=0x7f3e4800a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:21.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:21.883+0000 7f3e557fa640 1 -- 172.21.15.52:0/2202457776 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3e4c087250 con 0x7f3e581067f0 2024-09-06T15:06:22.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.061+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3e581982b0 con 0x7f3e40077460 2024-09-06T15:06:22.061 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.062+0000 7f3e557fa640 1 -- 172.21.15.52:0/2202457776 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3e581982b0 con 0x7f3e40077460 2024-09-06T15:06:22.061 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:06:22.062 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:06:22.063 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:06:22.063 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:06:22.063 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:06:22.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e40077460 msgr2=0x7f3e40079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e40077460 0x7f3e40079920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3e480058c0 tx=0x7f3e4800a2d0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581067f0 msgr2=0x7f3e5819db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581067f0 0x7f3e5819db40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c031460 tx=0x7f3e4c0048f0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 shutdown_connections 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e581067f0 0x7f3e5819db40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3e40077460 0x7f3e40079920 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 --2- 172.21.15.52:0/2202457776 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e581007f0 0x7f3e5819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 >> 172.21.15.52:0/2202457776 conn(0x7f3e580fc550 msgr2=0x7f3e58069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 shutdown_connections 2024-09-06T15:06:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.064+0000 7f3e5e6f8640 1 -- 172.21.15.52:0/2202457776 wait complete. 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/4072903405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102b60 msgr2=0x7f5dd4102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/4072903405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102b60 0x7f5dd4102f40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009c20 tx=0x7f5dc402aa00 comp rx=0 tx=0).stop 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/4072903405 shutdown_connections 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/4072903405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd4103480 0x7f5dd410b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/4072903405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4102b60 0x7f5dd4102f40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/4072903405 >> 172.21.15.52:0/4072903405 conn(0x7f5dd40fc520 msgr2=0x7f5dd40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/4072903405 shutdown_connections 2024-09-06T15:06:22.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.147+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/4072903405 wait complete. 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd8a3c640 1 Processor -- start 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd8a3c640 1 -- start start 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd8a3c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd4102b60 0x7f5dd419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd8a3c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4103480 0x7f5dd419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd8a3c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410edd0 con 0x7f5dd4103480 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd8a3c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410ec50 con 0x7f5dd4102b60 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4103480 0x7f5dd419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4103480 0x7f5dd419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:58796/0 (socket says 172.21.15.52:58796) 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.148+0000 7f5dd1d9b640 1 -- 172.21.15.52:0/2872166915 learned_addr learned my addr 172.21.15.52:0/2872166915 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:22.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dd259c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd4102b60 0x7f5dd419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dd1d9b640 1 -- 172.21.15.52:0/2872166915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd4102b60 msgr2=0x7f5dd419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dd1d9b640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd4102b60 0x7f5dd419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dd1d9b640 1 -- 172.21.15.52:0/2872166915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd41977e0 con 0x7f5dd4103480 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dd1d9b640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4103480 0x7f5dd419dba0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800d8d0 tx=0x7f5dc800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dc37fe640 1 -- 172.21.15.52:0/2872166915 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dc8017070 con 0x7f5dd4103480 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dc37fe640 1 -- 172.21.15.52:0/2872166915 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5dc8010460 con 0x7f5dd4103480 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd4197ad0 con 0x7f5dd4103480 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dc37fe640 1 -- 172.21.15.52:0/2872166915 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dc800f5f0 con 0x7f5dd4103480 2024-09-06T15:06:22.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.149+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd4198060 con 0x7f5dd4103480 2024-09-06T15:06:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.150+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd406a9f0 con 0x7f5dd4103480 2024-09-06T15:06:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.151+0000 7f5dc37fe640 1 -- 172.21.15.52:0/2872166915 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5dc8009a30 con 0x7f5dd4103480 2024-09-06T15:06:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.152+0000 7f5dc37fe640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dbc0774b0 0x7f5dbc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.152+0000 7f5dd259c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dbc0774b0 0x7f5dbc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:22.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.152+0000 7f5dc37fe640 1 -- 172.21.15.52:0/2872166915 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f5dc8099570 con 0x7f5dd4103480 2024-09-06T15:06:22.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.152+0000 7f5dd259c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dbc0774b0 0x7f5dbc079970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009430 tx=0x7f5dc403a040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:22.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.156+0000 7f5dc37fe640 1 -- 172.21.15.52:0/2872166915 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5dc80666c0 con 0x7f5dd4103480 2024-09-06T15:06:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:21 smithi165 ceph-mon[82925]: pgmap v663: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:21 smithi165 ceph-mon[82925]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:21 smithi165 ceph-mon[82925]: from='client.35058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:21 smithi165 ceph-mon[82925]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:21 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/111122111' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:06:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:21 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1195417373' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:06:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.373+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5dd4198d10 con 0x7f5dd4103480 2024-09-06T15:06:22.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.374+0000 7f5dc37fe640 1 -- 172.21.15.52:0/2872166915 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f5dc806b0e0 con 0x7f5dd4103480 2024-09-06T15:06:22.373 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:06:22.374 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:06:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.375+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dbc0774b0 msgr2=0x7f5dbc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.375+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dbc0774b0 0x7f5dbc079970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009430 tx=0x7f5dc403a040 comp rx=0 tx=0).stop 2024-09-06T15:06:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.375+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4103480 msgr2=0x7f5dd419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.375+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4103480 0x7f5dd419dba0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800d8d0 tx=0x7f5dc800dd90 comp rx=0 tx=0).stop 2024-09-06T15:06:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.376+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 shutdown_connections 2024-09-06T15:06:22.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.376+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5dd4103480 0x7f5dd419dba0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.376+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dbc0774b0 0x7f5dbc079970 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.376+0000 7f5dd8a3c640 1 --2- 172.21.15.52:0/2872166915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5dd4102b60 0x7f5dd419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.376+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 >> 172.21.15.52:0/2872166915 conn(0x7f5dd40fc520 msgr2=0x7f5dd4108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.376+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 shutdown_connections 2024-09-06T15:06:22.376 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:22.376+0000 7f5dd8a3c640 1 -- 172.21.15.52:0/2872166915 wait complete. 2024-09-06T15:06:23.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:22 smithi052 ceph-mon[112917]: from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:23.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:22 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2872166915' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:06:23.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:22 smithi165 ceph-mon[82925]: from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:22 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2872166915' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:06:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:24.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:23 smithi052 ceph-mon[112917]: pgmap v664: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:24.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:23 smithi165 ceph-mon[82925]: pgmap v664: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:25.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:25 smithi052 ceph-mon[112917]: pgmap v665: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:26.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:25 smithi165 ceph-mon[82925]: pgmap v665: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:28.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:27 smithi052 ceph-mon[112917]: pgmap v666: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:28.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:27 smithi165 ceph-mon[82925]: pgmap v666: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:30.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:29 smithi052 ceph-mon[112917]: pgmap v667: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:29 smithi165 ceph-mon[82925]: pgmap v667: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:32.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:31 smithi052 ceph-mon[112917]: pgmap v668: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:32.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:31 smithi165 ceph-mon[82925]: pgmap v668: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:34.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:33 smithi052 ceph-mon[112917]: pgmap v669: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:34.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:33 smithi165 ceph-mon[82925]: pgmap v669: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:36.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:35 smithi052 ceph-mon[112917]: pgmap v670: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:36.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:35 smithi165 ceph-mon[82925]: pgmap v670: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:37 smithi052 ceph-mon[112917]: pgmap v671: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:37 smithi165 ceph-mon[82925]: pgmap v671: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:40.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:39 smithi052 ceph-mon[112917]: pgmap v672: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:40.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:39 smithi165 ceph-mon[82925]: pgmap v672: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:42.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:41 smithi165 ceph-mon[82925]: pgmap v673: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:42.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:41 smithi052 ceph-mon[112917]: pgmap v673: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:44.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:43 smithi165 ceph-mon[82925]: pgmap v674: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:44.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:43 smithi052 ceph-mon[112917]: pgmap v674: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:46.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:45 smithi052 ceph-mon[112917]: pgmap v675: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:46.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:45 smithi165 ceph-mon[82925]: pgmap v675: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:48.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:47 smithi165 ceph-mon[82925]: pgmap v676: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:48.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:47 smithi052 ceph-mon[112917]: pgmap v676: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:50.170 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:49 smithi052 ceph-mon[112917]: pgmap v677: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:50.272 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:49 smithi165 ceph-mon[82925]: pgmap v677: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:52.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:51 smithi052 ceph-mon[112917]: pgmap v678: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:52.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:51 smithi165 ceph-mon[82925]: pgmap v678: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:52.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 -- 172.21.15.52:0/2299218353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0101900 msgr2=0x7f79a0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 --2- 172.21.15.52:0/2299218353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0101900 0x7f79a0101d60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7988009880 tx=0x7f798802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 -- 172.21.15.52:0/2299218353 shutdown_connections 2024-09-06T15:06:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 --2- 172.21.15.52:0/2299218353 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0101900 0x7f79a0101d60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 --2- 172.21.15.52:0/2299218353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79a0107900 0x7f79a0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 -- 172.21.15.52:0/2299218353 >> 172.21.15.52:0/2299218353 conn(0x7f79a00fd600 msgr2=0x7f79a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 -- 172.21.15.52:0/2299218353 shutdown_connections 2024-09-06T15:06:52.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.473+0000 7f79a6388640 1 -- 172.21.15.52:0/2299218353 wait complete. 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f79a6388640 1 Processor -- start 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f79a6388640 1 -- start start 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f79a6388640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79a0101900 0x7f79a00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f79a6388640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0107900 0x7f79a0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f79a6388640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f79a010edb0 con 0x7f79a0107900 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f79a6388640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79a010ec30 con 0x7f79a0101900 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f7997fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0107900 0x7f79a0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:52.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f7997fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0107900 0x7f79a0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35572/0 (socket says 172.21.15.52:35572) 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f7997fff640 1 -- 172.21.15.52:0/149536213 learned_addr learned my addr 172.21.15.52:0/149536213 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f799ffff640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79a0101900 0x7f79a00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f7997fff640 1 -- 172.21.15.52:0/149536213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79a0101900 msgr2=0x7f79a00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f7997fff640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79a0101900 0x7f79a00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.474+0000 7f7997fff640 1 -- 172.21.15.52:0/149536213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a0074f70 con 0x7f79a0107900 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.475+0000 7f7997fff640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0107900 0x7f79a0074a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7988031460 tx=0x7f79880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.475+0000 7f799dffb640 1 -- 172.21.15.52:0/149536213 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f798803f070 con 0x7f79a0107900 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.475+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a0075200 con 0x7f79a0107900 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.475+0000 7f799dffb640 1 -- 172.21.15.52:0/149536213 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79880035f0 con 0x7f79a0107900 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.475+0000 7f799dffb640 1 -- 172.21.15.52:0/149536213 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7988035030 con 0x7f79a0107900 2024-09-06T15:06:52.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.475+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a01a3d90 con 0x7f79a0107900 2024-09-06T15:06:52.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.476+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a0103040 con 0x7f79a0107900 2024-09-06T15:06:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.477+0000 7f799dffb640 1 -- 172.21.15.52:0/149536213 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7988042070 con 0x7f79a0107900 2024-09-06T15:06:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.477+0000 7f799dffb640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f798c077460 0x7f798c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.477+0000 7f799dffb640 1 -- 172.21.15.52:0/149536213 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f79880ba0c0 con 0x7f79a0107900 2024-09-06T15:06:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.477+0000 7f799ffff640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f798c077460 0x7f798c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:52.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.478+0000 7f799ffff640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f798c077460 0x7f798c079920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f799000bbe0 tx=0x7f799000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:52.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.481+0000 7f799dffb640 1 -- 172.21.15.52:0/149536213 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7988087190 con 0x7f79a0107900 2024-09-06T15:06:52.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.660+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f79a0062630 con 0x7f798c077460 2024-09-06T15:06:52.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.661+0000 7f799dffb640 1 -- 172.21.15.52:0/149536213 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f79a0062630 con 0x7f798c077460 2024-09-06T15:06:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f798c077460 msgr2=0x7f798c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f798c077460 0x7f798c079920 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f799000bbe0 tx=0x7f799000b390 comp rx=0 tx=0).stop 2024-09-06T15:06:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0107900 msgr2=0x7f79a0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0107900 0x7f79a0074a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7988031460 tx=0x7f79880045e0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 shutdown_connections 2024-09-06T15:06:52.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f79a0107900 0x7f79a0074a30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f798c077460 0x7f798c079920 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 --2- 172.21.15.52:0/149536213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79a0101900 0x7f79a00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 >> 172.21.15.52:0/149536213 conn(0x7f79a00fd600 msgr2=0x7f79a00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:52.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 shutdown_connections 2024-09-06T15:06:52.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.663+0000 7f79a6388640 1 -- 172.21.15.52:0/149536213 wait complete. 2024-09-06T15:06:52.672 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 -- 172.21.15.52:0/396673521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1067f0 msgr2=0x7fd69c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/396673521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1067f0 0x7fd69c106bd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009880 tx=0x7fd68c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 -- 172.21.15.52:0/396673521 shutdown_connections 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/396673521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd69c1007f0 0x7fd69c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/396673521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1067f0 0x7fd69c106bd0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 -- 172.21.15.52:0/396673521 >> 172.21.15.52:0/396673521 conn(0x7fd69c0fc550 msgr2=0x7fd69c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 -- 172.21.15.52:0/396673521 shutdown_connections 2024-09-06T15:06:52.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 -- 172.21.15.52:0/396673521 wait complete. 2024-09-06T15:06:52.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.748+0000 7fd6a0dca640 1 Processor -- start 2024-09-06T15:06:52.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd6a0dca640 1 -- start start 2024-09-06T15:06:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd6a0dca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1007f0 0x7fd69c19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd6a0dca640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd69c1067f0 0x7fd69c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:52.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd6a0dca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c10dca0 con 0x7fd69c1007f0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd6a0dca640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c10db20 con 0x7fd69c1067f0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd69a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1007f0 0x7fd69c19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd69a59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1007f0 0x7fd69c19f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35592/0 (socket says 172.21.15.52:35592) 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd69a59c640 1 -- 172.21.15.52:0/2172725191 learned_addr learned my addr 172.21.15.52:0/2172725191 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd693fff640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd69c1067f0 0x7fd69c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd69a59c640 1 -- 172.21.15.52:0/2172725191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd69c1067f0 msgr2=0x7fd69c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd69a59c640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd69c1067f0 0x7fd69c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd69a59c640 1 -- 172.21.15.52:0/2172725191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c1a03a0 con 0x7fd69c1007f0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.749+0000 7fd69a59c640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1007f0 0x7fd69c19f7b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd68c031460 tx=0x7fd68c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.750+0000 7fd6937fe640 1 -- 172.21.15.52:0/2172725191 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd68c03f070 con 0x7fd69c1007f0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.750+0000 7fd6937fe640 1 -- 172.21.15.52:0/2172725191 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd68c004cf0 con 0x7fd69c1007f0 2024-09-06T15:06:52.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.750+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c199a30 con 0x7fd69c1007f0 2024-09-06T15:06:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.750+0000 7fd6937fe640 1 -- 172.21.15.52:0/2172725191 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd68c035030 con 0x7fd69c1007f0 2024-09-06T15:06:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.750+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c199f30 con 0x7fd69c1007f0 2024-09-06T15:06:52.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.751+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c101f30 con 0x7fd69c1007f0 2024-09-06T15:06:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.752+0000 7fd6937fe640 1 -- 172.21.15.52:0/2172725191 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd68c042070 con 0x7fd69c1007f0 2024-09-06T15:06:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.752+0000 7fd6937fe640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd688077460 0x7fd688079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.753+0000 7fd6937fe640 1 -- 172.21.15.52:0/2172725191 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd68c0ba2b0 con 0x7fd69c1007f0 2024-09-06T15:06:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.753+0000 7fd693fff640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd688077460 0x7fd688079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:52.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.753+0000 7fd693fff640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd688077460 0x7fd688079920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ffb80 tx=0x7fd68400a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:52.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.756+0000 7fd6937fe640 1 -- 172.21.15.52:0/2172725191 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd68c083170 con 0x7fd69c1007f0 2024-09-06T15:06:52.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.935+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd69c19a250 con 0x7fd688077460 2024-09-06T15:06:52.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.937+0000 7fd6937fe640 1 -- 172.21.15.52:0/2172725191 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd69c19a250 con 0x7fd688077460 2024-09-06T15:06:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd688077460 msgr2=0x7fd688079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd688077460 0x7fd688079920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0ffb80 tx=0x7fd68400a2d0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1007f0 msgr2=0x7fd69c19f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:52.939 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1007f0 0x7fd69c19f7b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd68c031460 tx=0x7fd68c0048f0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 shutdown_connections 2024-09-06T15:06:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd688077460 0x7fd688079920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd69c1067f0 0x7fd69c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 --2- 172.21.15.52:0/2172725191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd69c1007f0 0x7fd69c19f7b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:52.940 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 >> 172.21.15.52:0/2172725191 conn(0x7fd69c0fc550 msgr2=0x7fd69c069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 shutdown_connections 2024-09-06T15:06:52.941 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:52.939+0000 7fd6a0dca640 1 -- 172.21.15.52:0/2172725191 wait complete. 2024-09-06T15:06:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 -- 172.21.15.52:0/89327184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda041033e0 msgr2=0x7fda0410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/89327184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda041033e0 0x7fda0410b8d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009880 tx=0x7fd9f802a530 comp rx=0 tx=0).stop 2024-09-06T15:06:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 -- 172.21.15.52:0/89327184 shutdown_connections 2024-09-06T15:06:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/89327184 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda041033e0 0x7fda0410b8d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/89327184 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda04102ac0 0x7fda04102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 -- 172.21.15.52:0/89327184 >> 172.21.15.52:0/89327184 conn(0x7fda040fc520 msgr2=0x7fda040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:53.023 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:53.027 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 -- 172.21.15.52:0/89327184 shutdown_connections 2024-09-06T15:06:53.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.022+0000 7fda0a1fe640 1 -- 172.21.15.52:0/89327184 wait complete. 2024-09-06T15:06:53.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.023+0000 7fda0a1fe640 1 Processor -- start 2024-09-06T15:06:53.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.023+0000 7fda0a1fe640 1 -- start start 2024-09-06T15:06:53.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.023+0000 7fda0a1fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda04102ac0 0x7fda0419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.028 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.023+0000 7fda0a1fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda041033e0 0x7fda0419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.023+0000 7fda0a1fe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda0410ee50 con 0x7fda04102ac0 2024-09-06T15:06:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.023+0000 7fda0a1fe640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fda0410ecd0 con 0x7fda041033e0 2024-09-06T15:06:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda04102ac0 0x7fda0419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda04102ac0 0x7fda0419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35608/0 (socket says 172.21.15.52:35608) 2024-09-06T15:06:53.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda037fe640 1 -- 172.21.15.52:0/1770011494 learned_addr learned my addr 172.21.15.52:0/1770011494 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:53.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda02ffd640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda041033e0 0x7fda0419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda037fe640 1 -- 172.21.15.52:0/1770011494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda041033e0 msgr2=0x7fda0419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda037fe640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda041033e0 0x7fda0419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda037fe640 1 -- 172.21.15.52:0/1770011494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda04197840 con 0x7fda04102ac0 2024-09-06T15:06:53.030 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda037fe640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda04102ac0 0x7fda0419d6c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400b420 tx=0x7fd9f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda00ff9640 1 -- 172.21.15.52:0/1770011494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f4011630 con 0x7fda04102ac0 2024-09-06T15:06:53.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda00ff9640 1 -- 172.21.15.52:0/1770011494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9f4016070 con 0x7fda04102ac0 2024-09-06T15:06:53.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda04197b30 con 0x7fda04102ac0 2024-09-06T15:06:53.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda04198090 con 0x7fda04102ac0 2024-09-06T15:06:53.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.024+0000 7fda00ff9640 1 -- 172.21.15.52:0/1770011494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f4010d40 con 0x7fda04102ac0 2024-09-06T15:06:53.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.026+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0406aa90 con 0x7fda04102ac0 2024-09-06T15:06:53.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.026+0000 7fda00ff9640 1 -- 172.21.15.52:0/1770011494 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd9f401b460 con 0x7fda04102ac0 2024-09-06T15:06:53.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.026+0000 7fda00ff9640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd9ec0774b0 0x7fd9ec079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.027+0000 7fda00ff9640 1 -- 172.21.15.52:0/1770011494 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd9f4098ea0 con 0x7fda04102ac0 2024-09-06T15:06:53.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.027+0000 7fda02ffd640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd9ec0774b0 0x7fd9ec079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.027+0000 7fda02ffd640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd9ec0774b0 0x7fd9ec079970 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda04198b90 tx=0x7fd9f8031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.033 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.031+0000 7fda00ff9640 1 -- 172.21.15.52:0/1770011494 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd9f4061e80 con 0x7fda04102ac0 2024-09-06T15:06:53.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.198+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fda041983a0 con 0x7fd9ec0774b0 2024-09-06T15:06:53.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.208+0000 7fda00ff9640 1 -- 172.21.15.52:0/1770011494 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fda041983a0 con 0x7fd9ec0774b0 2024-09-06T15:06:53.207 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:06:53.207 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (19m) 13m ago 30m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:06:53.207 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (22m) 13m ago 30m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:06:53.207 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (21m) 13m ago 29m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (17m) 13m ago 30m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (17m) 13m ago 29m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (18m) 13m ago 29m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (13m) 13m ago 25m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (13m) 13m ago 24m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (13m) 13m ago 24m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (13m) 13m ago 24m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (21m) 13m ago 31m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (20m) 13m ago 29m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (18m) 13m ago 31m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (17m) 13m ago 29m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (20m) 13m ago 30m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:06:53.208 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (20m) 13m ago 29m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:06:53.209 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (17m) 13m ago 28m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:06:53.209 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (16m) 13m ago 27m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:06:53.209 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (15m) 13m ago 27m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:06:53.209 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (15m) 13m ago 26m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:06:53.209 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (14m) 13m ago 26m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:06:53.209 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (14m) 13m ago 26m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:06:53.209 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (19m) 13m ago 29m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd9ec0774b0 msgr2=0x7fd9ec079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd9ec0774b0 0x7fd9ec079970 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fda04198b90 tx=0x7fd9f8031400 comp rx=0 tx=0).stop 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda04102ac0 msgr2=0x7fda0419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda04102ac0 0x7fda0419d6c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400b420 tx=0x7fd9f400b8e0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 shutdown_connections 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd9ec0774b0 0x7fd9ec079970 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fda041033e0 0x7fda0419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 --2- 172.21.15.52:0/1770011494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda04102ac0 0x7fda0419d6c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 >> 172.21.15.52:0/1770011494 conn(0x7fda040fc520 msgr2=0x7fda04108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:53.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 shutdown_connections 2024-09-06T15:06:53.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.210+0000 7fda0a1fe640 1 -- 172.21.15.52:0/1770011494 wait complete. 2024-09-06T15:06:53.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.291+0000 7f7735c39640 1 -- 172.21.15.52:0/3380957358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730103470 msgr2=0x7f773010b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.291+0000 7f7735c39640 1 --2- 172.21.15.52:0/3380957358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730103470 0x7f773010b960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7724009880 tx=0x7f772402a530 comp rx=0 tx=0).stop 2024-09-06T15:06:53.291 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.292+0000 7f7735c39640 1 -- 172.21.15.52:0/3380957358 shutdown_connections 2024-09-06T15:06:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.292+0000 7f7735c39640 1 --2- 172.21.15.52:0/3380957358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730103470 0x7f773010b960 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.292+0000 7f7735c39640 1 --2- 172.21.15.52:0/3380957358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7730102b50 0x7f7730102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.292+0000 7f7735c39640 1 -- 172.21.15.52:0/3380957358 >> 172.21.15.52:0/3380957358 conn(0x7f77300fc4d0 msgr2=0x7f77300fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.292+0000 7f7735c39640 1 -- 172.21.15.52:0/3380957358 shutdown_connections 2024-09-06T15:06:53.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.292+0000 7f7735c39640 1 -- 172.21.15.52:0/3380957358 wait complete. 2024-09-06T15:06:53.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.292+0000 7f7735c39640 1 Processor -- start 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f7735c39640 1 -- start start 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f7735c39640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730102b50 0x7f773019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f7735c39640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7730103470 0x7f773019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f7735c39640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f773010ede0 con 0x7f7730102b50 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f7735c39640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f773010ec60 con 0x7f7730103470 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730102b50 0x7f773019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730102b50 0x7f773019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35628/0 (socket says 172.21.15.52:35628) 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772f7fe640 1 -- 172.21.15.52:0/3333844535 learned_addr learned my addr 172.21.15.52:0/3333844535 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772effd640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7730103470 0x7f773019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772f7fe640 1 -- 172.21.15.52:0/3333844535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7730103470 msgr2=0x7f773019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772f7fe640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7730103470 0x7f773019dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772f7fe640 1 -- 172.21.15.52:0/3333844535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7730197890 con 0x7f7730102b50 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.293+0000 7f772f7fe640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730102b50 0x7f773019d6d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f772000e970 tx=0x7f772000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.294+0000 7f772cff9640 1 -- 172.21.15.52:0/3333844535 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f772000cac0 con 0x7f7730102b50 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.294+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7730197b80 con 0x7f7730102b50 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.294+0000 7f772cff9640 1 -- 172.21.15.52:0/3333844535 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77200054e0 con 0x7f7730102b50 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.294+0000 7f772cff9640 1 -- 172.21.15.52:0/3333844535 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7720010430 con 0x7f7730102b50 2024-09-06T15:06:53.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.294+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77301980e0 con 0x7f7730102b50 2024-09-06T15:06:53.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.295+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f773006ad00 con 0x7f7730102b50 2024-09-06T15:06:53.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.295+0000 7f772cff9640 1 -- 172.21.15.52:0/3333844535 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7720004f00 con 0x7f7730102b50 2024-09-06T15:06:53.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.296+0000 7f772cff9640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77180774b0 0x7f7718079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.296+0000 7f772effd640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77180774b0 0x7f7718079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.296+0000 7f772cff9640 1 -- 172.21.15.52:0/3333844535 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7720099d50 con 0x7f7730102b50 2024-09-06T15:06:53.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.297+0000 7f772effd640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77180774b0 0x7f7718079970 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7730199080 tx=0x7f7724004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.300 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.301+0000 7f772cff9640 1 -- 172.21.15.52:0/3333844535 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f772009d030 con 0x7f7730102b50 2024-09-06T15:06:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:06:53.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.524+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7730198dc0 con 0x7f7730102b50 2024-09-06T15:06:53.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.524+0000 7f772cff9640 1 -- 172.21.15.52:0/3333844535 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7720062d30 con 0x7f7730102b50 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:06:53.524 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:53.525 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:06:53.525 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:06:53.525 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:06:53.525 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:06:53.525 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:06:53.525 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:06:53.525 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:06:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77180774b0 msgr2=0x7f7718079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77180774b0 0x7f7718079970 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7730199080 tx=0x7f7724004f30 comp rx=0 tx=0).stop 2024-09-06T15:06:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730102b50 msgr2=0x7f773019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730102b50 0x7f773019d6d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f772000e970 tx=0x7f772000ed70 comp rx=0 tx=0).stop 2024-09-06T15:06:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 shutdown_connections 2024-09-06T15:06:53.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f77180774b0 0x7f7718079970 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7730103470 0x7f773019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 --2- 172.21.15.52:0/3333844535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7730102b50 0x7f773019d6d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 >> 172.21.15.52:0/3333844535 conn(0x7f77300fc4d0 msgr2=0x7f7730103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 shutdown_connections 2024-09-06T15:06:53.527 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.526+0000 7f7735c39640 1 -- 172.21.15.52:0/3333844535 wait complete. 2024-09-06T15:06:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 -- 172.21.15.52:0/1556197972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8107900 msgr2=0x7fc1b8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 --2- 172.21.15.52:0/1556197972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8107900 0x7fc1b8107ce0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009880 tx=0x7fc1a802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 -- 172.21.15.52:0/1556197972 shutdown_connections 2024-09-06T15:06:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 --2- 172.21.15.52:0/1556197972 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1b8101900 0x7fc1b8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 --2- 172.21.15.52:0/1556197972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8107900 0x7fc1b8107ce0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 -- 172.21.15.52:0/1556197972 >> 172.21.15.52:0/1556197972 conn(0x7fc1b80fd600 msgr2=0x7fc1b80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:53.609 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 -- 172.21.15.52:0/1556197972 shutdown_connections 2024-09-06T15:06:53.610 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.609+0000 7fc1bd532640 1 -- 172.21.15.52:0/1556197972 wait complete. 2024-09-06T15:06:53.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.610+0000 7fc1bd532640 1 Processor -- start 2024-09-06T15:06:53.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.610+0000 7fc1bd532640 1 -- start start 2024-09-06T15:06:53.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.610+0000 7fc1bd532640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8101900 0x7fc1b819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.610+0000 7fc1bd532640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1b8107900 0x7fc1b819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1bd532640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b810edd0 con 0x7fc1b8101900 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1bd532640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b810ec50 con 0x7fc1b8107900 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8101900 0x7fc1b819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b6ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8101900 0x7fc1b819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35644/0 (socket says 172.21.15.52:35644) 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b6ffd640 1 -- 172.21.15.52:0/3266551671 learned_addr learned my addr 172.21.15.52:0/3266551671 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1affff640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1b8107900 0x7fc1b819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b6ffd640 1 -- 172.21.15.52:0/3266551671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1b8107900 msgr2=0x7fc1b819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b6ffd640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1b8107900 0x7fc1b819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b6ffd640 1 -- 172.21.15.52:0/3266551671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b81977a0 con 0x7fc1b8101900 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b6ffd640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8101900 0x7fc1b819d620 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8031460 tx=0x7fc1a8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.612 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b4ff9640 1 -- 172.21.15.52:0/3266551671 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1a803f070 con 0x7fc1b8101900 2024-09-06T15:06:53.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b8197a30 con 0x7fc1b8101900 2024-09-06T15:06:53.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b4ff9640 1 -- 172.21.15.52:0/3266551671 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1a80035f0 con 0x7fc1b8101900 2024-09-06T15:06:53.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.611+0000 7fc1b4ff9640 1 -- 172.21.15.52:0/3266551671 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc1a8035030 con 0x7fc1b8101900 2024-09-06T15:06:53.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.612+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b8197f60 con 0x7fc1b8101900 2024-09-06T15:06:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.613+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b8103040 con 0x7fc1b8101900 2024-09-06T15:06:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.613+0000 7fc1b4ff9640 1 -- 172.21.15.52:0/3266551671 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc1a8042070 con 0x7fc1b8101900 2024-09-06T15:06:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.614+0000 7fc1b4ff9640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc1a40774b0 0x7fc1a4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.614+0000 7fc1b4ff9640 1 -- 172.21.15.52:0/3266551671 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc1a80b9fd0 con 0x7fc1b8101900 2024-09-06T15:06:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.614+0000 7fc1affff640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc1a40774b0 0x7fc1a4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.614+0000 7fc1affff640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc1a40774b0 0x7fc1a4079970 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ffc20 tx=0x7fc1a0005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.617 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.618+0000 7fc1b4ff9640 1 -- 172.21.15.52:0/3266551671 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc1a8087120 con 0x7fc1b8101900 2024-09-06T15:06:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.803+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc1b8109e70 con 0x7fc1b8101900 2024-09-06T15:06:53.803 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.803+0000 7fc1b4ff9640 1 -- 172.21.15.52:0/3266551671 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7fc1a808bb40 con 0x7fc1b8101900 2024-09-06T15:06:53.803 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:06:53.803 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:06:53.803 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:06:53.803 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:06:53.803 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:06:53.804 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:06:53.805 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:06:53.806 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:53.807 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:53.807 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:53.807 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:06:53.807 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc1a40774b0 msgr2=0x7fc1a4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc1a40774b0 0x7fc1a4079970 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80ffc20 tx=0x7fc1a0005f90 comp rx=0 tx=0).stop 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8101900 msgr2=0x7fc1b819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8101900 0x7fc1b819d620 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8031460 tx=0x7fc1a8004530 comp rx=0 tx=0).stop 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 shutdown_connections 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc1a40774b0 0x7fc1a4079970 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1b8107900 0x7fc1b819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 --2- 172.21.15.52:0/3266551671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1b8101900 0x7fc1b819d620 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 >> 172.21.15.52:0/3266551671 conn(0x7fc1b80fd600 msgr2=0x7fc1b80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 shutdown_connections 2024-09-06T15:06:53.808 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.805+0000 7fc1bd532640 1 -- 172.21.15.52:0/3266551671 wait complete. 2024-09-06T15:06:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 -- 172.21.15.52:0/242927258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 msgr2=0x7f340410b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 --2- 172.21.15.52:0/242927258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340410b960 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009880 tx=0x7f33f802a530 comp rx=0 tx=0).stop 2024-09-06T15:06:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 -- 172.21.15.52:0/242927258 shutdown_connections 2024-09-06T15:06:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 --2- 172.21.15.52:0/242927258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340410b960 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 --2- 172.21.15.52:0/242927258 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3404102b50 0x7f3404102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 -- 172.21.15.52:0/242927258 >> 172.21.15.52:0/242927258 conn(0x7f34040fc550 msgr2=0x7f34040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:53.888 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 -- 172.21.15.52:0/242927258 shutdown_connections 2024-09-06T15:06:53.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.888+0000 7f3409995640 1 -- 172.21.15.52:0/242927258 wait complete. 2024-09-06T15:06:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.889+0000 7f3409995640 1 Processor -- start 2024-09-06T15:06:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.889+0000 7f3409995640 1 -- start start 2024-09-06T15:06:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.889+0000 7f3409995640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3404102b50 0x7f340419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.889+0000 7f3409995640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.889+0000 7f3409995640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f340410ede0 con 0x7f3404103470 2024-09-06T15:06:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.889+0000 7f3409995640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f340410ec60 con 0x7f3404102b50 2024-09-06T15:06:53.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f34027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f34027fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35658/0 (socket says 172.21.15.52:35658) 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f34027fc640 1 -- 172.21.15.52:0/1111138175 learned_addr learned my addr 172.21.15.52:0/1111138175 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f3402ffd640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3404102b50 0x7f340419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f34027fc640 1 -- 172.21.15.52:0/1111138175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3404102b50 msgr2=0x7f340419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f34027fc640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3404102b50 0x7f340419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f34027fc640 1 -- 172.21.15.52:0/1111138175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34041977b0 con 0x7f3404103470 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f34027fc640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340419db70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f33f8004f90 tx=0x7f33f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f3408993640 1 -- 172.21.15.52:0/1111138175 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33f803f070 con 0x7f3404103470 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3404197a40 con 0x7f3404103470 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f3408993640 1 -- 172.21.15.52:0/1111138175 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33f8004b80 con 0x7f3404103470 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f3408993640 1 -- 172.21.15.52:0/1111138175 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f33f8035030 con 0x7f3404103470 2024-09-06T15:06:53.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.890+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3404197f70 con 0x7f3404103470 2024-09-06T15:06:53.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.891+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340406a4e0 con 0x7f3404103470 2024-09-06T15:06:53.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.892+0000 7f3408993640 1 -- 172.21.15.52:0/1111138175 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f33f8042070 con 0x7f3404103470 2024-09-06T15:06:53.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.892+0000 7f3408993640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f33ec077460 0x7f33ec079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:53.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.893+0000 7f3402ffd640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f33ec077460 0x7f33ec079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.893+0000 7f3408993640 1 -- 172.21.15.52:0/1111138175 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f33f80ba2a0 con 0x7f3404103470 2024-09-06T15:06:53.893 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.893+0000 7f3402ffd640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f33ec077460 0x7f33ec079920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f33f4005fd0 tx=0x7f33f4009500 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:53.896 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:53.897+0000 7f3408993640 1 -- 172.21.15.52:0/1111138175 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f33f8083200 con 0x7f3404103470 2024-09-06T15:06:54.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.074+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f34041982e0 con 0x7f33ec077460 2024-09-06T15:06:54.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.075+0000 7f3408993640 1 -- 172.21.15.52:0/1111138175 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f34041982e0 con 0x7f33ec077460 2024-09-06T15:06:54.074 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:06:54.074 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:06:54.074 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:06:54.075 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:06:54.075 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:06:54.075 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:06:54.075 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:06:54.075 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:06:54.075 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:06:54.076 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:06:54.076 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:06:54.076 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:06:54.076 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:06:54.076 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:06:54.076 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:06:54.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f33ec077460 msgr2=0x7f33ec079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f33ec077460 0x7f33ec079920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f33f4005fd0 tx=0x7f33f4009500 comp rx=0 tx=0).stop 2024-09-06T15:06:54.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 msgr2=0x7f340419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340419db70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f33f8004f90 tx=0x7f33f80046c0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 shutdown_connections 2024-09-06T15:06:54.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3404103470 0x7f340419db70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f33ec077460 0x7f33ec079920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 --2- 172.21.15.52:0/1111138175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3404102b50 0x7f340419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 >> 172.21.15.52:0/1111138175 conn(0x7f34040fc550 msgr2=0x7f3404103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:54.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 shutdown_connections 2024-09-06T15:06:54.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.077+0000 7f3409995640 1 -- 172.21.15.52:0/1111138175 wait complete. 2024-09-06T15:06:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 -- 172.21.15.52:0/1227051418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4106800 msgr2=0x7f36a4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1227051418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4106800 0x7f36a4106be0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3694009880 tx=0x7f369402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 -- 172.21.15.52:0/1227051418 shutdown_connections 2024-09-06T15:06:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1227051418 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36a4100800 0x7f36a4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1227051418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4106800 0x7f36a4106be0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 -- 172.21.15.52:0/1227051418 >> 172.21.15.52:0/1227051418 conn(0x7f36a40fc520 msgr2=0x7f36a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:54.160 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:53 smithi052 ceph-mon[112917]: pgmap v679: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:54.161 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:53 smithi052 ceph-mon[112917]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:54.161 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:53 smithi052 ceph-mon[112917]: from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:54.161 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:53 smithi052 ceph-mon[112917]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:54.161 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:53 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3333844535' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:06:54.161 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:53 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3266551671' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 -- 172.21.15.52:0/1227051418 shutdown_connections 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.160+0000 7f36a8a38640 1 -- 172.21.15.52:0/1227051418 wait complete. 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.161+0000 7f36a8a38640 1 Processor -- start 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.161+0000 7f36a8a38640 1 -- start start 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.161+0000 7f36a8a38640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4100800 0x7f36a419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.161+0000 7f36a8a38640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36a4106800 0x7f36a419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.161+0000 7f36a8a38640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f36a410dd30 con 0x7f36a4100800 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.161+0000 7f36a8a38640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f36a410dbb0 con 0x7f36a4106800 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4100800 0x7f36a419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4100800 0x7f36a419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:35682/0 (socket says 172.21.15.52:35682) 2024-09-06T15:06:54.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a259c640 1 -- 172.21.15.52:0/1724155606 learned_addr learned my addr 172.21.15.52:0/1724155606 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a1d9b640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36a4106800 0x7f36a419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a259c640 1 -- 172.21.15.52:0/1724155606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36a4106800 msgr2=0x7f36a419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a259c640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36a4106800 0x7f36a419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a259c640 1 -- 172.21.15.52:0/1724155606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a4197880 con 0x7f36a4100800 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a259c640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4100800 0x7f36a419d6c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3694031460 tx=0x7f36940048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36937fe640 1 -- 172.21.15.52:0/1724155606 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f369403f070 con 0x7f36a4100800 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a4197b10 con 0x7f36a4100800 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36937fe640 1 -- 172.21.15.52:0/1724155606 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36940044d0 con 0x7f36a4100800 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36937fe640 1 -- 172.21.15.52:0/1724155606 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3694035030 con 0x7f36a4100800 2024-09-06T15:06:54.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.162+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a4198040 con 0x7f36a4100800 2024-09-06T15:06:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.164+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a4101f40 con 0x7f36a4100800 2024-09-06T15:06:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.164+0000 7f36937fe640 1 -- 172.21.15.52:0/1724155606 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3694042070 con 0x7f36a4100800 2024-09-06T15:06:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.165+0000 7f36937fe640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f368c077460 0x7f368c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:06:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.165+0000 7f36a1d9b640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f368c077460 0x7f368c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:06:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.165+0000 7f36937fe640 1 -- 172.21.15.52:0/1724155606 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f36940ba2a0 con 0x7f36a4100800 2024-09-06T15:06:54.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.165+0000 7f36a1d9b640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f368c077460 0x7f368c079920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36a4104f50 tx=0x7f3698009110 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:06:54.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.169+0000 7f36937fe640 1 -- 172.21.15.52:0/1724155606 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3694004cf0 con 0x7f36a4100800 2024-09-06T15:06:54.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:53 smithi165 ceph-mon[82925]: pgmap v679: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:54.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:53 smithi165 ceph-mon[82925]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:54.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:53 smithi165 ceph-mon[82925]: from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:54.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:53 smithi165 ceph-mon[82925]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:54.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:53 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3333844535' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:06:54.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:53 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3266551671' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:06:54.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.390+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f36a4198db0 con 0x7f36a4100800 2024-09-06T15:06:54.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.391+0000 7f36937fe640 1 -- 172.21.15.52:0/1724155606 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f3694083200 con 0x7f36a4100800 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:06:54.391 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:06:54.392 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:06:54.392 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:06:54.392 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:06:54.392 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:06:54.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f368c077460 msgr2=0x7f368c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f368c077460 0x7f368c079920 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36a4104f50 tx=0x7f3698009110 comp rx=0 tx=0).stop 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4100800 msgr2=0x7f36a419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4100800 0x7f36a419d6c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3694031460 tx=0x7f36940048f0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 shutdown_connections 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f368c077460 0x7f368c079920 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f36a4106800 0x7f36a419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 --2- 172.21.15.52:0/1724155606 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f36a4100800 0x7f36a419d6c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 >> 172.21.15.52:0/1724155606 conn(0x7f36a40fc520 msgr2=0x7f36a406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 shutdown_connections 2024-09-06T15:06:54.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:06:54.393+0000 7f36a8a38640 1 -- 172.21.15.52:0/1724155606 wait complete. 2024-09-06T15:06:55.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:54 smithi052 ceph-mon[112917]: from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:55.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:54 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1724155606' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:06:55.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:54 smithi165 ceph-mon[82925]: from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:06:55.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:54 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1724155606' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:06:56.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:55 smithi165 ceph-mon[82925]: pgmap v680: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:56.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:55 smithi052 ceph-mon[112917]: pgmap v680: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:58.219 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:57 smithi052 ceph-mon[112917]: pgmap v681: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:06:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:57 smithi165 ceph-mon[82925]: pgmap v681: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:00.321 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:06:59 smithi052 ceph-mon[112917]: pgmap v682: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:00.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:06:59 smithi165 ceph-mon[82925]: pgmap v682: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:02.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:01 smithi165 ceph-mon[82925]: pgmap v683: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:01 smithi052 ceph-mon[112917]: pgmap v683: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:04.178 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:03 smithi052 ceph-mon[112917]: pgmap v684: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:04.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:03 smithi165 ceph-mon[82925]: pgmap v684: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:05 smithi165 ceph-mon[82925]: pgmap v685: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:06.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:05 smithi052 ceph-mon[112917]: pgmap v685: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:08.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:07 smithi165 ceph-mon[82925]: pgmap v686: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:08.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:08.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:07 smithi052 ceph-mon[112917]: pgmap v686: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:08.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:10.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:09 smithi052 ceph-mon[112917]: pgmap v687: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:09 smithi165 ceph-mon[82925]: pgmap v687: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:12.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:11 smithi165 ceph-mon[82925]: pgmap v688: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:12.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:11 smithi052 ceph-mon[112917]: pgmap v688: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:14.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:13 smithi165 ceph-mon[82925]: pgmap v689: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:14.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:13 smithi052 ceph-mon[112917]: pgmap v689: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:16.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:15 smithi052 ceph-mon[112917]: pgmap v690: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:16.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:15 smithi165 ceph-mon[82925]: pgmap v690: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:18.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:17 smithi165 ceph-mon[82925]: pgmap v691: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:18.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:17 smithi052 ceph-mon[112917]: pgmap v691: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:20.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:19 smithi165 ceph-mon[82925]: pgmap v692: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:20.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:19 smithi052 ceph-mon[112917]: pgmap v692: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:22.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:21 smithi052 ceph-mon[112917]: pgmap v693: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:21 smithi165 ceph-mon[82925]: pgmap v693: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:23.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:24.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:23 smithi165 ceph-mon[82925]: pgmap v694: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:24.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:23 smithi052 ceph-mon[112917]: pgmap v694: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 -- 172.21.15.52:0/2923833399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 msgr2=0x7f3ef010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 --2- 172.21.15.52:0/2923833399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef010b8d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009880 tx=0x7f3ee002a530 comp rx=0 tx=0).stop 2024-09-06T15:07:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 -- 172.21.15.52:0/2923833399 shutdown_connections 2024-09-06T15:07:24.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 --2- 172.21.15.52:0/2923833399 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef010b8d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 --2- 172.21.15.52:0/2923833399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ef0102ac0 0x7f3ef0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 -- 172.21.15.52:0/2923833399 >> 172.21.15.52:0/2923833399 conn(0x7f3ef00fc520 msgr2=0x7f3ef00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 -- 172.21.15.52:0/2923833399 shutdown_connections 2024-09-06T15:07:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.490+0000 7f3ef875a640 1 -- 172.21.15.52:0/2923833399 wait complete. 2024-09-06T15:07:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef875a640 1 Processor -- start 2024-09-06T15:07:24.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef875a640 1 -- start start 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef875a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ef0102ac0 0x7f3ef019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef875a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef875a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef010edf0 con 0x7f3ef01033e0 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef875a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef010ec70 con 0x7f3ef0102ac0 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef5cf5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef5cf5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41174/0 (socket says 172.21.15.52:41174) 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef5cf5640 1 -- 172.21.15.52:0/968840608 learned_addr learned my addr 172.21.15.52:0/968840608 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.491+0000 7f3ef64f6640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ef0102ac0 0x7f3ef019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ef5cf5640 1 -- 172.21.15.52:0/968840608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ef0102ac0 msgr2=0x7f3ef019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ef5cf5640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ef0102ac0 0x7f3ef019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ef5cf5640 1 -- 172.21.15.52:0/968840608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef0197820 con 0x7f3ef01033e0 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ef5cf5640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef019dbe0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0031460 tx=0x7f3ee0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ee77fe640 1 -- 172.21.15.52:0/968840608 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ee003f070 con 0x7f3ef01033e0 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ee77fe640 1 -- 172.21.15.52:0/968840608 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3ee00035f0 con 0x7f3ef01033e0 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef0197ab0 con 0x7f3ef01033e0 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ee77fe640 1 -- 172.21.15.52:0/968840608 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3ee0035030 con 0x7f3ef01033e0 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.492+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef0197fe0 con 0x7f3ef01033e0 2024-09-06T15:07:24.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.493+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef006aa90 con 0x7f3ef01033e0 2024-09-06T15:07:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.494+0000 7f3ee77fe640 1 -- 172.21.15.52:0/968840608 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3ee0042070 con 0x7f3ef01033e0 2024-09-06T15:07:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.495+0000 7f3ee77fe640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3edc0774b0 0x7f3edc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.495+0000 7f3ef64f6640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3edc0774b0 0x7f3edc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.495+0000 7f3ee77fe640 1 -- 172.21.15.52:0/968840608 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3ee00b9fe0 con 0x7f3ef01033e0 2024-09-06T15:07:24.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.495+0000 7f3ef64f6640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3edc0774b0 0x7f3edc079970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3eec005fd0 tx=0x7f3eec00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:24.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.499+0000 7f3ee77fe640 1 -- 172.21.15.52:0/968840608 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3ee0087130 con 0x7f3ef01033e0 2024-09-06T15:07:24.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.676+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3ef0198290 con 0x7f3edc0774b0 2024-09-06T15:07:24.676 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.677+0000 7f3ee77fe640 1 -- 172.21.15.52:0/968840608 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3ef0198290 con 0x7f3edc0774b0 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3edc0774b0 msgr2=0x7f3edc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3edc0774b0 0x7f3edc079970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3eec005fd0 tx=0x7f3eec00b390 comp rx=0 tx=0).stop 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 msgr2=0x7f3ef019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef019dbe0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0031460 tx=0x7f3ee0004530 comp rx=0 tx=0).stop 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 shutdown_connections 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ef01033e0 0x7f3ef019dbe0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3edc0774b0 0x7f3edc079970 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 --2- 172.21.15.52:0/968840608 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ef0102ac0 0x7f3ef019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 >> 172.21.15.52:0/968840608 conn(0x7f3ef00fc520 msgr2=0x7f3ef0108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 shutdown_connections 2024-09-06T15:07:24.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.679+0000 7f3ef875a640 1 -- 172.21.15.52:0/968840608 wait complete. 2024-09-06T15:07:24.687 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:07:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 -- 172.21.15.52:0/3652401102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 msgr2=0x7f5de8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 --2- 172.21.15.52:0/3652401102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de8106be0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009880 tx=0x7f5de402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 -- 172.21.15.52:0/3652401102 shutdown_connections 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 --2- 172.21.15.52:0/3652401102 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de8100800 0x7f5de8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 --2- 172.21.15.52:0/3652401102 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de8106be0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 -- 172.21.15.52:0/3652401102 >> 172.21.15.52:0/3652401102 conn(0x7f5de80fc520 msgr2=0x7f5de80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 -- 172.21.15.52:0/3652401102 shutdown_connections 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.763+0000 7f5defd63640 1 -- 172.21.15.52:0/3652401102 wait complete. 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5defd63640 1 Processor -- start 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5defd63640 1 -- start start 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5defd63640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de8100800 0x7f5de819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5defd63640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5defd63640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5de810dcd0 con 0x7f5de8106800 2024-09-06T15:07:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5defd63640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5de810db50 con 0x7f5de8100800 2024-09-06T15:07:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5ded2fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5ded2fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41198/0 (socket says 172.21.15.52:41198) 2024-09-06T15:07:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5ded2fe640 1 -- 172.21.15.52:0/323294812 learned_addr learned my addr 172.21.15.52:0/323294812 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:24.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5dedaff640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de8100800 0x7f5de819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5ded2fe640 1 -- 172.21.15.52:0/323294812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de8100800 msgr2=0x7f5de819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.764+0000 7f5ded2fe640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de8100800 0x7f5de819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.765+0000 7f5ded2fe640 1 -- 172.21.15.52:0/323294812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de8197800 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.765+0000 7f5ded2fe640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de819dbc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800d6f0 tx=0x7f5dd800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.765+0000 7f5ddeffd640 1 -- 172.21.15.52:0/323294812 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dd8017070 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.765+0000 7f5ddeffd640 1 -- 172.21.15.52:0/323294812 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5dd800de00 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.765+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de8197af0 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.765+0000 7f5ddeffd640 1 -- 172.21.15.52:0/323294812 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5dd8004bb0 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.765+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de8198080 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.766+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de8101f40 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.767+0000 7f5ddeffd640 1 -- 172.21.15.52:0/323294812 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5dd8004e60 con 0x7f5de8106800 2024-09-06T15:07:24.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.767+0000 7f5ddeffd640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dd4077460 0x7f5dd4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.767+0000 7f5ddeffd640 1 -- 172.21.15.52:0/323294812 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f5dd8099390 con 0x7f5de8106800 2024-09-06T15:07:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.767+0000 7f5dedaff640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dd4077460 0x7f5dd4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:24.768 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.768+0000 7f5dedaff640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dd4077460 0x7f5dd4079920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5de40096c0 tx=0x7f5de4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:24.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.771+0000 7f5ddeffd640 1 -- 172.21.15.52:0/323294812 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5dd8066460 con 0x7f5de8106800 2024-09-06T15:07:24.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.952+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5de8198330 con 0x7f5dd4077460 2024-09-06T15:07:24.952 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.953+0000 7f5ddeffd640 1 -- 172.21.15.52:0/323294812 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5de8198330 con 0x7f5dd4077460 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dd4077460 msgr2=0x7f5dd4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dd4077460 0x7f5dd4079920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5de40096c0 tx=0x7f5de4031400 comp rx=0 tx=0).stop 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 msgr2=0x7f5de819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de819dbc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800d6f0 tx=0x7f5dd800dbb0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 shutdown_connections 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5de8106800 0x7f5de819dbc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5dd4077460 0x7f5dd4079920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 --2- 172.21.15.52:0/323294812 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5de8100800 0x7f5de819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:24.955 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 >> 172.21.15.52:0/323294812 conn(0x7f5de80fc520 msgr2=0x7f5de806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:24.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 shutdown_connections 2024-09-06T15:07:24.956 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:24.955+0000 7f5defd63640 1 -- 172.21.15.52:0/323294812 wait complete. 2024-09-06T15:07:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.038+0000 7f701d4bd640 1 -- 172.21.15.52:0/2765386569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018103440 msgr2=0x7f701810b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.038+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2765386569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018103440 0x7f701810b930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f70000098b0 tx=0x7f700002a560 comp rx=0 tx=0).stop 2024-09-06T15:07:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.038+0000 7f701d4bd640 1 -- 172.21.15.52:0/2765386569 shutdown_connections 2024-09-06T15:07:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2765386569 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018103440 0x7f701810b930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2765386569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7018102b20 0x7f7018102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 -- 172.21.15.52:0/2765386569 >> 172.21.15.52:0/2765386569 conn(0x7f70180fc520 msgr2=0x7f70180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 -- 172.21.15.52:0/2765386569 shutdown_connections 2024-09-06T15:07:25.039 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 -- 172.21.15.52:0/2765386569 wait complete. 2024-09-06T15:07:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 Processor -- start 2024-09-06T15:07:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 -- start start 2024-09-06T15:07:25.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018102b20 0x7f701819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7018103440 0x7f701819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f701810edd0 con 0x7f7018102b20 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.039+0000 7f701d4bd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f701810ec50 con 0x7f7018103440 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7016ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018102b20 0x7f701819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7016ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018102b20 0x7f701819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41210/0 (socket says 172.21.15.52:41210) 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7016ffd640 1 -- 172.21.15.52:0/2400092823 learned_addr learned my addr 172.21.15.52:0/2400092823 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f700ffff640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7018103440 0x7f701819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7016ffd640 1 -- 172.21.15.52:0/2400092823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7018103440 msgr2=0x7f701819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7016ffd640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7018103440 0x7f701819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7016ffd640 1 -- 172.21.15.52:0/2400092823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7018197880 con 0x7f7018102b20 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7016ffd640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018102b20 0x7f701819d6c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f700800d8d0 tx=0x7f700800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7014ff9640 1 -- 172.21.15.52:0/2400092823 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7008017030 con 0x7f7018102b20 2024-09-06T15:07:25.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7014ff9640 1 -- 172.21.15.52:0/2400092823 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7008004020 con 0x7f7018102b20 2024-09-06T15:07:25.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7018197b70 con 0x7f7018102b20 2024-09-06T15:07:25.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f7014ff9640 1 -- 172.21.15.52:0/2400092823 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70080047a0 con 0x7f7018102b20 2024-09-06T15:07:25.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.040+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70181980d0 con 0x7f7018102b20 2024-09-06T15:07:25.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.042+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f701806aa30 con 0x7f7018102b20 2024-09-06T15:07:25.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.042+0000 7f7014ff9640 1 -- 172.21.15.52:0/2400092823 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7008004aa0 con 0x7f7018102b20 2024-09-06T15:07:25.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.043+0000 7f7014ff9640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7004077460 0x7f7004079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.043+0000 7f7014ff9640 1 -- 172.21.15.52:0/2400092823 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7008018070 con 0x7f7018102b20 2024-09-06T15:07:25.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.043+0000 7f700ffff640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7004077460 0x7f7004079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.043+0000 7f700ffff640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7004077460 0x7f7004079920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7000000c00 tx=0x7f7000031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.047+0000 7f7014ff9640 1 -- 172.21.15.52:0/2400092823 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7008062480 con 0x7f7018102b20 2024-09-06T15:07:25.219 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.219+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7018198db0 con 0x7f7004077460 2024-09-06T15:07:25.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.230+0000 7f7014ff9640 1 -- 172.21.15.52:0/2400092823 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7018198db0 con 0x7f7004077460 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (19m) 14m ago 30m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (22m) 14m ago 30m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (22m) 13m ago 30m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (18m) 14m ago 30m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (18m) 13m ago 30m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (19m) 14m ago 30m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (14m) 14m ago 25m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (14m) 14m ago 25m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (13m) 13m ago 25m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:07:25.230 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (13m) 13m ago 25m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (22m) 14m ago 31m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (20m) 13m ago 29m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (18m) 14m ago 32m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (18m) 13m ago 29m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (20m) 14m ago 30m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (20m) 13m ago 29m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (17m) 14m ago 28m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (17m) 14m ago 28m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (16m) 14m ago 27m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (15m) 13m ago 27m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:07:25.231 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (15m) 13m ago 27m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:07:25.232 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (14m) 13m ago 26m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:07:25.232 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (20m) 14m ago 30m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:07:25.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7004077460 msgr2=0x7f7004079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7004077460 0x7f7004079920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7000000c00 tx=0x7f7000031400 comp rx=0 tx=0).stop 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018102b20 msgr2=0x7f701819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018102b20 0x7f701819d6c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f700800d8d0 tx=0x7f700800dd90 comp rx=0 tx=0).stop 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 shutdown_connections 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7004077460 0x7f7004079920 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7018103440 0x7f701819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 --2- 172.21.15.52:0/2400092823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7018102b20 0x7f701819d6c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 >> 172.21.15.52:0/2400092823 conn(0x7f70180fc520 msgr2=0x7f7018103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 shutdown_connections 2024-09-06T15:07:25.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.232+0000 7f701d4bd640 1 -- 172.21.15.52:0/2400092823 wait complete. 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 -- 172.21.15.52:0/1311793230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 msgr2=0x7f63a4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 --2- 172.21.15.52:0/1311793230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a4101d60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f638c009880 tx=0x7f638c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 -- 172.21.15.52:0/1311793230 shutdown_connections 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 --2- 172.21.15.52:0/1311793230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a4101d60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 --2- 172.21.15.52:0/1311793230 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a4107900 0x7f63a4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 -- 172.21.15.52:0/1311793230 >> 172.21.15.52:0/1311793230 conn(0x7f63a40fd600 msgr2=0x7f63a40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 -- 172.21.15.52:0/1311793230 shutdown_connections 2024-09-06T15:07:25.314 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 -- 172.21.15.52:0/1311793230 wait complete. 2024-09-06T15:07:25.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.314+0000 7f63ab09c640 1 Processor -- start 2024-09-06T15:07:25.315 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63ab09c640 1 -- start start 2024-09-06T15:07:25.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63ab09c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63ab09c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a4107900 0x7f63a419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.316 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63ab09c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f63a410edd0 con 0x7f63a4101900 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63ab09c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f63a410ec50 con 0x7f63a4107900 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a8e38640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a8e38640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41230/0 (socket says 172.21.15.52:41230) 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a8e38640 1 -- 172.21.15.52:0/4071102410 learned_addr learned my addr 172.21.15.52:0/4071102410 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a3fff640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a4107900 0x7f63a419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a8e38640 1 -- 172.21.15.52:0/4071102410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a4107900 msgr2=0x7f63a419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a8e38640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a4107900 0x7f63a419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a8e38640 1 -- 172.21.15.52:0/4071102410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a4197800 con 0x7f63a4101900 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.315+0000 7f63a8e38640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a419d680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f639400c8f0 tx=0x7f639400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.316+0000 7f63a1ffb640 1 -- 172.21.15.52:0/4071102410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63940079b0 con 0x7f63a4101900 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.316+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a4197af0 con 0x7f63a4101900 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.316+0000 7f63a1ffb640 1 -- 172.21.15.52:0/4071102410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63940054e0 con 0x7f63a4101900 2024-09-06T15:07:25.317 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.316+0000 7f63a1ffb640 1 -- 172.21.15.52:0/4071102410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6394004dd0 con 0x7f63a4101900 2024-09-06T15:07:25.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.316+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a4198050 con 0x7f63a4101900 2024-09-06T15:07:25.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.317+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a4103040 con 0x7f63a4101900 2024-09-06T15:07:25.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.318+0000 7f63a1ffb640 1 -- 172.21.15.52:0/4071102410 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6394005020 con 0x7f63a4101900 2024-09-06T15:07:25.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.318+0000 7f63a1ffb640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63900773f0 0x7f63900798b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.318+0000 7f63a1ffb640 1 -- 172.21.15.52:0/4071102410 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f63940997c0 con 0x7f63a4101900 2024-09-06T15:07:25.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.318+0000 7f63a3fff640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63900773f0 0x7f63900798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.319+0000 7f63a3fff640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63900773f0 0x7f63900798b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63a4198b50 tx=0x7f638c031420 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.322+0000 7f63a1ffb640 1 -- 172.21.15.52:0/4071102410 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6394014030 con 0x7f63a4101900 2024-09-06T15:07:25.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.545+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f63a4109e70 con 0x7f63a4101900 2024-09-06T15:07:25.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.545+0000 7f63a1ffb640 1 -- 172.21.15.52:0/4071102410 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f6394062720 con 0x7f63a4101900 2024-09-06T15:07:25.545 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:07:25.545 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:07:25.545 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:07:25.545 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:25.545 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:07:25.546 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:07:25.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63900773f0 msgr2=0x7f63900798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63900773f0 0x7f63900798b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f63a4198b50 tx=0x7f638c031420 comp rx=0 tx=0).stop 2024-09-06T15:07:25.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 msgr2=0x7f63a419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a419d680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f639400c8f0 tx=0x7f639400cdb0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 shutdown_connections 2024-09-06T15:07:25.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f63900773f0 0x7f63900798b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63a4107900 0x7f63a419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 --2- 172.21.15.52:0/4071102410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63a4101900 0x7f63a419d680 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.547+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 >> 172.21.15.52:0/4071102410 conn(0x7f63a40fd600 msgr2=0x7f63a40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:25.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.548+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 shutdown_connections 2024-09-06T15:07:25.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.548+0000 7f63ab09c640 1 -- 172.21.15.52:0/4071102410 wait complete. 2024-09-06T15:07:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1379588815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54101900 msgr2=0x7f0c54101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1379588815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54101900 0x7f0c54101d60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009880 tx=0x7f0c4002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1379588815 shutdown_connections 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1379588815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54101900 0x7f0c54101d60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1379588815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c54107900 0x7f0c54107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1379588815 >> 172.21.15.52:0/1379588815 conn(0x7f0c540fd600 msgr2=0x7f0c540ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1379588815 shutdown_connections 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.631+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1379588815 wait complete. 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c5b0f0640 1 Processor -- start 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c5b0f0640 1 -- start start 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c5b0f0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c54101900 0x7f0c5419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c5b0f0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54107900 0x7f0c5419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c5b0f0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410edd0 con 0x7f0c54107900 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c5b0f0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5410ec50 con 0x7f0c54101900 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54107900 0x7f0c5419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c53fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54107900 0x7f0c5419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41238/0 (socket says 172.21.15.52:41238) 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c53fff640 1 -- 172.21.15.52:0/1547603974 learned_addr learned my addr 172.21.15.52:0/1547603974 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c58e8c640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c54101900 0x7f0c5419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c53fff640 1 -- 172.21.15.52:0/1547603974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c54101900 msgr2=0x7f0c5419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c53fff640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c54101900 0x7f0c5419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.632+0000 7f0c53fff640 1 -- 172.21.15.52:0/1547603974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c54197800 con 0x7f0c54107900 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.633+0000 7f0c53fff640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54107900 0x7f0c5419dbc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0c40031460 tx=0x7f0c400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.633+0000 7f0c51ffb640 1 -- 172.21.15.52:0/1547603974 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c4003f070 con 0x7f0c54107900 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.633+0000 7f0c51ffb640 1 -- 172.21.15.52:0/1547603974 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c400035f0 con 0x7f0c54107900 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.633+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c54197a90 con 0x7f0c54107900 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.633+0000 7f0c51ffb640 1 -- 172.21.15.52:0/1547603974 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c40035030 con 0x7f0c54107900 2024-09-06T15:07:25.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.633+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c54197fc0 con 0x7f0c54107900 2024-09-06T15:07:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.634+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c54103040 con 0x7f0c54107900 2024-09-06T15:07:25.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.634+0000 7f0c51ffb640 1 -- 172.21.15.52:0/1547603974 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0c40042070 con 0x7f0c54107900 2024-09-06T15:07:25.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.635+0000 7f0c51ffb640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0c44077460 0x7f0c44079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.635+0000 7f0c51ffb640 1 -- 172.21.15.52:0/1547603974 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0c400ba170 con 0x7f0c54107900 2024-09-06T15:07:25.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.635+0000 7f0c58e8c640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0c44077460 0x7f0c44079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.636+0000 7f0c58e8c640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0c44077460 0x7f0c44079920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c48005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.638 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.639+0000 7f0c51ffb640 1 -- 172.21.15.52:0/1547603974 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0c400830d0 con 0x7f0c54107900 2024-09-06T15:07:25.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.825+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0c54198d30 con 0x7f0c54107900 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.825+0000 7f0c51ffb640 1 -- 172.21.15.52:0/1547603974 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f0c40087240 con 0x7f0c54107900 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:25.825 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:07:25.826 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:07:25.827 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:25.828 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:07:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0c44077460 msgr2=0x7f0c44079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0c44077460 0x7f0c44079920 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0c48005fd0 tx=0x7f0c48005850 comp rx=0 tx=0).stop 2024-09-06T15:07:25.829 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54107900 msgr2=0x7f0c5419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54107900 0x7f0c5419dbc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0c40031460 tx=0x7f0c400045e0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 shutdown_connections 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c54107900 0x7f0c5419dbc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0c44077460 0x7f0c44079920 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 --2- 172.21.15.52:0/1547603974 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c54101900 0x7f0c5419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 >> 172.21.15.52:0/1547603974 conn(0x7f0c540fd600 msgr2=0x7f0c540fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 shutdown_connections 2024-09-06T15:07:25.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.827+0000 7f0c5b0f0640 1 -- 172.21.15.52:0/1547603974 wait complete. 2024-09-06T15:07:25.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 -- 172.21.15.52:0/3549490427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c101900 msgr2=0x7f5e2c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.910 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 --2- 172.21.15.52:0/3549490427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c101900 0x7f5e2c101d60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009880 tx=0x7f5e2002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 -- 172.21.15.52:0/3549490427 shutdown_connections 2024-09-06T15:07:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 --2- 172.21.15.52:0/3549490427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c101900 0x7f5e2c101d60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 --2- 172.21.15.52:0/3549490427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e2c107900 0x7f5e2c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 -- 172.21.15.52:0/3549490427 >> 172.21.15.52:0/3549490427 conn(0x7f5e2c0fd600 msgr2=0x7f5e2c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 -- 172.21.15.52:0/3549490427 shutdown_connections 2024-09-06T15:07:25.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 -- 172.21.15.52:0/3549490427 wait complete. 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.911+0000 7f5e30e99640 1 Processor -- start 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e30e99640 1 -- start start 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e30e99640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e2c101900 0x7f5e2c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e30e99640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c107900 0x7f5e2c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e30e99640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c10edd0 con 0x7f5e2c107900 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e30e99640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c10ec50 con 0x7f5e2c101900 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e29d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c107900 0x7f5e2c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e29d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c107900 0x7f5e2c19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41254/0 (socket says 172.21.15.52:41254) 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e29d9b640 1 -- 172.21.15.52:0/329190552 learned_addr learned my addr 172.21.15.52:0/329190552 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e2a59c640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e2c101900 0x7f5e2c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e29d9b640 1 -- 172.21.15.52:0/329190552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e2c101900 msgr2=0x7f5e2c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:25.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e29d9b640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e2c101900 0x7f5e2c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e29d9b640 1 -- 172.21.15.52:0/329190552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c199a10 con 0x7f5e2c107900 2024-09-06T15:07:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.912+0000 7f5e29d9b640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c107900 0x7f5e2c19fd90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5e20031460 tx=0x7f5e200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.913+0000 7f5e1b7fe640 1 -- 172.21.15.52:0/329190552 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e2003f070 con 0x7f5e2c107900 2024-09-06T15:07:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.913+0000 7f5e1b7fe640 1 -- 172.21.15.52:0/329190552 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e20004b10 con 0x7f5e2c107900 2024-09-06T15:07:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.913+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c199ca0 con 0x7f5e2c107900 2024-09-06T15:07:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.913+0000 7f5e1b7fe640 1 -- 172.21.15.52:0/329190552 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e20035030 con 0x7f5e2c107900 2024-09-06T15:07:25.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.913+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c19a1d0 con 0x7f5e2c107900 2024-09-06T15:07:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.914+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c103040 con 0x7f5e2c107900 2024-09-06T15:07:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.914+0000 7f5e1b7fe640 1 -- 172.21.15.52:0/329190552 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5e20042070 con 0x7f5e2c107900 2024-09-06T15:07:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.915+0000 7f5e1b7fe640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e14077460 0x7f5e14079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.915+0000 7f5e1b7fe640 1 -- 172.21.15.52:0/329190552 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f5e200ba270 con 0x7f5e2c107900 2024-09-06T15:07:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.915+0000 7f5e2a59c640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e14077460 0x7f5e14079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:25.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.915+0000 7f5e2a59c640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e14077460 0x7f5e14079920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c19ab50 tx=0x7f5e1c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:25.918 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:25.919+0000 7f5e1b7fe640 1 -- 172.21.15.52:0/329190552 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5e20087340 con 0x7f5e2c107900 2024-09-06T15:07:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:25 smithi165 ceph-mon[82925]: pgmap v695: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:25 smithi165 ceph-mon[82925]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:25 smithi165 ceph-mon[82925]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:25 smithi165 ceph-mon[82925]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:25 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4071102410' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:07:26.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:25 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1547603974' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:07:26.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.096+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5e2c19a480 con 0x7f5e14077460 2024-09-06T15:07:26.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.097+0000 7f5e1b7fe640 1 -- 172.21.15.52:0/329190552 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5e2c19a480 con 0x7f5e14077460 2024-09-06T15:07:26.096 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:07:26.097 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:07:26.098 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:07:26.098 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:07:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e14077460 msgr2=0x7f5e14079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e14077460 0x7f5e14079920 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c19ab50 tx=0x7f5e1c00b390 comp rx=0 tx=0).stop 2024-09-06T15:07:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c107900 msgr2=0x7f5e2c19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:26.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c107900 0x7f5e2c19fd90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5e20031460 tx=0x7f5e200045e0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 shutdown_connections 2024-09-06T15:07:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e2c107900 0x7f5e2c19fd90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5e14077460 0x7f5e14079920 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 --2- 172.21.15.52:0/329190552 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5e2c101900 0x7f5e2c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 >> 172.21.15.52:0/329190552 conn(0x7f5e2c0fd600 msgr2=0x7f5e2c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 shutdown_connections 2024-09-06T15:07:26.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.099+0000 7f5e30e99640 1 -- 172.21.15.52:0/329190552 wait complete. 2024-09-06T15:07:26.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 -- 172.21.15.52:0/468349443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4100800 msgr2=0x7fedd4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:26.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/468349443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4100800 0x7fedd4100c60 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009880 tx=0x7fedbc02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 -- 172.21.15.52:0/468349443 shutdown_connections 2024-09-06T15:07:26.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/468349443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4100800 0x7fedd4100c60 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/468349443 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedd4106800 0x7fedd4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 -- 172.21.15.52:0/468349443 >> 172.21.15.52:0/468349443 conn(0x7fedd40fc520 msgr2=0x7fedd40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:26.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 -- 172.21.15.52:0/468349443 shutdown_connections 2024-09-06T15:07:26.182 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:25 smithi052 ceph-mon[112917]: pgmap v695: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:26.182 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:25 smithi052 ceph-mon[112917]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:26.183 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:25 smithi052 ceph-mon[112917]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:26.183 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:25 smithi052 ceph-mon[112917]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:26.183 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:25 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4071102410' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:07:26.183 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:25 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1547603974' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.182+0000 7fedd8ba6640 1 -- 172.21.15.52:0/468349443 wait complete. 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd8ba6640 1 Processor -- start 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd8ba6640 1 -- start start 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd8ba6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedd4100800 0x7fedd419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd8ba6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4106800 0x7fedd419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd8ba6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fedd410dd30 con 0x7fedd4106800 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd8ba6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fedd410dbb0 con 0x7fedd4100800 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4106800 0x7fedd419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd1d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4106800 0x7fedd419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:41282/0 (socket says 172.21.15.52:41282) 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd1d9b640 1 -- 172.21.15.52:0/4246501708 learned_addr learned my addr 172.21.15.52:0/4246501708 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd259c640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedd4100800 0x7fedd419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:26.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd1d9b640 1 -- 172.21.15.52:0/4246501708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedd4100800 msgr2=0x7fedd419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd1d9b640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedd4100800 0x7fedd419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd1d9b640 1 -- 172.21.15.52:0/4246501708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd4197870 con 0x7fedd4106800 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.183+0000 7fedd259c640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedd4100800 0x7fedd419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.184+0000 7fedd1d9b640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4106800 0x7fedd419dbf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fedbc031460 tx=0x7fedbc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.184+0000 7fedcb7fe640 1 -- 172.21.15.52:0/4246501708 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedbc03f070 con 0x7fedd4106800 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.184+0000 7fedcb7fe640 1 -- 172.21.15.52:0/4246501708 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedbc004cf0 con 0x7fedd4106800 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.184+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd4197b00 con 0x7fedd4106800 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.184+0000 7fedcb7fe640 1 -- 172.21.15.52:0/4246501708 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedbc035030 con 0x7fedd4106800 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.184+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd4198030 con 0x7fedd4106800 2024-09-06T15:07:26.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.185+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd4101f40 con 0x7fedd4106800 2024-09-06T15:07:26.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.186+0000 7fedcb7fe640 1 -- 172.21.15.52:0/4246501708 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fedbc042070 con 0x7fedd4106800 2024-09-06T15:07:26.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.186+0000 7fedcb7fe640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fedc0077460 0x7fedc0079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:26.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.186+0000 7fedcb7fe640 1 -- 172.21.15.52:0/4246501708 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fedbc0ba2e0 con 0x7fedd4106800 2024-09-06T15:07:26.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.186+0000 7fedd259c640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fedc0077460 0x7fedc0079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:26.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.187+0000 7fedd259c640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fedc0077460 0x7fedc0079920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fedc4006fd0 tx=0x7fedc4008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:26.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.191+0000 7fedcb7fe640 1 -- 172.21.15.52:0/4246501708 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fedbc083240 con 0x7fedd4106800 2024-09-06T15:07:26.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.410+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fedd4109da0 con 0x7fedd4106800 2024-09-06T15:07:26.410 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.411+0000 7fedcb7fe640 1 -- 172.21.15.52:0/4246501708 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7fedbc0873b0 con 0x7fedd4106800 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:07:26.411 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:07:26.412 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:07:26.412 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:07:26.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fedc0077460 msgr2=0x7fedc0079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:26.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fedc0077460 0x7fedc0079920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fedc4006fd0 tx=0x7fedc4008040 comp rx=0 tx=0).stop 2024-09-06T15:07:26.412 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4106800 msgr2=0x7fedd419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4106800 0x7fedd419dbf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fedbc031460 tx=0x7fedbc0048f0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 shutdown_connections 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fedd4106800 0x7fedd419dbf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fedc0077460 0x7fedc0079920 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 --2- 172.21.15.52:0/4246501708 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fedd4100800 0x7fedd419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 >> 172.21.15.52:0/4246501708 conn(0x7fedd40fc520 msgr2=0x7fedd406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 shutdown_connections 2024-09-06T15:07:26.413 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:26.413+0000 7fedd8ba6640 1 -- 172.21.15.52:0/4246501708 wait complete. 2024-09-06T15:07:27.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:26 smithi165 ceph-mon[82925]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:27.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:26 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4246501708' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:07:27.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:26 smithi052 ceph-mon[112917]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:27.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:26 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4246501708' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:07:28.213 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:27 smithi052 ceph-mon[112917]: pgmap v696: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:28.226 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:27 smithi165 ceph-mon[82925]: pgmap v696: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:29 smithi165 ceph-mon[82925]: pgmap v697: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:30.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:29 smithi052 ceph-mon[112917]: pgmap v697: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:32.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:31 smithi165 ceph-mon[82925]: pgmap v698: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:32.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:31 smithi052 ceph-mon[112917]: pgmap v698: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:34.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:33 smithi052 ceph-mon[112917]: pgmap v699: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:34.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:33 smithi165 ceph-mon[82925]: pgmap v699: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:36.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:35 smithi165 ceph-mon[82925]: pgmap v700: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:36.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:35 smithi052 ceph-mon[112917]: pgmap v700: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:37 smithi165 ceph-mon[82925]: pgmap v701: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:37 smithi052 ceph-mon[112917]: pgmap v701: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:38.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:40.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:39 smithi165 ceph-mon[82925]: pgmap v702: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:40.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:39 smithi052 ceph-mon[112917]: pgmap v702: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:42.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:41 smithi165 ceph-mon[82925]: pgmap v703: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:42.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:41 smithi052 ceph-mon[112917]: pgmap v703: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:44.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:43 smithi165 ceph-mon[82925]: pgmap v704: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:44.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:43 smithi052 ceph-mon[112917]: pgmap v704: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:46.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:45 smithi165 ceph-mon[82925]: pgmap v705: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:46.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:45 smithi052 ceph-mon[112917]: pgmap v705: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:48.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:47 smithi165 ceph-mon[82925]: pgmap v706: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:48.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:47 smithi052 ceph-mon[112917]: pgmap v706: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:50.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:49 smithi165 ceph-mon[82925]: pgmap v707: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:50.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:49 smithi052 ceph-mon[112917]: pgmap v707: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:52.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:51 smithi165 ceph-mon[82925]: pgmap v708: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:52.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:51 smithi052 ceph-mon[112917]: pgmap v708: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:53.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:07:54.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:54 smithi165 ceph-mon[82925]: pgmap v709: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:54.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:54 smithi052 ceph-mon[112917]: pgmap v709: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:56.260 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:56 smithi165 ceph-mon[82925]: pgmap v710: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:56.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:56 smithi052 ceph-mon[112917]: pgmap v710: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 -- 172.21.15.52:0/3889541257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1067f0 msgr2=0x7fb78c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 --2- 172.21.15.52:0/3889541257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1067f0 0x7fb78c106bd0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009880 tx=0x7fb77c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 -- 172.21.15.52:0/3889541257 shutdown_connections 2024-09-06T15:07:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 --2- 172.21.15.52:0/3889541257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78c1007f0 0x7fb78c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 --2- 172.21.15.52:0/3889541257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1067f0 0x7fb78c106bd0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 -- 172.21.15.52:0/3889541257 >> 172.21.15.52:0/3889541257 conn(0x7fb78c0fc550 msgr2=0x7fb78c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 -- 172.21.15.52:0/3889541257 shutdown_connections 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 -- 172.21.15.52:0/3889541257 wait complete. 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.508+0000 7fb79209b640 1 Processor -- start 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb79209b640 1 -- start start 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb79209b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1007f0 0x7fb78c0fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb79209b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78c1067f0 0x7fb78c0fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb79209b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c10dcc0 con 0x7fb78c1007f0 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb79209b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c10db40 con 0x7fb78c1067f0 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb78b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1007f0 0x7fb78c0fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb78b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1007f0 0x7fb78c0fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43610/0 (socket says 172.21.15.52:43610) 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb78b7fe640 1 -- 172.21.15.52:0/3216493456 learned_addr learned my addr 172.21.15.52:0/3216493456 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:56.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb78affd640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78c1067f0 0x7fb78c0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb78b7fe640 1 -- 172.21.15.52:0/3216493456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78c1067f0 msgr2=0x7fb78c0fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb78b7fe640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78c1067f0 0x7fb78c0fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.509+0000 7fb78b7fe640 1 -- 172.21.15.52:0/3216493456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c0fd790 con 0x7fb78c1007f0 2024-09-06T15:07:56.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.510+0000 7fb78b7fe640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1007f0 0x7fb78c0fcd10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb77c031460 tx=0x7fb77c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.510+0000 7fb788ff9640 1 -- 172.21.15.52:0/3216493456 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb77c03f070 con 0x7fb78c1007f0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.510+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78c0fda20 con 0x7fb78c1007f0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.510+0000 7fb788ff9640 1 -- 172.21.15.52:0/3216493456 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb77c0035f0 con 0x7fb78c1007f0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.510+0000 7fb788ff9640 1 -- 172.21.15.52:0/3216493456 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb77c035030 con 0x7fb78c1007f0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.510+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78c1a3da0 con 0x7fb78c1007f0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.511+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78c101f30 con 0x7fb78c1007f0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.512+0000 7fb788ff9640 1 -- 172.21.15.52:0/3216493456 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb77c042070 con 0x7fb78c1007f0 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.512+0000 7fb788ff9640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb774077460 0x7fb774079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:56.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.512+0000 7fb788ff9640 1 -- 172.21.15.52:0/3216493456 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fb77c0ba0c0 con 0x7fb78c1007f0 2024-09-06T15:07:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.512+0000 7fb78affd640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb774077460 0x7fb774079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:56.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.513+0000 7fb78affd640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb774077460 0x7fb774079920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0fe7a0 tx=0x7fb78000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:56.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.516+0000 7fb788ff9640 1 -- 172.21.15.52:0/3216493456 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb77c087190 con 0x7fb78c1007f0 2024-09-06T15:07:56.693 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.693+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb78c062630 con 0x7fb774077460 2024-09-06T15:07:56.694 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.695+0000 7fb788ff9640 1 -- 172.21.15.52:0/3216493456 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb78c062630 con 0x7fb774077460 2024-09-06T15:07:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb774077460 msgr2=0x7fb774079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb774077460 0x7fb774079920 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0fe7a0 tx=0x7fb78000b390 comp rx=0 tx=0).stop 2024-09-06T15:07:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1007f0 msgr2=0x7fb78c0fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1007f0 0x7fb78c0fcd10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb77c031460 tx=0x7fb77c0045e0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 shutdown_connections 2024-09-06T15:07:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb774077460 0x7fb774079920 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb78c1067f0 0x7fb78c0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 --2- 172.21.15.52:0/3216493456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb78c1007f0 0x7fb78c0fcd10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 >> 172.21.15.52:0/3216493456 conn(0x7fb78c0fc550 msgr2=0x7fb78c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 shutdown_connections 2024-09-06T15:07:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.697+0000 7fb79209b640 1 -- 172.21.15.52:0/3216493456 wait complete. 2024-09-06T15:07:56.705 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:07:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 -- 172.21.15.52:0/985007075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 msgr2=0x7fec80107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 --2- 172.21.15.52:0/985007075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80107ce0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fec70009880 tx=0x7fec7002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 -- 172.21.15.52:0/985007075 shutdown_connections 2024-09-06T15:07:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 --2- 172.21.15.52:0/985007075 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec80101900 0x7fec80101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 --2- 172.21.15.52:0/985007075 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80107ce0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 -- 172.21.15.52:0/985007075 >> 172.21.15.52:0/985007075 conn(0x7fec800fd600 msgr2=0x7fec800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:56.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 -- 172.21.15.52:0/985007075 shutdown_connections 2024-09-06T15:07:56.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.781+0000 7fec84d61640 1 -- 172.21.15.52:0/985007075 wait complete. 2024-09-06T15:07:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.782+0000 7fec84d61640 1 Processor -- start 2024-09-06T15:07:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.782+0000 7fec84d61640 1 -- start start 2024-09-06T15:07:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.782+0000 7fec84d61640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec80101900 0x7fec800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:56.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.782+0000 7fec84d61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.782+0000 7fec84d61640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec8010ee30 con 0x7fec80107900 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.782+0000 7fec84d61640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec8010ecb0 con 0x7fec80101900 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.782+0000 7fec7dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec7dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43628/0 (socket says 172.21.15.52:43628) 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec7dd9b640 1 -- 172.21.15.52:0/3776460838 learned_addr learned my addr 172.21.15.52:0/3776460838 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec7e59c640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec80101900 0x7fec800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec7dd9b640 1 -- 172.21.15.52:0/3776460838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec80101900 msgr2=0x7fec800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec7dd9b640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec80101900 0x7fec800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec7dd9b640 1 -- 172.21.15.52:0/3776460838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec80074f70 con 0x7fec80107900 2024-09-06T15:07:56.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec7dd9b640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80074a30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fec7400b420 tx=0x7fec7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec6f7fe640 1 -- 172.21.15.52:0/3776460838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec74011630 con 0x7fec80107900 2024-09-06T15:07:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec6f7fe640 1 -- 172.21.15.52:0/3776460838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec74016070 con 0x7fec80107900 2024-09-06T15:07:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec80075260 con 0x7fec80107900 2024-09-06T15:07:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec6f7fe640 1 -- 172.21.15.52:0/3776460838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec74010d40 con 0x7fec80107900 2024-09-06T15:07:56.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.783+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec801a3e90 con 0x7fec80107900 2024-09-06T15:07:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.785+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec80103040 con 0x7fec80107900 2024-09-06T15:07:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.785+0000 7fec6f7fe640 1 -- 172.21.15.52:0/3776460838 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fec7401b460 con 0x7fec80107900 2024-09-06T15:07:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.786+0000 7fec6f7fe640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec680774b0 0x7fec68079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.786+0000 7fec7e59c640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec680774b0 0x7fec68079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.786+0000 7fec6f7fe640 1 -- 172.21.15.52:0/3776460838 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fec74098e90 con 0x7fec80107900 2024-09-06T15:07:56.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.787+0000 7fec7e59c640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec680774b0 0x7fec68079970 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fec700096c0 tx=0x7fec70031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:56.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.790+0000 7fec6f7fe640 1 -- 172.21.15.52:0/3776460838 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fec74061dd0 con 0x7fec80107900 2024-09-06T15:07:56.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.969+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fec80062630 con 0x7fec680774b0 2024-09-06T15:07:56.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.970+0000 7fec6f7fe640 1 -- 172.21.15.52:0/3776460838 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fec80062630 con 0x7fec680774b0 2024-09-06T15:07:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec680774b0 msgr2=0x7fec68079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec680774b0 0x7fec68079970 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fec700096c0 tx=0x7fec70031400 comp rx=0 tx=0).stop 2024-09-06T15:07:56.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 msgr2=0x7fec80074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80074a30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fec7400b420 tx=0x7fec7400b8e0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 shutdown_connections 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec80107900 0x7fec80074a30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fec680774b0 0x7fec68079970 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 --2- 172.21.15.52:0/3776460838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec80101900 0x7fec800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 >> 172.21.15.52:0/3776460838 conn(0x7fec800fd600 msgr2=0x7fec800fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 shutdown_connections 2024-09-06T15:07:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:56.972+0000 7fec84d61640 1 -- 172.21.15.52:0/3776460838 wait complete. 2024-09-06T15:07:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.055+0000 7fe747b0f640 1 -- 172.21.15.52:0/3441483995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe740102ac0 msgr2=0x7fe740102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.055+0000 7fe747b0f640 1 --2- 172.21.15.52:0/3441483995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe740102ac0 0x7fe740102ea0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe73c009880 tx=0x7fe73c02a530 comp rx=0 tx=0).stop 2024-09-06T15:07:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.055+0000 7fe747b0f640 1 -- 172.21.15.52:0/3441483995 shutdown_connections 2024-09-06T15:07:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.055+0000 7fe747b0f640 1 --2- 172.21.15.52:0/3441483995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7401033e0 0x7fe74010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.055+0000 7fe747b0f640 1 --2- 172.21.15.52:0/3441483995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe740102ac0 0x7fe740102ea0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.055+0000 7fe747b0f640 1 -- 172.21.15.52:0/3441483995 >> 172.21.15.52:0/3441483995 conn(0x7fe7400fc520 msgr2=0x7fe7400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.056+0000 7fe747b0f640 1 -- 172.21.15.52:0/3441483995 shutdown_connections 2024-09-06T15:07:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.056+0000 7fe747b0f640 1 -- 172.21.15.52:0/3441483995 wait complete. 2024-09-06T15:07:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.056+0000 7fe747b0f640 1 Processor -- start 2024-09-06T15:07:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.056+0000 7fe747b0f640 1 -- start start 2024-09-06T15:07:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe747b0f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe740102ac0 0x7fe74019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe747b0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7401033e0 0x7fe74019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe747b0f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe74010edf0 con 0x7fe7401033e0 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe747b0f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe74010ec70 con 0x7fe740102ac0 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7450aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7401033e0 0x7fe74019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7450aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7401033e0 0x7fe74019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43640/0 (socket says 172.21.15.52:43640) 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7450aa640 1 -- 172.21.15.52:0/676397015 learned_addr learned my addr 172.21.15.52:0/676397015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7458ab640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe740102ac0 0x7fe74019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7450aa640 1 -- 172.21.15.52:0/676397015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe740102ac0 msgr2=0x7fe74019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7450aa640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe740102ac0 0x7fe74019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7450aa640 1 -- 172.21.15.52:0/676397015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7401999d0 con 0x7fe7401033e0 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.057+0000 7fe7450aa640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7401033e0 0x7fe74019fd50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe73000d6d0 tx=0x7fe73000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.058+0000 7fe736ffd640 1 -- 172.21.15.52:0/676397015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe730017070 con 0x7fe7401033e0 2024-09-06T15:07:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.058+0000 7fe736ffd640 1 -- 172.21.15.52:0/676397015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7300054e0 con 0x7fe7401033e0 2024-09-06T15:07:57.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.058+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe740199cc0 con 0x7fe7401033e0 2024-09-06T15:07:57.059 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.058+0000 7fe736ffd640 1 -- 172.21.15.52:0/676397015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe730004ae0 con 0x7fe7401033e0 2024-09-06T15:07:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.058+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74019a250 con 0x7fe7401033e0 2024-09-06T15:07:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.059+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74006aa90 con 0x7fe7401033e0 2024-09-06T15:07:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.059+0000 7fe736ffd640 1 -- 172.21.15.52:0/676397015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe730004de0 con 0x7fe7401033e0 2024-09-06T15:07:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.060+0000 7fe736ffd640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe72c077460 0x7fe72c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.060+0000 7fe736ffd640 1 -- 172.21.15.52:0/676397015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe730099400 con 0x7fe7401033e0 2024-09-06T15:07:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.060+0000 7fe7458ab640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe72c077460 0x7fe72c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.060+0000 7fe7458ab640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe72c077460 0x7fe72c079920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000c00 tx=0x7fe73c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.064+0000 7fe736ffd640 1 -- 172.21.15.52:0/676397015 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe730062360 con 0x7fe7401033e0 2024-09-06T15:07:57.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.233+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe74019af00 con 0x7fe72c077460 2024-09-06T15:07:57.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.243+0000 7fe736ffd640 1 -- 172.21.15.52:0/676397015 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe74019af00 con 0x7fe72c077460 2024-09-06T15:07:57.242 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (20m) 14m ago 31m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (23m) 14m ago 31m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (22m) 14m ago 30m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (18m) 14m ago 31m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (18m) 14m ago 30m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (19m) 14m ago 31m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (15m) 14m ago 26m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (14m) 14m ago 26m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (14m) 14m ago 26m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (14m) 14m ago 25m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (22m) 14m ago 32m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (21m) 14m ago 30m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:07:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (19m) 14m ago 32m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (18m) 14m ago 30m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (21m) 14m ago 31m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (21m) 14m ago 30m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (18m) 14m ago 29m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (17m) 14m ago 28m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (17m) 14m ago 28m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (16m) 14m ago 27m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (15m) 14m ago 27m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (15m) 14m ago 27m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:07:57.244 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (20m) 14m ago 30m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:07:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe72c077460 msgr2=0x7fe72c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe72c077460 0x7fe72c079920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000c00 tx=0x7fe73c031400 comp rx=0 tx=0).stop 2024-09-06T15:07:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7401033e0 msgr2=0x7fe74019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7401033e0 0x7fe74019fd50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe73000d6d0 tx=0x7fe73000db90 comp rx=0 tx=0).stop 2024-09-06T15:07:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 shutdown_connections 2024-09-06T15:07:57.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7401033e0 0x7fe74019fd50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe72c077460 0x7fe72c079920 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 --2- 172.21.15.52:0/676397015 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe740102ac0 0x7fe74019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 >> 172.21.15.52:0/676397015 conn(0x7fe7400fc520 msgr2=0x7fe740100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 shutdown_connections 2024-09-06T15:07:57.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.245+0000 7fe747b0f640 1 -- 172.21.15.52:0/676397015 wait complete. 2024-09-06T15:07:57.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.326+0000 7f7a37f53640 1 -- 172.21.15.52:0/1980862233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 msgr2=0x7f7a30106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.326+0000 7f7a37f53640 1 --2- 172.21.15.52:0/1980862233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30106bd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c009880 tx=0x7f7a2c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.326 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 -- 172.21.15.52:0/1980862233 shutdown_connections 2024-09-06T15:07:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 --2- 172.21.15.52:0/1980862233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a301007f0 0x7f7a30100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 --2- 172.21.15.52:0/1980862233 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30106bd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 -- 172.21.15.52:0/1980862233 >> 172.21.15.52:0/1980862233 conn(0x7f7a300fc550 msgr2=0x7f7a300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 -- 172.21.15.52:0/1980862233 shutdown_connections 2024-09-06T15:07:57.327 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 -- 172.21.15.52:0/1980862233 wait complete. 2024-09-06T15:07:57.328 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 Processor -- start 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.327+0000 7f7a37f53640 1 -- start start 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a37f53640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a301007f0 0x7f7a30107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a37f53640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a37f53640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3010dca0 con 0x7f7a301067f0 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a37f53640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3010db20 con 0x7f7a301007f0 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a354ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a354ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43668/0 (socket says 172.21.15.52:43668) 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a354ee640 1 -- 172.21.15.52:0/598562405 learned_addr learned my addr 172.21.15.52:0/598562405 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a35cef640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a301007f0 0x7f7a30107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a354ee640 1 -- 172.21.15.52:0/598562405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a301007f0 msgr2=0x7f7a30107720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a354ee640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a301007f0 0x7f7a30107720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.329 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a354ee640 1 -- 172.21.15.52:0/598562405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a301081a0 con 0x7f7a301067f0 2024-09-06T15:07:57.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a354ee640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30107c60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c8a0 tx=0x7f7a2000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.328+0000 7f7a26ffd640 1 -- 172.21.15.52:0/598562405 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a200079b0 con 0x7f7a301067f0 2024-09-06T15:07:57.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.329+0000 7f7a26ffd640 1 -- 172.21.15.52:0/598562405 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a20007b50 con 0x7f7a301067f0 2024-09-06T15:07:57.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.329+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a30108490 con 0x7f7a301067f0 2024-09-06T15:07:57.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.329+0000 7f7a26ffd640 1 -- 172.21.15.52:0/598562405 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a20018700 con 0x7f7a301067f0 2024-09-06T15:07:57.330 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.329+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a301a3d70 con 0x7f7a301067f0 2024-09-06T15:07:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.330+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a30101f30 con 0x7f7a301067f0 2024-09-06T15:07:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.330+0000 7f7a26ffd640 1 -- 172.21.15.52:0/598562405 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7a20007d00 con 0x7f7a301067f0 2024-09-06T15:07:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.331+0000 7f7a26ffd640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a1c077460 0x7f7a1c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.331+0000 7f7a26ffd640 1 -- 172.21.15.52:0/598562405 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7a20099a90 con 0x7f7a301067f0 2024-09-06T15:07:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.331+0000 7f7a35cef640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a1c077460 0x7f7a1c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.331 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.332+0000 7f7a35cef640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a1c077460 0x7f7a1c079920 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c000c00 tx=0x7f7a2c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.335+0000 7f7a26ffd640 1 -- 172.21.15.52:0/598562405 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7a20014030 con 0x7f7a301067f0 2024-09-06T15:07:57.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.554+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7a301a40b0 con 0x7f7a301067f0 2024-09-06T15:07:57.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.555+0000 7f7a26ffd640 1 -- 172.21.15.52:0/598562405 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7a20062a70 con 0x7f7a301067f0 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:07:57.555 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:07:57.556 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:07:57.556 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:07:57.556 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:07:57.556 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a1c077460 msgr2=0x7f7a1c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a1c077460 0x7f7a1c079920 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c000c00 tx=0x7f7a2c031400 comp rx=0 tx=0).stop 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 msgr2=0x7f7a30107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30107c60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c8a0 tx=0x7f7a2000cd60 comp rx=0 tx=0).stop 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 shutdown_connections 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a301067f0 0x7f7a30107c60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a1c077460 0x7f7a1c079920 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 --2- 172.21.15.52:0/598562405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a301007f0 0x7f7a30107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 >> 172.21.15.52:0/598562405 conn(0x7f7a300fc550 msgr2=0x7f7a30069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 shutdown_connections 2024-09-06T15:07:57.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.557+0000 7f7a37f53640 1 -- 172.21.15.52:0/598562405 wait complete. 2024-09-06T15:07:57.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 -- 172.21.15.52:0/486930760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 msgr2=0x7f8f7c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 --2- 172.21.15.52:0/486930760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c107cf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009880 tx=0x7f8f6c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 -- 172.21.15.52:0/486930760 shutdown_connections 2024-09-06T15:07:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 --2- 172.21.15.52:0/486930760 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f7c101910 0x7f8f7c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 --2- 172.21.15.52:0/486930760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c107cf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 -- 172.21.15.52:0/486930760 >> 172.21.15.52:0/486930760 conn(0x7f8f7c0fd610 msgr2=0x7f8f7c0ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 -- 172.21.15.52:0/486930760 shutdown_connections 2024-09-06T15:07:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.640+0000 7f8f819ad640 1 -- 172.21.15.52:0/486930760 wait complete. 2024-09-06T15:07:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f819ad640 1 Processor -- start 2024-09-06T15:07:57.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f819ad640 1 -- start start 2024-09-06T15:07:57.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f819ad640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f7c101910 0x7f8f7c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f819ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f819ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c10edc0 con 0x7f8f7c107910 2024-09-06T15:07:57.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f819ad640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7c10ec40 con 0x7f8f7c101910 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f727fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f727fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43688/0 (socket says 172.21.15.52:43688) 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.641+0000 7f8f727fc640 1 -- 172.21.15.52:0/468146898 learned_addr learned my addr 172.21.15.52:0/468146898 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f7affd640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f7c101910 0x7f8f7c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f727fc640 1 -- 172.21.15.52:0/468146898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f7c101910 msgr2=0x7f8f7c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f727fc640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f7c101910 0x7f8f7c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f727fc640 1 -- 172.21.15.52:0/468146898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7c074f70 con 0x7f8f7c107910 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f727fc640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c074a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400e970 tx=0x7f8f6400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f809ab640 1 -- 172.21.15.52:0/468146898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f6400cac0 con 0x7f8f7c107910 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7c075260 con 0x7f8f7c107910 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f809ab640 1 -- 172.21.15.52:0/468146898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f6400cc60 con 0x7f8f7c107910 2024-09-06T15:07:57.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f809ab640 1 -- 172.21.15.52:0/468146898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f64018720 con 0x7f8f7c107910 2024-09-06T15:07:57.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.642+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f7c1a3e70 con 0x7f8f7c107910 2024-09-06T15:07:57.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.643+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f7c103050 con 0x7f8f7c107910 2024-09-06T15:07:57.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.644+0000 7f8f809ab640 1 -- 172.21.15.52:0/468146898 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8f64010430 con 0x7f8f7c107910 2024-09-06T15:07:57.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.644+0000 7f8f809ab640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8f680774b0 0x7f8f68079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.645+0000 7f8f809ab640 1 -- 172.21.15.52:0/468146898 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8f64099e10 con 0x7f8f7c107910 2024-09-06T15:07:57.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.645+0000 7f8f7affd640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8f680774b0 0x7f8f68079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.645+0000 7f8f7affd640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8f680774b0 0x7f8f68079970 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0096c0 tx=0x7f8f6c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.649+0000 7f8f809ab640 1 -- 172.21.15.52:0/468146898 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8f6409d030 con 0x7f8f7c107910 2024-09-06T15:07:57.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.832+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8f7c104b20 con 0x7f8f7c107910 2024-09-06T15:07:57.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.832+0000 7f8f809ab640 1 -- 172.21.15.52:0/468146898 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f8f6406b020 con 0x7f8f7c107910 2024-09-06T15:07:57.832 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:07:57.832 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:07:57.832 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:07:57.832 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:07:57.832 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:07:57.833 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:07:57.834 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:57.835 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:57.836 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:07:57.836 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:07:57.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8f680774b0 msgr2=0x7f8f68079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8f680774b0 0x7f8f68079970 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0096c0 tx=0x7f8f6c031400 comp rx=0 tx=0).stop 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 msgr2=0x7f8f7c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c074a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400e970 tx=0x7f8f6400ee30 comp rx=0 tx=0).stop 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 shutdown_connections 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8f7c107910 0x7f8f7c074a30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8f680774b0 0x7f8f68079970 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 --2- 172.21.15.52:0/468146898 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f7c101910 0x7f8f7c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.834+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 >> 172.21.15.52:0/468146898 conn(0x7f8f7c0fd610 msgr2=0x7f8f7c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.835+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 shutdown_connections 2024-09-06T15:07:57.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.835+0000 7f8f819ad640 1 -- 172.21.15.52:0/468146898 wait complete. 2024-09-06T15:07:57.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.918+0000 7fdb72c75640 1 -- 172.21.15.52:0/2006361731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c102b50 msgr2=0x7fdb6c102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.918+0000 7fdb72c75640 1 --2- 172.21.15.52:0/2006361731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c102b50 0x7fdb6c102f30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009880 tx=0x7fdb5c02a530 comp rx=0 tx=0).stop 2024-09-06T15:07:57.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.918+0000 7fdb72c75640 1 -- 172.21.15.52:0/2006361731 shutdown_connections 2024-09-06T15:07:57.919 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.918+0000 7fdb72c75640 1 --2- 172.21.15.52:0/2006361731 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6c103470 0x7fdb6c10b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.918+0000 7fdb72c75640 1 --2- 172.21.15.52:0/2006361731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c102b50 0x7fdb6c102f30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.918+0000 7fdb72c75640 1 -- 172.21.15.52:0/2006361731 >> 172.21.15.52:0/2006361731 conn(0x7fdb6c0fc550 msgr2=0x7fdb6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 -- 172.21.15.52:0/2006361731 shutdown_connections 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 -- 172.21.15.52:0/2006361731 wait complete. 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 Processor -- start 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 -- start start 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6c102b50 0x7fdb6c1007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c103470 0x7fdb6c100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c10edc0 con 0x7fdb6c103470 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.919+0000 7fdb72c75640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6c10ec40 con 0x7fdb6c102b50 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb6bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c103470 0x7fdb6c100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb6bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c103470 0x7fdb6c100cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43714/0 (socket says 172.21.15.52:43714) 2024-09-06T15:07:57.920 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb6bfff640 1 -- 172.21.15.52:0/3513253977 learned_addr learned my addr 172.21.15.52:0/3513253977 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:57.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb70a11640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6c102b50 0x7fdb6c1007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb6bfff640 1 -- 172.21.15.52:0/3513253977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6c102b50 msgr2=0x7fdb6c1007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:57.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb6bfff640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6c102b50 0x7fdb6c1007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:57.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb6bfff640 1 -- 172.21.15.52:0/3513253977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6c101230 con 0x7fdb6c103470 2024-09-06T15:07:57.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb6bfff640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c103470 0x7fdb6c100cf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c8a0 tx=0x7fdb6000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb69ffb640 1 -- 172.21.15.52:0/3513253977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb600079b0 con 0x7fdb6c103470 2024-09-06T15:07:57.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb69ffb640 1 -- 172.21.15.52:0/3513253977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb60007b50 con 0x7fdb6c103470 2024-09-06T15:07:57.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6c101520 con 0x7fdb6c103470 2024-09-06T15:07:57.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.920+0000 7fdb69ffb640 1 -- 172.21.15.52:0/3513253977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb60018700 con 0x7fdb6c103470 2024-09-06T15:07:57.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.921+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6c1a3dd0 con 0x7fdb6c103470 2024-09-06T15:07:57.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.922+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6c06a4e0 con 0x7fdb6c103470 2024-09-06T15:07:57.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.923+0000 7fdb69ffb640 1 -- 172.21.15.52:0/3513253977 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fdb60007d00 con 0x7fdb6c103470 2024-09-06T15:07:57.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.923+0000 7fdb69ffb640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdb540774b0 0x7fdb54079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:57.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.924+0000 7fdb70a11640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdb540774b0 0x7fdb54079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:57.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.924+0000 7fdb69ffb640 1 -- 172.21.15.52:0/3513253977 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fdb60099910 con 0x7fdb6c103470 2024-09-06T15:07:57.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.924+0000 7fdb70a11640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdb540774b0 0x7fdb54079970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c000c00 tx=0x7fdb5c004f30 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:57.927 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:57.928+0000 7fdb69ffb640 1 -- 172.21.15.52:0/3513253977 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fdb60014030 con 0x7fdb6c103470 2024-09-06T15:07:58.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.107+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdb6c062630 con 0x7fdb540774b0 2024-09-06T15:07:58.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.109+0000 7fdb69ffb640 1 -- 172.21.15.52:0/3513253977 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fdb6c062630 con 0x7fdb540774b0 2024-09-06T15:07:58.108 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:07:58.108 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:07:58.108 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:07:58.108 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:07:58.108 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:07:58.109 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:07:58.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdb540774b0 msgr2=0x7fdb54079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:58.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdb540774b0 0x7fdb54079970 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c000c00 tx=0x7fdb5c004f30 comp rx=0 tx=0).stop 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c103470 msgr2=0x7fdb6c100cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c103470 0x7fdb6c100cf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c8a0 tx=0x7fdb6000cd60 comp rx=0 tx=0).stop 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 shutdown_connections 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb6c103470 0x7fdb6c100cf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdb540774b0 0x7fdb54079970 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 --2- 172.21.15.52:0/3513253977 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdb6c102b50 0x7fdb6c1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 >> 172.21.15.52:0/3513253977 conn(0x7fdb6c0fc550 msgr2=0x7fdb6c108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 shutdown_connections 2024-09-06T15:07:58.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.111+0000 7fdb72c75640 1 -- 172.21.15.52:0/3513253977 wait complete. 2024-09-06T15:07:58.172 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:58 smithi052 ceph-mon[112917]: pgmap v711: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:58.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:58 smithi052 ceph-mon[112917]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:58.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:58 smithi052 ceph-mon[112917]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:58.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:58 smithi052 ceph-mon[112917]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:58.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:58 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/598562405' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:07:58.173 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:58 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/468146898' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:07:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 -- 172.21.15.52:0/1520787951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 msgr2=0x7f15f8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 --2- 172.21.15.52:0/1520787951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f8101d60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009880 tx=0x7f15ec02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 -- 172.21.15.52:0/1520787951 shutdown_connections 2024-09-06T15:07:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 --2- 172.21.15.52:0/1520787951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f8101d60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 --2- 172.21.15.52:0/1520787951 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15f8107900 0x7f15f8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 -- 172.21.15.52:0/1520787951 >> 172.21.15.52:0/1520787951 conn(0x7f15f80fd600 msgr2=0x7f15f80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:58.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 -- 172.21.15.52:0/1520787951 shutdown_connections 2024-09-06T15:07:58.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.195+0000 7f15fccd5640 1 -- 172.21.15.52:0/1520787951 wait complete. 2024-09-06T15:07:58.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15fccd5640 1 Processor -- start 2024-09-06T15:07:58.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15fccd5640 1 -- start start 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15fccd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15fccd5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15f8107900 0x7f15f819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15fccd5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f15f810edd0 con 0x7f15f8101900 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15fccd5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15f810ec50 con 0x7f15f8107900 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15f659c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43740/0 (socket says 172.21.15.52:43740) 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15f659c640 1 -- 172.21.15.52:0/2945487655 learned_addr learned my addr 172.21.15.52:0/2945487655 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15f5d9b640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15f8107900 0x7f15f819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.196+0000 7f15f659c640 1 -- 172.21.15.52:0/2945487655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15f8107900 msgr2=0x7f15f819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:58.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15f659c640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15f8107900 0x7f15f819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15f659c640 1 -- 172.21.15.52:0/2945487655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f8197800 con 0x7f15f8101900 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15f659c640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f819d680 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f15e800eb10 tx=0x7f15e800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15e77fe640 1 -- 172.21.15.52:0/2945487655 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15e800cce0 con 0x7f15f8101900 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15e77fe640 1 -- 172.21.15.52:0/2945487655 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15e8005020 con 0x7f15f8101900 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f8197af0 con 0x7f15f8101900 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15e77fe640 1 -- 172.21.15.52:0/2945487655 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15e8010660 con 0x7f15f8101900 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.197+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f8198050 con 0x7f15f8101900 2024-09-06T15:07:58.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.198+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f8103040 con 0x7f15f8101900 2024-09-06T15:07:58.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.199+0000 7f15e77fe640 1 -- 172.21.15.52:0/2945487655 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f15e80051d0 con 0x7f15f8101900 2024-09-06T15:07:58.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.199+0000 7f15e77fe640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f15e00774b0 0x7f15e0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:07:58.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.199+0000 7f15e77fe640 1 -- 172.21.15.52:0/2945487655 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f15e8099fe0 con 0x7f15f8101900 2024-09-06T15:07:58.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.199+0000 7f15f5d9b640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f15e00774b0 0x7f15e0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:07:58.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.200+0000 7f15f5d9b640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f15e00774b0 0x7f15e0079970 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f15f8198b50 tx=0x7f15ec031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:07:58.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.203+0000 7f15e77fe640 1 -- 172.21.15.52:0/2945487655 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f15e8062f80 con 0x7f15f8101900 2024-09-06T15:07:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:58 smithi165 ceph-mon[82925]: pgmap v711: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:07:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:58 smithi165 ceph-mon[82925]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:58 smithi165 ceph-mon[82925]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:58 smithi165 ceph-mon[82925]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:58 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/598562405' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:07:58.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:58 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/468146898' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:07:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.443+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f15f8109e70 con 0x7f15f8101900 2024-09-06T15:07:58.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.444+0000 7f15e77fe640 1 -- 172.21.15.52:0/2945487655 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7f15e80670f0 con 0x7f15f8101900 2024-09-06T15:07:58.443 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:07:58.444 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:07:58.445 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:07:58.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f15e00774b0 msgr2=0x7f15e0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:58.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f15e00774b0 0x7f15e0079970 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f15f8198b50 tx=0x7f15ec031400 comp rx=0 tx=0).stop 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 msgr2=0x7f15f819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f819d680 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f15e800eb10 tx=0x7f15e800c2d0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 shutdown_connections 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f15e00774b0 0x7f15e0079970 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15f8107900 0x7f15f819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 --2- 172.21.15.52:0/2945487655 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15f8101900 0x7f15f819d680 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 >> 172.21.15.52:0/2945487655 conn(0x7f15f80fd600 msgr2=0x7f15f80fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 shutdown_connections 2024-09-06T15:07:58.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:07:58.446+0000 7f15fccd5640 1 -- 172.21.15.52:0/2945487655 wait complete. 2024-09-06T15:07:59.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:59 smithi165 ceph-mon[82925]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:59.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:07:59 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2945487655' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:07:59.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:59 smithi052 ceph-mon[112917]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:07:59.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:07:59 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2945487655' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:08:00.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:00 smithi165 ceph-mon[82925]: pgmap v712: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:00.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:00 smithi052 ceph-mon[112917]: pgmap v712: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:02.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:02 smithi165 ceph-mon[82925]: pgmap v713: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:02.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:02 smithi052 ceph-mon[112917]: pgmap v713: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:04.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:04 smithi165 ceph-mon[82925]: pgmap v714: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:04.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:04 smithi052 ceph-mon[112917]: pgmap v714: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:06.305 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:06 smithi052 ceph-mon[112917]: pgmap v715: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:06 smithi165 ceph-mon[82925]: pgmap v715: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:08 smithi165 ceph-mon[82925]: pgmap v716: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:08.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:08 smithi052 ceph-mon[112917]: pgmap v716: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:08.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:10 smithi165 ceph-mon[82925]: pgmap v717: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:10.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:10 smithi052 ceph-mon[112917]: pgmap v717: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:12.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:12 smithi165 ceph-mon[82925]: pgmap v718: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:12.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:12 smithi052 ceph-mon[112917]: pgmap v718: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:14.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:14 smithi165 ceph-mon[82925]: pgmap v719: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:14.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:14 smithi052 ceph-mon[112917]: pgmap v719: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:16.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:16 smithi165 ceph-mon[82925]: pgmap v720: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:16.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:16 smithi052 ceph-mon[112917]: pgmap v720: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:18.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:18 smithi165 ceph-mon[82925]: pgmap v721: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:18.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:18 smithi052 ceph-mon[112917]: pgmap v721: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:20.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:20 smithi165 ceph-mon[82925]: pgmap v722: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:20.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:20 smithi052 ceph-mon[112917]: pgmap v722: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:22.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:22 smithi165 ceph-mon[82925]: pgmap v723: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:22.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:22 smithi052 ceph-mon[112917]: pgmap v723: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:23.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:24.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:24 smithi165 ceph-mon[82925]: pgmap v724: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:24.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:24 smithi052 ceph-mon[112917]: pgmap v724: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:26.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:26 smithi165 ceph-mon[82925]: pgmap v725: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:26.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:26 smithi052 ceph-mon[112917]: pgmap v725: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:28.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:28 smithi165 ceph-mon[82925]: pgmap v726: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:28.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:28 smithi052 ceph-mon[112917]: pgmap v726: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:28.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 -- 172.21.15.52:0/2513934150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544102b20 msgr2=0x7fa544102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:28.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 --2- 172.21.15.52:0/2513934150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544102b20 0x7fa544102f00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa5340098b0 tx=0x7fa53402a560 comp rx=0 tx=0).stop 2024-09-06T15:08:28.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 -- 172.21.15.52:0/2513934150 shutdown_connections 2024-09-06T15:08:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 --2- 172.21.15.52:0/2513934150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa544103440 0x7fa54410b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 --2- 172.21.15.52:0/2513934150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544102b20 0x7fa544102f00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 -- 172.21.15.52:0/2513934150 >> 172.21.15.52:0/2513934150 conn(0x7fa5440fc520 msgr2=0x7fa5440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 -- 172.21.15.52:0/2513934150 shutdown_connections 2024-09-06T15:08:28.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.542+0000 7fa549158640 1 -- 172.21.15.52:0/2513934150 wait complete. 2024-09-06T15:08:28.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.543+0000 7fa549158640 1 Processor -- start 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.543+0000 7fa549158640 1 -- start start 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa549158640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa544102b20 0x7fa544100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa549158640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544103440 0x7fa544100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa549158640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa54410edf0 con 0x7fa544103440 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa549158640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa54410ec70 con 0x7fa544102b20 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa53bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544103440 0x7fa544100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa53bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544103440 0x7fa544100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42906/0 (socket says 172.21.15.52:42906) 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa53bfff640 1 -- 172.21.15.52:0/2007910975 learned_addr learned my addr 172.21.15.52:0/2007910975 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa542d9d640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa544102b20 0x7fa544100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa53bfff640 1 -- 172.21.15.52:0/2007910975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa544102b20 msgr2=0x7fa544100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa53bfff640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa544102b20 0x7fa544100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa53bfff640 1 -- 172.21.15.52:0/2007910975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa544101200 con 0x7fa544103440 2024-09-06T15:08:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.544+0000 7fa53bfff640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544103440 0x7fa544100cc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00d6f0 tx=0x7fa52c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.545+0000 7fa540d99640 1 -- 172.21.15.52:0/2007910975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa52c017070 con 0x7fa544103440 2024-09-06T15:08:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.545+0000 7fa540d99640 1 -- 172.21.15.52:0/2007910975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa52c00de00 con 0x7fa544103440 2024-09-06T15:08:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.545+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5441014f0 con 0x7fa544103440 2024-09-06T15:08:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.545+0000 7fa540d99640 1 -- 172.21.15.52:0/2007910975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa52c004bb0 con 0x7fa544103440 2024-09-06T15:08:28.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.545+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5441a3f00 con 0x7fa544103440 2024-09-06T15:08:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.546+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa54406aa30 con 0x7fa544103440 2024-09-06T15:08:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.546+0000 7fa540d99640 1 -- 172.21.15.52:0/2007910975 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa52c009a30 con 0x7fa544103440 2024-09-06T15:08:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.547+0000 7fa540d99640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa530077460 0x7fa530079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.547+0000 7fa540d99640 1 -- 172.21.15.52:0/2007910975 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fa52c099380 con 0x7fa544103440 2024-09-06T15:08:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.547+0000 7fa542d9d640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa530077460 0x7fa530079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:28.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.547+0000 7fa542d9d640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa530077460 0x7fa530079920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa534000c00 tx=0x7fa534031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:28.551 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.551+0000 7fa540d99640 1 -- 172.21.15.52:0/2007910975 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa52c066450 con 0x7fa544103440 2024-09-06T15:08:28.730 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.730+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa544062630 con 0x7fa530077460 2024-09-06T15:08:28.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.731+0000 7fa540d99640 1 -- 172.21.15.52:0/2007910975 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa544062630 con 0x7fa530077460 2024-09-06T15:08:28.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa530077460 msgr2=0x7fa530079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa530077460 0x7fa530079920 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa534000c00 tx=0x7fa534031400 comp rx=0 tx=0).stop 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544103440 msgr2=0x7fa544100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544103440 0x7fa544100cc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00d6f0 tx=0x7fa52c00dbb0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 shutdown_connections 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa544103440 0x7fa544100cc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa530077460 0x7fa530079920 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 --2- 172.21.15.52:0/2007910975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa544102b20 0x7fa544100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 >> 172.21.15.52:0/2007910975 conn(0x7fa5440fc520 msgr2=0x7fa544107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 shutdown_connections 2024-09-06T15:08:28.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.733+0000 7fa549158640 1 -- 172.21.15.52:0/2007910975 wait complete. 2024-09-06T15:08:28.743 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:08:28.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 -- 172.21.15.52:0/3533382777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 msgr2=0x7f8db0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:28.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 --2- 172.21.15.52:0/3533382777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0107ce0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8da0009880 tx=0x7f8da002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 -- 172.21.15.52:0/3533382777 shutdown_connections 2024-09-06T15:08:28.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 --2- 172.21.15.52:0/3533382777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db0101900 0x7f8db0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 --2- 172.21.15.52:0/3533382777 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0107ce0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 -- 172.21.15.52:0/3533382777 >> 172.21.15.52:0/3533382777 conn(0x7f8db00fd600 msgr2=0x7f8db00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:28.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 -- 172.21.15.52:0/3533382777 shutdown_connections 2024-09-06T15:08:28.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.817+0000 7f8db5af3640 1 -- 172.21.15.52:0/3533382777 wait complete. 2024-09-06T15:08:28.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.818+0000 7f8db5af3640 1 Processor -- start 2024-09-06T15:08:28.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.818+0000 7f8db5af3640 1 -- start start 2024-09-06T15:08:28.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8db5af3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db0101900 0x7f8db00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:28.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8db5af3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8db5af3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8db010edb0 con 0x7f8db0107900 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8db5af3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8db010ec30 con 0x7f8db0101900 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daeffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42932/0 (socket says 172.21.15.52:42932) 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daeffd640 1 -- 172.21.15.52:0/161043514 learned_addr learned my addr 172.21.15.52:0/161043514 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daf7fe640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db0101900 0x7f8db00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daeffd640 1 -- 172.21.15.52:0/161043514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db0101900 msgr2=0x7f8db00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daeffd640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db0101900 0x7f8db00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daeffd640 1 -- 172.21.15.52:0/161043514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db0074f70 con 0x7f8db0107900 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8daeffd640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0074a30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8da400d8d0 tx=0x7f8da400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:28.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.819+0000 7f8dacff9640 1 -- 172.21.15.52:0/161043514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8da4017070 con 0x7f8db0107900 2024-09-06T15:08:28.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.820+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db0075260 con 0x7f8db0107900 2024-09-06T15:08:28.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.820+0000 7f8dacff9640 1 -- 172.21.15.52:0/161043514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8da4010460 con 0x7f8db0107900 2024-09-06T15:08:28.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.820+0000 7f8dacff9640 1 -- 172.21.15.52:0/161043514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8da400f5f0 con 0x7f8db0107900 2024-09-06T15:08:28.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.820+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db01a3e60 con 0x7f8db0107900 2024-09-06T15:08:28.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.821+0000 7f8dacff9640 1 -- 172.21.15.52:0/161043514 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8da4009a30 con 0x7f8db0107900 2024-09-06T15:08:28.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.821+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db0103040 con 0x7f8db0107900 2024-09-06T15:08:28.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.822+0000 7f8dacff9640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8d98077460 0x7f8d98079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:28.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.822+0000 7f8dacff9640 1 -- 172.21.15.52:0/161043514 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8da4099630 con 0x7f8db0107900 2024-09-06T15:08:28.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.822+0000 7f8daf7fe640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8d98077460 0x7f8d98079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:28.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.822+0000 7f8daf7fe640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8d98077460 0x7f8d98079920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8da00096c0 tx=0x7f8da0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:28.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:28.826+0000 7f8dacff9640 1 -- 172.21.15.52:0/161043514 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8da4066700 con 0x7f8db0107900 2024-09-06T15:08:29.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.005+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8db0062630 con 0x7f8d98077460 2024-09-06T15:08:29.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.006+0000 7f8dacff9640 1 -- 172.21.15.52:0/161043514 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8db0062630 con 0x7f8d98077460 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8d98077460 msgr2=0x7f8d98079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8d98077460 0x7f8d98079920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8da00096c0 tx=0x7f8da0031400 comp rx=0 tx=0).stop 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 msgr2=0x7f8db0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0074a30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8da400d8d0 tx=0x7f8da400dd90 comp rx=0 tx=0).stop 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 shutdown_connections 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8db0107900 0x7f8db0074a30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8d98077460 0x7f8d98079920 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 --2- 172.21.15.52:0/161043514 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8db0101900 0x7f8db00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.008+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 >> 172.21.15.52:0/161043514 conn(0x7f8db00fd600 msgr2=0x7f8db00fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.009+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 shutdown_connections 2024-09-06T15:08:29.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.009+0000 7f8db5af3640 1 -- 172.21.15.52:0/161043514 wait complete. 2024-09-06T15:08:29.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.092+0000 7fc9c09a1640 1 -- 172.21.15.52:0/3577170688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1031f0 msgr2=0x7fc9bc10b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.092+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/3577170688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1031f0 0x7fc9bc10b6e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4009880 tx=0x7fc9a402a530 comp rx=0 tx=0).stop 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 -- 172.21.15.52:0/3577170688 shutdown_connections 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/3577170688 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1031f0 0x7fc9bc10b6e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/3577170688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9bc1028d0 0x7fc9bc102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 -- 172.21.15.52:0/3577170688 >> 172.21.15.52:0/3577170688 conn(0x7fc9bc0fc310 msgr2=0x7fc9bc0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 -- 172.21.15.52:0/3577170688 shutdown_connections 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 -- 172.21.15.52:0/3577170688 wait complete. 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 Processor -- start 2024-09-06T15:08:29.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.093+0000 7fc9c09a1640 1 -- start start 2024-09-06T15:08:29.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9c09a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1028d0 0x7fc9bc19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9c09a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9bc1031f0 0x7fc9bc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9c09a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc10ec00 con 0x7fc9bc1028d0 2024-09-06T15:08:29.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9c09a1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc10ea80 con 0x7fc9bc1031f0 2024-09-06T15:08:29.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9bb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1028d0 0x7fc9bc19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9bb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1028d0 0x7fc9bc19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42958/0 (socket says 172.21.15.52:42958) 2024-09-06T15:08:29.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9bb7fe640 1 -- 172.21.15.52:0/4168717023 learned_addr learned my addr 172.21.15.52:0/4168717023 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9b2ffd640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9bc1031f0 0x7fc9bc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9bb7fe640 1 -- 172.21.15.52:0/4168717023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9bc1031f0 msgr2=0x7fc9bc19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9bb7fe640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9bc1031f0 0x7fc9bc19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9bb7fe640 1 -- 172.21.15.52:0/4168717023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc1998c0 con 0x7fc9bc1028d0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9b2ffd640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9bc1031f0 0x7fc9bc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.094+0000 7fc9bb7fe640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1028d0 0x7fc9bc19f700 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00d6f0 tx=0x7fc9ac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.095+0000 7fc9b97fa640 1 -- 172.21.15.52:0/4168717023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9ac017070 con 0x7fc9bc1028d0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.095+0000 7fc9b97fa640 1 -- 172.21.15.52:0/4168717023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9ac00de00 con 0x7fc9bc1028d0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.095+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc199bb0 con 0x7fc9bc1028d0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.095+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc19a140 con 0x7fc9bc1028d0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.095+0000 7fc9b97fa640 1 -- 172.21.15.52:0/4168717023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9ac004bb0 con 0x7fc9bc1028d0 2024-09-06T15:08:29.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.096+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc06a580 con 0x7fc9bc1028d0 2024-09-06T15:08:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.096+0000 7fc9b97fa640 1 -- 172.21.15.52:0/4168717023 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fc9ac004e60 con 0x7fc9bc1028d0 2024-09-06T15:08:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.097+0000 7fc9b97fa640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9a8077460 0x7fc9a8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.097+0000 7fc9b2ffd640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9a8077460 0x7fc9a8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.098+0000 7fc9b97fa640 1 -- 172.21.15.52:0/4168717023 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fc9ac099420 con 0x7fc9bc1028d0 2024-09-06T15:08:29.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.098+0000 7fc9b2ffd640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9a8077460 0x7fc9a8079920 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4031460 tx=0x7fc9a40095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.101+0000 7fc9b97fa640 1 -- 172.21.15.52:0/4168717023 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fc9ac062380 con 0x7fc9bc1028d0 2024-09-06T15:08:29.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.270+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc9bc19adf0 con 0x7fc9a8077460 2024-09-06T15:08:29.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.280+0000 7fc9b97fa640 1 -- 172.21.15.52:0/4168717023 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc9bc19adf0 con 0x7fc9a8077460 2024-09-06T15:08:29.280 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (20m) 15m ago 31m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (23m) 15m ago 31m 9210k - 19.1.1-268-g635ed4cf b6db46a449e5 2ff14084e492 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (23m) 14m ago 31m 9168k - 19.1.1-268-g635ed4cf b6db46a449e5 8ff2b41be3dc 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (19m) 15m ago 31m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (19m) 14m ago 31m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (20m) 15m ago 31m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (15m) 15m ago 26m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (15m) 15m ago 26m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (15m) 14m ago 26m 16.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (14m) 14m ago 26m 11.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (23m) 15m ago 33m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:08:29.281 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (21m) 14m ago 30m 458M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (19m) 15m ago 33m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (19m) 14m ago 30m 39.9M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (21m) 15m ago 31m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (21m) 14m ago 31m 11.8M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (18m) 15m ago 29m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (18m) 15m ago 29m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (17m) 15m ago 28m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (16m) 14m ago 28m 92.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (16m) 14m ago 28m 83.8M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (15m) 14m ago 27m 81.0M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:08:29.282 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (21m) 15m ago 31m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:08:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.281+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9a8077460 msgr2=0x7fc9a8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.281+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9a8077460 0x7fc9a8079920 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4031460 tx=0x7fc9a40095f0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.281+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1028d0 msgr2=0x7fc9bc19f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.281+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1028d0 0x7fc9bc19f700 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00d6f0 tx=0x7fc9ac00dbb0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.283 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.282+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 shutdown_connections 2024-09-06T15:08:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.282+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fc9a8077460 0x7fc9a8079920 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.282+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9bc1031f0 0x7fc9bc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.282+0000 7fc9c09a1640 1 --2- 172.21.15.52:0/4168717023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9bc1028d0 0x7fc9bc19f700 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.282+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 >> 172.21.15.52:0/4168717023 conn(0x7fc9bc0fc310 msgr2=0x7fc9bc100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.282+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 shutdown_connections 2024-09-06T15:08:29.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.282+0000 7fc9c09a1640 1 -- 172.21.15.52:0/4168717023 wait complete. 2024-09-06T15:08:29.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 -- 172.21.15.52:0/1602231865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4100650 msgr2=0x7f6dd4100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/1602231865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4100650 0x7f6dd4100a30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009880 tx=0x7f6dd002a490 comp rx=0 tx=0).stop 2024-09-06T15:08:29.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 -- 172.21.15.52:0/1602231865 shutdown_connections 2024-09-06T15:08:29.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/1602231865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6dd4101000 0x7f6dd410dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.364 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/1602231865 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4100650 0x7f6dd4100a30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 -- 172.21.15.52:0/1602231865 >> 172.21.15.52:0/1602231865 conn(0x7f6dd40fc520 msgr2=0x7f6dd40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 -- 172.21.15.52:0/1602231865 shutdown_connections 2024-09-06T15:08:29.365 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.363+0000 7f6ddba4a640 1 -- 172.21.15.52:0/1602231865 wait complete. 2024-09-06T15:08:29.366 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.364+0000 7f6ddba4a640 1 Processor -- start 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.364+0000 7f6ddba4a640 1 -- start start 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.364+0000 7f6ddba4a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6dd4100650 0x7f6dd419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.364+0000 7f6ddba4a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4101000 0x7f6dd419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.364+0000 7f6ddba4a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4110fb0 con 0x7f6dd4101000 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.364+0000 7f6ddba4a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4110e30 con 0x7f6dd4100650 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd8fe5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4101000 0x7f6dd419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd8fe5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4101000 0x7f6dd419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42980/0 (socket says 172.21.15.52:42980) 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd8fe5640 1 -- 172.21.15.52:0/61033130 learned_addr learned my addr 172.21.15.52:0/61033130 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd97e6640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6dd4100650 0x7f6dd419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd8fe5640 1 -- 172.21.15.52:0/61033130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6dd4100650 msgr2=0x7f6dd419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.367 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd8fe5640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6dd4100650 0x7f6dd419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd8fe5640 1 -- 172.21.15.52:0/61033130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd4199a40 con 0x7f6dd4101000 2024-09-06T15:08:29.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dd8fe5640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4101000 0x7f6dd419fdc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400d6f0 tx=0x7f6dc400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dca7fc640 1 -- 172.21.15.52:0/61033130 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dc4017070 con 0x7f6dd4101000 2024-09-06T15:08:29.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6dca7fc640 1 -- 172.21.15.52:0/61033130 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dc400de00 con 0x7f6dd4101000 2024-09-06T15:08:29.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.365+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd4199d30 con 0x7f6dd4101000 2024-09-06T15:08:29.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.366+0000 7f6dca7fc640 1 -- 172.21.15.52:0/61033130 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dc4004bb0 con 0x7f6dd4101000 2024-09-06T15:08:29.368 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.366+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd419a2c0 con 0x7f6dd4101000 2024-09-06T15:08:29.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.367+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd406aa90 con 0x7f6dd4101000 2024-09-06T15:08:29.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.367+0000 7f6dca7fc640 1 -- 172.21.15.52:0/61033130 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f6dc4009a30 con 0x7f6dd4101000 2024-09-06T15:08:29.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.368+0000 7f6dca7fc640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6dc00774b0 0x7f6dc0079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.368+0000 7f6dca7fc640 1 -- 172.21.15.52:0/61033130 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f6dc4098f40 con 0x7f6dd4101000 2024-09-06T15:08:29.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.368+0000 7f6dd97e6640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6dc00774b0 0x7f6dc0079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.369 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.369+0000 7f6dd97e6640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6dc00774b0 0x7f6dc0079970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000c00 tx=0x7f6dd0031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.372 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.372+0000 7f6dca7fc640 1 -- 172.21.15.52:0/61033130 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f6dc4066130 con 0x7f6dd4101000 2024-09-06T15:08:29.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.594+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6dd410b3d0 con 0x7f6dd4101000 2024-09-06T15:08:29.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.594+0000 7f6dca7fc640 1 -- 172.21.15.52:0/61033130 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f6dc406ab50 con 0x7f6dd4101000 2024-09-06T15:08:29.595 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:08:29.596 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:08:29.596 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:08:29.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:08:29.596 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:08:29.596 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:08:29.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:08:29.597 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:08:29.597 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:08:29.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:08:29.597 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:08:29.597 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:08:29.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:08:29.598 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:08:29.598 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:08:29.598 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:08:29.598 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:08:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6dc00774b0 msgr2=0x7f6dc0079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6dc00774b0 0x7f6dc0079970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0000c00 tx=0x7f6dd0031400 comp rx=0 tx=0).stop 2024-09-06T15:08:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4101000 msgr2=0x7f6dd419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4101000 0x7f6dd419fdc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400d6f0 tx=0x7f6dc400dbb0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 shutdown_connections 2024-09-06T15:08:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dd4101000 0x7f6dd419fdc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f6dc00774b0 0x7f6dc0079970 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 --2- 172.21.15.52:0/61033130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6dd4100650 0x7f6dd419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 >> 172.21.15.52:0/61033130 conn(0x7f6dd40fc520 msgr2=0x7f6dd40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 shutdown_connections 2024-09-06T15:08:29.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.596+0000 7f6ddba4a640 1 -- 172.21.15.52:0/61033130 wait complete. 2024-09-06T15:08:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.679+0000 7f57e2deb640 1 -- 172.21.15.52:0/2732785807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1007f0 msgr2=0x7f57dc100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.679+0000 7f57e2deb640 1 --2- 172.21.15.52:0/2732785807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1007f0 0x7f57dc100c50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009880 tx=0x7f57c802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 -- 172.21.15.52:0/2732785807 shutdown_connections 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 --2- 172.21.15.52:0/2732785807 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1007f0 0x7f57dc100c50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 --2- 172.21.15.52:0/2732785807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57dc1067f0 0x7f57dc106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 -- 172.21.15.52:0/2732785807 >> 172.21.15.52:0/2732785807 conn(0x7f57dc0fc550 msgr2=0x7f57dc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 -- 172.21.15.52:0/2732785807 shutdown_connections 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 -- 172.21.15.52:0/2732785807 wait complete. 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 Processor -- start 2024-09-06T15:08:29.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.680+0000 7f57e2deb640 1 -- start start 2024-09-06T15:08:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57e2deb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57dc1007f0 0x7f57dc1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57e2deb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1067f0 0x7f57dc198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57e2deb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc10dca0 con 0x7f57dc1067f0 2024-09-06T15:08:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57e2deb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc10db20 con 0x7f57dc1007f0 2024-09-06T15:08:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1067f0 0x7f57dc198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57dbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1067f0 0x7f57dc198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:42994/0 (socket says 172.21.15.52:42994) 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57dbfff640 1 -- 172.21.15.52:0/3981797738 learned_addr learned my addr 172.21.15.52:0/3981797738 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57e0b87640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57dc1007f0 0x7f57dc1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57dbfff640 1 -- 172.21.15.52:0/3981797738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57dc1007f0 msgr2=0x7f57dc1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57dbfff640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57dc1007f0 0x7f57dc1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57dbfff640 1 -- 172.21.15.52:0/3981797738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc199260 con 0x7f57dc1067f0 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57dbfff640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1067f0 0x7f57dc198cf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f57c8031460 tx=0x7f57c80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57d9ffb640 1 -- 172.21.15.52:0/3981797738 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57c803f070 con 0x7f57dc1067f0 2024-09-06T15:08:29.689 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc1994f0 con 0x7f57dc1067f0 2024-09-06T15:08:29.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.681+0000 7f57d9ffb640 1 -- 172.21.15.52:0/3981797738 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57c8004cf0 con 0x7f57dc1067f0 2024-09-06T15:08:29.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.682+0000 7f57d9ffb640 1 -- 172.21.15.52:0/3981797738 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57c8035030 con 0x7f57dc1067f0 2024-09-06T15:08:29.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.682+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc1a1aa0 con 0x7f57dc1067f0 2024-09-06T15:08:29.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.683+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57dc101f30 con 0x7f57dc1067f0 2024-09-06T15:08:29.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.683+0000 7f57d9ffb640 1 -- 172.21.15.52:0/3981797738 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f57c8042070 con 0x7f57dc1067f0 2024-09-06T15:08:29.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.684+0000 7f57d9ffb640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f57cc077460 0x7f57cc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.690 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.684+0000 7f57e0b87640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f57cc077460 0x7f57cc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.684+0000 7f57d9ffb640 1 -- 172.21.15.52:0/3981797738 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f57c80ba230 con 0x7f57dc1067f0 2024-09-06T15:08:29.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.684+0000 7f57e0b87640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f57cc077460 0x7f57cc079920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f57d0005e10 tx=0x7f57d0005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.688+0000 7f57d9ffb640 1 -- 172.21.15.52:0/3981797738 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f57c8083190 con 0x7f57dc1067f0 2024-09-06T15:08:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.872+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f57dc1a1d50 con 0x7f57dc1067f0 2024-09-06T15:08:29.873 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.873+0000 7f57d9ffb640 1 -- 172.21.15.52:0/3981797738 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+2002 (secure 0 0 0) 0x7f57c8087300 con 0x7f57dc1067f0 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:e30 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T14:53:44:505929+0000 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:08:29.874 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T14:52:46.620986+0000 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:08:29.875 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:up {} 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:failed 0,1 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:08:29.876 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 0 members: 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout:Standby daemons: 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{-1:34342} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{-1:34374} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:08:29.877 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:08:29.878 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:08:29.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f57cc077460 msgr2=0x7f57cc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f57cc077460 0x7f57cc079920 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f57d0005e10 tx=0x7f57d0005da0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1067f0 msgr2=0x7f57dc198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1067f0 0x7f57dc198cf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f57c8031460 tx=0x7f57c80048f0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 shutdown_connections 2024-09-06T15:08:29.878 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f57dc1067f0 0x7f57dc198cf0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f57cc077460 0x7f57cc079920 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 --2- 172.21.15.52:0/3981797738 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f57dc1007f0 0x7f57dc1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 >> 172.21.15.52:0/3981797738 conn(0x7f57dc0fc550 msgr2=0x7f57dc0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 shutdown_connections 2024-09-06T15:08:29.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.875+0000 7f57e2deb640 1 -- 172.21.15.52:0/3981797738 wait complete. 2024-09-06T15:08:29.960 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.959+0000 7fbcfc38f640 1 -- 172.21.15.52:0/3615522782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 msgr2=0x7fbcf410dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.959+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/3615522782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf410dd40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009880 tx=0x7fbce802a490 comp rx=0 tx=0).stop 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.959+0000 7fbcfc38f640 1 -- 172.21.15.52:0/3615522782 shutdown_connections 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.959+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/3615522782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf410dd40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.959+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/3615522782 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcf41006d0 0x7fbcf4100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.960+0000 7fbcfc38f640 1 -- 172.21.15.52:0/3615522782 >> 172.21.15.52:0/3615522782 conn(0x7fbcf40fc520 msgr2=0x7fbcf40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.960+0000 7fbcfc38f640 1 -- 172.21.15.52:0/3615522782 shutdown_connections 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.960+0000 7fbcfc38f640 1 -- 172.21.15.52:0/3615522782 wait complete. 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.960+0000 7fbcfc38f640 1 Processor -- start 2024-09-06T15:08:29.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.960+0000 7fbcfc38f640 1 -- start start 2024-09-06T15:08:29.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcfc38f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcf41006d0 0x7fbcf419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcfc38f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcfc38f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4110f90 con 0x7fbcf4101080 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcfc38f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf4110e10 con 0x7fbcf41006d0 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf992a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf992a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43012/0 (socket says 172.21.15.52:43012) 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf992a640 1 -- 172.21.15.52:0/2711226134 learned_addr learned my addr 172.21.15.52:0/2711226134 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcfa12b640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcf41006d0 0x7fbcf419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf992a640 1 -- 172.21.15.52:0/2711226134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcf41006d0 msgr2=0x7fbcf419f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf992a640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcf41006d0 0x7fbcf419f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf992a640 1 -- 172.21.15.52:0/2711226134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf4199a20 con 0x7fbcf4101080 2024-09-06T15:08:29.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf992a640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf419fda0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbce8031460 tx=0x7fbce80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf37fe640 1 -- 172.21.15.52:0/2711226134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbce803f070 con 0x7fbcf4101080 2024-09-06T15:08:29.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcf37fe640 1 -- 172.21.15.52:0/2711226134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbce80035f0 con 0x7fbcf4101080 2024-09-06T15:08:29.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.961+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf4199cb0 con 0x7fbcf4101080 2024-09-06T15:08:29.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.962+0000 7fbcf37fe640 1 -- 172.21.15.52:0/2711226134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbce8035030 con 0x7fbcf4101080 2024-09-06T15:08:29.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.962+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf419a240 con 0x7fbcf4101080 2024-09-06T15:08:29.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.963+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf406aa10 con 0x7fbcf4101080 2024-09-06T15:08:29.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.963+0000 7fbcf37fe640 1 -- 172.21.15.52:0/2711226134 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fbce8042070 con 0x7fbcf4101080 2024-09-06T15:08:29.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.964+0000 7fbcf37fe640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbcdc0774b0 0x7fbcdc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:29.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.964+0000 7fbcf37fe640 1 -- 172.21.15.52:0/2711226134 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fbce80ba0b0 con 0x7fbcf4101080 2024-09-06T15:08:29.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.964+0000 7fbcfa12b640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbcdc0774b0 0x7fbcdc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:29.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.964+0000 7fbcfa12b640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbcdc0774b0 0x7fbcdc079970 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbcf419ab60 tx=0x7fbce4009680 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:29.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:29.968+0000 7fbcf37fe640 1 -- 172.21.15.52:0/2711226134 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fbce8087160 con 0x7fbcf4101080 2024-09-06T15:08:30.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.147+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbcf410b490 con 0x7fbcdc0774b0 2024-09-06T15:08:30.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.149+0000 7fbcf37fe640 1 -- 172.21.15.52:0/2711226134 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fbce4012450 con 0x7fbcdc0774b0 2024-09-06T15:08:30.149 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:08:30.149 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:08:30.149 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:08:30.149 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:08:30.149 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:08:30.149 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "16/23 daemons upgraded", 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading mds daemons", 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:08:30.150 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:08:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbcdc0774b0 msgr2=0x7fbcdc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:30.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbcdc0774b0 0x7fbcdc079970 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbcf419ab60 tx=0x7fbce4009680 comp rx=0 tx=0).stop 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 msgr2=0x7fbcf419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf419fda0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbce8031460 tx=0x7fbce80045e0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 shutdown_connections 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcf4101080 0x7fbcf419fda0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fbcdc0774b0 0x7fbcdc079970 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 --2- 172.21.15.52:0/2711226134 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcf41006d0 0x7fbcf419f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 >> 172.21.15.52:0/2711226134 conn(0x7fbcf40fc520 msgr2=0x7fbcf40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 shutdown_connections 2024-09-06T15:08:30.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.151+0000 7fbcfc38f640 1 -- 172.21.15.52:0/2711226134 wait complete. 2024-09-06T15:08:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 -- 172.21.15.52:0/1169147826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0107900 msgr2=0x7ff4f0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:30.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 --2- 172.21.15.52:0/1169147826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0107900 0x7ff4f0107ce0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009880 tx=0x7ff4ec02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 -- 172.21.15.52:0/1169147826 shutdown_connections 2024-09-06T15:08:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 --2- 172.21.15.52:0/1169147826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4f0101900 0x7ff4f0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 --2- 172.21.15.52:0/1169147826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0107900 0x7ff4f0107ce0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 -- 172.21.15.52:0/1169147826 >> 172.21.15.52:0/1169147826 conn(0x7ff4f00fd600 msgr2=0x7ff4f00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:30.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:30 smithi052 ceph-mon[112917]: pgmap v727: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:30.235 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:30 smithi052 ceph-mon[112917]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:30.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:30 smithi052 ceph-mon[112917]: from='client.35170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:30.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:30 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/61033130' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:30.236 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:30 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3981797738' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:08:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 -- 172.21.15.52:0/1169147826 shutdown_connections 2024-09-06T15:08:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.233+0000 7ff4f796b640 1 -- 172.21.15.52:0/1169147826 wait complete. 2024-09-06T15:08:30.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f796b640 1 Processor -- start 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f796b640 1 -- start start 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f796b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0101900 0x7ff4f019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f796b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4f0107900 0x7ff4f019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f796b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f010edb0 con 0x7ff4f0101900 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f796b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f010ec30 con 0x7ff4f0107900 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f5707640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0101900 0x7ff4f019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f5707640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0101900 0x7ff4f019f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:43030/0 (socket says 172.21.15.52:43030) 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.234+0000 7ff4f5707640 1 -- 172.21.15.52:0/3203050633 learned_addr learned my addr 172.21.15.52:0/3203050633 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4f4f06640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4f0107900 0x7ff4f019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4f5707640 1 -- 172.21.15.52:0/3203050633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4f0107900 msgr2=0x7ff4f019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4f5707640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4f0107900 0x7ff4f019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4f5707640 1 -- 172.21.15.52:0/3203050633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f01a0480 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4f5707640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0101900 0x7ff4f019f890 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec031460 tx=0x7ff4ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4e67fc640 1 -- 172.21.15.52:0/3203050633 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec03f070 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f0199b10 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4e67fc640 1 -- 172.21.15.52:0/3203050633 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4ec004cf0 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4e67fc640 1 -- 172.21.15.52:0/3203050633 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4ec035030 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.235+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f019a010 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.236+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f0103040 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.237+0000 7ff4e67fc640 1 -- 172.21.15.52:0/3203050633 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff4ec042070 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.237+0000 7ff4e67fc640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff4dc077460 0x7ff4dc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.238+0000 7ff4e67fc640 1 -- 172.21.15.52:0/3203050633 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ff4ec0b9e30 con 0x7ff4f0101900 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.238+0000 7ff4f4f06640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff4dc077460 0x7ff4dc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:08:30.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.238+0000 7ff4f4f06640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff4dc077460 0x7ff4dc079920 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0005e10 tx=0x7ff4e0005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:08:30.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.241+0000 7ff4e67fc640 1 -- 172.21.15.52:0/3203050633 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff4ec082d90 con 0x7ff4f0101900 2024-09-06T15:08:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:30 smithi165 ceph-mon[82925]: pgmap v727: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:30 smithi165 ceph-mon[82925]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:30 smithi165 ceph-mon[82925]: from='client.35170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:30 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/61033130' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:30.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:30 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3981797738' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:08:30.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.462+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff4f019a380 con 0x7ff4f0101900 2024-09-06T15:08:30.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.462+0000 7ff4e67fc640 1 -- 172.21.15.52:0/3203050633 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1203 (secure 0 0 0) 0x7ff4ec086f00 con 0x7ff4f0101900 2024-09-06T15:08:30.463 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:08:30.463 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-06T15:08:30.463 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is degraded 2024-09-06T15:08:30.463 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:08:30.463 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:08:30.463 INFO:teuthology.orchestra.run.smithi052.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:08:30.464 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff4dc077460 msgr2=0x7ff4dc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff4dc077460 0x7ff4dc079920 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0005e10 tx=0x7ff4e0005da0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0101900 msgr2=0x7ff4f019f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0101900 0x7ff4f019f890 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec031460 tx=0x7ff4ec0048f0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 shutdown_connections 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff4dc077460 0x7ff4dc079920 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff4f0107900 0x7ff4f019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 --2- 172.21.15.52:0/3203050633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4f0101900 0x7ff4f019f890 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:08:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 >> 172.21.15.52:0/3203050633 conn(0x7ff4f00fd600 msgr2=0x7ff4f00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:08:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 shutdown_connections 2024-09-06T15:08:30.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:08:30.464+0000 7ff4f796b640 1 -- 172.21.15.52:0/3203050633 wait complete. 2024-09-06T15:08:31.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:31 smithi165 ceph-mon[82925]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:31.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:31 smithi165 ceph-mon[82925]: from='client.35186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:31.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:31 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3203050633' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:08:31.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:31 smithi052 ceph-mon[112917]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:31.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:31 smithi052 ceph-mon[112917]: from='client.35186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:08:31.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:31 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3203050633' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:08:32.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:32 smithi165 ceph-mon[82925]: pgmap v728: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:32.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:32 smithi052 ceph-mon[112917]: pgmap v728: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:34.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:34 smithi165 ceph-mon[82925]: pgmap v729: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:34.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:34 smithi052 ceph-mon[112917]: pgmap v729: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:36.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:36 smithi165 ceph-mon[82925]: pgmap v730: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:36.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:36 smithi052 ceph-mon[112917]: pgmap v730: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:38 smithi052 ceph-mon[112917]: pgmap v731: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:38.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:38.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:38 smithi165 ceph-mon[82925]: pgmap v731: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:38.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:40.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:40 smithi052 ceph-mon[112917]: pgmap v732: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:40.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:40 smithi165 ceph-mon[82925]: pgmap v732: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:42.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:42 smithi052 ceph-mon[112917]: pgmap v733: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:42.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:42 smithi165 ceph-mon[82925]: pgmap v733: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:44.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:44 smithi052 ceph-mon[112917]: pgmap v734: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:44.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:44 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:44.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:44 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:44.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:44 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:44.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:44 smithi165 ceph-mon[82925]: pgmap v734: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:44.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:44 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:44.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:44 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:08:44.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:44 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: pgmap v735: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all mds 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.dfprfm"}]': finished 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.eqtxfx"} : dispatch 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.eqtxfx"}]': finished 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.nmjcsh"} : dispatch 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.nmjcsh"}]': finished 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.zpunux"} : dispatch 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.zpunux"}]': finished 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: Upgrade: Setting filesystem cephfs Joinable 2024-09-06T15:08:45.377 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:45 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-06T15:08:45.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: pgmap v735: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:45.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all mds 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.dfprfm"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.dfprfm"}]': finished 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.eqtxfx"} : dispatch 2024-09-06T15:08:45.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi052.eqtxfx"}]': finished 2024-09-06T15:08:45.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.nmjcsh"} : dispatch 2024-09-06T15:08:45.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.nmjcsh"}]': finished 2024-09-06T15:08:45.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.zpunux"} : dispatch 2024-09-06T15:08:45.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi165.zpunux"}]': finished 2024-09-06T15:08:45.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: Upgrade: Setting filesystem cephfs Joinable 2024-09-06T15:08:45.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:45 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-06T15:08:46.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-06T15:08:46.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: Standby daemon mds.cephfs.smithi052.dfprfm assigned to filesystem cephfs as rank 0 2024-09-06T15:08:46.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: Standby daemon mds.cephfs.smithi052.eqtxfx assigned to filesystem cephfs as rank 1 2024-09-06T15:08:46.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-06T15:08:46.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T15:08:46.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-06T15:08:46.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:replay,1=cephfs.smithi052.eqtxfx=up:replay} 2 up:standby 2024-09-06T15:08:46.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:46 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-06T15:08:46.628 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-06T15:08:46.628 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: Standby daemon mds.cephfs.smithi052.dfprfm assigned to filesystem cephfs as rank 0 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: Standby daemon mds.cephfs.smithi052.eqtxfx assigned to filesystem cephfs as rank 1 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:replay,1=cephfs.smithi052.eqtxfx=up:replay} 2 up:standby 2024-09-06T15:08:46.629 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:46 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-06T15:08:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: pgmap v736: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-06T15:08:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:resolve 2024-09-06T15:08:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:replay,1=cephfs.smithi052.eqtxfx=up:resolve} 2 up:standby 2024-09-06T15:08:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:47.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all rgw 2024-09-06T15:08:47.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:47.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:47.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all rbd-mirror 2024-09-06T15:08:47.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:47.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:47 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:47.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: pgmap v736: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-06T15:08:47.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-06T15:08:47.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:resolve 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:replay,1=cephfs.smithi052.eqtxfx=up:resolve} 2 up:standby 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all rgw 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all rbd-mirror 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:47.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:47 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:08:49.214 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:48 smithi052 ceph-mon[112917]: Upgrade: Updating ceph-exporter.smithi052 (1/2) 2024-09-06T15:08:49.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:49.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-06T15:08:49.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:48 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:49.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:48 smithi052 ceph-mon[112917]: Deploying daemon ceph-exporter.smithi052 on smithi052 2024-09-06T15:08:49.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:48 smithi052 ceph-mon[112917]: pgmap v737: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 0 op/s 2024-09-06T15:08:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:48 smithi165 ceph-mon[82925]: Upgrade: Updating ceph-exporter.smithi052 (1/2) 2024-09-06T15:08:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi052", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-06T15:08:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:48 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:48 smithi165 ceph-mon[82925]: Deploying daemon ceph-exporter.smithi052 on smithi052 2024-09-06T15:08:49.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:48 smithi165 ceph-mon[82925]: pgmap v737: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 0 op/s 2024-09-06T15:08:51.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:51 smithi052 ceph-mon[112917]: pgmap v738: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 5 op/s 2024-09-06T15:08:51.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:51 smithi165 ceph-mon[82925]: pgmap v738: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 12 MiB/s rd, 5 op/s 2024-09-06T15:08:53.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:52 smithi052 ceph-mon[112917]: pgmap v739: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-09-06T15:08:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:53.255 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:53.256 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:53.256 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:52 smithi165 ceph-mon[82925]: pgmap v739: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 6 op/s 2024-09-06T15:08:53.256 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:53.256 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:08:54.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:54 smithi165 ceph-mon[82925]: Upgrade: Updating ceph-exporter.smithi165 (2/2) 2024-09-06T15:08:54.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:54 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:54.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:54 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-06T15:08:54.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:54 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:54 smithi165 ceph-mon[82925]: Deploying daemon ceph-exporter.smithi165 on smithi165 2024-09-06T15:08:54.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:54 smithi165 ceph-mon[82925]: pgmap v740: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2024-09-06T15:08:54.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:54 smithi052 ceph-mon[112917]: Upgrade: Updating ceph-exporter.smithi165 (2/2) 2024-09-06T15:08:54.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:54 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:54.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:54 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi165", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-06T15:08:54.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:54 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:08:54.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:54 smithi052 ceph-mon[112917]: Deploying daemon ceph-exporter.smithi165 on smithi165 2024-09-06T15:08:54.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:54 smithi052 ceph-mon[112917]: pgmap v740: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2024-09-06T15:08:55.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:55 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:resolve 2024-09-06T15:08:55.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:55 smithi052 ceph-mon[112917]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:resolve,1=cephfs.smithi052.eqtxfx=up:resolve} 2 up:standby 2024-09-06T15:08:55.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:55 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:resolve 2024-09-06T15:08:55.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:55 smithi165 ceph-mon[82925]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:resolve,1=cephfs.smithi052.eqtxfx=up:resolve} 2 up:standby 2024-09-06T15:08:56.556 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: reconnect by client.14616 192.168.0.1:0/3950046951 after 0.000999986 2024-09-06T15:08:56.556 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: reconnect by client.14616 192.168.0.1:0/3950046951 after 0.000999986 2024-09-06T15:08:56.557 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: reconnect by client.24315 192.168.0.1:0/4209345592 after 0.000999986 2024-09-06T15:08:56.557 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: reconnect by client.24315 192.168.0.1:0/4209345592 after 0.000999986 2024-09-06T15:08:56.557 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:reconnect 2024-09-06T15:08:56.557 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:reconnect 2024-09-06T15:08:56.557 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:reconnect,1=cephfs.smithi052.eqtxfx=up:reconnect} 2 up:standby 2024-09-06T15:08:56.557 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:56 smithi165 ceph-mon[82925]: pgmap v741: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-06T15:08:56.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: reconnect by client.14616 192.168.0.1:0/3950046951 after 0.000999986 2024-09-06T15:08:56.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: reconnect by client.14616 192.168.0.1:0/3950046951 after 0.000999986 2024-09-06T15:08:56.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: reconnect by client.24315 192.168.0.1:0/4209345592 after 0.000999986 2024-09-06T15:08:56.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: reconnect by client.24315 192.168.0.1:0/4209345592 after 0.000999986 2024-09-06T15:08:56.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:reconnect 2024-09-06T15:08:56.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:reconnect 2024-09-06T15:08:56.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:reconnect,1=cephfs.smithi052.eqtxfx=up:reconnect} 2 up:standby 2024-09-06T15:08:56.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:56 smithi052 ceph-mon[112917]: pgmap v741: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-06T15:08:57.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:rejoin 2024-09-06T15:08:57.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:rejoin 2024-09-06T15:08:57.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:rejoin,1=cephfs.smithi052.eqtxfx=up:rejoin} 2 up:standby 2024-09-06T15:08:57.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: daemon mds.cephfs.smithi052.eqtxfx is now active in filesystem cephfs as rank 1 2024-09-06T15:08:57.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: daemon mds.cephfs.smithi052.dfprfm is now active in filesystem cephfs as rank 0 2024-09-06T15:08:57.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:57.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:57 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:rejoin 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:rejoin 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: fsmap cephfs:2/2 {0=cephfs.smithi052.dfprfm=up:rejoin,1=cephfs.smithi052.eqtxfx=up:rejoin} 2 up:standby 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: daemon mds.cephfs.smithi052.eqtxfx is now active in filesystem cephfs as rank 1 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: daemon mds.cephfs.smithi052.dfprfm is now active in filesystem cephfs as rank 0 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:57.627 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:57 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:08:58.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:58 smithi165 ceph-mon[82925]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-06T15:08:58.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:58 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:active 2024-09-06T15:08:58.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:58 smithi165 ceph-mon[82925]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:active 2024-09-06T15:08:58.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:58 smithi165 ceph-mon[82925]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi052.eqtxfx=up:active} 2 up:standby 2024-09-06T15:08:58.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:58 smithi165 ceph-mon[82925]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi052.eqtxfx=up:active} 2 up:standby-replay 2024-09-06T15:08:58.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:08:58 smithi165 ceph-mon[82925]: pgmap v742: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 9 op/s 2024-09-06T15:08:58.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:58 smithi052 ceph-mon[112917]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-06T15:08:58.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:58 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] up:active 2024-09-06T15:08:58.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:58 smithi052 ceph-mon[112917]: mds.? [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] up:active 2024-09-06T15:08:58.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:58 smithi052 ceph-mon[112917]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi052.eqtxfx=up:active} 2 up:standby 2024-09-06T15:08:58.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:58 smithi052 ceph-mon[112917]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi052.eqtxfx=up:active} 2 up:standby-replay 2024-09-06T15:08:58.627 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:08:58 smithi052 ceph-mon[112917]: pgmap v742: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 9 op/s 2024-09-06T15:09:00.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 -- 172.21.15.52:0/700949645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 msgr2=0x7fa02c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:00.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 --2- 172.21.15.52:0/700949645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c102e90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009880 tx=0x7fa01c02a530 comp rx=0 tx=0).stop 2024-09-06T15:09:00.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 -- 172.21.15.52:0/700949645 shutdown_connections 2024-09-06T15:09:00.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 --2- 172.21.15.52:0/700949645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa02c1033d0 0x7fa02c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 --2- 172.21.15.52:0/700949645 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c102e90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 -- 172.21.15.52:0/700949645 >> 172.21.15.52:0/700949645 conn(0x7fa02c0fc550 msgr2=0x7fa02c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:00.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 -- 172.21.15.52:0/700949645 shutdown_connections 2024-09-06T15:09:00.556 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.555+0000 7fa03247f640 1 -- 172.21.15.52:0/700949645 wait complete. 2024-09-06T15:09:00.557 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.556+0000 7fa03247f640 1 Processor -- start 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.556+0000 7fa03247f640 1 -- start start 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa03247f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa03247f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa02c1033d0 0x7fa02c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa03247f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa02c10edc0 con 0x7fa02c102ab0 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa03247f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa02c10ec40 con 0x7fa02c1033d0 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02bfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60836/0 (socket says 172.21.15.52:60836) 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02bfff640 1 -- 172.21.15.52:0/3906460083 learned_addr learned my addr 172.21.15.52:0/3906460083 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02b7fe640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa02c1033d0 0x7fa02c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02bfff640 1 -- 172.21.15.52:0/3906460083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa02c1033d0 msgr2=0x7fa02c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02bfff640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa02c1033d0 0x7fa02c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.558 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02bfff640 1 -- 172.21.15.52:0/3906460083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02c101190 con 0x7fa02c102ab0 2024-09-06T15:09:00.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02b7fe640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa02c1033d0 0x7fa02c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:09:00.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa02bfff640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c100710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa01c031460 tx=0x7fa01c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:00.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa0297fa640 1 -- 172.21.15.52:0/3906460083 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa01c03f070 con 0x7fa02c102ab0 2024-09-06T15:09:00.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.557+0000 7fa0297fa640 1 -- 172.21.15.52:0/3906460083 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa01c0035f0 con 0x7fa02c102ab0 2024-09-06T15:09:00.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.558+0000 7fa0297fa640 1 -- 172.21.15.52:0/3906460083 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa01c035030 con 0x7fa02c102ab0 2024-09-06T15:09:00.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.558+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02c101420 con 0x7fa02c102ab0 2024-09-06T15:09:00.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.558+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa02c1a3d70 con 0x7fa02c102ab0 2024-09-06T15:09:00.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.559+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa02c06a580 con 0x7fa02c102ab0 2024-09-06T15:09:00.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.559+0000 7fa0297fa640 1 -- 172.21.15.52:0/3906460083 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fa01c042070 con 0x7fa02c102ab0 2024-09-06T15:09:00.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.560+0000 7fa0297fa640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa0140774b0 0x7fa014079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:00.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.560+0000 7fa02b7fe640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa0140774b0 0x7fa014079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:00.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.560+0000 7fa0297fa640 1 -- 172.21.15.52:0/3906460083 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fa01c0ba100 con 0x7fa02c102ab0 2024-09-06T15:09:00.560 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.561+0000 7fa02b7fe640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa0140774b0 0x7fa014079970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa02c1021a0 tx=0x7fa02000b690 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:00.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.564+0000 7fa0297fa640 1 -- 172.21.15.52:0/3906460083 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fa01c084140 con 0x7fa02c102ab0 2024-09-06T15:09:00.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.743+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa02c062630 con 0x7fa0140774b0 2024-09-06T15:09:00.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.744+0000 7fa0297fa640 1 -- 172.21.15.52:0/3906460083 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7fa02c062630 con 0x7fa0140774b0 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa0140774b0 msgr2=0x7fa014079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa0140774b0 0x7fa014079970 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa02c1021a0 tx=0x7fa02000b690 comp rx=0 tx=0).stop 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 msgr2=0x7fa02c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c100710 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa01c031460 tx=0x7fa01c0045e0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 shutdown_connections 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fa0140774b0 0x7fa014079970 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa02c1033d0 0x7fa02c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 --2- 172.21.15.52:0/3906460083 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa02c102ab0 0x7fa02c100710 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 >> 172.21.15.52:0/3906460083 conn(0x7fa02c0fc550 msgr2=0x7fa02c108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:00.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 shutdown_connections 2024-09-06T15:09:00.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.746+0000 7fa03247f640 1 -- 172.21.15.52:0/3906460083 wait complete. 2024-09-06T15:09:00.754 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:09:00.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 -- 172.21.15.52:0/2980858624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 msgr2=0x7f00c8100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:00.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 --2- 172.21.15.52:0/2980858624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c8100710 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009880 tx=0x7f00c402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 -- 172.21.15.52:0/2980858624 shutdown_connections 2024-09-06T15:09:00.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 --2- 172.21.15.52:0/2980858624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c8100ce0 0x7f00c81065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 --2- 172.21.15.52:0/2980858624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c8100710 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 -- 172.21.15.52:0/2980858624 >> 172.21.15.52:0/2980858624 conn(0x7f00c8077270 msgr2=0x7f00c8077680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 -- 172.21.15.52:0/2980858624 shutdown_connections 2024-09-06T15:09:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.830+0000 7f00d002a640 1 -- 172.21.15.52:0/2980858624 wait complete. 2024-09-06T15:09:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00d002a640 1 Processor -- start 2024-09-06T15:09:00.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00d002a640 1 -- start start 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00d002a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00d002a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c8100ce0 0x7f00c819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00d002a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00c810edf0 con 0x7f00c8100330 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00d002a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00c810ec70 con 0x7f00c8100ce0 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00cddc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00cddc6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60842/0 (socket says 172.21.15.52:60842) 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00cddc6640 1 -- 172.21.15.52:0/1537869211 learned_addr learned my addr 172.21.15.52:0/1537869211 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:00.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.831+0000 7f00cd5c5640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c8100ce0 0x7f00c819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00cddc6640 1 -- 172.21.15.52:0/1537869211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c8100ce0 msgr2=0x7f00c819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00cddc6640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c8100ce0 0x7f00c819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00cddc6640 1 -- 172.21.15.52:0/1537869211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c81977b0 con 0x7f00c8100330 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00cddc6640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c819d630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f00c4031460 tx=0x7f00c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00beffd640 1 -- 172.21.15.52:0/1537869211 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00c403f070 con 0x7f00c8100330 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00beffd640 1 -- 172.21.15.52:0/1537869211 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f00c40035f0 con 0x7f00c8100330 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c8197a40 con 0x7f00c8100330 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00beffd640 1 -- 172.21.15.52:0/1537869211 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00c4035030 con 0x7f00c8100330 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.832+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c8197f70 con 0x7f00c8100330 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.833+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c8069e00 con 0x7f00c8100330 2024-09-06T15:09:00.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.834+0000 7f00beffd640 1 -- 172.21.15.52:0/1537869211 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f00c4042070 con 0x7f00c8100330 2024-09-06T15:09:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.834+0000 7f00beffd640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f00b4077460 0x7f00b4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.834+0000 7f00cd5c5640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f00b4077460 0x7f00b4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.834+0000 7f00beffd640 1 -- 172.21.15.52:0/1537869211 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f00c40ba0c0 con 0x7f00c8100330 2024-09-06T15:09:00.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.835+0000 7f00cd5c5640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f00b4077460 0x7f00b4079920 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f00c80ffc70 tx=0x7f00b800b410 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:00.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:00.838+0000 7f00beffd640 1 -- 172.21.15.52:0/1537869211 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f00c4087190 con 0x7f00c8100330 2024-09-06T15:09:01.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.018+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f00c81982e0 con 0x7f00b4077460 2024-09-06T15:09:01.018 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.019+0000 7f00beffd640 1 -- 172.21.15.52:0/1537869211 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f00c81982e0 con 0x7f00b4077460 2024-09-06T15:09:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f00b4077460 msgr2=0x7f00b4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f00b4077460 0x7f00b4079920 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f00c80ffc70 tx=0x7f00b800b410 comp rx=0 tx=0).stop 2024-09-06T15:09:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 msgr2=0x7f00c819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c819d630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f00c4031460 tx=0x7f00c40045e0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 shutdown_connections 2024-09-06T15:09:01.021 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f00b4077460 0x7f00b4079920 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c8100ce0 0x7f00c819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 --2- 172.21.15.52:0/1537869211 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00c8100330 0x7f00c819d630 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 >> 172.21.15.52:0/1537869211 conn(0x7f00c8077270 msgr2=0x7f00c80fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 shutdown_connections 2024-09-06T15:09:01.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.021+0000 7f00d002a640 1 -- 172.21.15.52:0/1537869211 wait complete. 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 -- 172.21.15.52:0/2606255202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c107900 msgr2=0x7f7a1c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2606255202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c107900 0x7f7a1c107ce0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009880 tx=0x7f7a0c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 -- 172.21.15.52:0/2606255202 shutdown_connections 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2606255202 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a1c101900 0x7f7a1c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2606255202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c107900 0x7f7a1c107ce0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 -- 172.21.15.52:0/2606255202 >> 172.21.15.52:0/2606255202 conn(0x7f7a1c0fd600 msgr2=0x7f7a1c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 -- 172.21.15.52:0/2606255202 shutdown_connections 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 -- 172.21.15.52:0/2606255202 wait complete. 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 Processor -- start 2024-09-06T15:09:01.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.105+0000 7f7a21d49640 1 -- start start 2024-09-06T15:09:01.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a21d49640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c101900 0x7f7a1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a21d49640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a1c107900 0x7f7a1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a21d49640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c10edd0 con 0x7f7a1c101900 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a21d49640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c10ec50 con 0x7f7a1c107900 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c101900 0x7f7a1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c101900 0x7f7a1c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60852/0 (socket says 172.21.15.52:60852) 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a1b7fe640 1 -- 172.21.15.52:0/2830454027 learned_addr learned my addr 172.21.15.52:0/2830454027 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a12ffd640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a1c107900 0x7f7a1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a1b7fe640 1 -- 172.21.15.52:0/2830454027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a1c107900 msgr2=0x7f7a1c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a1b7fe640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a1c107900 0x7f7a1c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a1b7fe640 1 -- 172.21.15.52:0/2830454027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c074f70 con 0x7f7a1c101900 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.106+0000 7f7a1b7fe640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c101900 0x7f7a1c0744f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c031460 tx=0x7f7a0c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:01.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.107+0000 7f7a197fa640 1 -- 172.21.15.52:0/2830454027 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c03f070 con 0x7f7a1c101900 2024-09-06T15:09:01.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.107+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c075200 con 0x7f7a1c101900 2024-09-06T15:09:01.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.107+0000 7f7a197fa640 1 -- 172.21.15.52:0/2830454027 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a0c0035f0 con 0x7f7a1c101900 2024-09-06T15:09:01.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.107+0000 7f7a197fa640 1 -- 172.21.15.52:0/2830454027 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c035030 con 0x7f7a1c101900 2024-09-06T15:09:01.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.107+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c1a3d80 con 0x7f7a1c101900 2024-09-06T15:09:01.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.108+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1c103040 con 0x7f7a1c101900 2024-09-06T15:09:01.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.109+0000 7f7a197fa640 1 -- 172.21.15.52:0/2830454027 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f7a0c042070 con 0x7f7a1c101900 2024-09-06T15:09:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.109+0000 7f7a197fa640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a08077460 0x7f7a08079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.110+0000 7f7a197fa640 1 -- 172.21.15.52:0/2830454027 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7a0c0ba090 con 0x7f7a1c101900 2024-09-06T15:09:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.110+0000 7f7a12ffd640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a08077460 0x7f7a08079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.110+0000 7f7a12ffd640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a08077460 0x7f7a08079920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c075f80 tx=0x7f7a04005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:01.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.113+0000 7f7a197fa640 1 -- 172.21.15.52:0/2830454027 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7a0c087160 con 0x7f7a1c101900 2024-09-06T15:09:01.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.293+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7a1c062630 con 0x7f7a08077460 2024-09-06T15:09:01.293 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:01 smithi052 ceph-mon[112917]: pgmap v743: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 28 MiB/s rd, 682 B/s wr, 17 op/s 2024-09-06T15:09:01.293 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.293 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.293 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.293 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:01 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.303 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.304+0000 7f7a197fa640 1 -- 172.21.15.52:0/2830454027 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7a1c062630 con 0x7f7a08077460 2024-09-06T15:09:01.303 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:09:01.303 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (21m) 15m ago 32m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 starting - - - - 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (4s) 1s ago 31m 7197k - 19.3.0-4704-g8b38c33c 1c45aca0610a 5ee9a78f191f 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (19m) 15m ago 32m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (19m) 1s ago 31m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (21m) 15m ago 32m 80.2M - c8b91775d855 af78eb451b94 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (16m) 15m ago 27m 13.6M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (15m) 15m ago 27m 10.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (15m) 1s ago 27m 132M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (15m) 1s ago 27m 21.2M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (23m) 15m ago 33m 524M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (22m) 1s ago 31m 464M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:09:01.304 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (20m) 15m ago 33m 47.0M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (19m) 1s ago 31m 49.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (22m) 15m ago 32m 10.7M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (22m) 1s ago 31m 12.1M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (19m) 15m ago 30m 98.0M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (18m) 15m ago 29m 99.1M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (18m) 15m ago 29m 119M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (17m) 1s ago 29m 108M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (16m) 1s ago 28m 94.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (16m) 1s ago 28m 94.7M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:09:01.305 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (21m) 15m ago 31m 58.8M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:09:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a08077460 msgr2=0x7f7a08079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a08077460 0x7f7a08079920 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c075f80 tx=0x7f7a04005f90 comp rx=0 tx=0).stop 2024-09-06T15:09:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c101900 msgr2=0x7f7a1c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c101900 0x7f7a1c0744f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c031460 tx=0x7f7a0c004530 comp rx=0 tx=0).stop 2024-09-06T15:09:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 shutdown_connections 2024-09-06T15:09:01.306 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7a08077460 0x7f7a08079920 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7a1c107900 0x7f7a1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 --2- 172.21.15.52:0/2830454027 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a1c101900 0x7f7a1c0744f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 >> 172.21.15.52:0/2830454027 conn(0x7f7a1c0fd600 msgr2=0x7f7a1c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 shutdown_connections 2024-09-06T15:09:01.307 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.306+0000 7f7a21d49640 1 -- 172.21.15.52:0/2830454027 wait complete. 2024-09-06T15:09:01.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.388+0000 7fd826984640 1 -- 172.21.15.52:0/502229368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 msgr2=0x7fd820101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.388+0000 7fd826984640 1 --2- 172.21.15.52:0/502229368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd820101d60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd814009880 tx=0x7fd81402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.388+0000 7fd826984640 1 -- 172.21.15.52:0/502229368 shutdown_connections 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.388+0000 7fd826984640 1 --2- 172.21.15.52:0/502229368 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd820101d60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.388+0000 7fd826984640 1 --2- 172.21.15.52:0/502229368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd820107900 0x7fd820107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.388+0000 7fd826984640 1 -- 172.21.15.52:0/502229368 >> 172.21.15.52:0/502229368 conn(0x7fd8200fd600 msgr2=0x7fd8200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.388+0000 7fd826984640 1 -- 172.21.15.52:0/502229368 shutdown_connections 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.389+0000 7fd826984640 1 -- 172.21.15.52:0/502229368 wait complete. 2024-09-06T15:09:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.389+0000 7fd826984640 1 Processor -- start 2024-09-06T15:09:01.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.389+0000 7fd826984640 1 -- start start 2024-09-06T15:09:01.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.389+0000 7fd826984640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd82019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.389+0000 7fd826984640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd820107900 0x7fd82019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.389+0000 7fd826984640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd82010edd0 con 0x7fd820101900 2024-09-06T15:09:01.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.389+0000 7fd826984640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd82010ec50 con 0x7fd820107900 2024-09-06T15:09:01.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd82019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd82019f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60870/0 (socket says 172.21.15.52:60870) 2024-09-06T15:09:01.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81ffff640 1 -- 172.21.15.52:0/3437216637 learned_addr learned my addr 172.21.15.52:0/3437216637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:01.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81f7fe640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd820107900 0x7fd82019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81ffff640 1 -- 172.21.15.52:0/3437216637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd820107900 msgr2=0x7fd82019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81ffff640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd820107900 0x7fd82019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81ffff640 1 -- 172.21.15.52:0/3437216637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd820199a10 con 0x7fd820101900 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81ffff640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd82019f850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd81000d6f0 tx=0x7fd81000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81d7fa640 1 -- 172.21.15.52:0/3437216637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd810017070 con 0x7fd820101900 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd820199d00 con 0x7fd820101900 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81d7fa640 1 -- 172.21.15.52:0/3437216637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd81000de00 con 0x7fd820101900 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd81d7fa640 1 -- 172.21.15.52:0/3437216637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd810004bb0 con 0x7fd820101900 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.390+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82019a260 con 0x7fd820101900 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.391+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd820103040 con 0x7fd820101900 2024-09-06T15:09:01.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.392+0000 7fd81d7fa640 1 -- 172.21.15.52:0/3437216637 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd810004e60 con 0x7fd820101900 2024-09-06T15:09:01.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.392+0000 7fd81d7fa640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd808077460 0x7fd808079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.392+0000 7fd81d7fa640 1 -- 172.21.15.52:0/3437216637 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd810099430 con 0x7fd820101900 2024-09-06T15:09:01.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.393+0000 7fd81f7fe640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd808077460 0x7fd808079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.393+0000 7fd81f7fe640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd808077460 0x7fd808079920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd82019b200 tx=0x7fd814031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:01.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.397+0000 7fd81d7fa640 1 -- 172.21.15.52:0/3437216637 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd810066460 con 0x7fd820101900 2024-09-06T15:09:01.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:01 smithi165 ceph-mon[82925]: pgmap v743: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 28 MiB/s rd, 682 B/s wr, 17 op/s 2024-09-06T15:09:01.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.458 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:01 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:01.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.619+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd82019a510 con 0x7fd820101900 2024-09-06T15:09:01.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.620+0000 7fd81d7fa640 1 -- 172.21.15.52:0/3437216637 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd81006ae80 con 0x7fd820101900 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:09:01.620 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:09:01.621 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:01.621 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:09:01.621 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:09:01.621 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:09:01.621 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd808077460 msgr2=0x7fd808079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd808077460 0x7fd808079920 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd82019b200 tx=0x7fd814031400 comp rx=0 tx=0).stop 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 msgr2=0x7fd82019f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd82019f850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd81000d6f0 tx=0x7fd81000dbb0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 shutdown_connections 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd808077460 0x7fd808079920 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd820107900 0x7fd82019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 --2- 172.21.15.52:0/3437216637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd820101900 0x7fd82019f850 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 >> 172.21.15.52:0/3437216637 conn(0x7fd8200fd600 msgr2=0x7fd820074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 shutdown_connections 2024-09-06T15:09:01.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.622+0000 7fd826984640 1 -- 172.21.15.52:0/3437216637 wait complete. 2024-09-06T15:09:01.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.704+0000 7f34d2772640 1 -- 172.21.15.52:0/1172005464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 msgr2=0x7f34cc106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.704+0000 7f34d2772640 1 --2- 172.21.15.52:0/1172005464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc106bd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009880 tx=0x7f34bc02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 -- 172.21.15.52:0/1172005464 shutdown_connections 2024-09-06T15:09:01.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 --2- 172.21.15.52:0/1172005464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34cc1007f0 0x7f34cc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 --2- 172.21.15.52:0/1172005464 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc106bd0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 -- 172.21.15.52:0/1172005464 >> 172.21.15.52:0/1172005464 conn(0x7f34cc0fc550 msgr2=0x7f34cc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 -- 172.21.15.52:0/1172005464 shutdown_connections 2024-09-06T15:09:01.705 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 -- 172.21.15.52:0/1172005464 wait complete. 2024-09-06T15:09:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 Processor -- start 2024-09-06T15:09:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.705+0000 7f34d2772640 1 -- start start 2024-09-06T15:09:01.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34d2772640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34cc1007f0 0x7f34cc107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34d2772640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34d2772640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc10dca0 con 0x7f34cc1067f0 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34d2772640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc10db20 con 0x7f34cc1007f0 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc107c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60888/0 (socket says 172.21.15.52:60888) 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cb7fe640 1 -- 172.21.15.52:0/1565190820 learned_addr learned my addr 172.21.15.52:0/1565190820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cbfff640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34cc1007f0 0x7f34cc107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cb7fe640 1 -- 172.21.15.52:0/1565190820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34cc1007f0 msgr2=0x7f34cc107720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cb7fe640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34cc1007f0 0x7f34cc107720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cb7fe640 1 -- 172.21.15.52:0/1565190820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc1081a0 con 0x7f34cc1067f0 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34cb7fe640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc107c60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f34c000d8d0 tx=0x7f34c000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:01.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34c97fa640 1 -- 172.21.15.52:0/1565190820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34c0017070 con 0x7f34cc1067f0 2024-09-06T15:09:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34c97fa640 1 -- 172.21.15.52:0/1565190820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34c0010460 con 0x7f34cc1067f0 2024-09-06T15:09:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.706+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc108490 con 0x7f34cc1067f0 2024-09-06T15:09:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.707+0000 7f34c97fa640 1 -- 172.21.15.52:0/1565190820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34c000f5f0 con 0x7f34cc1067f0 2024-09-06T15:09:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.707+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc1a3dd0 con 0x7f34cc1067f0 2024-09-06T15:09:01.708 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.707+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc101f30 con 0x7f34cc1067f0 2024-09-06T15:09:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.708+0000 7f34c97fa640 1 -- 172.21.15.52:0/1565190820 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f34c0009a30 con 0x7f34cc1067f0 2024-09-06T15:09:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.708+0000 7f34c97fa640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34b40774b0 0x7f34b4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.709+0000 7f34cbfff640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34b40774b0 0x7f34b4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.709+0000 7f34c97fa640 1 -- 172.21.15.52:0/1565190820 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f34c0099530 con 0x7f34cc1067f0 2024-09-06T15:09:01.710 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.709+0000 7f34cbfff640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34b40774b0 0x7f34b4079970 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0096c0 tx=0x7f34bc031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:01.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.713+0000 7f34c97fa640 1 -- 172.21.15.52:0/1565190820 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f34c0066680 con 0x7f34cc1067f0 2024-09-06T15:09:01.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.897+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f34cc1a40b0 con 0x7f34cc1067f0 2024-09-06T15:09:01.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.898+0000 7f34c97fa640 1 -- 172.21.15.52:0/1565190820 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) ==== 76+0+2052 (secure 0 0 0) 0x7f34c006b0a0 con 0x7f34cc1067f0 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:e38 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T15:08:57:307509+0000 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 38 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T15:09:01.898 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T15:08:57.307495+0000 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:09:01.899 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=34342,1=34374} 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 34342 members: 34374,34342 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:34342} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{0:44321} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:09:01.900 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{1:34374} state up:active seq 240 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:09:01.901 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:44349} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:09:01.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:09:01.901 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:09:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2024-09-06T15:09:01.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34b40774b0 msgr2=0x7f34b4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34b40774b0 0x7f34b4079970 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0096c0 tx=0x7f34bc031400 comp rx=0 tx=0).stop 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 msgr2=0x7f34cc107c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc107c60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f34c000d8d0 tx=0x7f34c000dd90 comp rx=0 tx=0).stop 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 shutdown_connections 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f34cc1067f0 0x7f34cc107c60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f34b40774b0 0x7f34b4079970 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 --2- 172.21.15.52:0/1565190820 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f34cc1007f0 0x7f34cc107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 >> 172.21.15.52:0/1565190820 conn(0x7f34cc0fc550 msgr2=0x7f34cc069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 shutdown_connections 2024-09-06T15:09:01.902 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:01.900+0000 7f34d2772640 1 -- 172.21.15.52:0/1565190820 wait complete. 2024-09-06T15:09:02.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 -- 172.21.15.52:0/2356843623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf20101050 msgr2=0x7faf2010dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 --2- 172.21.15.52:0/2356843623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf20101050 0x7faf2010dd10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7faf08009880 tx=0x7faf0802a490 comp rx=0 tx=0).stop 2024-09-06T15:09:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 -- 172.21.15.52:0/2356843623 shutdown_connections 2024-09-06T15:09:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 --2- 172.21.15.52:0/2356843623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf20101050 0x7faf2010dd10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 --2- 172.21.15.52:0/2356843623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf201006a0 0x7faf20100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 -- 172.21.15.52:0/2356843623 >> 172.21.15.52:0/2356843623 conn(0x7faf200fc550 msgr2=0x7faf200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 -- 172.21.15.52:0/2356843623 shutdown_connections 2024-09-06T15:09:02.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 -- 172.21.15.52:0/2356843623 wait complete. 2024-09-06T15:09:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.007+0000 7faf25ab2640 1 Processor -- start 2024-09-06T15:09:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf25ab2640 1 -- start start 2024-09-06T15:09:02.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf25ab2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf201006a0 0x7faf2019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf25ab2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf20101050 0x7faf2019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf25ab2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faf20110f20 con 0x7faf201006a0 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf25ab2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faf20110da0 con 0x7faf20101050 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf1f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf201006a0 0x7faf2019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf1f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf201006a0 0x7faf2019f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60904/0 (socket says 172.21.15.52:60904) 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf1f7fe640 1 -- 172.21.15.52:0/3980164360 learned_addr learned my addr 172.21.15.52:0/3980164360 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf16ffd640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf20101050 0x7faf2019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf1f7fe640 1 -- 172.21.15.52:0/3980164360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf20101050 msgr2=0x7faf2019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf1f7fe640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf20101050 0x7faf2019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf1f7fe640 1 -- 172.21.15.52:0/3980164360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf20199930 con 0x7faf201006a0 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.008+0000 7faf16ffd640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf20101050 0x7faf2019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:09:02.009 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.009+0000 7faf1f7fe640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf201006a0 0x7faf2019f770 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faf1000d8d0 tx=0x7faf1000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.009+0000 7faf1d7fa640 1 -- 172.21.15.52:0/3980164360 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf10017070 con 0x7faf201006a0 2024-09-06T15:09:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.009+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf20199c20 con 0x7faf201006a0 2024-09-06T15:09:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.009+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2019a180 con 0x7faf201006a0 2024-09-06T15:09:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.009+0000 7faf1d7fa640 1 -- 172.21.15.52:0/3980164360 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf10010460 con 0x7faf201006a0 2024-09-06T15:09:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.009+0000 7faf1d7fa640 1 -- 172.21.15.52:0/3980164360 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf1000f5f0 con 0x7faf201006a0 2024-09-06T15:09:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.010+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2006a520 con 0x7faf201006a0 2024-09-06T15:09:02.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.011+0000 7faf1d7fa640 1 -- 172.21.15.52:0/3980164360 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7faf10009a30 con 0x7faf201006a0 2024-09-06T15:09:02.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.011+0000 7faf1d7fa640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faf0c077460 0x7faf0c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:02.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.012+0000 7faf16ffd640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faf0c077460 0x7faf0c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:02.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.012+0000 7faf1d7fa640 1 -- 172.21.15.52:0/3980164360 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7faf10099670 con 0x7faf201006a0 2024-09-06T15:09:02.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.012+0000 7faf16ffd640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faf0c077460 0x7faf0c079920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faf08000c00 tx=0x7faf08031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:02.015 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.015+0000 7faf1d7fa640 1 -- 172.21.15.52:0/3980164360 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7faf100626f0 con 0x7faf201006a0 2024-09-06T15:09:02.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.195+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faf2019ae60 con 0x7faf0c077460 2024-09-06T15:09:02.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.196+0000 7faf1d7fa640 1 -- 172.21.15.52:0/3980164360 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7faf2019ae60 con 0x7faf0c077460 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30", 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": true, 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [ 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "osd", 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "mds", 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "mon", 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr", 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: "crash" 2024-09-06T15:09:02.196 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-09-06T15:09:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": "17/23 daemons upgraded", 2024-09-06T15:09:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-06T15:09:02.197 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:09:02.197 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:09:02.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faf0c077460 msgr2=0x7faf0c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faf0c077460 0x7faf0c079920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7faf08000c00 tx=0x7faf08031400 comp rx=0 tx=0).stop 2024-09-06T15:09:02.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf201006a0 msgr2=0x7faf2019f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf201006a0 0x7faf2019f770 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7faf1000d8d0 tx=0x7faf1000dd90 comp rx=0 tx=0).stop 2024-09-06T15:09:02.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 shutdown_connections 2024-09-06T15:09:02.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7faf0c077460 0x7faf0c079920 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faf20101050 0x7faf2019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 --2- 172.21.15.52:0/3980164360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faf201006a0 0x7faf2019f770 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 >> 172.21.15.52:0/3980164360 conn(0x7faf200fc550 msgr2=0x7faf200fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:02.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 shutdown_connections 2024-09-06T15:09:02.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.199+0000 7faf25ab2640 1 -- 172.21.15.52:0/3980164360 wait complete. 2024-09-06T15:09:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.283+0000 7fdd037a3640 1 -- 172.21.15.52:0/3270781842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 msgr2=0x7fdcfc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.283+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3270781842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc101d60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009880 tx=0x7fdcec02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 -- 172.21.15.52:0/3270781842 shutdown_connections 2024-09-06T15:09:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3270781842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc101d60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3270781842 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcfc107900 0x7fdcfc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 -- 172.21.15.52:0/3270781842 >> 172.21.15.52:0/3270781842 conn(0x7fdcfc0fd620 msgr2=0x7fdcfc0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 -- 172.21.15.52:0/3270781842 shutdown_connections 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 -- 172.21.15.52:0/3270781842 wait complete. 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 Processor -- start 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.284+0000 7fdd037a3640 1 -- start start 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd037a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd037a3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcfc107900 0x7fdcfc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd037a3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc10edd0 con 0x7fdcfc101900 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd037a3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc10ec50 con 0x7fdcfc107900 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd0153f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd0153f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60924/0 (socket says 172.21.15.52:60924) 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd0153f640 1 -- 172.21.15.52:0/3241050377 learned_addr learned my addr 172.21.15.52:0/3241050377 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd00d3e640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcfc107900 0x7fdcfc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd00d3e640 1 -- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 msgr2=0x7fdcfc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd00d3e640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd00d3e640 1 -- 172.21.15.52:0/3241050377 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc197820 con 0x7fdcfc107900 2024-09-06T15:09:02.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.285+0000 7fdd0153f640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-06T15:09:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.286+0000 7fdd00d3e640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcfc107900 0x7fdcfc19dbe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006010 tx=0x7fdcec0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.286+0000 7fdcf27fc640 1 -- 172.21.15.52:0/3241050377 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdcec03f070 con 0x7fdcfc107900 2024-09-06T15:09:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.286+0000 7fdcf27fc640 1 -- 172.21.15.52:0/3241050377 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdcec0035f0 con 0x7fdcfc107900 2024-09-06T15:09:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.286+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc197ab0 con 0x7fdcfc107900 2024-09-06T15:09:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.286+0000 7fdcf27fc640 1 -- 172.21.15.52:0/3241050377 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdcec035030 con 0x7fdcfc107900 2024-09-06T15:09:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.286+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc197fe0 con 0x7fdcfc107900 2024-09-06T15:09:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.287+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcfc103040 con 0x7fdcfc107900 2024-09-06T15:09:02.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.290+0000 7fdcf27fc640 1 -- 172.21.15.52:0/3241050377 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fdcec042070 con 0x7fdcfc107900 2024-09-06T15:09:02.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.290+0000 7fdcf27fc640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdce80774f0 0x7fdce80799b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:02.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.290+0000 7fdcf27fc640 1 -- 172.21.15.52:0/3241050377 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fdcec0ba1e0 con 0x7fdcfc107900 2024-09-06T15:09:02.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.291+0000 7fdd0153f640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdce80774f0 0x7fdce80799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:02.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.291+0000 7fdd0153f640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdce80774f0 0x7fdce80799b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8011500 tx=0x7fdcf8005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.296+0000 7fdcf27fc640 1 -- 172.21.15.52:0/3241050377 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fdcec087310 con 0x7fdcfc107900 2024-09-06T15:09:02.518 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.518+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdcfc109e70 con 0x7fdcfc107900 2024-09-06T15:09:02.518 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:02 smithi052 ceph-mon[112917]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:02.518 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:02 smithi052 ceph-mon[112917]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:02.518 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:02 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3437216637' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:02.518 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:02 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1565190820' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.519+0000 7fdcf27fc640 1 -- 172.21.15.52:0/3241050377 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+4353 (secure 0 0 0) 0x7fdcec08bd30 con 0x7fdcfc107900 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN failed to probe daemons or devices; 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stdout: host smithi165 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi165/config 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 -e NODE_NAME=smithi165 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968:/var/run/ceph:z -v /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp01962jk0:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 inventory --format=json-pretty --filter-for-batch 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stdout:Traceback (most recent call last): 2024-09-06T15:09:02.519 INFO:teuthology.orchestra.run.smithi052.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: return _run_code(code, main_globals, None, 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: exec(code, run_globals) 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/__main__.py", line 5620, in 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/__main__.py", line 5608, in main 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-06T15:09:02.520 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/__main__.py", line 3345, in command_ceph_volume 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: File "/tmp/tmpe2ps22mg.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 -e NODE_NAME=smithi165 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968:/var/run/ceph:z -v /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp01962jk0:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 inventory --format=json-pretty --filter-for-batch 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:09:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:09:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdce80774f0 msgr2=0x7fdce80799b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdce80774f0 0x7fdce80799b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8011500 tx=0x7fdcf8005f90 comp rx=0 tx=0).stop 2024-09-06T15:09:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcfc107900 msgr2=0x7fdcfc19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcfc107900 0x7fdcfc19dbe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdcec006010 tx=0x7fdcec0045e0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 shutdown_connections 2024-09-06T15:09:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fdce80774f0 0x7fdce80799b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdcfc107900 0x7fdcfc19dbe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 --2- 172.21.15.52:0/3241050377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdcfc101900 0x7fdcfc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.520+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 >> 172.21.15.52:0/3241050377 conn(0x7fdcfc0fd620 msgr2=0x7fdcfc0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.521+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 shutdown_connections 2024-09-06T15:09:02.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:02.521+0000 7fdd037a3640 1 -- 172.21.15.52:0/3241050377 wait complete. 2024-09-06T15:09:02.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:02 smithi165 ceph-mon[82925]: from='client.35196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:02.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:02 smithi165 ceph-mon[82925]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:02.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:02 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3437216637' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:02.545 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:02 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1565190820' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:09:03.232 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:03 smithi052 ceph-mon[112917]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:03.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:03 smithi052 ceph-mon[112917]: pgmap v744: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 767 B/s wr, 16 op/s 2024-09-06T15:09:03.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:03 smithi052 ceph-mon[112917]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:03.233 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:03 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3241050377' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:09:03.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:03 smithi165 ceph-mon[82925]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:03.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:03 smithi165 ceph-mon[82925]: pgmap v744: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 767 B/s wr, 16 op/s 2024-09-06T15:09:03.494 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:03 smithi165 ceph-mon[82925]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:03.495 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:03 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3241050377' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:09:04.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:04.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:04.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:04 smithi052 ceph-mon[112917]: pgmap v745: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 767 B/s wr, 17 op/s 2024-09-06T15:09:04.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:04.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:04.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:04.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:04 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:05.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:04 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:05.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:04 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:05.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:04 smithi165 ceph-mon[82925]: pgmap v745: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 767 B/s wr, 17 op/s 2024-09-06T15:09:05.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:04 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:05.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:04 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:05.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:04 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:05.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:04 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:07.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:07 smithi052 ceph-mon[112917]: pgmap v746: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-06T15:09:07.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:07 smithi165 ceph-mon[82925]: pgmap v746: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: pgmap v747: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 5.1 KiB/s wr, 19 op/s 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:08.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: Upgrade: Setting filesystem cephfs Joinable 2024-09-06T15:09:08.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-06T15:09:09.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: pgmap v747: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 5.1 KiB/s wr, 19 op/s 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: Upgrade: Setting filesystem cephfs Joinable 2024-09-06T15:09:09.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-06T15:09:09.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-06T15:09:09.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-06T15:09:09.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi052.eqtxfx=up:active} 2 up:standby-replay 2024-09-06T15:09:09.876 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all ceph-exporter 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi052"} : dispatch 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi052"}]': finished 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi165"} : dispatch 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi165"}]': finished 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.877 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all iscsi 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all nfs 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: Upgrade: Setting container_image for all nvmeof 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.878 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: Upgrade: Finalizing container_image settings 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-06T15:09:09.879 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.880 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: Upgrade: Complete! 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:09.881 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:09.882 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:09.882 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:09.882 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:10.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-06T15:09:10.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-06T15:09:10.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: fsmap cephfs:2 {0=cephfs.smithi052.dfprfm=up:active,1=cephfs.smithi052.eqtxfx=up:active} 2 up:standby-replay 2024-09-06T15:09:10.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all ceph-exporter 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi052"} : dispatch 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi052"}]': finished 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi165"} : dispatch 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi165"}]': finished 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all iscsi 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:10.078 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all nfs 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: Upgrade: Setting container_image for all nvmeof 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.079 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: Upgrade: Finalizing container_image settings 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-06T15:09:10.080 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-06T15:09:10.081 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: Upgrade: Complete! 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-06T15:09:10.082 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:10.083 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:10.083 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:10.083 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:10.083 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:09:10.083 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:09:10.083 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:09:10.083 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:10.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:10 smithi052 ceph-mon[112917]: pgmap v748: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 5.1 KiB/s wr, 19 op/s 2024-09-06T15:09:11.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:10 smithi165 ceph-mon[82925]: pgmap v748: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 5.1 KiB/s wr, 19 op/s 2024-09-06T15:09:13.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:12 smithi165 ceph-mon[82925]: pgmap v749: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-06T15:09:13.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:12 smithi052 ceph-mon[112917]: pgmap v749: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-06T15:09:14.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:13 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:14.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:13 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:15.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:14 smithi165 ceph-mon[82925]: pgmap v750: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-06T15:09:15.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:14 smithi052 ceph-mon[112917]: pgmap v750: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-06T15:09:17.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:16 smithi165 ceph-mon[82925]: pgmap v751: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-06T15:09:17.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:16 smithi052 ceph-mon[112917]: pgmap v751: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.6 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-06T15:09:19.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:18 smithi165 ceph-mon[82925]: pgmap v752: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 3 op/s 2024-09-06T15:09:19.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:18 smithi052 ceph-mon[112917]: pgmap v752: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 3 op/s 2024-09-06T15:09:21.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:20 smithi165 ceph-mon[82925]: pgmap v753: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3 op/s 2024-09-06T15:09:21.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:20 smithi052 ceph-mon[112917]: pgmap v753: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3 op/s 2024-09-06T15:09:23.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:22 smithi165 ceph-mon[82925]: pgmap v754: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 4 op/s 2024-09-06T15:09:23.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:23.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:23.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:22 smithi052 ceph-mon[112917]: pgmap v754: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 4 op/s 2024-09-06T15:09:23.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:09:23.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:25.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:24 smithi165 ceph-mon[82925]: pgmap v755: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:25.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:24 smithi052 ceph-mon[112917]: pgmap v755: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:26 smithi052 ceph-mon[112917]: pgmap v756: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:27.224 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:26 smithi165 ceph-mon[82925]: pgmap v756: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:29.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:28 smithi052 ceph-mon[112917]: pgmap v757: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:29.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:28 smithi165 ceph-mon[82925]: pgmap v757: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:31.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:30 smithi052 ceph-mon[112917]: pgmap v758: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:31.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:30 smithi165 ceph-mon[82925]: pgmap v758: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:32.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 -- 172.21.15.52:0/1052107100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 msgr2=0x7f5028102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:32.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 --2- 172.21.15.52:0/1052107100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028102f10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5020009c20 tx=0x7f502002aa00 comp rx=0 tx=0).stop 2024-09-06T15:09:32.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 -- 172.21.15.52:0/1052107100 shutdown_connections 2024-09-06T15:09:32.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 --2- 172.21.15.52:0/1052107100 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5028103450 0x7f502810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:32.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 --2- 172.21.15.52:0/1052107100 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028102f10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 -- 172.21.15.52:0/1052107100 >> 172.21.15.52:0/1052107100 conn(0x7f50280fc550 msgr2=0x7f50280fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 -- 172.21.15.52:0/1052107100 shutdown_connections 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.619+0000 7f502ffa6640 1 -- 172.21.15.52:0/1052107100 wait complete. 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.620+0000 7f502ffa6640 1 Processor -- start 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.620+0000 7f502ffa6640 1 -- start start 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.620+0000 7f502ffa6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.620+0000 7f502ffa6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5028103450 0x7f5028100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.620+0000 7f502ffa6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f502810edc0 con 0x7f5028102b30 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.620+0000 7f502ffa6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f502810ec40 con 0x7f5028103450 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502dd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502dd42640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60692/0 (socket says 172.21.15.52:60692) 2024-09-06T15:09:32.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502dd42640 1 -- 172.21.15.52:0/4225224550 learned_addr learned my addr 172.21.15.52:0/4225224550 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:32.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502d541640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5028103450 0x7f5028100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502dd42640 1 -- 172.21.15.52:0/4225224550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5028103450 msgr2=0x7f5028100cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502dd42640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5028103450 0x7f5028100cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502dd42640 1 -- 172.21.15.52:0/4225224550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5028101210 con 0x7f5028102b30 2024-09-06T15:09:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502dd42640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028100790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f502002af20 tx=0x7f502002ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f5026ffd640 1 -- 172.21.15.52:0/4225224550 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5020047070 con 0x7f5028102b30 2024-09-06T15:09:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f5026ffd640 1 -- 172.21.15.52:0/4225224550 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5020003e30 con 0x7f5028102b30 2024-09-06T15:09:32.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50281014a0 con 0x7f5028102b30 2024-09-06T15:09:32.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f5026ffd640 1 -- 172.21.15.52:0/4225224550 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5020033050 con 0x7f5028102b30 2024-09-06T15:09:32.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.621+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50281a3d70 con 0x7f5028102b30 2024-09-06T15:09:32.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.623+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502806a500 con 0x7f5028102b30 2024-09-06T15:09:32.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.624+0000 7f5026ffd640 1 -- 172.21.15.52:0/4225224550 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f502004a070 con 0x7f5028102b30 2024-09-06T15:09:32.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.624+0000 7f5026ffd640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f50100774b0 0x7f5010079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:32.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.624+0000 7f5026ffd640 1 -- 172.21.15.52:0/4225224550 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f502003e030 con 0x7f5028102b30 2024-09-06T15:09:32.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.624+0000 7f502d541640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f50100774b0 0x7f5010079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:32.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.625+0000 7f502d541640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f50100774b0 0x7f5010079970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5028102220 tx=0x7f501c00b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:32.628 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.629+0000 7f5026ffd640 1 -- 172.21.15.52:0/4225224550 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f50200878f0 con 0x7f5028102b30 2024-09-06T15:09:32.806 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.807+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5028062630 con 0x7f50100774b0 2024-09-06T15:09:32.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.808+0000 7f5026ffd640 1 -- 172.21.15.52:0/4225224550 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f5028062630 con 0x7f50100774b0 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f50100774b0 msgr2=0x7f5010079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f50100774b0 0x7f5010079970 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5028102220 tx=0x7f501c00b390 comp rx=0 tx=0).stop 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 msgr2=0x7f5028100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028100790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f502002af20 tx=0x7f502002ee50 comp rx=0 tx=0).stop 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 shutdown_connections 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f50100774b0 0x7f5010079970 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5028103450 0x7f5028100cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 --2- 172.21.15.52:0/4225224550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5028102b30 0x7f5028100790 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 >> 172.21.15.52:0/4225224550 conn(0x7f50280fc550 msgr2=0x7f5028108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 shutdown_connections 2024-09-06T15:09:32.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:32.810+0000 7f502ffa6640 1 -- 172.21.15.52:0/4225224550 wait complete. 2024-09-06T15:09:33.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:32 smithi052 ceph-mon[112917]: pgmap v759: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:33.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:32 smithi165 ceph-mon[82925]: pgmap v759: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:33.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph orch ps' 2024-09-06T15:09:33.785 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:09:34.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:33 smithi052 ceph-mon[112917]: from='client.35224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 -- 172.21.15.52:0/1580964336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780107900 msgr2=0x7f8780107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 --2- 172.21.15.52:0/1580964336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780107900 0x7f8780107ce0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f877c009880 tx=0x7f877c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 -- 172.21.15.52:0/1580964336 shutdown_connections 2024-09-06T15:09:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 --2- 172.21.15.52:0/1580964336 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8780101900 0x7f8780101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 --2- 172.21.15.52:0/1580964336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780107900 0x7f8780107ce0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 -- 172.21.15.52:0/1580964336 >> 172.21.15.52:0/1580964336 conn(0x7f87800fd5e0 msgr2=0x7f87800ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:34.262 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 -- 172.21.15.52:0/1580964336 shutdown_connections 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.261+0000 7f87886ac640 1 -- 172.21.15.52:0/1580964336 wait complete. 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f87886ac640 1 Processor -- start 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f87886ac640 1 -- start start 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f87886ac640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780101900 0x7f87800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f87886ac640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8780107900 0x7f8780074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f87886ac640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f878010edd0 con 0x7f8780101900 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f87886ac640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f878010ec50 con 0x7f8780107900 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f8786448640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780101900 0x7f87800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f8786448640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780101900 0x7f87800744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60708/0 (socket says 172.21.15.52:60708) 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f8786448640 1 -- 172.21.15.52:0/414248559 learned_addr learned my addr 172.21.15.52:0/414248559 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.262+0000 7f8785c47640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8780107900 0x7f8780074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f8786448640 1 -- 172.21.15.52:0/414248559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8780107900 msgr2=0x7f8780074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f8786448640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8780107900 0x7f8780074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.264 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f8786448640 1 -- 172.21.15.52:0/414248559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780074f70 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f8786448640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780101900 0x7f87800744f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f877c031460 tx=0x7f877c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f87777fe640 1 -- 172.21.15.52:0/414248559 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f877c03f070 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f87777fe640 1 -- 172.21.15.52:0/414248559 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f877c0035f0 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8780075200 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f87777fe640 1 -- 172.21.15.52:0/414248559 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f877c035030 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.263+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87801a3d80 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.264+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8780103040 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.265+0000 7f87777fe640 1 -- 172.21.15.52:0/414248559 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f877c042070 con 0x7f8780101900 2024-09-06T15:09:34.265 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.265+0000 7f87777fe640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f876c077460 0x7f876c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:34.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.266+0000 7f87777fe640 1 -- 172.21.15.52:0/414248559 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f877c0ba0c0 con 0x7f8780101900 2024-09-06T15:09:34.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.266+0000 7f8785c47640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f876c077460 0x7f876c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:34.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.266+0000 7f8785c47640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f876c077460 0x7f876c079920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8780075f80 tx=0x7f877000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:34.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.270+0000 7f87777fe640 1 -- 172.21.15.52:0/414248559 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f877c087190 con 0x7f8780101900 2024-09-06T15:09:34.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:33 smithi165 ceph-mon[82925]: from='client.35224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:34.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.439+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8780062630 con 0x7f876c077460 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.457+0000 7f87777fe640 1 -- 172.21.15.52:0/414248559 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8780062630 con 0x7f876c077460 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (22m) 30s ago 32m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (43s) 30s ago 33m 7814k - 19.3.0-4704-g8b38c33c 1c45aca0610a 134a3aa52dc5 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (38s) 34s ago 32m 7197k - 19.3.0-4704-g8b38c33c 1c45aca0610a 5ee9a78f191f 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (20m) 30s ago 33m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (20m) 34s ago 32m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:09:34.457 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (21m) 30s ago 32m 80.0M - c8b91775d855 af78eb451b94 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (16m) 30s ago 27m 88.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (16m) 30s ago 27m 22.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (16m) 34s ago 27m 132M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (15m) 34s ago 27m 21.2M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (24m) 30s ago 34m 528M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (23m) 34s ago 32m 464M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (20m) 30s ago 34m 67.8M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (20m) 34s ago 31m 49.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (22m) 30s ago 32m 10.4M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (22m) 34s ago 32m 12.1M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (19m) 30s ago 30m 111M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:09:34.458 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (19m) 30s ago 30m 112M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:09:34.459 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (18m) 30s ago 30m 114M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:09:34.459 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (18m) 34s ago 29m 108M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:09:34.459 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (17m) 34s ago 29m 94.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:09:34.459 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (16m) 34s ago 28m 94.7M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:09:34.459 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (22m) 30s ago 32m 69.7M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f876c077460 msgr2=0x7f876c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f876c077460 0x7f876c079920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8780075f80 tx=0x7f877000b390 comp rx=0 tx=0).stop 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780101900 msgr2=0x7f87800744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780101900 0x7f87800744f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f877c031460 tx=0x7f877c0045e0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 shutdown_connections 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f876c077460 0x7f876c079920 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8780107900 0x7f8780074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 --2- 172.21.15.52:0/414248559 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8780101900 0x7f87800744f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 >> 172.21.15.52:0/414248559 conn(0x7f87800fd5e0 msgr2=0x7f87800fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 shutdown_connections 2024-09-06T15:09:34.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:34.459+0000 7f87886ac640 1 -- 172.21.15.52:0/414248559 wait complete. 2024-09-06T15:09:35.090 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:34 smithi052 ceph-mon[112917]: pgmap v760: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:35.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph orch upgrade status' 2024-09-06T15:09:35.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:34 smithi165 ceph-mon[82925]: pgmap v760: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:35.378 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:09:35.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 -- 172.21.15.52:0/797407394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 msgr2=0x7fd11c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:35.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 --2- 172.21.15.52:0/797407394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c100c50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd110009880 tx=0x7fd11002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:35.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 -- 172.21.15.52:0/797407394 shutdown_connections 2024-09-06T15:09:35.854 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 --2- 172.21.15.52:0/797407394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c100c50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 --2- 172.21.15.52:0/797407394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c1067f0 0x7fd11c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 -- 172.21.15.52:0/797407394 >> 172.21.15.52:0/797407394 conn(0x7fd11c0fc550 msgr2=0x7fd11c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 -- 172.21.15.52:0/797407394 shutdown_connections 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 -- 172.21.15.52:0/797407394 wait complete. 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.853+0000 7fd1231e5640 1 Processor -- start 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd1231e5640 1 -- start start 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd1231e5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd1231e5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c1067f0 0x7fd11c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd1231e5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c10dca0 con 0x7fd11c1007f0 2024-09-06T15:09:35.855 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd1231e5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c10db20 con 0x7fd11c1067f0 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd120f81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd120f81640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c1987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60724/0 (socket says 172.21.15.52:60724) 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd120f81640 1 -- 172.21.15.52:0/4154684736 learned_addr learned my addr 172.21.15.52:0/4154684736 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd11bfff640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c1067f0 0x7fd11c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd120f81640 1 -- 172.21.15.52:0/4154684736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c1067f0 msgr2=0x7fd11c198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd120f81640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c1067f0 0x7fd11c198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd120f81640 1 -- 172.21.15.52:0/4154684736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c1992f0 con 0x7fd11c1007f0 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd120f81640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c1987b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00d8d0 tx=0x7fd10c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:35.856 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.854+0000 7fd119ffb640 1 -- 172.21.15.52:0/4154684736 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd10c017030 con 0x7fd11c1007f0 2024-09-06T15:09:35.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.855+0000 7fd119ffb640 1 -- 172.21.15.52:0/4154684736 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd10c004020 con 0x7fd11c1007f0 2024-09-06T15:09:35.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.855+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c1995e0 con 0x7fd11c1007f0 2024-09-06T15:09:35.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.855+0000 7fd119ffb640 1 -- 172.21.15.52:0/4154684736 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd10c0047a0 con 0x7fd11c1007f0 2024-09-06T15:09:35.857 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.855+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c1a1be0 con 0x7fd11c1007f0 2024-09-06T15:09:35.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.856+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11c101f30 con 0x7fd11c1007f0 2024-09-06T15:09:35.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.856+0000 7fd119ffb640 1 -- 172.21.15.52:0/4154684736 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd10c009a30 con 0x7fd11c1007f0 2024-09-06T15:09:35.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.857+0000 7fd119ffb640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd104077460 0x7fd104079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:35.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.857+0000 7fd119ffb640 1 -- 172.21.15.52:0/4154684736 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd10c018070 con 0x7fd11c1007f0 2024-09-06T15:09:35.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.857+0000 7fd11bfff640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd104077460 0x7fd104079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:35.858 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.857+0000 7fd11bfff640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd104077460 0x7fd104079920 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1100096c0 tx=0x7fd110000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:35.860 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:35.861+0000 7fd119ffb640 1 -- 172.21.15.52:0/4154684736 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd11c1995e0 con 0x7fd11c1007f0 2024-09-06T15:09:36.036 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.037+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd11c0fd460 con 0x7fd104077460 2024-09-06T15:09:36.037 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:35 smithi052 ceph-mon[112917]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:36.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.038+0000 7fd119ffb640 1 -- 172.21.15.52:0/4154684736 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fd11c0fd460 con 0x7fd104077460 2024-09-06T15:09:36.037 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout: "target_image": null, 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout: "in_progress": false, 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout: "which": "", 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout: "services_complete": [], 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout: "progress": null, 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout: "message": "", 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout: "is_paused": false 2024-09-06T15:09:36.038 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd104077460 msgr2=0x7fd104079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd104077460 0x7fd104079920 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1100096c0 tx=0x7fd110000bc0 comp rx=0 tx=0).stop 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 msgr2=0x7fd11c1987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c1987b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd10c00d8d0 tx=0x7fd10c00dd90 comp rx=0 tx=0).stop 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 shutdown_connections 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd104077460 0x7fd104079920 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c1067f0 0x7fd11c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:36.040 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 --2- 172.21.15.52:0/4154684736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd11c1007f0 0x7fd11c1987b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:36.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 >> 172.21.15.52:0/4154684736 conn(0x7fd11c0fc550 msgr2=0x7fd11c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:36.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 shutdown_connections 2024-09-06T15:09:36.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:36.040+0000 7fd1231e5640 1 -- 172.21.15.52:0/4154684736 wait complete. 2024-09-06T15:09:36.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:35 smithi165 ceph-mon[82925]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:36.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph health detail' 2024-09-06T15:09:36.966 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:09:37.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:36 smithi052 ceph-mon[112917]: pgmap v761: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:37.086 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:36 smithi052 ceph-mon[112917]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:37.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:36 smithi165 ceph-mon[82925]: pgmap v761: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:37.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:36 smithi165 ceph-mon[82925]: from='client.35232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:09:37.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 -- 172.21.15.52:0/2058282172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970107900 msgr2=0x7f3970107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:37.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 --2- 172.21.15.52:0/2058282172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970107900 0x7f3970107ce0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3960009880 tx=0x7f396002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:37.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 -- 172.21.15.52:0/2058282172 shutdown_connections 2024-09-06T15:09:37.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 --2- 172.21.15.52:0/2058282172 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3970101900 0x7f3970101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:37.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 --2- 172.21.15.52:0/2058282172 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970107900 0x7f3970107ce0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:37.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 -- 172.21.15.52:0/2058282172 >> 172.21.15.52:0/2058282172 conn(0x7f39700fd600 msgr2=0x7f39700ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:37.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 -- 172.21.15.52:0/2058282172 shutdown_connections 2024-09-06T15:09:37.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.475+0000 7f3975a50640 1 -- 172.21.15.52:0/2058282172 wait complete. 2024-09-06T15:09:37.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f3975a50640 1 Processor -- start 2024-09-06T15:09:37.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f3975a50640 1 -- start start 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f3975a50640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970101900 0x7f397019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f3975a50640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3970107900 0x7f397019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f3975a50640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f397010edd0 con 0x7f3970101900 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f3975a50640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f397010ec50 con 0x7f3970107900 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970101900 0x7f397019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970101900 0x7f397019f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60744/0 (socket says 172.21.15.52:60744) 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396effd640 1 -- 172.21.15.52:0/924908881 learned_addr learned my addr 172.21.15.52:0/924908881 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396e7fc640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3970107900 0x7f397019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396effd640 1 -- 172.21.15.52:0/924908881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3970107900 msgr2=0x7f397019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:37.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396effd640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3970107900 0x7f397019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396effd640 1 -- 172.21.15.52:0/924908881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39701999d0 con 0x7f3970101900 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.476+0000 7f396e7fc640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3970107900 0x7f397019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.477+0000 7f396effd640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970101900 0x7f397019f810 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3960031460 tx=0x7f3960004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.477+0000 7f3974a4e640 1 -- 172.21.15.52:0/924908881 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f396003f070 con 0x7f3970101900 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.477+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3970199c60 con 0x7f3970101900 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.477+0000 7f3974a4e640 1 -- 172.21.15.52:0/924908881 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3960004a90 con 0x7f3970101900 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.477+0000 7f3974a4e640 1 -- 172.21.15.52:0/924908881 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3960035030 con 0x7f3970101900 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.477+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397019a190 con 0x7f3970101900 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.478+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3970103040 con 0x7f3970101900 2024-09-06T15:09:37.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.479+0000 7f3974a4e640 1 -- 172.21.15.52:0/924908881 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f3960042070 con 0x7f3970101900 2024-09-06T15:09:37.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.479+0000 7f3974a4e640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3958077460 0x7f3958079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:37.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.479+0000 7f3974a4e640 1 -- 172.21.15.52:0/924908881 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f39600ba2b0 con 0x7f3970101900 2024-09-06T15:09:37.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.479+0000 7f396e7fc640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3958077460 0x7f3958079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:37.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.480+0000 7f396e7fc640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3958077460 0x7f3958079920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f39700757e0 tx=0x7f3964005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:37.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.483+0000 7f3974a4e640 1 -- 172.21.15.52:0/924908881 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3960083210 con 0x7f3970101900 2024-09-06T15:09:37.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.711+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f397019af30 con 0x7f3970101900 2024-09-06T15:09:37.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.712+0000 7f3974a4e640 1 -- 172.21.15.52:0/924908881 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+981 (secure 0 0 0) 0x7f3960087380 con 0x7f3970101900 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout:[WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:09:37.713 INFO:teuthology.orchestra.run.smithi052.stdout: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:09:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3958077460 msgr2=0x7f3958079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3958077460 0x7f3958079920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f39700757e0 tx=0x7f3964005f90 comp rx=0 tx=0).stop 2024-09-06T15:09:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970101900 msgr2=0x7f397019f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970101900 0x7f397019f810 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3960031460 tx=0x7f3960004530 comp rx=0 tx=0).stop 2024-09-06T15:09:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 shutdown_connections 2024-09-06T15:09:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f3958077460 0x7f3958079920 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:37.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3970107900 0x7f397019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 --2- 172.21.15.52:0/924908881 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3970101900 0x7f397019f810 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 >> 172.21.15.52:0/924908881 conn(0x7f39700fd600 msgr2=0x7f3970074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 shutdown_connections 2024-09-06T15:09:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:37.714+0000 7f3975a50640 1 -- 172.21.15.52:0/924908881 wait complete. 2024-09-06T15:09:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:37 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/924908881' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:09:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:37 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/924908881' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-06T15:09:38.499 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph versions' 2024-09-06T15:09:38.760 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:09:39.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:38 smithi052 ceph-mon[112917]: pgmap v762: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 -- 172.21.15.52:0/2497116066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 msgr2=0x7f40f0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 --2- 172.21.15.52:0/2497116066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f0100c50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009880 tx=0x7f40ec02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 -- 172.21.15.52:0/2497116066 shutdown_connections 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 --2- 172.21.15.52:0/2497116066 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f0100c50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 --2- 172.21.15.52:0/2497116066 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40f01067f0 0x7f40f0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 -- 172.21.15.52:0/2497116066 >> 172.21.15.52:0/2497116066 conn(0x7f40f00fc550 msgr2=0x7f40f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 -- 172.21.15.52:0/2497116066 shutdown_connections 2024-09-06T15:09:39.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 -- 172.21.15.52:0/2497116066 wait complete. 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 Processor -- start 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.206+0000 7f40f871c640 1 -- start start 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f871c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f871c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40f01067f0 0x7f40f019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f871c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40f010dca0 con 0x7f40f01007f0 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f871c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40f010db20 con 0x7f40f01067f0 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f64b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f64b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:60766/0 (socket says 172.21.15.52:60766) 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f64b8640 1 -- 172.21.15.52:0/2259733995 learned_addr learned my addr 172.21.15.52:0/2259733995 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f64b8640 1 -- 172.21.15.52:0/2259733995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40f01067f0 msgr2=0x7f40f019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f64b8640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40f01067f0 0x7f40f019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f64b8640 1 -- 172.21.15.52:0/2259733995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f0199990 con 0x7f40f01007f0 2024-09-06T15:09:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f64b8640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f019f7d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f40e400c810 tx=0x7f40e400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40e37fe640 1 -- 172.21.15.52:0/2259733995 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40e4004020 con 0x7f40f01007f0 2024-09-06T15:09:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40e37fe640 1 -- 172.21.15.52:0/2259733995 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40e40041c0 con 0x7f40f01007f0 2024-09-06T15:09:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f0199c80 con 0x7f40f01007f0 2024-09-06T15:09:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.207+0000 7f40e37fe640 1 -- 172.21.15.52:0/2259733995 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40e40047a0 con 0x7f40f01007f0 2024-09-06T15:09:39.210 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.208+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f019a210 con 0x7f40f01007f0 2024-09-06T15:09:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.208+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f0101f30 con 0x7f40f01007f0 2024-09-06T15:09:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.209+0000 7f40e37fe640 1 -- 172.21.15.52:0/2259733995 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f40e40079b0 con 0x7f40f01007f0 2024-09-06T15:09:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.210+0000 7f40e37fe640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f40dc0774b0 0x7f40dc079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:09:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.210+0000 7f40e37fe640 1 -- 172.21.15.52:0/2259733995 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f40e4099600 con 0x7f40f01007f0 2024-09-06T15:09:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.210+0000 7f40f5cb7640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f40dc0774b0 0x7f40dc079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:09:39.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.210+0000 7f40f5cb7640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f40dc0774b0 0x7f40dc079970 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0096c0 tx=0x7f40ec000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:09:39.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.214+0000 7f40e37fe640 1 -- 172.21.15.52:0/2259733995 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f40e4014030 con 0x7f40f01007f0 2024-09-06T15:09:39.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:38 smithi165 ceph-mon[82925]: pgmap v762: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:39.433 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.433+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f40f019a520 con 0x7f40f01007f0 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.433+0000 7f40e37fe640 1 -- 172.21.15.52:0/2259733995 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f40e40625e0 con 0x7f40f01007f0 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:09:39.434 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:09:39.435 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:09:39.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.435+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f40dc0774b0 msgr2=0x7f40dc079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:39.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.435+0000 7f40f871c640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f40dc0774b0 0x7f40dc079970 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0096c0 tx=0x7f40ec000bc0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.435+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 msgr2=0x7f40f019f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:09:39.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.435+0000 7f40f871c640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f019f7d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f40e400c810 tx=0x7f40e400ccd0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.435+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 shutdown_connections 2024-09-06T15:09:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.436+0000 7f40f871c640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f40dc0774b0 0x7f40dc079970 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.436+0000 7f40f871c640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40f01067f0 0x7f40f019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.436+0000 7f40f871c640 1 --2- 172.21.15.52:0/2259733995 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40f01007f0 0x7f40f019f7d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:09:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.436+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 >> 172.21.15.52:0/2259733995 conn(0x7f40f00fc550 msgr2=0x7f40f0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:09:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.436+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 shutdown_connections 2024-09-06T15:09:39.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:09:39.436+0000 7f40f871c640 1 -- 172.21.15.52:0/2259733995 wait complete. 2024-09-06T15:09:40.067 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:39 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2259733995' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:40.069 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-06T15:09:40.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:39 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2259733995' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:09:40.332 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:09:40.817 INFO:teuthology.orchestra.run.smithi052.stdout:wait for servicemap items w/ changing names to refresh 2024-09-06T15:09:41.056 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:40 smithi052 ceph-mon[112917]: pgmap v763: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:41.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:40 smithi165 ceph-mon[82925]: pgmap v763: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:41.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'sleep 60' 2024-09-06T15:09:41.626 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:09:43.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:42 smithi052 ceph-mon[112917]: pgmap v764: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:43.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:42 smithi165 ceph-mon[82925]: pgmap v764: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:44 smithi052 ceph-mon[112917]: pgmap v765: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:45.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:44 smithi165 ceph-mon[82925]: pgmap v765: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:46 smithi052 ceph-mon[112917]: pgmap v766: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:46 smithi165 ceph-mon[82925]: pgmap v766: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:49.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:48 smithi052 ceph-mon[112917]: pgmap v767: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:48 smithi165 ceph-mon[82925]: pgmap v767: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:51.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:50 smithi052 ceph-mon[112917]: pgmap v768: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:51.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:50 smithi165 ceph-mon[82925]: pgmap v768: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:52 smithi165 ceph-mon[82925]: pgmap v769: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:53.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:52 smithi052 ceph-mon[112917]: pgmap v769: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:53.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:09:55.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:54 smithi052 ceph-mon[112917]: pgmap v770: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:55.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:54 smithi165 ceph-mon[82925]: pgmap v770: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:57.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:56 smithi165 ceph-mon[82925]: pgmap v771: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:57.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:56 smithi052 ceph-mon[112917]: pgmap v771: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:09:59.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:09:58 smithi165 ceph-mon[82925]: pgmap v772: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:09:59.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:09:58 smithi052 ceph-mon[112917]: pgmap v772: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: pgmap v773: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: [WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:10:01.144 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:00 smithi165 ceph-mon[82925]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: pgmap v773: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data; Module 'volumes' has failed dependency: No module named 'ceph.fs'; 4 mgr modules have recently crashed 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: fs cephfs has deprecated feature inline_data enabled. 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: [WRN] MGR_MODULE_DEPENDENCY: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: Module 'volumes' has failed dependency: No module named 'ceph.fs' 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: [WRN] RECENT_MGR_MODULE_CRASH: 4 mgr modules have recently crashed 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi052.vsthpq on host smithi052 at 2024-09-06T14:45:26.905583Z 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:43:54.374021Z 2024-09-06T15:10:01.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:45:53.001307Z 2024-09-06T15:10:01.222 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:00 smithi052 ceph-mon[112917]: mgr module volumes crashed in daemon mgr.smithi165.hcexoi on host smithi165 at 2024-09-06T14:46:31.194423Z 2024-09-06T15:10:03.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:02 smithi165 ceph-mon[82925]: pgmap v774: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:03.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:02 smithi052 ceph-mon[112917]: pgmap v774: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:05.297 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:04 smithi052 ceph-mon[112917]: pgmap v775: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:05.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:04 smithi165 ceph-mon[82925]: pgmap v775: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:07.212 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:06 smithi052 ceph-mon[112917]: pgmap v776: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:06 smithi165 ceph-mon[82925]: pgmap v776: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:08.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:09.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:08 smithi165 ceph-mon[82925]: pgmap v777: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:09.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:08 smithi052 ceph-mon[112917]: pgmap v777: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:10.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:10.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:10.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:10.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:09 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:10:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:10:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:10:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:10:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:09 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:10:11.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:10 smithi165 ceph-mon[82925]: pgmap v778: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:11.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:10 smithi052 ceph-mon[112917]: pgmap v778: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:13.223 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:12 smithi052 ceph-mon[112917]: pgmap v779: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:13.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:12 smithi165 ceph-mon[82925]: pgmap v779: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:15.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:14 smithi165 ceph-mon[82925]: pgmap v780: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:15.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:14 smithi052 ceph-mon[112917]: pgmap v780: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:17.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:16 smithi165 ceph-mon[82925]: pgmap v781: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:17.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:16 smithi052 ceph-mon[112917]: pgmap v781: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:19.215 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:18 smithi052 ceph-mon[112917]: pgmap v782: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:19.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:18 smithi165 ceph-mon[82925]: pgmap v782: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:21.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:20 smithi165 ceph-mon[82925]: pgmap v783: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:21.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:20 smithi052 ceph-mon[112917]: pgmap v783: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:23.229 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:22 smithi165 ceph-mon[82925]: pgmap v784: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:23.229 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:23.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:22 smithi052 ceph-mon[112917]: pgmap v784: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:23.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:25.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:24 smithi052 ceph-mon[112917]: pgmap v785: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:25.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:24 smithi165 ceph-mon[82925]: pgmap v785: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:27.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:26 smithi165 ceph-mon[82925]: pgmap v786: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:27.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:26 smithi052 ceph-mon[112917]: pgmap v786: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:29.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:28 smithi165 ceph-mon[82925]: pgmap v787: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:29.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:28 smithi052 ceph-mon[112917]: pgmap v787: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:31.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:30 smithi052 ceph-mon[112917]: pgmap v788: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:31.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:30 smithi165 ceph-mon[82925]: pgmap v788: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:33.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:32 smithi165 ceph-mon[82925]: pgmap v789: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:33.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:32 smithi052 ceph-mon[112917]: pgmap v789: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:35.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:34 smithi165 ceph-mon[82925]: pgmap v790: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:35.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:34 smithi052 ceph-mon[112917]: pgmap v790: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:37.211 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:36 smithi052 ceph-mon[112917]: pgmap v791: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:37.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:36 smithi165 ceph-mon[82925]: pgmap v791: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:39.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:38 smithi052 ceph-mon[112917]: pgmap v792: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:39.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:38 smithi165 ceph-mon[82925]: pgmap v792: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:41.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:40 smithi165 ceph-mon[82925]: pgmap v793: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:40 smithi052 ceph-mon[112917]: pgmap v793: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:42.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph orch ps' 2024-09-06T15:10:42.907 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:43.221 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:42 smithi052 ceph-mon[112917]: pgmap v794: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:43.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:42 smithi165 ceph-mon[82925]: pgmap v794: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:43.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 -- 172.21.15.52:0/4003689153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 msgr2=0x7fadd010dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:43.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 --2- 172.21.15.52:0/4003689153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd010dd30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009880 tx=0x7fadc002a490 comp rx=0 tx=0).stop 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 -- 172.21.15.52:0/4003689153 shutdown_connections 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 --2- 172.21.15.52:0/4003689153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd010dd30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 --2- 172.21.15.52:0/4003689153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadd01006c0 0x7fadd0100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 -- 172.21.15.52:0/4003689153 >> 172.21.15.52:0/4003689153 conn(0x7fadd00fc550 msgr2=0x7fadd00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 -- 172.21.15.52:0/4003689153 shutdown_connections 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.425+0000 7fadd8170640 1 -- 172.21.15.52:0/4003689153 wait complete. 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd8170640 1 Processor -- start 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd8170640 1 -- start start 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd8170640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadd01006c0 0x7fadd019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd8170640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd8170640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadd0110f80 con 0x7fadd0101070 2024-09-06T15:10:43.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd8170640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fadd0110e00 con 0x7fadd01006c0 2024-09-06T15:10:43.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd570b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:43.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd570b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51152/0 (socket says 172.21.15.52:51152) 2024-09-06T15:10:43.427 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd570b640 1 -- 172.21.15.52:0/808489166 learned_addr learned my addr 172.21.15.52:0/808489166 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd5f0c640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadd01006c0 0x7fadd019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd570b640 1 -- 172.21.15.52:0/808489166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadd01006c0 msgr2=0x7fadd019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd570b640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadd01006c0 0x7fadd019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd570b640 1 -- 172.21.15.52:0/808489166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd01999d0 con 0x7fadd0101070 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd5f0c640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadd01006c0 0x7fadd019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.426+0000 7fadd570b640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd019fd50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fadc0031460 tx=0x7fadc00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.427+0000 7fadc6ffd640 1 -- 172.21.15.52:0/808489166 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc003f070 con 0x7fadd0101070 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.427+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd0199c60 con 0x7fadd0101070 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.427+0000 7fadc6ffd640 1 -- 172.21.15.52:0/808489166 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fadc00035f0 con 0x7fadd0101070 2024-09-06T15:10:43.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.427+0000 7fadc6ffd640 1 -- 172.21.15.52:0/808489166 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadc0035030 con 0x7fadd0101070 2024-09-06T15:10:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.427+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd019a1f0 con 0x7fadd0101070 2024-09-06T15:10:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.428+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd006a500 con 0x7fadd0101070 2024-09-06T15:10:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.428+0000 7fadc6ffd640 1 -- 172.21.15.52:0/808489166 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fadc0042070 con 0x7fadd0101070 2024-09-06T15:10:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.429+0000 7fadc6ffd640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fadbc077460 0x7fadbc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.429+0000 7fadc6ffd640 1 -- 172.21.15.52:0/808489166 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fadc00ba170 con 0x7fadd0101070 2024-09-06T15:10:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.429+0000 7fadd5f0c640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fadbc077460 0x7fadbc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:43.430 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.429+0000 7fadd5f0c640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fadbc077460 0x7fadbc079920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fadd019ab10 tx=0x7fadcc005e70 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:43.432 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.433+0000 7fadc6ffd640 1 -- 172.21.15.52:0/808489166 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fadc00830d0 con 0x7fadd0101070 2024-09-06T15:10:43.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.602+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 --> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fadd010b480 con 0x7fadbc077460 2024-09-06T15:10:43.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.611+0000 7fadc6ffd640 1 -- 172.21.15.52:0/808489166 <== mgr.14764 v2:172.21.15.52:6800/1957033453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fadcc009300 con 0x7fadbc077460 2024-09-06T15:10:43.611 INFO:teuthology.orchestra.run.smithi052.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-06T15:10:43.611 INFO:teuthology.orchestra.run.smithi052.stdout:alertmanager.smithi052 smithi052 *:9093,9094 running (23m) 99s ago 33m 20.1M - 0.27.0 11f11916f8cd 9a89985a3e14 2024-09-06T15:10:43.611 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi052 smithi052 running (112s) 99s ago 34m 7814k - 19.3.0-4704-g8b38c33c 1c45aca0610a 134a3aa52dc5 2024-09-06T15:10:43.611 INFO:teuthology.orchestra.run.smithi052.stdout:ceph-exporter.smithi165 smithi165 running (107s) 103s ago 33m 7197k - 19.3.0-4704-g8b38c33c 1c45aca0610a 5ee9a78f191f 2024-09-06T15:10:43.611 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi052 smithi052 running (21m) 99s ago 34m 6971k - 19.3.0-4704-g8b38c33c 1c45aca0610a 311f5daef1dd 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:crash.smithi165 smithi165 running (21m) 103s ago 33m 7000k - 19.3.0-4704-g8b38c33c 1c45aca0610a 9de73ff22437 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:grafana.smithi052 smithi052 *:3000 running (22m) 99s ago 33m 80.0M - c8b91775d855 af78eb451b94 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.dfprfm smithi052 running (17m) 99s ago 28m 88.0M - 19.3.0-4704-g8b38c33c 1c45aca0610a 10ab77be6ea5 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi052.eqtxfx smithi052 running (17m) 99s ago 28m 22.8M - 19.3.0-4704-g8b38c33c 1c45aca0610a 080444203d57 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.nmjcsh smithi165 running (17m) 103s ago 28m 132M - 19.3.0-4704-g8b38c33c 1c45aca0610a e41410564a5a 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mds.cephfs.smithi165.zpunux smithi165 running (17m) 103s ago 28m 21.2M - 19.3.0-4704-g8b38c33c 1c45aca0610a 8272d326c6a4 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi052.vsthpq smithi052 *:8443,9283,8765 running (25m) 99s ago 35m 528M - 19.3.0-4704-g8b38c33c 1c45aca0610a 5e6adc689624 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mgr.smithi165.hcexoi smithi165 *:8443,9283,8765 running (24m) 103s ago 33m 464M - 19.3.0-4704-g8b38c33c 1c45aca0610a 762fb1570d54 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi052 smithi052 running (21m) 99s ago 35m 67.8M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a 2a986cec59f7 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:mon.smithi165 smithi165 running (21m) 103s ago 33m 49.5M 2048M 19.3.0-4704-g8b38c33c 1c45aca0610a d1730548ae8d 2024-09-06T15:10:43.612 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi052 smithi052 *:9100 running (24m) 99s ago 34m 10.4M - 1.7.0 72c9c2088986 c70e1e3fc84a 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:node-exporter.smithi165 smithi165 *:9100 running (23m) 103s ago 33m 12.1M - 1.7.0 72c9c2088986 89fd112df9a9 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 smithi052 running (20m) 99s ago 32m 111M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a a2f3778f51c7 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 smithi052 running (20m) 99s ago 31m 112M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a 05161933d9e1 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 smithi052 running (19m) 99s ago 31m 114M 1217M 19.3.0-4704-g8b38c33c 1c45aca0610a b669d4c32bf6 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:osd.3 smithi165 running (19m) 103s ago 30m 108M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a cc36f08fa3ae 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:osd.4 smithi165 running (18m) 103s ago 30m 94.2M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 81f6b343a244 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:osd.5 smithi165 running (18m) 103s ago 29m 94.7M 2240M 19.3.0-4704-g8b38c33c 1c45aca0610a 04da38e02cd8 2024-09-06T15:10:43.613 INFO:teuthology.orchestra.run.smithi052.stdout:prometheus.smithi052 smithi052 *:9095 running (23m) 99s ago 33m 69.7M - 2.51.0 1d3b7f56885b ef2e66858cdd 2024-09-06T15:10:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.613+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fadbc077460 msgr2=0x7fadbc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.613+0000 7fadd8170640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fadbc077460 0x7fadbc079920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fadd019ab10 tx=0x7fadcc005e70 comp rx=0 tx=0).stop 2024-09-06T15:10:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.613+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 msgr2=0x7fadd019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.613+0000 7fadd8170640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd019fd50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fadc0031460 tx=0x7fadc00045e0 comp rx=0 tx=0).stop 2024-09-06T15:10:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.614+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 shutdown_connections 2024-09-06T15:10:43.614 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.614+0000 7fadd8170640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadd0101070 0x7fadd019fd50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.614+0000 7fadd8170640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fadbc077460 0x7fadbc079920 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.614+0000 7fadd8170640 1 --2- 172.21.15.52:0/808489166 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fadd01006c0 0x7fadd019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.614+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 >> 172.21.15.52:0/808489166 conn(0x7fadd00fc550 msgr2=0x7fadd00fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.614+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 shutdown_connections 2024-09-06T15:10:43.615 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:43.614+0000 7fadd8170640 1 -- 172.21.15.52:0/808489166 wait complete. 2024-09-06T15:10:44.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph versions' 2024-09-06T15:10:44.490 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:45.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/91896643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48107900 msgr2=0x7f4d48107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/91896643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48107900 0x7f4d48107ce0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009880 tx=0x7f4d3c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/91896643 shutdown_connections 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/91896643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d48101900 0x7f4d48101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/91896643 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48107900 0x7f4d48107ce0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/91896643 >> 172.21.15.52:0/91896643 conn(0x7f4d480fd620 msgr2=0x7f4d480ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/91896643 shutdown_connections 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.106+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/91896643 wait complete. 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4ee8e640 1 Processor -- start 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4ee8e640 1 -- start start 2024-09-06T15:10:45.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4ee8e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48101900 0x7f4d480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4ee8e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d48107900 0x7f4d48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4ee8e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4810ee30 con 0x7f4d48101900 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4ee8e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4810ecb0 con 0x7f4d48107900 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4cc2a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48101900 0x7f4d480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4cc2a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48101900 0x7f4d480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51170/0 (socket says 172.21.15.52:51170) 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4cc2a640 1 -- 172.21.15.52:0/4218049665 learned_addr learned my addr 172.21.15.52:0/4218049665 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d47fff640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d48107900 0x7f4d48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4cc2a640 1 -- 172.21.15.52:0/4218049665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d48107900 msgr2=0x7f4d48074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4cc2a640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d48107900 0x7f4d48074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.107+0000 7f4d4cc2a640 1 -- 172.21.15.52:0/4218049665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d48074f70 con 0x7f4d48101900 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.108+0000 7f4d4cc2a640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48101900 0x7f4d480744f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c031460 tx=0x7f4d3c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.108+0000 7f4d45ffb640 1 -- 172.21.15.52:0/4218049665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d3c03f070 con 0x7f4d48101900 2024-09-06T15:10:45.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.108+0000 7f4d45ffb640 1 -- 172.21.15.52:0/4218049665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d3c004cf0 con 0x7f4d48101900 2024-09-06T15:10:45.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.108+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d48075200 con 0x7f4d48101900 2024-09-06T15:10:45.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.108+0000 7f4d45ffb640 1 -- 172.21.15.52:0/4218049665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d3c035030 con 0x7f4d48101900 2024-09-06T15:10:45.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.108+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d481a3d90 con 0x7f4d48101900 2024-09-06T15:10:45.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.109+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d48103040 con 0x7f4d48101900 2024-09-06T15:10:45.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.110+0000 7f4d45ffb640 1 -- 172.21.15.52:0/4218049665 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4d3c042070 con 0x7f4d48101900 2024-09-06T15:10:45.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.110+0000 7f4d45ffb640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d380774b0 0x7f4d38079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:45.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.110+0000 7f4d45ffb640 1 -- 172.21.15.52:0/4218049665 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4d3c0ba260 con 0x7f4d48101900 2024-09-06T15:10:45.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.110+0000 7f4d47fff640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d380774b0 0x7f4d38079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:45.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.111+0000 7f4d47fff640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d380774b0 0x7f4d38079970 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4d48075f80 tx=0x7f4d34008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:45.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.114+0000 7f4d45ffb640 1 -- 172.21.15.52:0/4218049665 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4d3c083240 con 0x7f4d48101900 2024-09-06T15:10:45.114 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:44 smithi052 ceph-mon[112917]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:45.114 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:44 smithi052 ceph-mon[112917]: pgmap v795: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:45.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:44 smithi165 ceph-mon[82925]: from='client.35244 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-06T15:10:45.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:44 smithi165 ceph-mon[82925]: pgmap v795: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:45.333 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.334+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4d48075a20 con 0x7f4d48101900 2024-09-06T15:10:45.334 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.335+0000 7f4d45ffb640 1 -- 172.21.15.52:0/4218049665 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4d3c0873b0 con 0x7f4d48101900 2024-09-06T15:10:45.334 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-06T15:10:45.334 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": { 2024-09-06T15:10:45.334 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:10:45.334 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:10:45.334 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": { 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 2 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": { 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 6 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 4 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: "overall": { 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)": 14 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-06T15:10:45.335 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d380774b0 msgr2=0x7f4d38079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d380774b0 0x7f4d38079970 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4d48075f80 tx=0x7f4d34008040 comp rx=0 tx=0).stop 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48101900 msgr2=0x7f4d480744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48101900 0x7f4d480744f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c031460 tx=0x7f4d3c0048f0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 shutdown_connections 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4d380774b0 0x7f4d38079970 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4d48107900 0x7f4d48074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.337 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 --2- 172.21.15.52:0/4218049665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4d48101900 0x7f4d480744f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:45.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 >> 172.21.15.52:0/4218049665 conn(0x7f4d480fd620 msgr2=0x7f4d480fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:45.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 shutdown_connections 2024-09-06T15:10:45.338 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:45.337+0000 7f4d4ee8e640 1 -- 172.21.15.52:0/4218049665 wait complete. 2024-09-06T15:10:45.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-06T15:10:46.204 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:46.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:45 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4218049665' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:10:46.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:45 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4218049665' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:10:46.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 -- 172.21.15.52:0/3148272979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 msgr2=0x7f5aec101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:46.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 --2- 172.21.15.52:0/3148272979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec101d60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009880 tx=0x7f5ae002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:46.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 -- 172.21.15.52:0/3148272979 shutdown_connections 2024-09-06T15:10:46.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 --2- 172.21.15.52:0/3148272979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec101d60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:46.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 --2- 172.21.15.52:0/3148272979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aec107900 0x7f5aec107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:46.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 -- 172.21.15.52:0/3148272979 >> 172.21.15.52:0/3148272979 conn(0x7f5aec0fd600 msgr2=0x7f5aec0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 -- 172.21.15.52:0/3148272979 shutdown_connections 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.813+0000 7f5af1d51640 1 -- 172.21.15.52:0/3148272979 wait complete. 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5af1d51640 1 Processor -- start 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5af1d51640 1 -- start start 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5af1d51640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5af1d51640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aec107900 0x7f5aec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5af1d51640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec10edd0 con 0x7f5aec101900 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5af1d51640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec10ec50 con 0x7f5aec107900 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5aeb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5aeb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51192/0 (socket says 172.21.15.52:51192) 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.814+0000 7f5aeb7fe640 1 -- 172.21.15.52:0/1262609171 learned_addr learned my addr 172.21.15.52:0/1262609171 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:46.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5aeaffd640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aec107900 0x7f5aec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5aeb7fe640 1 -- 172.21.15.52:0/1262609171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aec107900 msgr2=0x7f5aec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5aeb7fe640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aec107900 0x7f5aec074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5aeb7fe640 1 -- 172.21.15.52:0/1262609171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec074f70 con 0x7f5aec101900 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5aeb7fe640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec0744f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00d6f0 tx=0x7f5adc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5ae8ff9640 1 -- 172.21.15.52:0/1262609171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5adc017070 con 0x7f5aec101900 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec075260 con 0x7f5aec101900 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5ae8ff9640 1 -- 172.21.15.52:0/1262609171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5adc00de00 con 0x7f5aec101900 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5ae8ff9640 1 -- 172.21.15.52:0/1262609171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5adc004bb0 con 0x7f5aec101900 2024-09-06T15:10:46.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.815+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec1a3e80 con 0x7f5aec101900 2024-09-06T15:10:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.816+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aec103040 con 0x7f5aec101900 2024-09-06T15:10:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.817+0000 7f5ae8ff9640 1 -- 172.21.15.52:0/1262609171 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f5adc004e60 con 0x7f5aec101900 2024-09-06T15:10:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.817+0000 7f5ae8ff9640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5ad4077460 0x7f5ad4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.817+0000 7f5ae8ff9640 1 -- 172.21.15.52:0/1262609171 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f5adc099440 con 0x7f5aec101900 2024-09-06T15:10:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.817+0000 7f5aeaffd640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5ad4077460 0x7f5ad4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:46.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.818+0000 7f5aeaffd640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5ad4077460 0x7f5ad4079920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0031460 tx=0x7f5ae0009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:46.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:46.821+0000 7f5ae8ff9640 1 -- 172.21.15.52:0/1262609171 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f5adc0623a0 con 0x7f5aec101900 2024-09-06T15:10:47.042 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.042+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5aec109e70 con 0x7f5aec101900 2024-09-06T15:10:47.044 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:46 smithi052 ceph-mon[112917]: pgmap v796: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:47.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.042+0000 7f5ae8ff9640 1 -- 172.21.15.52:0/1262609171 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f5adc066510 con 0x7f5aec101900 2024-09-06T15:10:47.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5ad4077460 msgr2=0x7f5ad4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:47.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5ad4077460 0x7f5ad4079920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0031460 tx=0x7f5ae0009560 comp rx=0 tx=0).stop 2024-09-06T15:10:47.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 msgr2=0x7f5aec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:47.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec0744f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00d6f0 tx=0x7f5adc00dbb0 comp rx=0 tx=0).stop 2024-09-06T15:10:47.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 shutdown_connections 2024-09-06T15:10:47.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f5ad4077460 0x7f5ad4079920 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5aec107900 0x7f5aec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 --2- 172.21.15.52:0/1262609171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5aec101900 0x7f5aec0744f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.044+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 >> 172.21.15.52:0/1262609171 conn(0x7f5aec0fd600 msgr2=0x7f5aec0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.045+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 shutdown_connections 2024-09-06T15:10:47.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:47.045+0000 7f5af1d51640 1 -- 172.21.15.52:0/1262609171 wait complete. 2024-09-06T15:10:47.054 INFO:teuthology.orchestra.run.smithi052.stdout:true 2024-09-06T15:10:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:46 smithi165 ceph-mon[82925]: pgmap v796: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:47.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -e sha1=8b38c33cecf4b0b7a9b3116eb9089e21e444ac73 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-06T15:10:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:48.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:47 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1262609171' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:10:48.339 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:47 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1262609171' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:10:48.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 -- 172.21.15.52:0/2477396484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8107900 msgr2=0x7f4bc8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:48.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/2477396484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8107900 0x7f4bc8107ce0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009880 tx=0x7f4bbc02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 -- 172.21.15.52:0/2477396484 shutdown_connections 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/2477396484 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc8101900 0x7f4bc8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/2477396484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8107900 0x7f4bc8107ce0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 -- 172.21.15.52:0/2477396484 >> 172.21.15.52:0/2477396484 conn(0x7f4bc80fd600 msgr2=0x7f4bc80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 -- 172.21.15.52:0/2477396484 shutdown_connections 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.421+0000 7f4bcec9f640 1 -- 172.21.15.52:0/2477396484 wait complete. 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcec9f640 1 Processor -- start 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcec9f640 1 -- start start 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcec9f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8101900 0x7f4bc819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcec9f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc8107900 0x7f4bc819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcec9f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc810ee30 con 0x7f4bc8101900 2024-09-06T15:10:48.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcec9f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4bc810ecb0 con 0x7f4bc8107900 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcca3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8101900 0x7f4bc819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcca3b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8101900 0x7f4bc819f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51214/0 (socket says 172.21.15.52:51214) 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcca3b640 1 -- 172.21.15.52:0/1640232396 learned_addr learned my addr 172.21.15.52:0/1640232396 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcca3b640 1 -- 172.21.15.52:0/1640232396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc8107900 msgr2=0x7f4bc819fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bc7fff640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc8107900 0x7f4bc819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcca3b640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc8107900 0x7f4bc819fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.422+0000 7f4bcca3b640 1 -- 172.21.15.52:0/1640232396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bc8199a70 con 0x7f4bc8101900 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.423+0000 7f4bc7fff640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc8107900 0x7f4bc819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.423+0000 7f4bcca3b640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8101900 0x7f4bc819f8b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc031460 tx=0x7f4bbc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.423+0000 7f4bc5ffb640 1 -- 172.21.15.52:0/1640232396 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc03f070 con 0x7f4bc8101900 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.423+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bc8199d00 con 0x7f4bc8101900 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.423+0000 7f4bc5ffb640 1 -- 172.21.15.52:0/1640232396 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4bbc004cf0 con 0x7f4bc8101900 2024-09-06T15:10:48.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.423+0000 7f4bc5ffb640 1 -- 172.21.15.52:0/1640232396 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4bbc035030 con 0x7f4bc8101900 2024-09-06T15:10:48.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.423+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bc819a230 con 0x7f4bc8101900 2024-09-06T15:10:48.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.424+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bc8103040 con 0x7f4bc8101900 2024-09-06T15:10:48.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.425+0000 7f4bc5ffb640 1 -- 172.21.15.52:0/1640232396 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4bbc042070 con 0x7f4bc8101900 2024-09-06T15:10:48.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.425+0000 7f4bc5ffb640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bb8077460 0x7f4bb8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:48.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.425+0000 7f4bc5ffb640 1 -- 172.21.15.52:0/1640232396 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4bbc0ba2e0 con 0x7f4bc8101900 2024-09-06T15:10:48.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.425+0000 7f4bc7fff640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bb8077460 0x7f4bb8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:48.426 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.426+0000 7f4bc7fff640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bb8077460 0x7f4bb8079920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4006fd0 tx=0x7f4bb4008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:48.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.429+0000 7f4bc5ffb640 1 -- 172.21.15.52:0/1640232396 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4bbc083240 con 0x7f4bc8101900 2024-09-06T15:10:48.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.647+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4bc819b040 con 0x7f4bc8101900 2024-09-06T15:10:48.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.647+0000 7f4bc5ffb640 1 -- 172.21.15.52:0/1640232396 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4bbc0873b0 con 0x7f4bc8101900 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bb8077460 msgr2=0x7f4bb8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bb8077460 0x7f4bb8079920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4006fd0 tx=0x7f4bb4008040 comp rx=0 tx=0).stop 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8101900 msgr2=0x7f4bc819f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8101900 0x7f4bc819f8b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc031460 tx=0x7f4bbc0048f0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 shutdown_connections 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4bb8077460 0x7f4bb8079920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4bc8107900 0x7f4bc819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 --2- 172.21.15.52:0/1640232396 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4bc8101900 0x7f4bc819f8b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:48.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 >> 172.21.15.52:0/1640232396 conn(0x7f4bc80fd600 msgr2=0x7f4bc8074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 shutdown_connections 2024-09-06T15:10:48.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:48.649+0000 7f4bcec9f640 1 -- 172.21.15.52:0/1640232396 wait complete. 2024-09-06T15:10:48.657 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph version 19.3.0-4704-g8b38c33c (8b38c33cecf4b0b7a9b3116eb9089e21e444ac73) squid (dev)" 2024-09-06T15:10:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:48 smithi165 ceph-mon[82925]: pgmap v797: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:48 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1640232396' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:10:49.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:48 smithi052 ceph-mon[112917]: pgmap v797: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:49.327 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:48 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1640232396' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-06T15:10:49.353 DEBUG:teuthology.parallel:result is None 2024-09-06T15:10:49.353 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-06T15:10:49.369 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T15:10:49.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-06T15:10:49.622 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 -- 172.21.15.52:0/3977325950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 msgr2=0x7fd260101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3977325950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd260101d60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd248009880 tx=0x7fd24802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 -- 172.21.15.52:0/3977325950 shutdown_connections 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3977325950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd260101d60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3977325950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd260107900 0x7fd260107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 -- 172.21.15.52:0/3977325950 >> 172.21.15.52:0/3977325950 conn(0x7fd2600fd600 msgr2=0x7fd2600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 -- 172.21.15.52:0/3977325950 shutdown_connections 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.179+0000 7fd264c3e640 1 -- 172.21.15.52:0/3977325950 wait complete. 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd264c3e640 1 Processor -- start 2024-09-06T15:10:50.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd264c3e640 1 -- start start 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd264c3e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd2600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd264c3e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd260107900 0x7fd260074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd264c3e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd26010edd0 con 0x7fd260101900 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd264c3e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd26010ec50 con 0x7fd260107900 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd25e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd2600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd25e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd2600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51232/0 (socket says 172.21.15.52:51232) 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd25e59c640 1 -- 172.21.15.52:0/3325065170 learned_addr learned my addr 172.21.15.52:0/3325065170 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd25dd9b640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd260107900 0x7fd260074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd25e59c640 1 -- 172.21.15.52:0/3325065170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd260107900 msgr2=0x7fd260074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd25e59c640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd260107900 0x7fd260074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.180+0000 7fd25e59c640 1 -- 172.21.15.52:0/3325065170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd260074f70 con 0x7fd260101900 2024-09-06T15:10:50.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.181+0000 7fd25e59c640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd2600744f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd25000d6f0 tx=0x7fd25000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:50.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.181+0000 7fd2577fe640 1 -- 172.21.15.52:0/3325065170 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd250017070 con 0x7fd260101900 2024-09-06T15:10:50.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.181+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd260075260 con 0x7fd260101900 2024-09-06T15:10:50.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.181+0000 7fd2577fe640 1 -- 172.21.15.52:0/3325065170 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd25000de00 con 0x7fd260101900 2024-09-06T15:10:50.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.181+0000 7fd2577fe640 1 -- 172.21.15.52:0/3325065170 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd250004bb0 con 0x7fd260101900 2024-09-06T15:10:50.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.181+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2601a3e80 con 0x7fd260101900 2024-09-06T15:10:50.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.182+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd260103040 con 0x7fd260101900 2024-09-06T15:10:50.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.182+0000 7fd2577fe640 1 -- 172.21.15.52:0/3325065170 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd250004e60 con 0x7fd260101900 2024-09-06T15:10:50.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.183+0000 7fd2577fe640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd24c077460 0x7fd24c079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:50.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.183+0000 7fd25dd9b640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd24c077460 0x7fd24c079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:50.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.183+0000 7fd2577fe640 1 -- 172.21.15.52:0/3325065170 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd250099390 con 0x7fd260101900 2024-09-06T15:10:50.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.184+0000 7fd25dd9b640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd24c077460 0x7fd24c079920 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd260075f80 tx=0x7fd248031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:50.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.187+0000 7fd2577fe640 1 -- 172.21.15.52:0/3325065170 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd250066460 con 0x7fd260101900 2024-09-06T15:10:50.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.374+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd260075a20 con 0x7fd260101900 2024-09-06T15:10:50.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.374+0000 7fd2577fe640 1 -- 172.21.15.52:0/3325065170 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) ==== 76+0+2052 (secure 0 0 0) 0x7fd25006ae80 con 0x7fd260101900 2024-09-06T15:10:50.375 INFO:teuthology.orchestra.run.smithi052.stdout:e39 2024-09-06T15:10:50.375 INFO:teuthology.orchestra.run.smithi052.stdout:btime 2024-09-06T15:09:08:623589+0000 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:legacy client fscid: 1 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:Filesystem 'cephfs' (1) 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:fs_name cephfs 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 39 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-06T14:41:46.713227+0000 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-09-06T15:09:07.759573+0000 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:tableserver 0 2024-09-06T15:10:50.376 INFO:teuthology.orchestra.run.smithi052.stdout:root 0 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:session_timeout 60 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:session_autoclose 300 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:max_file_size 1099511627776 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:max_xattr_size 65536 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:required_client_features {} 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure 0 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:last_failure_osd_epoch 87 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:max_mds 2 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:in 0,1 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:up {0=34342,1=34374} 2024-09-06T15:10:50.377 INFO:teuthology.orchestra.run.smithi052.stdout:failed 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:damaged 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:stopped 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:data_pools [3] 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:metadata_pool 2 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:inline_data enabled 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:balancer 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:bal_rank_mask -1 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:standby_count_wanted 1 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:qdb_cluster leader: 34342 members: 34342,34374 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.dfprfm{0:34342} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.52:6826/3019175304,v1:172.21.15.52:6827/3019175304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.nmjcsh{0:44321} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.165:6824/3934747666,v1:172.21.15.165:6825/3934747666] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi052.eqtxfx{1:34374} state up:active seq 240 join_fscid=1 addr [v2:172.21.15.52:6828/3819874840,v1:172.21.15.52:6829/3819874840] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.cephfs.smithi165.zpunux{1:44349} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.165:6826/1211110348,v1:172.21.15.165:6827/1211110348] compat {c=[1],r=[1],i=[1fff]}] 2024-09-06T15:10:50.378 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:50.379 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 39 2024-09-06T15:10:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd24c077460 msgr2=0x7fd24c079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd24c077460 0x7fd24c079920 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd260075f80 tx=0x7fd248031400 comp rx=0 tx=0).stop 2024-09-06T15:10:50.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 msgr2=0x7fd2600744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd2600744f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd25000d6f0 tx=0x7fd25000dbb0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 shutdown_connections 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd24c077460 0x7fd24c079920 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd260107900 0x7fd260074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 --2- 172.21.15.52:0/3325065170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd260101900 0x7fd2600744f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.377+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 >> 172.21.15.52:0/3325065170 conn(0x7fd2600fd600 msgr2=0x7fd2600fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.378+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 shutdown_connections 2024-09-06T15:10:50.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:50.378+0000 7fd264c3e640 1 -- 172.21.15.52:0/3325065170 wait complete. 2024-09-06T15:10:51.038 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-06T15:10:51.049 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 2024-09-06T15:10:51.305 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:51.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:50 smithi165 ceph-mon[82925]: pgmap v798: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:51.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:50 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3325065170' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:10:51.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:50 smithi052 ceph-mon[112917]: pgmap v798: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:51.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:50 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3325065170' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-06T15:10:51.879 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 -- 172.21.15.52:0/2544744943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 msgr2=0x7fd7a0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/2544744943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a0100c60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009880 tx=0x7fd78c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 -- 172.21.15.52:0/2544744943 shutdown_connections 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/2544744943 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a0100c60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/2544744943 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a0106800 0x7fd7a0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 -- 172.21.15.52:0/2544744943 >> 172.21.15.52:0/2544744943 conn(0x7fd7a00fc520 msgr2=0x7fd7a00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 -- 172.21.15.52:0/2544744943 shutdown_connections 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.851+0000 7fd7a6c52640 1 -- 172.21.15.52:0/2544744943 wait complete. 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a6c52640 1 Processor -- start 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a6c52640 1 -- start start 2024-09-06T15:10:51.880 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a6c52640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a6c52640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a0106800 0x7fd7a019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a6c52640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a010dcb0 con 0x7fd7a0100800 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a6c52640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a010db30 con 0x7fd7a0106800 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a49ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a49ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51990/0 (socket says 172.21.15.52:51990) 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.852+0000 7fd7a49ee640 1 -- 172.21.15.52:0/104122519 learned_addr learned my addr 172.21.15.52:0/104122519 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd79ffff640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a0106800 0x7fd7a019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd7a49ee640 1 -- 172.21.15.52:0/104122519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a0106800 msgr2=0x7fd7a019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd7a49ee640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a0106800 0x7fd7a019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd7a49ee640 1 -- 172.21.15.52:0/104122519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a01977f0 con 0x7fd7a0100800 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd79ffff640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a0106800 0x7fd7a019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd7a49ee640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a019d670 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c8a0 tx=0x7fd79400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:51.881 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd79dffb640 1 -- 172.21.15.52:0/104122519 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd7940079b0 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd79dffb640 1 -- 172.21.15.52:0/104122519 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd794007b50 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd79dffb640 1 -- 172.21.15.52:0/104122519 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd794018700 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a0197ae0 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.853+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a0198070 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.854+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a0101f40 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.855+0000 7fd79dffb640 1 -- 172.21.15.52:0/104122519 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd794007d00 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.855+0000 7fd79dffb640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7900774b0 0x7fd790079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.855+0000 7fd79dffb640 1 -- 172.21.15.52:0/104122519 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd794099a40 con 0x7fd7a0100800 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.855+0000 7fd79ffff640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7900774b0 0x7fd790079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.856+0000 7fd79ffff640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7900774b0 0x7fd790079970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd78c031460 tx=0x7fd78c0095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:51.882 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:51.859+0000 7fd79dffb640 1 -- 172.21.15.52:0/104122519 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd794014030 con 0x7fd7a0100800 2024-09-06T15:10:52.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.040+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7a0109da0 con 0x7fd7a0100800 2024-09-06T15:10:52.041 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.041+0000 7fd79dffb640 1 -- 172.21.15.52:0/104122519 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5364 (secure 0 0 0) 0x7fd794062980 con 0x7fd7a0100800 2024-09-06T15:10:52.042 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:52.042 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":39,"btime":"2024-09-06T15:09:08:623589+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:09:07.759573+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:active","state_seq":244,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:active","state_seq":240,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44321":{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44349":{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34342,"qdb_cluster":[34342,34374]},"id":1}]} 2024-09-06T15:10:52.042 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 39 2024-09-06T15:10:52.043 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7900774b0 msgr2=0x7fd790079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7900774b0 0x7fd790079970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd78c031460 tx=0x7fd78c0095f0 comp rx=0 tx=0).stop 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 msgr2=0x7fd7a019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a019d670 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c8a0 tx=0x7fd79400cd60 comp rx=0 tx=0).stop 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 shutdown_connections 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd7900774b0 0x7fd790079970 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a0106800 0x7fd7a019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 --2- 172.21.15.52:0/104122519 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7a0100800 0x7fd7a019d670 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 >> 172.21.15.52:0/104122519 conn(0x7fd7a00fc520 msgr2=0x7fd7a006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 shutdown_connections 2024-09-06T15:10:52.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:52.043+0000 7fd7a6c52640 1 -- 172.21.15.52:0/104122519 wait complete. 2024-09-06T15:10:52.670 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-06T15:10:52.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 20 2024-09-06T15:10:52.923 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:52 smithi165 ceph-mon[82925]: pgmap v799: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:52 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/104122519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-06T15:10:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:53.329 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:52 smithi052 ceph-mon[112917]: pgmap v799: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:53.329 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:52 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/104122519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-06T15:10:53.329 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 -- 172.21.15.52:0/4115248319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 msgr2=0x7ff038106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 --2- 172.21.15.52:0/4115248319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff038106610 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff028009880 tx=0x7ff02802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 -- 172.21.15.52:0/4115248319 shutdown_connections 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 --2- 172.21.15.52:0/4115248319 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff038106610 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 --2- 172.21.15.52:0/4115248319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0381000c0 0x7ff0381004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 -- 172.21.15.52:0/4115248319 >> 172.21.15.52:0/4115248319 conn(0x7ff0380fbc90 msgr2=0x7ff0380fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 -- 172.21.15.52:0/4115248319 shutdown_connections 2024-09-06T15:10:53.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.410+0000 7ff03f465640 1 -- 172.21.15.52:0/4115248319 wait complete. 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.411+0000 7ff03f465640 1 Processor -- start 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.411+0000 7ff03f465640 1 -- start start 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.411+0000 7ff03f465640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0381000c0 0x7ff03819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.411+0000 7ff03f465640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff03819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.411+0000 7ff03f465640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff03810ee40 con 0x7ff038100a70 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.411+0000 7ff03f465640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff03810ecc0 con 0x7ff0381000c0 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.411+0000 7ff03ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff03819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03ca00640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff03819dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52022/0 (socket says 172.21.15.52:52022) 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03ca00640 1 -- 172.21.15.52:0/3176886886 learned_addr learned my addr 172.21.15.52:0/3176886886 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03d201640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0381000c0 0x7ff03819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03ca00640 1 -- 172.21.15.52:0/3176886886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0381000c0 msgr2=0x7ff03819d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:53.422 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03ca00640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0381000c0 0x7ff03819d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03ca00640 1 -- 172.21.15.52:0/3176886886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03819e2c0 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03ca00640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff03819dc10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff028031460 tx=0x7ff0280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff02e7fc640 1 -- 172.21.15.52:0/3176886886 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff02803f070 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff02e7fc640 1 -- 172.21.15.52:0/3176886886 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff028004cf0 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff038197950 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff02e7fc640 1 -- 172.21.15.52:0/3176886886 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff028035030 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.412+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff038197e50 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.413+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff038103180 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.414+0000 7ff02e7fc640 1 -- 172.21.15.52:0/3176886886 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7ff028042070 con 0x7ff038100a70 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.414+0000 7ff02e7fc640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff024077460 0x7ff024079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.415+0000 7ff03d201640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff024077460 0x7ff024079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:53.423 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.415+0000 7ff02e7fc640 1 -- 172.21.15.52:0/3176886886 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7ff0280ba240 con 0x7ff038100a70 2024-09-06T15:10:53.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.415+0000 7ff03d201640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff024077460 0x7ff024079920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff0381989d0 tx=0x7ff03400a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:53.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.419+0000 7ff02e7fc640 1 -- 172.21.15.52:0/3176886886 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7ff028083100 con 0x7ff038100a70 2024-09-06T15:10:53.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.599+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7ff038198dc0 con 0x7ff038100a70 2024-09-06T15:10:53.600 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.600+0000 7ff02e7fc640 1 -- 172.21.15.52:0/3176886886 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v39) ==== 107+0+3648 (secure 0 0 0) 0x7ff028087270 con 0x7ff038100a70 2024-09-06T15:10:53.601 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:53.601 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"btime":"2024-09-06T14:52:46:478495+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:45.480553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14584,"mds_1":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14584":{"gid":14584,"name":"cephfs.smithi052.eqtxfx","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.52:6829/1318417598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1318417598},{"type":"v1","addr":"172.21.15.52:6829","nonce":1318417598}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24277":{"gid":24277,"name":"cephfs.smithi165.nmjcsh","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.165:6825/3417309574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3417309574},{"type":"v1","addr":"172.21.15.165:6825","nonce":3417309574}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14584,"qdb_cluster":[14584,24277]},"id":1}]} 2024-09-06T15:10:53.601 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 20 2024-09-06T15:10:53.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff024077460 msgr2=0x7ff024079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff024077460 0x7ff024079920 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff0381989d0 tx=0x7ff03400a2d0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 msgr2=0x7ff03819dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff03819dc10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff028031460 tx=0x7ff0280048f0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 shutdown_connections 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff038100a70 0x7ff03819dc10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7ff024077460 0x7ff024079920 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 --2- 172.21.15.52:0/3176886886 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff0381000c0 0x7ff03819d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 >> 172.21.15.52:0/3176886886 conn(0x7ff0380fbc90 msgr2=0x7ff0380fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 shutdown_connections 2024-09-06T15:10:53.603 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:53.602+0000 7ff03f465640 1 -- 172.21.15.52:0/3176886886 wait complete. 2024-09-06T15:10:54.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:54 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3176886886' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-06T15:10:54.226 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-09-06T15:10:54.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 21 2024-09-06T15:10:54.250 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:54 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3176886886' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-06T15:10:54.479 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:54.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 -- 172.21.15.52:0/2460724861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 msgr2=0x7f3530101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:54.961 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 --2- 172.21.15.52:0/2460724861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f3530101d60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3524009880 tx=0x7f352402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 -- 172.21.15.52:0/2460724861 shutdown_connections 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 --2- 172.21.15.52:0/2460724861 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f3530101d60 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 --2- 172.21.15.52:0/2460724861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3530107900 0x7f3530107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 -- 172.21.15.52:0/2460724861 >> 172.21.15.52:0/2460724861 conn(0x7f35300fd600 msgr2=0x7f35300ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 -- 172.21.15.52:0/2460724861 shutdown_connections 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.926+0000 7f353640b640 1 -- 172.21.15.52:0/2460724861 wait complete. 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.927+0000 7f353640b640 1 Processor -- start 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.927+0000 7f353640b640 1 -- start start 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f353640b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f353019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f353640b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3530107900 0x7f353019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f353640b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f353010edb0 con 0x7f3530101900 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f353640b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f353010ec30 con 0x7f3530107900 2024-09-06T15:10:54.962 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f353019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f353019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52048/0 (socket says 172.21.15.52:52048) 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352ffff640 1 -- 172.21.15.52:0/3974474359 learned_addr learned my addr 172.21.15.52:0/3974474359 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352f7fe640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3530107900 0x7f353019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352ffff640 1 -- 172.21.15.52:0/3974474359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3530107900 msgr2=0x7f353019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352ffff640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3530107900 0x7f353019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352ffff640 1 -- 172.21.15.52:0/3974474359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3530199990 con 0x7f3530101900 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352ffff640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f353019f7d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f352000d8d0 tx=0x7f352000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352d7fa640 1 -- 172.21.15.52:0/3974474359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3520017030 con 0x7f3530101900 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352d7fa640 1 -- 172.21.15.52:0/3974474359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3520004020 con 0x7f3530101900 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3530199c80 con 0x7f3530101900 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f352d7fa640 1 -- 172.21.15.52:0/3974474359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35200047a0 con 0x7f3530101900 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.928+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353019a1e0 con 0x7f3530101900 2024-09-06T15:10:54.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.929+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3530103040 con 0x7f3530101900 2024-09-06T15:10:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.930+0000 7f352d7fa640 1 -- 172.21.15.52:0/3974474359 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f35200041d0 con 0x7f3530101900 2024-09-06T15:10:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.931+0000 7f352d7fa640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35180774b0 0x7f3518079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.931+0000 7f352f7fe640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35180774b0 0x7f3518079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.931+0000 7f352d7fa640 1 -- 172.21.15.52:0/3974474359 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f3520018070 con 0x7f3530101900 2024-09-06T15:10:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.931+0000 7f352f7fe640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35180774b0 0x7f3518079970 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f353019b180 tx=0x7f3524031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:54.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:54.935+0000 7f352d7fa640 1 -- 172.21.15.52:0/3974474359 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f3520062500 con 0x7f3530101900 2024-09-06T15:10:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.122+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f353019a4f0 con 0x7f3530101900 2024-09-06T15:10:55.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.123+0000 7f352d7fa640 1 -- 172.21.15.52:0/3974474359 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v39) ==== 107+0+3612 (secure 0 0 0) 0x7f3520066670 con 0x7f3530101900 2024-09-06T15:10:55.124 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:55.124 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"btime":"2024-09-06T14:52:46:620989+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34330,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/2488952568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2488952568},{"type":"v1","addr":"172.21.15.52:6827","nonce":2488952568}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:10:55.124 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 21 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35180774b0 msgr2=0x7f3518079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35180774b0 0x7f3518079970 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f353019b180 tx=0x7f3524031400 comp rx=0 tx=0).stop 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 msgr2=0x7f353019f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f353019f7d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f352000d8d0 tx=0x7f352000dd90 comp rx=0 tx=0).stop 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 shutdown_connections 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f35180774b0 0x7f3518079970 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3530107900 0x7f353019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:55.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 --2- 172.21.15.52:0/3974474359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3530101900 0x7f353019f7d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 >> 172.21.15.52:0/3974474359 conn(0x7f35300fd600 msgr2=0x7f3530074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 shutdown_connections 2024-09-06T15:10:55.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:55.125+0000 7f353640b640 1 -- 172.21.15.52:0/3974474359 wait complete. 2024-09-06T15:10:55.220 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:55 smithi052 ceph-mon[112917]: pgmap v800: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:55.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:55 smithi165 ceph-mon[82925]: pgmap v800: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:55.776 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:10:55.776 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-06T15:10:55.776 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 22 2024-09-06T15:10:56.070 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:56.294 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:56 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3974474359' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-06T15:10:56.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:56 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3974474359' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-06T15:10:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 -- 172.21.15.52:0/1063574521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781067f0 msgr2=0x7fe878106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 --2- 172.21.15.52:0/1063574521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781067f0 0x7fe878106bd0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe868009880 tx=0x7fe86802a4a0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 -- 172.21.15.52:0/1063574521 shutdown_connections 2024-09-06T15:10:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 --2- 172.21.15.52:0/1063574521 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8781007f0 0x7fe878100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 --2- 172.21.15.52:0/1063574521 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781067f0 0x7fe878106bd0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 -- 172.21.15.52:0/1063574521 >> 172.21.15.52:0/1063574521 conn(0x7fe8780fc550 msgr2=0x7fe8780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 -- 172.21.15.52:0/1063574521 shutdown_connections 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 -- 172.21.15.52:0/1063574521 wait complete. 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 Processor -- start 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.509+0000 7fe87ef94640 1 -- start start 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87ef94640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781007f0 0x7fe87819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87ef94640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8781067f0 0x7fe87819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87ef94640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe87810dca0 con 0x7fe8781007f0 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87ef94640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe87810db20 con 0x7fe8781067f0 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87cd30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781007f0 0x7fe87819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87cd30640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781007f0 0x7fe87819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52060/0 (socket says 172.21.15.52:52060) 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87cd30640 1 -- 172.21.15.52:0/4029537975 learned_addr learned my addr 172.21.15.52:0/4029537975 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:56.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87cd30640 1 -- 172.21.15.52:0/4029537975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8781067f0 msgr2=0x7fe87819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87cd30640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8781067f0 0x7fe87819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87cd30640 1 -- 172.21.15.52:0/4029537975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe878197750 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87cd30640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781007f0 0x7fe87819d680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe868031460 tx=0x7fe8680048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe875ffb640 1 -- 172.21.15.52:0/4029537975 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe86803f070 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe875ffb640 1 -- 172.21.15.52:0/4029537975 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe868004cf0 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe875ffb640 1 -- 172.21.15.52:0/4029537975 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe868035030 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.510+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8781979e0 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.511+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe878197f10 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.512+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe878101f30 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.512+0000 7fe875ffb640 1 -- 172.21.15.52:0/4029537975 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fe868042070 con 0x7fe8781007f0 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.513+0000 7fe875ffb640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe860077460 0x7fe860079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:56.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.513+0000 7fe875ffb640 1 -- 172.21.15.52:0/4029537975 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fe8680ba230 con 0x7fe8781007f0 2024-09-06T15:10:56.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.513+0000 7fe877fff640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe860077460 0x7fe860079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:56.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.513+0000 7fe877fff640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe860077460 0x7fe860079920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe878198fa0 tx=0x7fe86c005c70 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:56.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.517+0000 7fe875ffb640 1 -- 172.21.15.52:0/4029537975 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fe868083190 con 0x7fe8781007f0 2024-09-06T15:10:56.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.703+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7fe8781981c0 con 0x7fe8781007f0 2024-09-06T15:10:56.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.703+0000 7fe875ffb640 1 -- 172.21.15.52:0/4029537975 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v39) ==== 107+0+5309 (secure 0 0 0) 0x7fe868087300 con 0x7fe8781007f0 2024-09-06T15:10:56.704 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:56.704 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"btime":"2024-09-06T14:52:47:622451+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34330,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/2488952568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":2488952568},{"type":"v1","addr":"172.21.15.52:6827","nonce":2488952568}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34338,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3913146670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3913146670},{"type":"v1","addr":"172.21.15.52:6829","nonce":3913146670}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44293,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3871572907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3871572907},{"type":"v1","addr":"172.21.15.165:6825","nonce":3871572907}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:10:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 22 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe860077460 msgr2=0x7fe860079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe860077460 0x7fe860079920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe878198fa0 tx=0x7fe86c005c70 comp rx=0 tx=0).stop 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781007f0 msgr2=0x7fe87819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781007f0 0x7fe87819d680 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe868031460 tx=0x7fe8680048f0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 shutdown_connections 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fe860077460 0x7fe860079920 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe8781067f0 0x7fe87819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 --2- 172.21.15.52:0/4029537975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8781007f0 0x7fe87819d680 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 >> 172.21.15.52:0/4029537975 conn(0x7fe8780fc550 msgr2=0x7fe878069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 shutdown_connections 2024-09-06T15:10:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:56.705+0000 7fe87ef94640 1 -- 172.21.15.52:0/4029537975 wait complete. 2024-09-06T15:10:57.265 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:57 smithi052 ceph-mon[112917]: pgmap v801: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:57.265 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:57 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4029537975' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-06T15:10:57.293 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:10:57.293 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-06T15:10:57.293 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 23 2024-09-06T15:10:57.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:57 smithi165 ceph-mon[82925]: pgmap v801: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:10:57.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:57 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4029537975' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-06T15:10:57.550 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:58.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 -- 172.21.15.52:0/390999427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4410102ab0 msgr2=0x7f4410102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:58.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 --2- 172.21.15.52:0/390999427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4410102ab0 0x7f4410102e90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4400009880 tx=0x7f440002a530 comp rx=0 tx=0).stop 2024-09-06T15:10:58.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 -- 172.21.15.52:0/390999427 shutdown_connections 2024-09-06T15:10:58.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 --2- 172.21.15.52:0/390999427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44101033d0 0x7f441010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:58.044 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 --2- 172.21.15.52:0/390999427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4410102ab0 0x7f4410102e90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 -- 172.21.15.52:0/390999427 >> 172.21.15.52:0/390999427 conn(0x7f44100fc550 msgr2=0x7f44100fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 -- 172.21.15.52:0/390999427 shutdown_connections 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 -- 172.21.15.52:0/390999427 wait complete. 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 Processor -- start 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.009+0000 7f4416781640 1 -- start start 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f4416781640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4410102ab0 0x7f4410100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f4416781640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44101033d0 0x7f4410100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f4416781640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f441010edc0 con 0x7f44101033d0 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f4416781640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f441010ec40 con 0x7f4410102ab0 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44101033d0 0x7f4410100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44101033d0 0x7f4410100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52086/0 (socket says 172.21.15.52:52086) 2024-09-06T15:10:58.045 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440f7fe640 1 -- 172.21.15.52:0/463771602 learned_addr learned my addr 172.21.15.52:0/463771602 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440ffff640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4410102ab0 0x7f4410100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440f7fe640 1 -- 172.21.15.52:0/463771602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4410102ab0 msgr2=0x7f4410100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440f7fe640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4410102ab0 0x7f4410100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440f7fe640 1 -- 172.21.15.52:0/463771602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4410101190 con 0x7f44101033d0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.010+0000 7f440f7fe640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44101033d0 0x7f4410100c50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f440400d6c0 tx=0x7f440400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.011+0000 7f440d7fa640 1 -- 172.21.15.52:0/463771602 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4404017070 con 0x7f44101033d0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.011+0000 7f440d7fa640 1 -- 172.21.15.52:0/463771602 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4404009ce0 con 0x7f44101033d0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.011+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4410101480 con 0x7f44101033d0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.011+0000 7f440d7fa640 1 -- 172.21.15.52:0/463771602 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f440400f3c0 con 0x7f44101033d0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.011+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44101a3e30 con 0x7f44101033d0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.012+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441006a580 con 0x7f44101033d0 2024-09-06T15:10:58.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.012+0000 7f440d7fa640 1 -- 172.21.15.52:0/463771602 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4404010460 con 0x7f44101033d0 2024-09-06T15:10:58.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.013+0000 7f440d7fa640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43f80774b0 0x7f43f8079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:58.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.013+0000 7f440d7fa640 1 -- 172.21.15.52:0/463771602 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4404099400 con 0x7f44101033d0 2024-09-06T15:10:58.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.013+0000 7f440ffff640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43f80774b0 0x7f43f8079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:58.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.013+0000 7f440ffff640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43f80774b0 0x7f43f8079970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f44000096c0 tx=0x7f4400031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:58.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.017+0000 7f440d7fa640 1 -- 172.21.15.52:0/463771602 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4404066550 con 0x7f44101033d0 2024-09-06T15:10:58.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.203+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f4410101c40 con 0x7f44101033d0 2024-09-06T15:10:58.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.203+0000 7f440d7fa640 1 -- 172.21.15.52:0/463771602 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v39) ==== 107+0+4462 (secure 0 0 0) 0x7f440406af70 con 0x7f44101033d0 2024-09-06T15:10:58.204 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:58.205 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":23,"btime":"2024-09-06T14:52:50:626926+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3913146670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3913146670},{"type":"v1","addr":"172.21.15.52:6829","nonce":3913146670}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44293,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3871572907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3871572907},{"type":"v1","addr":"172.21.15.165:6825","nonce":3871572907}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:10:58.205 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 23 2024-09-06T15:10:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43f80774b0 msgr2=0x7f43f8079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43f80774b0 0x7f43f8079970 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f44000096c0 tx=0x7f4400031400 comp rx=0 tx=0).stop 2024-09-06T15:10:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44101033d0 msgr2=0x7f4410100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44101033d0 0x7f4410100c50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f440400d6c0 tx=0x7f440400db80 comp rx=0 tx=0).stop 2024-09-06T15:10:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 shutdown_connections 2024-09-06T15:10:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f44101033d0 0x7f4410100c50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f43f80774b0 0x7f43f8079970 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 --2- 172.21.15.52:0/463771602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4410102ab0 0x7f4410100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.205+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 >> 172.21.15.52:0/463771602 conn(0x7f44100fc550 msgr2=0x7f4410108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.206+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 shutdown_connections 2024-09-06T15:10:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:58.206+0000 7f4416781640 1 -- 172.21.15.52:0/463771602 wait complete. 2024-09-06T15:10:58.818 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:10:58.818 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-06T15:10:58.818 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 24 2024-09-06T15:10:59.073 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:10:59.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:59 smithi165 ceph-mon[82925]: pgmap v802: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:59.328 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:10:59 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/463771602' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-06T15:10:59.343 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:59 smithi052 ceph-mon[112917]: pgmap v802: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:10:59.343 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:10:59 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/463771602' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 -- 172.21.15.52:0/2165450112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 msgr2=0x7f883810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 --2- 172.21.15.52:0/2165450112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883810b8d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f882c009880 tx=0x7f882c02a530 comp rx=0 tx=0).stop 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 -- 172.21.15.52:0/2165450112 shutdown_connections 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 --2- 172.21.15.52:0/2165450112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883810b8d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 --2- 172.21.15.52:0/2165450112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8838102ac0 0x7f8838102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 -- 172.21.15.52:0/2165450112 >> 172.21.15.52:0/2165450112 conn(0x7f88380fc520 msgr2=0x7f88380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 -- 172.21.15.52:0/2165450112 shutdown_connections 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 -- 172.21.15.52:0/2165450112 wait complete. 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 Processor -- start 2024-09-06T15:10:59.543 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.532+0000 7f883e73c640 1 -- start start 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f883e73c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8838102ac0 0x7f883819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f883e73c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f883e73c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f883810edf0 con 0x7f88381033e0 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f883e73c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f883810ec70 con 0x7f8838102ac0 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88377fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52108/0 (socket says 172.21.15.52:52108) 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88377fe640 1 -- 172.21.15.52:0/2664921885 learned_addr learned my addr 172.21.15.52:0/2664921885 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f8837fff640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8838102ac0 0x7f883819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88377fe640 1 -- 172.21.15.52:0/2664921885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8838102ac0 msgr2=0x7f883819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88377fe640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8838102ac0 0x7f883819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88377fe640 1 -- 172.21.15.52:0/2664921885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8838197800 con 0x7f88381033e0 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88377fe640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883819dbc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f882c031460 tx=0x7f882c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:59.544 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88357fa640 1 -- 172.21.15.52:0/2664921885 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f882c03f070 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88357fa640 1 -- 172.21.15.52:0/2664921885 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f882c0035f0 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8838197a90 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.533+0000 7f88357fa640 1 -- 172.21.15.52:0/2664921885 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f882c035030 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.534+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8838197fc0 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.534+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883806aa90 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.535+0000 7f88357fa640 1 -- 172.21.15.52:0/2664921885 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f882c042070 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.535+0000 7f88357fa640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8820077460 0x7f8820079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.536+0000 7f88357fa640 1 -- 172.21.15.52:0/2664921885 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f882c0ba140 con 0x7f88381033e0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.536+0000 7f8837fff640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8820077460 0x7f8820079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.536+0000 7f8837fff640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8820077460 0x7f8820079920 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8828005fd0 tx=0x7f8828005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:10:59.545 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.539+0000 7f88357fa640 1 -- 172.21.15.52:0/2664921885 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f882c0830a0 con 0x7f88381033e0 2024-09-06T15:10:59.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.722+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f8838105f60 con 0x7f88381033e0 2024-09-06T15:10:59.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.723+0000 7f88357fa640 1 -- 172.21.15.52:0/2664921885 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v39) ==== 107+0+5309 (secure 0 0 0) 0x7f882c087210 con 0x7f88381033e0 2024-09-06T15:10:59.724 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:10:59.724 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":24,"btime":"2024-09-06T14:52:55:604062+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34338,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3913146670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3913146670},{"type":"v1","addr":"172.21.15.52:6829","nonce":3913146670}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44293,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3871572907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3871572907},{"type":"v1","addr":"172.21.15.165:6825","nonce":3871572907}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:10:59.724 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 24 2024-09-06T15:10:59.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8820077460 msgr2=0x7f8820079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8820077460 0x7f8820079920 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8828005fd0 tx=0x7f8828005850 comp rx=0 tx=0).stop 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 msgr2=0x7f883819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883819dbc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f882c031460 tx=0x7f882c004530 comp rx=0 tx=0).stop 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 shutdown_connections 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88381033e0 0x7f883819dbc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8820077460 0x7f8820079920 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 --2- 172.21.15.52:0/2664921885 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8838102ac0 0x7f883819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 >> 172.21.15.52:0/2664921885 conn(0x7f88380fc520 msgr2=0x7f8838108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 shutdown_connections 2024-09-06T15:10:59.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:10:59.726+0000 7f883e73c640 1 -- 172.21.15.52:0/2664921885 wait complete. 2024-09-06T15:11:00.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:00 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2664921885' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-06T15:11:00.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:00 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2664921885' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-06T15:11:00.403 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:11:00.403 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-06T15:11:00.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 25 2024-09-06T15:11:00.659 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:01.102 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:01 smithi052 ceph-mon[112917]: pgmap v803: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:01.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 -- 172.21.15.52:0/383426535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08106800 msgr2=0x7fad08106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/383426535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08106800 0x7fad08106be0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fad04009880 tx=0x7fad0402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 -- 172.21.15.52:0/383426535 shutdown_connections 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/383426535 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad08100800 0x7fad08100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/383426535 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08106800 0x7fad08106be0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 -- 172.21.15.52:0/383426535 >> 172.21.15.52:0/383426535 conn(0x7fad080fc520 msgr2=0x7fad080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 -- 172.21.15.52:0/383426535 shutdown_connections 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.102+0000 7fad0fc0e640 1 -- 172.21.15.52:0/383426535 wait complete. 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0fc0e640 1 Processor -- start 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0fc0e640 1 -- start start 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0fc0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08100800 0x7fad0819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0fc0e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad08106800 0x7fad0819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:01.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0fc0e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad0810dcd0 con 0x7fad08100800 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0fc0e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fad0810db50 con 0x7fad08106800 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0d9aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08100800 0x7fad0819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0d9aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08100800 0x7fad0819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36308/0 (socket says 172.21.15.52:36308) 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.103+0000 7fad0d9aa640 1 -- 172.21.15.52:0/1538354824 learned_addr learned my addr 172.21.15.52:0/1538354824 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0d1a9640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad08106800 0x7fad0819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0d9aa640 1 -- 172.21.15.52:0/1538354824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad08106800 msgr2=0x7fad0819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0d9aa640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad08106800 0x7fad0819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0d9aa640 1 -- 172.21.15.52:0/1538354824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad081977e0 con 0x7fad08100800 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0d1a9640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad08106800 0x7fad0819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0d9aa640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08100800 0x7fad0819d660 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fad04031460 tx=0x7fad04004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7facfaffd640 1 -- 172.21.15.52:0/1538354824 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad0403f070 con 0x7fad08100800 2024-09-06T15:11:01.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7facfaffd640 1 -- 172.21.15.52:0/1538354824 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad040035f0 con 0x7fad08100800 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad08197a70 con 0x7fad08100800 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7facfaffd640 1 -- 172.21.15.52:0/1538354824 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad04035030 con 0x7fad08100800 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.104+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad08197fa0 con 0x7fad08100800 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.105+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad08101f40 con 0x7fad08100800 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.106+0000 7facfaffd640 1 -- 172.21.15.52:0/1538354824 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fad04042070 con 0x7fad08100800 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.106+0000 7facfaffd640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facf40774b0 0x7facf4079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.107+0000 7fad0d1a9640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facf40774b0 0x7facf4079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.107+0000 7facfaffd640 1 -- 172.21.15.52:0/1538354824 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fad040ba130 con 0x7fad08100800 2024-09-06T15:11:01.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.107+0000 7fad0d1a9640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facf40774b0 0x7facf4079970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad08104f70 tx=0x7facfc005f90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:01.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.111+0000 7facfaffd640 1 -- 172.21.15.52:0/1538354824 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fad04083070 con 0x7fad08100800 2024-09-06T15:11:01.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.295+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7fad08109d80 con 0x7fad08100800 2024-09-06T15:11:01.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.295+0000 7facfaffd640 1 -- 172.21.15.52:0/1538354824 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v39) ==== 107+0+4462 (secure 0 0 0) 0x7fad040871e0 con 0x7fad08100800 2024-09-06T15:11:01.295 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:01.295 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":25,"btime":"2024-09-06T14:53:08:568222+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44293,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3871572907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3871572907},{"type":"v1","addr":"172.21.15.165:6825","nonce":3871572907}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:01.295 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 25 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facf40774b0 msgr2=0x7facf4079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facf40774b0 0x7facf4079970 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad08104f70 tx=0x7facfc005f90 comp rx=0 tx=0).stop 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08100800 msgr2=0x7fad0819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08100800 0x7fad0819d660 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fad04031460 tx=0x7fad04004530 comp rx=0 tx=0).stop 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 shutdown_connections 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7facf40774b0 0x7facf4079970 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fad08106800 0x7fad0819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 --2- 172.21.15.52:0/1538354824 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad08100800 0x7fad0819d660 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:01.297 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 >> 172.21.15.52:0/1538354824 conn(0x7fad080fc520 msgr2=0x7fad0806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:01.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 shutdown_connections 2024-09-06T15:11:01.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:01.297+0000 7fad0fc0e640 1 -- 172.21.15.52:0/1538354824 wait complete. 2024-09-06T15:11:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:01 smithi165 ceph-mon[82925]: pgmap v803: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:01.955 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:11:01.955 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-06T15:11:01.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 26 2024-09-06T15:11:02.215 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:02.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:02 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1538354824' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-06T15:11:02.335 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:02 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1538354824' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-06T15:11:02.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 -- 172.21.15.52:0/4162771249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940102b20 msgr2=0x7f9940102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:02.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 --2- 172.21.15.52:0/4162771249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940102b20 0x7f9940102f00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f99300098b0 tx=0x7f993002a560 comp rx=0 tx=0).stop 2024-09-06T15:11:02.700 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 -- 172.21.15.52:0/4162771249 shutdown_connections 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 --2- 172.21.15.52:0/4162771249 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9940103440 0x7f994010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 --2- 172.21.15.52:0/4162771249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940102b20 0x7f9940102f00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 -- 172.21.15.52:0/4162771249 >> 172.21.15.52:0/4162771249 conn(0x7f99400fc520 msgr2=0x7f99400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 -- 172.21.15.52:0/4162771249 shutdown_connections 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 -- 172.21.15.52:0/4162771249 wait complete. 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.665+0000 7f99448de640 1 Processor -- start 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f99448de640 1 -- start start 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f99448de640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9940102b20 0x7f9940100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f99448de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940103440 0x7f9940100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f99448de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f994010ee50 con 0x7f9940103440 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f99448de640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f994010ecd0 con 0x7f9940102b20 2024-09-06T15:11:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940103440 0x7f9940100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940103440 0x7f9940100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36332/0 (socket says 172.21.15.52:36332) 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993dd9b640 1 -- 172.21.15.52:0/3726272256 learned_addr learned my addr 172.21.15.52:0/3726272256 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993dd9b640 1 -- 172.21.15.52:0/3726272256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9940102b20 msgr2=0x7f9940100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993e59c640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9940102b20 0x7f9940100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993dd9b640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9940102b20 0x7f9940100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993dd9b640 1 -- 172.21.15.52:0/3726272256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9940101200 con 0x7f9940103440 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993e59c640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9940102b20 0x7f9940100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f993dd9b640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940103440 0x7f9940100cc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f992800b420 tx=0x7f992800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:02.702 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.666+0000 7f99377fe640 1 -- 172.21.15.52:0/3726272256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9928011630 con 0x7f9940103440 2024-09-06T15:11:02.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.667+0000 7f99377fe640 1 -- 172.21.15.52:0/3726272256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9928016070 con 0x7f9940103440 2024-09-06T15:11:02.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.667+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99401014f0 con 0x7f9940103440 2024-09-06T15:11:02.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.667+0000 7f99377fe640 1 -- 172.21.15.52:0/3726272256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9928010d40 con 0x7f9940103440 2024-09-06T15:11:02.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.667+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401a3ee0 con 0x7f9940103440 2024-09-06T15:11:02.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.668+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994006aa30 con 0x7f9940103440 2024-09-06T15:11:02.703 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.668+0000 7f99377fe640 1 -- 172.21.15.52:0/3726272256 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f992801b460 con 0x7f9940103440 2024-09-06T15:11:02.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.669+0000 7f99377fe640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f992c0774b0 0x7f992c079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:02.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.669+0000 7f99377fe640 1 -- 172.21.15.52:0/3726272256 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f9928098e90 con 0x7f9940103440 2024-09-06T15:11:02.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.669+0000 7f993e59c640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f992c0774b0 0x7f992c079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:02.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.669+0000 7f993e59c640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f992c0774b0 0x7f992c079970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9930006010 tx=0x7f99300095f0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:02.704 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.673+0000 7f99377fe640 1 -- 172.21.15.52:0/3726272256 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f9928021250 con 0x7f9940103440 2024-09-06T15:11:02.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.859+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f9940105f80 con 0x7f9940103440 2024-09-06T15:11:02.859 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.860+0000 7f99377fe640 1 -- 172.21.15.52:0/3726272256 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v39) ==== 107+0+5309 (secure 0 0 0) 0x7f9928061e70 con 0x7f9940103440 2024-09-06T15:11:02.860 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:02.860 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":26,"btime":"2024-09-06T14:53:12:578413+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44293,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3871572907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3871572907},{"type":"v1","addr":"172.21.15.165:6825","nonce":3871572907}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:02.860 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 26 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f992c0774b0 msgr2=0x7f992c079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f992c0774b0 0x7f992c079970 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9930006010 tx=0x7f99300095f0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940103440 msgr2=0x7f9940100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940103440 0x7f9940100cc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f992800b420 tx=0x7f992800b8e0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 shutdown_connections 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9940103440 0x7f9940100cc0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f992c0774b0 0x7f992c079970 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 --2- 172.21.15.52:0/3726272256 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9940102b20 0x7f9940100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 >> 172.21.15.52:0/3726272256 conn(0x7f99400fc520 msgr2=0x7f9940108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:02.862 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 shutdown_connections 2024-09-06T15:11:02.863 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:02.862+0000 7f99448de640 1 -- 172.21.15.52:0/3726272256 wait complete. 2024-09-06T15:11:03.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:03 smithi052 ceph-mon[112917]: pgmap v804: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:03.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:03 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3726272256' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-06T15:11:03.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:03 smithi165 ceph-mon[82925]: pgmap v804: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:03.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:03 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3726272256' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-06T15:11:03.518 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:11:03.518 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-06T15:11:03.518 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 27 2024-09-06T15:11:03.772 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/1886673804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 msgr2=0x7f4b2410dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/1886673804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2410dc00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009880 tx=0x7f4b1402a530 comp rx=0 tx=0).stop 2024-09-06T15:11:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/1886673804 shutdown_connections 2024-09-06T15:11:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/1886673804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2410dc00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/1886673804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b24074620 0x7f4b24074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/1886673804 >> 172.21.15.52:0/1886673804 conn(0x7f4b240fd5e0 msgr2=0x7f4b240ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:04.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/1886673804 shutdown_connections 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.230+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/1886673804 wait complete. 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b2b4ef640 1 Processor -- start 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b2b4ef640 1 -- start start 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b2b4ef640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b24074620 0x7f4b2419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b2b4ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b2b4ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b24110ff0 con 0x7f4b24074f40 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b2b4ef640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b24110e70 con 0x7f4b24074620 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b28a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b28a8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36344/0 (socket says 172.21.15.52:36344) 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b28a8a640 1 -- 172.21.15.52:0/31604599 learned_addr learned my addr 172.21.15.52:0/31604599 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:04.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.231+0000 7f4b2928b640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b24074620 0x7f4b2419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b28a8a640 1 -- 172.21.15.52:0/31604599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b24074620 msgr2=0x7f4b2419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b28a8a640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b24074620 0x7f4b2419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b28a8a640 1 -- 172.21.15.52:0/31604599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b24199a40 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b28a8a640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2419fdc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4b14031460 tx=0x7f4b140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b1a7fc640 1 -- 172.21.15.52:0/31604599 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b1403f070 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b1a7fc640 1 -- 172.21.15.52:0/31604599 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b140035f0 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b24199cd0 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b1a7fc640 1 -- 172.21.15.52:0/31604599 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b14035030 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.232+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2419a200 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.233+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b24075cd0 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.234+0000 7f4b1a7fc640 1 -- 172.21.15.52:0/31604599 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f4b14042070 con 0x7f4b24074f40 2024-09-06T15:11:04.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.234+0000 7f4b1a7fc640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4b10077460 0x7f4b10079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:04.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.235+0000 7f4b2928b640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4b10077460 0x7f4b10079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:04.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.235+0000 7f4b1a7fc640 1 -- 172.21.15.52:0/31604599 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f4b140ba0c0 con 0x7f4b24074f40 2024-09-06T15:11:04.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.235+0000 7f4b2928b640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4b10077460 0x7f4b10079920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4b2419ab80 tx=0x7f4b2000b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:04.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.239+0000 7f4b1a7fc640 1 -- 172.21.15.52:0/31604599 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f4b14087190 con 0x7f4b24074f40 2024-09-06T15:11:04.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.441+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f4b24108320 con 0x7f4b24074f40 2024-09-06T15:11:04.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.442+0000 7f4b1a7fc640 1 -- 172.21.15.52:0/31604599 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v39) ==== 107+0+4459 (secure 0 0 0) 0x7f4b1408bbb0 con 0x7f4b24074f40 2024-09-06T15:11:04.442 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:04.442 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"btime":"2024-09-06T14:53:25:082806+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:04.442 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 27 2024-09-06T15:11:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4b10077460 msgr2=0x7f4b10079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4b10077460 0x7f4b10079920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4b2419ab80 tx=0x7f4b2000b390 comp rx=0 tx=0).stop 2024-09-06T15:11:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 msgr2=0x7f4b2419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2419fdc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4b14031460 tx=0x7f4b140045e0 comp rx=0 tx=0).stop 2024-09-06T15:11:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 shutdown_connections 2024-09-06T15:11:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b24074f40 0x7f4b2419fdc0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:04.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f4b10077460 0x7f4b10079920 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:04.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 --2- 172.21.15.52:0/31604599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b24074620 0x7f4b2419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:04.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 >> 172.21.15.52:0/31604599 conn(0x7f4b240fd5e0 msgr2=0x7f4b2410b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:04.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.444+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 shutdown_connections 2024-09-06T15:11:04.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:04.445+0000 7f4b2b4ef640 1 -- 172.21.15.52:0/31604599 wait complete. 2024-09-06T15:11:05.065 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:11:05.065 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-06T15:11:05.065 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 28 2024-09-06T15:11:05.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:05 smithi165 ceph-mon[82925]: pgmap v805: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:05.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:05 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/31604599' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-06T15:11:05.328 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:05.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:05 smithi052 ceph-mon[112917]: pgmap v805: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:05.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:05 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/31604599' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-06T15:11:05.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 -- 172.21.15.52:0/503412634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20101900 msgr2=0x7f8a20101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 --2- 172.21.15.52:0/503412634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20101900 0x7f8a20101d60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8a14009880 tx=0x7f8a1402a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 -- 172.21.15.52:0/503412634 shutdown_connections 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 --2- 172.21.15.52:0/503412634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20101900 0x7f8a20101d60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 --2- 172.21.15.52:0/503412634 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a20107900 0x7f8a20107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 -- 172.21.15.52:0/503412634 >> 172.21.15.52:0/503412634 conn(0x7f8a200fd600 msgr2=0x7f8a200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 -- 172.21.15.52:0/503412634 shutdown_connections 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.757+0000 7f8a267fa640 1 -- 172.21.15.52:0/503412634 wait complete. 2024-09-06T15:11:05.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a267fa640 1 Processor -- start 2024-09-06T15:11:05.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a267fa640 1 -- start start 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a267fa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a20101900 0x7f8a2019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a267fa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20107900 0x7f8a2019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a267fa640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010edb0 con 0x7f8a20107900 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a267fa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2010ec30 con 0x7f8a20101900 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a1f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20107900 0x7f8a2019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a1f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20107900 0x7f8a2019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36366/0 (socket says 172.21.15.52:36366) 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.758+0000 7f8a1f7fe640 1 -- 172.21.15.52:0/4223866430 learned_addr learned my addr 172.21.15.52:0/4223866430 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1ffff640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a20101900 0x7f8a2019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1f7fe640 1 -- 172.21.15.52:0/4223866430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a20101900 msgr2=0x7f8a2019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:05.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1f7fe640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a20101900 0x7f8a2019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1f7fe640 1 -- 172.21.15.52:0/4223866430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a201977d0 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1f7fe640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20107900 0x7f8a2019db90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8a14031460 tx=0x7f8a140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1d7fa640 1 -- 172.21.15.52:0/4223866430 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a1403f070 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1d7fa640 1 -- 172.21.15.52:0/4223866430 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a14004cf0 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a20197a60 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a1d7fa640 1 -- 172.21.15.52:0/4223866430 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a14035030 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.759+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a20197f90 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.760+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a20103040 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.761+0000 7f8a1d7fa640 1 -- 172.21.15.52:0/4223866430 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f8a14042070 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.761+0000 7f8a1d7fa640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a08077460 0x7f8a08079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.761+0000 7f8a1d7fa640 1 -- 172.21.15.52:0/4223866430 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f8a140ba230 con 0x7f8a20107900 2024-09-06T15:11:05.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.761+0000 7f8a1ffff640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a08077460 0x7f8a08079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:05.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.762+0000 7f8a1ffff640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a08077460 0x7f8a08079920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a10005e10 tx=0x7f8a10005da0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:05.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.765+0000 7f8a1d7fa640 1 -- 172.21.15.52:0/4223866430 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f8a14083190 con 0x7f8a20107900 2024-09-06T15:11:05.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.946+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7f8a20198d00 con 0x7f8a20107900 2024-09-06T15:11:05.946 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.947+0000 7f8a1d7fa640 1 -- 172.21.15.52:0/4223866430 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v39) ==== 107+0+5309 (secure 0 0 0) 0x7f8a14087300 con 0x7f8a20107900 2024-09-06T15:11:05.947 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:05.947 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":28,"btime":"2024-09-06T14:53:29:088340+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44283,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/3987199510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":3987199510},{"type":"v1","addr":"172.21.15.165:6827","nonce":3987199510}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:05.947 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 28 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a08077460 msgr2=0x7f8a08079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a08077460 0x7f8a08079920 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a10005e10 tx=0x7f8a10005da0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20107900 msgr2=0x7f8a2019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20107900 0x7f8a2019db90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8a14031460 tx=0x7f8a140048f0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 shutdown_connections 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a20107900 0x7f8a2019db90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f8a08077460 0x7f8a08079920 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 --2- 172.21.15.52:0/4223866430 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8a20101900 0x7f8a2019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 >> 172.21.15.52:0/4223866430 conn(0x7f8a200fd600 msgr2=0x7f8a200fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 shutdown_connections 2024-09-06T15:11:05.949 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:05.949+0000 7f8a267fa640 1 -- 172.21.15.52:0/4223866430 wait complete. 2024-09-06T15:11:06.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:06 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/4223866430' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-06T15:11:06.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:06 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/4223866430' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-06T15:11:06.610 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:11:06.611 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-06T15:11:06.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 29 2024-09-06T15:11:06.871 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:07.273 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:07 smithi052 ceph-mon[112917]: pgmap v806: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:07 smithi165 ceph-mon[82925]: pgmap v806: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 -- 172.21.15.52:0/3544843871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1008b0 msgr2=0x7f30dc100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 --2- 172.21.15.52:0/3544843871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1008b0 0x7f30dc100c90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009880 tx=0x7f30d402a530 comp rx=0 tx=0).stop 2024-09-06T15:11:07.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 -- 172.21.15.52:0/3544843871 shutdown_connections 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 --2- 172.21.15.52:0/3544843871 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc1011d0 0x7f30dc1056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 --2- 172.21.15.52:0/3544843871 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1008b0 0x7f30dc100c90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 -- 172.21.15.52:0/3544843871 >> 172.21.15.52:0/3544843871 conn(0x7f30dc0fc520 msgr2=0x7f30dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 -- 172.21.15.52:0/3544843871 shutdown_connections 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.355+0000 7f30e3279640 1 -- 172.21.15.52:0/3544843871 wait complete. 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e3279640 1 Processor -- start 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e3279640 1 -- start start 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e3279640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc1008b0 0x7f30dc19dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e3279640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1011d0 0x7f30dc19e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e3279640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc1153f0 con 0x7f30dc1011d0 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e3279640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc115270 con 0x7f30dc1008b0 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e0814640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1011d0 0x7f30dc19e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:07.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e0814640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1011d0 0x7f30dc19e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36390/0 (socket says 172.21.15.52:36390) 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e0814640 1 -- 172.21.15.52:0/1313891168 learned_addr learned my addr 172.21.15.52:0/1313891168 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.356+0000 7f30e1015640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc1008b0 0x7f30dc19dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30e0814640 1 -- 172.21.15.52:0/1313891168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc1008b0 msgr2=0x7f30dc19dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30e0814640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc1008b0 0x7f30dc19dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30e0814640 1 -- 172.21.15.52:0/1313891168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc1a2880 con 0x7f30dc1011d0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30e0814640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1011d0 0x7f30dc19e4f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f30d000d6d0 tx=0x7f30d000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30da7fc640 1 -- 172.21.15.52:0/1313891168 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30d0017070 con 0x7f30dc1011d0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc1a2b70 con 0x7f30dc1011d0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30da7fc640 1 -- 172.21.15.52:0/1313891168 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30d00054e0 con 0x7f30dc1011d0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30da7fc640 1 -- 172.21.15.52:0/1313891168 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30d0004ae0 con 0x7f30dc1011d0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.357+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc1a3100 con 0x7f30dc1011d0 2024-09-06T15:11:07.392 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.358+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc06aa90 con 0x7f30dc1011d0 2024-09-06T15:11:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.359+0000 7f30da7fc640 1 -- 172.21.15.52:0/1313891168 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f30d0004de0 con 0x7f30dc1011d0 2024-09-06T15:11:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.359+0000 7f30da7fc640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f30c4077460 0x7f30c4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.359+0000 7f30da7fc640 1 -- 172.21.15.52:0/1313891168 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f30d0099400 con 0x7f30dc1011d0 2024-09-06T15:11:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.359+0000 7f30e1015640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f30c4077460 0x7f30c4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.360+0000 7f30e1015640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f30c4077460 0x7f30c4079920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f30d40096c0 tx=0x7f30d4031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:07.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.363+0000 7f30da7fc640 1 -- 172.21.15.52:0/1313891168 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f30d0062360 con 0x7f30dc1011d0 2024-09-06T15:11:07.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.547+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f30dc102d70 con 0x7f30dc1011d0 2024-09-06T15:11:07.548 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.548+0000 7f30da7fc640 1 -- 172.21.15.52:0/1313891168 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v39) ==== 107+0+4459 (secure 0 0 0) 0x7f30d00664d0 con 0x7f30dc1011d0 2024-09-06T15:11:07.548 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:07.548 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":29,"btime":"2024-09-06T14:53:38:490525+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:07.548 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 29 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f30c4077460 msgr2=0x7f30c4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f30c4077460 0x7f30c4079920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f30d40096c0 tx=0x7f30d4031400 comp rx=0 tx=0).stop 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1011d0 msgr2=0x7f30dc19e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1011d0 0x7f30dc19e4f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f30d000d6d0 tx=0x7f30d000db90 comp rx=0 tx=0).stop 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 shutdown_connections 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30dc1011d0 0x7f30dc19e4f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f30c4077460 0x7f30c4079920 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 --2- 172.21.15.52:0/1313891168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30dc1008b0 0x7f30dc19dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 >> 172.21.15.52:0/1313891168 conn(0x7f30dc0fc520 msgr2=0x7f30dc112ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 shutdown_connections 2024-09-06T15:11:07.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:07.550+0000 7f30e3279640 1 -- 172.21.15.52:0/1313891168 wait complete. 2024-09-06T15:11:08.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:08 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1313891168' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-06T15:11:08.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:08.165 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:11:08.165 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-06T15:11:08.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 30 2024-09-06T15:11:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:08 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1313891168' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-06T15:11:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:08.421 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:08.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.871+0000 7fd0f8308640 1 -- 172.21.15.52:0/2775953791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f00ffea0 msgr2=0x7fd0f0100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:08.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.871+0000 7fd0f8308640 1 --2- 172.21.15.52:0/2775953791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f00ffea0 0x7fd0f0100300 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009880 tx=0x7fd0e002a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:08.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 -- 172.21.15.52:0/2775953791 shutdown_connections 2024-09-06T15:11:08.889 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 --2- 172.21.15.52:0/2775953791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f00ffea0 0x7fd0f0100300 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 --2- 172.21.15.52:0/2775953791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0f0106970 0x7fd0f0106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 -- 172.21.15.52:0/2775953791 >> 172.21.15.52:0/2775953791 conn(0x7fd0f00fbc90 msgr2=0x7fd0f00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 -- 172.21.15.52:0/2775953791 shutdown_connections 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 -- 172.21.15.52:0/2775953791 wait complete. 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 Processor -- start 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 -- start start 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0f00ffea0 0x7fd0f0101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f0106970 0x7fd0f01015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f010ef50 con 0x7fd0f0106970 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.872+0000 7fd0f8308640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f010edd0 con 0x7fd0f00ffea0 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f58a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f0106970 0x7fd0f01015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:08.890 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f58a3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f0106970 0x7fd0f01015c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36396/0 (socket says 172.21.15.52:36396) 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f58a3640 1 -- 172.21.15.52:0/3488925728 learned_addr learned my addr 172.21.15.52:0/3488925728 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f60a4640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0f00ffea0 0x7fd0f0101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f58a3640 1 -- 172.21.15.52:0/3488925728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0f00ffea0 msgr2=0x7fd0f0101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f58a3640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0f00ffea0 0x7fd0f0101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f58a3640 1 -- 172.21.15.52:0/3488925728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f0101b00 con 0x7fd0f0106970 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f58a3640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f0106970 0x7fd0f01015c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0031460 tx=0x7fd0e00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3488925728 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0e003f070 con 0x7fd0f0106970 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3488925728 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0e00035f0 con 0x7fd0f0106970 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f0101d90 con 0x7fd0f0106970 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3488925728 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0e0035030 con 0x7fd0f0106970 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.873+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f01a3ee0 con 0x7fd0f0106970 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.874+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f01031c0 con 0x7fd0f0106970 2024-09-06T15:11:08.891 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.875+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3488925728 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd0e0042070 con 0x7fd0f0106970 2024-09-06T15:11:08.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.875+0000 7fd0e77fe640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd0dc077460 0x7fd0dc079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:08.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.875+0000 7fd0f60a4640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd0dc077460 0x7fd0dc079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:08.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.875+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3488925728 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd0e00ba170 con 0x7fd0f0106970 2024-09-06T15:11:08.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.876+0000 7fd0f60a4640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd0dc077460 0x7fd0dc079920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec005fd0 tx=0x7fd0ec005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:08.892 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:08.879+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3488925728 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd0e00830d0 con 0x7fd0f0106970 2024-09-06T15:11:09.062 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.063+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7fd0f01025b0 con 0x7fd0f0106970 2024-09-06T15:11:09.063 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:09 smithi052 ceph-mon[112917]: pgmap v807: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:09.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.063+0000 7fd0e77fe640 1 -- 172.21.15.52:0/3488925728 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v39) ==== 107+0+5309 (secure 0 0 0) 0x7fd0e0087240 con 0x7fd0f0106970 2024-09-06T15:11:09.063 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:09.064 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":30,"btime":"2024-09-06T14:53:44:505929+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T14:52:46.620986+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:09.064 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 30 2024-09-06T15:11:09.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd0dc077460 msgr2=0x7fd0dc079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:09.065 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd0dc077460 0x7fd0dc079920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec005fd0 tx=0x7fd0ec005850 comp rx=0 tx=0).stop 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f0106970 msgr2=0x7fd0f01015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f0106970 0x7fd0f01015c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0031460 tx=0x7fd0e00045e0 comp rx=0 tx=0).stop 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 shutdown_connections 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd0f0106970 0x7fd0f01015c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd0dc077460 0x7fd0dc079920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 --2- 172.21.15.52:0/3488925728 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd0f00ffea0 0x7fd0f0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 >> 172.21.15.52:0/3488925728 conn(0x7fd0f00fbc90 msgr2=0x7fd0f00fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 shutdown_connections 2024-09-06T15:11:09.066 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:09.066+0000 7fd0f8308640 1 -- 172.21.15.52:0/3488925728 wait complete. 2024-09-06T15:11:09.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:09 smithi165 ceph-mon[82925]: pgmap v807: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:09.763 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-06T15:11:09.764 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-06T15:11:09.764 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 31 2024-09-06T15:11:10.028 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:10 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3488925728' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-06T15:11:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:10.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:11:10.372 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:10 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3488925728' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-06T15:11:10.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:11:10.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:11:10.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:11:10.373 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.455+0000 7f2505999640 1 -- 172.21.15.52:0/1687181366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 msgr2=0x7f2500102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.455+0000 7f2505999640 1 --2- 172.21.15.52:0/1687181366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f2500102f50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009880 tx=0x7f24f002a530 comp rx=0 tx=0).stop 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.455+0000 7f2505999640 1 -- 172.21.15.52:0/1687181366 shutdown_connections 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.455+0000 7f2505999640 1 --2- 172.21.15.52:0/1687181366 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2500103490 0x7f250010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.455+0000 7f2505999640 1 --2- 172.21.15.52:0/1687181366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f2500102f50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.455+0000 7f2505999640 1 -- 172.21.15.52:0/1687181366 >> 172.21.15.52:0/1687181366 conn(0x7f25000fc550 msgr2=0x7f25000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 -- 172.21.15.52:0/1687181366 shutdown_connections 2024-09-06T15:11:10.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 -- 172.21.15.52:0/1687181366 wait complete. 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 Processor -- start 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 -- start start 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f250019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2500103490 0x7f250019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f250010ede0 con 0x7f2500102b70 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.456+0000 7f2505999640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f250010ec60 con 0x7f2500103490 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24feffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f250019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24feffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f250019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39478/0 (socket says 172.21.15.52:39478) 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24feffd640 1 -- 172.21.15.52:0/218684837 learned_addr learned my addr 172.21.15.52:0/218684837 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24fe7fc640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2500103490 0x7f250019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24feffd640 1 -- 172.21.15.52:0/218684837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2500103490 msgr2=0x7f250019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24feffd640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2500103490 0x7f250019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:10.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24feffd640 1 -- 172.21.15.52:0/218684837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25001977b0 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f24feffd640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f250019d630 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f24f0004f90 tx=0x7f24f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f2504997640 1 -- 172.21.15.52:0/218684837 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24f003f070 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2500197a40 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f2504997640 1 -- 172.21.15.52:0/218684837 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24f0004c70 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f2504997640 1 -- 172.21.15.52:0/218684837 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24f0035030 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.457+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2500197f70 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.459+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250006a4c0 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.459+0000 7f2504997640 1 -- 172.21.15.52:0/218684837 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f24f0042070 con 0x7f2500102b70 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.459+0000 7f2504997640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24e8077460 0x7f24e8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:10.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.459+0000 7f2504997640 1 -- 172.21.15.52:0/218684837 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f24f00ba0e0 con 0x7f2500102b70 2024-09-06T15:11:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.459+0000 7f24fe7fc640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24e8077460 0x7f24e8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.460+0000 7f24fe7fc640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24e8077460 0x7f24e8079920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2500108940 tx=0x7f24f400b390 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:10.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.463+0000 7f2504997640 1 -- 172.21.15.52:0/218684837 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f24f00871b0 con 0x7f2500102b70 2024-09-06T15:11:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.647+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f2500105fd0 con 0x7f2500102b70 2024-09-06T15:11:10.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.648+0000 7f2504997640 1 -- 172.21.15.52:0/218684837 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v39) ==== 107+0+5308 (secure 0 0 0) 0x7f24f008bbd0 con 0x7f2500102b70 2024-09-06T15:11:10.648 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:10.648 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":31,"btime":"2024-09-06T15:08:45:218313+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:44.221354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:10.648 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 31 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24e8077460 msgr2=0x7f24e8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24e8077460 0x7f24e8079920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2500108940 tx=0x7f24f400b390 comp rx=0 tx=0).stop 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 msgr2=0x7f250019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f250019d630 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f24f0004f90 tx=0x7f24f00048f0 comp rx=0 tx=0).stop 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 shutdown_connections 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f24e8077460 0x7f24e8079920 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2500103490 0x7f250019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 --2- 172.21.15.52:0/218684837 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2500102b70 0x7f250019d630 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 >> 172.21.15.52:0/218684837 conn(0x7f25000fc550 msgr2=0x7f2500108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 shutdown_connections 2024-09-06T15:11:10.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:10.650+0000 7f2505999640 1 -- 172.21.15.52:0/218684837 wait complete. 2024-09-06T15:11:11.290 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-06T15:11:11.290 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 32 2024-09-06T15:11:11.313 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:11 smithi052 ceph-mon[112917]: pgmap v808: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:11.313 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:11 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/218684837' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-06T15:11:11.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:11 smithi165 ceph-mon[82925]: pgmap v808: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:11.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:11 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/218684837' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-06T15:11:11.546 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:11.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.970+0000 7f7282409640 1 -- 172.21.15.52:0/564627346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 msgr2=0x7f727c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:11.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.970+0000 7f7282409640 1 --2- 172.21.15.52:0/564627346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c107ce0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f726c009880 tx=0x7f726c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:11.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.970+0000 7f7282409640 1 -- 172.21.15.52:0/564627346 shutdown_connections 2024-09-06T15:11:11.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.970+0000 7f7282409640 1 --2- 172.21.15.52:0/564627346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f727c101900 0x7f727c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:11.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.970+0000 7f7282409640 1 --2- 172.21.15.52:0/564627346 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c107ce0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:11.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.970+0000 7f7282409640 1 -- 172.21.15.52:0/564627346 >> 172.21.15.52:0/564627346 conn(0x7f727c0fd600 msgr2=0x7f727c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:11.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.970+0000 7f7282409640 1 -- 172.21.15.52:0/564627346 shutdown_connections 2024-09-06T15:11:11.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.971+0000 7f7282409640 1 -- 172.21.15.52:0/564627346 wait complete. 2024-09-06T15:11:11.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.971+0000 7f7282409640 1 Processor -- start 2024-09-06T15:11:11.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.971+0000 7f7282409640 1 -- start start 2024-09-06T15:11:11.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.971+0000 7f7282409640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f727c101900 0x7f727c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:11.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.971+0000 7f7282409640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:11.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.971+0000 7f7282409640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f727c10ee30 con 0x7f727c107900 2024-09-06T15:11:11.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.971+0000 7f7282409640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f727c10ecb0 con 0x7f727c101900 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c19dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39506/0 (socket says 172.21.15.52:39506) 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727b7fe640 1 -- 172.21.15.52:0/2016167577 learned_addr learned my addr 172.21.15.52:0/2016167577 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727bfff640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f727c101900 0x7f727c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727b7fe640 1 -- 172.21.15.52:0/2016167577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f727c101900 msgr2=0x7f727c19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727b7fe640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f727c101900 0x7f727c19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727b7fe640 1 -- 172.21.15.52:0/2016167577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727c197810 con 0x7f727c107900 2024-09-06T15:11:11.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f727b7fe640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c19dbd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f727000b420 tx=0x7f727000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:11.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f72797fa640 1 -- 172.21.15.52:0/2016167577 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7270011630 con 0x7f727c107900 2024-09-06T15:11:11.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f72797fa640 1 -- 172.21.15.52:0/2016167577 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7270016070 con 0x7f727c107900 2024-09-06T15:11:11.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f72797fa640 1 -- 172.21.15.52:0/2016167577 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7270010d40 con 0x7f727c107900 2024-09-06T15:11:11.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727c197b00 con 0x7f727c107900 2024-09-06T15:11:11.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.972+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727c198090 con 0x7f727c107900 2024-09-06T15:11:11.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.973+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727c103040 con 0x7f727c107900 2024-09-06T15:11:11.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.974+0000 7f72797fa640 1 -- 172.21.15.52:0/2016167577 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f727001b460 con 0x7f727c107900 2024-09-06T15:11:11.976 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.975+0000 7f72797fa640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7264077460 0x7f7264079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:11.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.975+0000 7f727bfff640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7264077460 0x7f7264079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:11.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.975+0000 7f72797fa640 1 -- 172.21.15.52:0/2016167577 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f7270098fe0 con 0x7f727c107900 2024-09-06T15:11:11.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.975+0000 7f727bfff640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7264077460 0x7f7264079920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f726c0096c0 tx=0x7f726c031400 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:11.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:11.979+0000 7f72797fa640 1 -- 172.21.15.52:0/2016167577 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f7270021250 con 0x7f727c107900 2024-09-06T15:11:12.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.164+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f727c109e70 con 0x7f727c107900 2024-09-06T15:11:12.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.164+0000 7f72797fa640 1 -- 172.21.15.52:0/2016167577 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v39) ==== 107+0+5331 (secure 0 0 0) 0x7f7270061ea0 con 0x7f727c107900 2024-09-06T15:11:12.164 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:12.164 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":32,"btime":"2024-09-06T15:08:45:222438+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:45.222425+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:12.165 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 32 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7264077460 msgr2=0x7f7264079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7264077460 0x7f7264079920 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f726c0096c0 tx=0x7f726c031400 comp rx=0 tx=0).stop 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 msgr2=0x7f727c19dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c19dbd0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f727000b420 tx=0x7f727000b8e0 comp rx=0 tx=0).stop 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 shutdown_connections 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f727c107900 0x7f727c19dbd0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7264077460 0x7f7264079920 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 --2- 172.21.15.52:0/2016167577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f727c101900 0x7f727c19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:12.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 >> 172.21.15.52:0/2016167577 conn(0x7f727c0fd600 msgr2=0x7f727c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:12.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 shutdown_connections 2024-09-06T15:11:12.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:12.166+0000 7f7282409640 1 -- 172.21.15.52:0/2016167577 wait complete. 2024-09-06T15:11:12.798 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-06T15:11:12.798 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 33 2024-09-06T15:11:13.098 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:13.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:13 smithi165 ceph-mon[82925]: pgmap v809: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:13.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:13 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2016167577' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-06T15:11:13.328 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:13 smithi052 ceph-mon[112917]: pgmap v809: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:13.328 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:13 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2016167577' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-06T15:11:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.528+0000 7f1f747ef640 1 -- 172.21.15.52:0/3840809992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 msgr2=0x7f1f6c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.528+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3840809992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c10b8d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009880 tx=0x7f1f6802a530 comp rx=0 tx=0).stop 2024-09-06T15:11:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.528+0000 7f1f747ef640 1 -- 172.21.15.52:0/3840809992 shutdown_connections 2024-09-06T15:11:13.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.528+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3840809992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c10b8d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.528+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3840809992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f6c102ac0 0x7f1f6c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.528+0000 7f1f747ef640 1 -- 172.21.15.52:0/3840809992 >> 172.21.15.52:0/3840809992 conn(0x7f1f6c0fc520 msgr2=0x7f1f6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 -- 172.21.15.52:0/3840809992 shutdown_connections 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 -- 172.21.15.52:0/3840809992 wait complete. 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 Processor -- start 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 -- start start 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f6c102ac0 0x7f1f6c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c10edf0 con 0x7f1f6c1033e0 2024-09-06T15:11:13.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f747ef640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c10ec70 con 0x7f1f6c102ac0 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.529+0000 7f1f71d8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f71d8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39512/0 (socket says 172.21.15.52:39512) 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f71d8a640 1 -- 172.21.15.52:0/3018025929 learned_addr learned my addr 172.21.15.52:0/3018025929 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f7258b640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f6c102ac0 0x7f1f6c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f71d8a640 1 -- 172.21.15.52:0/3018025929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f6c102ac0 msgr2=0x7f1f6c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f71d8a640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f6c102ac0 0x7f1f6c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f71d8a640 1 -- 172.21.15.52:0/3018025929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c197820 con 0x7f1f6c1033e0 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f7258b640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f6c102ac0 0x7f1f6c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f71d8a640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c19dbe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1f68031460 tx=0x7f1f68004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:13.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f637fe640 1 -- 172.21.15.52:0/3018025929 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f6803f070 con 0x7f1f6c1033e0 2024-09-06T15:11:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f637fe640 1 -- 172.21.15.52:0/3018025929 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f680035f0 con 0x7f1f6c1033e0 2024-09-06T15:11:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c197ab0 con 0x7f1f6c1033e0 2024-09-06T15:11:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c197fe0 con 0x7f1f6c1033e0 2024-09-06T15:11:13.533 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.530+0000 7f1f637fe640 1 -- 172.21.15.52:0/3018025929 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f68035030 con 0x7f1f6c1033e0 2024-09-06T15:11:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.531+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6c06aa90 con 0x7f1f6c1033e0 2024-09-06T15:11:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.532+0000 7f1f637fe640 1 -- 172.21.15.52:0/3018025929 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f1f68042070 con 0x7f1f6c1033e0 2024-09-06T15:11:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.532+0000 7f1f637fe640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f58077460 0x7f1f58079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:13.534 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.532+0000 7f1f637fe640 1 -- 172.21.15.52:0/3018025929 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f1f680ba140 con 0x7f1f6c1033e0 2024-09-06T15:11:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.532+0000 7f1f7258b640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f58077460 0x7f1f58079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:13.535 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.533+0000 7f1f7258b640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f58077460 0x7f1f58079920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0058c0 tx=0x7f1f5c005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:13.536 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.536+0000 7f1f637fe640 1 -- 172.21.15.52:0/3018025929 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f1f680830a0 con 0x7f1f6c1033e0 2024-09-06T15:11:13.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.719+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f1f6c198d50 con 0x7f1f6c1033e0 2024-09-06T15:11:13.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.719+0000 7f1f637fe640 1 -- 172.21.15.52:0/3018025929 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v39) ==== 107+0+5333 (secure 0 0 0) 0x7f1f68087210 con 0x7f1f6c1033e0 2024-09-06T15:11:13.720 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:13.720 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":33,"btime":"2024-09-06T15:08:46:224215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:45.234033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:resolve","state_seq":235,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:13.720 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 33 2024-09-06T15:11:13.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f58077460 msgr2=0x7f1f58079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:13.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f58077460 0x7f1f58079920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0058c0 tx=0x7f1f5c005850 comp rx=0 tx=0).stop 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 msgr2=0x7f1f6c19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c19dbe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1f68031460 tx=0x7f1f68004530 comp rx=0 tx=0).stop 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 shutdown_connections 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1f6c1033e0 0x7f1f6c19dbe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f1f58077460 0x7f1f58079920 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 --2- 172.21.15.52:0/3018025929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f6c102ac0 0x7f1f6c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.721+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 >> 172.21.15.52:0/3018025929 conn(0x7f1f6c0fc520 msgr2=0x7f1f6c108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.722+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 shutdown_connections 2024-09-06T15:11:13.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:13.722+0000 7f1f747ef640 1 -- 172.21.15.52:0/3018025929 wait complete. 2024-09-06T15:11:14.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:14 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3018025929' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-06T15:11:14.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:14 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3018025929' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-06T15:11:14.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 34 2024-09-06T15:11:14.690 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:15.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:15 smithi052 ceph-mon[112917]: pgmap v810: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 -- 172.21.15.52:0/57242729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 msgr2=0x7f45b8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/57242729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b8106be0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009880 tx=0x7f45ac02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 -- 172.21.15.52:0/57242729 shutdown_connections 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/57242729 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b8100800 0x7f45b8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/57242729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b8106be0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 -- 172.21.15.52:0/57242729 >> 172.21.15.52:0/57242729 conn(0x7f45b80fc520 msgr2=0x7f45b80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 -- 172.21.15.52:0/57242729 shutdown_connections 2024-09-06T15:11:15.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.128+0000 7f45bf6b9640 1 -- 172.21.15.52:0/57242729 wait complete. 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bf6b9640 1 Processor -- start 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bf6b9640 1 -- start start 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bf6b9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b8100800 0x7f45b819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bf6b9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bf6b9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f45b810dd30 con 0x7f45b8106800 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bf6b9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f45b810dbb0 con 0x7f45b8100800 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bcc54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bcc54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b819cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39542/0 (socket says 172.21.15.52:39542) 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bcc54640 1 -- 172.21.15.52:0/334440603 learned_addr learned my addr 172.21.15.52:0/334440603 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:15.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bcc54640 1 -- 172.21.15.52:0/334440603 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b8100800 msgr2=0x7f45b819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bcc54640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b8100800 0x7f45b819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bcc54640 1 -- 172.21.15.52:0/334440603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b8196730 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.129+0000 7f45bcc54640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b819cba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f45b400d910 tx=0x7f45b400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.130+0000 7f45aa7fc640 1 -- 172.21.15.52:0/334440603 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45b401b070 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.130+0000 7f45aa7fc640 1 -- 172.21.15.52:0/334440603 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45b400eb70 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.130+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b81969c0 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.130+0000 7f45aa7fc640 1 -- 172.21.15.52:0/334440603 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45b4014600 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.130+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b8196f20 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.131+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b8101f40 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.131+0000 7f45aa7fc640 1 -- 172.21.15.52:0/334440603 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f45b401e070 con 0x7f45b8106800 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.132+0000 7f45aa7fc640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f45a4077460 0x7f45a4079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:15.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.132+0000 7f45bd455640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f45a4077460 0x7f45a4079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.132+0000 7f45aa7fc640 1 -- 172.21.15.52:0/334440603 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f45b409af90 con 0x7f45b8106800 2024-09-06T15:11:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.132+0000 7f45bd455640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f45a4077460 0x7f45a4079920 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0096c0 tx=0x7f45ac000bc0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:15.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.136+0000 7f45aa7fc640 1 -- 172.21.15.52:0/334440603 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f45b4068060 con 0x7f45b8106800 2024-09-06T15:11:15.318 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.319+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7f45b8197230 con 0x7f45b8106800 2024-09-06T15:11:15.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.319+0000 7f45aa7fc640 1 -- 172.21.15.52:0/334440603 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v39) ==== 107+0+5336 (secure 0 0 0) 0x7f45b406c3a0 con 0x7f45b8106800 2024-09-06T15:11:15.319 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:15.319 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":34,"btime":"2024-09-06T15:08:54:288620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:53.616944+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:resolve","state_seq":241,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:resolve","state_seq":235,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:15.319 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 34 2024-09-06T15:11:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f45a4077460 msgr2=0x7f45a4079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f45a4077460 0x7f45a4079920 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0096c0 tx=0x7f45ac000bc0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 msgr2=0x7f45b819cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b819cba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f45b400d910 tx=0x7f45b400ddd0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 shutdown_connections 2024-09-06T15:11:15.321 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45b8106800 0x7f45b819cba0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f45a4077460 0x7f45a4079920 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 --2- 172.21.15.52:0/334440603 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f45b8100800 0x7f45b819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.321+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 >> 172.21.15.52:0/334440603 conn(0x7f45b80fc520 msgr2=0x7f45b80fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.322+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 shutdown_connections 2024-09-06T15:11:15.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:15.322+0000 7f45bf6b9640 1 -- 172.21.15.52:0/334440603 wait complete. 2024-09-06T15:11:15.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:15 smithi165 ceph-mon[82925]: pgmap v810: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:15.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 35 2024-09-06T15:11:16.218 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:16 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/334440603' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-06T15:11:16.221 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:16.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:16 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/334440603' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- 172.21.15.52:0/542042907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c107900 msgr2=0x7fb46c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 --2- 172.21.15.52:0/542042907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c107900 0x7fb46c107ce0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009880 tx=0x7fb45c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- 172.21.15.52:0/542042907 shutdown_connections 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 --2- 172.21.15.52:0/542042907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c101900 0x7fb46c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 --2- 172.21.15.52:0/542042907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c107900 0x7fb46c107ce0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- 172.21.15.52:0/542042907 >> 172.21.15.52:0/542042907 conn(0x7fb46c0fd600 msgr2=0x7fb46c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- 172.21.15.52:0/542042907 shutdown_connections 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- 172.21.15.52:0/542042907 wait complete. 2024-09-06T15:11:16.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 Processor -- start 2024-09-06T15:11:16.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- start start 2024-09-06T15:11:16.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c101900 0x7fb46c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:16.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c107900 0x7fb46c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:16.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c10edd0 con 0x7fb46c101900 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.677+0000 7fb4730ee640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb46c10ec50 con 0x7fb46c107900 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb470e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c101900 0x7fb46c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb470e8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c101900 0x7fb46c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39550/0 (socket says 172.21.15.52:39550) 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb470e8a640 1 -- 172.21.15.52:0/3359519647 learned_addr learned my addr 172.21.15.52:0/3359519647 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb46bfff640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c107900 0x7fb46c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb470e8a640 1 -- 172.21.15.52:0/3359519647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c107900 msgr2=0x7fb46c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb470e8a640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c107900 0x7fb46c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb470e8a640 1 -- 172.21.15.52:0/3359519647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46c1977c0 con 0x7fb46c101900 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb470e8a640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c101900 0x7fb46c19d640 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb45c031460 tx=0x7fb45c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb469ffb640 1 -- 172.21.15.52:0/3359519647 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb45c03f070 con 0x7fb46c101900 2024-09-06T15:11:16.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb469ffb640 1 -- 172.21.15.52:0/3359519647 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb45c0035f0 con 0x7fb46c101900 2024-09-06T15:11:16.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46c197a50 con 0x7fb46c101900 2024-09-06T15:11:16.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.678+0000 7fb469ffb640 1 -- 172.21.15.52:0/3359519647 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb45c035030 con 0x7fb46c101900 2024-09-06T15:11:16.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.679+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46c197f80 con 0x7fb46c101900 2024-09-06T15:11:16.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.680+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46c103040 con 0x7fb46c101900 2024-09-06T15:11:16.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.680+0000 7fb469ffb640 1 -- 172.21.15.52:0/3359519647 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb45c042070 con 0x7fb46c101900 2024-09-06T15:11:16.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.681+0000 7fb469ffb640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:16.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.681+0000 7fb469ffb640 1 -- 172.21.15.52:0/3359519647 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fb45c0ba210 con 0x7fb46c101900 2024-09-06T15:11:16.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.681+0000 7fb46bfff640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:16.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.681+0000 7fb46bfff640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb460005fd0 tx=0x7fb460005850 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:16.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.685+0000 7fb469ffb640 1 -- 172.21.15.52:0/3359519647 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb45c0830d0 con 0x7fb46c101900 2024-09-06T15:11:16.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.868+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7fb46c109e70 con 0x7fb46c101900 2024-09-06T15:11:16.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.868+0000 7fb469ffb640 1 -- 172.21.15.52:0/3359519647 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v39) ==== 107+0+5340 (secure 0 0 0) 0x7fb45c087240 con 0x7fb46c101900 2024-09-06T15:11:16.868 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:16.869 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":35,"btime":"2024-09-06T15:08:55:293085+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:54.349722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":242,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:reconnect","state_seq":238,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:16.869 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 35 2024-09-06T15:11:16.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 msgr2=0x7fb454079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:16.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb460005fd0 tx=0x7fb460005850 comp rx=0 tx=0).stop 2024-09-06T15:11:16.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c101900 msgr2=0x7fb46c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:16.870 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c101900 0x7fb46c19d640 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb45c031460 tx=0x7fb45c0045e0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 shutdown_connections 2024-09-06T15:11:16.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb454077460 0x7fb454079920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb46c107900 0x7fb46c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 --2- 172.21.15.52:0/3359519647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb46c101900 0x7fb46c19d640 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:16.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 >> 172.21.15.52:0/3359519647 conn(0x7fb46c0fd600 msgr2=0x7fb46c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:16.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 shutdown_connections 2024-09-06T15:11:16.871 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:16.870+0000 7fb4730ee640 1 -- 172.21.15.52:0/3359519647 wait complete. 2024-09-06T15:11:17.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:17 smithi052 ceph-mon[112917]: pgmap v811: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:17.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:17 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3359519647' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-06T15:11:17.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:17 smithi165 ceph-mon[82925]: pgmap v811: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:17.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:17 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3359519647' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-06T15:11:17.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 36 2024-09-06T15:11:17.737 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:18.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.176+0000 7fb6658f8640 1 -- 172.21.15.52:0/3378901876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660106860 msgr2=0x7fb660106c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:18.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.176+0000 7fb6658f8640 1 --2- 172.21.15.52:0/3378901876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660106860 0x7fb660106c40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb650009c20 tx=0x7fb65002a970 comp rx=0 tx=0).stop 2024-09-06T15:11:18.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.176+0000 7fb6658f8640 1 -- 172.21.15.52:0/3378901876 shutdown_connections 2024-09-06T15:11:18.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.176+0000 7fb6658f8640 1 --2- 172.21.15.52:0/3378901876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb660100860 0x7fb660100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.176+0000 7fb6658f8640 1 --2- 172.21.15.52:0/3378901876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660106860 0x7fb660106c40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.176+0000 7fb6658f8640 1 -- 172.21.15.52:0/3378901876 >> 172.21.15.52:0/3378901876 conn(0x7fb6600fc580 msgr2=0x7fb6600fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.177+0000 7fb6658f8640 1 -- 172.21.15.52:0/3378901876 shutdown_connections 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.177+0000 7fb6658f8640 1 -- 172.21.15.52:0/3378901876 wait complete. 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.177+0000 7fb6658f8640 1 Processor -- start 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.177+0000 7fb6658f8640 1 -- start start 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6658f8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660100860 0x7fb66019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6658f8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb660106860 0x7fb66019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6658f8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb66010ee30 con 0x7fb660100860 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6658f8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb66010ecb0 con 0x7fb660106860 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660100860 0x7fb66019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65effd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660100860 0x7fb66019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39560/0 (socket says 172.21.15.52:39560) 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65effd640 1 -- 172.21.15.52:0/218845117 learned_addr learned my addr 172.21.15.52:0/218845117 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:18.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65e7fc640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb660106860 0x7fb66019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65effd640 1 -- 172.21.15.52:0/218845117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb660106860 msgr2=0x7fb66019dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65effd640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb660106860 0x7fb66019dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65effd640 1 -- 172.21.15.52:0/218845117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb660197840 con 0x7fb660100860 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb65effd640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660100860 0x7fb66019d6c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb650005cc0 tx=0x7fb65002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6648f6640 1 -- 172.21.15.52:0/218845117 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb650047070 con 0x7fb660100860 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6648f6640 1 -- 172.21.15.52:0/218845117 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb65002f7e0 con 0x7fb660100860 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb660197ad0 con 0x7fb660100860 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.178+0000 7fb6648f6640 1 -- 172.21.15.52:0/218845117 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb650034070 con 0x7fb660100860 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.179+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb660198000 con 0x7fb660100860 2024-09-06T15:11:18.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.180+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb660101fa0 con 0x7fb660100860 2024-09-06T15:11:18.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.180+0000 7fb6648f6640 1 -- 172.21.15.52:0/218845117 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fb65004a070 con 0x7fb660100860 2024-09-06T15:11:18.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.181+0000 7fb6648f6640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb6480774b0 0x7fb648079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:18.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.181+0000 7fb6648f6640 1 -- 172.21.15.52:0/218845117 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fb6500ba560 con 0x7fb660100860 2024-09-06T15:11:18.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.181+0000 7fb65e7fc640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb6480774b0 0x7fb648079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:18.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.181+0000 7fb65e7fc640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb6480774b0 0x7fb648079970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb6600ffc90 tx=0x7fb65400a2d0 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:18.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.185+0000 7fb6648f6640 1 -- 172.21.15.52:0/218845117 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fb65003f070 con 0x7fb660100860 2024-09-06T15:11:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.370+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) -- 0x7fb660198d70 con 0x7fb660100860 2024-09-06T15:11:18.373 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.371+0000 7fb6648f6640 1 -- 172.21.15.52:0/218845117 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v39) ==== 107+0+5334 (secure 0 0 0) 0x7fb6500876b0 con 0x7fb660100860 2024-09-06T15:11:18.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:18.373 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":36,"btime":"2024-09-06T15:08:56:298210+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:55.300179+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":243,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:rejoin","state_seq":239,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-06T15:11:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 36 2024-09-06T15:11:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb6480774b0 msgr2=0x7fb648079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:18.374 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb6480774b0 0x7fb648079970 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb6600ffc90 tx=0x7fb65400a2d0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660100860 msgr2=0x7fb66019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660100860 0x7fb66019d6c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb650005cc0 tx=0x7fb65002f5f0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 shutdown_connections 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fb6480774b0 0x7fb648079970 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb660106860 0x7fb66019dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 --2- 172.21.15.52:0/218845117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb660100860 0x7fb66019d6c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 >> 172.21.15.52:0/218845117 conn(0x7fb6600fc580 msgr2=0x7fb6600fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 shutdown_connections 2024-09-06T15:11:18.375 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:18.373+0000 7fb6658f8640 1 -- 172.21.15.52:0/218845117 wait complete. 2024-09-06T15:11:18.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 37 2024-09-06T15:11:19.216 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:19 smithi052 ceph-mon[112917]: pgmap v812: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:19.217 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:19 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/218845117' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-06T15:11:19.234 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:19.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:19 smithi165 ceph-mon[82925]: pgmap v812: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:19.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:19 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/218845117' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.742+0000 7f72afd1c640 1 -- 172.21.15.52:0/1974762252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8107900 msgr2=0x7f72a8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.742+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1974762252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8107900 0x7f72a8107ce0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7298009c20 tx=0x7f729802a970 comp rx=0 tx=0).stop 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.742+0000 7f72afd1c640 1 -- 172.21.15.52:0/1974762252 shutdown_connections 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.742+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1974762252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72a8101900 0x7f72a8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.742+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1974762252 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8107900 0x7f72a8107ce0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.742+0000 7f72afd1c640 1 -- 172.21.15.52:0/1974762252 >> 172.21.15.52:0/1974762252 conn(0x7f72a80fd600 msgr2=0x7f72a80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.742+0000 7f72afd1c640 1 -- 172.21.15.52:0/1974762252 shutdown_connections 2024-09-06T15:11:19.744 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72afd1c640 1 -- 172.21.15.52:0/1974762252 wait complete. 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72afd1c640 1 Processor -- start 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72afd1c640 1 -- start start 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72afd1c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8101900 0x7f72a819d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72afd1c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72a8107900 0x7f72a819dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72afd1c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72a810ee30 con 0x7f72a8101900 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72afd1c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f72a810ecb0 con 0x7f72a8107900 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72adab8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8101900 0x7f72a819d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72adab8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8101900 0x7f72a819d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:39584/0 (socket says 172.21.15.52:39584) 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.743+0000 7f72adab8640 1 -- 172.21.15.52:0/1987376024 learned_addr learned my addr 172.21.15.52:0/1987376024 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72ad2b7640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72a8107900 0x7f72a819dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:19.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72adab8640 1 -- 172.21.15.52:0/1987376024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72a8107900 msgr2=0x7f72a819dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72adab8640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72a8107900 0x7f72a819dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72adab8640 1 -- 172.21.15.52:0/1987376024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a81978c0 con 0x7f72a8101900 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72adab8640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8101900 0x7f72a819d700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7298005cc0 tx=0x7f729802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72a6ffd640 1 -- 172.21.15.52:0/1987376024 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7298047070 con 0x7f72a8101900 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72a6ffd640 1 -- 172.21.15.52:0/1987376024 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f729802f7e0 con 0x7f72a8101900 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72a6ffd640 1 -- 172.21.15.52:0/1987376024 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7298034070 con 0x7f72a8101900 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a8197b50 con 0x7f72a8101900 2024-09-06T15:11:19.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.744+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a8198080 con 0x7f72a8101900 2024-09-06T15:11:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.745+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a8103040 con 0x7f72a8101900 2024-09-06T15:11:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.746+0000 7f72a6ffd640 1 -- 172.21.15.52:0/1987376024 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f729804a070 con 0x7f72a8101900 2024-09-06T15:11:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.746+0000 7f72a6ffd640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7290077460 0x7f7290079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.746+0000 7f72a6ffd640 1 -- 172.21.15.52:0/1987376024 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f72980ba780 con 0x7f72a8101900 2024-09-06T15:11:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.746+0000 7f72ad2b7640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7290077460 0x7f7290079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.747+0000 7f72ad2b7640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7290077460 0x7f7290079920 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f72a8106fc0 tx=0x7f729c008040 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.750+0000 7f72a6ffd640 1 -- 172.21.15.52:0/1987376024 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f729803f070 con 0x7f72a8101900 2024-09-06T15:11:19.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.933+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) -- 0x7f72a8198df0 con 0x7f72a8101900 2024-09-06T15:11:19.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.934+0000 7f72a6ffd640 1 -- 172.21.15.52:0/1987376024 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v39) ==== 107+0+5349 (secure 0 0 0) 0x7f7298083640 con 0x7f72a8101900 2024-09-06T15:11:19.933 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:19.934 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":37,"btime":"2024-09-06T15:08:57:302767+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:57.302761+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:active","state_seq":244,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:active","state_seq":240,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34342,"qdb_cluster":[34342,34374]},"id":1}]} 2024-09-06T15:11:19.934 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 37 2024-09-06T15:11:19.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.935+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7290077460 msgr2=0x7f7290079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:19.935 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.935+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7290077460 0x7f7290079920 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f72a8106fc0 tx=0x7f729c008040 comp rx=0 tx=0).stop 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.935+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8101900 msgr2=0x7f72a819d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.935+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8101900 0x7f72a819d700 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7298005cc0 tx=0x7f729802f5f0 comp rx=0 tx=0).stop 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.935+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 shutdown_connections 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.935+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f7290077460 0x7f7290079920 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.936+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f72a8107900 0x7f72a819dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.936+0000 7f72afd1c640 1 --2- 172.21.15.52:0/1987376024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f72a8101900 0x7f72a819d700 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.936+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 >> 172.21.15.52:0/1987376024 conn(0x7f72a80fd600 msgr2=0x7f72a80fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.936+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 shutdown_connections 2024-09-06T15:11:19.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:19.936+0000 7f72afd1c640 1 -- 172.21.15.52:0/1987376024 wait complete. 2024-09-06T15:11:20.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:20 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/1987376024' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-06T15:11:20.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:20 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/1987376024' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-06T15:11:20.645 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph fs dump --format=json 38 2024-09-06T15:11:20.899 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:21.310 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:21 smithi052 ceph-mon[112917]: pgmap v813: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:21.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:21 smithi165 ceph-mon[82925]: pgmap v813: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:21.393 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.393+0000 7fcb5cd29640 1 -- 172.21.15.52:0/2525854117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb581001d0 msgr2=0x7fcb58100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:21.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.393+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/2525854117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb581001d0 0x7fcb58100630 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009880 tx=0x7fcb4002a530 comp rx=0 tx=0).stop 2024-09-06T15:11:21.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.394+0000 7fcb5cd29640 1 -- 172.21.15.52:0/2525854117 shutdown_connections 2024-09-06T15:11:21.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.394+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/2525854117 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb581001d0 0x7fcb58100630 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:21.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.394+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/2525854117 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb58107b00 0x7fcb58107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:21.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.394+0000 7fcb5cd29640 1 -- 172.21.15.52:0/2525854117 >> 172.21.15.52:0/2525854117 conn(0x7fcb580771e0 msgr2=0x7fcb580775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:21.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.394+0000 7fcb5cd29640 1 -- 172.21.15.52:0/2525854117 shutdown_connections 2024-09-06T15:11:21.394 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.394+0000 7fcb5cd29640 1 -- 172.21.15.52:0/2525854117 wait complete. 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb5cd29640 1 Processor -- start 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb5cd29640 1 -- start start 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb5cd29640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb581001d0 0x7fcb5819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb5cd29640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58107b00 0x7fcb5819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb5cd29640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5810ee40 con 0x7fcb58107b00 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb5cd29640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5810ecc0 con 0x7fcb581001d0 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb55d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58107b00 0x7fcb5819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb55d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58107b00 0x7fcb5819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47946/0 (socket says 172.21.15.52:47946) 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.395+0000 7fcb55d9b640 1 -- 172.21.15.52:0/3396841561 learned_addr learned my addr 172.21.15.52:0/3396841561 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:21.396 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb5659c640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb581001d0 0x7fcb5819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb55d9b640 1 -- 172.21.15.52:0/3396841561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb581001d0 msgr2=0x7fcb5819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb55d9b640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb581001d0 0x7fcb5819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb55d9b640 1 -- 172.21.15.52:0/3396841561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb581977b0 con 0x7fcb58107b00 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb5659c640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb581001d0 0x7fcb5819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb55d9b640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58107b00 0x7fcb5819db70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcb40031460 tx=0x7fcb400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb4f7fe640 1 -- 172.21.15.52:0/3396841561 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb4003f070 con 0x7fcb58107b00 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb4f7fe640 1 -- 172.21.15.52:0/3396841561 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb400035f0 con 0x7fcb58107b00 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb58197a40 con 0x7fcb58107b00 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb4f7fe640 1 -- 172.21.15.52:0/3396841561 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb40035030 con 0x7fcb58107b00 2024-09-06T15:11:21.397 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.396+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb58197f70 con 0x7fcb58107b00 2024-09-06T15:11:21.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.397+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb580697e0 con 0x7fcb58107b00 2024-09-06T15:11:21.398 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.398+0000 7fcb4f7fe640 1 -- 172.21.15.52:0/3396841561 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fcb40042070 con 0x7fcb58107b00 2024-09-06T15:11:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.399+0000 7fcb4f7fe640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb440774b0 0x7fcb44079970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.399+0000 7fcb5659c640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb440774b0 0x7fcb44079970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.399+0000 7fcb4f7fe640 1 -- 172.21.15.52:0/3396841561 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fcb400ba160 con 0x7fcb58107b00 2024-09-06T15:11:21.399 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.399+0000 7fcb5659c640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb440774b0 0x7fcb44079970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009b40 tx=0x7fcb50005e50 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:21.402 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.403+0000 7fcb4f7fe640 1 -- 172.21.15.52:0/3396841561 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fcb40083140 con 0x7fcb58107b00 2024-09-06T15:11:21.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.584+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) -- 0x7fcb58198ce0 con 0x7fcb58107b00 2024-09-06T15:11:21.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.585+0000 7fcb4f7fe640 1 -- 172.21.15.52:0/3396841561 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v39) ==== 107+0+5364 (secure 0 0 0) 0x7fcb400872b0 con 0x7fcb58107b00 2024-09-06T15:11:21.585 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-06T15:11:21.585 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":38,"btime":"2024-09-06T15:08:57:307509+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-06T14:41:46.713227+0000","modified":"2024-09-06T15:08:57.307495+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34342,"mds_1":34374},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34342":{"gid":34342,"name":"cephfs.smithi052.dfprfm","rank":0,"incarnation":32,"state":"up:active","state_seq":244,"addr":"172.21.15.52:6827/3019175304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":3019175304},{"type":"v1","addr":"172.21.15.52:6827","nonce":3019175304}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34374":{"gid":34374,"name":"cephfs.smithi052.eqtxfx","rank":1,"incarnation":32,"state":"up:active","state_seq":240,"addr":"172.21.15.52:6829/3819874840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":3819874840},{"type":"v1","addr":"172.21.15.52:6829","nonce":3819874840}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44321":{"gid":44321,"name":"cephfs.smithi165.nmjcsh","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6825/3934747666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":3934747666},{"type":"v1","addr":"172.21.15.165:6825","nonce":3934747666}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44349":{"gid":44349,"name":"cephfs.smithi165.zpunux","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6827/1211110348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1211110348},{"type":"v1","addr":"172.21.15.165:6827","nonce":1211110348}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34342,"qdb_cluster":[34374,34342]},"id":1}]} 2024-09-06T15:11:21.585 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 38 2024-09-06T15:11:21.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb440774b0 msgr2=0x7fcb44079970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb440774b0 0x7fcb44079970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fcb50009b40 tx=0x7fcb50005e50 comp rx=0 tx=0).stop 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58107b00 msgr2=0x7fcb5819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58107b00 0x7fcb5819db70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcb40031460 tx=0x7fcb400045e0 comp rx=0 tx=0).stop 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 shutdown_connections 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb58107b00 0x7fcb5819db70 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fcb440774b0 0x7fcb44079970 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 --2- 172.21.15.52:0/3396841561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb581001d0 0x7fcb5819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 >> 172.21.15.52:0/3396841561 conn(0x7fcb580771e0 msgr2=0x7fcb580fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 shutdown_connections 2024-09-06T15:11:21.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:21.587+0000 7fcb5cd29640 1 -- 172.21.15.52:0/3396841561 wait complete. 2024-09-06T15:11:22.189 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:22 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/3396841561' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 38, "format": "json"} : dispatch 2024-09-06T15:11:22.220 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-06T15:11:22.230 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-06T15:11:22.230 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T15:11:22.231 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-06T15:11:22.248 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T15:11:22.248 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-06T15:11:22.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd blocklist ls 2024-09-06T15:11:22.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:22 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/3396841561' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 38, "format": "json"} : dispatch 2024-09-06T15:11:22.597 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.050+0000 7f0f6249c640 1 -- 172.21.15.52:0/926247854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 msgr2=0x7f0f5c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.050+0000 7f0f6249c640 1 --2- 172.21.15.52:0/926247854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c106be0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009880 tx=0x7f0f4c02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 -- 172.21.15.52:0/926247854 shutdown_connections 2024-09-06T15:11:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 --2- 172.21.15.52:0/926247854 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c100800 0x7f0f5c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 --2- 172.21.15.52:0/926247854 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c106be0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 -- 172.21.15.52:0/926247854 >> 172.21.15.52:0/926247854 conn(0x7f0f5c0fc520 msgr2=0x7f0f5c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 -- 172.21.15.52:0/926247854 shutdown_connections 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 -- 172.21.15.52:0/926247854 wait complete. 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 Processor -- start 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.051+0000 7f0f6249c640 1 -- start start 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f6249c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c100800 0x7f0f5c1965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f6249c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f6249c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10dcd0 con 0x7f0f5c106800 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f6249c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c10db50 con 0x7f0f5c100800 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47970/0 (socket says 172.21.15.52:47970) 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5b7fe640 1 -- 172.21.15.52:0/2443679264 learned_addr learned my addr 172.21.15.52:0/2443679264 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:23.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5bfff640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c100800 0x7f0f5c1965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5b7fe640 1 -- 172.21.15.52:0/2443679264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c100800 msgr2=0x7f0f5c1965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5b7fe640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c100800 0x7f0f5c1965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5b7fe640 1 -- 172.21.15.52:0/2443679264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c197050 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f5b7fe640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c196b10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000d6f0 tx=0x7f0f5000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f597fa640 1 -- 172.21.15.52:0/2443679264 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f50017070 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f597fa640 1 -- 172.21.15.52:0/2443679264 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f5000de00 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c197340 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f597fa640 1 -- 172.21.15.52:0/2443679264 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f50004bb0 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.052+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1a3e10 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.054+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f5c101f40 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.054+0000 7f0f597fa640 1 -- 172.21.15.52:0/2443679264 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7f0f50004e60 con 0x7f0f5c106800 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.054+0000 7f0f597fa640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0f44077460 0x7f0f44079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:23.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.055+0000 7f0f597fa640 1 -- 172.21.15.52:0/2443679264 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7f0f50099400 con 0x7f0f5c106800 2024-09-06T15:11:23.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.055+0000 7f0f5bfff640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0f44077460 0x7f0f44079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:23.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.055+0000 7f0f5bfff640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0f44077460 0x7f0f44079920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c031460 tx=0x7f0f4c009560 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:23.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.058+0000 7f0f597fa640 1 -- 172.21.15.52:0/2443679264 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7f0f50062360 con 0x7f0f5c106800 2024-09-06T15:11:23.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:23 smithi052 ceph-mon[112917]: pgmap v814: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:23.229 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.229+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0f5c100c60 con 0x7f0f5c106800 2024-09-06T15:11:23.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.230+0000 7f0f597fa640 1 -- 172.21.15.52:0/2443679264 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 32 entries v91) ==== 81+0+1903 (secure 0 0 0) 0x7f0f500664d0 con 0x7f0f5c106800 2024-09-06T15:11:23.230 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6825/3417309574 2024-09-07T14:52:46.620772+0000 2024-09-06T15:11:23.230 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/1895569249 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:23.230 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:0/3613434492 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:23.230 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2372702164 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:23.230 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/175246929 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3329824106 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/3628559436 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/1895569249 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/2567430039 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6829/1318417598 2024-09-07T14:52:46.620760+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/2567430039 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:0/2005295966 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/3628559436 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2230692890 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:23.231 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2195954396 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:0/1810751788 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/1082422739 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6828/1318417598 2024-09-07T14:52:46.620760+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6829/100552479 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6828/100552479 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/175246929 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2579445121 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3105657816 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6827/974570891 2024-09-07T14:42:01.075375+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6826/974570891 2024-09-07T14:42:01.075375+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/88542092 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/4210640305 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:23.232 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/1634284377 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:23.233 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6824/3417309574 2024-09-07T14:52:46.620772+0000 2024-09-06T15:11:23.233 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3779039706 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:23.233 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3157720548 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:23.233 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3578956532 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:listed 32 entries 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.231+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0f44077460 msgr2=0x7f0f44079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.231+0000 7f0f6249c640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0f44077460 0x7f0f44079920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c031460 tx=0x7f0f4c009560 comp rx=0 tx=0).stop 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.231+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 msgr2=0x7f0f5c196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.231+0000 7f0f6249c640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c196b10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000d6f0 tx=0x7f0f5000dbb0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.232+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 shutdown_connections 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.232+0000 7f0f6249c640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f5c106800 0x7f0f5c196b10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.232+0000 7f0f6249c640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7f0f44077460 0x7f0f44079920 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.232+0000 7f0f6249c640 1 --2- 172.21.15.52:0/2443679264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0f5c100800 0x7f0f5c1965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.232+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 >> 172.21.15.52:0/2443679264 conn(0x7f0f5c0fc520 msgr2=0x7f0f5c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:23.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.232+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 shutdown_connections 2024-09-06T15:11:23.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:23.232+0000 7f0f6249c640 1 -- 172.21.15.52:0/2443679264 wait complete. 2024-09-06T15:11:23.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:23 smithi165 ceph-mon[82925]: pgmap v814: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:23.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:23.842 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-06T15:11:23.843 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-06T15:11:23.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 -- ceph osd blocklist ls 2024-09-06T15:11:24.158 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/mon.smithi052/config 2024-09-06T15:11:24.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:24 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2443679264' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:11:24.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:24 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2443679264' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:11:24.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 -- 172.21.15.52:0/382202759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc107900 msgr2=0x7fd3fc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:24.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 --2- 172.21.15.52:0/382202759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc107900 0x7fd3fc107ce0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec009880 tx=0x7fd3ec02a4a0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 -- 172.21.15.52:0/382202759 shutdown_connections 2024-09-06T15:11:24.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 --2- 172.21.15.52:0/382202759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3fc101900 0x7fd3fc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 --2- 172.21.15.52:0/382202759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc107900 0x7fd3fc107ce0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 -- 172.21.15.52:0/382202759 >> 172.21.15.52:0/382202759 conn(0x7fd3fc0fd600 msgr2=0x7fd3fc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 -- 172.21.15.52:0/382202759 shutdown_connections 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.610+0000 7fd401385640 1 -- 172.21.15.52:0/382202759 wait complete. 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd401385640 1 Processor -- start 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd401385640 1 -- start start 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd401385640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc101900 0x7fd3fc19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd401385640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3fc107900 0x7fd3fc19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd401385640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc10ee30 con 0x7fd3fc101900 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd401385640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc10ecb0 con 0x7fd3fc107900 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd3faffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc101900 0x7fd3fc19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:24.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd3faffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc101900 0x7fd3fc19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47992/0 (socket says 172.21.15.52:47992) 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd3faffd640 1 -- 172.21.15.52:0/2319280254 learned_addr learned my addr 172.21.15.52:0/2319280254 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd3faffd640 1 -- 172.21.15.52:0/2319280254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3fc107900 msgr2=0x7fd3fc19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd3faffd640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3fc107900 0x7fd3fc19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.611+0000 7fd3faffd640 1 -- 172.21.15.52:0/2319280254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc197810 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.612+0000 7fd3faffd640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc101900 0x7fd3fc19d690 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec031460 tx=0x7fd3ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.612+0000 7fd3f8ff9640 1 -- 172.21.15.52:0/2319280254 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec03f070 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.612+0000 7fd3f8ff9640 1 -- 172.21.15.52:0/2319280254 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3ec004cf0 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.612+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3fc197aa0 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.612+0000 7fd3f8ff9640 1 -- 172.21.15.52:0/2319280254 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec035030 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.612+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3fc197fd0 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.613+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3fc103040 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.613+0000 7fd3f8ff9640 1 -- 172.21.15.52:0/2319280254 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 32) ==== 99907+0+0 (secure 0 0 0) 0x7fd3ec042070 con 0x7fd3fc101900 2024-09-06T15:11:24.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.614+0000 7fd3f8ff9640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd3e8077460 0x7fd3e8079920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-06T15:11:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.614+0000 7fd3f8ff9640 1 -- 172.21.15.52:0/2319280254 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 6489+0+0 (secure 0 0 0) 0x7fd3ec0ba2e0 con 0x7fd3fc101900 2024-09-06T15:11:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.614+0000 7fd3f27fc640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd3e8077460 0x7fd3e8079920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-06T15:11:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.614+0000 7fd3f27fc640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd3e8077460 0x7fd3e8079920 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0ffc50 tx=0x7fd3e4006c90 comp rx=0 tx=0).ready entity=mgr.14764 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-06T15:11:24.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.618+0000 7fd3f8ff9640 1 -- 172.21.15.52:0/2319280254 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180031 (secure 0 0 0) 0x7fd3ec083240 con 0x7fd3fc101900 2024-09-06T15:11:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.795+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd3fc109e70 con 0x7fd3fc101900 2024-09-06T15:11:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.796+0000 7fd3f8ff9640 1 -- 172.21.15.52:0/2319280254 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 32 entries v91) ==== 81+0+1903 (secure 0 0 0) 0x7fd3ec0873b0 con 0x7fd3fc101900 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6825/3417309574 2024-09-07T14:52:46.620772+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/1895569249 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:0/3613434492 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2372702164 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/175246929 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3329824106 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/3628559436 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/1895569249 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/2567430039 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:24.796 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6829/1318417598 2024-09-07T14:52:46.620760+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6801/2567430039 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:0/2005295966 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/3628559436 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2230692890 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2195954396 2024-09-07T14:44:00.610304+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:0/1810751788 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/1082422739 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6828/1318417598 2024-09-07T14:52:46.620760+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6829/100552479 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6828/100552479 2024-09-07T14:45:51.541441+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6800/175246929 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2579445121 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:24.797 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3105657816 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6827/974570891 2024-09-07T14:42:01.075375+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6826/974570891 2024-09-07T14:42:01.075375+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/88542092 2024-09-07T14:37:10.243661+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/4210640305 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/1634284377 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.165:6824/3417309574 2024-09-07T14:52:46.620772+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3779039706 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3157720548 2024-09-07T14:35:42.967245+0000 2024-09-06T15:11:24.798 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/3578956532 2024-09-07T14:36:14.010074+0000 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:listed 32 entries 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd3e8077460 msgr2=0x7fd3e8079920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd3e8077460 0x7fd3e8079920 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0ffc50 tx=0x7fd3e4006c90 comp rx=0 tx=0).stop 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc101900 msgr2=0x7fd3fc19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc101900 0x7fd3fc19d690 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec031460 tx=0x7fd3ec0048f0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 shutdown_connections 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:6800/1957033453,v1:172.21.15.52:6801/1957033453] conn(0x7fd3e8077460 0x7fd3e8079920 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3fc107900 0x7fd3fc19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 --2- 172.21.15.52:0/2319280254 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd3fc101900 0x7fd3fc19d690 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-06T15:11:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.798+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 >> 172.21.15.52:0/2319280254 conn(0x7fd3fc0fd600 msgr2=0x7fd3fc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-06T15:11:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.799+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 shutdown_connections 2024-09-06T15:11:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-06T15:11:24.799+0000 7fd401385640 1 -- 172.21.15.52:0/2319280254 wait complete. 2024-09-06T15:11:25.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:25 smithi052 ceph-mon[112917]: pgmap v815: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:25.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:25 smithi052 ceph-mon[112917]: from='client.? 172.21.15.52:0/2319280254' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:11:25.469 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi052.front.sepia.ceph.com... 2024-09-06T15:11:25.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-06T15:11:25.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-06T15:11:25.496 INFO:teuthology.orchestra.run:waiting for 300 2024-09-06T15:11:25.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:25 smithi165 ceph-mon[82925]: pgmap v815: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:25.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:25 smithi165 ceph-mon[82925]: from='client.? 172.21.15.52:0/2319280254' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-06T15:11:26.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:26 smithi165 ceph-mon[82925]: pgmap v816: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:26.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:26 smithi052 ceph-mon[112917]: pgmap v816: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:29.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:28 smithi165 ceph-mon[82925]: pgmap v817: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:29.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:28 smithi052 ceph-mon[112917]: pgmap v817: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:31.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:30 smithi165 ceph-mon[82925]: pgmap v818: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:31.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:30 smithi052 ceph-mon[112917]: pgmap v818: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:33.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:32 smithi165 ceph-mon[82925]: pgmap v819: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:33.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:32 smithi052 ceph-mon[112917]: pgmap v819: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:34.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:34 smithi165 ceph-mon[82925]: pgmap v820: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:35.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:34 smithi052 ceph-mon[112917]: pgmap v820: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:37.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:36 smithi165 ceph-mon[82925]: pgmap v821: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:37.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:36 smithi052 ceph-mon[112917]: pgmap v821: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:38.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:38.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:39.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:38 smithi165 ceph-mon[82925]: pgmap v822: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:39.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:38 smithi052 ceph-mon[112917]: pgmap v822: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:41.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:40 smithi165 ceph-mon[82925]: pgmap v823: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:41.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:40 smithi052 ceph-mon[112917]: pgmap v823: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:43.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:42 smithi165 ceph-mon[82925]: pgmap v824: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:43.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:42 smithi052 ceph-mon[112917]: pgmap v824: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:45.030 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:44 smithi052 ceph-mon[112917]: pgmap v825: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:45.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:44 smithi165 ceph-mon[82925]: pgmap v825: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:47.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:46 smithi165 ceph-mon[82925]: pgmap v826: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:46 smithi052 ceph-mon[112917]: pgmap v826: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:49.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:48 smithi165 ceph-mon[82925]: pgmap v827: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:49.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:48 smithi052 ceph-mon[112917]: pgmap v827: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:51.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:50 smithi165 ceph-mon[82925]: pgmap v828: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:51.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:50 smithi052 ceph-mon[112917]: pgmap v828: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:52 smithi165 ceph-mon[82925]: pgmap v829: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:52 smithi052 ceph-mon[112917]: pgmap v829: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:11:55.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:54 smithi165 ceph-mon[82925]: pgmap v830: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:55.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:54 smithi052 ceph-mon[112917]: pgmap v830: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:57.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:56 smithi165 ceph-mon[82925]: pgmap v831: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:57.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:56 smithi052 ceph-mon[112917]: pgmap v831: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:11:59.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:11:58 smithi165 ceph-mon[82925]: pgmap v832: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:11:59.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:11:58 smithi052 ceph-mon[112917]: pgmap v832: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:01.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:00 smithi165 ceph-mon[82925]: pgmap v833: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:01.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:00 smithi052 ceph-mon[112917]: pgmap v833: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:03.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:02 smithi165 ceph-mon[82925]: pgmap v834: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:03.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:02 smithi052 ceph-mon[112917]: pgmap v834: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:05.054 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:04 smithi165 ceph-mon[82925]: pgmap v835: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:05.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:04 smithi052 ceph-mon[112917]: pgmap v835: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:07.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:06 smithi165 ceph-mon[82925]: pgmap v836: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:07.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:06 smithi052 ceph-mon[112917]: pgmap v836: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:08.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:08.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:09.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:08 smithi165 ceph-mon[82925]: pgmap v837: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:09.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:08 smithi052 ceph-mon[112917]: pgmap v837: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:11.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:10 smithi165 ceph-mon[82925]: pgmap v838: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:11.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:11.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:11.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:12:11.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:10 smithi052 ceph-mon[112917]: pgmap v838: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:11.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:12:11.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:12:11.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:12:11.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:12:13.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:12 smithi165 ceph-mon[82925]: pgmap v839: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:13.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:12 smithi052 ceph-mon[112917]: pgmap v839: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:15.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:14 smithi165 ceph-mon[82925]: pgmap v840: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:15.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:14 smithi052 ceph-mon[112917]: pgmap v840: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:17.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:16 smithi165 ceph-mon[82925]: pgmap v841: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:17.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:16 smithi052 ceph-mon[112917]: pgmap v841: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:19.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:18 smithi165 ceph-mon[82925]: pgmap v842: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:19.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:18 smithi052 ceph-mon[112917]: pgmap v842: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:21.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:20 smithi165 ceph-mon[82925]: pgmap v843: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:21.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:20 smithi052 ceph-mon[112917]: pgmap v843: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:23.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:22 smithi165 ceph-mon[82925]: pgmap v844: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:23.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:23.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:22 smithi052 ceph-mon[112917]: pgmap v844: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:23.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:25.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:24 smithi165 ceph-mon[82925]: pgmap v845: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:25.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:24 smithi052 ceph-mon[112917]: pgmap v845: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:27.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:26 smithi165 ceph-mon[82925]: pgmap v846: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:26 smithi052 ceph-mon[112917]: pgmap v846: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:29.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:28 smithi165 ceph-mon[82925]: pgmap v847: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:29.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:28 smithi052 ceph-mon[112917]: pgmap v847: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:31.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:30 smithi165 ceph-mon[82925]: pgmap v848: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:31.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:30 smithi052 ceph-mon[112917]: pgmap v848: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:33.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:32 smithi165 ceph-mon[82925]: pgmap v849: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:33.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:32 smithi052 ceph-mon[112917]: pgmap v849: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:35.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:34 smithi165 ceph-mon[82925]: pgmap v850: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:35.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:34 smithi052 ceph-mon[112917]: pgmap v850: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:37.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:36 smithi165 ceph-mon[82925]: pgmap v851: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:37.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:36 smithi052 ceph-mon[112917]: pgmap v851: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:38.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:39.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:38 smithi052 ceph-mon[112917]: pgmap v852: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:39.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:38 smithi165 ceph-mon[82925]: pgmap v852: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:41.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:40 smithi165 ceph-mon[82925]: pgmap v853: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:41.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:40 smithi052 ceph-mon[112917]: pgmap v853: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:43.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:42 smithi052 ceph-mon[112917]: pgmap v854: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:43.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:42 smithi165 ceph-mon[82925]: pgmap v854: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:44 smithi052 ceph-mon[112917]: pgmap v855: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:45.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:44 smithi165 ceph-mon[82925]: pgmap v855: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:47.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:46 smithi052 ceph-mon[112917]: pgmap v856: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:46 smithi165 ceph-mon[82925]: pgmap v856: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:49.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:48 smithi052 ceph-mon[112917]: pgmap v857: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:49.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:48 smithi165 ceph-mon[82925]: pgmap v857: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:51.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:50 smithi052 ceph-mon[112917]: pgmap v858: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:51.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:50 smithi165 ceph-mon[82925]: pgmap v858: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:53.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:52 smithi052 ceph-mon[112917]: pgmap v859: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:52 smithi165 ceph-mon[82925]: pgmap v859: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:12:55.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:54 smithi052 ceph-mon[112917]: pgmap v860: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:55.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:54 smithi165 ceph-mon[82925]: pgmap v860: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:57.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:56 smithi052 ceph-mon[112917]: pgmap v861: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:57.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:56 smithi165 ceph-mon[82925]: pgmap v861: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:12:59.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:12:58 smithi052 ceph-mon[112917]: pgmap v862: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:12:59.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:12:58 smithi165 ceph-mon[82925]: pgmap v862: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:01.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:00 smithi052 ceph-mon[112917]: pgmap v863: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:00 smithi165 ceph-mon[82925]: pgmap v863: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:03.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:02 smithi052 ceph-mon[112917]: pgmap v864: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:03.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:02 smithi165 ceph-mon[82925]: pgmap v864: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:05.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:04 smithi052 ceph-mon[112917]: pgmap v865: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:05.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:04 smithi165 ceph-mon[82925]: pgmap v865: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:07.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:06 smithi052 ceph-mon[112917]: pgmap v866: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:06 smithi165 ceph-mon[82925]: pgmap v866: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:08.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:09.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:08 smithi165 ceph-mon[82925]: pgmap v867: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:09.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:08 smithi052 ceph-mon[112917]: pgmap v867: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:11.235 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:10 smithi165 ceph-mon[82925]: pgmap v868: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:11.235 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:10 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:11.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:10 smithi052 ceph-mon[112917]: pgmap v868: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:11.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:10 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:13:12.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:11 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:12.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:11 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:12.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:11 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:13:12.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:11 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:13:12.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:11 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:13:12.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:11 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:13:13.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:13 smithi165 ceph-mon[82925]: pgmap v869: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:13.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:13 smithi052 ceph-mon[112917]: pgmap v869: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:15.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:15 smithi165 ceph-mon[82925]: pgmap v870: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:15.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:15 smithi052 ceph-mon[112917]: pgmap v870: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:17.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:17 smithi165 ceph-mon[82925]: pgmap v871: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:17.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:17 smithi052 ceph-mon[112917]: pgmap v871: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:19.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:19 smithi165 ceph-mon[82925]: pgmap v872: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:19.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:19 smithi052 ceph-mon[112917]: pgmap v872: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:21.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:21 smithi165 ceph-mon[82925]: pgmap v873: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:21.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:21 smithi052 ceph-mon[112917]: pgmap v873: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:23 smithi165 ceph-mon[82925]: pgmap v874: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:23.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:23 smithi052 ceph-mon[112917]: pgmap v874: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:23.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:25.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:25 smithi165 ceph-mon[82925]: pgmap v875: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:25.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:25 smithi052 ceph-mon[112917]: pgmap v875: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:27.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:27 smithi165 ceph-mon[82925]: pgmap v876: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:27.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:27 smithi052 ceph-mon[112917]: pgmap v876: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:29.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:29 smithi165 ceph-mon[82925]: pgmap v877: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:29.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:29 smithi052 ceph-mon[112917]: pgmap v877: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:31.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:31 smithi165 ceph-mon[82925]: pgmap v878: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:31.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:31 smithi052 ceph-mon[112917]: pgmap v878: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:33.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:33 smithi165 ceph-mon[82925]: pgmap v879: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:33.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:33 smithi052 ceph-mon[112917]: pgmap v879: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:35.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:35 smithi165 ceph-mon[82925]: pgmap v880: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:35.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:35 smithi052 ceph-mon[112917]: pgmap v880: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:37.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:37 smithi165 ceph-mon[82925]: pgmap v881: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:37.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:37 smithi052 ceph-mon[112917]: pgmap v881: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:38.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:38.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:39.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:39 smithi165 ceph-mon[82925]: pgmap v882: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:39.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:39 smithi052 ceph-mon[112917]: pgmap v882: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:41.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:41 smithi165 ceph-mon[82925]: pgmap v883: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:41.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:41 smithi052 ceph-mon[112917]: pgmap v883: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:43.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:43 smithi165 ceph-mon[82925]: pgmap v884: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:43.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:43 smithi052 ceph-mon[112917]: pgmap v884: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:45.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:45 smithi165 ceph-mon[82925]: pgmap v885: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:45.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:45 smithi052 ceph-mon[112917]: pgmap v885: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:47.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:47 smithi165 ceph-mon[82925]: pgmap v886: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:47.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:47 smithi052 ceph-mon[112917]: pgmap v886: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:49.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:49 smithi052 ceph-mon[112917]: pgmap v887: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:49.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:49 smithi165 ceph-mon[82925]: pgmap v887: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:51.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:51 smithi052 ceph-mon[112917]: pgmap v888: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:51.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:51 smithi165 ceph-mon[82925]: pgmap v888: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:53.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:53 smithi052 ceph-mon[112917]: pgmap v889: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:53.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:53 smithi165 ceph-mon[82925]: pgmap v889: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:53.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:13:55.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:55 smithi052 ceph-mon[112917]: pgmap v890: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:55.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:55 smithi165 ceph-mon[82925]: pgmap v890: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:57.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:57 smithi165 ceph-mon[82925]: pgmap v891: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:57.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:57 smithi052 ceph-mon[112917]: pgmap v891: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:13:59.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:13:59 smithi052 ceph-mon[112917]: pgmap v892: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:13:59.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:13:59 smithi165 ceph-mon[82925]: pgmap v892: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:01.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:01 smithi052 ceph-mon[112917]: pgmap v893: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:01.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:01 smithi165 ceph-mon[82925]: pgmap v893: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:03.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:03 smithi052 ceph-mon[112917]: pgmap v894: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:03.476 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:03 smithi165 ceph-mon[82925]: pgmap v894: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:05.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:05 smithi052 ceph-mon[112917]: pgmap v895: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:05.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:05 smithi165 ceph-mon[82925]: pgmap v895: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:07.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:07 smithi052 ceph-mon[112917]: pgmap v896: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:07.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:07 smithi165 ceph-mon[82925]: pgmap v896: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:08.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:08 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:08.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:08 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:09.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:09 smithi052 ceph-mon[112917]: pgmap v897: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:09.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:09 smithi165 ceph-mon[82925]: pgmap v897: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:11.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:11 smithi052 ceph-mon[112917]: pgmap v898: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:11.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:11 smithi165 ceph-mon[82925]: pgmap v898: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:12.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:12.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:12.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:12.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:14:12.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:14:12.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:14:12.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:14:12.577 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:14:13.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:13 smithi052 ceph-mon[112917]: pgmap v899: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:13.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:13 smithi165 ceph-mon[82925]: pgmap v899: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:15.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:15 smithi052 ceph-mon[112917]: pgmap v900: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:15.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:15 smithi165 ceph-mon[82925]: pgmap v900: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:17.375 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:17 smithi052 ceph-mon[112917]: pgmap v901: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:17.421 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:17 smithi165 ceph-mon[82925]: pgmap v901: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:19.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:19 smithi165 ceph-mon[82925]: pgmap v902: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:19.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:19 smithi052 ceph-mon[112917]: pgmap v902: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:21.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:21 smithi165 ceph-mon[82925]: pgmap v903: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:21.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:21 smithi052 ceph-mon[112917]: pgmap v903: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:23.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:23 smithi052 ceph-mon[112917]: pgmap v904: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:23.376 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:23 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:23.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:23 smithi165 ceph-mon[82925]: pgmap v904: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:23.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:23 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:25.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:25 smithi165 ceph-mon[82925]: pgmap v905: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:25.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:25 smithi052 ceph-mon[112917]: pgmap v905: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:27.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:27 smithi165 ceph-mon[82925]: pgmap v906: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:27.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:27 smithi052 ceph-mon[112917]: pgmap v906: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:29.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:29 smithi165 ceph-mon[82925]: pgmap v907: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:29.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:29 smithi052 ceph-mon[112917]: pgmap v907: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:31.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:31 smithi165 ceph-mon[82925]: pgmap v908: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:31.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:31 smithi052 ceph-mon[112917]: pgmap v908: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:33.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:33 smithi165 ceph-mon[82925]: pgmap v909: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:33.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:33 smithi052 ceph-mon[112917]: pgmap v909: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:35.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:35 smithi165 ceph-mon[82925]: pgmap v910: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:35.615 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:35 smithi052 ceph-mon[112917]: pgmap v910: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:37.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:37 smithi165 ceph-mon[82925]: pgmap v911: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:37.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:37 smithi052 ceph-mon[112917]: pgmap v911: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:38.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:38 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:38.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:38 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:39.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:39 smithi165 ceph-mon[82925]: pgmap v912: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:39.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:39 smithi052 ceph-mon[112917]: pgmap v912: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:41.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:41 smithi165 ceph-mon[82925]: pgmap v913: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:41.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:41 smithi052 ceph-mon[112917]: pgmap v913: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:43.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:43 smithi165 ceph-mon[82925]: pgmap v914: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:43.626 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:43 smithi052 ceph-mon[112917]: pgmap v914: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:45.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:45 smithi165 ceph-mon[82925]: pgmap v915: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:45.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:45 smithi052 ceph-mon[112917]: pgmap v915: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:47.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:47 smithi165 ceph-mon[82925]: pgmap v916: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:47.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:47 smithi052 ceph-mon[112917]: pgmap v916: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:49.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:49 smithi165 ceph-mon[82925]: pgmap v917: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:49.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:49 smithi052 ceph-mon[112917]: pgmap v917: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:51.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:51 smithi165 ceph-mon[82925]: pgmap v918: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:51.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:51 smithi052 ceph-mon[112917]: pgmap v918: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:53 smithi165 ceph-mon[82925]: pgmap v919: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:53.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:53 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:53.531 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:53 smithi052 ceph-mon[112917]: pgmap v919: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:53.531 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:53 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:14:55.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:55 smithi165 ceph-mon[82925]: pgmap v920: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:55.614 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:55 smithi052 ceph-mon[112917]: pgmap v920: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:56.825 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:56 smithi165 ceph-mon[82925]: pgmap v921: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:56.875 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:56 smithi052 ceph-mon[112917]: pgmap v921: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:14:59.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:14:58 smithi165 ceph-mon[82925]: pgmap v922: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:14:59.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:14:58 smithi052 ceph-mon[112917]: pgmap v922: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:01.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:00 smithi165 ceph-mon[82925]: pgmap v923: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:01.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:00 smithi052 ceph-mon[112917]: pgmap v923: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:03.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:02 smithi165 ceph-mon[82925]: pgmap v924: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:03.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:02 smithi052 ceph-mon[112917]: pgmap v924: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:05.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:04 smithi165 ceph-mon[82925]: pgmap v925: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:05.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:04 smithi052 ceph-mon[112917]: pgmap v925: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:07.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:06 smithi165 ceph-mon[82925]: pgmap v926: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:07.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:06 smithi052 ceph-mon[112917]: pgmap v926: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:08.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:08.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:09.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:08 smithi165 ceph-mon[82925]: pgmap v927: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:09.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:08 smithi052 ceph-mon[112917]: pgmap v927: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:11.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:10 smithi165 ceph-mon[82925]: pgmap v928: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:11.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:10 smithi052 ceph-mon[112917]: pgmap v928: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:12.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:11 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:12.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:11 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:15:13.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:12 smithi165 ceph-mon[82925]: pgmap v929: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:13.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:13.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:13.076 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:15:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:12 smithi052 ceph-mon[112917]: pgmap v929: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:15:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:15:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:15:15.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:14 smithi165 ceph-mon[82925]: pgmap v930: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:15.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:14 smithi052 ceph-mon[112917]: pgmap v930: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:17.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:16 smithi165 ceph-mon[82925]: pgmap v931: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:17.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:16 smithi052 ceph-mon[112917]: pgmap v931: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:19.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:18 smithi165 ceph-mon[82925]: pgmap v932: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:19.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:18 smithi052 ceph-mon[112917]: pgmap v932: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:20 smithi165 ceph-mon[82925]: pgmap v933: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:22 smithi165 ceph-mon[82925]: pgmap v934: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:24 smithi165 ceph-mon[82925]: pgmap v935: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:26 smithi165 ceph-mon[82925]: pgmap v936: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:20 smithi052 ceph-mon[112917]: pgmap v933: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:22 smithi052 ceph-mon[112917]: pgmap v934: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:24 smithi052 ceph-mon[112917]: pgmap v935: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:27.862 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:26 smithi052 ceph-mon[112917]: pgmap v936: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:29.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:28 smithi165 ceph-mon[82925]: pgmap v937: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:29.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:28 smithi052 ceph-mon[112917]: pgmap v937: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:31.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:30 smithi165 ceph-mon[82925]: pgmap v938: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:31.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:30 smithi052 ceph-mon[112917]: pgmap v938: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:33.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:32 smithi165 ceph-mon[82925]: pgmap v939: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:33.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:32 smithi052 ceph-mon[112917]: pgmap v939: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:35.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:34 smithi165 ceph-mon[82925]: pgmap v940: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:35.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:34 smithi052 ceph-mon[112917]: pgmap v940: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:37.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:36 smithi165 ceph-mon[82925]: pgmap v941: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:37.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:36 smithi052 ceph-mon[112917]: pgmap v941: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:38.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:37 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:38.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:37 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:39.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:38 smithi165 ceph-mon[82925]: pgmap v942: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:39.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:38 smithi052 ceph-mon[112917]: pgmap v942: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:41.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:40 smithi165 ceph-mon[82925]: pgmap v943: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:41.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:40 smithi052 ceph-mon[112917]: pgmap v943: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:43.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:42 smithi165 ceph-mon[82925]: pgmap v944: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:43.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:42 smithi052 ceph-mon[112917]: pgmap v944: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:45.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:44 smithi165 ceph-mon[82925]: pgmap v945: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:45.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:44 smithi052 ceph-mon[112917]: pgmap v945: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:47.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:46 smithi165 ceph-mon[82925]: pgmap v946: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:47.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:46 smithi052 ceph-mon[112917]: pgmap v946: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:49.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:48 smithi165 ceph-mon[82925]: pgmap v947: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:49.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:48 smithi052 ceph-mon[112917]: pgmap v947: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:51.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:50 smithi165 ceph-mon[82925]: pgmap v948: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:51.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:50 smithi052 ceph-mon[112917]: pgmap v948: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:52 smithi165 ceph-mon[82925]: pgmap v949: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:53.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:52 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:52 smithi052 ceph-mon[112917]: pgmap v949: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:53.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:52 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:15:55.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:54 smithi165 ceph-mon[82925]: pgmap v950: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:55.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:54 smithi052 ceph-mon[112917]: pgmap v950: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:57.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:56 smithi165 ceph-mon[82925]: pgmap v951: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:57.128 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:56 smithi052 ceph-mon[112917]: pgmap v951: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:15:59.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:15:58 smithi165 ceph-mon[82925]: pgmap v952: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:15:59.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:15:58 smithi052 ceph-mon[112917]: pgmap v952: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:01.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:00 smithi052 ceph-mon[112917]: pgmap v953: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:01.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:00 smithi165 ceph-mon[82925]: pgmap v953: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:03.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:02 smithi052 ceph-mon[112917]: pgmap v954: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:03.127 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:02 smithi165 ceph-mon[82925]: pgmap v954: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:05.127 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:04 smithi052 ceph-mon[112917]: pgmap v955: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:05.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:04 smithi165 ceph-mon[82925]: pgmap v955: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:07.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:06 smithi052 ceph-mon[112917]: pgmap v956: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:07.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:06 smithi165 ceph-mon[82925]: pgmap v956: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:08.128 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:07 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:08.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:07 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:09.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:08 smithi052 ceph-mon[112917]: pgmap v957: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:09.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:08 smithi165 ceph-mon[82925]: pgmap v957: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:11.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:10 smithi052 ceph-mon[112917]: pgmap v958: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:11.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:10 smithi165 ceph-mon[82925]: pgmap v958: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:12 smithi052 ceph-mon[112917]: pgmap v959: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:13.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:12 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:16:13.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:12 smithi165 ceph-mon[82925]: pgmap v959: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:13.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-06T15:16:13.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-06T15:16:13.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-06T15:16:13.326 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:12 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' 2024-09-06T15:16:15.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:14 smithi052 ceph-mon[112917]: pgmap v960: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:15.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:14 smithi165 ceph-mon[82925]: pgmap v960: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:17.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:16 smithi052 ceph-mon[112917]: pgmap v961: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:17.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:16 smithi165 ceph-mon[82925]: pgmap v961: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:19.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:18 smithi052 ceph-mon[112917]: pgmap v962: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:19.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:18 smithi165 ceph-mon[82925]: pgmap v962: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:21.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:20 smithi052 ceph-mon[112917]: pgmap v963: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:21.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:20 smithi165 ceph-mon[82925]: pgmap v963: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:23.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:22 smithi052 ceph-mon[112917]: pgmap v964: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:23.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:22 smithi052 ceph-mon[112917]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:22 smithi165 ceph-mon[82925]: pgmap v964: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:23.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:22 smithi165 ceph-mon[82925]: from='mgr.14764 172.21.15.52:0/4188433541' entity='mgr.smithi052.vsthpq' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-06T15:16:25.075 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:24 smithi165 ceph-mon[82925]: pgmap v965: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:25.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:24 smithi052 ceph-mon[112917]: pgmap v965: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:27.125 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:26 smithi052 ceph-mon[112917]: pgmap v966: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:27.325 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:26 smithi165 ceph-mon[82925]: pgmap v966: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:29.184 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-06T15:16:29.625 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-06T15:16:30.704 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-06T15:16:31.945 INFO:tasks.cephadm:Teardown begin 2024-09-06T15:16:31.967 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-06T15:16:32.623 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:16:32.912 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:28 smithi165 ceph-mon[82925]: pgmap v967: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:32.912 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:30 smithi165 ceph-mon[82925]: pgmap v968: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:32.912 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:28 smithi052 ceph-mon[112917]: pgmap v967: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:32.913 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:30 smithi052 ceph-mon[112917]: pgmap v968: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-06T15:16:33.178 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:16:33.212 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:32 smithi165 ceph-mon[82925]: pgmap v969: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:33.237 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-06T15:16:33.238 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-06T15:16:33.257 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-06T15:16:33.276 INFO:tasks.cephadm:Stopping all daemons... 2024-09-06T15:16:33.323 INFO:tasks.cephadm.mon.smithi052:Stopping mon.smithi052... 2024-09-06T15:16:33.332 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052 2024-09-06T15:16:33.358 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:32 smithi052 ceph-mon[112917]: pgmap v969: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-06T15:16:33.625 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:33 smithi052 systemd[1]: Stopping Ceph mon.smithi052 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:16:34.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:33 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T15:16:33.655+0000 7f505b10c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi052 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:16:34.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:33 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052[112913]: 2024-09-06T15:16:33.655+0000 7f505b10c640 -1 mon.smithi052@0(leader) e2 *** Got Signal Terminated *** 2024-09-06T15:16:34.126 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:33 smithi052 podman[161481]: 2024-09-06 15:16:33.71704151 +0000 UTC m=+0.179322654 container died 2a986cec59f7a194416fe5635e36a3900d9e51fa874d3f9e5673fa7c16aa34e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-06T15:16:34.528 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:34 smithi052 podman[161481]: 2024-09-06 15:16:34.344766078 +0000 UTC m=+0.807047210 container cleanup 2a986cec59f7a194416fe5635e36a3900d9e51fa874d3f9e5673fa7c16aa34e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-06T15:16:34.529 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:34 smithi052 bash[161481]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052 2024-09-06T15:16:34.779 INFO:journalctl@ceph.mon.smithi052.smithi052.stdout:Sep 06 15:16:34 smithi052 podman[161493]: 2024-09-06 15:16:34.529734074 +0000 UTC m=+0.809908650 container remove 2a986cec59f7a194416fe5635e36a3900d9e51fa874d3f9e5673fa7c16aa34e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi052, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-06T15:16:34.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi052.service' 2024-09-06T15:16:34.879 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:16:34.912 INFO:tasks.cephadm.mon.smithi052:Stopped mon.smithi052 2024-09-06T15:16:34.912 INFO:tasks.cephadm.mon.smithi165:Stopping mon.smithi165... 2024-09-06T15:16:34.913 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi165 2024-09-06T15:16:35.229 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:34 smithi165 systemd[1]: Stopping Ceph mon.smithi165 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:16:35.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:35 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165[82921]: 2024-09-06T15:16:35.228+0000 7fcc8075c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi165 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:16:35.575 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:35 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165[82921]: 2024-09-06T15:16:35.228+0000 7fcc8075c640 -1 mon.smithi165@1(peon) e2 *** Got Signal Terminated *** 2024-09-06T15:16:35.576 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:35 smithi165 podman[119230]: 2024-09-06 15:16:35.372589794 +0000 UTC m=+0.245666195 container died d1730548ae8d96a8c90ea78e86f082a3543efe4949203796fe0dcba909c69c94 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-06T15:16:36.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:35 smithi165 podman[119230]: 2024-09-06 15:16:35.829583326 +0000 UTC m=+0.702659725 container cleanup d1730548ae8d96a8c90ea78e86f082a3543efe4949203796fe0dcba909c69c94 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T15:16:36.077 INFO:journalctl@ceph.mon.smithi165.smithi165.stdout:Sep 06 15:16:35 smithi165 bash[119230]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-mon-smithi165 2024-09-06T15:16:36.315 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@mon.smithi165.service' 2024-09-06T15:16:36.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:16:36.362 INFO:tasks.cephadm.mon.smithi165:Stopped mon.smithi165 2024-09-06T15:16:36.362 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-06T15:16:36.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.0 2024-09-06T15:16:36.655 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:36 smithi052 systemd[1]: Stopping Ceph osd.0 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:16:37.126 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:36 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[122168]: 2024-09-06T15:16:36.678+0000 7f02e68dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:16:37.126 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:36 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[122168]: 2024-09-06T15:16:36.678+0000 7f02e68dc640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-06T15:16:37.126 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:36 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0[122168]: 2024-09-06T15:16:36.678+0000 7f02e68dc640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:16:42.475 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:42 smithi052 podman[161614]: 2024-09-06 15:16:42.180759216 +0000 UTC m=+5.624046429 container died a2f3778f51c7acdf4bc46fb037dac99cac25e9e52b5e6fa75e0209167c1f53e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T15:16:42.792 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:42 smithi052 podman[161614]: 2024-09-06 15:16:42.591685175 +0000 UTC m=+6.034972386 container cleanup a2f3778f51c7acdf4bc46fb037dac99cac25e9e52b5e6fa75e0209167c1f53e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T15:16:42.792 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:42 smithi052 bash[161614]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0 2024-09-06T15:16:43.125 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:42 smithi052 podman[161640]: 2024-09-06 15:16:42.793166335 +0000 UTC m=+0.612021212 container remove a2f3778f51c7acdf4bc46fb037dac99cac25e9e52b5e6fa75e0209167c1f53e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-06T15:16:43.521 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:43 smithi052 podman[161728]: 2024-09-06 15:16:43.123649176 +0000 UTC m=+0.016173758 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T15:16:43.521 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:43 smithi052 podman[161728]: 2024-09-06 15:16:43.28595469 +0000 UTC m=+0.178479267 container create 6c4998b391da680bf41cdddd7e8b8b2604b13f1c1448226111e7b505862abdb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T15:16:43.521 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:43 smithi052 podman[161728]: 2024-09-06 15:16:43.522148017 +0000 UTC m=+0.414672597 container init 6c4998b391da680bf41cdddd7e8b8b2604b13f1c1448226111e7b505862abdb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-06T15:16:43.876 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:43 smithi052 podman[161728]: 2024-09-06 15:16:43.525706425 +0000 UTC m=+0.418231005 container start 6c4998b391da680bf41cdddd7e8b8b2604b13f1c1448226111e7b505862abdb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T15:16:43.876 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:43 smithi052 podman[161728]: 2024-09-06 15:16:43.613941068 +0000 UTC m=+0.506465648 container attach 6c4998b391da680bf41cdddd7e8b8b2604b13f1c1448226111e7b505862abdb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-06T15:16:43.876 INFO:journalctl@ceph.osd.0.smithi052.stdout:Sep 06 15:16:43 smithi052 podman[161728]: 2024-09-06 15:16:43.71471723 +0000 UTC m=+0.607241807 container died 6c4998b391da680bf41cdddd7e8b8b2604b13f1c1448226111e7b505862abdb6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T15:16:44.294 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.0.service' 2024-09-06T15:16:44.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:16:44.336 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-06T15:16:44.337 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-06T15:16:44.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.1 2024-09-06T15:16:44.626 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:44 smithi052 systemd[1]: Stopping Ceph osd.1 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:16:45.126 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[128090]: 2024-09-06T15:16:44.650+0000 7fa94f3aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:16:45.126 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[128090]: 2024-09-06T15:16:44.650+0000 7fa94f3aa640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-06T15:16:45.126 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:44 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1[128090]: 2024-09-06T15:16:44.650+0000 7fa94f3aa640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:16:50.371 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:50 smithi052 podman[161831]: 2024-09-06 15:16:50.090031485 +0000 UTC m=+5.529269814 container died 05161933d9e13ea4f92b540e231192afde56297646ff460b22311e9d8fe88950 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T15:16:50.625 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:50 smithi052 podman[161831]: 2024-09-06 15:16:50.470887836 +0000 UTC m=+5.910126164 container cleanup 05161933d9e13ea4f92b540e231192afde56297646ff460b22311e9d8fe88950 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-06T15:16:50.626 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:50 smithi052 bash[161831]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1 2024-09-06T15:16:51.092 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:50 smithi052 podman[161846]: 2024-09-06 15:16:50.764020323 +0000 UTC m=+0.672781728 container remove 05161933d9e13ea4f92b540e231192afde56297646ff460b22311e9d8fe88950 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T15:16:51.376 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:51 smithi052 podman[161932]: 2024-09-06 15:16:50.995806838 +0000 UTC m=+0.016259561 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T15:16:51.376 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:51 smithi052 podman[161932]: 2024-09-06 15:16:51.106716769 +0000 UTC m=+0.127169517 container create e036a6bc527d62cd2b198e1e901da085c02f904f4ddaad4bca77712c84ff11d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-06T15:16:51.376 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:51 smithi052 podman[161932]: 2024-09-06 15:16:51.334157831 +0000 UTC m=+0.354610546 container init e036a6bc527d62cd2b198e1e901da085c02f904f4ddaad4bca77712c84ff11d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33) 2024-09-06T15:16:51.376 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:51 smithi052 podman[161932]: 2024-09-06 15:16:51.337420286 +0000 UTC m=+0.357872992 container start e036a6bc527d62cd2b198e1e901da085c02f904f4ddaad4bca77712c84ff11d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-06T15:16:51.838 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:51 smithi052 podman[161932]: 2024-09-06 15:16:51.434340957 +0000 UTC m=+0.454793672 container attach e036a6bc527d62cd2b198e1e901da085c02f904f4ddaad4bca77712c84ff11d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-06T15:16:51.838 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:51 smithi052 podman[161932]: 2024-09-06 15:16:51.534018537 +0000 UTC m=+0.554471249 container died e036a6bc527d62cd2b198e1e901da085c02f904f4ddaad4bca77712c84ff11d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-06T15:16:52.085 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.1.service' 2024-09-06T15:16:52.109 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:52 smithi052 podman[161955]: 2024-09-06 15:16:52.06304795 +0000 UTC m=+0.522867938 container remove e036a6bc527d62cd2b198e1e901da085c02f904f4ddaad4bca77712c84ff11d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T15:16:52.109 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:52 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-06T15:16:52.110 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:52 smithi052 systemd[1]: Stopped Ceph osd.1 for 14ffcc96-6c5d-11ef-bce4-c7b262605968. 2024-09-06T15:16:52.110 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 06 15:16:52 smithi052 systemd[1]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.1.service: Consumed 14.536s CPU time. 2024-09-06T15:16:52.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:16:52.126 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-06T15:16:52.126 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-06T15:16:52.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.2 2024-09-06T15:16:52.390 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:52 smithi052 systemd[1]: Stopping Ceph osd.2 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:16:52.875 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:52 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[133862]: 2024-09-06T15:16:52.473+0000 7f5e68d2e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:16:52.875 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:52 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[133862]: 2024-09-06T15:16:52.473+0000 7f5e68d2e640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-06T15:16:52.876 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:52 smithi052 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2[133862]: 2024-09-06T15:16:52.473+0000 7f5e68d2e640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:16:58.268 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:57 smithi052 podman[162035]: 2024-09-06 15:16:57.998256903 +0000 UTC m=+5.651479074 container died b669d4c32bf679c0b02a32c759db6667812a8493954f45dc420144b68a56ceba (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-06T15:16:58.626 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:58 smithi052 podman[162035]: 2024-09-06 15:16:58.358450438 +0000 UTC m=+6.011672607 container cleanup b669d4c32bf679c0b02a32c759db6667812a8493954f45dc420144b68a56ceba (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-06T15:16:58.626 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:58 smithi052 bash[162035]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2 2024-09-06T15:16:58.981 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:58 smithi052 podman[162050]: 2024-09-06 15:16:58.634894962 +0000 UTC m=+0.639768570 container remove b669d4c32bf679c0b02a32c759db6667812a8493954f45dc420144b68a56ceba (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-06T15:16:59.262 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:58 smithi052 podman[162139]: 2024-09-06 15:16:58.885379091 +0000 UTC m=+0.016818073 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T15:16:59.263 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:59 smithi052 podman[162139]: 2024-09-06 15:16:59.036073098 +0000 UTC m=+0.167512071 container create 62e1439c409f55de66253f9165cc036c37f5c2a61c7bcaa9a8f8656545dcebd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-06T15:16:59.263 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:59 smithi052 podman[162139]: 2024-09-06 15:16:59.263757414 +0000 UTC m=+0.395196404 container init 62e1439c409f55de66253f9165cc036c37f5c2a61c7bcaa9a8f8656545dcebd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T15:16:59.626 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:59 smithi052 podman[162139]: 2024-09-06 15:16:59.267078829 +0000 UTC m=+0.398517800 container start 62e1439c409f55de66253f9165cc036c37f5c2a61c7bcaa9a8f8656545dcebd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-06T15:16:59.626 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:59 smithi052 podman[162139]: 2024-09-06 15:16:59.355296657 +0000 UTC m=+0.486735646 container attach 62e1439c409f55de66253f9165cc036c37f5c2a61c7bcaa9a8f8656545dcebd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-06T15:16:59.626 INFO:journalctl@ceph.osd.2.smithi052.stdout:Sep 06 15:16:59 smithi052 podman[162139]: 2024-09-06 15:16:59.458344259 +0000 UTC m=+0.589783233 container died 62e1439c409f55de66253f9165cc036c37f5c2a61c7bcaa9a8f8656545dcebd6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-06T15:17:00.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.2.service' 2024-09-06T15:17:00.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:17:00.102 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-06T15:17:00.102 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-06T15:17:00.103 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.3 2024-09-06T15:17:00.406 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:00 smithi165 systemd[1]: Stopping Ceph osd.3 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:17:00.914 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:00 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[91411]: 2024-09-06T15:17:00.406+0000 7f7c7bacd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:17:00.914 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:00 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[91411]: 2024-09-06T15:17:00.406+0000 7f7c7bacd640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-06T15:17:00.914 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:00 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[91411]: 2024-09-06T15:17:00.406+0000 7f7c7bacd640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:17:04.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:03 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:03.901+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:04.942 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:04 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3[91411]: 2024-09-06T15:17:04.759+0000 7f7c780e2640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:39.003335+0000 front 2024-09-06T15:16:39.003368+0000 (oldest deadline 2024-09-06T15:17:04.203614+0000) 2024-09-06T15:17:05.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:04 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:04.942+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:06.075 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:05 smithi165 podman[119354]: 2024-09-06 15:17:05.799531875 +0000 UTC m=+5.500442403 container died cc36f08fa3aec44c37b8578eaf2c5131a73bb29f02c8f696b0aaaead76c2d730 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-06T15:17:06.075 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:05 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:05.900+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:06.439 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:06 smithi165 podman[119354]: 2024-09-06 15:17:06.214375271 +0000 UTC m=+5.915285809 container cleanup cc36f08fa3aec44c37b8578eaf2c5131a73bb29f02c8f696b0aaaead76c2d730 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-06T15:17:06.439 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:06 smithi165 bash[119354]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3 2024-09-06T15:17:06.773 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:06 smithi165 podman[119383]: 2024-09-06 15:17:06.440585806 +0000 UTC m=+0.635133228 container remove cc36f08fa3aec44c37b8578eaf2c5131a73bb29f02c8f696b0aaaead76c2d730 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-06T15:17:07.075 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:06 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:06.873+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:07.075 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:06 smithi165 podman[119468]: 2024-09-06 15:17:06.676721988 +0000 UTC m=+0.015766526 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T15:17:07.075 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:06 smithi165 podman[119468]: 2024-09-06 15:17:06.775005551 +0000 UTC m=+0.114050067 container create b0fb83b6979c1d5e10417a3182188e9ab6d95efa7647ee5daf7b9c9bb2f29096 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-06T15:17:07.076 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:07 smithi165 podman[119468]: 2024-09-06 15:17:07.010901577 +0000 UTC m=+0.349946095 container init b0fb83b6979c1d5e10417a3182188e9ab6d95efa7647ee5daf7b9c9bb2f29096 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-06T15:17:07.076 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:07 smithi165 podman[119468]: 2024-09-06 15:17:07.014267802 +0000 UTC m=+0.353312324 container start b0fb83b6979c1d5e10417a3182188e9ab6d95efa7647ee5daf7b9c9bb2f29096 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T15:17:07.555 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:07 smithi165 podman[119468]: 2024-09-06 15:17:07.116583103 +0000 UTC m=+0.455627741 container attach b0fb83b6979c1d5e10417a3182188e9ab6d95efa7647ee5daf7b9c9bb2f29096 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.license=GPLv2) 2024-09-06T15:17:07.555 INFO:journalctl@ceph.osd.3.smithi165.stdout:Sep 06 15:17:07 smithi165 podman[119468]: 2024-09-06 15:17:07.20495707 +0000 UTC m=+0.544001598 container died b0fb83b6979c1d5e10417a3182188e9ab6d95efa7647ee5daf7b9c9bb2f29096 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-06T15:17:07.556 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:07 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:07.196+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.132724+0000 front 2024-09-06T15:16:41.132644+0000 (oldest deadline 2024-09-06T15:17:06.432449+0000) 2024-09-06T15:17:07.896 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.3.service' 2024-09-06T15:17:07.937 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:17:07.937 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-06T15:17:07.937 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-06T15:17:07.937 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.4 2024-09-06T15:17:08.193 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:07 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:07.902+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:08.193 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:08 smithi165 systemd[1]: Stopping Ceph osd.4 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:17:08.194 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:08 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:08.193+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.132724+0000 front 2024-09-06T15:16:41.132644+0000 (oldest deadline 2024-09-06T15:17:06.432449+0000) 2024-09-06T15:17:08.575 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:08 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:08.301+0000 7ff96285a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:17:08.575 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:08 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:08.301+0000 7ff96285a640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-06T15:17:08.575 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:08 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:08.301+0000 7ff96285a640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:17:09.206 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:08 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:08.882+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:09.575 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:09 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:09.207+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.132724+0000 front 2024-09-06T15:16:41.132644+0000 (oldest deadline 2024-09-06T15:17:06.432449+0000) 2024-09-06T15:17:10.177 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:09 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:09.924+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:10.512 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:10 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:10.178+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.132724+0000 front 2024-09-06T15:16:41.132644+0000 (oldest deadline 2024-09-06T15:17:06.432449+0000) 2024-09-06T15:17:11.328 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:11 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:11.172+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.132724+0000 front 2024-09-06T15:16:41.132644+0000 (oldest deadline 2024-09-06T15:17:06.432449+0000) 2024-09-06T15:17:11.329 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:10 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:10.940+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:11.329 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:10 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:10.940+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:12.325 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:12 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:12.145+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.132724+0000 front 2024-09-06T15:16:41.132644+0000 (oldest deadline 2024-09-06T15:17:06.432449+0000) 2024-09-06T15:17:12.326 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:11 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:11.964+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:12.326 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:11 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:11.964+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:13.325 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:13 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:13.141+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.132724+0000 front 2024-09-06T15:16:41.132644+0000 (oldest deadline 2024-09-06T15:17:06.432449+0000) 2024-09-06T15:17:13.325 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:13 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4[96753]: 2024-09-06T15:17:13.141+0000 7ff95ae67640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:47.533501+0000 front 2024-09-06T15:16:47.533606+0000 (oldest deadline 2024-09-06T15:17:12.233438+0000) 2024-09-06T15:17:13.326 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:12 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:12.941+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:13.326 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:12 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:12.941+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:14.069 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:13 smithi165 podman[119572]: 2024-09-06 15:17:13.772035826 +0000 UTC m=+5.605485857 container died 81f6b343a244b87c33adb43608bfe531d2bee72e21ca272c9057da417125cdf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-06T15:17:14.069 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:13 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:13.914+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:14.069 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:13 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:13.914+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:14.325 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:14 smithi165 podman[119572]: 2024-09-06 15:17:14.168152307 +0000 UTC m=+6.001602340 container cleanup 81f6b343a244b87c33adb43608bfe531d2bee72e21ca272c9057da417125cdf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-06T15:17:14.325 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:14 smithi165 bash[119572]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4 2024-09-06T15:17:14.740 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:14 smithi165 podman[119587]: 2024-09-06 15:17:14.344269415 +0000 UTC m=+0.568784737 container remove 81f6b343a244b87c33adb43608bfe531d2bee72e21ca272c9057da417125cdf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-06T15:17:14.991 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:14 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:14.943+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:14.991 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:14 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:14.943+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:14.992 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:14 smithi165 podman[119678]: 2024-09-06 15:17:14.643963398 +0000 UTC m=+0.015617766 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T15:17:14.992 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:14 smithi165 podman[119678]: 2024-09-06 15:17:14.753284179 +0000 UTC m=+0.124938543 container create e7c9227f0c9ae290845053c088248c1d0ab24a0f7599e9798bc7b1f24e7ae1f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731) 2024-09-06T15:17:14.992 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:14 smithi165 podman[119678]: 2024-09-06 15:17:14.989030921 +0000 UTC m=+0.360685285 container init e7c9227f0c9ae290845053c088248c1d0ab24a0f7599e9798bc7b1f24e7ae1f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-06T15:17:14.992 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:14 smithi165 podman[119678]: 2024-09-06 15:17:14.992476192 +0000 UTC m=+0.364130557 container start e7c9227f0c9ae290845053c088248c1d0ab24a0f7599e9798bc7b1f24e7ae1f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-06T15:17:15.326 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:15 smithi165 podman[119678]: 2024-09-06 15:17:15.097483205 +0000 UTC m=+0.469137581 container attach e7c9227f0c9ae290845053c088248c1d0ab24a0f7599e9798bc7b1f24e7ae1f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-06T15:17:15.326 INFO:journalctl@ceph.osd.4.smithi165.stdout:Sep 06 15:17:15 smithi165 podman[119678]: 2024-09-06 15:17:15.179339267 +0000 UTC m=+0.550993632 container died e7c9227f0c9ae290845053c088248c1d0ab24a0f7599e9798bc7b1f24e7ae1f6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-06T15:17:15.850 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.4.service' 2024-09-06T15:17:15.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:17:15.889 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-06T15:17:15.889 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-06T15:17:15.889 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.5 2024-09-06T15:17:16.075 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:15 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:15.969+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:16.075 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:15 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:15.969+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:16.076 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:15 smithi165 systemd[1]: Stopping Ceph osd.5 for 14ffcc96-6c5d-11ef-bce4-c7b262605968... 2024-09-06T15:17:16.575 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:16 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:16.204+0000 7f7c62bfd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-06T15:17:16.575 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:16 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:16.204+0000 7f7c62bfd640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-06T15:17:16.575 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:16 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:16.204+0000 7f7c62bfd640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-06T15:17:17.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:16 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:16.983+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:17.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:16 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:16.983+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:18.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:17 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:17.970+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:18.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:17 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:17.970+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:19.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:18 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:18.975+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:19.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:18 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:18.975+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:20.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:19 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:19.989+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:20.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:19 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:19.989+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:20.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:19 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:19.989+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6822 osd.2 since back 2024-09-06T15:16:54.478818+0000 front 2024-09-06T15:16:54.478839+0000 (oldest deadline 2024-09-06T15:17:19.778800+0000) 2024-09-06T15:17:21.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:20 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:20.953+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6806 osd.0 since back 2024-09-06T15:16:41.276313+0000 front 2024-09-06T15:16:41.276507+0000 (oldest deadline 2024-09-06T15:17:02.976249+0000) 2024-09-06T15:17:21.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:20 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:20.953+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6814 osd.1 since back 2024-09-06T15:16:45.277244+0000 front 2024-09-06T15:16:45.277323+0000 (oldest deadline 2024-09-06T15:17:10.477679+0000) 2024-09-06T15:17:21.326 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:20 smithi165 ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5[102107]: 2024-09-06T15:17:20.953+0000 7f7c5f212640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.52:6822 osd.2 since back 2024-09-06T15:16:54.478818+0000 front 2024-09-06T15:16:54.478839+0000 (oldest deadline 2024-09-06T15:17:19.778800+0000) 2024-09-06T15:17:21.988 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:21 smithi165 podman[119782]: 2024-09-06 15:17:21.709735506 +0000 UTC m=+5.596370557 container died 04da38e02cd880560530fab63b2d44eec34e4fec6e68950108a8ef04555bb38c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-06T15:17:22.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:22 smithi165 podman[119782]: 2024-09-06 15:17:22.095129581 +0000 UTC m=+5.981764642 container cleanup 04da38e02cd880560530fab63b2d44eec34e4fec6e68950108a8ef04555bb38c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-06T15:17:22.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:22 smithi165 bash[119782]: ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5 2024-09-06T15:17:22.713 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:22 smithi165 podman[119801]: 2024-09-06 15:17:22.379640508 +0000 UTC m=+0.663403645 container remove 04da38e02cd880560530fab63b2d44eec34e4fec6e68950108a8ef04555bb38c (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-06T15:17:23.023 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:22 smithi165 podman[119889]: 2024-09-06 15:17:22.617284996 +0000 UTC m=+0.016254994 image pull 1c45aca0610a312233aa2613f7b416b2884ae14779f1297041485ab28f1c8110 quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30 2024-09-06T15:17:23.023 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:22 smithi165 podman[119889]: 2024-09-06 15:17:22.739041423 +0000 UTC m=+0.138011409 container create 5c6d48e357a0ece95f2a09518b0be43d4b0848449595df72d4fdd5a17a94a3d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-06T15:17:23.023 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:22 smithi165 podman[119889]: 2024-09-06 15:17:22.941412314 +0000 UTC m=+0.340382298 container init 5c6d48e357a0ece95f2a09518b0be43d4b0848449595df72d4fdd5a17a94a3d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-06T15:17:23.024 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:22 smithi165 podman[119889]: 2024-09-06 15:17:22.944724451 +0000 UTC m=+0.343694436 container start 5c6d48e357a0ece95f2a09518b0be43d4b0848449595df72d4fdd5a17a94a3d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-06T15:17:23.024 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:23 smithi165 podman[119889]: 2024-09-06 15:17:23.024609828 +0000 UTC m=+0.423579813 container attach 5c6d48e357a0ece95f2a09518b0be43d4b0848449595df72d4fdd5a17a94a3d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-06T15:17:23.325 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 06 15:17:23 smithi165 podman[119889]: 2024-09-06 15:17:23.13460958 +0000 UTC m=+0.533579566 container died 5c6d48e357a0ece95f2a09518b0be43d4b0848449595df72d4fdd5a17a94a3d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c86edd48571ab22373283621eb9feebce9df9c291d4164cfc4df1a09493e1f30, name=ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-athakkar-testing-2024-09-04-1837-8b38c33, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-06T15:17:23.744 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-14ffcc96-6c5d-11ef-bce4-c7b262605968@osd.5.service' 2024-09-06T15:17:23.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-06T15:17:23.784 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-06T15:17:23.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 --force --keep-logs 2024-09-06T15:17:23.995 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T15:17:28.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi052.stderr:ceph-fuse[77835]: fuse finished with error 0 and tester_r 0 2024-09-06T15:17:51.126 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 --force --keep-logs 2024-09-06T15:17:51.332 INFO:teuthology.orchestra.run.smithi165.stdout:Deleting cluster with fsid: 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T15:18:05.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:18:05.608 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-06T15:18:05.675 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-06T15:18:05.888 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365/remote/smithi052/crash 2024-09-06T15:18:05.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash -- . 2024-09-06T15:18:06.223 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash: Cannot open: No such file or directory 2024-09-06T15:18:06.225 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2024-09-06T15:18:06.261 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365/remote/smithi165/crash 2024-09-06T15:18:06.263 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash -- . 2024-09-06T15:18:06.305 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/crash: Cannot open: No such file or directory 2024-09-06T15:18:06.306 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now 2024-09-06T15:18:06.307 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-06T15:18:06.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-06T15:18:06.396 INFO:teuthology.orchestra.run.smithi052.stdout:2024-09-06T14:43:58.996159+0000 mgr.smithi165.hcexoi (mgr.24363) 1 : cluster [ERR] Failed to load ceph-mgr modules: volumes 2024-09-06T15:18:06.413 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-06T15:18:06.413 INFO:tasks.cephadm:Compressing logs... 2024-09-06T15:18:06.413 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-06T15:18:06.439 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-06T15:18:06.463 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2024-09-06T15:18:06.463 INFO:teuthology.orchestra.run.smithi052.stderr: -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.0.log 2024-09-06T15:18:06.463 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.1.log 2024-09-06T15:18:06.463 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mon.smithi052.log 2024-09-06T15:18:06.463 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.0.log: /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-volume.log 2024-09-06T15:18:06.463 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mon.smithi052.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.audit.log 2024-09-06T15:18:06.464 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.cephadm.log 2024-09-06T15:18:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi165.nmjcsh.log 2024-09-06T15:18:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:: No such file or directory 2024-09-06T15:18:06.465 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-volume.log 2024-09-06T15:18:06.466 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.4.log 2024-09-06T15:18:06.466 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi165.nmjcsh.log: /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi165.zpunux.log 2024-09-06T15:18:06.466 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.audit.log 2024-09-06T15:18:06.466 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi165.zpunux.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mgr.smithi165.hcexoi.log 2024-09-06T15:18:06.467 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.2.log 2024-09-06T15:18:06.467 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.cephadm.log: /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.2.log: 86.4% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.cephadm.log.gz 2024-09-06T15:18:06.468 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi052.dfprfm.log 2024-09-06T15:18:06.468 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.log 2024-09-06T15:18:06.469 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mon.smithi165.log 2024-09-06T15:18:06.469 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mgr.smithi165.hcexoi.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.cephadm.log 2024-09-06T15:18:06.469 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi052.dfprfm.log: 91.5% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.audit.log.gz 2024-09-06T15:18:06.471 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mon.smithi165.log: 91.6% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.audit.log.gz 2024-09-06T15:18:06.480 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.5.log 2024-09-06T15:18:06.482 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mgr.smithi052.vsthpq.log 2024-09-06T15:18:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.cephadm.log: 84.9% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.cephadm.log.gz 2024-09-06T15:18:06.482 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.log 2024-09-06T15:18:06.485 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.log: 89.2% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.log.gz 2024-09-06T15:18:06.487 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.5.log: 91.0% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-volume.log.gz 2024-09-06T15:18:06.487 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-client.ceph-exporter.smithi165.log 2024-09-06T15:18:06.488 INFO:teuthology.orchestra.run.smithi052.stderr: 91.1% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-volume.log.gz 2024-09-06T15:18:06.489 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-client.ceph-exporter.smithi052.log 2024-09-06T15:18:06.489 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mgr.smithi052.vsthpq.log: gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi052.eqtxfx.log 2024-09-06T15:18:06.492 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.log: 89.2% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph.log.gz 2024-09-06T15:18:06.493 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.3.log 2024-09-06T15:18:06.494 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-client.ceph-exporter.smithi052.log: 94.3% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-client.ceph-exporter.smithi052.log.gz 2024-09-06T15:18:06.494 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-06T15:18:06.496 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-client.ceph-exporter.smithi165.log: 94.3% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-client.ceph-exporter.smithi165.log.gz 2024-09-06T15:18:06.497 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-06T15:18:06.508 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi052.eqtxfx.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-06T15:18:06.516 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-06T15:18:06.520 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.1.log: 89.4% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mgr.smithi165.hcexoi.log.gz 2024-09-06T15:18:06.535 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-06T15:18:06.568 INFO:teuthology.orchestra.run.smithi165.stderr: 94.6% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi165.zpunux.log.gz 2024-09-06T15:18:06.591 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-06T15:18:07.128 INFO:teuthology.orchestra.run.smithi165.stderr: 92.5% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mon.smithi165.log.gz 2024-09-06T15:18:07.187 INFO:teuthology.orchestra.run.smithi052.stderr: 89.8% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mgr.smithi052.vsthpq.log.gz 2024-09-06T15:18:08.531 INFO:teuthology.orchestra.run.smithi052.stderr: 90.1% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mon.smithi052.log.gz 2024-09-06T15:18:10.790 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.4.log.gz 2024-09-06T15:18:11.646 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.5.log.gz 2024-09-06T15:18:13.023 INFO:teuthology.orchestra.run.smithi052.stderr: 93.8% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.2.log.gz 2024-09-06T15:18:13.422 INFO:teuthology.orchestra.run.smithi165.stderr: 93.8% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.3.log.gz 2024-09-06T15:18:13.601 INFO:teuthology.orchestra.run.smithi052.stderr: 93.7% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.0.log.gz 2024-09-06T15:18:14.163 INFO:teuthology.orchestra.run.smithi165.stderr: 94.9% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi165.nmjcsh.log.gz 2024-09-06T15:18:14.248 INFO:teuthology.orchestra.run.smithi052.stderr: 93.8% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-osd.1.log.gz 2024-09-06T15:18:20.739 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-06T15:18:20.739 INFO:teuthology.orchestra.run.smithi165.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-06T15:18:20.741 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-06T15:18:20.741 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m14.287s 2024-09-06T15:18:20.741 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m37.946s 2024-09-06T15:18:20.741 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m1.180s 2024-09-06T15:18:20.944 INFO:teuthology.orchestra.run.smithi052.stderr: 94.9% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi052.dfprfm.log.gz 2024-09-06T15:18:21.853 INFO:teuthology.orchestra.run.smithi052.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-06T15:19:54.444 INFO:teuthology.orchestra.run.smithi052.stderr: 92.9% -- replaced with /var/log/ceph/14ffcc96-6c5d-11ef-bce4-c7b262605968/ceph-mds.cephfs.smithi052.eqtxfx.log.gz 2024-09-06T15:19:54.446 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-06T15:19:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:real 1m47.993s 2024-09-06T15:19:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:user 2m36.672s 2024-09-06T15:19:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m4.442s 2024-09-06T15:19:54.446 INFO:tasks.cephadm:Archiving logs... 2024-09-06T15:19:54.492 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365/remote/smithi052/log 2024-09-06T15:19:54.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-06T15:20:37.014 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365/remote/smithi165/log 2024-09-06T15:20:37.018 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-06T15:20:42.451 INFO:tasks.cephadm:Removing cluster... 2024-09-06T15:20:42.452 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 --force 2024-09-06T15:20:42.740 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T15:20:43.077 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 14ffcc96-6c5d-11ef-bce4-c7b262605968 --force 2024-09-06T15:20:43.281 INFO:teuthology.orchestra.run.smithi165.stdout:Deleting cluster with fsid: 14ffcc96-6c5d-11ef-bce4-c7b262605968 2024-09-06T15:20:43.561 INFO:tasks.cephadm:Removing cephadm ... 2024-09-06T15:20:43.562 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-06T15:20:43.579 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-06T15:20:43.635 INFO:tasks.cephadm:Teardown complete 2024-09-06T15:20:43.722 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-06T15:20:43.915 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-06T15:20:44.687 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-06T15:20:44.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-06T15:20:44.742 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-06T15:20:48.428 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-06T15:20:48.445 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-06T15:20:48.486 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T15:20:48.522 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-06T15:20:48.523 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-06T15:20:48.524 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-06T15:20:48.524 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-06T15:20:48.524 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 7 377 7 +574us[ +571us] +/- 37ms 2024-09-06T15:20:48.524 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -906us[ -910us] +/- 74ms 2024-09-06T15:20:48.524 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 -154us[ -158us] +/- 84ms 2024-09-06T15:20:48.524 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T15:20:48.540 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-06T15:20:48.544 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-06T15:20:48.545 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-06T15:20:48.545 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 +602us[ +608us] +/- 37ms 2024-09-06T15:20:48.545 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 16 -897us[ -891us] +/- 74ms 2024-09-06T15:20:48.545 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 12 -93us[ -88us] +/- 84ms 2024-09-06T15:20:48.545 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-06T15:20:48.548 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-06T15:20:48.661 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-06T15:20:48.795 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-06T15:20:48.819 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-06T15:20:48.910 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-06T15:20:48.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-06T15:20:49.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T15:20:49.023 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-06T15:20:49.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T15:20:49.066 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-06T15:20:49.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-06T15:20:49.118 INFO:teuthology.task.internal:Duration was 3147.687505 seconds 2024-09-06T15:20:49.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-06T15:20:49.766 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-06T15:20:49.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-06T15:20:49.784 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-06T15:20:49.828 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-06T15:20:49.830 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-06T15:20:50.172 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-06T15:20:50.172 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-06T15:20:50.173 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-06T15:20:50.195 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-06T15:20:50.195 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-06T15:20:50.222 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-06T15:20:50.224 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-06T15:20:50.238 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-06T15:20:50.291 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-06T15:20:50.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-06T15:20:50.306 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-06T15:20:51.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-06T15:20:51.332 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-06T15:20:51.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-06T15:20:51.363 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-06T15:20:51.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-06T15:20:51.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:20:51.426 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:20:51.446 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-06T15:20:51.461 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-06T15:20:51.481 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:20:51.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T15:20:51.549 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-06T15:20:51.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T15:20:51.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-06T15:20:51.581 INFO:teuthology.task.internal:Transferring archived files... 2024-09-06T15:20:52.177 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365/remote/smithi052 2024-09-06T15:20:52.177 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-06T15:20:52.240 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/adking-2024-09-06_13:43:09-orch:cephadm-wip-athakkar-testing-2024-09-04-1837-distro-default-smithi/7892365/remote/smithi165 2024-09-06T15:20:52.240 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-06T15:20:52.285 INFO:teuthology.task.internal:Removing archive directory... 2024-09-06T15:20:52.285 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-06T15:20:52.287 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-06T15:20:52.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-06T15:20:52.364 INFO:teuthology.task.internal:Not uploading archives. 2024-09-06T15:20:52.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-06T15:20:52.394 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-06T15:20:52.395 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-06T15:20:52.397 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-06T15:20:52.411 INFO:teuthology.orchestra.run.smithi052.stdout: 262217 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 6 15:20 /home/ubuntu/cephtest 2024-09-06T15:20:52.411 INFO:teuthology.orchestra.run.smithi052.stdout: 549090 4 d--------- 2 ubuntu ubuntu 4096 Sep 6 14:42 /home/ubuntu/cephtest/mnt.0 2024-09-06T15:20:52.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-06T15:20:52.412 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-06T15:20:52.412 INFO:teuthology.orchestra.run.smithi052.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-06T15:20:52.413 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_8b38c33cecf4b0b7a9b3116eb9089e21e444ac73/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-06T15:20:52.430 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-06T15:20:52.442 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-06T15:20:52.907 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-06T15:20:53.014 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 3147.68750500679 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_adking@teuthology status: fail success: false 2024-09-06T15:20:53.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-06T15:20:55.172 INFO:teuthology.run:FAIL